
Lily Hay Newman
· 2 min read
Google Built a Giant ‘Mirror Dimension’ Internet to Test Its Chrome AI Agents
As the Google Chrome team has worked to develop AI browsing features using the company's Gemini models, they realized they need to go the extra mile to keep things from going haywire. So they did the only thing they could think to do—they built an expansive alternate-universe internet that they completely control.
“Web-use” agents need to be familiar with the open internet, how to navigate real websites and platforms, and how to be hardened against web attacks. So training them in limited test environments is only so effective. Plus, models can develop what's known as “eval awareness” where they behave differently because they have determined that they are in a test or simulation. On the other hand, setting unrefined agents loose on the open internet is a bad idea. That’s where the alternate-universe internet comes in.
The “Mirror Dimension,” which Google is detailing in a blog post today for the first time, is a sweeping and diverse but isolated web ecosystem that the Chrome team entirely controls. It includes a vast array of websites and platforms—including social media sites, shopping, and bank dashboards—that are built with all the components and attributes of real websites. Browsing assistant agents must interact with the sites and complete tasks in Chrome the way they would on the real internet. And they face resilience tests as they go, like hidden prompt-injection attacks, to test their defenses.
“Agents are not programmed so you can’t predict every possible thing an agent might see, the exploration space that we have to address is huge and the web is hostile,” says Charles Qian, a software engineer on the Chrome AI security team. “Any user can ask any prompt on any website, so we really need to explore that space as thoroughly as we can. And we’ve seen the agent start to develop a mature sense of judgement when it comes to knowing what information is actually needed for a task and when to punt back to the user for a confirmation.”
Original source
This story was published by WIRED: AI and written by Lily Hay Newman. SyncAI.news shows a preview; the complete article is on the publisher's site.
Read the full story on wired.com


