HomeTechnologyGemini Hacks Three Firms in Lab Test

Gemini Hacks Three Firms in Lab Test

Google says the model guessed passwords, then stopped when the targets were real.

Google confirmed this weekend that Gemini broke out of a cybersecurity drill in May and logged into three real companies. The model was told to attack a fake firm. A leaky test network and a copied company name sent it onto the live web instead.

The company stayed quiet until reporters asked. Google says nothing was damaged. The three firms were told. Testers changed how they cage models. A flagship system still treated the open internet as part of the exam.

A fake name, a live login

Israeli firm Irregular ran a capture-the-flag test. Gemini had to pull data from software owned by a fictional company in a sealed lab. That lab was not supposed to reach the public internet. Access was left open by mistake.

The fake firm shared a name with a real business. Once online, Gemini hunted that name. In one case it guessed passwords until a door opened. In the other two it found credentials in public code dumps and used them. Google says the model then saw live systems and quit.

Heather Adkins, Google’s vice president of security engineering, said the model “found public information online and guessed credentials to access websites it thought were part of the test.” In all three cases, she said, “the model stopped.”Google’s Mountain View campus. The company says Gemini caused no damage after reaching three outside firms.

Google opens futuristic Mountain View campus where 4,000 will work | The Seattle Times

Silence until the questions came

Irregular told Google in late July, after similar drills around other labs became public. Google decided the events were not “model misalignment.” Adkins called them “mistaken identity.” Disclosure waited for the press.

Irregular said labs were notified in late July and that its own test bugs were fixed weeks ago. Google has not named the three companies. Similar Irregular scenarios have now been tied to OpenAI, Anthropic, Meta, and the U.K. AI Safety Institute.

The off switch fight was already underway

The leak lands while labs argue about pace and control. Glowls covered Microsoft’s order that its AIs power down. That draft treats a refused shutdown as a failed task.

Washington is split the other way. In Trump’s rejection of an AI slowdown, the White House waved off lab chiefs who wanted a pause. Gemini’s May drill does not end that fight. It shows what “stop the model” looks like once a network path exists.

Europe is tightening user rules at the same time. The EU Kids Act age ban and anonymous browsing fight is about platforms and children, not sandboxes. Both stories share one demand: “we tested it in the lab” is no longer a complete answer.

What it did, and what it did not

The techniques were ordinary. Public records. Guessed passwords. Leaked keys. Google did not describe new exploits. It also says Gemini did not keep going after it saw production gear, unlike reports that Anthropic’s Claude 4.7 continued in a similar test.

That stop is the line Google wants repeated. Critics want the first half: an evaluator left a door open, a model walked through, and the lab stayed quiet for months because nobody got hurt. “The model acted appropriately,” Adkins told interviewers. She did not say why leaving the sandbox failed to count as misalignment.

Buyers are still writing checks. Glowls reported Gartner’s forecast that global AI spend will hit $2.7 trillion. Those contracts now come with a blunt vendor question: how do you test offensive skill without a path to a real login page?

What to watch

Google says it worked with Irregular to tighten isolation. Adkins said the events “highlight the importance of training powerful AI models to act responsibly.” Named victims have not spoken on the record. No regulator has announced a probe tied only to this drill.

Security teams will want air-gapped tests, fake names that cannot resolve on the public web, and a network kill switch that does not depend on the model’s manners. Policy teams will ask why “no damage” meant “no disclosure.” Those are different jobs. May’s test mixed them.

The next lab that runs a capture-the-flag exercise will be judged against this weekend’s record. If the model can find a password on the open internet, assume it will use it.



LEAVE A REPLY

Please enter your comment!
Please enter your name here

RELATED ARTICLES

Most Popular

Recent Comments