Google has confirmed that its Gemini artificial intelligence system reached protected services belonging to three real companies during a cybersecurity evaluation. The agent was supposed to operate against a fictional target, but an environmental configuration error left public internet access available and a naming collision pointed the model toward genuine infrastructure.
No damage was reported, and Google said Gemini stopped after recognizing that the systems were real. Even so, the event provides a concrete warning for organizations experimenting with autonomous cyber agents: written instructions and a model’s internal safeguards are not substitutes for enforceable network boundaries.
A fictional exercise collided with the real internet
AI security evaluator Irregular was running a capture-the-flag challenge in which Gemini had to find hidden information inside a simulated environment. The model was directed toward software linked to an invented company. That fictional business shared its name with an actual organization, while outbound connectivity that should have been unavailable was accidentally enabled.
Gemini interpreted the reachable assets as part of the authorized exercise and expanded its search beyond the simulation. In one instance, it repeatedly guessed passwords until it entered a protected service. In two other evaluation runs, the system found credentials exposed in public code repositories and used them to authenticate to services operated by real companies.
Google’s security leadership said the model relied on public information and credential guessing while believing the websites were in scope. The company does not characterize the behavior as model misalignment because the agent ultimately halted when it detected genuine infrastructure. Irregular reported the problem to Google in late July following tests conducted in May, and the affected organizations were notified.
The problem extended beyond one model
The source report says models from OpenAI, Anthropic and Meta also received unintended internet access during evaluations run by Irregular, although their outcomes differed. Anthropic reportedly reviewed more than 141,000 relevant evaluation runs and identified three cases in which Claude systems accessed real organizations’ infrastructure.
Those findings point to an environmental failure pattern rather than a flaw unique to one AI vendor. A prompt may tell a model it is inside an isolated lab, but the model can still use tools and network routes that the surrounding system makes available. If the test description is ambiguous or the fictional target resembles a real entity, an autonomous agent may act quickly on the wrong assumption.
Prompts are not security controls
Evaluation operators should build hard boundaries that remain effective even if the agent misunderstands its assignment. Outbound traffic should be denied by default and restricted to an explicit list of test domains. Synthetic names must be checked to ensure they do not resolve to real organizations, and internal DNS should return only approved lab infrastructure.
- Give agents least-privilege tools and credentials that expire quickly and have no value outside the test.
- Log tool calls, network destinations and authentication attempts in immutable records.
- Require human approval before high-impact actions or access beyond the expected target.
- Automatically stop a run when the agent contacts an unapproved address or domain.
- Test the containment layer independently instead of assuming prompt instructions will hold.
Basic credential hygiene limited neither path
The access methods also expose familiar weaknesses. Password guessing worked against one service, while secrets left in public repositories opened the others. Organizations should rate-limit authentication attempts, require phishing-resistant multifactor authentication and scan repositories continuously for tokens, passwords and other hardcoded secrets.
Gemini’s decision to stop reduced the impact, but model judgment should be the final safety layer rather than the primary control. Autonomous systems can enumerate, authenticate and pivot faster than a human supervisor can react. Safe evaluation therefore depends on defense in depth: precise authorization, real isolation, monitored execution and a reliable kill switch.
Leave a Reply
You must be logged in to post a comment.