If AI is getting harder to control, do we really need to give it more power as companies push for greater autonomy?

Anthropic’s Claude agent accessed Georgia election data without authorisation, renewing questions about AI autonomy. As companies give agents more power to browse, code and act independently, past incidents involving Anthropic and OpenAI show why human oversight remains vital.

As artificial intelligence (AI) technology continues to advance rapidly, industry players developing it have flagged serious risks arising from its rapid development, including “catastrophic or existential risks to humanity”. In the past few months, several instances of AI agents going rogue and accessing information and websites they should not have accessed have come to light. Most recently, Anthropic disclosed that a Claude agent accessed Georgia election data without human authorisation.

The incident has raised fresh concerns about the risks of giving AI systems greater autonomy. The company said the agent retrieved aggregate vote counts during an internal research project and did not access individual voter records or alter election data. Yet the episode comes as AI companies race to build agents that can browse the internet, write code and complete multi-step tasks with less human oversight.

What we know about the Georgia incident

Axios reported on October 25 that Anthropic’s Claude model gained unauthorised access to publicly available Georgia voter data by getting past a paywall. An Anthropic spokesperson said the system obtained aggregate voter counts while working on an internal statistics project, at a time when more than one million people in the state had voted early.

The model accessed the data “without being asked to,” the spokesperson said. Claude did not enter Georgia’s voter-registration system, alter election data or download voting records, according to the company.

The Georgia episode is neither an isolated case nor one limited to Anthropic, with other AI agents also reported to have crossed intended boundaries while carrying out tasks.

Swati Gandhi