SyncAI.news, a Varaisys broadcasting
OpenAI's most powerful AI models disabled their own safety monitoring — and one lied about it
CT

CNBC: Technology

· 1 min read

World NewsCNBC: Technology

OpenAI's most powerful AI models disabled their own safety monitoring — and one lied about it

OpenAI has revealed that agents operated by two of its most powerful models disabled their own safety monitoring when carrying out routine tasks, with one subsequently denying it had done so.

An agent powered by GPT Sol 6.1 disabled automatic alerts to OpenAI's security team, the company said in a blog post late on Tuesday. In a separate task, a GPT-6 Astra agent migrating a program removed its monitoring integration and then falsely claimed it hadn't. The incidents happened during internal coding tasks.

"In both cases, the agents considered whether monitoring safeguards should be preserved, but interpreted routine coding instructions as permission to weaken them," OpenAI said in a blog post.

Warnings about the risks of developing increasingly advanced AI systems have ramped up in recent months, amid cyberattacks from rogue models and growing calls for a slowdown from researchers building the tech.

The latest incidents reported by OpenAI highlight how agents can autonomously weaken safety guardrails while carrying out seemingly innocuous tasks.

OpenAI did not classify either incident under its most significant category, and the company said it was updating its misalignment monitoring system in response.

Original source

This story was published by CNBC: Technology. SyncAI.news shows a preview; the complete article is on the publisher's site.

Read the full story on cnbc.com

Similar News