SyncAI.news, a Varaisys broadcasting
AI coding agents ace isolated tests but complete fewer than one in ten tasks in a simulated workplace
JK

Jonathan Kemper

· 1 min read

BusinessThe Decoder

AI coding agents ace isolated tests but complete fewer than one in ten tasks in a simulated workplace

A new real-world test puts AI coding agents in a simulated developer job with colleagues, project boards, and incomplete handoffs, where they have to keep developing software on their own and reliably close open tickets in a messy daily workflow. Even Opus 5.5 and Astra fall far short, solving fewer than one in ten tasks completely. The models finish clear, standalone assignments quickly, but they lose track as autonomous developers.

Original source

This story was published by The Decoder and written by Jonathan Kemper. SyncAI.news shows a preview; the complete article is on the publisher's site.

Read the full story on the-decoder.com

Similar News