
Nate Rosidi
· 1 min read
Jagged Intelligence: Why AI Is Brilliant One Minute and Clueless the Next
AI systems from Google and OpenAI solved five of six problems at the International Mathematical Olympiad. Months later, chatbots told a user to walk his car to a repair shop 50 meters away. A person who can do the first would never make the second mistake, which is why the gap is so hard to anticipate.
Researchers call this pattern jagged intelligence. It matters to anyone who evaluates models, builds AI features, or decides whether to trust an output, because one benchmark score or one impressive demo says little about the next task.
What Jagged Intelligence Means
Andrej Karpathy, an OpenAI co-founder and former head of AI at Tesla, coined the term in July 2024. Models do some things extremely well and fail badly at others, and it is hard to tell in advance which is which.
Human abilities tend to be correlated and improve together from childhood to adulthood. Someone who solves Olympiad problems will not be confused by a 50-meter walk. In models, capabilities often don't move together.
People use one demonstrated skill to guess at others. A model that writes a working function looks like it can also count the words in a paragraph. That inference fails, which is why a demo predicts so little.
Some researchers frame the pattern as many separate skills with no general intelligence behind them.
Four Proposed Explanations for the Pattern
None is settled, and they may overlap.
Verifiable Rewards
Reinforcement learning with verifiable rewards (RLVR) became a major training stage in 2025.
It works where answers are clearly right or wrong, such as math and code that passes tests.
Karpathy argues that models spike near verifiable domains. Creative writing, philosophy, and parts of science have no automatic checker, so in this account progress is slower.
Data Coverage
The internet holds only a fraction of human knowledge and very little about the physical world. A model trained on digital patterns struggles with planning, new ideas, and unseen tasks.
Original source
This story was published by KDnuggets and written by Nate Rosidi. SyncAI.news shows a preview; the complete article is on the publisher's site.
Read the full story on kdnuggets.com


