AI Can Get Smarter Without Getting More Authority

Kognitos Founder & CEO Binny Gill holds nearly 100 patents in computer science.

​We all saw something unusual happen in AI as some of the people building the world’s most capable systems began arguing that the technology may be advancing faster than our ability to control it.​

Anthropic CEO Dario Amodei called for the industry to “pace the frontier,” warning that AI capabilities could advance faster than our ability to control them. Other AI leaders echoed this, and Anthropic began measuring how much AI contributes to developing future AI systems.​

I take those concerns seriously, but I think they also expose an assumption that deserves more scrutiny. We often talk as though greater intelligence must inevitably bring greater autonomy, when the two are separate engineering decisions.​

Intelligence Does Not Confer Authority

Traditionally, software has been created to perform a task and given the access needed to do it. With generative AI, the software can now determine what it thinks should happen next. An AI system can interpret a request, identify a problem and propose a course of action without that sequence having been explicitly programmed.

That capability does not require unrestricted authority to carry the proposal out.​

We understand this easily when dealing with people. A talented financial analyst may identify a multimillion-dollar opportunity, but that does not give the analyst permission to move the money. Organizations separate expertise from authority because knowing what should happen is different from having permission to do it.

Control Should Sit Outside The Model

Much of the frontier safety debate focuses on models themselves. Researchers want to understand model behavior and whether systems continue to follow human intent as their capabilities increase. But control can sit where the model’s reasoning meets the outside world.