Cognitive Concentration: The Hidden Risk Beneath Enterprise AI

​Swati Deepak Kumar is Senior Vice President of Information Technology at Citi.

Enterprises have spent years diversifying their technology. A company may use different applications for sales, procurement, customer service, software development, supply chain and legal work, each from a different vendor. At face value, that portfolio looks diversified.

But what if several of those applications are effectively thinking with the same brain?

Different software vendors may be using the same foundation model, model family, API, compute provider or AI ecosystem. We’ve diversified the applications while potentially concentrating the intelligence that powers them.

I call this cognitive concentration. It’s a proposed management lens, not an established regulatory term. Different applications can look independent while still relying on the same underlying knowledge system.

Identifying The Hidden Common Brain

Traditional architecture reviews focus on the visible application layer (who supplies each platform, where it is hosted and what data it uses). But it isn’t enough to say we use different vendors because those vendors may be using the same AI underneath.

That creates a hidden common brain. Imagine four of 10 applications use the same underlying model. The provider releases a new version, and nothing crashes. Yet the decision system underneath four workflows changes simultaneously. One model change, but multiple parts of the business are affected.

Applications built on the same model won’t automatically produce identical decisions. Prompts, private data, retrieval, fine-tuning, policies and human controls can change their outputs. But behind them all, they still share a potential channel for failure. If the model underlying the applications develops a blind spot or changes its behavior, separate systems may begin making correlated incorrect or shifted judgments.