Your Cloud Is The Foundation AI Keeps Falling Through

Vaibhav Gujral works at Capgemini and is a 7x Microsoft MVP. He writes about cloud architecture, agentic AI, and technology leadership.

​Every enterprise I talk to has an AI strategy. Far fewer have a cloud foundation that can actually support one.

Over the past few years, I’ve watched organizations across financial services, insurance and healthcare launch AI pilots with real enthusiasm and then quietly stall—not because the models underperformed but because nobody had asked the boring question first: Is our cloud environment actually ready for this?

AI exposes cloud debt you could ignore before.

For a decade, plenty of enterprises got away with “good enough” cloud architecture—fragmented data stores, inconsistent identity and access controls, and cost governance bolted on as an afterthought. None of it was pretty, but it didn’t actively break anything.

AI changes that. A large language model or agentic workflow doesn’t politely work around messy data the way a human analyst does. It ingests whatever it’s given, at scale, and produces confident answers regardless of whether the underlying data was ever trustworthy. Governance gaps that were compliance risks become operational ones. Access control gaps that were a security concern become a data-leakage concern the moment an AI agent has broader read access than any single employee ever did.

The pattern I see repeatedly is a pilot that works beautifully in a sandboxed environment with clean, hand-picked data and then falls apart the moment it touches production systems—because production is where the cloud debt actually lives.

Follow the data, not just the code.

Cost governance was optional, but now it’s existential.

​Handling this well doesn’t mean increasing your AI budget. The companies I see experiencing success already had real FinOps discipline built into their cloud practice before AI arrived. Cost governance stopped being a nice-to-have optimization exercise and became a prerequisite for being allowed to experiment.