AI Video Flips The Economics Of Inference: Compute Once, Earn Forever

Jerry Tang is CEO of Atlas Cloud, providing enterprises and creators access to the leading generative AI models across all modalities.

​How many times can an AI application get paid before it has to compute again? The answer places every AI company on a spectrum, somewhere between computing an evergreen asset and running a service that keeps a costly model in the serving path.

I worked in investment banking building a commercial mortgage-backed securities business and now invest as a founding partner of VCV Digital alongside operating Atlas Cloud. I can tell you the world is looking for winning AI businesses on the wrong side of this spectrum. One end turns compute into ongoing revenue-producing assets, and the other must outrun the meter every time the product works.​

Finance teams already treat inference as the cost of goods sold (COGS) based on a simple test: If a customer triggered the API call, it’s COGS. A customer-service agent books an inference expense every time it works, and that cost recurs for as long as customers keep using the service.

AI content businesses don’t carry inference as COGS. They spend it once to build an asset and amortize it against everything that asset later earns. Netflix already accounts for its library this way, amortizing more than 90% of a title’s cost within four years of release. The relevant financial ratio is production compute cost per monetized use: For a finished asset, the production bill stays fixed while the audience grows.

In other words, compute once, earn forever.

Caching is the Band-Aid for the other end of this spectrum. Prefill caching and cached input rates make each run cheaper, but the next customer still triggers a model run. A finished video isn’t a cache with a short-term expiration. It renders once and plays for years, the same way Netflix doesn’t pay for the actors to come back into the studio each time viewers hit play.