Prompt: The AI Infrastructure Boom Is Getting Bigger Than GPUs

Justin Sullivan via Getty Images

Editor’s Note: Welcome to Prompt, your weekly briefing on the shifting AI landscape. We provide an analytical look at the week’s biggest developments, paired with a curated roundup of the stories that matter.

For years, the AI infrastructure race has been defined largely by one thing: GPUs.

Nvidia's latest earnings suggest that the race isn't slowing down. It's getting bigger.

The AI chipmaker reported $96.2 billion in quarterly revenue this week, more than double what it generated a year ago. Data center revenue reached $89 billion, up 117% year over year, as demand for AI computing infrastructure continued to climb.

But the numbers may not be the most important part of Nvidia's quarter.

At the same time, it reported record results. Nvidia expanded its partnership with AWS, which will add another 2 million Nvidia GPUs across the cloud provider's global infrastructure. The collaboration also extends beyond GPUs to CPUs, networking, open models, government AI infrastructure and robotics.

Nvidia is making a similar push at the edge. The company unveiled its Jetson Orin Nano 2 platform this week, designed to run AI in robots, drones and vision systems as Nvidia looks to capitalize on growing interest in physical AI.

Put together, the developments point to an AI infrastructure market that is not only continuing to expand but also becoming much broader.

Training large models drove much of the industry's initial infrastructure boom. Now, agentic AI, inference, robotics and other emerging workloads are creating new demands for computing infrastructure in the cloud, data center and increasingly at the edge.

That expansion also complicates infrastructure decisions for enterprises. CIOs are no longer simply choosing how much GPU capacity they need. They are weighing different chips, cloud architectures, networking requirements and increasingly specialized infrastructure depending on where and how AI will run.

Also in AI News This Week: