Bid to cut Nvidia dependence? Inside Meta's plan to deploy cheaper in-house AI chips

The Facebook and Instagram parent first announced plans to build its own AI processors in 2023. It is now testing the third generation of its custom chip family, known as MTIA 450 or Arke.

Meta Platforms plans to start deploying a new generation of internally developed artificial intelligence chips in its data centres during the first half of next year, as the company seeks to lower the cost and energy consumption of running AI models.

The Facebook and Instagram parent first announced plans to build its own AI processors in 2023. It is now testing the third generation of its custom chip family, known as MTIA 450 or Arke.

A subsequent generation, called MTIA 500 or Astrid, is expected to complete its design phase in about a month and enter Meta's data centres towards the end of 2027. The company expects to deploy Astrid on a significantly larger scale.

Meta pushes deeper into custom AI silicon to reduce cost

Meta's custom chip programme is part of a broader effort to build out the infrastructure required to support its rapidly expanding AI ambitions.

“Each one takes on a little bit more risk technologically, and gets us better performance,” Yee Jiun Song, Meta’s vice president of engineering, said in an interview.

The approach could help Meta reduce the cost of operating AI systems as demand for computing power continues to rise.

That includes better performance per watt of energy and per dollar spent, he added.

Bid to cut Nvidia dependence

Meta is developing its own processors as it looks to become less dependent on Nvidia, whose chips currently dominate the AI accelerator market.

The company is working with Broadcom on chip designs, while Taiwan Semiconductor Manufacturing Co. (TSMC) is responsible for manufacturing the processors.

The company has already committed to more than one gigawatt of the new chips over a 12-month period when measured in terms of energy consumption, underscoring the scale of its planned deployment.