Microsoft’s Big Bet on AI Chips
Microsoft bought twice as many of Nvidia’s flagship chips as any of its largest rivals in the US and China this year, as OpenAI’s biggest investor accelerated its investment in artificial intelligence infrastructure.
Nvidia’s Dominance Unchallenged
Analysts at Omdia, a technology consultancy, estimate that Microsoft bought 485,000 of Nvidia’s "Hopper" chips this year, putting Microsoft far ahead of Nvidia’s next biggest US customer Meta, which bought 224,000 Hopper chips, as well as its cloud computing rivals Amazon and Google.
Global Demand Outstrips Supply
With demand outstripping supply of Nvidia’s most advanced graphics processing units for much of the past two years, Microsoft’s chip hoard has given it an edge in the race to build the next generation of AI systems. This year, Big Tech companies have spent tens of billions of dollars on data centers running Nvidia’s latest chips, which have become the hottest commodity in Silicon Valley since the debut of ChatGPT two years ago kicked off an unprecedented surge of investment in AI.
Big Tech’s AI Chips
Microsoft’s Azure cloud infrastructure was used to train OpenAI’s latest o1 model, as they race against a resurgent Google, start-ups such as Anthropic and Elon Musk’s xAI, and rivals in China for dominance of the next generation of computing.
Rivals’ Chip Orders
Omdia estimates ByteDance and Tencent each ordered about 230,000 of Nvidia’s chips this year, including the H20 model, a less powerful version of Hopper that was modified to meet US export controls for Chinese customers. Amazon and Google, which along with Meta are stepping up deployment of their own custom AI chips as an alternative to Nvidia’s, bought 196,000 and 169,000 Hopper chips, respectively.
Global Server Spending
Tech companies around the world will spend an estimated $229bn on servers in 2024, led by Microsoft’s $31bn in capital expenditure and Amazon’s $26bn. The top 10 buyers of data center infrastructure – which now include relative newcomers xAI and CoreWeave – make up 60% of global investment in computing power.
Nvidia’s Dominance
Vlad Galabov, director of cloud and data center research at Omdia, said some 43% of spending on servers went to Nvidia in 2024. "Nvidia GPUs claimed a tremendously high share of the server capex," he said. "We’re close to the peak."
Rivals’ Own AI Chips
While Nvidia still dominates the AI chip market, its Silicon Valley rival AMD has been making inroads. Meta bought 173,000 of AMD’s MI300 chips this year, while Microsoft bought 96,000, according to Omdia. Big Tech companies have also stepped up usage of their own AI chips this year, as they try to reduce their reliance on Nvidia.
Conclusion
In conclusion, Microsoft’s aggressive investment in Nvidia’s AI chips has given it a significant edge in the race to build the next generation of AI systems. While rivals such as Amazon and Google are stepping up their own investments in AI chips, Nvidia’s dominance of the market remains unchallenged.
FAQs
Q: How many Hopper chips did Microsoft buy this year?
A: Microsoft bought 485,000 Hopper chips this year, according to Omdia estimates.
Q: Who are the top buyers of data center infrastructure?
A: The top 10 buyers of data center infrastructure make up 60% of global investment in computing power, led by Microsoft and Amazon.
Q: What is the total spending on servers in 2024?
A: Tech companies around the world will spend an estimated $229bn on servers in 2024, led by Microsoft’s $31bn in capital expenditure and Amazon’s $26bn.
Q: What is the share of spending on servers that goes to Nvidia?
A: Some 43% of spending on servers went to Nvidia in 2024, according to Omdia estimates.
