Unlock the Editor’s Digest for free
Roula Khalaf, Editor of the FT, selects her favourite stories in this weekly newsletter.
Elon Musk’s AI Start-up xAI Expands Colossus Supercomputer
Elon Musk’s artificial intelligence start-up xAI has pledged to expand its Colossus supercomputer tenfold to incorporate more than 1mn graphics processing units, in an effort to leap ahead of rivals such as Google, OpenAI and Anthropic.
Colossus, built in just three months earlier this year, is believed to be the largest supercomputer in the world, operating a cluster of more than 100,000 interconnected Nvidia GPUs. The chips are used to train Musk’s chatbot Grok, which is less advanced and has fewer users than market-leader ChatGPT or Google’s Gemini.
Cost of Expansion
The cost of acquiring so many GPUs would be significant. The latest generation of Nvidia GPUs typically cost tens of thousands of dollars, although older versions of the chips can be cheaper. Musk’s planned expansion of Colossus would require an investment likely to reach tens of billions of dollars — plus the high cost of building, powering and cooling the vast servers in which they would sit. xAI has raised about $11bn in capital from investors this year.
AI Companies Scramble for GPUs and Data Centers
AI companies are scrambling to secure GPUs and access to data centers to supply the computing power needed to train and run their frontier large-language models.
OpenAI, the maker of ChatGPT, has an almost $14bn partnership with Microsoft that includes credits for computing power. Anthropic, the maker of the Claude chatbot, has received $8bn in investment from Amazon and will soon be given access to a new cluster of more than 100,000 of its specialised AI chips.
Rivalry Between xAI and OpenAI
Rather than form partnerships, Musk, the world’s richest man, has used his power and influence within the tech sector to build his own supercomputing capacity, although he is playing catch-up after founding xAI barely more than a year ago. The trajectory has been steep — the start-up is valued at $45bn and recently raised another $5bn.
Musk is in fierce competition with OpenAI, which he helped co-found with Sam Altman among others in 2015. The pair subsequently fell out and Musk is now suing OpenAI, seeking to block its transition from a non-profit to a more traditional enterprise.
Conclusion
xAI’s rapid expansion of Colossus is a significant move in the AI landscape, with the company aiming to leap ahead of its rivals. The cost of the expansion is likely to be significant, but xAI has raised billions of dollars in capital from investors this year. The rivalry between xAI and OpenAI is likely to continue, with both companies vying for dominance in the AI market.
FAQs
Q: What is Colossus?
A: Colossus is a supercomputer built by xAI, an artificial intelligence start-up founded by Elon Musk.
Q: How many GPUs does Colossus have?
A: Colossus has more than 100,000 interconnected Nvidia GPUs.
Q: What is the cost of expanding Colossus?
A: The cost of expanding Colossus is likely to be tens of billions of dollars, including the cost of acquiring GPUs, building, powering, and cooling the servers.
Q: Who is xAI’s main rival?
A: xAI’s main rival is OpenAI, a company co-founded by Elon Musk and now led by Sam Altman.
