NVIDIA’s Blackwell Processor and the Future of Data Centers
NVIDIA’s Blackwell Processor is a Game Changer
NVIDIA’s Blackwell processor is a game changer, but it is also incredibly dense and runs hot. When you have 72 of these processors in a rack, the heat becomes a big problem. Air cooling just doesn’t cut it anymore, so NVIDIA has released a spec rack that is water-cooled. Vendors like Dell are quickly bringing out Blackwell servers using this new method.
Lenovo’s Lead in Water Cooling
On the other hand, Lenovo has argued for some time that data centers need to shift to water cooling. With its unique Neptune water cooling system, Lenovo is in the lead, particularly with regard to Blackwell. When it comes to mixing electronics and water, you don’t want a novice. Water leaks in high amperage electronics can be damaging to the equipment and even deadly to people.
Blackwell’s Massive Popularity
Blackwell is incredibly popular as a way to rapidly scale AI performance, so much so that NVIDIA is having trouble keeping up with demand. The reason behind Blackwell’s popularity is that it is a uniquely designed part by the hardware company that led the charge into generative AI.
Why Future Data Centers Will Need to Be Water Cooled
Yes, it takes 72 processors before you have to water-cool the result, but each Blackwell throws off a lot of heat that can degrade server components over time. In addition, when using air cooling, you have to increase the air velocity as the item you are trying to cool heats up. This tends to turn data centers into loud, hot rooms that no one really wants to work in, and with this kind of heat, there are dangers of injury to those working on operating servers.
Why Water Cooling is the Future
As the follow-on to Blackwell comes to market along with competing parts from vendors like AMD and Intel, the need to cool the resulting servers will only increase due to the resulting density of these new parts, suggesting that very soon, air-cooled servers will become obsolete.
Wrapping Up: Warm Water-Cooled Data Centers
This brings me to my conclusion that as we aggressively deploy AI in our companies, the need for warm-water cooling will only increase, and planning for this in advance with vendors who understand and have a long history of bringing water-cooled solutions to market becomes increasingly important.
Conclusion
I’d advise planning to implement warm water-cooled data centers in the second half of this decade because that’s exactly what you are likely going to need to do unless you plan to fully outsource AI to a Cloud service. While that’s a popular option, it may not provide the intellectual property protection that the CIO needs to see. Given smaller businesses are likely to go exclusively to the Cloud, I have my doubts whether these massive data centers can keep up with the demands of an enterprise, which suggests enterprises likely need to put their most critical AI systems on premise.
FAQs
Q: What is the NVIDIA Blackwell processor?
A: The NVIDIA Blackwell processor is a game-changing, but dense and hot processor.
Q: Why do data centers need to shift to water cooling?
A: Water cooling is necessary to keep data centers cool and running efficiently.
Q: What is Lenovo’s unique water cooling system?
A: Lenovo’s Neptune water cooling system is a unique and effective way to cool data centers.
Q: Why is water cooling the future of data centers?
A: Water cooling is necessary to keep data centers cool and running efficiently as processors get denser and hotter.
Q: What are the benefits of water cooling?
A: Water cooling reduces the cost of installing and maintaining data centers, reduces water waste, and uses less power.
Q: What are the limitations of air cooling?
A: Air cooling can’t keep up with the increasing density and heat of processors, resulting in hot, loud data centers.
