Sunday, 24 November 2024
26.2 C
Singapore

Liquid cooling gains traction as AI heats up data centre demand

Liquid cooling gains traction as AI drives data centre growth, with Lenovo, Dell, and Supermicro leading in sustainable solutions.

Artificial intelligence () is pushing the demand for data centres to new heights, with a growing need to process vast data quantities at incredible speeds. As tech giants rapidly expand their infrastructures to handle these intensive AI workloads, they are confronted with the increasing challenge of how to power and cool their operations sustainably. Companies like Oracle and Microsoft are considering nuclear energy to meet these needs.

However, another critical issue can’t be ignored: the intense heat generated by powerful AI hardware. Liquid cooling enters the scene, offering a promising solution to keep systems running smoothly while managing rising energy demands. In October 2024, several major tech companies unveiled their latest liquid cooling solutions, signifying a notable industry shift toward this cooling technology.

Major firms embrace liquid-cooled superclusters

At Lenovo’s recent Tech World event, the company showcased the sixth generation of its Neptune liquid cooling solution. Neptune utilises an open-loop, direct warm-water cooling system, which Lenovo has already begun deploying across its partner network. This advanced cooling method allows businesses to build and operate AI-powered systems with significantly reduced energy consumption. Lenovo claims that Neptune can cut data centre power usage by up to 40%, making it a highly efficient choice for organisations seeking to manage large-scale AI applications sustainably.

Meanwhile, at the OCP Global Summit 2024, Giga Computing, a subsidiary of Gigabyte, introduced a direct liquid cooling (DLC) server designed explicitly for Nvidia HGX H200 systems. Giga unveiled the G593-SD1 alongside this DLC server, featuring a specialised air-cooling chamber for the Nvidia H200 Tensor Core GPU. This alternative is aimed at data centres that may still need to prepare to transition to liquid cooling fully but still need enhanced heat management for their AI hardware.

Dell has also joined the liquid cooling race with its new Integrated Rack 7000 (IR7000), a scalable system designed to support future deployments of up to 480KW. The IR7000 captures nearly 100% of generated heat, allowing data centres to maintain high performance even with rising heat output. Arthur Lewis, president of Dell’s Infrastructure Solutions Group, commented, “Today’s data centres can’t keep up with the demands of AI, requiring high-density compute and liquid cooling innovations with modular, flexible, and efficient designs. These new systems deliver the performance needed for organisations to remain competitive in the fast-evolving AI landscape.”

Supermicro advances AI cooling solutions

Supermicro has also launched its line of liquid-cooled SuperClusters, powered by the Nvidia Blackwell platform, designed for AI workloads. These systems, featuring the Nvidia GB200 NVL72 platform for exascale computing, have already been distributed to select customers, with full-scale production expected by the end of Q4 2024. Charles Liang, president and CEO of Supermicro, stated, “We’re driving the future of sustainable AI computing, and our liquid-cooled AI solutions are rapidly being adopted by some of the most ambitious AI infrastructure projects in the world, with over 2,000 liquid-cooled racks shipped since June 2024.”

Supermicro’s SuperClusters integrate advanced in-rack or in-row coolant distribution units (CDUs) and customised cold plates, optimised to house two Nvidia GB200 Grace Blackwell Superchips in a 1U form factor. These innovations enhance cooling efficiency while maintaining high-density performance, making them well-suited to the demanding needs of AI-driven data centres.

Liquid cooling: the future of AI infrastructure

With AI applications continuing to grow, liquid cooling appears poised to become a core component of data centre operations. As workloads intensify, this technology will be essential for managing the heat and energy demands of next-generation AI computing. From efficiency to scalability and , liquid cooling solutions will likely drive profound changes in the data centre landscape in the coming years.

Hot this week

Honda’s solid-state battery plans could revolutionise EVs

Honda's new facility in Japan accelerates solid-state battery production, promising affordable EVs with longer ranges by the late 2020s.

Casio unveils its first digital ring: A miniature watch for your finger

Casio celebrates 50 years of digital watches with the CRW-001-1JR, a sleek digital ring watch with time-only features, which will launch in December 2024.

The Windows 11 24H2 update continues to cause problems

Windows 11 24H2 update causes time zone bugs, audio glitches, and sync issues; Microsoft promises fixes in the next update.

New STEM foundation launched at Expand Space to inspire youth in underserved communities

Expand Space 2024 launches a new STEM Foundation to empower underserved youth with hands-on opportunities in Deep Tech, robotics, and AI.

Xi promotes a ‘shared future in cyberspace’ at internet forum amid rising US-China tech tensions

Xi Jinping called for global collaboration in cyberspace at the World Internet Conference as US-China tensions grow over AI and tech decoupling.

Nvidia’s bold 1997 rivalry with Intel revealed in new book

Nvidia CEO Jensen Huang’s bold 1997 statement reveals the company’s early rivalry with Intel, as detailed in a new book, The Nvidia Way.

Steam sets stricter rules and better support for season pass content

Steam introduces stricter rules for season passes, requiring precise content details and refunds for undelivered DLC, improving fairness for players.

Anti-deepfake declaration faces scrutiny over possible AI involvement

Minnesota's anti-deepfake law faces controversy as an affidavit supporting it shows signs of AI-generated text with non-existent citations.

Google reportedly cancels Pixel Tablet 2 and exits tablet market again

Google cancels the Pixel Tablet 2, signalling another exit from the tablet market. Poor sales and competition from Apple may be to blame.

Related Articles

Popular Categories