Why the immediate future of liquid cooling is hybrid

Posted

From training massive language models to powering nonstop inference, AI is fundamentally rewriting the rules of data center thermal management.

AI workloads are characteristically less predictable and significantly more power-dense than traditional operations. As a result, deploying liquid cooling is no longer an experimental consideration. It has become absolute table stakes for handling AI and high-performance computing (HPC) demands. The industry conversation has shifted rapidly from “if or when” to how quickly organizations can deploy and scale.

Here is a look at how AI is driving the shift toward high-density thermal management, the operational realities of adopting these systems, why the near future belongs to hybrid environments, and how data center operators can successfully navigate the transition.

AI Workloads Push Densities Beyond Air Alone: The Hybrid Era

Historically, traditional cooling methods were sufficient for enterprise workloads. However, air cooling remains viable and efficient only up to approximately 20 to 40 kW per rack. Today’s GPU-accelerated AI racks commonly operate between 40 kW and well over 100 kW, with next-generation systems expected to push toward 200 kW or more. This GPU-driven density has made air-only cooling strategies fundamentally impractical for cutting-edge infrastructure.

This extreme concentration of heat generation challenges traditional airflow-based architectures, demanding a transformation in AI data center cooling. In the ongoing evaluation of DLC vs. air (direct liquid cooling versus air cooling), the performance data is conclusive.

Thermal modeling demonstrates that single-phase direct liquid cooling maintains chip-to-coolant temperature differences of roughly 17 to 20 °C under roughly 500 W processor loads, whereas comparable air-cooled systems exceed 60 °C. Liquid cooling, which is up to 3,000 times more effective at transferring heat than air, efficiently captures heat directly at the source, preventing thermal throttling and protecting infrastructure ROI.

While transitioning to liquid cooling may seem like a straightforward solution, it is rarely a sudden, wholesale replacement. Most facilities are not going all-in on liquid. Instead, they are adopting hybrid cooling models that combine traditional air architectures with advanced direct-to-chip systems.

Why Hybrid Will Dominate Transitions Through 2027-2028

Through 2027 and 2028, hybrid thermal strategies will dominate because data centers must accommodate both legacy IT equipment and next-generation AI accelerators within the same facility. The reality of brownfield retrofits, where most AI capacity is initially being deployed in existing air-cooled facilities, versus designing greenfield sites for liquid from day one means that air cooling will still play a critical role in ancillary systems and lower-density zones.

The future is not strictly liquid cooling only. It is about right-sizing the cooling method to the specific workload. Operators will successfully scale by deploying mixed architectures, such as utilizing direct-to-chip cold plates and Coolant Distribution Units (CDUs) for dense AI clusters, while managing residual heat with Computer Room Air Handlers (CRAHs) or fan-assisted Rear-Door Heat Exchangers (RDHx).

The Real Bottleneck: Operational Complexity and the Talent Gap

While the technology for liquid cooling is maturing, navigating the operational complexity of a hybrid cooling environment is the real challenge. Cooling is no longer just a facilities issue. It requires the convergence of IT, mechanical engineering, and software management. Facilities must now manage fluid chemistry, leak detection, risk mitigation, and sophisticated maintenance workflows.

What’s more, the industry is facing a widening talent gap. Uptime Institute reports that nearly two-thirds of operators struggle to hire and retain qualified staff, underscoring a shortage of teams with expertise across both liquid cooling systems and integrated infrastructure. Addressing this will require new training models, deeper vendor collaboration, and greater reliance on managed services.

While the industry is making strides toward standardizing interoperable designs - such as plug-and-play CDUs and manifolds that distribute coolant efficiently across racks - there is still fragmentation across vendors and approaches. Additionally, operators must navigate changing economics. While liquid infrastructure requires higher upfront CapEx, it delivers better Total Cost of Ownership (TCO) over time due to enhanced efficiency and density. Decision-makers are consequently shifting their focus from what is cheapest today to what can scale with AI demand.

A Blueprint for Success: Reference Architectures and Readiness

Navigating this hybrid cooling transition requires standardizing deployments to avoid complex, bespoke engineering for every site. A successful liquid cooling ecosystem relies on selecting the appropriate heat rejection architectures, which are defined by the heat capture method, CDU type (rack-mounted or floor-mounted), and the method of rejecting heat outdoors.

A successful blueprint involves choosing among six core architectures, ranging from rejecting heat to air within the IT space via liquid-to-air (L-A) CDUs, to utilizing dedicated independent water systems with liquid-to-liquid (L-L) CDUs for massive deployments.

To future-proof AI infrastructure, operators should utilize a strategic readiness checklist:

● Plan in Parallel: Physical infrastructure and IT planning must happen simultaneously from day one to prevent facilities from lagging behind hardware deployments.

● Design for Flexibility: Build dynamic, responsive designs capable of supporting multiple hardware generations, utilizing hybrid air and liquid combinations.

● Embrace Sustainability and Heat Reuse: Tying cooling strategies to ESG goals is a clear win, as advanced liquid cooling solutions can reduce total facility energy consumption by up to 40 percent and cut water use by 20-90 percent. Furthermore, liquid cooling unlocks opportunities for heat reuse, allowing operators to redirect waste heat to adjacent buildings or district heating systems.

Derisking Adoption Through Integrated Partnerships

Deploying liquid cooling at scale introduces risk, particularly when sourcing racks, power, and cooling from multiple uncoordinated vendors. To derisk adoption and bridge the talent gap, operators must lean on integrated, end-to-end partnerships.

Providers like Schneider Electric are addressing this complexity by engineering fully synchronized ecosystems. Facilities can successfully derisk liquid cooling transitions by focusing on:

● Integrated Power and Cooling: At AI densities, even minor imbalances between electrical load and thermal rejection can lead to system instability, underscoring the necessity of integrated AI data center cooling solutions. Through its acquisition of Motivair, Schneider Electric now offers a complete end-to-end liquid cooling ecosystem (including CDUs, cold plates, and manifolds) that is designed to work seamlessly alongside resilient uninterruptible power supplies (UPS) and distribution units.

● Validated Designs: Collaborating early with IT vendors and chip designers helps align reference designs for optimized integration. For example, Schneider Electric’s close collaboration with NVIDIA on validated architectures helps prevent physical infrastructure from becoming a bottleneck to GPU performance.

● Digital Lifecycle Management: AI infrastructure must become more dynamic. Using digital twins and simulation software, like Schneider Electric’s ETAP and AVEVA platforms, teams can design, model, and validate integrated power and cooling architectures before physical construction begins, predicting issues before they arise.

● Global Manufacturing and Services: Sourcing from partners with robust global manufacturing capacity reduces supply chain risk and accelerates delivery. Post-implementation, leveraging real-time monitoring and predictive maintenance helps bridge the internal talent gap while sustaining operations.

From Debate to Design: Building for a Hybrid-Cooled Future

Ultimately, liquid cooling hasn’t replaced air. It has fundamentally reshaped the conversation around data center design. What was once framed as a binary debate between direct-to-chip and traditional air cooling has evolved into a more pragmatic reality: no single approach can meet the diverse and rapidly shifting demands of AI workloads.

The future lies in flexible, hybrid environments that intelligently integrate both air and liquid cooling to match workload requirements, optimize efficiency, and manage risk. As AI continues to push the boundaries of power density and performance, operators must prioritize adaptability, designing infrastructure that can scale, evolve, and respond in real time. In this new era, success will not be defined by choosing one cooling method over another, but by building resilient, future-ready systems capable of supporting whatever comes next.

Supplied by Schneider Electric

ai and ml