Liquid-Cooled Rack Cost Optimization via Pump and Clock Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional air-cooling solutions struggle to manage thermal challenges in high power density GPU racks, leading to inefficiencies in energy consumption and performance, especially in high performance machine learning computing environments.
Innovation Solution
A liquid-cooled IT rack system is optimized by determining an optimal chip clock rate and pump speed using a coolant distribution unit and rack management unit, which minimizes total ownership cost by balancing server acquisition, cooling system acquisition, power consumption, and operational costs through a holistic approach.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Temperature
If conventional air-cooling solutions are used for high power density GPU racks, then the cooling system is simpler to implement, but thermal management effectiveness deteriorates and energy consumption increases
Solution Approach 1:
The patent transitions from air-cooling to liquid-cooling technology, using hydraulic principles to circulate coolant through cold plates attached to processors. This liquid cooling system removes heat more efficiently from high power density GPUs, solving the thermal management problem while reducing overall energy consumption compared to conventional air-cooling methods
Solution Approach 2:
The patent changes the cooling medium parameter from gas (air) to liquid (coolant), fundamentally improving heat transfer efficiency. This parameter change enables effective thermal management of high power density processors and reduces the energy required for cooling operations
2Temperature
If liquid cooling is implemented for better thermal management, then cooling performance improves, but system complexity and acquisition cost increase
Solution Approach 1:
The liquid cooling system is divided into modular components including cold plates attached to individual processors, a separate coolant circulation loop with pumps and heat exchangers, and a management system. This segmentation allows the cooling function to be added independently without redesigning the entire server architecture, reducing implementation complexity
Solution Approach 2:
The patent introduces a coolant as an intermediary substance between the heat-generating processors and the heat dissipation system. The coolant circulates through cold plates, absorbing heat from processors and transporting it to external heat exchangers, thereby decoupling the processors from direct thermal management complexity
3Temperature
If liquid cooling system is used, then thermal conditions improve, but acquisition cost and operational cost increase
Solution Approach 1:
The liquid cooling system is designed to serve multiple functions: cooling multiple different types of processors (CPUs, GPUs, FPGAs) within the same rack infrastructure, providing both thermal management and potential heat recovery capabilities. This multi-functionality justifies the higher acquisition cost by delivering superior thermal conditions and additional operational benefits
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution effectively manages thermal conditions, reduces energy consumption, and enhances computing performance by optimizing the clock rate and pump speed within predetermined constraints, thereby minimizing the overall cost of ownership for liquid-cooled IT racks.
Implementation Method 1
Cold plate liquid cooling solution provides much better cooling performance
Implementation Method 2
coolant distribution unit (CDU) to supply cooling liquid to the processors and to receive the cooling liquid carrying the heat exchanged from the processors
Data Source
AI summary
An electronic rack includes an array of server blades arranged in a stack. Each server blade contains one or more servers and each server includes one or more processors to provide data processing services. The electronic rack includes a coolant distribution unit (CDU) and a rack management unit (RMU). The CDU supplies cooling liquid to the processors and receives the cooling liquid carrying heat from the processors. The CDU includes a liquid pump to pump the cooling liquid. The RMU is configured to manage the operations of the components within the electronic rack such as CDU, etc. The RMU includes control logic to determine an optimal pump speed and an optimal processor clock rate based on a first relationship between cost of the electronic rack and clock rate of the processors and a second relationship between energy consumption of the electronic rack, clock rate of the processors and pump speed.