Electronic Module Cooling System

A hybrid cooling system with two circuits and a heat exchanger efficiently cools electronic modules, addressing inefficiencies in existing systems by enhancing performance and reducing coolant use, suitable for retrofitting.

JP7591521B2Active Publication Date: 2024-11-28ICEOTOPE
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
JP2021569205
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2019-11-18
Filing Date
2020-05-21
Publication Date
2024-11-28
Estimated Expiration
2040-05-21

AI Technical Summary

Technical Problem

Existing cooling systems for electronic modules, particularly in IT devices, are limited by the inefficiencies of air-cooled methods and the complexity and cost of liquid cooling systems, which restrict computing performance and space utilization.

Method used

A hybrid cooling system utilizing two interconnected cooling circuits: a first circuit for general cooling and a second, more efficient circuit for high-power components, with a heat exchanger to transfer heat between them, and optional components like weirs and cold plates for targeted cooling.

Benefits of technology

Enhances cooling efficiency, allowing higher performance and reduced coolant usage, while maintaining a stable temperature environment within the electronic module, and is adaptable for retrofitting existing systems.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007591521000001
    Figure 0007591521000001
  • Figure 0007591521000002
    Figure 0007591521000002
  • Figure 0007591521000003
    Figure 0007591521000003
Patent Text Reader

Abstract

A system and method for cooling multiple electronic devices contained within an electronic module housing. The system includes a first cooling circulation apparatus configured to circulate a first liquid coolant between a first electronic device of the multiple electronic devices and a heat exchanger, the first electronic device being thermally coupled to the first liquid coolant such that heat is transferred from the first electronic device to the first liquid coolant. The system further includes a second cooling circulation apparatus configured to circulate a second liquid coolant between a second electronic device of the multiple electronic devices and the heat exchanger, the second electronic device being thermally coupled to the second liquid coolant such that heat is transferred from the second electronic device to the second liquid coolant. The first and second cooling circulation apparatuses are thermally coupled via at least the heat exchanger such that heat is transferred from the first liquid coolant to the second liquid coolant via the heat exchanger.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] Technical Field of the Disclosure The present disclosure relates to a system for cooling a plurality of electronic devices housed in an electronic module. The system comprises a first cooling circulation device configured to cool a first electronic device in the electronic module and a second cooling circulation device configured to cool a second electronic device in the electronic module. A coolant circulating in the first cooling circulation device is cooled by transferring heat to a coolant circulating in the second cooling circulation device via a heat exchanger. Additionally, a method for cooling a plurality of electronic devices housed in an electronic module is described.

[0002] The present disclosure also relates to a system for cooling electronic modules configured for installation within a rack. The present disclosure further contemplates an installation method of a liquid cooling system for electronic modules, and a kit for use in the installation method. [Background technology]

[0003] Background of the Disclosure Within a computer, server, or other device used for data processing (referred to as IT or Information Technology), there are several electronic devices called integrated circuits (ICs). The electronic devices within an integrated circuit may include a central processing unit (CPU), an application specific integrated circuit (ASIC), a graphics processing unit (GPU), a random access memory (RAM), etc. Each of these devices generates heat when in use. It is important to transfer this heat outward from the device to keep the device at an optimal temperature for correct operation. As the processing power of IT increases, and thus the number of electronic devices within a computer, server, or other IT, the challenge of removing enough heat generated by the electronic devices increases.

[0004] Electronic devices, typically implemented on a printed circuit board (PCB), are typically housed or enclosed within a case or chassis to form an electronic module. For example, a computer server often comprises multiple electronic modules mounted in a rack and connected together to provide the necessary IT facilities. To maintain the electronic devices within the chassis at the proper temperature, a method of removing heat from each case or chassis is required.

[0005] It is common to cool electronic modules by passing air over or through their respective cases or chassis. The airflow can be sufficient to remove some heat from inside the enclosure to the surrounding environment. Until recently, this cooling method has been used almost exclusively for mass-produced IT and server equipment. However, as technological size for the same performance has decreased, it has been found that the heat generated by electronic devices has increased even though their footprint has decreased. Thus, the peak performance of IT systems has been held back by the limitations of cooling electronic modules with air-cooled systems.

[0006] Thus, more complex systems and methods have been proposed for cooling electronic modules. In some cases, liquid cooling has been used, in which a liquid coolant is flowed over or in close proximity to a heat sink coupled to an electronic device. Heat can then be transferred outward from the electronic device to an area or element that can remove the heat from the liquid coolant. Liquid cooling can in some cases provide a more efficient transfer of heat outward from an electronic device or component, and therefore provide greater cooling capacity than air-cooled systems. However, prior art liquid cooling systems often require customized systems that are complex and expensive to install. Summary of the Invention [Problem to be solved by the invention]

[0007] It is therefore an object of the present invention to provide a system for cooling electronic modules, and also a method for cooling such a system, that overcomes these drawbacks of the prior art systems. [Means for solving the problem]

[0008] SUMMARY OF THE DISCLOSURE Against this background, a system and method for cooling a plurality of electronic devices housed within a housing of an electronic module is provided. In particular, the system comprises a first cooling circulation device and a second cooling circulation device, or a first cooling loop and a second cooling loop, each of which circulates a respective first liquid coolant and a second liquid coolant. Each of the cooling circulation systems is used to cool the electronic devices of the plurality of devices within the electronic module. Meanwhile, the second cooling circulation device is further configured to cool the coolant circulating within the first cooling circulation system by exchanging heat between the first liquid coolant and the second liquid coolant via a heat exchanger. The first cooling circulation device and the second cooling circulation device may have different efficiencies, and thus the more efficient cooling provided by the second cooling circulation device may be used to cool the first liquid coolant. Furthermore, the more efficient second cooling circulation device may be focused on a particular high-power electronic device (which generates relatively more heat). The first liquid coolant may be used to maintain a generally lower temperature for the entire environment within the electronic module.

[0009] In a preferred example, the second cooling circulation device may include a cold plate that may be thermally coupled to a particular electronic device of the plurality of electronic devices. In comparison, the first cooling circulation system may circulate a first liquid coolant partially contained in a reservoir within the electronic module, with some electronic devices being at least partially immersed in the reservoir of the first liquid coolant. Furthermore, the inclusion of a weir or bath heat sink within the first cooling circulation system may provide additional advantages to the described systems and methods, as described below.

[0010] In a first aspect, a system for cooling a plurality of electronic devices contained within a housing of an electronic module, comprising: a first cooling circulation apparatus configured to circulate a first liquid coolant between a first electronic device of the plurality of electronic devices and a heat exchanger, the first electronic device being thermally coupled to the first liquid coolant such that heat is transferred from the first electronic device to the first liquid coolant; a second cooling circulation apparatus configured to circulate a second liquid coolant between a second electronic device of the plurality of electronic devices and a heat exchanger, the second electronic device being thermally coupled to the second liquid coolant such that heat is transferred from the second electronic device to the second liquid coolant; Equipped with A system is described in which the first cooling circulation device and the second cooling circulation device are thermally coupled via at least a heat exchanger such that heat is transferred from the first liquid coolant to the second liquid coolant via the heat exchanger.

[0011] An electronic device may be any heat-generating device or component, including integrated circuits (ICs) including central processing units (CPUs), application specific integrated circuits (ASICs), graphics processing units (GPUs), random access memories (RAMs), etc. Devices may be connected together to form a server or other computer processing functionality, or other IT.

[0012] An electronics module or server module may be a module that forms part of a computer server. The electronics module may have a chassis or housing in which each of the electronic devices is mounted. The electronics module may be configured to be mounted or installed in a rack. For example, the electronics module may conform to industry standard dimensions required to fit into a standard server rack (known as 1RU (one rack unit) or 1OU (one open unit)). Such a unit may be referred to as a blade server.

[0013] The system includes a first cooling circulation device and a second cooling circulation device (or a first cooling loop and a second cooling loop), the cooling circulation devices providing an arrangement for flow of respective first and second coolants through the electronic module.

[0014] Specifically, the first cooling circulation system circulates or flows a first liquid coolant from at least a first electronic heat generating device (from which heat is absorbed by the first liquid coolant) to a heat exchanger where heat can be removed from the first liquid coolant.

[0015] The second cooling circulation system circulates or flows the second liquid coolant from at least a second electronic heat generating device (where heat is absorbed by the second liquid coolant) to a heat exchanger where heat from the first liquid coolant is received by the second liquid coolant.

[0016] In some cases, the second cooling circuit may be closed (in other words, the liquid coolant is recirculated and recycled within the loop), but this is not always the case. In alternative cases, the second cooling circuit may represent an open loop in which the liquid coolant is received, flows around the described path, and then sent to a drainage system. For example, after passing through the heat exchanger, the second liquid coolant in the second cooling circuit may be cooled (by passing through a cooling system before returning to the electronics module) or replenished (e.g., if the second liquid coolant is part of a facility-wide coolant supply facility, such as a facility water supply).

[0017] Advantageously, the system described is a hybrid system of two cooling circuits. The use of such a hybrid system allows for a higher performance and more efficient cooling arrangement, especially for the hot components (at least the second cooling circuit for the second electronic device), as well as the use of further cooling arrangements for cooling other devices. However, rather than simply using two completely separate cooling systems in parallel, the inventors have realized that the return flow of the higher performance cooling device can also be used to remove heat from the other, less powerful cooling device. To some extent, the first cooling circuit can be considered nested with the second cooling circuit.

[0018] Optionally, the first liquid coolant is a dielectric liquid and the second liquid coolant is water. Although the term liquid coolant is used herein, it will be understood that any suitable fluid coolant may be used.

[0019] Optionally, the second cooling circulation device further comprises a cooling system, the second cooling circulation device is configured to circulate a second liquid coolant between a second electronic device of the plurality of electronic devices, the heat exchanger, and the cooling system, and heat is removed from the second liquid coolant by the cooling system. Preferably, the cooling system is arranged to be external to the electronic module. In other words, the second cooling circulation device forms a closed loop, and the second liquid coolant received from the electronic module is cooled by the cooling system before being returned to the electronic module for cooling the second electronic device.

[0020] Alternatively, the second cooling circulation device is connected to a second liquid coolant supply facility, and the second cooling circulation device is configured to circulate the second liquid coolant received from the second liquid coolant supply facility between a second electronic device of the plurality of electronic devices and the heat exchanger and return to the second liquid coolant supply facility. In other words, the second cooling circulation device is open loop, and the second liquid coolant is supplied from a facility-level supply facility and is constantly replenished. For example, the second liquid coolant supply facility may be a water facility, from which water is received (as the second liquid coolant), circulated through the second cooling circulation device, and then exits the second cooling circulation device to a facility drain.

[0021] Preferably, the heat exchanger comprises at least a first chamber and a second chamber separated by a thermal interface, the heat exchanger being configured for flow of a first liquid coolant through at least the first chamber and a second liquid coolant through at least the second chamber such that heat is transferred from the first liquid coolant to the second liquid coolant through the thermal interface. The heat exchanger is a dedicated element configured to exchange heat between the first liquid coolant and the second liquid coolant. Each of the first liquid coolant and the second liquid coolant can pass through one or more dedicated chambers of the heat exchanger, and heat can pass from the first liquid coolant to the second liquid coolant through the thermal interface between the chambers. The heat exchanger may be of any suitable design and may provide multiple chambers and multiple thermal interfaces to improve the efficiency of the heat exchange. The thermal interfaces may be provided with fins or other protrusions to increase the surface area of ​​the thermal interfaces and promote the efficiency of the heat exchange between the first liquid coolant and the second liquid coolant. Optionally, the heat exchanger is a plate heat exchanger.

[0022] Preferably, the heat exchanger is arranged within the housing of the electronic module. In particular, the heat exchanger is housed within the electronic module. This allows at least the first liquid coolant to be kept entirely within the electronic module. This reduces the complexity of the connections to and from the electronic module. This also allows the electronic module to be provided as a sealed module, which may be advantageous if the second liquid coolant is a dielectric, which may be harmful to humans if released from the module and may be expensive to replace in case of leakage or loss.

[0023] Optionally, the first cooling circulation device is entirely contained within the housing of the electronic module, in other words, the first cooling circulation device is arranged such that the first liquid coolant does not leave the confines of the housing of the electronic module during normal operation.

[0024] The first cooling circulation device can be at least partially insulated from the second cooling circulation device in the portion of the second cooling circulation device before the second liquid coolant is circulated to the second electronic device, where the second liquid coolant is at its coldest. The first cooling circulation device can be at least partially insulated from the second cooling circulation device, except for the heat exchanger to which the first cooling circulation device and the second cooling circulation device are thermally coupled. In other words, the return flow of the second cooling circulation device (in other words, after receiving heat from the second electronic device) is used to cool the first liquid coolant. This avoids increasing the temperature of the second liquid coolant before it reaches the second electronic device, in order to maximize the cooling capacity (or more specifically, the temperature gradient) in the second electronic device.

[0025] Optionally, the housing of the electronic module contains a first liquid coolant, and the first electronic device is at least partially immersed in the first liquid coolant. In other words, the first cooling circulation apparatus is an immersion cooling apparatus. Heat can be transferred directly to the first liquid coolant from a surface of the first electronic device that is at least partially immersed in the first liquid coolant. The portion of the second cooling circulation apparatus that includes the second electronic device may also be at least partially immersed in the first liquid coolant.

[0026] In contrast, the second cooling circulation apparatus may be configured to circulate a second liquid coolant through a cooling module and a heat exchanger, the cooling module being mounted to the second electronic device at a mounting surface of the cooling module, such that heat is indirectly exchanged between the second electronic device and the second liquid coolant via the mounting surface of the second cooling module. The cooling module forming part of the second cooling circulation apparatus is described in more detail below.

[0027] In a preferred embodiment, the first cooling circuit comprises a weir, the weir comprising: a base and a retaining wall extending from the base, the base and the retaining wall defining a volume for retaining a portion of the first liquid coolant; an inlet through which a first liquid coolant enters the volume; Equipped with Flow of sufficient first liquid coolant through the inlet and into the volume causes the first liquid coolant to overflow the retaining wall and merge with the first liquid coolant contained within the housing of the electronics module and external to the weir.

[0028] The base and the retaining wall can provide a container or "bath" from which the first coolant can overflow. The weir can be coupled to a surface of the first electronic device to act as a heat sink for the first electronic device. The weir thus provides a volume for maintaining or holding the liquid coolant against the heat-generating electronic device. Alternatively or additionally, the weir may be mounted on the PCB elevated relative to other components in the electronic device and / or relative to the level of the first coolant in the cavity of the housing of the electronic module. In this way, the first liquid coolant, upon overflowing the weir, acts to flow over the first electronic device and some other electronic devices or components housed within the electronic module.

[0029] The weir can be configured to direct the flow of the first liquid coolant circulating through the first cooling circulation device. In other words, the weir can be configured to allow the first liquid coolant overflowing the weir to flow to or over a particular electronic device housed within the electronic module. Advantageously, by including the weir in the first cooling circulation device, the liquid coolant can be more effectively applied to the location or locations where the most heat is generated. Thus, less coolant can be used. Because coolant is expensive and heavy, reducing the amount of coolant can improve flexibility, efficiency, and reliability (e.g., because coolant leaks are less likely to occur and the coolant in the volume can withstand momentary temperature changes caused by the failure of other components in the system).

[0030] With respect to the weir, a volume for maintaining or retaining a first liquid coolant can be defined by a base and a retaining wall (which may be integral or separate). The base is the portion of the weir that can be mounted on top of an electronic device (more specifically, a heat transfer surface of the electronic device) and transfers heat from the heat transfer surface. The base typically has a flat surface that defines the volume (and the base itself may be of flat shape). Heat transferred (typically conducted) through the base (particularly its surface that defines the volume) is transferred to the liquid coolant maintained within the volume. The retaining wall extends from the base.

[0031] One effect of the weir is to make the level of coolant maintained within the weir volume higher than outside that volume (at least when the cooling module is operated with the plane of the electronic device and / or circuit board horizontal) and to make the amount of coolant within the cooling module's container lower than the height of the retaining wall.

[0032] Advantageously, the heat sink has protrusions (such as pins and / or fins) extending from the base (or, less preferably, from the retaining wall) within the volume. The protrusions can spread the liquid coolant radially outwardly (e.g., coincident with the hottest portion of the electronic device) from a predetermined point on the surface of the base. In particular, the protrusions can be formed in a non-linear pattern.

[0033] Preferably, the inlet to the weir further comprises a nozzle arrangement for directing the first liquid coolant flowing into the volume. The nozzle arrangement may comprise one or more nozzles (which may be push-in type), each of which directs the flowing or pumped first liquid coolant into a respective portion of the weir volume, in particular a portion of the base of the weir. The one or more nozzles may each be arranged in the base, in the retaining wall, or on the top of the volume to direct the first liquid coolant into the volume. For example, each nozzle may direct the flowing or pumped liquid coolant into a respective portion of the weir volume adjacent to a portion of the heat transfer surface of the electronic device having a maximum temperature or a temperature above a threshold level (i.e. one of the hottest portions of the device). Most preferably, the nozzle arrangement directs the flowing or pumped liquid coolant in a direction perpendicular to the base of the weir. This allows the coolant to be directly pushed into the volume, improving heat dissipation.

[0034] Preferably, the first cooling circulation apparatus further comprises a pump configured to circulate the first liquid coolant around the first cooling circulation apparatus. The pump can be configured to receive the first liquid coolant from a reservoir of liquid coolant contained within the electronic module, with at least the first electronic device being at least partially submerged. The pump can then move the received first liquid coolant to another region of the electronic module, for example a heat exchanger, and then to the inlet of the weir. The pump can be at least partially submerged in the first liquid coolant, whereby the first liquid coolant also assists in cooling the pump.

[0035] The first cooling circulation device may further comprise a pump inlet arranged to receive a first liquid coolant contained within the housing of the electronic module and outside the weir, in other words, the first liquid coolant contained within the electronic module may be received by the pump inlet and delivered to the pump.

[0036] Preferably, the first cooling circulation device further comprises at least a first pipe and a second pipe configured to transport the first liquid coolant from the pump to the heat exchanger and from the heat exchanger to the inlet of the weir, respectively.

[0037] Preferably, the second cooling circulation device further comprises a cooling module configured to thermally couple the second electronic device to the second liquid coolant. The cooling module can be a specific component for efficient heat transfer from the second electronic device to the second liquid coolant. The cooling module can be mounted on the second electronic device via a mounting surface of the cooling module, so that heat is transferred from the second electronic device to the second liquid coolant through the mounting surface.

[0038] Preferably, the cooling module comprises a cold plate, the cold plate comprising: a cold plate housing, a surface of the cold plate housing configured to provide a thermal interface for cooling a second electronic device thermally coupled to the cold plate housing; at least one channel within the cold plate housing proximate a surface of the cold plate housing, the at least one channel configured to allow a second liquid coolant to flow through the channel such that heat received through the surface of the cold plate housing from a second electronic device is transferred to the second liquid coolant; Equipped with.

[0039] Advantageously, the cold plate provides an efficient and effective mechanism for cooling a particular electronic device within an electronic module. The cold plate provides high performance cooling to a second electronic device to which it is thermally coupled. Thus, the cold plate can be coupled to one or more of the hottest components within an electronic module to provide maximum cooling power to those components.

[0040] Optionally, a surface of the cold plate housing may be directly coupled to a surface of the second electronic device. Alternatively, the housing may be coupled by additional interfaces or components. Nevertheless, the cold plate and the second electronic device are thermally coupled to facilitate effective and efficient heat transfer from the second electronic device to the second liquid coolant.

[0041] Two or more cold plates can be arranged in the electronic module as part of the second cooling circuit. Two or more cold plates can be arranged in parallel or series in the second cooling circuit, or a combination of parallel and series configurations can be implemented when three or more cold plates are used.

[0042] Preferably, the second cooling circulation device comprises a plurality of conduits configured to transport a second liquid coolant between the cold plate and the heat exchanger and to connect to any cooling system or coolant supply external to the electronic module.

[0043] In a second aspect, a method for cooling a plurality of electronic devices contained within a housing of an electronic module, comprising: circulating a first liquid coolant around a first cooling circulation apparatus, the first liquid coolant including circulating the first liquid coolant between a first electronic device of the plurality of electronic devices and a heat exchanger, the first electronic device being thermally coupled to the first liquid coolant such that heat is transferred from the first electronic device to the first liquid coolant; circulating a second liquid coolant around a second cooling circulation apparatus, the second liquid coolant including circulating the second liquid coolant between a second electronic device of the plurality of electronic devices and a heat exchanger, the second electronic device being thermally coupled to the second liquid coolant such that heat is transferred from the second electronic device to the second liquid coolant; Including, A method is described in which the first cooling circulation device and the second cooling circulation device are thermally coupled via at least a heat exchanger such that heat is transferred from the first liquid coolant to the second liquid coolant via the heat exchanger.

[0044] In other words, the method can include circulating a first liquid coolant through a first cooling circulation device and circulating a second liquid coolant through a second cooling circulation device. Each of the first and second cooling circulation devices is configured to cool at least the respective first and second electronic devices. Furthermore, the second cooling circulation device is configured such that the second liquid coolant receives heat transferred from the first liquid coolant in a heat exchanger. Advantageously, this hybrid cooling system provides the benefits of a high-performance cooling system for the hottest components (the second cooling circulation device targeting the first electronic device), but then uses an additional cooling system to cool other components in the electronic module. In particular, it may be impractical to equip all components in the electronic module with a targeted cooling system (such as that provided by the second cooling circulation device), and therefore the first cooling circulation device can provide an additional cooling system for the remaining components to reduce the temperature of the general environment in the electronic module. Additionally, the return flow of the high performance second cooling circuit can itself be used to remove heat from the first cooling system.

[0045] It will be appreciated that the features described above with respect to the system may also be considered to be disclosed in the use of a method for cooling a plurality of electronic devices contained in a housing of an electronic module.

[0046] In particular, preferably, the second cooling circulation device further comprises a cooling system, and the step of circulating the second liquid coolant around the second cooling circulation device comprises circulating the second liquid coolant between a second electronic device of the plurality of electronic devices, a heat exchanger and the cooling system, and heat is removed from the second liquid coolant by the cooling system. The cooling system may be external to the electronic module and may be configured to transfer heat outwardly from the second liquid coolant. For example, the cooling system may comprise a heat exchanger for transferring heat to a further (third) coolant liquid or medium.

[0047] Alternatively, the second cooling circulation device further comprises a second liquid coolant supply facility, and the step of circulating the second liquid coolant around the second cooling circulation device includes receiving the second liquid coolant from the second liquid coolant supply facility, circulating the second liquid coolant between a second electronic device of the plurality of electronic devices and the heat exchanger, and then returning it to the second liquid coolant supply facility. For example, the second liquid coolant may be water, and the second cooling circulation device may be connected to a facility water supply. Once the water has been circulated through the second cooling circulation device, it may enter a drainage system (and thus not be recirculated through the second cooling circulation device).

[0048] The heat exchanger may comprise at least a first chamber and a second chamber separated by a thermal interface, the heat exchanger configured for flow of a first liquid coolant through at least the first chamber and a second liquid coolant through at least the second chamber such that heat is transferred from the first liquid coolant to the second liquid coolant through the thermal interface. A heat exchanger is a specific element configured to efficiently transfer heat between the first liquid coolant and the second liquid coolant. The heat exchanger may be of any suitable design for allowing flow of the first liquid coolant and the second liquid coolant therethrough and exchanging heat therebetween. Optionally, the heat exchanger is a plate heat exchanger.

[0049] Preferably, the heat exchanger is located or housed within the housing of the electronic module. Advantageously, this prevents the first liquid coolant from exiting the electronic module. This reduces the complexity of the connections in the housing of the electronic module, as well as reducing the risk of leakage or loss of the first liquid coolant.

[0050] Preferably, the first cooling circulation device and the second cooling circulation device are thermally coupled through a heat exchanger in the return flow of the second cooling circulation device. In other words, the first cooling circulation device and the second cooling circulation device are thermally coupled through a heat exchanger so that the second liquid coolant passes through the heat exchanger after receiving heat from the second electronic device (considering that the coldest second liquid coolant is found at the start of the second cooling circulation device). The first cooling circulation device can be at least partially insulated from the second cooling circulation device before the heat exchanger. This provides the largest possible temperature gradient between the second liquid coolant and the second electronic device.

[0051] Preferably, the housing of the electronic module contains a first liquid coolant and the first electronic device is at least partially immersed in the first liquid coolant. In other words, the housing of the electronic device contains a reservoir of the first liquid coolant in which the first electronic device is at least partially immersed. Thus, heat is transferred directly to the first liquid coolant from a surface of the first electronic device that is at least partially immersed in the first liquid coolant.

[0052] Preferably, the first cooling circuit device comprises a weir. a base and a retaining wall extending from the base, the base and the retaining wall defining a volume for retaining a portion of the first liquid coolant; an inlet through which a first liquid coolant enters the volume; Equipped with Flow of sufficient first liquid coolant through the inlet and into the volume causes the first liquid coolant to overflow the retaining wall and merge with the first liquid coolant contained within the housing of the electronics module and external to the weir.

[0053] Advantageously, the weir acts to facilitate flow of the first liquid coolant within the electronic module. The weir may be further configured to direct flow of the first liquid coolant circulating through the first cooling circulation device to the particular electronic component.

[0054] In a particularly preferred example, the base of the weir can be thermally coupled to the first electronic device. In this manner, the weir acts as an effective heat sink for the first electronic device. The weir also maintains a flow of a first liquid coolant that can cool heat-generating components disposed about the first electronic device to which the weir is coupled.

[0055] The inlet further comprises a nozzle arrangement for directing the first liquid coolant flowing into the volume. The nozzle arrangement comprises one or more nozzles.

[0056] The weir may further comprise a protrusion extending from the base and / or the retaining wall within the volume of the weir.

[0057] The method may further include providing a pump in the first cooling circulation device, the pump configured to circulate the first liquid coolant around the first cooling circulation device. The first cooling circulation device may further include a pump inlet positioned to receive the first liquid coolant contained within the housing of the electronic module and outside the weir.

[0058] The method may further include providing a plurality of pipes in the first cooling circulation device configured to transport the first liquid coolant from the pump to the heat exchanger and from the heat exchanger to the inlet of the weir, respectively.

[0059] Preferably, the method includes providing a cooling module in the second cooling circulation apparatus configured to thermally couple the second electronic device to the second liquid coolant. The cooling module may be mounted or coupled to a surface of the second electronic device. The cooling module may provide a mechanism for indirect transfer of heat from the second electronic device to the second liquid coolant via the cooling module (in other words, the second liquid coolant is not in direct contact with a surface of the second electronic device, but instead heat is transferred from the second electronic device through a portion of the cooling module and received in the second liquid coolant). The cooling module may provide a higher cooling capacity and assist in cooling the second electronic device more efficiently than may otherwise be provided by the first cooling circulation apparatus.

[0060] In a preferred example, the step of providing a cooling module in the second cooling circuit includes providing a cold plate, the cold plate comprising: a cold plate housing, a surface of the cold plate housing configured to provide a thermal interface for cooling a second electronic device thermally coupled to the cold plate housing; at least one channel within the cold plate housing proximate a surface of the cold plate housing, the at least one channel configured to allow a second liquid coolant to flow through the channel such that heat received through the surface of the cold plate housing from a second electronic device is transferred to the second liquid coolant; Equipped with.

[0061] There can be two or more cold plates that can be arranged in parallel or series within the second cooling circulation apparatus. A surface of the cold plate housing can be directly coupled to a surface of the second electronic device or can be coupled via an interface to facilitate efficient heat transfer.

[0062] The method may further include providing a plurality of conduits or pipes in the second cooling circuit configured to transport a second liquid coolant between the cold plate, the heat exchanger and the cooling system.

[0063] In yet a further aspect, a system for cooling an electronic module (or server module) configured for installation in a rack (or server rack) is described. The system comprises at least a first cold plate and a second cold plate (or a cold plate module or cold plate assembly) mounted in the electronic module through which a liquid coolant (which may be, for example, water or a dielectric fluid) circulates in a cooling loop. The first cold plate and the second cold plate are each disposed on a separate parallel branch of the cooling loop. While the liquid coolant circulates through the cold plates, heat is transferred from one or more electronic devices thermally coupled to the cold plates to the liquid coolant passing through each of the first cold plate and the second cold plate. A cooling system is connected in the cooling loop to remove or transfer heat outward from the liquid circulating in the cooling loop. The liquid coolant may be disposed either externally or internally to a chassis or housing of the electronic module.

[0064] In a further aspect, there is a system for cooling an electronic module configured for installation in a rack, comprising a first cold plate and a second cold plate mounted within a module housing of the electronic module. Each cold plate comprises a housing, a surface of the housing configured to provide a thermal interface for cooling an electronic device thermally coupled thereto. Each cold plate further includes at least one channel within the housing and proximate the surface configured for liquid coolant to flow therethrough such that heat received by the thermal interface is transferred to the liquid coolant. The first and second cold plates of the system are coupled in parallel within a cooling loop, the cooling loop configured to circulate the liquid coolant.

[0065] Preferably, the system further comprises a cooling system configured to remove heat from the liquid coolant, and a plurality of conduits coupled to the first and second cold plates and the cooling system for transporting the liquid coolant circulating in the cooling loop between the first and second cold plates and the cooling system. The conduits may be pipes or tubing, which are preferably flexible to allow for placement of the conduits around the components in the electronic module. The pipes may have small bore sizes or diameters (e.g., 2-20 mm, more preferably 3-10 mm) to aid placement within an existing configuration of components in the electronic module. This is also beneficial to allow for the passage of the pipes or tubes through existing holes, openings or apertures in the module housing or chassis. The cooling system may comprise at least a heat exchanger for transferring heat from the liquid coolant to another cooling medium (such as a second liquid coolant, or air). The cooling system may be located within the housing or chassis of the electronic module, or may be located external to the module.

[0066] Preferably, the plurality of conduits comprises at least a first input conduit coupled to the first cold plate, a second input conduit coupled to the second cold plate, a supply conduit to which the first input conduit and the second input conduit are coupled in parallel, a first output conduit coupled to the first cold plate, a second output conduit coupled to the second cold plate, and a receiving conduit to which the first output conduit and the second output conduit are coupled in parallel. In other words, the plurality of conduits includes at least conduits forming a first and a second parallel branch of the cooling loop (the first input conduit and the first output conduit, and the second input conduit and the second output conduit, respectively) and two further conduits for supplying or receiving liquid coolant to the parallel branches of the cooling loop.

[0067] The couplings between the first and second input conduits and the supply conduit, and the couplings between the first and second output conduits and the receiving conduit may both be located within the module housing, in which case the supply and receiving conduits are arranged to pass through an opening in a wall of the module housing. Alternatively, the couplings between the first and second input conduits and the supply conduit, and the couplings between the first and second output conduits and the receiving conduit may be located outside the module housing, in which case the first and second input conduits and the first and second output conduits are arranged to pass through an opening in a wall of the module housing.

[0068] Optionally, the system further comprises a manifold for coupling the first input conduit and the second input conduit to the supply conduit and / or for coupling the first output conduit and the second output conduit to the receiving conduit. Optionally, the system comprises a manifold for coupling the supply conduit to a first further conduit of the plurality of conduits and / or for coupling the receiving conduit to a second further conduit of the plurality of conduits. The manifold may be a unit for joining or coupling the conduits. Beneficially, the manifold may provide a more robust coupling. The manifold may be a single unit (with appropriate partitions) for coupling the input and supply conduits and the output and receiving conduits. However, two manifolds may be used, each associated with a supply side and a receiving side of the cooling loop.

[0069] The system may include at least one connector for connecting the first and second input conduits and / or the first and second output conduits to the manifold. The system may include at least one connector for connecting the supply conduit and / or the receiving conduit to the manifold. Any type of suitable connector may be used to connect the conduits to the manifold. In one example, a drip-free manual connector is used, which requires direct manual manipulation by the installer. In a further example, a blind-mate connector may be used, which is a push-fit connector that does not require specific manipulation to mate and seal the connectors together. A manually connected drip-free connector may advantageously interface with existing IT, since tubes can exit the module housing whenever there is an opening or aperture. A blind-mate connector requires a custom bracket for each electronic module, but may provide easier mating.

[0070] In one example, the system can include a bracket for securing the manifold to the module housing. In a further example, the system can include a bracket for securing the manifold to the rack. The mounting of the manifold to the electronics module on the rack can be selected according to the space available in the rack and the requirements of the system. The connection of the manifold to the electronics module can reduce movement and strain on the connections between the conduits. However, the connection of the manifold to the rack can be more compact and less likely to be banged up or encounter accidental damage.

[0071] In a particular advantageous example, the manifolds may be mounted to the rack within ducts defined within the rack for passing cables connected to the electronic modules. As mentioned above, the electronic modules and racks typically conform to industry standards. Generally, the rack includes a rear cavity, portion or duct through which electronic and data cables can be housed or passed before connecting to the individual electronic modules. This cavity or duct can be used to house one or more manifolds mounted therein. This provides a more robust system, with the manifolds protected and partially enclosed by the ducts. The walls of the ducts also provide suitable fastening points for the manifolds (especially since the ducts typically include pre-existing openings of holes for cable penetration or fastening).

[0072] Preferably, the system includes a third cold plate, which is coupled in series with either the first or second cold plate in the cooling loop. In fact, the system can include four or more or any number of cold plates. In particular, the system can include two or more cold plates on each parallel branch of the cooling loop. For example, the first parallel branch of the cooling loop can include a single first cold plate, and the second parallel branch of the cooling loop can include a second cold plate and a third cold plate, with the second cold plate and the third cold plate themselves being arranged in series. Three or more cold plates can be arranged in series on each parallel branch of the cooling loop.

[0073] Additionally, more than two parallel branches of a cooling loop may be disposed within an electronics module, with each parallel branch having one or more cold plates connected thereto. If more than one cold plate is disposed on a particular parallel branch of a cooling loop, the additional cold plates may be disposed in series on a given branch.

[0074] Advantageously, the described system may allow for the circulation of liquid coolant through the cold plates, for example, individually or in groups, in parallel or in series, or as a mixture of both.

[0075] In a further aspect, a method for cooling an electronic module configured for installation in a rack is described, the method including circulating a liquid coolant around a cooling loop, where a first cold plate and a second cold plate are coupled in parallel in the cooling loop, and the first cold plate and the second cold plate are contained within a module housing of the electronic module. Each of the first cold plate and the second cold plate comprises a housing, where a surface of the housing is configured to provide a thermal interface for cooling an electronic device thermally coupled to the housing, and at least one channel in the housing proximate to the surface, where the liquid coolant is configured to flow through the channel such that heat received by the thermal interface is transferred to the liquid coolant. Each of the features mentioned in this disclosure with respect to the system for cooling can be implemented by the method for cooling of this aspect.

[0076] The cooling system described in the present disclosure can be housed within a typical or standard electronic module (or server module) of the type configured for installation in a rack (or server rack). In particular, the described cooling system can be advantageously retrofitted to an existing electronic module (or panel of a server module in a server rack). The described cooling system can be used to replace an existing cooling system, such as a typical air-cooled system, in a generic or mass-produced server module. Such air-cooling systems typically include an air-cooled heat sink within the chassis of the server module, which can be removed and replaced with a cold plate described as part of the cooling system of the present disclosure. Thus, the "footprint" (i.e., the dimensions of each cold plate in the plane of the server module, e.g., 50 mm x 50 mm to 150 mm x 150 mm) may be the same or similar to a typical air-cooled heat sink used in this type of server module.

[0077] Advantageously, the disclosed cooling system based on liquid-cooled cold plates is more efficient and provides greater cooling capacity than the air-cooled systems it is intended to replace. Providing a more efficient cooling system for electronic or server modules allows a greater number of components to be included in a particular electronic module (thus improving space efficiency) and / or allows components within the electronic module to operate at higher power performance ratios. In particular, using the described cold plates (and cooling systems) allows components within the electronic module (such as CPUs) to operate at higher speeds and for longer because the described systems are more effective at removing heat. Thus, providing the described cooling system removes some of the limitations currently imposed on computing performance and use of space within electronic or server modules as a result of the challenges of adequate cooling found in prior art systems.

[0078] It is therefore particularly beneficial to retrofit the cooling system described in the present disclosure into existing electronic modules that previously utilized an alternative cooling system.Thus, in yet a further aspect, there is provided a method of installing a liquid-cooled system for an electronic module configured for installation in a rack, the method including the steps of removing an air-cooled heat sink contained within a module housing of the electronic module, mounting a cold plate within the module housing at the previous location of the air-cooled heat sink, coupling an input conduit to an inlet cooling port of the cold plate, coupling an output conduit to an outlet cooling port of the cold plate, and connecting the input conduit and the output conduit in a liquid coolant fluid loop such that liquid coolant circulating around the liquid coolant fluid loop passes through at least the input conduit, the cold plate, and the output conduit. Each of the first and second cold plates may comprise a housing, the surface of the housing configured to provide a thermal interface for cooling an electronic device thermally coupled to the housing, at least one channel in the housing proximate the surface, the at least one channel configured for liquid coolant to flow through the channel such that heat received by the thermal interface is transferred to the liquid coolant, an inlet coolant port extending to the exterior of the housing for transporting the liquid coolant to the at least one channel, and an outlet coolant port extending to the exterior of the housing for transporting the liquid coolant from the at least one channel. It will be appreciated that more than one cold plate may be installed according to this method. In particular, two or more air-cooled heat sinks may be removed from the electronic module and replaced with two or more respective cold plates. The two or more cold plates may be arranged in a parallel fit within the cooling loop (as described in the above embodiment) or, alternatively, may be arranged in series within the cooling loop.

[0079] Preferably, the method further comprises the step of positioning the input and output conduits to pass through openings in a wall of the module housing.

[0080] Preferably, the step of connecting the input conduit and the output conduit in the liquid coolant fluid loop may include coupling the input conduit to a first outlet port of the manifold, coupling the output conduit to a first inlet port of the manifold, coupling a supply conduit to a second inlet port of the manifold for transporting liquid coolant from the heat exchanger to the manifold, and coupling a receiving conduit to a second outlet port of the manifold for transporting liquid coolant from the manifold to the heat exchanger.

[0081] Optionally, the method further comprises securing the manifold to the rack, hi one example, securing the manifold to the rack comprises securing the manifold within a duct defined in the rack for routing cables connected to the electronic modules.

[0082] The method may further include connecting a heat exchanger between the supply conduit and the receiving conduit, the heat exchanger configured to transfer heat outwardly from the liquid coolant. The method may also include connecting a pump between the supply conduit and the receiving conduit, the pump configured to circulate the liquid coolant around the liquid coolant fluid loop.

[0083] Alternatively, for example, if no manifold is present in the cooling loop, a heat exchanger may be connected between the input and output conduits. Similarly, a pump may be connected between the input and output conduits. This example can be used when the entire cooling loop is present within the module housing of the electronics module. Thus, the pump, cooling system (or heat exchanger), and cold plate are all within the module housing. The cooling system can be used to transfer heat from the liquid coolant in the cooling loop outwardly to another medium (such as a second cooling loop arranged to pass through the housing).

[0084] In yet a further aspect, a kit is disclosed for use in the above-described installation method. The kit may include at least one cold plate, a first pipe for use as an input conduit, and a second pipe for use as a second conduit. The kit may include, for example, any of the components described above in connection with other aspects. The options, features, and advantages described above for each component apply to this aspect.

[0085] Preferably, the inlet and outlet coolant ports of the cold plate each include an independently rotating fluid connector, thereby allowing adjustment of the orientation of the first or second pipe coupled to the respective coolant port.

[0086] Preferably, the cold plate further comprises pins and / or fins disposed within the at least one channel. Optionally, the pins and / or fins are configured to extend from a bottom surface of the at least one channel proximal to a surface of the housing configured to provide a thermal interface to a top surface of the at least one channel distal to a surface of the housing configured to provide a thermal interface.

[0087] Preferably, the kit further comprises a manifold for connecting the input and output conduits in a liquid coolant fluid loop, the manifold comprising a first inlet port for coupling to the output conduit, a first outlet port for coupling to the input conduit, a second inlet port for receiving liquid coolant at the manifold through a supply conduit, and a second outlet port for transferring liquid coolant from the manifold through a receiving conduit. Optionally, for example, two separate manifolds can be provided for coupling the input conduit to the supply conduit and the output conduit to the receiving conduit, respectively, with the two manifolds having appropriate ports.

[0088] Optionally, the manifold is configured to be secured to the rack, more preferably within a duct defined in the rack for passing cables for connection to the electronic modules.

[0089] The kit may further comprise a heat exchanger and / or a pump, which may be for connection between the supply conduit and the receiving conduit or for connection between the supply conduit and the receiving conduit, depending on the configuration of the cooling loop.

[0090] In yet a further example, there is a system for cooling an electronic module configured for installation in a rack, the system comprising: a first cooling loop through which a first liquid coolant is circulated, the first coolant loop comprising at least one cold plate; a second cooling loop through which a second liquid coolant is circulated; and a cooling system for transferring heat from the first liquid coolant to the second liquid coolant, the first coolant loop and the cooling system being contained within a housing of the electronic module.

[0091] The first and second cooling loops can be considered as a first and second cooling circulation device, respectively. Beneficially, the described configuration allows the first liquid coolant circulating through the at least one cold plate to be kept entirely within the electronic module (i.e., enclosed within the housing or chassis of the electronic module). In this way, no connection or disconnection to the first coolant loop is required when the electronic module is installed or removed from the rack, and the first coolant loop is "closed loop" throughout the entire installation process. Thus, the risk of leakage or loss of expensive and sometimes toxic coolant fluid can be reduced or avoided. Furthermore, a different type of coolant fluid (e.g., a more expensive dielectric liquid) can be used as the first liquid coolant, and a second, more abundantly available fluid (e.g., water) can be used as the second liquid coolant. While using water as the second liquid coolant can help enable high flow rates and increase cooling capacity, advantageously, the described configuration allows the second liquid coolant to be maintained away from any electrical components or electronic devices housed within the chassis.

[0092] Preferably, each cold plate comprises a housing, a surface of the housing configured to provide a thermal interface for cooling an electronic device thermally coupled to the housing, and at least one channel within the housing proximate to the surface, the channel configured for a first liquid coolant to flow through the channel such that heat received by the thermal interface is transferred to the first liquid coolant.

[0093] Optionally, the first coolant loop comprises a first cold plate and a second cold plate mounted within the housing of the electronic module, the first cold plate and the second cold plate being coupled in parallel within the first cooling loop.

[0094] Preferably, the first cooling loop further comprises a pump for circulating the first liquid coolant around the first cooling loop, the pump being contained within a housing or chassis of the electronic module.

[0095] Preferably, the cooling system is a heat exchanger. Optionally, the cooling system is the first cooling system and the second cooling loop further comprises a second cooling system for transferring heat outwardly from the second liquid coolant.

[0096] Preferably, the second cooling loop further comprises a pump for circulating the second liquid coolant around the second cooling loop.

[0097] The following numbered paragraphs provide illustrative examples only. 1. A system for cooling electronic modules configured for installation in a rack, comprising: a first cold plate and a second cold plate mounted within a module housing of the electronic module, each cold plate comprising: a housing, a surface of the housing arranged to provide a thermal interface for cooling an electronic device thermally coupled to the housing; at least one channel within the housing and proximate the surface, the at least one channel configured for liquid coolant to flow therethrough such that heat received by the thermal interface is transferred to the liquid coolant; The system, wherein the first cold plate and the second cold plate are coupled in parallel within a cooling loop, the cooling loop being configured to circulate a liquid coolant.

[0098] 2. The system of claim 1, further comprising: a cooling system configured to remove heat from a liquid coolant; and a plurality of conduits coupled to the first and second cold plates and the cooling system for transporting liquid coolant circulating in the cooling loop between the first and second cold plates and the cooling system.

[0099] 3. The system described in paragraph 2, wherein the cooling system comprises a heat exchanger for transferring heat from the liquid coolant to a further cooling medium.

[0100] 4. Multiple conduits have at least: a first input conduit coupled to the first cold plate; a second input conduit coupled to the second cold plate; a supply conduit to which the first input conduit and the second input conduit are coupled in parallel; a first output conduit coupled to the first cold plate; a second output conduit coupled to the second cold plate; a receiving conduit to which the first output conduit and the second output conduit are coupled in parallel; The system according to item 2 or 3, comprising:

[0101] 5. A coupling between the first and second input conduits and the supply conduit is disposed within the module housing; a coupling between the first and second output conduits and the receiving conduit disposed within the module housing; Item 5. The system of item 4, wherein the supply conduit and the receiving conduit are configured to pass through openings in a wall of the module housing.

[0102] 6. The coupling between the first and second input conduits and the supply conduit is located outside the module housing; a coupling between the first and second output conduits and the receiving conduit is disposed external to the module housing; Item 5. The system of item 4, wherein the first and second input conduits and the first and second output conduits are configured to pass through openings in a wall of the module housing.

[0103] 7. The system of claim 4 or 6, further comprising a manifold for coupling the first input conduit and the second input conduit to a supply conduit and / or for coupling the first output conduit and the second output conduit to a receiving conduit.

[0104] 8. The system of paragraph 7, further comprising at least one connector for connecting the first and second input conduits and / or the first and second output conduits to a manifold.

[0105] 9. The system of any one of claims 4 to 6, further comprising a manifold for coupling the supply conduit to a first further conduit of the plurality of conduits and / or for coupling the receiving conduit to a second further conduit of the plurality of conduits.

[0106] 10. The system of claim 9, further comprising at least one connector for connecting a supply conduit and / or a receiving conduit to the manifold.

[0107] 11. The system of any one of claims 7 to 10, further comprising a bracket for securing the manifold to the module housing.

[0108] 12. The system of any one of claims 7 to 11, further comprising a bracket for fixing the manifold to the rack.

[0109] 13. The system of claim 12, wherein the manifold is configured to be secured to the rack within a duct defined in the rack for passing cables connected to the electronic modules.

[0110] 14. The system of any one of claims 1 to 13, further comprising a third cold plate, the third cold plate being coupled in series with either the first cold plate or the second cold plate in the cooling loop.

[0111] 15. A method for cooling an electronic module configured for installation in a rack, comprising: The method includes circulating a liquid coolant around a cooling loop, the first cold plate and the second cold plate being coupled in parallel within the cooling loop, the first cold plate and the second cold plate being contained within a module housing of the electronic module, and each of the first cold plate and the second cold plate being: a housing, a surface of the housing configured to provide a thermal interface for cooling an electronic device thermally coupled to the housing; at least one channel within the housing and proximate the surface configured for liquid coolant to flow therethrough such that heat received by the thermal interface is transferred to the liquid coolant; A method comprising:

[0112] 16. A method of installing a liquid cooling system for electronic modules configured for installation in a rack, comprising: Removing an air-cooled heat sink contained within a module housing of the electronic module; Mounting a cold plate within the module housing at the previous location of the air-cooled heat sink, the cold plate comprising: a housing, a surface of the housing configured to provide a thermal interface for cooling an electronic device thermally coupled to the housing; at least one channel within the housing proximate the surface, the at least one channel configured for flow of a liquid coolant such that heat received by the thermal interface is transferred to the liquid coolant; an inlet coolant port extending outside the housing for transporting liquid coolant to the at least one channel; an outlet coolant port extending to an exterior of the housing for transporting liquid coolant from the at least one channel; mounting a cold plate; coupling an input conduit to an inlet cooling port of a cold plate; coupling an output conduit to an outlet cooling port of the cold plate; connecting an input conduit and an output conduit in a liquid coolant fluid loop such that liquid coolant circulating around the liquid coolant fluid loop passes through at least the input conduit, the cold plate, and the output conduit; A method comprising:

[0113] 17. The method of claim 16, further comprising positioning the input and output conduits to pass through openings in a wall of the module housing.

[0114] 18. The step of connecting an input conduit and an output conduit in a liquid coolant fluid loop comprises: coupling an input conduit to a first outlet port of a manifold; coupling an output conduit to a first inlet port of a manifold; coupling a supply conduit to a second inlet port of the manifold for transporting liquid coolant from the heat exchanger to the manifold; coupling a receiving conduit to the second outlet port of the manifold for transporting liquid coolant from the manifold to the heat exchanger; Item 18. The method according to item 16 or 17, comprising:

[0115] 19. The method of claim 18, further comprising the step of securing the manifold to a rack. 20. The method of claim 19, wherein the step of fixing the manifold to the rack includes fixing the manifold within a duct defined in the rack for passing cables connected to the electronic modules.

[0116] 21. The method further includes connecting a heat exchanger between the supply conduit and the receiving conduit; 21. The method of any one of clauses 18 to 20, wherein the heat exchanger is configured to transfer heat outwardly from the liquid coolant.

[0117] 22. The method of any one of clauses 18 to 21, wherein the method further includes connecting a pump between the supply conduit and the receiving conduit, the pump configured to circulate the liquid coolant around the liquid coolant fluid loop.

[0118] 23. The method of any one of clauses 16 or 17, wherein the method further includes a step of connecting a heat exchanger between the input conduit and the output conduit, the heat exchanger being configured to transfer heat outwardly from the liquid coolant.

[0119] 24. The method of claim 16, 17 or 23, wherein the method further includes connecting a pump between the input conduit and the output conduit, the pump configured to circulate the liquid coolant around the liquid coolant fluid loop.

[0120] 25. A kit for use in the installation method according to any one of items 16 to 24, A cold plate; a first pipe for use as an input conduit; a second pipe for use as a second conduit; A kit comprising:

[0121] 26. The kit described in paragraph 25, wherein the inlet and outlet coolant ports of the cold plate each have an independently rotating fluid connector, thereby allowing adjustment of the direction of the first pipe or second pipe coupled to the respective coolant port.

[0122] 27. The kit of claim 25 or 26, wherein the cold plate further comprises pins and / or fins disposed within at least one channel.

[0123] 28. The kit of paragraph 27, wherein the pins and / or fins are configured to extend from a bottom surface of at least one channel proximal to a surface of the housing configured to provide a thermal interface to a top surface of at least one channel distal to a surface of the housing configured to provide a thermal interface.

[0124] 29. The kit further comprises a manifold for connecting the input conduit and the output conduit in a liquid coolant fluid loop, the manifold comprising: a first inlet port for coupling to an output conduit; a first outlet port for coupling to an input conduit; a second inlet port for receiving liquid coolant at the manifold through a supply conduit; a second outlet port for transferring liquid coolant from the manifold through a receiving conduit; The kit according to any one of items 25 to 28, comprising:

[0125] 30. The kit of claim 29, wherein the manifold is configured to be secured to the rack within a duct defined in the rack for passing cables for connection to the electronic modules.

[0126] 31. The kit according to paragraph 29 or 30, further comprising a heat exchanger for connection between the supply conduit and the receiving conduit.

[0127] 32. A kit as described in any one of clauses 29 to 31, wherein the kit further comprises a pump for connection between the supply conduit and the receiving conduit, the pump configured to circulate the liquid coolant around the liquid coolant fluid loop.

[0128] 33. The kit according to any one of claims 25 to 29, further comprising a heat exchanger for connection between the input conduit and the output conduit.

[0129] 34. The kit of any one of paragraphs 25-29 or 33, wherein the kit further comprises a pump for connection between the supply conduit and the receiving conduit, the pump configured to circulate liquid coolant around the liquid coolant fluid loop.

[0130] BRIEF DESCRIPTION OF THE DRAWINGS The present disclosure can be practiced in many ways and preferred embodiments will now be described, by way of example only, with reference to the accompanying drawings in which: [Brief description of the drawings]

[0131] [Figure 1] FIG. 1 is a plan view of an electronic module housing containing multiple electronic devices cooled by the described system. [Diagram 2] FIG. 2 is a perspective view of the electronic module of FIG. 1; [Diagram 3] FIG. 3 is a second, different perspective view of the electronic module of FIGS. 1 and 2. [Figure 4A] FIG. 2 is a schematic diagram of a first example of a second cooling circuit device. [Figure 4B] FIG. 4 is a schematic diagram of a second example of the second cooling circuit device. [Diagram 5] FIG. 1 is a schematic diagram of multiple electronic modules mounted in a rack. [Figure 6] FIG. 2 is a perspective view of a weir in the first cooling circuit; [Figure 7] FIG. 13 is an exploded view of a weir in the first cooling circuit. [Figure 8] FIG. 2 is a cross-sectional view of a weir in the first cooling circuit. [Figure 9] FIG. 11 is a further view of the weir in the first cooling circuit. [Figure 10] FIG. 13 shows a further example of a weir in the first cooling circuit. [Figure 11] FIG. 13 shows yet a further example of a weir in the first cooling circuit. [Figure 12A] FIG. 1 is a schematic perspective view of an exemplary cold plate. [Figure 12B]FIG. 12B is a plan view of the internal structure of the example cold plate of FIG. 12A. [Figure 12C] FIG. 12B is a cross-sectional view of the example cold plate of FIG. 12A. [Figure 13A] FIG. 2 is a schematic diagram of a further example of the system. [Figure 13B] FIG. 2 is a schematic diagram of yet a further example of the system. [Figure 14] FIG. 2 is a top view of an exemplary electronic module or blade server having an exemplary cold plate mounted therein. [Figure 15] FIG. 2 is a perspective view of a second example of an electronic module or blade server having two exemplary cold plates mounted therein. [Figure 16] FIG. 16 is a plan view of a second example of the electronic module or blade server of FIG. 15. [Figure 17] FIG. 13 is a plan view of a third example of an electronic module or blade server having an exemplary cold plate mounted therein. [Figure 18] FIG. 13 is a plan view of a fourth example of an electronic module or blade server having an exemplary cold plate mounted therein. [Figure 19] FIG. 13 is a plan view of a fifth example of an electronic module or blade server with an exemplary cold plate mounted therein. [Figure 20] FIG. 13 is a plan view of a sixth example of an electronic module or blade server having an exemplary cold plate mounted therein. [Figure 21] FIG. 13 is a plan view of a seventh example of an electronic module or blade server having an exemplary cold plate mounted therein, including a manifold. [Figure 22] FIG. 13 is a plan view of an eighth example of an electronic module or blade server having an exemplary cold plate mounted therein, including a manifold. [Figure 23] FIG. 1 is a schematic diagram of an example of a single rack server cooling system according to the present disclosure. [Figure 24] FIG. 2 is a schematic diagram of a further example of a single rack server cooling system according to the present disclosure. [Diagram 25] FIG. 1 is a schematic diagram of a multi-server cooling system according to the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0132] In the drawings, like parts are designated by like reference numerals. The drawings are not drawn to scale.

[0133] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An electronic module 100 is described having a hybrid cooling system that includes two cooperating circulation loops of liquid coolant. Referring initially to Figure 1, a preferred embodiment of the electronic module 100, which may be a module or server blade, is shown, with appropriate dimensions and external connectors to fit within a typical server rack (not shown). The same electronic module 100 is shown in Figures 2 and 3, each showing a different perspective view of the module.

[0134] The electronic module has an outer housing or enclosure 110, which may have a base, walls and a lid, and may be sealable. Within the housing are mounted multiple electronic devices (or heat-generating components). In some cases, the components may be mounted on a printed circuit board (PCB) 120, which may be connected to the base, lid, or walls of the housing. The system described is intended to remove heat generated by the electronic devices from within the electronic module.

[0135] The first cooling circuit (or first cooling loop) is used to cool a particular electronic device among the plurality of electronic devices mounted in the electronic module. The second cooling circuit (or second cooling loop) is used to cool other heat-generating components. For example, the second cooling circuit may be provided with a larger cooling capacity and thus may be used to cool a particular component that generates a larger amount of heat than the component cooled by the first cooling circuit.

[0136] In the examples shown in Figures 1, 2 and 3, the electronic module has a first cooling circuit (or first cooling loop) that provides immersion cooling. The first cooling circuit is completely contained within the housing 110 of the electronic module. In particular, a first liquid coolant is contained within the sealable housing of the electronic module, such that several components 115 to be cooled are at least partially immersed in the first liquid coolant. The first liquid coolant contained in the volume of the housing of the electronic module can be considered as a reservoir of the first liquid coolant.

[0137] A first liquid coolant from a reservoir of first liquid coolant is collected or received at a pump input 190. The pump input 190 may be shaped to improve the flow of liquid coolant towards a pump 185. The pump 185 moves the first liquid coolant through a first cooling circulation system (or first cooling loop). The first liquid coolant that passes through the pump 185 moves through a pipe 195 to the heat exchanger 170 where it is cooled. In particular, as explained below, heat retained within the first coolant fluid can be transferred to a second coolant fluid, which is also passed through the heat exchanger. As will be appreciated, the first liquid coolant entering the heat exchanger is at a higher temperature than the first liquid coolant exiting the heat exchanger.

[0138] In the example of Figures 1, 2 and 3, a pipe 200 is connected to the heat exchanger to carry the first cooling fluid output from the heat exchanger 170. At the distal end of the pipe 200 are one or more outlets or nozzles 205a, 205b. In the particular example of Figures 1, 2 and 3, the outlets or nozzles 205a each form an inlet to a weir 202a, 202b. The weirs act as heat sinks and are part of the first cooling circulation system. The weirs are described in more detail below with respect to Figures 6-11.

[0139] The first cooling fluid passes outwardly from the outlets or nozzles 205a, 205b through the weirs 202a, 202b until it is collected in a reservoir of first liquid coolant contained within the volume of the housing 110 of the electronic module 100. In this manner, the cooler first cooling fluid that passed through the heat exchanger can be reintroduced into the bath or reservoir of first cooling fluid within the housing 110 to cool electronic components partially immersed in the reservoir. Specifically, the cooled first liquid coolant absorbs heat from the surfaces of the electronic devices (including the first electronic device with which it is in contact). Eventually, the first liquid coolant is again collected at the pump input, thereby completing its flow through the first cooling circulation system (or first cooling loop).

[0140] 1, 2 and 3 also show a second cooling circulation apparatus. The second cooling circulation apparatus incorporates one or more cold plates 125a, 125b, each mounted to one or more electronic devices 130a, 130b. Ideally, the electronic devices 130a, 130b require higher performance cooling. The cold plates 125a, 125b are modules or chambers through which a second cooling fluid (such as water) can be passed. Heat can be transferred from the electronic devices 130a, 130b to the second coolant fluid in the cold plates by conducting heat through the mounting surface of the cold plate coupled to a given electronic device. The cold plates 125a, 125b of the second cooling circulation apparatus are described in more detail below with respect to FIGS. 12A, 12B and 12C.

[0141] The second cooling circulation device of Figures 1, 2 and 3 has two cold plates connected in parallel. In particular, a single input conduit 135 is connected to an inlet 145 in the wall of the housing to receive the second coolant fluid input to the electronic module. The inlet 145 is provided with a connector, which may be any suitable type of connector, including a quick-disconnect connector. At the distal end, the single input conduit 135 is connected to an input manifold 150 to which two further input conduits 140a, 140b are connected. The further input conduits 140a, 140b are each connected to a respective cold plate 125a, 125b. In this way, the second coolant fluid can be transported in parallel to each of the cold plates 125a, 125b in the electronic module. The second liquid coolant is then passed through the cold plates, as described below in connection with Figures 12A, 12B and 12C.

[0142] An output conduit 155a, 155b is connected to each of the respective cold plates 125a, 125b. The output conduits 155a, 155b receive the second liquid coolant output in parallel from each of the cold plates 125a, 125b. The output conduits 155a, 155b are connected to an output manifold 160 which also has a single output conduit 165 connected thereto for transporting the second liquid coolant outwardly from the output manifold 160.

[0143] The single output conduit 165 is connected to a heat exchanger 170 as described above with respect to the first cooling circuit. The heat exchanger 170 is located entirely within the housing 110 of the electronics module. In the particular example of Figures 1, 2 and 3, the heat exchanger 170 is a plate heat exchanger and is connected to a wall of the housing 110. However, other suitable types of heat exchangers (described further below) may be used and may be located anywhere within the electronics module (or, less preferably, external to the electronics module).

[0144] The heat exchanger 170 may be of any suitable type that allows for heat exchange between a first coolant fluid and a second coolant fluid while maintaining separation (not mixing) of the two liquid coolants. For example, the heat exchanger may have a first chamber through which the first liquid coolant flows, the first chamber being separated from a second chamber through which the second coolant fluid flows. One or more walls separating the first and second chambers act as a thermal interface through which heat may be transferred. In particular, heat may be transferred from a hotter liquid coolant (in this example, the second liquid coolant under normal operation) to a cooler liquid coolant (in this example, the first liquid coolant under normal operation) as a result of a temperature gradient across the thermal interface. As may be envisioned by one skilled in the art, three or more chambers may be included within the heat exchanger, and two or more thermal interfaces may be provided to separate the chambers through which different liquid coolants flow. The heat exchanger may include fins or other features at the thermal interfaces to facilitate heat exchange.

[0145] Returning to Figures 1, 2 and 3, an output pipe 175 connected to the heat exchanger 170 is configured to receive the second liquid coolant that has passed through the heat exchanger. As will be appreciated, the second liquid coolant exiting the heat exchanger 170 will be at a higher temperature than the second liquid coolant entering the heat exchanger 170 as a result of heat absorption from the first liquid coolant within the heat exchanger 170. The output pipe 175 is connected to an outlet 180 in the wall of the electronics module housing 110. The outlet 180 includes a connector, which may be any suitable type of connector, including a quick disconnect connector.

[0146] 1, 2 and 3, inlet 145 and outlet 180 may each be connected to a cooling system or a second liquid coolant supply (e.g., by further pipes connected to inlet 145 and outlet 180, if necessary), as will be described in more detail below in relation to Figures 4A and 4B.

[0147] As will be appreciated, different devices within an electronic module may generate different amounts of heat than other components, and therefore require different cooling rates. Thus, the present invention provides a cooling system that provides effective and efficient cooling for all electronic devices within the electronic module. In particular, the second cooling circuit can provide high performance cooling for the hottest components, while the first cooling circuit can provide cooling for other components within the electronic module. While certain previous systems have described the use of a first cooling loop and a second cooling loop within an electronic module (e.g., as described in U.S. Pat. No. 7,724,524), the use of a heat exchanger to exchange heat between the first and second cooling circuits in the present application improves the overall efficiency of the cooling. In contrast, in prior art systems, cooling may be limited by exposing a reservoir of the first coolant to a cold plate cooled by the second coolant.

[0148] 4A and 4B show schematic diagrams of the first and second cooling circulation devices when the electronic module 100 is connected in a rack 400. The configurations of the first and second cooling circulation devices in the electronic module are the same for both examples of FIG. 4A and FIG. 4B and are aligned with the first and second cooling circulation devices of FIG. 1, FIG. 2 and FIG. 3 (except for providing only a single weir 202 in the first cooling circulation system example of FIG. 4A and FIG. 4B). However, the device for supplying the low-temperature second liquid coolant to the electronic module is different in the two examples of FIG. 4A and FIG. 4B.

[0149] Considering the common aspects first, Figures 4A and 4B show the first cooling circulation system described above, having a pump inlet 190, a pump 185, a heat exchanger 170, and a weir 202 for circulating a first liquid coolant 401 within the housing of the electronic module 100. Figures 4A and 4B further show the second cooling circulation device described above. In this configuration, the second liquid coolant 402 is received in the electronic module 100 through the inlet 145 and through conduits for supplying the coolant to two cold plates 125a, 125b arranged in parallel. After passing through the cold plates 125a, 125b, the second liquid coolant is transported through various conduits to the heat exchanger 170, where heat is transferred from the first liquid coolant to the second liquid coolant. From the heat exchanger 170, the second liquid coolant is discharged from the electronic module via the outlet 180. The inlet 145 and outlet 180 may each be connected to an inlet 405 or outlet 410 manifold, respectively, of a server rack 400 in which the electronic module 100 is mounted.

[0150] In the example of Fig. 4A, the cooling system 450 is connected as part of a second cooling circuit. In particular, the second liquid coolant exiting the outlet 180 of the electronic module and passing through the outlet manifold 410 is input to the cooling system 450. The cooling system 450 comprises a heat exchanger 455 and a pump 460. Heat is transferred from the second liquid coolant outwardly in the heat exchanger 455 to a further cooling medium 470, and the cooled second liquid coolant is pumped back to the inlet manifold 405 and the inlet 145 of the electronic module 100. The further cooling medium 470 may be, for example, air, or a further liquid coolant.

[0151] 4B, the second cooling circulation system may be provided with a lower temperature second liquid coolant by a facility level provision. In particular, the second liquid coolant is water and is provided at the facility level from a main water supply 490. The higher temperature second liquid coolant received from the electronics module may be passed to a main drain 495 at the facility level.

[0152] Figure 5 shows an example of several electronic modules 100 according to the examples of Figures 1, 2 and 3 mounted in a rack 400 of Figure 4A, where a second cooling circuit is connected to a rack level cooling system 450. In particular, several electronic modules are connected in parallel, with a single cooling system 450 (as described above in connection with Figure 4A) being used to cool a secondary liquid coolant supplied to each of the electronic modules 100 in the rack 400.

[0153] It will be appreciated that the second cooling circulation system for the multiple electronic modules mounted in rack 400 as shown in FIG. 5 can also be supplied with a lower temperature second liquid coolant by connecting to a facility-level cooling system, such as the facility-level water chilled water system supplied by a mains supply as shown in FIG. 4B.

[0154] The weir of the first cooling circulation system will now be described in more detail with reference to Figures 6-11. The weir provides particular advantages for directing and increasing the flow of the first liquid coolant in the first cooling circulation system. By using the weir, the first liquid coolant can be directed to flow over or through a particular area of ​​the electronic module and any electronic devices mounted therein. In some examples, the base of the weir can be coupled to the first electronic device (or another electronic device) and thus act as a heat sink for the coupled device. Additionally, the use of the weir allows for a reduction in the level of the first liquid coolant required at the electronic module, as described further below.

[0155] Referring first to FIG. 6, a first embodiment of a weir or weir heat sink for use in a first cooling circulation system is shown. Referring to FIG. 7, an exploded view of the embodiment of FIG. 6 is shown. Weir 600 comprises a base made up of mount 610 and planar substrate 615 fixed to mount 610, a retaining wall 620 attached to planar substrate 615, protrusions (shown in the form of pins) 625, and fixing screws 630 attaching substrate 615 to mount 610. In this way, planar substrate 615 is located directly on a high-temperature component, which may be first electronic device 635. Heat is thus transferred from first electronic device 635 to a volume defined by planar substrate 615 provided with protrusions 625 and retaining wall 620.

[0156] The dam heat sink 600 can be fabricated from a single component, for example, by die casting, lost wax casting, mold injection molding (MIM), additive manufacturing, or forging. The heat sink may also be machined or skived from a block of material. The dam heat sink 600 may be formed from any material that is thermally conductive, such as a metal or other thermal conductor. Some examples may include aluminum, copper, or carbon.

[0157] Also shown in Figures 6 and 7 is the inlet to the weir at the pipe 640 and nozzle 645. A first liquid coolant is delivered to the weir heat sink 600 via the nozzle 645. The nozzle 645 is positioned to direct the coolant perpendicular to the plane of the substrate 615. This forces a jet or stream of liquid coolant directly into the volume defined by the substrate 615 and the retaining wall 620 of the heat sink 600. This results in improved heat dissipation. This is especially true in comparison to systems such as air-cooled systems where the coolant is directed to flow over the heat sink in a direction parallel to the plane of the heat sink substrate.

[0158] 6 and 7, the nozzle 645 delivers coolant directly to the center of the volume defined by the substrate 615 and the retaining wall 620. In this example, the center of that volume corresponds to the hottest portion of the area of ​​the substrate 615 adjacent (and directly above) the hot component 635. This provides a reverse flow so that the coldest coolant is directed into contact with the hottest area of ​​the weir heat sink. The coolant travels radially outward from the hottest portion.

[0159] Referring to FIG. 8, a cross-sectional view of the weir heat sink of FIG. 6 in operation is shown. Features that are the same as those shown in the previous figures are identified by the same reference numbers. Arrows indicate the flow of coolant in pipes 640 to provide first liquid coolant 805 within the volume defined by substrate 615 and retaining wall 620 of heat sink 600 and to provide first liquid coolant 810 outside heat sink 1. As previously mentioned, the first liquid coolant exiting nozzle 645 is directed toward the center of the volume (corresponding to the center of the surface area of ​​substrate 615) and travels radially outward from there toward retaining wall 620. Sufficient first liquid coolant is pumped through nozzle 645 into the volume so that it overflows 810 over retaining wall 620 to join the remaining first liquid coolant 815 outside weir heat sink 600.

[0160] The retaining walls 620 acting as side walls allow for multiple different levels of coolant. A first liquid coolant 805 within the volume of the weir heat sink 600 is at a relatively high level, and a liquid coolant 815 that at least partially immerses multiple other electronic devices (not shown in this figure) within the electronic module is at a lower level. This allows for the use of significantly less liquid coolant than other similar systems that cover all components at the same height.

[0161] This achieves several advantages. First, if a dielectric coolant is used as the first liquid coolant, less first liquid coolant is used. This has two main advantages: dielectric coolants can be expensive, thus significantly reducing costs, and dielectric liquid coolants are typically very heavy, thus reducing the weight of the electronic module. Furthermore, by using less liquid coolant, the electronic module 100 can be more easily installed and / or lifted. Also, installing the electronic module 100 requires less infrastructure. Furthermore, the electronic module 100 is easier to handle than similar devices that are systems that use significantly more primary liquid coolant. The level of the first liquid coolant 815 in the majority of the vessel 110 is not near the top of the vessel. As a result, spills are less likely to occur during maintenance or replacement of components. The risk of leakage is also reduced.

[0162] The retaining wall 630 creates a weir effect and promotes the flow of the first liquid coolant. The coolant 815, at a relatively low liquid level, cools the electronic devices (the first electronic device, and any other electronic devices) in the electronic module 100. The first electronic device and any other electronic devices do not need to be completely submerged in the first liquid coolant. The first liquid coolant retained in the weir heat sink 600 can also provide some redundancy in cooling for the first cooling circuit in the event of failure of the pump 185 or other components.

[0163] 9, there is shown a top view of the embodiment of FIG. 7 showing the nozzle arrangement. As previously described, nozzle 645 is coupled to pipe 640. Nozzle 645 is positioned to face the center of the surface area of ​​substrate 615 (not shown in this view). The radial flow of coolant is indicated by arrows in this view.

[0164] Alternative positions of the nozzle 640 are possible. Some such positions will now be described with reference to FIG. 10, in which a top view of a first variant of the nozzle arrangement of the embodiment of FIG. 6 is shown, and with reference to FIG. 11, in which a top view of a second variant of the nozzle arrangement of the embodiment of FIG. 6 is shown. Referring first to FIG. 10, the nozzle 645 is shown off-center. Such an arrangement may be provided when the hottest part of the first electronic device (not shown, to which the weir heat sink 600 may be bonded) is not adjacent to the center of the substrate 615. With reference to FIG. 11, two nozzles are shown. The two nozzles 645 are positioned on a surface area of ​​the substrate 615 (not shown) adjacent to two of the hottest parts of the first electronic device (not shown, to which the weir heat sink 600 may be bonded).

[0165] The protrusions 625 (as pins and / or fins) may be integrally formed with the remainder of the weir heat sink 600 or may be made from separate components. The protrusions 625 may be tolerance fitted, glued or brazed in place. Additionally or alternatively, the retaining wall 620 may be integrally formed with the remainder of the heat sink 600 or made separately, for example by extrusion or fabricated sheet metal parts. The retaining wall 620 may then be tolerance fitted, glued, brazed or welded in place.

[0166] The cold plate of the second cooling circulation device will now be described in more detail with reference to Figs. 12A-12C. The cold plate has particular advantages for providing high performance and efficient cooling of the particular electronic device to which it is coupled. Thus, the second cooling circulation device, and more particularly the cold plate, can be coupled to the electronic devices in the electronic module that generate the greatest amount of heat. While it is impractical to cool all electronic devices in the electronic module in this manner, the use of a cold plate as part of the second cooling circulation device allows for centralized cooling that can relieve the burden of cooling the entire volume of the electronic module by the first cooling circulation system. Thus, the first cooling circulation device and the second cooling circulation device cooperate to provide a particularly efficient and effective cooling system for the electronic module.

[0167] An additional advantage of the cold plate in the second cooling circuit is that it provides a closed, sealed system where the second liquid coolant does not come into direct contact with any electronic devices. This allows for the use of low-cost, readily available water for the second liquid coolant (rather than, for example, a dielectric liquid). If the second cooling circuit is connected to the facility water supply and drain, or to a powerful pumping system external to the electronic modules, a large throughput of water through the second cooling circuit is possible, further increasing the potential cooling capacity of the second cooling circuit.

[0168] Generally described herein is a cold plate comprising a housing (which may be integrally formed), where a surface (typically planar) of the housing is configured to provide a thermal interface (sometimes referred to as a conduction surface) for cooling an electronic device thermally coupled to the housing. The cold plate further comprises at least one channel within the housing and proximate the surface. The one or more channels may be formed from an internal chamber (or chambers), volume, or other space for containing a liquid coolant (e.g., a coolant that essentially comprises water, a water-based coolant, water, or a liquid substitute with a high specific heat capacity, such as mineral oil or a dielectric fluid). The one or more channels are arranged and configured for liquid coolant to flow therethrough such that heat received by the thermal interface is transferred to the liquid coolant. Optionally, multiple parallel channels may be provided, each extending from a coolant port. As further described below, pins and / or fins are preferably disposed within at least one channel.

[0169] The cold plate also comprises a coolant port extending to the exterior of the housing for transporting liquid coolant to and / or from at least one channel. The coolant port may be a connector, coupling, joint, or other similar structure. Inlet and outlet coolant ports may be provided. At least one conduit, such as a pipe, hose or tube (preferably flexible), may be coupled to the coolant port for transporting liquid coolant to and / or from the coolant port. Advantageously, the cold plate is configured such that the liquid coolant remains in a substantially liquid state (i.e., single-phase liquid cooling) throughout the cooling system.

[0170] Referring first to FIG. 12A, one embodiment of a cold plate (or cold plate assembly) 1200 for use as a cooling module of a second cooling circulation device is shown in schematic form. In particular, the cold plate is advantageous for use in an electronic module or a server blade (or similar module). The cold plate assembly comprises a cold plate housing 1210 (preferably made integrally), connectors 1220a, 1220b forming the inlet / outlet ports of the cold plate, and an inlet / outlet conduit 1225 (here a pipe or tube). Fixation points 1230 of the cold plate 1200 are also shown. These fixation points can beneficially replicate those found on air-cooled heat sinks in a typical server chassis, allowing the cold plate to be retrofitted to a server blade.

[0171] In a preferred example, multiple coolant ports 1220a, 1220b are used, as shown in FIG. 12A. A first liquid coolant port 1220a is provided for transferring liquid coolant to the cold plate 1200, and a second liquid coolant port 1220a is provided for transferring liquid coolant from the cold plate 1200. In the example of FIG. 12A, the coolant ports 1220a, 1220b are coupled to independently rotating fluid connectors (or swivel joints or swivel elbow connectors, these terms are used interchangeably herein), thereby allowing adjustment of the orientation of the inlet / outlet conduits 1225a, 1225b coupled to the coolant ports 1220a, 1220b. This type of connector is therefore particularly useful for configuring or installing the cold plate assembly for operation. The swivel joints can increase the flexibility of the cold plate's placement. This may more easily allow for the retrofit of a cold plate into an existing electronic module, such as a server or other computer system, without the need to make any other modifications to the unit or system. The cold plate may be configured, for example, to fit in place of an air-cooled heat sink.

[0172] Preferably, the surface configured to provide a thermal interface to an electronic device (such as a second electronic device) to which the cold plate is coupled is the bottom surface of the cold plate housing (e.g., the unillustrated underside of the cold plate housing 1210 in FIG. 12A). The coolant ports 1220a, 1220b are then advantageously provided on the top surface of the housing 1210 opposite the bottom surface. In a preferred embodiment, the coolant ports extend in a direction perpendicular to the top surface of the housing. The swivel joint can then extend the coolant ports in a different direction, typically more parallel to the top surface of the housing. Advantageously, the swivel joint allows the orientation of the pipes to be adjusted around an axis perpendicular to the top surface of the housing. In particular, the swivel joint can allow the orientation of the pipes to be adjusted at least 90 degrees, 180 degrees, 270 degrees, preferably up to (and including) 360 degrees, in particular around an axis perpendicular to the top surface of the housing. The swivel connector can thus allow a full rotational freedom of the coolant ports.

[0173] In principle, a single coolant port can provide both the inlet and outlet of liquid coolant to the channels. In a preferred embodiment, multiple coolant ports are used, as shown in FIG. 12A. The coolant port is then a first coolant port for transferring liquid coolant to at least one channel. The cold plate may also include a second coolant port for transferring liquid coolant from at least one channel.

[0174] The housing of the cold plate and the arrangement of the ports on the cold plate can take any shape useful for facilitating the flow of coolant through the cold plate and to the portion of the second electronic device to which the cold plate is coupled. In some examples, the housing is elongated and the first and second coolant ports are disposed at opposite ends of the housing along the elongation direction, which can facilitate the flow of liquid coolant across the thermal interface surface and / or aid in flexible positioning of the cold plate. Additionally or alternatively, the second coolant port can include a swivel joint (as can the first coolant port), thereby allowing for adjustment of the direction of a pipe coupled to the second coolant port. Providing two coolant ports, each with a swivel joint, can allow for improved methods of coupling cold plates within a cooling system, including the possibility of coupling cold plates together.

[0175] Referring to Figure 12B, a top interior (plan) view of an exemplary cold plate according to the example of Figure 12A is shown, with the lid and nozzle removed for clarity.

[0176] 12B shows coolant inlet port 1225a, coolant outlet or exhaust port 1225b, coolant flow passage 1235, and pins 1240. It can be seen that a flow passage is formed between coolant inlet port 1225a and coolant outlet or exhaust port 1225b through which a second liquid coolant can flow when the cold plate is in use. This configuration, and particularly the configuration of pins 1240, distributes the coolant flow in all directions within the cold plate, allowing the coolant to be spread evenly throughout the cold plate.

[0177] Referring to FIG. 12C, a side (cross-sectional) view of the embodiment of FIG. 12B is shown with connectors coupled to ports 1225a, 1225b, cold plate base 1245. Also shown is cold plate lid 1250. Base plate 1245 and lid 1250 can together form cold plate housing 1210 shown in FIG. 12A. As shown in FIG. 12C, pins 1240 are connected to base 1245 and lid 1250. This can ensure that the flow of liquid coolant through channel 106 does not shortcut or bypass pins 109. In this way, pins 109 can direct the flow of coolant into the cold plate.

[0178] The base plate 1245 can provide a thermal interface to which a second electronic device can be coupled. In particular, the cold plate 1200 can be mounted to an electronic device (e.g., a second or third electronic device 130a, 130b, as shown in Figures 1, 2, and 3) with the base plate 125 of the cold plate in direct contact with a surface of the second electronic device. In this manner, heat can be transferred from a surface of the electronic device through the thermal interface provided by the base plate 1245 to a liquid coolant flowing within the cold plate.

[0179] All of the features disclosed herein may be combined in any combination, except combinations in which at least some of such features and / or steps are mutually exclusive. In particular, the preferred features of the invention are applicable to all aspects of the invention and may be used in any combination. Similarly, features described in non-essential combinations may be used separately (not in combination).

[0180] In particular, although Figures 1-4B above describe certain preferred embodiments of the invention in which one or more weirs are incorporated within a first cooling circulation system and one or more cold plates are incorporated within a second cooling circulation device, these components are not necessarily required. In particular, in its most general form, the concept described herein is the use of first and second cooperating cooling circulation systems (or cooling loops) whereby both the first and second cooling circulation devices each cool a different electronic device within an electronic module, and further, the second cooling circulation device is used to cool the first cooling circulation system.

[0181] This most general concept is illustrated in Figures 13A and 13B. The examples of Figures 13A and 13B show a first common feature: a first cooling circulation system (dotted lines) configured to circulate a first liquid coolant between a first electronic device 1320 of a plurality of electronic devices and a heat exchanger 1330. In the particular example of Figures 13A and 13B, a pump 1325 is shown as forming part of the first cooling circulation system, but this is not required and circulation may be performed by other mechanisms (such as convection). In the first cooling circulation system of Figures 13A and 13B, the first electronic device 1320 is thermally coupled to the circulating first liquid coolant such that heat is transferred from the first electronic device 1320 to the first liquid coolant (when the system is in use).

[0182] 13A and 13B illustrate a second common feature: a second cooling circulation apparatus (bold line) is configured to circulate a second liquid coolant between a second electronic device 1335 (and a parallel third electronic device 1340) of the multiple electronic devices and the heat exchanger 1330. The second electronic device 1335 and the third electronic device 1340 are thermally coupled to the second liquid coolant that circulates through the second cooling circulation apparatus (in use of the system) such that heat is transferred from the second electronic device 1335 and the third electronic device 1340 to the second liquid coolant.

[0183] 13A and 13B illustrate a third common feature: the first and second cooling circulation devices are thermally coupled via a heat exchanger 1330. In other words, when the first and second liquid coolants each pass through the heat exchanger 1330, heat is transferred from the first liquid coolant to the second liquid coolant via a thermal interface within the heat exchanger 1330.

[0184] Additionally, Figure 13A shows the cooling system as part of a second cooling circuit, and Figure 13B shows the second cooling circuit connected to a water supply and a drain, which corresponds to those parts of the second cooling circuit described above with respect to Figures 4A and 4B.

[0185] Thus, a system is shown in which heat is removed from the first liquid coolant in the first cooling circuit and transferred outward by heat transfer to the second liquid coolant in the second cooling circuit. The heat transfer takes place mainly in a dedicated heat exchanger 1330 that provides efficient removal of heat from the first cooling circuit. The described system allows efficient cooling of certain components of the electronic module (by the second cooling circuit) as well as cooling of the entire volume of the electronic module (by the first cooling circuit). The described system is more compact so that it can be used in industry standard server blades or chassis, and can be more easily installed in a typical server rack as a result of the quick attachment and detachment mechanism of the closed loop first and second cooling circuits.

[0186] Thus, the described system describes an efficient and adaptable system that utilizes a hybrid arrangement of targeted and volumetric cooling within an electronic module.

[0187] Although a particular configuration of two cold plates in an electronic module is shown in Figures 1-4B above, it will be understood that various cold plate configurations are possible. Furthermore, different configurations of cold plates and associated connection of circulation systems to a rack (or server) can provide several advantages. Various systems for cooling an electronic module configured for installation in a rack, as well as methods of installing a liquid-cooled system for an electronic module, are now described. Each of the described configurations incorporates at least one cold plate (as described above with respect to Figures 12A, 12B and 12C) and can be combined with the above-mentioned embodiments, particularly with respect to incorporation into a second cooling circulation device.

[0188] FIG. 14 shows a plan view of an electronic module (or server module) in which a cold plate assembly 1401 is disposed. The electronic module is of a type that is to be mounted in an existing rack server system. The cold plate assembly 1401 may be installed in place of a previous air-cooled heat sink module. Advantageously, the cold plate assembly can be installed in the same footprint as the air-cooled heat sink module. Thus, the cold plate assembly has the same or similar footprint or dimensions as a commonly used air-cooled heat sink module.

[0189] The cold plate assembly 1401 is mounted within a housing or chassis (or server chassis) 1420 of an electronic module 1410. The server chassis 1420 may be, for example, a 1RU server chassis conforming to established industry standards. A base plate of the cold plate module 1401 is configured to be thermally coupled to an electronic device mounted within the housing. The cold plate module may be mounted against a substrate (or printed circuit board) 1425 that forms the base of the module housing 1420. An input conduit 1430 is coupled to an inlet port 1435 of the cold plate. An output conduit 1440 is connected to an outlet port 1445 of the cold plate. In addition to the novel features associated with the cold plate assembly, the illustrated electronics module also exhibits various other features that would be typical in a standard electronics module, notably ingress / egress ports 1450 (including USB, QSFP and Ethernet ports) for electrical or data connections (at the front of the electronics module when viewed when the module is mounted in a rack) and a fan 1455 for cooling a cavity within the module housing (at the rear of the electronics module when viewed when the module is mounted in a rack). The module housing can house various electronic components or devices 1460 (such as RAM chips).

[0190] In use, the cold plate assembly 1401 and the inlet conduit 1430 and the outlet conduit 1440 are connected in a cooling loop with a cooling system and a pump (not shown in FIG. 14). A liquid coolant is circulated around the cooling loop. Specifically, the liquid coolant is passed through the cold plate assembly 1401 via the input conduit 1430. The liquid coolant passes through channels in the housing of the cold plate assembly to receive heat transferred to the liquid coolant from an electronic device thermally coupled to the cold plate housing, as described above in connection with FIGS. 12A, 12B and 12C. Thus, the liquid coolant exiting the cold plate assembly 1401 has a higher temperature than the liquid coolant entering the cold plate assembly 1401.

[0191] The liquid coolant leaving the cold plate assembly 1401 is received through an outlet conduit 1440. The liquid coolant is then transported through an output conduit 1440 to a cooling system and pump (not shown, may include a combined unit). The cooling system is provided with a heat exchanger for transferring heat from the liquid coolant to a second cooling medium. The second cooling medium may be, for example, air or may be a second cooling loop in which the second liquid coolant is circulated. The cooling system reduces the temperature of the liquid coolant or cools the liquid coolant. The liquid coolant cooling loop may be formed as part of a larger cooling installation (such as a building water cooling loop). In another example, the liquid cooling loop may be formed as a smaller loop local to the server module or to the rack to which the server module is connected. The liquid cooling loop may be configured according to local codes and requirements.

[0192] After cooling in the cooling system, the cooled liquid coolant is then further circulated around the cooling loop through input conduit 1430 to the cold plate module 1401, thereby completing its flow through the cooling loop.

[0193] As will be appreciated by those skilled in the art, various other components may be included in the cooling loop (such as switches, valves, manifolds, or additional pumps). Additional cold plate assemblies may also be included in the cooling loop, as described below. The cooling loops described are provided for illustrative purposes and are not intended to be limiting.

[0194] Figure 15 illustrates a further example of an electronic module (or server module) 1510 in which two cold plate assemblies 1401a, 1401b are arranged. The same example is shown in plan view in Figure 16. The electronic module 1510 comprises a module housing 1420 having a substrate 1425, input / output ports 1450, and a fan 1455. Electrical components including computer RAM 1460 and capacitors 1565 are housed within the module housing 1520.

[0195] The lid of the first cold plate assembly 1401a is provided with a first inlet port 1435a and a first outlet port 1445a. Similarly, the lid of the second cold plate assembly 1401b is provided with a second inlet port 1435b and a second outlet port 1445b. The first input conduit 1430a and the second input conduit 1430b are attached to the first inlet port 1435a and the second inlet port 1435b, respectively, and the first output conduit 1440a and the second output conduit 1440b are attached to the first outlet port 1445a and the second outlet port 1445b, respectively. The first cold plate assembly 1401a and the second cold plate assembly 1401b are arranged in a cooling loop in a parallel configuration. Thus, a single supply conduit 1550 is connected to both the first inlet conduit 1430a and the second inlet conduit 1430b. Similarly, a single receiving conduit 1555 is connected to both the first output conduit 1440a and the second output conduit 1440b. The supply conduit 1550 can be considered to be "split" into parallel paths provided, for example, by a first input conduit and a second input conduit.

[0196] At least one coupling 1570a, 1570b is provided for connecting the supply conduit 1550 to the first and second inlet conduits 1430a, 1430b and / or for connecting the first and second output conduits 1440a, 1440b to the receiving conduit 1555. In this example, the couplings 1570a, 1570b are external to the module housing 1420. The first and second input conduits 1430a, 1430b and the first and second output conduits 1440a, 1440b are therefore configured to pass through an opening 1480 in the wall of the housing 1420 to transfer liquid coolant between the interior and exterior of the cavity in the electronic module. Advantageously, the opening 1480 is an opening provided at the rear of a typical server module, such as an existing PCIE card slot, as shown in FIG. 15.

[0197] As shown in Figures 3 and 4, the input conduits 1430a, 1430b and the output conduits 1440a, 1440b are arranged around the electrical components 1565, 1460 arranged in the module housing. Beneficially, the conduits are provided by flexible tubing or pipes having a narrow diameter (or bore size). Thus, the conduits can be more easily fitted around the electrical components. Furthermore, the tubing can be arranged to pass through typically provided or existing openings in the walls of the module housing (e.g., for electrical or data ports, or for components such as data cards, etc.).

[0198] The described properties of the cold plate assemblies 1401a, 1401b are particularly useful when the cold plate assemblies are being retrofitted, for example in place of an air-cooled heat sink, since electrical components are already installed within the module housing and it is desirable not to move or reposition the existing components. In this way, when retrofitting the cold plate assemblies, the mechanic can advantageously fit the cold plate module within the footprint of the previous cooling device (as a result of the dimensions of the cold plate assembly), and further, the flexible narrow tubing used for the conduits, along with swivel nozzles at the ports to each cold plate assembly, can allow the installer to evaluate and apply the most natural route for the piping through the server chassis and around the existing components.

[0199] In use, liquid coolant is passed through the supply conduit 1550 via the junction 1570a to the first and second input conduits 1430a, 1430b. From here, the first and second cold plate assemblies 1401a, 1401b form part of separate first and second parallel branches of a cooling loop. Liquid coolant is circulated through each of the first and second input conduits 1430a, 1430b in parallel, such that liquid coolant is input through the inlet ports 1435a, 1435b of each of the first and second cold plates for the respective first and second input conduits. The liquid coolant then passes through the inner channels of each cold plate, picks up heat transferred from the thermally coupled electronic device, and then exits the cold plate through the outlet ports 1445a, 1445b. The liquid coolant is then transferred to each of the first and second output conduits 1440a, 1440b, which connect to the receiving conduit 1555 at junction 1570b.

[0200] In use, the supply conduit 1550 and the receiving conduit 1555 are connected to a cooling system and / or pump to complete the cooling loop, as described above with respect to the example of Figure 14. The cooling system acts to remove heat from the liquid coolant, thus removing heat from the cooling loop that was originally transferred from the electrical components.

[0201] 17 shows a plan view of a further example of an electronic module 1710 including four cold plate assemblies, the configurations of the first 1401a and second 1401b cold plate assemblies as well as the third 1401c and fourth 1401d cold plate assemblies being similar to the configurations of the first and second cold plate assemblies shown in FIGS.

[0202] More specifically, the first and second cold plate assemblies 1401a, 1401b are connected in parallel in a liquid coolant loop in a configuration similar to that described with respect to Figures 15 and 16 (although the positions of the first and second cold plate assemblies 1401a, 1401b on the electronic module substrate 1425 differ from those of Figures 15 and 16 to optimize the configuration of the piping forming the first and second input conduits 1430a, 1430b and the first and second output conduits 1440a, 1440b). In this example, the supply and receiving conduits represent first supply conduit 1550a and first receiving conduit 1555a.

[0203] A third cold plate 1401c and a fourth cold plate 1401d are also provided. The system of the third and fourth cold plates, the third and fourth input conduits 1430c and 1430d, and the third and fourth output conduits 1440c and 1440d is equivalent to the system of the first and second cold plates, the first and second input conduits, and the first and second output conduits, respectively. Thus, the third and fourth cold plate assemblies 1401c and 1401d are connected in parallel in a liquid coolant loop. The third and fourth input conduits 1430c and 1430d are coupled to the second supply conduit 1550b and receive liquid coolant therefrom. Similarly, the third output conduit 1440c and the fourth output conduit 1440d are coupled to the second receiving conduit 1555b and deliver liquid coolant thereto.

[0204] The first supply conduit 1550a and the second supply conduit 1550b shown in Fig. 17 may be connected in parallel within a liquid cooling loop. In other words, a single output from the cooling system of the cooling loop may be split to each connect to the first supply conduit 1550a and the second supply conduit 1550b. Similarly, the first receiving conduit 1555a and the second receiving conduit 1555b may be connected in parallel such that the first receiving conduit and the second receiving conduit join to proceed as a single entity to the input of the cooling system.

[0205] In an alternative example, the first supply conduit 1550a and the second supply conduit 1550b and the first receiving conduit 1555a and the second receiving conduit 1555b may be connected to separate respective first and second cooling loops, each having a cooling system. This may provide greater cooling capacity than the above configuration in which the first supply conduit 1550a and the second supply conduit 1550b and the first receiving conduit 1555a and the second receiving conduit 1555b are arranged in series. However, it may also require a more complex infrastructure and be more costly. The particular configuration of the cooling loops connected to the apparatus shown in the example of FIG. 17 (and other examples shown herein) may be selected according to the cooling requirements and infrastructure of a particular server facility.

[0206] 18 shows an electronic module 1810 with a first cold plate assembly 1401a and a second cold plate assembly 1401b mounted thereon. In this example, the first and second cold plates are arranged in parallel in a cooling loop with the first and second input conduits 1430a and 1430b, the first and second output conduits 1440a and 1440b, the couplings 1570a, 1570b, the supply conduit 1550 and the receiving conduit 1555 arranged in substantially the same manner as in FIGS. 15 and 16. However, in this example, the couplings 1570a, 1570b where the first and second input conduits 1430a and 1430b are coupled to the supply conduit 1555 and the first and second output conduits 1440a and 1440b are coupled to the receiving conduit 1555 are disposed within the module housing 1420. In this case, the supply conduit 1550 and the receiving conduit 1555 are positioned to pass through openings in the module housing.

[0207] Compared to the arrangement of Figures 15 and 16, this configuration has the advantage that fewer pipes or tubes must penetrate the wall of the module housing. However, to maintain a generally efficient flow of liquid coolant through the first and second cooling assemblies, the supply and receiving conduits are typically provided by tubes having a larger bore size or diameter than each of the first and second input conduits and the first and second output conduits. Thus, in some scenarios, it may be preferable to place the couplings within the module housing (as shown in the examples of Figures 15 and 16) to allow for greater flexibility in the placement of the penetrations for each conduit.

[0208] FIG. 19 shows a plan view of an electronic module housing 1910 housing a first cold plate 1401a and a second cold plate 1401b. However, in comparison to the previous example, the first cold plate 1401a and the second cold plate 1401b are arranged in series in a cooling loop. Thus, the first input conduit 1430a is connected to the first inlet port 1435a of the first cold plate, and the second output conduit 1440b is connected to the outlet port 1440b of the second cold plate, but as previously described, in this case the first outlet port 1445a is directly coupled to the second inlet port 1435b via a link conduit 1915. The first input conduit 1430a and the second output conduit 1440b are arranged to pass through an opening in the wall of the module housing 1420. The first input conduit 1430a and the second output conduit 1440b are then connected to the cooling loop as previously described.

[0209] In use, liquid coolant is transported through the first input conduit 1430a and received at the inlet port 1435a of the first cold plate 1401a. The liquid coolant passes through the channels of the first cold plate and receives heat transferred from an electronic device thermally coupled to the first cold plate. The liquid coolant then exits the first cold plate through the first outlet port 1445a and is transported through the link conduit 1915 to the inlet port 1435a of the second cold plate 1401b. The liquid coolant then further passes through the channels of the second cold plate and receives heat transferred from an electronic device thermally coupled to the second cold plate. The liquid coolant is then passed outward from the second cold plate through the second outlet port 1445b to the second output conduit 1440b. The liquid coolant is further circulated towards the cooling system in the cooling loop.

[0210] In the series-connected cold plates of FIG. 19, the liquid coolant has a first temperature before entering the first cold plate (i.e., in the first input conduit 1430a), a second temperature after leaving the first cold plate and before entering the second cold plate (i.e., in the link conduit 1915), and a third temperature after leaving the second cold plate (i.e., in the second output conduit 1440b). The first temperature will be lower than the second temperature, which will be lower than the third temperature. In other words, the liquid coolant becomes progressively hotter as it passes through additional cold plates, taking into account the heat transferred within the channels of each cold plate.

[0211] The efficiency of heat transfer from the electronic device to the liquid coolant in the channels of the cold plate depends on the temperature gradient (or temperature difference) between the electronic device and the liquid coolant. Thus, when the temperature of the liquid coolant is higher and therefore closer to the operating temperature of the electronic device, the efficiency of heat transfer (i.e., cooling) from the electronic device to the liquid coolant may be reduced. Thus, in the series configuration of cold plates shown in FIG. 19, an electronic device thermally coupled to the first cold plate 1401a may be cooled more efficiently than an electronic device thermally coupled to the second cold plate 1401b. However, the series configuration of cold plate modules is more compact and requires fewer pipes and tubes to act as conduits. Furthermore, the maximum possible cooling efficiency may not be required for all electronic devices in a given electronic module. Thus, a series of cold plate modules in a series configuration can be selected to provide sufficient cooling for each electronic device to be cooled.

[0212] The difference in cooling efficiency between the first and second cold plates described in FIG. 19 can be effectively overcome by providing each of the cold plates in parallel in a cooling loop, for example as shown in the examples of FIGS. 15, 16, 17 and 18. In a parallel configuration, the temperature of the liquid coolant circulating through each cold plate is the same. Thus, each cold plate mounted in each parallel branch of the cooling loop has the same potential cooling efficiency for an electronic device operating at a given temperature.

[0213] Nonetheless, the described parallel configuration may be more cumbersome to install within a server blade (especially if a cooling system is retrofitted), especially as more cold plates are added within a particular electronics module or server blade, since more conduits (pipes or tubes) and connections are required to achieve the parallel configuration. More conduits may need to be threaded through existing openings or apertures in the walls of the module housing to service the cold plate modules arranged in parallel. Thus, in some cases, a series arrangement of cold plate modules may be preferred over a parallel arrangement of cold plate modules, depending on the particular space considerations and cooling requirements of a particular electronics module.

[0214] With this in mind, FIG. 20 illustrates a further example of a liquid cooling system installed within an electronic module 2010. In this example, two parallel branches of a cooling loop circulate through cold plates mounted within the electronic module. The first branch of the cooling loop has a first cold plate, a second cold plate, and a third cold plate arranged in series. The second branch of the cooling loop has a fourth cold plate and a fifth cold plate arranged in series. The footprint and volume of each cold plate on the first branch (the first cold plate, the second cold plate, and the third cold plate) is smaller than the footprint and volume of each cold plate on the second branch (the fourth cold plate and the fifth cold plate). The cooling capacity of the larger cold plates (fourth cold plate and fifth cold plate) can be greater than that of the smaller cold plates (first cold plate, second cold plate and third cold plate) because they provide a larger surface area for the transfer of heat from the electronic device to the liquid coolant. However, the cooling capacity is limited in part by the flow rate of the liquid coolant through each branch of the cooling loop (which may be determined by the bore size or diameter of the pipes that form the conduits for the connection of the cold plates).

[0215] The particular liquid cooling system of Figure 20 includes a first cold plate 1401a, a second cold plate 1401b, a third cold plate 1401c, a fourth cold plate 1401d, and a fifth cold plate 1401e. Each cold plate has a respective inlet and outlet port. A supply conduit 350 provides a passage for liquid coolant received from the cooling system before splitting into two parallel branches of the cooling loop. In a first branch from the supply conduit, a first input conduit 1430a is arranged to transport liquid coolant to an inlet port 1435a of the first cold plate, a first link conduit 1915a is arranged to transport liquid coolant from a first outlet port 1445a of the first cold plate to a second inlet port 1435b of the second cold plate, a second link conduit 1915b is arranged to transport liquid coolant from a second outlet port 1445b of the second cold plate to a third inlet port 1435a of the third cold plate, and a first output conduit 1440a is arranged to transport liquid coolant from an outlet port 1445c of the third cold plate to a junction 1570b with the receiving conduit 1555. In a second branch from the supply conduit (arranged in parallel to the first branch), a second input conduit 1430b is arranged to transport liquid coolant to the inlet port 1435d of the fourth cold plate, a third link conduit 1915c is arranged to transport liquid coolant from the outlet port 1445d of the fourth cold plate to the inlet port 1435e of the fifth cold plate, and a second output conduit 1440b is arranged to transport liquid coolant from the outlet port 1445e of the fifth cold plate to the junction with the receiving conduit 1555.

[0216] In use, liquid coolant is circulated around each branch of the cooling loop. Relatively cool liquid coolant is supplied by a supply conduit to an input conduit of each branch, and relatively hot liquid coolant is received in a receiving conduit from each output conduit of each branch. A pump and cooling system (described above) may be disposed in the cooling loop between the receiving and supply conduits to circulate the liquid coolant and transfer heat outwardly from the liquid coolant.

[0217] As will be appreciated, any number of configurations of cold plates and cooling loops can be arranged based on the examples outlined. Three or more parallel branches of a cooling loop can be arranged within an electronics module, with any number of cold plates arranged in series in each branch of the cooling loop. A particular arrangement is selected according to the cooling requirements of a particular electronics module and taking into account the space and configuration limitations of the electronics module (especially when the described cooling system is retrofitted to an existing electronics module). A particular arrangement can be selected (e.g., by an installer) to optimize efficient cooling of the electronics module given these requirements and constraints.

[0218] FIG. 21 shows a plan view of a further example of a cooling system installed in an electronic module 2110. The electronic module 2110 is shown mounted in a rack 2100. In this example, a first cold plate 1401a and a second cold plate 1401b are arranged in parallel in a cooling loop. Within the confines of the module housing 1420, the configuration of the first and second input conduits 1430a and 1430b, the first and second output conduits 1440a and 1440b, and the first and second cold plates are the same as described above with respect to the examples of FIGS. 15 and 16. However, in this example, the first and second manifolds 2120a and 2120b are provided external to the electronic module. The first manifold 2120a is coupled to a first input conduit 1430a and a second input conduit 1430b, and the second manifold 2120b is coupled to a first output conduit 1440a and a second output conduit 1440b. It will be understood that supply and receiving conduits, each having a similar function in the cooling loop as the supply and receiving conduits described above with respect to Figures 15 and 16, are connected to the first and second manifolds, respectively. In Figure 21, the supply and receiving conduits are not visible and are connected to the manifolds perpendicular to the direction of liquid coolant flow in the input and output conduits (i.e., the flow of liquid coolant through the supply and receiving conduits is in / out of the plane of the electronics module in Figure 21).

[0219] Each manifold provides a unit having passages or channels for supplying liquid coolant to the conduits. The passages or channels in the manifolds can have a wider diameter or bore size than the conduits to avoid restrictions on the flow rate of liquid coolant through the manifold. The manifold unit is made rigid, allowing easier fastening to an electronic module or rack than simple bonds between flexible tubing (e.g., as shown with respect to bonds 1570a, 1570b in Figs. 15 and 16). Furthermore, providing a rigid manifold as a point of bonding the input and output conduits to the respective supply and receiving conduits reduces distortion of the bonds and thus helps to prevent leakage of liquid coolant or loss of pressure in the liquid cooling loop. Finally, the use of the described manifolds aids in the installation and mating of the cooling system, as it allows for separable connections between the conduits, thus allowing flexibility in the placement of the various components of the cooling system.

[0220] The manifold may be supported by a bracket 2130 that is connected to the rear of the module housing in the example of Figure 21. In another example, the bracket may be connected to a rack.

[0221] Each of the first and second input conduits is connected or coupled to the first manifold using connectors 2125a, 2125b, more specifically blind-mate connectors, although other types of connectors may also be used. Blind-mate connectors are "push-fit", in other words, have a mating action by sliding or snapping the connector plug into the socket. Thus, the connectors are more easily mated without the use of tools such as wrenches. Furthermore, no torque needs to be applied to the tubing or pipes providing the conduits when mated (which allows for greater control over the placement of the conduits in the cooling system). Furthermore, blind-mate connectors have a self-aligning feature that allows for a restoring force for small misalignments when mated. Thus, this type of connector makes mating of the cooling system easier, especially when installed in an existing electronic module instead of an air-cooled heat sink system.

[0222] FIG. 22 shows a plan view of a further example of a cooling system installed in an electronic module 2200. This example also includes a manifold, but in yet another configuration compared to that shown in FIG. 21. The cooling system of FIG. 22 comprises a first cold plate 1401a and a second cold plate 1401b arranged in parallel in a cooling loop. The arrangement of the first cold plate 1401a and the second cold plate 1401b, the first input conduit 1430a and the second input conduit 1430b, the first output conduit 1440a and the second output conduit 1440b, and the supply conduit 1550 and the receiving conduit 1555 are the same as described above with respect to the examples of FIGS. 15 and 16.

[0223] In the example of Fig. 22, the supply conduits 1550 and receiving conduits 1555 are each connected to a respective first manifold 2120a and second manifold 2120b. The manifolds can connect the supply and receiving conduits into a cooling loop, as previously described. Similar to the manifolds described above with respect to Fig. 21, the manifolds 2120a, 2120b are units or elements that have passages or channels for supplying liquid coolant to the conduits. They may be rigid, providing various advantages as outlined above.

[0224] The supply and receiving conduits can be connected to the manifold via connectors 2225a, 2225b. The connectors can be, for example, manual connectors that require manual connection during installation (or manual disconnection for removing the electronic module from the rack). Such connectors are relatively easier and less complicated to install than other types of connectors. Thus, this type of drip-free manual connector can be particularly useful when retrofitting the described cooling system to an existing electronic module.

[0225] In the example of FIG. 22, the first manifold 2120a and the second manifold 2120b are supported by a rack 2100. More specifically, the first manifold 2120a and the second manifold 2120b are mounted within a duct (or passageway or cavity) 2101 provided in a typical rack for housing electrical and data cables. The duct 2101 provides a cavity adjacent the rear of the electronic module 2100 such that the first manifold 2120a and the second manifold 2120b mounted therein may be housed compactly and securely. Beneficially, this configuration for housing the manifolds 2120a, 2120b does not necessarily require additional brackets or infrastructure to be provided for support of the manifolds, yet still securely and rigidly mounts the manifolds in place.

[0226] It should be noted that the manifolds described above with respect to Figures 21 and 22 are shown as separate manifold units for each of the inlet and outlet portions of the cooling loop. It will be understood that both the input and outlet portions may be served by a single manifold unit with appropriate partitions therein. Nevertheless, separate manifolds for each of the input and outlet portions may be beneficial to provide additional flexibility in manifold arrangements, particularly when retrofitting cooling systems to existing server blades.

[0227] The cooling loop of which the above-mentioned cold plate device forms a part has been described above. FIG. 23 shows, by way of example, a schematic diagram of a particular configuration of the entire cooling loop. FIG. 23 shows an electronic module or server chassis 2300, a first cold plate 2320a and a second cold plate 2320b according to the present disclosure, a water cooling loop 2330 (which is the "cooling loop" circulating through the cold plates as described with reference to the above examples), a first manifold 2340a and a second manifold 2340b, a cooling distribution unit (CDU) 2350 comprising a heat exchanger 2360 (or cooling system) for transferring heat from the liquid coolant in the liquid cooling loop 2330 to a heat sink 2380. A facility level pump 2370 is used to distribute the coolant to all cold plates 2320a, 2320b in the cooling loop 2330. The electronic modules or server chassis 2300 may be mounted in a rack 2310 and manifolds 2340a, 2340b are mounted in the rack and are also used to direct coolant to and from other servers (not shown). The manifolds may be mounted in ducts in the rack for storage and passage of electronic and data cables, as shown in FIG.

[0228] In FIG. 23, the pump and heat exchanger are shown within the unit (CDU), but it will be understood that a separate cooling system (or heat exchanger) and pump may instead be implemented within the cooling loop 2330.

[0229] 24 shows an alternative example of a cooling loop of which one or more of the cold plates described in the above examples may form a part. FIG. 24 shows a schematic diagram of an electronic module 2400 mounted in a rack 2410, comprising a first cold plate 2420a and a second cold plate 2420b in accordance with the present disclosure, a first cooling loop 2430 (which is a "cooling loop" circulating through the cold plates as described with reference to the above examples), a cooling system comprising a heat exchanger 2465, a first pump 2475, a second cooling loop 2435, a first manifold 2440a and a second manifold 2440b, and a cooling distribution unit (CDU) 2450 comprising a heat sink 2480 and a heat exchanger 2460 for transferring heat to a facility level pump 2470.

[0230] In this example, a first cooling loop 2430 (or "cooling loop" as described with respect to Figures 13-22 above) circulates through cold plates 2420a, 2420b and is entirely contained within the chassis of the electronic module 2400. The first cooling loop 2430 is circulated by a pump 2475 also contained within the chassis. The first cooling loop 2430 is connected to a cooling system, here comprising a heat exchanger 2465 for transferring heat from a liquid coolant circulating in the first cooling loop to a cooling medium (e.g., water, or another liquid coolant) circulating in a second cooling loop 2435. In this manner, heat is removed from the first cooling loop 2430. The cooling system in this example is also contained within the chassis of the electronic module 2400.

[0231] A second cooling loop 2435 circulates between the heat exchanger and the cooling distribution unit. Circulation may be performed by a pump 2470 in the CDU. The second cooling loop 2435 may be a facility level cooling loop (i.e., a building water cooling loop). Or, it may be local to, for example, the electronic modules, the rack of electronic modules, or the server room in which the modules are housed. The second cooling loop may pass through manifolds 2440a, 2440b mounted on the rack 2410. In an alternative, the manifolds may be mounted on the electronic modules.

[0232] At the CDU, heat is transferred from the second cooling loop 2435 via a heat exchanger 2460. The heat is transferred to a heat sink 2480. It will be appreciated that the heat sink 2480 may represent an air-cooled heat sink. Alternatively, the heat sink 2480 may form part of a further (third) cooling loop through which a liquid coolant is circulated. This may be appropriate where the second cooling loop is local to a particular rack of electronic modules and the third cooling loop is a facility level cooling loop (such as a building water cooling loop).

[0233] As will be appreciated by those skilled in the art, electronic modules such as those described above with respect to Figures 14-24 are configured to fit into racks. In particular, each rack can house multiple electronic modules. In this manner, a bank of electronic modules is formed, each providing a server within a server bank, for example. Thus, the cooling system described above with respect to an individual electronic module forms part of a larger cooling system that can service a rack, or multiple electronic modules within one or more racks.

[0234] FIG. 25 shows a schematic diagram of an exemplary cooling system comprising multiple electronic modules, each having a cooling system installed. FIG. 25 shows a server chassis or electronic module 2500 mounted in a rack 2510. Multiple racks may be provided, each of which may accommodate up to 42 electronic modules 2500. In this example, a water cooling loop 2530 is provided across all electronic modules 2500. The cooling loop 2530 is cooled using a single coolant distribution unit (CDU) 2550. The CDU 2550 includes a heat exchanger 2560 and a facility level pump 2570, which transfers heat to a heat sink 2580. The heat sink 2580 may itself be air-cooled. Alternatively, the heat sink 2580 may form part of a second coolant loop (not shown). In either case, the heat exchanger aids in the transfer of heat from the liquid coolant circulating in the cooling loop 2530. Thus, a single pump 2570 can be used in a system having multiple (even hundreds) of electronic modules 2500.

[0235] It should be noted that each of the server chassis or electronic modules 2500 shown in Fig. 25 is configured with a cooling loop in accordance with the server chassis or electronic module 2300 shown in more detail in Fig. 23. However, it will be understood that each of the electronic modules 2500 in Fig. 25 may instead have a configuration in accordance with the electronic module 2400 shown in Fig. 24. In particular, each electronic module 2500 in Fig. 25 may include a cooling system (including at least a heat exchanger 2465 for transferring heat to the second cooling loop 2435) and a pump 2475 within the body of the electronic module or server chassis in accordance with the illustrated electronic module 2400 in Fig. 24.

[0236] In summary, a series of benefits are provided by the embodiments according to the present disclosure. These are particularly advantageous in cold plates for electronics cooling in high density applications (e.g., 1U size servers in multiple racks) and ultra-high density applications. Particular advantages are provided by the adaptability and configuration of the described cooling system, which makes it particularly suitable for retrofitting existing electronic modules or server rack systems. Moreover, the described system can be applied to standard or typical server chassis or server racks without complex customization.

[0237] Furthermore, any of the configurations described for the cold plates of Figures 14-25 can be applied to the first and second cooling circulation devices as described above with respect to Figures 1-4B. In particular, the first cooling circulation device described can be combined with any of the described cold plate configurations (implemented as a second cooling circulation device) described with reference to Figures 14-25 with the addition of a suitable heat exchanger 170 for transferring heat between the first and second cooling circulation devices.

[0238] Several combinations of the various described embodiments may be envisioned by those skilled in the art. All of the features disclosed herein may be combined in any combination, except combinations in which at least some of such features and / or steps are mutually exclusive. In particular, the preferred features of the invention are applicable to all aspects of the invention and may be used in any combination. Similarly, features described in non-essential combinations may be used separately (not in combination).

Claims

1. 1. A system for cooling a plurality of electronic devices housed within an electronic module, comprising: a housing for the electronic module, the housing including a plurality of electronic devices housed within the housing; a heat exchanger disposed within the housing of the electronic module; a first cooling circulation apparatus configured to circulate a first liquid coolant between a first electronic device of the plurality of electronic devices and the heat exchanger, the housing of the electronic module containing the first liquid coolant and the first electronic device in contact with the first liquid coolant such that heat is transferred to the first liquid coolant from a surface of the first electronic device in contact with the first liquid coolant; a second cooling circulation apparatus configured to circulate a second liquid coolant between a second electronic device of the plurality of electronic devices and the heat exchanger, the second electronic device being thermally coupled to the second liquid coolant such that heat is transferred from the second electronic device to the second liquid coolant; Equipped with the first cooling circulation device and the second cooling circulation device are thermally coupled through at least the heat exchanger such that heat is transferred from the first liquid coolant to the second liquid coolant through the heat exchanger; the heat exchanger comprises at least a first chamber and a second chamber separated by a thermal interface, the heat exchanger being configured for flow of the first liquid coolant through at least the first chamber and for flow of the second liquid coolant through at least the second chamber such that heat is transferred from the first liquid coolant to the second liquid coolant through the thermal interface.

2. 2. The system of claim 1, wherein the second cooling circulation apparatus further comprises a cooling system, the second cooling circulation apparatus configured to circulate the second liquid coolant between the second electronic device of the plurality of electronic devices, the heat exchanger, and the cooling system, and heat is removed from the second liquid coolant by the cooling system.

3. 2. The system of claim 1, wherein the second cooling circulation device is connected to a second liquid coolant supply facility, and the second cooling circulation device is configured to circulate the second liquid coolant received from the second liquid coolant supply facility between the second electronic device of the plurality of electronic devices and the heat exchanger and return the second liquid coolant to the second liquid coolant supply facility.

4. A system as described in any one of claims 1 to 3, at least partially immersed in the first liquid coolant.

5. The first cooling circuit further comprises a dam, the dam comprising: a base and a retaining wall extending from the base, the base and the retaining wall defining a volume for retaining a portion of the first liquid coolant; an inlet through which the first liquid coolant enters the volume; Equipped with 5. The system of claim 4, wherein flowing sufficient of the first liquid coolant through the inlet and into the volume causes the first liquid coolant to overflow the retaining wall into contact with the surface of the first electronic device and combine with first liquid coolant contained within the housing of the electronic module and external to the weir for circulation to the first cooling circulation device.

6. The system of claim 5 , wherein the inlet further comprises a nozzle arrangement for directing the first liquid coolant flowing into the volume.

7. The system of claim 5 or 6, wherein the weir further comprises a protrusion extending from the base and / or the retaining wall within the volume of the weir.

8. The system of any one of claims 5 to 7, wherein the dam is coupled to a surface of the first electronic device to act as a heat sink.

9. The first cooling circulation device is The system of any one of claims 1 to 8, further comprising a pump configured to circulate the first liquid coolant around the first cooling circulation device.

10. 10. The system of claim 9, wherein the first cooling circulation device further comprises a pump inlet positioned to receive a first liquid coolant contained within the housing of the electronic module and outside a weir.

11. The first cooling circulation device is 11. The system of claim 9 or 10, further comprising at least a first pipe and a second pipe configured to transport the first liquid coolant from the pump to the heat exchanger and from the heat exchanger to an inlet of a weir, respectively.

12. 12. The system of claim 1, wherein the second cooling circulation system further comprises a cooling module configured to thermally couple the second electronic device to the second liquid coolant.

13. The cooling module includes a cold plate, the cold plate comprising: a cold plate housing, a surface of the cold plate housing configured to provide a thermal interface for cooling the second electronic device thermally coupled to the cold plate housing; at least one channel within the cold plate housing proximate a surface of the cold plate housing, the at least one channel configured to allow the second liquid coolant to flow through the channel such that heat received through a surface of the cold plate housing from the second electronic device is transferred to the second liquid coolant; The system of claim 12 comprising:

14. The system of claim 13 , wherein the second cooling circulation device further comprises a plurality of conduits configured to transport the second liquid coolant between the cold plate, the heat exchanger, and a cooling system.

15. 1. A method for cooling a plurality of electronic devices contained within a housing of an electronic module, comprising: circulating a first liquid coolant through a first cooling circulation apparatus, the first liquid coolant including circulating the first liquid coolant between a first electronic device of the plurality of electronic devices and a heat exchanger, the heat exchanger being disposed within a housing of the electronic module, the housing of the electronic module containing the first liquid coolant, and the first electronic device being in contact with the first liquid coolant such that heat is transferred to the first liquid coolant from a surface of the first electronic device in contact with the first liquid coolant; circulating a second liquid coolant around a second cooling circulation arrangement, the second liquid coolant including circulating the second liquid coolant between a second electronic device of the plurality of electronic devices and the heat exchanger, the second electronic device being thermally coupled to the second liquid coolant such that heat is transferred from the second electronic device to the second liquid coolant; Including, the first cooling circulation device and the second cooling circulation device are thermally coupled through at least the heat exchanger such that heat is transferred from the first liquid coolant to the second liquid coolant through the heat exchanger; The method of claim 1, wherein the heat exchanger comprises at least a first chamber and a second chamber separated by a thermal interface, the heat exchanger being configured for flow of the first liquid coolant through at least the first chamber and for flow of the second liquid coolant through at least the second chamber such that heat is transferred from the first liquid coolant to the second liquid coolant through the thermal interface.

16. 16. The method of claim 15, wherein the second cooling circulation apparatus further comprises a cooling system, and circulating the second liquid coolant around the second cooling circulation apparatus includes circulating the second liquid coolant between the second electronic device of the plurality of electronic devices, the heat exchanger, and the cooling system, and heat is removed from the second liquid coolant by the cooling system.

17. 16. The method of claim 15, wherein the second cooling circulation apparatus further comprises a second liquid coolant supply facility, and circulating the second liquid coolant around the second cooling circulation apparatus includes receiving the second liquid coolant from the second liquid coolant supply facility, circulating the second liquid coolant between the second electronic device of the plurality of electronic devices and the heat exchanger, and then returning the second liquid coolant to the second liquid coolant supply facility.

18. A method according to any one of claims 15 to 17, wherein the first electronic device is at least partially immersed in the first liquid coolant.

19. The first cooling circuit further comprises a dam, the dam comprising: a base and a retaining wall extending from the base, the base and the retaining wall defining a volume for retaining a portion of the first liquid coolant; an inlet through which the first liquid coolant enters the volume; Equipped with 19. The method of claim 15, wherein flowing sufficient of the first liquid coolant through the inlet and into the volume causes the first liquid coolant to overflow the retaining wall into contact with the surface of the first electronic device, and causes the overflowing first liquid coolant to merge with first liquid coolant contained within the housing of the electronic module and external to the weir for circulation to the first cooling circulation device.

20. 20. The method of claim 15, wherein the second cooling circulation apparatus further comprises a cooling module configured to thermally couple the second electronic device to the second liquid coolant.

21. The cooling module includes a cold plate, the cold plate comprising: a cold plate housing, a surface of the cold plate housing configured to provide a thermal interface for cooling the second electronic device thermally coupled to the cold plate housing; at least one channel within the cold plate housing proximate a surface of the cold plate housing, the at least one channel configured to allow the second liquid coolant to flow through the channel such that heat received from the second electronic device through a surface of the cold plate housing is transferred to the second liquid coolant; The method according to any one of claims 15 to 20, comprising:

Citation Information

Patent Citations

  • Immersion cooler, immersion cooling system, and control method of immersion cooler

    JP2018018857A

  • Liquid flow control management for shared infrastructure servers

    US20170177007A1

  • Hybrid immersion cooled server with integral spot and bath cooling

    US7724524B1

  • Heat Sink, Heat Sink Arrangement and Module for Liquid Immersion Cooling

    WO2019048864A1