Liquid dispensing for electronics racks
By designing a flexible liquid distribution system in an electronic rack, the cooling requirements of high-power density racks are solved, flexible configuration and redundancy are achieved, and cooling effects and costs are optimized.
Patent Information
- Application Number
- CN202011468399.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2020-06-08
- Filing Date
- 2020-12-14
- Publication Date
- 2024-12-06
- Estimated Expiration
- 2040-12-14
AI Technical Summary
Existing cooling systems are difficult to effectively cool high-power density electronic racks, especially in high-heat flow scenarios, liquid cooling becomes a more effective solution, but the flow distribution ports of traditional rack manifolds limit the installation location of liquid cooling equipment and quantity, resulting in insufficient configuration and redundancy.
A flexible liquid distribution system is designed, including a main liquid supply and return unit, a slidable mounting rail and a connecting unit, which allows dynamic configuration of the position and quantity of liquid cooling equipment to be created through flexible supply and return lines. Thermal loop and provides redundancy to deal with failures and demand changes.
It realizes flexible liquid cooling configuration, adapts to different equipment needs, improves the redundancy and efficiency of the system, reduces the total cost, and optimizes the flow rate distribution and cooling effect by dynamically adjusting the number of connection units.
Smart Images

Figure CN113840509B_ABST
Abstract
Description
Technical Field
[0001] Embodiments of the present disclosure generally relate to liquid dispensing systems for electronics racks. Background Art
[0002] Thermal management for a data center that includes several active electronic racks is critical to ensuring proper performance of the servers and other equipment running in the racks. However, without proper thermal management, the thermal environment (e.g., temperature) within the rack may exceed a thermal operating threshold, which may result in adverse consequences (e.g., server failure, etc.). One method of managing the thermal environment is to use cooled air to cool the IT equipment pieces. The cooled air is recirculated using a cooling unit that extracts the heat captured by the cooled air. A commonly used cooling unit is a computer room air conditioning (CRAC) unit, which is a device that draws in hot exhaust air and supplies cooled air to the data center to maintain the thermal environment of the data center. CRAC is an air cooling unit widely used in existing air-cooled data centers, and there are many other types of solutions for air-cooled data centers.
[0003] Recently, data centers have been deploying more high-power density electronic racks, where more high-density chips are packed more tightly together to provide more processing power. Especially due to the development of artificial intelligence (AI) and cloud-based services, high-performance and high-power density processors, such as control processing units (CPUs) and graphics processing units (GPUs), are needed. Maintaining an appropriate thermal environment to cool these high-density racks may be a problem for existing cooling systems, such as CRAC units. For example, although CRAC units can maintain a thermal environment with more traditional (or low-density) racks, CRAC units may not be able to effectively cool high-power density racks because higher-density electronic products can generate heat loads at a higher rate. In some cases, in high-power density or high-heat flow scenarios, liquid cooling becomes a more effective and feasible cooling solution.
[0004] Electronic racks may utilize both liquid cooling and air cooling, where some devices are liquid cooled and other devices are air cooled. In this case, the rack may include a rack manifold that is configured to have a determined number of flow distribution ports at fixed positions. In some cases, the number of ports that a rack may include is less than the number of devices that can be installed in the rack. This means that some locations in the rack are designated for liquid cooling devices, while other locations may be designated for air cooling devices (since these locations may not include flow distribution ports). Thus, the available port locations limit the installable locations of liquid cooling devices in the rack, and the total number of ports of the rack manifold limits the total number of liquid cooling devices. As a result, the configuration of liquid cooling devices and air cooling devices installed in the rack depends on the defined port numbers and locations. Summary of the invention
[0005] The present disclosure provides a liquid distribution system for an electronics rack, an electronics rack, and a data center.
[0006] A liquid distribution system for an electronic rack includes: a main liquid supply and return unit; a mounting rail extending along at least a portion of the height of the electronic rack; and a connection unit slidably coupled to the mounting rail and coupled to the main liquid supply and return unit via a flexible supply line and a flexible return line, the connection unit being arranged to be coupled to an information technology (IT) equipment piece so that coolant from the main liquid supply and return unit circulates through the IT equipment piece to create a heat transfer loop to transfer thermal energy from the IT equipment piece to the coolant.
[0007] An electronic rack comprises: a plurality of slots arranged in a stack, each slot being used to accommodate at least one piece of information technology (IT) equipment configured to provide data processing services; and a liquid distribution system comprising: a main liquid supply and return unit; a mounting rail extending along at least a portion of the height of the electronic rack; and a connection unit slidably coupled to the mounting rail and coupled to the main liquid supply and return unit via a flexible supply line and a flexible return line, the connection unit being arranged to be coupled to the information technology (IT) equipment piece so that coolant from the main liquid supply and return unit circulates through the IT equipment piece to create a heat transfer loop to transfer thermal energy from the IT equipment piece to the coolant.
[0008] A data center comprises: an information technology (IT) room of the data center; and one or more electronic racks in the IT room, each electronic rack comprising: a plurality of slots arranged in a stack, each slot being used to accommodate at least one information technology (IT) equipment piece configured to provide data processing services; and a liquid distribution system comprising: a main liquid supply and return unit; a mounting rail extending along at least a portion of the height of the electronic rack; and a connection unit slidably connected to the mounting rail and connected to the main liquid supply and return unit via a flexible supply line and a flexible return line, the connection unit being arranged to be connected to the information technology (IT) equipment piece so that a coolant from the main liquid supply and return unit circulates through the IT equipment piece to create a heat transfer loop to transfer thermal energy from the IT equipment piece to the coolant. BRIEF DESCRIPTION OF THE DRAWINGS
[0009] Various aspects are shown by way of example and not limitation in the figures of the accompanying drawings, in which like reference numerals indicate similar elements. It should be noted that reference numerals for "an" or "one" aspect of the present disclosure are not necessarily the same aspect, and they are intended to refer to at least one. Moreover, for the sake of brevity and to reduce the total number of drawings, a given drawing may be used to illustrate features of more than one aspect, and not all elements in a drawing are required for a given aspect.
[0010] Figure 1 A side view of the interior of an electronics rack with a liquid distribution system is shown according to one embodiment.
[0011] Figure 2 A front view of an electronics rack with a liquid distribution system is shown according to one embodiment.
[0012] Figure 3 Several connection units of a liquid distribution system relocated to a piece of liquid cooled IT equipment housed within an electronics rack are shown according to one embodiment.
[0013] Figure 4 Several connection units are shown arranged to slide along separate sections of a mounting rail according to one embodiment.
[0014] Figure 5 An example of a container housing portion of a flex wire is shown according to one embodiment.
[0015] Figure 6 An example of a connection unit of a liquid distribution system coupled to several pieces of IT equipment according to one embodiment is shown.
[0016] Figure 7 An example of an IT room with installed electronics racks including a liquid distribution system in a data structure is shown according to one embodiment. DETAILED DESCRIPTION
[0017] Several aspects of the present disclosure are now explained with reference to the accompanying drawings. Whenever the shapes, relative positions and other aspects of the components described in a given aspect are not clearly defined, the scope of the present disclosure herein is not limited to the parts shown, but is for illustrative purposes only. Moreover, although many details are set forth, it should be understood that some aspects can be implemented without these details. In other cases, well-known circuits, structures and techniques are not shown in detail to avoid confusing the understanding of this description. In addition, unless the meaning is obviously contrary, all ranges listed herein are deemed to include the endpoints of each range.
[0018] References in this specification to "one embodiment" or "an embodiment" mean that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the present disclosure. The appearances of the phrase "in one embodiment" in various places in this specification are not necessarily all referring to the same embodiment.
[0019] The present disclosure solves the problem of dynamically configuring an electronic rack, which may include a hybrid solution of air cooling and liquid cooling. The electronic rack may include several slots forming a stack, each slot being used to accommodate information technology (IT) equipment pieces that may be liquid cooled or air cooled (or a combination of both). The present disclosure describes a liquid distribution system for an electronic rack, the liquid distribution system including a main liquid supply and return unit, at least one mounting rail extending along at least a portion of the height of the electronic rack, and at least one connection unit connected to the main liquid supply and return unit via a flexible supply line and a flexible return line. The connection unit is slidably connected to the mounting rail and can be arranged to be connected to an IT equipment piece placed in a slot of the rack via a supply port and a return port to create a heat transfer loop. For example, the connection unit can slide up and down along the mounting rail to be connected to any IT equipment piece in the stack. Thus, the configuration of the liquid-cooled IT equipment pieces and air-cooled IT equipment pieces placed in the stack does not depend on the specific position of the flow port. Rather, the present disclosure provides a flexible liquid cooling solution that can adjust the position of the connection unit (along the mounting rails) to provide liquid cooling depending on where the liquid-cooled IT equipment pieces are positioned within the stack.
[0020] In addition, the flow distribution system of the present disclosure can be configured to accommodate any number of liquid-cooled IT equipment pieces. For example, unlike a rack manifold having a determined number of flow distribution ports, the flow distribution system described herein can be equipped with one or more connection units that can be removably connected to mounting rails and main liquid supply and return units (via flexible lines) and can be arranged to be connected to different IT equipment pieces in order to create various heat exchange loops. In other words, connection units can be added or removed from the flow distribution system based on the needs of rack liquid cooling. Thus, as the port number requirements change based on the number of liquid-cooled IT equipment pieces installed in the rack, the number of connection units can be adjusted to accommodate the needs.
[0021] Being able to adjust the number of connection units can provide a certain degree of redundancy. As described herein, multiple connection units can be slidably connected to the mounting rail. In the event of a connection unit failure (e.g., a coolant leak), the failed connection unit can be separated from the respective IT equipment piece, removed from the mounting rail, and can be replaced by another (redundant) connection unit. Thus, each heat exchange circuit can be replaced and interchanged with a different connection unit, thereby providing redundancy, preventing water leakage during operation, and helping to evenly distribute flow rates. In addition, the number of configurable connection units can reduce the overall cost of the electronic rack. For example, a conventional rack manifold may be expensive and underutilized (e.g., half of the ports may be connected to a liquid cooling device). However, the flow distribution system of the present disclosure provides a configurable liquid cooling solution in which the number of connection units required can be adjusted according to the liquid cooling requirements of each rack.
[0022] According to one embodiment, a liquid distribution system for an electronic rack includes: a main liquid supply and return unit; a mounting rail extending along at least a portion of the height of the electronic rack; and a connection unit slidably coupled to the mounting rail and coupled to the main liquid supply and return unit via a flexible supply line and a flexible return line, the connection unit being arranged to: couple to an information technology (IT) equipment piece to circulate coolant from the main liquid supply and return unit through the IT equipment piece to create a heat transfer loop that transfers thermal energy from the IT equipment piece to the coolant.
[0023] In one embodiment, the connection unit is arranged to be removably connected to the IT equipment piece via a supply port and a return port. In another embodiment, the main liquid supply and return unit is removably connected to a coolant source via a main supply port and a main return port to 1) receive coolant from the coolant source, and 2) provide warm coolant generated by transferring thermal energy into the coolant to the coolant source. In some embodiments, the liquid distribution system also includes a liquid manifold, which is arranged to connect the connection unit to one or more IT equipment pieces to create a respective heat transfer loop for each IT equipment piece. In one embodiment, the liquid distribution system also includes a container disposed between the connection unit and the main liquid supply and return unit, and the container is sized to accommodate at least a portion of each of the flexible supply line and the flexible return line.
[0024] In some embodiments, the connection unit is a first connection unit, and the liquid dispensing system further comprises a second connection unit slidably coupled to the mounting rail below the first connection unit, wherein both connection units are arranged to slide independently of each other along the mounting rail. In another embodiment, the mounting rail comprises an upper portion extending along an upper half of the electronics rack and a lower portion extending along a lower half of the electronics rack, the first connection unit is slidably coupled to the upper portion, and the second connection unit is slidably coupled to the lower portion, and each of the connection units is arranged to slide only along its respective portion. In one embodiment, the flexible supply line is a first flexible supply line, and the flexible return line is a first flexible return line, and the second connection unit is connected to the main liquid supply and return unit via the second flexible supply line and the second flexible return line; and the sizes of the first flexible supply line and the first flexible return line are set so that when the first connection unit is connected to the main liquid supply and return unit, the first connection unit is prevented from sliding below the upper half of the mounting rail by the first flexible supply line and the first flexible return line; and the sizes of the second flexible supply line and the second flexible return line are set to be different from the sizes of the first flexible supply line and the first flexible return line, so that when the second connection unit is connected to the main liquid supply and return unit, the second flexible supply line and the second flexible return line will not prevent the second connection unit from sliding along the entire length of the mounting rail.
[0025] According to another embodiment, an electronics rack includes: several slots arranged in a stack, each slot for accommodating at least one piece of information technology (IT) equipment configured to provide data processing services; and a liquid distribution system similar to the liquid distribution system described above.
[0026] According to another embodiment, a data center includes at least one data center IT room, and the data center IT room includes one or more electronic racks similar to the aforementioned electronic racks.
[0027] As described herein, a component being "coupled" to another component may refer to two components being fluidly coupled together so as to allow a fluid and / or vapor, such as a liquid coolant (or coolant), to flow between the two components. For example, a line (tube or hose) being fluidly coupled to another line refers to coupling (or connecting) the two lines so that a fluid can flow from one line to the other line. In another embodiment, a component being "coupled" to another component may refer to two components being slidably coupled together so as to allow one component to slide (or move) in (at least) one direction relative to the other component while still being coupled together. For example, a component (e.g., a connecting unit as described herein) and a rail being slidably coupled together may refer to a component being coupled (or mounted) to the rail and the component being able to slide longitudinally (e.g., manually) along the length of (at least a portion of) the rail.
[0028] Figure 1 A side view of the interior of an electronics rack with a liquid distribution system according to one embodiment is shown. Specifically, the figure shows an electronics rack 1 (hereinafter may be referred to as a "rack") including a liquid distribution system 3, and the electronics rack 1 can be arranged for one or more IT equipment pieces for liquid cooling and / or air cooling. In one embodiment, the electronics rack 1 can be a standard rack (e.g., having a chassis) with a standard size, such as a typical full-size 42U rack. In another embodiment, the rack can be any size with any size.
[0029] The electronic rack 1 includes eight slots 4a to 4h, a liquid distribution system 3, a main supply port 8, a main return port 9, and three fans 13a to 13c. Each of the slots is sized to receive and place (or accommodate) one or more IT equipment pieces. For example, each of the slots 4a to 4d includes an IT equipment piece, each of which can be inserted into its respective slot from the front of the rack. The remaining slots 4e to 4h remain vacant. In one embodiment, the equipment can be inserted from the front and / or back of the rack. In one embodiment, the rack may include more or fewer slots than the eight shown. For example, the rack may include forty-two slots, each of which is used to accommodate at least one IT equipment piece having a height of 1U. In another embodiment, the IT equipment piece may have any height, such as 1U, 2U, 3U, or 4U.
[0030] Each of the IT equipment pieces 2a to 2d may include one or more IT components (e.g., a central processing unit or CPU, a graphics processing unit (GPU), a memory, and / or a storage device). Each IT component can perform data processing tasks, wherein the IT component may include software installed in a storage device, loaded into the memory, and the software is run by one or more processors to perform data processing tasks. At least some of these IT components may be attached to the cooling disk described herein. An IT equipment piece may include a host server (referred to as a host node) connected to one or more computing servers (also referred to as computing nodes, such as CPU servers and GPU servers). The host server (having one or more CPUs) is typically connected to a client via a network (e.g., the Internet) to receive requests for specific services such as storage services (e.g., cloud-based storage services such as backup and / or restore), and execute applications to perform certain operations (e.g., image processing, deep data learning algorithms or modeling, etc. as part of a software as a service or SaaS platform). In response to the request, the host server assigns the task to one or more of the performance computing nodes or computing servers (having one or more GPUs) managed by the host server. In one embodiment, when the IT equipment pieces are operating (eg, performing data processing tasks), the IT equipment pieces may generate heat, which may be dissipated due to an air cooling scheme and / or a liquid cooling scheme, as described herein.
[0031] In one embodiment, the rack 1 may include a power supply unit (PSU) and / or a backup battery unit (BBU), each of which may be installed in one or more slots. The PSU may include necessary circuits (e.g., an alternating current (AC) to direct current (DC) or DC to DC power converter, a backup battery, a transformer or a voltage regulator, etc.) to provide power to other components of the electronic rack. The BBU may be configured to provide backup battery power to the electronic equipment when the (main) power (provided by the PSU) is unavailable (e.g., a power outage).
[0032] Each of the fans 13a to 13c is mounted on the back of the electronic rack 1 and is arranged to generate airflow to provide air cooling to one or more IT equipment pieces placed in the rack. For example, fans 13a to 13c can generate airflow that flows from the front of the rack through the interior of the rack (e.g., the air chamber of at least some equipment placed inside the rack) and flows out from the back of the rack. In another embodiment, the fan can generate reverse airflow, meaning that air flows from the back of the rack to the front. In another embodiment, at least some fans can be installed in front of the rack. In some embodiments, each of the fans can be associated with at least one IT equipment piece. For example, fan 13a can be set on the rack so that it generates airflow for IT equipment piece 2a. In this case, the rack can include at least one fan for each IT equipment piece contained in the rack. In another embodiment, as shown in the figure, the rack can have fewer fans than slots.
[0033] The liquid distribution system 3 includes a mounting rail 6, a main liquid supply and return unit 7, four connection units 5a to 5d, and four pairs of flexible lines 12a to 12d. In one embodiment, the system may include more or fewer components, such as having one or more connection units and one or more mounting rails (such as Figure 2 As shown, the liquid distribution system is housed (e.g., integrated) within the electronics rack 1 (e.g., a housing or frame). In another embodiment, the liquid distribution system may be (at least partially) separate from the electronics rack. For example, the system may be contained in a separate unit (or housing). In another embodiment, at least some of the components may be contained within the electronics rack, such as the connection units 5a to 5d and the mounting rails 6. In this case, the main liquid supply and return unit may be in a separate unit.
[0034] The mounting rail 6 is a structure arranged for mounting (e.g., slidably coupling) one or more connection units and sized to extend along at least a portion of the height of the electronics rack (e.g., in a vertical direction). As shown, the mounting rail extends along the height of the electronics rack. Specifically, the mounting rail is disposed within the rack and secured (e.g., via one or more fasteners) to the interior (wall) of the rack, and extends along the height of the interior of the rack. Also as shown, the mounting rail is positioned adjacent to the slots 4a to 4h so that the connection units coupled to the rails can be fluidly coupled to one or more IT equipment pieces disposed within the slots via ports to circulate coolant through the IT equipment pieces, as described herein.
[0035] In one embodiment, the mounting rail 6 includes one or more (eg, threaded) holes (eg, Figure 2As shown in FIG. 1 , the holes can be separated from each other at a mounting hole spacing that meets a standard rack protocol (such as EIA-310 for a standard rack). As a result, in order to connect the connection unit to an IT equipment piece inserted into a slot, the connection unit connected to the mounting rail can be positioned proximate (or adjacent) to any slot in the stack. More is described herein regarding the connection of IT equipment pieces to the connection unit.
[0036] In one embodiment, the connection unit 5a to 5d may include one or more mechanisms that enable the connection unit to slide along the mounting rail 6. In one embodiment, the connection unit may include a rail (e.g., a rail coupled to the side of the connection unit) arranged to slide along the mounting rail when the two rails are coupled. The connection unit may slide along the mounting rail 6 to a specific position (e.g., by a technician) and may be installed in place by coupling the unit to the mounting rail 6 via one or more bolts (or fasteners) inserted into the holes of the mounting rail. In another embodiment, the connection unit may include any mechanism that enables the connection unit to slide along the mounting rail and be coupled to a specific position along the rail. In one embodiment, each of the connection units may slide along (at least a portion of) the mounting rail 6 independently of one another. In some embodiments, at least some of the connection units may be removably coupled to the mounting rail 6. Thus, the connection unit may be added to the liquid dispensing system 3 or removed from the liquid dispensing system 3.
[0037] Each of the connection units 5a to 5d is configured to be removably connected to one or more IT equipment pieces via a connection unit supply port (or supply port) 10 and a connection unit return port (or return port) 11. Specifically, as shown, each of the connection units 5a to 5d is connected to IT equipment pieces 2a to 2d via a supply port and a return port, respectively. In one embodiment, each of the ports may include a connector, such as a drip-free blind-mate quick disconnect. For example, each of the ports may be a formula drip-free connector. In this case, the IT equipment piece may include two female drip-free connectors. In order to connect an IT equipment piece such as 2a to a connection unit such as 5a, the connection unit may first be positioned adjacent to the slot 4a. Once positioned, the IT equipment piece 2a may be inserted into the slot 4a and then pushed into the slot until the connector of the IT equipment piece is connected (or paired) with the connector of the corresponding connection unit 5a. In one embodiment, the IT equipment piece may include a formula connector, and the connection unit includes a female connector.
[0038] Each of the connection units 5a to 5d is configured to connect the flexible wires 12a to 12d (each pair includes a flexible supply wire 20 and a flexible return wire 21, such as Figure 210 and 11) are fluidly coupled to the main liquid supply and return unit 7. In one embodiment, each of the connection units may include two ports, an inlet port and an outlet port (not shown) fluidly coupled to the supply port 10 and the return port 11, so that coolant can flow between the coupled ports. For example, the connection unit may include at least two internal lines, wherein the inlet port is coupled to the supply port 10 via at least one line, and the outlet port is coupled to the return port 11 via at least another line. Thus, in this example, the inlet port is arranged to be coupled to the flexible supply line 20, and the outlet port is arranged to be coupled to the flexible return line 21. In one embodiment, the inlet port and the outlet port may include connectors, such as non-drip blind-mate quick disconnects arranged to be removably coupled to their respective flexible lines (e.g., the inlet port and the outlet port may include female connectors, and the flexible line includes a male connector).
[0039] In one embodiment, each of the connection units 5a to 5d is arranged to be fluidly coupled to an IT equipment piece to circulate coolant from the main liquid supply and return unit through the IT equipment piece (e.g., through ports 10 and 11) to create a heat transfer loop that transfers thermal energy from the IT equipment piece (e.g., when the IT equipment piece is operating, such as providing data processing services) to the coolant. More is described herein about creating a heat transfer loop.
[0040] In order to allow coolant to circulate through the respective heat transfer loops of each connection unit, the main liquid supply and return unit is arranged to removably connect a coolant source (not shown) to one or more connection units (units 5a to 5d). In one embodiment, the main liquid supply and return unit 7 is removably connected to the coolant source via a main supply port 8 and a main return port 9. In one embodiment, ports 8 and 9 can be part of an electronic rack. In another embodiment, ports 8 and 9 can be part of the main liquid supply and return unit 7. In one embodiment, the main supply port 8 can be connected to a supply line (not shown) to receive coolant from a coolant source, and the main return port 9 can be connected to a return line (not shown) to return (or provide) warm coolant generated by transferring thermal energy into the coolant to the coolant source by one or more IT equipment pieces. In one embodiment, as described herein, ports 8 and 9 can include connectors, such as non-drip blind-mate quick disconnects.
[0041] The main liquid supply and return unit 7 includes four pairs of ports, each of which is connected to a connection unit via a respective flexible line. Each pair of ports includes a supply port 14 arranged to be connected to a flexible supply line 20 (connected to a connection unit), and a return port 15 arranged to be connected to a flexible return line 21 (connected to the same connection unit), such as a flexible line 12a that is connected to the connection unit 5a and the main liquid supply and return unit 7. In one embodiment, at least some of the supply port pairs can be arranged to be removably connected to the flexible line. In this case, as described herein, the port can include a connector, such as a drip-free matching quick disconnect. In some embodiments, the main liquid supply and return unit 7 can include more or fewer pairs of ports (e.g., to allow more or fewer connection units to be connected to the main liquid supply and return unit 7).
[0042] In one embodiment, the main liquid supply and return unit 7 may include a main fluid distribution manifold (not shown) configured to connect each of the connection units to a coolant source to create individual heat transfer loops. For example, once each of the connection units (e.g., the connection unit supply port 10 and the connection unit return port 11 of each of the connection units) is connected to an IT equipment piece, the coolant can be circulated as follows. The main liquid supply and return unit 7 receives coolant from a coolant source via a main supply port 8 and provides coolant to each of the connection units via respective flexible supply lines. The coolant flows through each connection unit via the connection unit supply port 10 of the connection unit and flows into its respective IT equipment piece. Each IT equipment piece transfers heat to the coolant to produce warm coolant, which is then returned to the connection via the connection unit return port 11 of the connection unit. The warm coolant flows through each connection unit and returns to the main liquid supply and return unit 7 via respective flexible return lines. In this article, the warm coolant from each of the connection units is mixed together and returned (provided) to the coolant source via the main return port 9. In some embodiments, once a circuit is disconnected (e.g., an IT equipment piece is disconnected from its respective connection unit), the coolant may stop circulating in any heat transfer circuit. However, if this occurs, the coolant may still flow through the remaining heat transfer circuits.
[0043] In one embodiment, the main liquid supply and return unit 7 may include a cooling distribution unit (CDU) configured to provide liquid cooling. In one embodiment, the CDU may include at least one of a heat exchanger, a liquid pump, one or more monitoring sensors, a liquid reservoir, and / or a pump controller. In some embodiments, the heat exchanger may be a liquid to liquid heat exchanger. The heat exchanger may be coupled to the main supply port 8 and the main return port 9 to form a main loop with a coolant source. In addition, the heat exchanger may include an inlet coupled to each return port 15 and an outlet coupled to each supply port 14, thereby forming a heat transfer loop with each of the connection units as a secondary loop. In one embodiment, the heat exchanger may be coupled to each of the connection units via a fluid distribution manifold. During operation, the heat exchanger may transfer heat from a warm coolant supplied by each of the connection units (via a flexible return line and a return port) to a coolant received from a coolant source (via a main supply port). Once the heat is extracted, the cooled coolant may be redistributed by each of the secondary loops. In one embodiment, the coolant in the secondary loop may circulate via one or more liquid pumps. Thus, the coolant in each of the secondary loops does not contact the coolant flowing in the primary loop. Note that the CDU can be any type of CDU, commercially available or custom made. Thus, the details of the CDU will not be described herein. In one embodiment, at least some of the CDU components can be mounted in at least one of the slots (e.g., a pump controller can be mounted to slot 4h).
[0044] As described herein, each of the components can be coupled to another via a connector (such as a no-drip blind-mate quick disconnect). In one embodiment, each of the connectors can be the same type of connector, such as being the same type of connector and / or having the same size. In this case, each of the connectors can have the same inner diameter. However, in another embodiment, at least some of the connectors can be different. For example, the connection unit supply port 10 and return port 11 of the connection unit 5a can have smaller connectors (having a smaller inner diameter) than the ports of the connection unit 5b. As a result, the coolant flow rate of the heat transfer circuit through the connection unit 5a can be slower than the coolant flow rate of the heat transfer circuit through the connection unit 5b. In some embodiments, the connector can be removably coupled to the port so that different types of connectors (e.g., based on the type of connector of the IT equipment piece) can be interchanged as needed.
[0045] In one embodiment, the flexible lines 12a to 12d can be made of any flexible material. For example, the line can be made of metals such as copper, polymers (e.g., ethylene propylene diene monomer (EPDM) rubber), vinyl and / or plastics (e.g., polyurethane). In one embodiment, the supply line (e.g., line 20) can be different from the return line (e.g., line 21). For example, the supply line can have a smaller inner diameter, while the return line includes a larger inner diameter. As described herein, the flexible line can include any type of connector, such as a drip-free matching quick disconnect. In another embodiment, the flexible line can include a barb fitting at either end of the flexible line so that the barb fitting at one end of the flexible line is connected to a connection unit (e.g., an inlet port of the connection unit), and another barb fitting at the other end of the flexible line is connected to the main liquid supply and return unit 7 (e.g., the supply port 14 of the main liquid supply and return unit 7).
[0046] In one embodiment, the dimensions of the flexible lines 12a to 12d can be set so that the connection units 5a to 5d can slide along at least a portion of the mounting rails 6 while remaining connected to the main liquid supply and return unit via the flexible lines. Specifically, in order to create a heat transfer loop, the length of the flexible lines may exceed the length required for each connection unit to be connected to the IT equipment piece. This situation is illustrated by each of the flexible lines 12a to 12d hanging below the connection unit (connected to each of the flexible lines). As a result, at least some of the connection units can slide (or move) along the mounting rails. In one embodiment, each of the flexible lines 12a to 12d can have the same length. In another embodiment, at least some of the flexible lines 12a to 12d can have different lengths. More description is given herein about the flexible lines.
[0047] In some embodiments, the electronics rack may include additional components, such as a rack management unit (RMU) that may be installed in one or more slots of the electronics rack. The RMU is configured to provide and manage power supplied to the IT equipment pieces 2a to 2d, fans 13a to 13c, and / or other components (e.g., the main liquid supply and return unit 7). In one embodiment, the RMU may be coupled to the PSU to manage the power consumption of the PSU.
[0048] In one embodiment, the RMU includes an optimization module and a rack management controller (RMC). The RMC may include a monitor to monitor the operating status of various components in the electronic rack (e.g., IT equipment pieces 2a to 2d, the CDU of the return unit, and fans 13a to 13c). Specifically, the monitor receives operating data from various sensors representing the operating environment of the electronic rack. For example, the monitor can receive operating data representing the temperature of the processor, coolant, and airflow, and the operating data can be captured and collected by various temperature sensors. The monitor can also receive data representing fan power and pump power, which are generated by the fan and the liquid pump of the CDU and can be proportional to their respective speeds. These operating data are called real-time operating data. Note that the monitor can be implemented as a separate module within the RMU.
[0049] Based on the operating data, the optimization module performs optimization using a predefined optimization function or optimization model to derive a set of optimal fan speeds for one or more fans 13a to 13c and a set of optimal pump speeds for the liquid pump, so that the operating data associated with the liquid pump and the cooling fan of the fan are within their respective design specifications, while the total power consumption of the power liquid pump and fan module is minimized. Once the optimal pump speed and the optimal fan speed are determined, the RMC configures the liquid pump and the cooling fan based on the optimal pump speed and the fan speed.
[0050] As an example, based on the optimal pump speed, the RMC communicates with the pump controller of the CDU to control the speed of the liquid pump, which in turn controls the liquid flow rate of the coolant supplied to one or more connection units 5a to 5d for distribution to the equipment. Thus, the operating conditions and the corresponding cooling equipment performance are adjusted. Similarly, based on the optimal fan speed, the RMC communicates with each of the fans 13a to 13c to control the speed of the fan, which in turn controls the airflow rate of the fan module 531. Note that each fan module 531 can be individually controlled with its specific optimal fan speed, and different fan modules and / or different cooling fans within the same fan module can have different optimal fan speeds.
[0051] Figure 2A front view of an electronic rack 1 with a liquid distribution system 3 according to one embodiment is shown. As shown, the liquid distribution system 3 can occupy only a portion of the total width of the rack. In one embodiment, the system can occupy a larger portion of the width to accommodate larger connection units. In addition, the figure shows that the system includes two mounting rails, one mounting rail can be fixed to the inner wall of the rack (as previously described), and the other mounting rail can be positioned along the interior of the rack (mounted to the upper and lower portions of the rack). As described herein, each of the connection units can be coupled between the two mounting rails and slide along the rails. Flexible supply lines 20 and flexible return lines 21 of flexible lines 12a to 12d are also shown (a total of eight lines, four supply lines and four return lines).
[0052] Figure 3 Several connection units of a liquid distribution system for liquid cooled IT equipment pieces housed within an electronics rack are shown that have been relocated to liquid cooled IT equipment pieces housed within an electronics rack according to one embodiment. In the figure, electronics rack 1 has been reconfigured to include several air cooled IT equipment pieces, with the result that several liquid cooled IT equipment pieces have been moved to different slots. Specifically, air cooled IT equipment pieces 2e through 2h have been inserted into slots 4c through 4f, respectively, while liquid cooled IT equipment pieces 2c and 2d, which were previously housed in slots 4c and 4d, have been moved to slots 4g and 4h, respectively. In one embodiment, the location of the IT equipment pieces may have changed due to processing requirements. As a result of the relocation of IT equipment pieces 2c and 2d, connection units 5c and 5d have been moved downward along the mounting rails.
[0053] In one embodiment, the range of movement of each of the connection units can be based on the size (e.g., length) of the flexible wire of the unit. For example, the size of the flexible wire can be set to prevent the connection unit 5b from sliding below the upper half (e.g., H2) of the mounting rail (which can correspond to the upper half of the interior of the electronic rack) when the connection unit is connected to the main liquid supply and return unit 7. For example, when the unit begins to slide below H2, the flexible wire 12b can become taut, thereby preventing the unit from moving further. However, the size of other flexible wires can be different. For example, the size of the flexible wire 12d can be set to prevent the connection unit 5d from sliding along the entire length (e.g., H1) of the mounting rail (which can correspond to the entire height of the interior of the electronic rack) when the connection unit is connected to the main liquid supply and return unit, and the connection unit is connected to the main liquid supply and return unit. Thus, the flexible wire 12d may not prevent the connection unit 5d from sliding along the length of the mounting rail. However, other connection units above connection unit 5d may prevent its range of movement (eg, beyond the next connection unit above it, in this case connection unit 5c).
[0054] In another embodiment, each of the connection units may have a different range of movement based on its respective flex line. For example, flex line 12a may enable connection unit 5a to have a first range of movement (e.g., allowing the unit to be coupled to pieces of IT equipment in slots 4a and 4b), while flex line 12b may enable connection unit 5b to have a second range of movement (e.g., allowing the unit to be coupled to pieces of IT equipment in slots 4a to 4d).
[0055] In some embodiments, the size of the flexible wires connecting the connection units can be based on the position of the connection units along the stack of connection units connected to the mounting rail. For example, the lower the connection unit in the stack, the longer the flexible wire. In another embodiment, the connection units can be divided into two groups, each group having flexible wires of different sizes. For example, the upper half of the connection unit (5a and 5b in this case) can have a flexible wire of a first size, while the lower half of the connection unit (5c and 5d in this case) can have a flexible wire of a second size. The flexible wire of the first size can allow the upper half of the connection unit to have a range of movement along H2, while the flexible wire of the second size can allow the lower half of the connection unit to have another range of movement along H1. In some embodiments, the lower half of the connection unit can have a range of movement only along a portion of the mounting rail, such as along the lower half of the mounting rail (e.g., H3).
[0056] Figure 4 Several connection units arranged to slide along independent portions of a mounting rail are shown according to one embodiment. Specifically, the figure shows that the mounting rail 6 includes an upper portion 45 extending along H2 and a lower portion 46 extending along H3. In one embodiment, both portions are independent of each other. Specifically, connection units 5a and 5b are slidably coupled to the upper portion 45 and are arranged to slide only along that portion; while connection units 5c and 5d are slidably coupled to the lower portion 46 and are arranged to slide only along that portion. In one embodiment, the connection unit coupled to the upper portion 45 may have a flexible line having a first length, and the connection unit coupled to the lower portion 46 may have a flexible line having a second length that is longer than the first length.
[0057] Figure 5 An example of a container housing portion of a flexible line according to one embodiment is shown. Specifically, the figure shows that the liquid dispensing system 3 includes a container 40, which is disposed between the connection units 5a to 5d and the main liquid supply and return unit 7 and is sized to accommodate at least a portion of each of the flexible lines 12a to 12d. Specifically, the container includes an excess flexible supply line portion 41 and an excess flexible return line portion 42 (each being a portion of the flexible line 12a to 12d). In one embodiment, as Figure 1As shown, these parts are redundant and would hang below the respective connection unit lines if no container was provided. In some embodiments, the container is watertight so that any leaks in the line (or from the main liquid supply and return unit) can be contained within the container. In another embodiment, the container can include the main liquid supply and return unit 7.
[0058] Figure 6 An example of a connection unit of a liquid distribution system coupled to several IT equipment pieces according to one embodiment is shown. As shown so far, for example, Figure 1 As shown, the connection unit can be connected to a specific IT equipment piece. The figure shows several connection units, which are connected to multiple IT equipment pieces to provide liquid cooling. For example, the liquid distribution system 3 includes a liquid manifold 51, which is arranged to connect the connection unit to one or more IT equipment pieces to create individual heat transfer loops for each IT equipment piece. In particular, the liquid manifold 51 is connected to the connection unit supply port 10 and the connection unit return port 11 of the connection unit 5a, and is connected to two IT equipment pieces 2a and 2b. As shown, the liquid manifold is arranged to receive coolant via the supply port 10 and supply the coolant to the IT equipment pieces 2a and 2b (e.g., via the supply port), and receive warm coolant from the equipment (e.g., via the return port) and supply the warm coolant to the connection unit via the return port 11. In one embodiment, as described herein, the port to which the IT equipment piece is connected may include a connector.
[0059] As shown, the liquid manifold 51 is independent of the connection unit 5a. Thus, the manifold can be removably coupled to the connection unit. This can allow any connection unit to be converted to provide liquid cooling to multiple IT equipment pieces. In another embodiment, the liquid manifold can be fixedly connected to the connection unit.
[0060] The figure shows a connection unit 5e in which a liquid manifold 52 is integrated. The connection unit 5e is arranged to be coupled to one or more IT equipment pieces to create individual heat transfer loops. As shown, the connection unit 5e is coupled to the IT equipment piece 2c via a flexible line 55 and to the IT equipment piece 2d via a flexible line 56. In one embodiment, the connection unit may include multiple pairs of connection unit flexible supply ports 10 and return ports 11 that allow the connection unit to be coupled to one or more IT equipment pieces. Each of the supply ports and return ports may be coupled to the liquid manifold 52, which is coupled to the main liquid supply and return unit 7 via a single pair of flexible lines 12e.
[0061] Figure 7An example of an IT room in a data center having an installed electronic rack including a liquid distribution system is shown according to one embodiment. Specifically, the figure shows a data center IT room 60 (of a data center) having two IT PODs (POD A 64a and POD B 64b) and an IT room cooling liquid supply and return loop 61 connected to a coolant source 70. In one embodiment, the coolant source can be a single-phase liquid to liquid heat exchanger. In another embodiment, the coolant source can be a data center cooling liquid system or an IT liquid cooling water system. In this case, loop 61 can be part of the system. In some embodiments, the coolant source can be any type of source configured to remove heat from a warm liquid coolant to produce a cooled liquid coolant. As shown, the coolant source is separate from the data center IT room (e.g., external). In one embodiment, the coolant source can be inside the room.
[0062] Each POD is surrounded by a cold aisle 62 and has a hot aisle 63 in the middle of the POD. Each POD is equipped with twelve electronic racks 1, which include a liquid distribution system on each side of the hot aisle. In order to provide liquid cooling to the respective electronic racks of the system, each of the liquid distribution systems is connected to the IT room cooling liquid supply and return loop 61. In one embodiment, some of the electronic racks may not include a liquid distribution system.
[0063] In one embodiment, at least some of the electronics racks can provide air cooling to some of the IT equipment pieces housed therein. These racks can draw (e.g., using one or more fans) cool air from the cold aisle 62 to remove contained heat from one or more IT equipment pieces (or IT components), thereby generating hot exhaust air that is pushed into the hot aisle 63. The warm air in the hot aisle 63 can be air conditioned using any type of data center air conditioning unit and can be circulated back into the cold aisle 62. As described herein, this design enables air cooling components within the racks to be cooled in addition to liquid cooling components coupled to the liquid distribution system.
[0064] As previously described, embodiments of the present disclosure may be (or include) a non-transitory machine-readable medium (such as a microelectronic memory) having stored thereon instructions that program one or more data processing components (generally referred to herein as "processors") to perform cooling operations, such as the flow of one or more liquid pumps described herein. In other embodiments, some of these operations may be performed by specific hardware components containing hardwired logic. These operations may alternatively be performed by any combination of programmed data processing components and fixed hardwired circuit components.
[0065] In the above description, embodiments of the present disclosure have been described with reference to specific exemplary embodiments of the present disclosure. It will be apparent that various modifications may be made to the present invention without departing from the broader spirit and scope of the present disclosure as set forth in the appended claims. Thus, the present description and the accompanying drawings should be understood in an illustrative rather than a restrictive sense.
[0066] Although certain aspects have been described and shown in the drawings, it will be understood that these aspects are merely illustrative and not restrictive of the broad disclosure, and that the disclosure is not limited to the specific constructions and arrangements shown and described, since various other modifications may be made by those skilled in the art. The description is therefore to be regarded as illustrative and not restrictive.
[0067] In some aspects, the disclosure may include language such as “at least one of [element A] and [element B].” The language may refer to one or more elements. For example, “at least one of A and B” may refer to “A,” “B,” or “A and B.” Specifically, “at least one of A and B” may refer to “at least one of A and at least one of B” or “at least one of A or B.” In some aspects, the disclosure may include language such as “[element A], [element B], and / or [element C].” The language may refer to any one of the elements or any combination thereof. For example, “A, B, and / or C” may refer to “A,” “B,” “C,” “A and B,” “A and C,” “B and C,” or “A, B, and C.”
Claims
1. A liquid dispensing system for an electronic rack, the liquid dispensing system comprising: Main liquid supply and return unit; a mounting rail extending along at least a portion of the height of the electronics rack; as well as a connecting unit slidably coupled to the mounting rail and coupled to the main liquid supply and return unit via a flexible supply line and a flexible return line, wherein The connection unit is arranged to slide up and down along the mounting rail to couple to an information technology equipment piece to circulate coolant from the main liquid supply and return unit through the information technology equipment piece to create a heat transfer loop to transfer thermal energy from the information technology equipment piece to the coolant; Therein, the connection unit is arranged to be removably coupled to the piece of information technology equipment via a supply port and a return port.
2. The liquid dispensing system according to claim 1, wherein: The main liquid supply and return unit is removably coupled to a coolant source via a main supply port and a main return port to 1) receiving the coolant from the coolant source, and 2) Providing warm coolant to the coolant source, generated by transferring thermal energy into the coolant.
3. The liquid distribution system of claim 1, further comprising a liquid manifold arranged to couple the connection unit to one or more pieces of information technology equipment, creating a respective heat transfer loop for each piece of information technology equipment.
4. The liquid dispensing system of claim 1 further comprising a container disposed between the connection unit and the main liquid supply and return unit, and the container is sized to accommodate at least a portion of each of the flexible supply line and the flexible return line.
5. The liquid dispensing system according to claim 1, wherein: The connection unit is a first connection unit, wherein the liquid dispensing system further comprises a second connection unit slidably coupled to the mounting rail below the first connection unit, wherein both connection units are arranged to slide along the mounting rail independently of each other.
6. The liquid dispensing system according to claim 5, wherein: The mounting rail includes an upper portion extending along the upper half of the electronic rack, and a lower portion extending along the lower half of the electronic rack, wherein: The first connection unit is slidably coupled to the upper portion, and the second connection unit is slidably coupled to the lower portion, wherein Each of the connecting units is arranged to slide only along its respective portion.
7. The liquid dispensing system according to claim 5, in, the flexible supply line is a first flexible supply line, and the flexible return line is a first flexible return line, wherein the second connection unit is coupled to the main liquid supply and return unit via a second flexible supply line and a second flexible return line, and wherein the first flexible supply line and the first flexible return line are sized such that when the first connection unit is coupled to the main liquid supply and return unit, the first connection unit is prevented from sliding below the upper half of the mounting rail by the first flexible supply line and the first flexible return line; and The dimensions of the second flexible supply line and the second flexible return line are set to be different from the dimensions of the first flexible supply line and the first flexible return line, so that when the second connection unit is connected to the main liquid supply and return unit, the second flexible supply line and the second flexible return line will not prevent the second connection unit from sliding along the entire length of the mounting rail.
8. Electronic rack, including: a plurality of slots arranged in a stack, each slot being configured to accommodate at least one piece of information technology equipment configured to provide data processing services; as well as Liquid dispensing system, comprising: Main liquid supply and return unit, a mounting rail extending along at least a portion of the height of the electronics rack, and a connection unit slidably coupled to the mounting rail and coupled to the main liquid supply and return unit via a flexible supply line and a flexible return line, the connection unit being arranged to slide up and down along the mounting rail to couple to the information technology equipment piece to circulate coolant from the main liquid supply and return unit through the information technology equipment piece to create a heat transfer loop to transfer thermal energy from the information technology equipment piece to the coolant; Therein, the connection unit is arranged to be removably coupled to the piece of information technology equipment via a supply port and a return port.
9. The electronics rack of claim 8, further comprising a main supply port and a main return port that removably couple the main liquid supply and return unit to a coolant source to 1) receiving the coolant from the coolant source, and 2) Providing warm coolant to the coolant source, generated by transferring thermal energy into the coolant.
10. The electronic rack according to claim 8, wherein: The connection unit further comprises a liquid manifold arranged to couple the connection unit to one or more pieces of information technology equipment, creating a respective heat transfer loop for each piece of information technology equipment.
11. The electronics rack of claim 8, further comprising a container disposed between the connection unit and the main liquid supply and return unit, and the container is sized to accommodate at least a portion of each of the flexible supply line and the flexible return line.
12. The electronic rack according to claim 8, wherein: in, The connection unit is a first connection unit, wherein the liquid dispensing system further comprises a second connection unit slidably coupled to the mounting rail below the first connection unit, wherein both connection units are arranged to slide along the mounting rail independently of each other.
13. The electronic rack according to claim 12, wherein: The mounting rail includes an upper portion extending along the upper half of the electronic rack, and a lower portion extending along the lower half of the electronic rack, wherein: The first connection unit is slidably coupled to the upper portion, and the second connection unit is slidably coupled to the lower portion, wherein Each of the connecting units is arranged to slide only along its respective portion.
14. The electronic rack according to claim 12, in, the flexible supply line is a first flexible supply line, and the flexible return line is a first flexible return line, wherein the second connection unit is coupled to the main liquid supply and return unit via a second flexible supply line and a second flexible return line, and wherein the first flexible supply line and the first flexible return line are sized such that when the first connection unit is coupled to the main liquid supply and return unit, the first connection unit is prevented from sliding below the upper half of the mounting rail by the first flexible supply line and the first flexible return line; and The dimensions of the second flexible supply line and the second flexible return line are set to be different from the dimensions of the first flexible supply line and the first flexible return line, so that when the second connection unit is connected to the main liquid supply and return unit, the second flexible supply line and the second flexible return line will not prevent the second connection unit from sliding along the entire length of the mounting rail.
15. Data center, including: Data center information technology room; as well as One or more electronic racks in the information technology room, each electronic rack comprising: a plurality of slots arranged in a stack, each slot being configured to accommodate at least one piece of information technology equipment configured to provide data processing services; and Liquid dispensing system, comprising: Main liquid supply and return unit, a mounting rail extending along at least a portion of the height of the electronics rack, and a connection unit slidably coupled to the mounting rail and coupled to the main liquid supply and return unit via a flexible supply line and a flexible return line, the connection unit being arranged to slide up and down along the mounting rail to couple to the information technology equipment piece to circulate coolant from the main liquid supply and return unit through the information technology equipment piece to create a heat transfer loop to transfer thermal energy from the information technology equipment piece to the coolant; Therein, the connection unit is arranged to be removably coupled to the piece of information technology equipment via a supply port and a return port.
16. The data center according to claim 15, wherein: in, The connection unit is a first connection unit, wherein the liquid dispensing system further comprises a second connection unit slidably coupled to the mounting rail below the first connection unit, wherein both connection units are arranged to slide along the mounting rail independently of each other.
17. The data center according to claim 16, wherein: The mounting rail includes an upper portion extending along the upper half of the electronic rack, and a lower portion extending along the lower half of the electronic rack, wherein: The first connection unit is slidably coupled to the upper portion, and the second connection unit is slidably coupled to the lower portion, wherein Each of the connecting units is arranged to slide only along its respective portion.
18. The data center according to claim 17, in, the flexible supply line is a first flexible supply line, and the flexible return line is a first flexible return line, wherein the second connection unit is coupled to the main liquid supply and return unit via a second flexible supply line and a second flexible return line, and wherein the first flexible supply line and the first flexible return line are sized such that when the first connection unit is coupled to the main liquid supply and return unit, the first connection unit is prevented from sliding below the upper half of the mounting rail by the first flexible supply line and the first flexible return line; and The dimensions of the second flexible supply line and the second flexible return line are set to be different from the dimensions of the first flexible supply line and the first flexible return line, so that when the second connection unit is connected to the main liquid supply and return unit, the second flexible supply line and the second flexible return line will not prevent the second connection unit from sliding along the entire length of the mounting rail.
Citation Information
Patent Citations
Rack enclosure
CN102088838A
Liquid-cooled electronics rack with immersion-cooled electronic subsystems and vertically-mounted, vapor-condensing unit
US20110315353A1
