Server rack, system and method for controlling heat dissipation in server system

Abstract

The invention discloses a server rack, a system and a method for controlling heat dissipation in a server system. The server rack includes a rack structure including a plurality of slots for receiving at least one or more rack servers. The server rack includes a first coolant distribution manifold coupled to a first leading edge of the rack structure, the first leading edge extending adjacent to the plurality of slots. The first coolant distribution manifold includes a plurality of outlets configured to provide a flow of coolant from the first leading edge of the rack structure to the one or more rack servers. The server rack further includes a second coolant distribution manifold coupled to a second leading edge of the rack structure, the second leading edge extending adjacent to the plurality of slots. The second coolant distribution manifold includes a plurality of inlets configured to collect a flow of coolant exiting the one or more rack servers from the second leading edge of the rack structure.

Description

Technical Field

[0001] This invention generally relates to cooling techniques in electronic systems, including but not limited to methods, apparatus, structures, devices, and systems for dissipating heat generated at server systems. Background Technology

[0002] During operation, server racks generate significant heat, posing thermal management challenges within the confined space of the rack. Without proper management using suitable cooling solutions, overheating at server racks can lead to performance degradation or even hardware failure. Conventional heat dissipation solutions rely on coolant systems that occupy at least some of the space within the server rack that would otherwise be occupied by computing hardware, thus compromising the computing hardware density within the rack. In some cases, due to space constraints, conventional coolant systems can only dissipate a limited amount of heat generated by the computing hardware housed within the server rack, and cooling structures need to be installed across multiple rack units within a single server rack. Therefore, there is a need for improved systems, methods, and apparatus that address one or more of the aforementioned drawbacks in a cost-effective, efficient, reliable, and scalable manner. Summary of the Invention

[0003] Various embodiments of the present invention relate to methods, apparatuses, structures, devices, and systems for dissipating heat generated by server systems.

[0004] In some embodiments, the present invention relates to a rack structure for dissipating heat at a server system. In some embodiments, the server system includes a coolant distribution unit (CDU) configured to circulate liquid to transfer heat generated by the server system to the liquid. In some embodiments, such as due to space design constraints associated with the server system, the rack structure of the present invention includes one or more inlets and / or one or more outlets located at a front edge portion of the rack structure. In some embodiments, the rack structure includes one or more coolant distribution manifolds configured to receive liquid, such as coolant, from the server system and the CDU and circulate the liquid. In some embodiments, the rack structure is configured to utilize an edge portion, such as the front edge between two or more mounting rails and two or more side panels of the rack structure, which allows fluid routing through one or more coolant distribution manifolds of the CDU.

[0005] Turning to a more specific aspect, one aspect of the invention relates to providing a server rack. In some embodiments, the server rack includes a rack structure. The rack structure includes a plurality of slots for housing at least one rack server. Furthermore, the server rack includes a first coolant distribution manifold and a second coolant distribution manifold. The first coolant distribution manifold is coupled to a first front edge of the rack structure, wherein the first front edge extends adjacent to the plurality of slots. Additionally, the first coolant distribution manifold includes a plurality of outlets configured to provide a coolant flow from the first front edge of the rack structure to one or more rack servers. The second coolant distribution manifold is coupled to a second front edge of the rack structure, wherein the second front edge extends adjacent to the plurality of slots. Furthermore, the second coolant distribution manifold includes a plurality of inlets configured to collect coolant flow exiting the one or more rack servers from the second front edge of the rack structure.

[0006] In some embodiments, the rack structure is mounted on a support surface, and the first coolant distribution manifold and the second coolant distribution manifold extend parallel to a direction substantially perpendicular to the support surface.

[0007] In some embodiments, the first front edge is opposite to the second front edge, and a plurality of slots are located between the first front edge and the second front edge of the frame structure.

[0008] In some embodiments, the first front edge is the second front edge, and the first coolant distribution manifold and the second coolant distribution manifold are closely disposed on the same first front edge of the frame structure.

[0009] In some embodiments, the server rack includes a third coolant distribution manifold coupled to an opposite front edge of the rack structure, which is different from the first front edge, and the third coolant distribution manifold is configured to provide supplemental coolant flow to one or more rack servers.

[0010] In some embodiments, the server rack includes a fourth coolant distribution manifold coupled to an opposite front edge of the rack structure, which is different from the first front edge, and the fourth coolant distribution manifold is configured to collect a corresponding coolant flow from one or more rack servers.

[0011] In some embodiments, a plurality of outlets are substantially uniformly distributed on at least a portion of a first coolant distribution manifold, and a plurality of inlets are substantially uniformly distributed on at least a portion of a second coolant distribution manifold.

[0012] In some embodiments, the server rack further includes a plurality of rack servers arranged in parallel between a first front edge and a second front edge of the rack structure, each rack server being housed by a corresponding subset of a plurality of slots.

[0013] In some embodiments, at least two of a plurality of rack servers are disposed in two adjacent slots of a rack structure, and include a first rack server and a second rack server. The bottom surface of the first rack server and the top surface of the second rack server are separated by a distance less than a separation threshold.

[0014] In some embodiments, the plurality of rack servers include a first rack server, and the first rack server includes a cooling structure coupled to a subset of the inlets and a subset of the outlets of a second coolant distribution manifold. Furthermore, the cooling structure is configured to dissipate heat generated by the first rack server by receiving a first coolant flow from the first coolant distribution manifold, circulating the first coolant flow through a portion of the first rack server, and outputting the first coolant flow to the second coolant distribution manifold.

[0015] In some embodiments, the multiple rack servers include multiple graphics processing units (GPUs) configured to perform machine learning operations.

[0016] In some embodiments, the server rack further includes a coolant distribution unit (CDU) disposed in one of a plurality of slots in the rack structure, wherein the CDU is coupled to a first coolant distribution manifold and a second coolant distribution manifold via two coolant pipes and is configured to supply and collect coolant flow via the two coolant pipes. Furthermore, the CDU has a front surface facing forward and disposed near a first front edge and a second front edge of the rack structure.

[0017] In some embodiments, the CDU further includes a rear surface opposite to the front surface of the CDU, and the rear surface of the CDU further includes a coolant source interface configured to connect to an external coolant source (e.g., Figure 3B The external coolant source 380 in the middle exchanges the coolant flow in the center.

[0018] In some embodiments, the CDU further includes a rear surface opposite to the front surface of the CDU, and the rear surface of the CDU further includes a pipe interface configured to provide coolant flow to a first coolant distribution manifold and collect coolant flow from a second coolant distribution manifold.

[0019] In some embodiments, two coolant pipes are coupled to a pipe interface and housed in one of a plurality of slots in a rack structure to extend to the front surface to access the first and second coolant distribution manifolds.

[0020] In some embodiments, the CDU further includes a rear surface opposite to the front surface of the CDU. Furthermore, the rear surface of the CDU further includes a first pipe interface coupled to one of the first and second coolant distribution manifolds. Furthermore, the front surface of the CDU further includes a second pipe interface coupled to the other of the first and second coolant distribution manifolds.

[0021] In some embodiments, the front surface of the CDU further includes a pipe interface configured to provide coolant flow to a first coolant distribution manifold and collect coolant flow from a second coolant distribution manifold.

[0022] In some embodiments, the CDU further includes a coolant pump and a coolant controller coupled to the coolant pump. The coolant controller is configured to control the coolant pump to push center coolant into a first coolant distribution manifold and collect center coolant from a second coolant distribution manifold.

[0023] In some embodiments, the server rack includes or is coupled to a plurality of panels configured to convert the server rack into a server cabinet.

[0024] Another aspect of the present invention relates to providing a server system. The server system includes a plurality of rack servers and a rack structure for supporting the plurality of rack servers. Furthermore, the server system includes a first coolant distribution manifold and a second coolant distribution manifold. The first coolant distribution manifold is coupled to a first front edge of the rack structure, the first front edge extending adjacent to the plurality of rack servers. The first coolant distribution manifold includes a plurality of outlets configured to provide a coolant flow from the first front edge of the rack structure to the plurality of rack servers. Furthermore, the second coolant distribution manifold is coupled to a second front edge of the rack structure, the second front edge extending adjacent to the plurality of rack servers. The second coolant distribution manifold includes a plurality of inlets configured to collect coolant flow exiting the plurality of rack servers from the second front edge of the rack structure.

[0025] Another aspect of the invention relates to a method for controlling heat dissipation in a server system. The method includes providing a rack structure to support a plurality of rack servers. The method further includes providing a first coolant distribution manifold coupled to a first front edge of the rack structure, the first front edge extending adjacent to the plurality of rack servers. The first coolant distribution manifold includes a plurality of outlets configured to provide a coolant flow from the first front edge of the rack structure to the plurality of rack servers. Additionally, the method includes providing a second coolant distribution manifold coupled to a second front edge of the rack structure, the second front edge extending adjacent to the plurality of rack servers. The second coolant distribution manifold includes a plurality of inlets configured to collect coolant flow exiting the plurality of rack servers from the second front edge of the rack structure.

[0026] These illustrative embodiments and implementations are mentioned not to limit or restrict the invention, but to provide examples to aid in understanding the invention. Additional embodiments are discussed in the detailed description and are further described herein. Attached Figure Description

[0027] To better understand the various described implementation schemes, refer to the following detailed embodiments in conjunction with the accompanying drawings, wherein the same reference numerals throughout the drawings refer to corresponding parts.

[0028] Figure 1 A front view of an instance server rack supporting one or more servers according to some embodiments;

[0029] Figure 2 According to some embodiments, it can be used as Figure 1 A block diagram of an example system module in a typical computer device used for server applications.

[0030] Figure 3A A perspective view of an example server rack including a coolant distribution unit (CDU) according to some embodiments;

[0031] Figure 3B to Figure 3E This describes four additional instance CDUs for exchanging coolant with an external coolant source, according to some embodiments;

[0032] Figure 4A This is a front view of an example server rack including a server cooling system according to some embodiments, and Figure 4B According to some embodiments Figure 4A The image shows a rear view of the instance server rack.

[0033] Figure 5 and Figure 6The following is a front view of two other example server racks according to some embodiments, each of which supports one or more servers;

[0034] Figure 7 This is a schematic diagram of a cooling structure used in rack servers according to some embodiments;

[0035] Figure 8 This is a schematic diagram comparing a first server rack including a front coolant manifold and a second server rack according to some embodiments;

[0036] Figure 9 This is a flowchart of a method for controlling heat dissipation in a server system according to some embodiments;

[0037] In a diagram, the same reference numerals refer to the corresponding parts in several views. Detailed Implementation

[0038] Detailed reference will now be made to specific embodiments, examples of which are illustrated in the accompanying drawings. In the following detailed description, numerous non-limiting details are set forth to aid in understanding the subject matter presented herein. However, it will be apparent to those skilled in the art that various alternatives may be used without departing from the scope of the claims, and that the subject matter may be practiced without these specific details.

[0039] Figure 1 This is a front view of an example server rack 100 (also referred to as a rack mount, rack cabinet, or simply rack) supporting one or more rack servers 120 according to some embodiments. The server rack 100 includes a rack structure 102 (also referred to as a frame) and a plurality of slots 104 (also referred to as rack units (RUs)) and can be used in a data center, server room, or network cabinet to support, organize, and manage multiple computing device modules 106 (e.g., rack servers 120, storage devices such as solid-state drives (SSDs) 116S and network attached storage 116N, networking devices, and other types of hardware). Each of the plurality of slots 104 of the server rack 100 is configured to receive and support a corresponding computing device module 106. In some embodiments, the plurality of slots 104 includes at least one blank slot 104B that is not used to provide mechanical support to any device module 106 and can receive a device module 106 if needed.

[0040] In some embodiments, the server rack 100 further includes a plurality of rack servers 120, such as at least four rack servers 120, at least six rack servers 120, at least eight rack servers 120, at least ten rack servers 120, at least twenty rack servers 120, or similar. In some embodiments, the server rack 100 further includes at most four rack servers 120, at most six rack servers 120, at most eight rack servers 120, at most ten rack servers 120, at most twenty rack servers 120, or similar. In some embodiments, the plurality of rack servers 120 are arranged in parallel between a first front edge 140-1 and a second front edge 140-2 of the rack structure 102. Therefore, in some embodiments, each of the plurality of rack servers 120 is configured to be received by a corresponding slot 104 of a plurality of slots 104.

[0041] In some embodiments, at least two of the plurality of rack servers 120 are disposed in two adjacent slots 104 of a plurality of slots 104 of rack structure 102, such that a first rack server 120-1 is disposed adjacent to a second rack server 120-2 of the plurality of rack servers 120. For example, in some embodiments, the bottom surface of the first rack server and the top surface of the second rack server are less than a separation threshold distance. In some embodiments, the server rack 100 has a predefined width of 19 or 23 inches, a height of up to 84 inches or greater, and a depth selected from 24, 32, 40, or 48 inches. However, the invention is not limited thereto.

[0042] Examples of computing device modules 106 supported by multiple slots 104 of server rack 100 include, but are not limited to, firewall module 108, switch box 110, rack server 120, display device 112, keyboard 114, solid-state drive (SSD) 116S, network attached storage 116N, and uninterruptible power supply (UPS) 118. Each computing device module 106 plays a corresponding role in maintaining the network and computing environment. In some embodiments, firewall module 108 is a network security device that monitors and controls incoming and outgoing network traffic based on predetermined security rules, thereby establishing a barrier between a trusted internal network and an untrusted external network. Firewall module 108 may be placed near the network entry point to protect server rack 100 from unauthorized access, malware, and network attacks. In some embodiments, firewall module 108 includes packet filtering, stateful inspection, VPN support, and intrusion prevention system (IPS). In some embodiments, the switch box 110 is placed in conjunction with the firewall module 108 near the network entry point and configured to receive incoming signals and forward the incoming signals (e.g., which may be converted into electrical signals) to different rack servers 120 mounted on server rack 100. The switch box 110 is used in server rack 100 to minimize cable length and ensure effective network traffic management. The switch box 110 may support different speeds (e.g., 800 gigabits per second, 1.6 Tbs, 3.2 Tbs), has multiple ports (24, 48, etc.), and provides features such as Virtual LAN (VLAN) support, PoE (Power over Ethernet), and managed or unmanaged capabilities.

[0043] The multiple computing device modules 106 of server rack 100 may include multiple rack servers 120, each configured to provide data, resources, services, or programs to other client devices via one or more wired or wireless communication networks. Each rack server 120 is mounted in a slot 104 of server rack 100 and configured to provide one or more services (e.g., website hosting, database management, and application support). Compared to individual client devices, the rack servers 120 mounted on server rack 100 can provide higher processing power, larger memory capacity, redundant power supplies, and hot-swappable components for high availability and reliability. In some embodiments, one or more rack servers 120 include multiple graphics processing units (GPUs) configured to perform machine learning operations, for example, in a data center associated with machine learning tasks.

[0044] The SSD 116S and NAS 116N are configured to provide storage space for rack server 120 mounted in server rack 100. The SSD uses flash memory to store data and, compared to hard disk drives (HDDs), exhibits high speed, low latency, durability, and lower power consumption, as well as different capacities and form factors. Conversely, the NAS 116N is a dedicated file storage device that provides data access to a network and allows a large number of different types of client devices to retrieve data from a centralized disk capacity. In some embodiments, the NAS 116N may have high capacity, redundant array of independent disks (RAID), support for multiple file sharing protocols (NFS, SMB / CIFS, FTP), user management, and backup features. In some embodiments, the SSD 116S is a storage drive for speed and is used, for example, within rack server 120 housed in the same server rack 100, while the NAS 116N is configured for file sharing, data backup, and remote access.

[0045] In some implementations, a UPS 118 is used to provide emergency power to other computing device modules 106 in the event of a power outage, allowing them to remain operational long enough to safely shut down or switch to an alternative power source. In examples, the UPS 118 is mounted in a server rack 100 or placed in a bottom slot to support its weight, thereby providing backup power to other computing device modules 106. The UPS 118 provides one or more of the following: battery backup, surge protection, voltage regulation, real-time monitoring, management software, and / or runtime based on capacity and load variations.

[0046] The server rack 100 further includes a plurality of mechanical structures configured to provide mechanical support for or facilitate access to a plurality of computing device modules 106. The plurality of mechanical structures includes one or more of the following: an open-frame rack (e.g., without doors or side panels), mounting rails, cable management features (e.g., arms, hooks, and trays), power strips, shelves, drawers, and concealed panels. In some embodiments, the plurality of mechanical structures also include a rack housing (e.g., a cabinet), lockable doors, and side panels to protect the computing device modules 106 from unauthorized access. In an example, the server rack 100 includes or is coupled to a plurality of panels configured to convert the server rack 100 into a server cabinet. In some embodiments, the server rack 100 further includes a cooling system or ventilation system to facilitate heat dissipation. Using the server rack 100 helps optimize space, improve cooling efficiency, simplify maintenance, and enhance the overall organization and management of information technology (IT) infrastructure.

[0047] Some embodiments of server rack 100 include a rack structure 102 (e.g., including a frame and multiple slots 104) for supporting one or more rack servers 120. In some embodiments, rack structure 102 completely surrounds one or more rack servers 120 and a coolant distribution unit (CDU). One or more rack servers 120 are mechanically mounted on rack structure 102.

[0048] Figure 2 According to some embodiments, it can be used as Figure 1 The diagram illustrates an example system module 200 (e.g., a rack server) in a typical computer device using a rack server 120 application. System module 200 in this computer device includes at least a processor module 202, a memory module 204 for storing programs, instructions, and data, an input / output (I / O) controller 206, one or more communication interfaces such as a network interface 208, and one or more communication buses 240 for interconnecting these components. In some embodiments, the I / O controller 206 allows the processor module 202 to communicate with I / O devices (e.g., a keyboard, mouse, or touchpad) via a universal serial bus interface. In some embodiments, the network interface 208 includes one or more interfaces for Wi-Fi, Ethernet, and Bluetooth networks, each allowing the computer device to exchange data with an external source (e.g., a server or another computer device). In some embodiments, the communication bus 240 includes a circuitry (sometimes referred to as a chipset) that interconnects the various system components included in system module 200 and controls communication between said system components.

[0049] In some embodiments, memory module 204 includes high-speed random access memory, such as DRAM, static random access memory (SRAM), double data rate (DDR) dynamic random access memory (RAM), or other random access solid-state memory devices. In some embodiments, memory module 204 includes non-volatile memory, such as one or more disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state memory devices. In some embodiments, memory module 204, or alternatively, one or more non-volatile memory devices within memory module 204, include non-transitory computer-readable storage media. In some embodiments, a memory slot is reserved on system module 200 for housing memory module 204. Once inserted into the memory slot, memory module 204 is integrated into system module 200.

[0050] In some embodiments, system module 200 further includes one or more components selected from memory controller 210, solid-state drive (SSD) 212, hard disk drive (HDD) 214, power supply unit (PSU) 216, power management integrated circuit (PMIC) 218, graphics module 220, and audio module 222. Memory controller 210 is configured to control communication between processor module 202 in the computer device and memory components including memory module 204. SSD 212 is configured to apply integrated circuit assemblies to store data in the computer device and, in many embodiments, is configured based on NAND or NOR memory. HDD 214 is a conventional data storage device for storing and retrieving digital information based on electromechanical disk. PSU 216 is configured to receive an external power supply and provide multiple DC power supplies (e.g., 12V, 54V). PMIC 218 is configured to modulate the multiple DC power supplies to other desired DC voltage levels required by various components or circuits within the computer device (e.g., processor module 202), such as 5V, 3.3V, or 1.8V. The graphics module 220 is configured to generate an output image to one or more display devices according to the desired image / video format of one or more display devices. The audio module 222 is configured to facilitate the input of audio signals to and output of audio signals from the computer device under the control of a computer program.

[0051] It should be noted that the communication bus 240 also interconnects various system components, including the component memory controller 210 to the sound module 222, and controls communication between the system components.

[0052] Figure 3A This is a perspective view of an example server rack including a coolant distribution unit (CDU) according to some embodiments. Figure 3B to Figure 3E This section describes four additional example CDU 310s according to some embodiments for exchanging coolant with an external coolant source 380. (See also...) Figure 3A In some embodiments, the rack structure 102 of the server rack 100 is mounted on a support surface 304 of the server rack 100, for example, configured to accommodate the upper surface of a base 150 of the rack structure 102. In some embodiments, the rack structure 102 is fixedly mounted on the support surface 304. However, the invention is not limited thereto.

[0053] Furthermore, in some embodiments, the server rack 100 includes one or more coolant distribution manifolds 302, such as a first coolant distribution manifold 302-1 and a second coolant distribution manifold 302-2. In some embodiments, the server rack 100 includes at least two coolant distribution manifolds 302, which allows the first coolant distribution manifold 302-1 to circulate cold coolant through some or all of the server rack 100, and to receive warm coolant heated by some or all of the plurality of computing device modules 106 via the second coolant distribution manifold 302-2. However, the invention is not limited thereto. In some embodiments, the server rack 100 includes at least three, at least four, or at least five coolant distribution manifolds 302. In some embodiments, the server rack 100 includes at most two, at most three, at most four, or at most five coolant distribution manifolds 302. In some embodiments, the server rack 100 includes one to six coolant distribution manifolds 302, one to four coolant distribution manifolds 302, one to two coolant distribution manifolds 302, two to six coolant distribution manifolds 302, two to four coolant distribution manifolds 302, or four to six coolant distribution manifolds 302. Therefore, in some embodiments, the server rack 100 is configured to use one of the multiple coolant distribution manifolds 302 (e.g., a first coolant distribution manifold 302-1 and a second coolant distribution manifold 302-2) to circulate coolant flow through some or all of the rack structure 102. The coolant flow can flow through some or all of the rack structure 102, thereby cooling and dissipating heat generated by the computing device modules 106 (e.g., rack servers 120) of the server rack 100. However, the invention is not limited thereto. Multiple coolant distribution manifolds 302 are used.

[0054] In some embodiments, each corresponding coolant distribution manifold 302 of the server rack 100 is coupled to the rack structure 102 at a corresponding front edge 140 or a portion of the front edge 140. For example, in some embodiments, the front edge 140 includes a first front edge 140-1 and a second front edge 140-2, with the first coolant distribution manifold 302-1 coupled to the first front edge 140-1 of the rack structure and the second coolant distribution manifold 302-2 coupled to the second front edge 140-2 of the rack structure 102, wherein the first front edge 140-1 is different from the second front edge 140-2 of the rack structure. However, the invention is not limited thereto. In some embodiments, the front edge of the rack structure is an inner edge portion of the rack structure 102, which allows the corresponding coolant distribution manifold 302 to be accommodated within the interior of the rack structure 102. In some embodiments, the front edge 140 of the rack structure 102 is an external or exposed surface of the rack structure 102, which allows easy access to the respective coolant distribution manifold 302, for example, for its maintenance. Therefore, in some embodiments, by coupling each of one or more coolant distribution manifolds 302 to a different front edge 140 or portion of the front edge 140 of the rack structure 102, the first coolant distribution manifold 302-1 is physically separated from the second coolant distribution manifold 302-2, thereby limiting indirect heat transfer between the first coolant distribution manifold 302-1 and the second coolant distribution manifold 302-2. For example, in some embodiments, the first front edge 140-1 of the rack structure 102 is opposite to the second front edge 140-2 of the rack structure 102, such that a plurality of slots 104 are located between the first front edge 140-1 and the second front edge 140-2 of the rack structure 102.

[0055] In some embodiments, the second coolant distribution manifold 302-2 is coupled to a second front edge 140-2 of the rack structure 102. In some embodiments, the second front edge 140-2 extends adjacent to a plurality of slots 104. For example, in some embodiments, the plurality of slots 104 and the second front edge 140-2 of the rack structure 102 extend along the longitudinal axis of the rack structure 102, such that the plurality of slots 104 are adjacent to the second front edge 140-2 of the rack structure 102.

[0056] In addition, the first coolant distribution manifold 302-1 includes a plurality of outlets 142 (e.g., Figure 3A (Exits 142-1, 142-2, ..., 142-T in the rack structure 102). In some embodiments, the plurality of outlets 142 are configured to provide a coolant flow to one or more rack servers 120. For example, in some embodiments, the plurality of outlets 142 provide a coolant flow from a first front edge of the rack structure 102 to one or more rack servers 120.

[0057] Additionally, the second coolant distribution manifold 302-2 includes multiple inlets 144 (e.g., Figure 3A (144-1, 144-2, ..., 144-U in some embodiments). In some embodiments, the plurality of inlets 144 are configured to collect coolant flow exiting one or more rack servers 120. For example, in some embodiments, the plurality of inlets 144 collect coolant flow exiting one or more rack servers 120 from a second front edge 140-2 of rack structure 102. As a non-limiting example, in some embodiments, the plurality of outlets 142 provide coolant (e.g., cooling fluid) flow from a first front edge of rack structure 102 to one or more rack servers 120, and after the coolant flow has been heated by one or more rack servers 120, the plurality of inlets 144 collect coolant flow exiting one or more rack servers 120 from a second front edge 140-2 of rack structure 102.

[0058] In some embodiments, the first coolant distribution manifold 302-1 and the second coolant distribution manifold 302-2 extend parallel to or substantially parallel to a direction perpendicular to or substantially perpendicular to the support surface 304. For example, in some embodiments, the support surface 304 is at the same height or horizontal relative to the ground, such that the first coolant distribution manifold 302-1 and the second coolant distribution manifold 302-2 extend vertically parallel to or substantially parallel to the ground.

[0059] In some embodiments, the first front edge 140-1 is the second front edge 140-2, such that the first coolant distribution manifold 302-1 and the second coolant distribution manifold 302-2 are closely disposed on the same first front edge 140-1 of the frame structure 102.

[0060] refer to Figure 3B to Figure 3E In some embodiments, the server rack 100 further includes a coolant distribution unit (CDU) 310. In some embodiments, the CDU 310 is disposed in a slot 104 of a plurality of slots 104 in the rack structure 102. The CDU 310 is coupled to a first coolant distribution manifold 302-1 and a second coolant distribution manifold 302-2 via a first coolant distribution pipe 312-1 and a second coolant distribution pipe 312-2, respectively. Reference Figure 3B and Figure 3C In some embodiments, both the first coolant distribution pipe 312-1 and the second coolant distribution pipe 312-2 are coupled to the rear surface 316 of the CDU 310, arranged adjacent to the CDU 310 to the first front edge 140-1 and the second front edge 140-2, and coupled to the first coolant distribution manifold 302-1 and the second coolant distribution manifold 302-2 near the first front edge 140-1 and the second front edge 140-2. (See reference...) Figure 3DIn some embodiments, both the first coolant pipe 312-1 and the second coolant pipe 312-2 are coupled to the front surface 314 of the CDU 310, are arranged in front of the CDU 310, and are coupled to the first coolant distribution manifold 302-1 and the second coolant distribution manifold 302-2 near the first front edge 140-1 and the second front edge 140-2. (See reference...) Figure 3E In some embodiments, a first coolant pipe 312-1 is coupled to the front surface 314, positioned in front of the CDU 310, and coupled to a first coolant distribution manifold 302-1. A second coolant pipe 312-2 is coupled to the rear surface 316 of the CDU 310, positioned adjacent to the CDU 310 to a second front edge 140-2, and coupled to a second coolant manifold 302-2. In some embodiments not shown, the first coolant pipe 312-1 is coupled to the rear surface 316, while the second coolant pipe 312-2 is coupled to the front surface 314 of the CDU 310.

[0061] Figure 4A This is a front view of an example server rack 100 including a server cooling system 400 according to some embodiments, and Figure 4B According to some embodiments Figure 4A The image shows a rear view of the example server rack 100. The server cooling system 400 relies on liquid cooling. In some embodiments, the server rack 100, including the server cooling system 400, is used in a data center used for implementing machine learning tasks (e.g., training deep neural networks, executing large language models (LLM)). The server rack 100 includes multiple slots 104 for housing and supporting corresponding computing device modules 106 (e.g., rack servers 120).

[0062] Server rack 100 includes a rack structure comprising a plurality of slots 104 for housing at least one or more rack servers 120 or other device modules 106. (Reference) Figure 4AThe server rack 100 includes a first coolant distribution manifold 302-1 coupled to a first front edge 140-1 of the rack structure, the first front edge 140-1 extending adjacent to a plurality of slots 104. The first coolant distribution manifold 302-1 includes a plurality of outlets 142 configured to provide coolant flow from the first front edge 140-1 of the rack structure to one or more rack servers 120. The server rack 100 further includes a second coolant distribution manifold 302-2 coupled to a second front edge 140-2 of the rack structure, the second front edge 140-2 extending adjacent to the plurality of slots. The second coolant distribution manifold 302-2 includes a plurality of inlets 144 configured to collect coolant flow exiting the one or more rack servers 120 from the second front edge 140-2 of the rack structure. For example, one of the multiple outlets 142 is coupled to the coolant inlet of the first server 120-1 via pipe 406, and one of the multiple inlets 144 is coupled to the coolant outlet of the first server 120-1 via pipe 404.

[0063] In some embodiments, reference Figure 4A A coolant pump 408 is coupled between two coolant pipes 312-1 and 312-2, which are further coupled to coolant distribution manifolds 302-1 and 302-2. A coolant controller 410 is coupled to the coolant pump 408 and configured to control the coolant pump 408 to push coolant into one of the two coolant pipes 312 and to draw coolant back from the other of the two coolant pipes 312. Additionally, in some embodiments, the coolant pump 408 is housed in the bottom tray of the server rack 100. In some embodiments, reference is made to... Figure 4B Each rack server 120 or CDU includes one or more corresponding fans 402 in an associated free slot space, and each corresponding fan 402 is configured to enhance air circulation and increase heat dissipation via air convection in the corresponding slot 104 in which the rack server 120 is located.

[0064] In some embodiments, a plurality of outlets 142 are substantially uniformly distributed on at least a portion 302A of the first coolant distribution manifold 302-1, and a plurality of inlets 144 are substantially uniformly distributed on at least a portion 302B of the second coolant distribution manifold 302-2.

[0065] Figure 5 and Figure 6The following is a front view of two additional example server racks 100 according to some embodiments, each of which supports one or more rack servers 120. In some embodiments, a first coolant distribution manifold 302-1 and a second coolant distribution manifold 302-2 are closely disposed on the same first front edge 140-1 of the rack structure. The server rack 100 further includes a third coolant distribution manifold 302-3. In some embodiments, the third coolant distribution manifold 302-3 is coupled to an opposite front edge of the rack structure 102 that is different from the first front edge 140-1 of the rack structure 102.

[0066] In some embodiments, the third coolant distribution manifold 302-3 is configured to provide supplemental coolant flow to one or more rack servers 120. For example, in some embodiments, the third coolant distribution manifold 302-3 is configured to provide coolant flow to a first rack server 120-1 of at least one rack server 120, and the first coolant distribution manifold 302-1 is configured to provide coolant flow to a second rack server 120-2 of the rack structure 102. As a non-limiting example, in some embodiments, the first coolant distribution manifold 302-1 is configured to provide coolant flow to one or more rack servers 120 at the upper portion of the rack structure 102, and the third coolant distribution manifold 302-3 is configured to provide coolant flow to one or more rack servers 120 at the lower portion of the rack structure 102, in order to reduce the threshold pressure required to provide coolant to the upper portion of the rack structure 102, such as head loss or slight pressure loss. However, the invention is not limited thereto.

[0067] In some embodiments, server rack 100 includes a fourth coolant distribution manifold 302-4. In some embodiments, the fourth coolant distribution manifold 302-4 is coupled to an opposite front edge of rack structure 102 that is different from the first front edge 140-1. In some embodiments, the fourth coolant distribution manifold 302-4 is configured to collect corresponding coolant flows from one or more rack servers 120. For example, the fourth coolant distribution manifold 302-4 includes a plurality of inlets 144 that collect coolant flows exiting one or more rack servers 120 from a second front edge 140-2 of rack structure 102. As a non-limiting example, in some embodiments, a plurality of outlets 142 provide coolant (e.g., cooling fluid) flows from the first front edge 140-1 of rack structure 102 to one or more rack servers 120, and after the coolant flow is heated by one or more rack servers 120, the plurality of inlets 144 collect coolant flows exiting one or more rack servers 120 from the second front edge 140-2 of rack structure 102.

[0068] Figure 7 This is a schematic diagram of a cooling structure 700 applied to a rack server 120 according to some embodiments. In some embodiments, a plurality of rack servers 120 include a first rack server 120-1, which further includes the cooling structure 700. In some embodiments, the cooling structure 700 is coupled to a subset of the inlets 144 of a second coolant distribution manifold 302-2 and a subset of the outlets 142 of the first coolant distribution manifold 302-1. Furthermore, in some embodiments, the cooling structure 700 is configured to dissipate heat generated by the first rack server 120-1 by receiving a first coolant flow from the first coolant distribution manifold 302-1, circulating the first coolant flow through a portion of the first rack server 120-1 (e.g., the lower surface or the upper surface of the first rack server 120-1), and outputting the first coolant flow to the second coolant distribution manifold 302-2. In some embodiments, the cooling structure 700 is configured to dissipate heat generated by the first rack server 120-1 by receiving a first coolant flow from a first coolant distribution manifold 302-1, circulating the first coolant flow through a portion of the first rack server 120-1 (e.g., the lower surface of the first rack server 120-1 and the upper surface of the second rack server 120-2, or the upper surface of the first rack server 120-1 and the lower surface of the second rack server 120-2) and outputting the first coolant flow to a second coolant distribution manifold 302-2, which allows heat generated by the first rack server 120-1 and the second rack server 120-2 to be dissipated.

[0069] In some embodiments, the cooling structure 700 is configured as a heat sink and / or radiator. For example, in some embodiments, the cooling structure 700 includes a plate 708. In some embodiments, the plate 708 is configured to contact the surface of the rack server 120 via contact surfaces to absorb heat generated by the rack server 120. In some embodiments, the plate 708 includes one or more of naval brass, aluminum, aluminum brass, carbon steel, copper, cupronickel 70 / 30 and cupronickel 90 / 10, nickel-copper alloys (also known as Monel alloys), stainless steel (e.g., duplex or super duplex grade), or combinations thereof. Additionally, in some embodiments, the plate 708 includes channels 712 within its interior that allow coolant to flow through the interior of the plate 708 to transfer heat from the server rack 100 to the plate 708 and ultimately to the coolant. For example, briefly refer to Figure 4BIn some embodiments, the channel 712 of plate 708 is in fluid communication with the inlet 144 of the first coolant distribution manifold 302-1 and the outlet 142 of the second coolant distribution manifold 302-2, thereby providing fluid communication between the first coolant distribution manifold 302-1 and the second coolant distribution manifold 302-2 via plate 708. In some embodiments, the coolant channel 712 includes a serpentine shape, which provides an increased surface area for heat transfer between plate 708 and the coolant flowing along the channel 712. Furthermore, in some embodiments, the channel 712 extends substantially parallel to the contact surface of the rack server 120 from the inlet 144 of the first coolant distribution manifold 302-1 to the outlet 142 of the second coolant distribution manifold 302-2.

[0070] Additionally, in some embodiments, the height of plate 708 is greater than a threshold dimension, for example, based on or greater than a first threshold dimension of the length and / or width of plate 708, thereby forming a metal block. In some embodiments, coolant channels 712 are configured to extend in three dimensions of the block. In some embodiments, coolant channels 712 extend along a plurality of parallel layers, each of which is substantially parallel or perpendicular to the contact surface of plate 708. In particular, in instances not described, coolant channels 712 extend continuously from a bottom layer adjacent to and parallel to the contact surface to each upper layer above the bottom layer parallel to the contact surface.

[0071] Therefore, in some embodiments, the server rack 100 further includes a cooling structure 700 disposed between two adjacent slots 104 of a plurality of slots 104. In other words, in some embodiments, the cooling structure 700 is disposed below the lower end surface of a respective upper slot 104 or above the upper end surface of a respective lower slot 104, wherein the upper slot 104 accommodates a first rack server 120-1 and the lower slot 104 accommodates a second rack server 120-2. Thus, the cooling structure 700 is configured to at least partially remove heat absorbed by the coolant flowing in the channel 712 from the adjacent computing device module 106 and / or rack server 120.

[0072] In some embodiments, the server rack 100 further includes a coolant distribution unit (CDU) 310. In some embodiments, the CDU 310 is disposed in a slot 104 among a plurality of slots 104 of the rack structure 102. However, the invention is not limited thereto. For example, briefly refer to Figure 4A In some embodiments, the CDU 310 is mounted on a support surface 304 of a base 150 associated with the rack structure 102, such that the plurality of slots 104 as a whole can be used to accommodate one or more rack servers 120.

[0073] In some embodiments, the plurality of rack servers 120 includes N servers, where N is an integer greater than or equal to two. Furthermore, in some embodiments, the server rack 100 includes a plurality of cooling structures 700, wherein the plurality of cooling structures 700 includes M cooling structures 700, where M is an integer greater than or equal to one. Furthermore, in some embodiments, M is one less than N, which allows for the placement of corresponding cooling structures 700 inserted between adjacent rack servers 120 in the plurality of rack servers 120. In some embodiments, M is at most one less than N, which allows for the placement of corresponding cooling structures 700 inserted between adjacent pairs of rack servers 120 in the plurality of rack servers 120, or similarly. By way of example, in some embodiments, the plurality of rack servers 120 includes 42 rack servers 120, such that at most 41 cooling structures 700 are placed between two or more rack servers 120 in the plurality of rack servers 120. However, the invention is not limited thereto.

[0074] In some embodiments, CDU 310 is coupled to a first coolant distribution manifold 302-1 and a second coolant distribution manifold 302-2, which allows coolant to circulate through both the first coolant distribution manifold 302-1 and the second coolant distribution manifold 302-2 via fluid communication provided by coupling with CDU 310. For example, in some embodiments, CDU 310, the first coolant distribution manifold 302-1, and the second coolant distribution manifold 302-2 form a closed loop for allowing first coolant from CDU 310 to flow through the first coolant distribution manifold 302-1 and be received by the second coolant distribution manifold 302-2 via cooling structure 700. However, the invention is not limited thereto. By way of example, in some embodiments, the first coolant distribution manifold 302-1 forms a first closed loop for circulating a first volume of first coolant via CDU 310, and the second coolant distribution manifold 302-2 forms a second closed loop for circulating a second volume of second coolant, different from the first coolant, via CDU 310, thereby physically separating the first coolant of the first coolant distribution manifold 302-1 from the second coolant of the second coolant distribution manifold 302-2. In some embodiments, the first coolant distribution manifold 302-1 forms a first closed loop for circulating a first volume of first coolant via CDU 310, and the second coolant distribution manifold 302-2 forms a second closed loop for circulating a second volume of second coolant via CDU 310. This physically separates the first closed loop of the first coolant distribution manifold 302-1 from the second closed loop of the second coolant distribution manifold 302-2 when using a common coolant, for example, the coolant flow received from the coolant reservoir 350 by CDU 310 and branched into the first coolant distribution manifold 302-1 and the second coolant distribution manifold 302-2 using CDU 310. However, the invention is not limited thereto.

[0075] In some embodiments, CDU 310 is coupled to a first coolant distribution manifold 302-1 and a second coolant distribution manifold 302-2 via two coolant pipes 312, the two coolant pipes being, for example, jointly configured to provide and collect coolant flow via CDU 310. By way of example, in some embodiments, the first coolant distribution manifold 302-1 is coupled to the first coolant pipe 312-1, and the second coolant distribution manifold 302-2 is coupled to the second coolant pipe 312-2. In some embodiments, the coolant pipes 312 are flexible, which allows the coolant pipes 312 to be configured to various rack servers 120.

[0076] Furthermore, in some embodiments, the CDU 310 has a front surface 314. In some embodiments, the front surface 314 of the CDU 310 is positioned in front of the server rack 100 (e.g., facing forward). In some embodiments, the CDU 310 is positioned near a first front edge 140-1 and a second front edge 140-2 of the rack structure 102. Furthermore, in some embodiments, the CDU 310 further includes a rear surface 316 opposite to the front surface 314 of the CDU 310.

[0077] In some embodiments, the rear surface 316 of the CDU 310 further includes a coolant source interface. In some embodiments, the coolant source interface is configured to connect to an external coolant source 380 ( Figure 3B For example, a coolant reservoir 350 exchanges the central coolant flow, and the coolant source is configured to provide external cooling fluid to the CDU 310. For instance, in some embodiments, coolant heated by and / or circulated through the rack structure 102 returns to an external coolant source 380, such as a reservoir 350 outside the CDU 310. Briefly refer to... Figure 3B In some embodiments, the coolant source interface includes an inlet 320 configured to receive coolant from the first reservoir 350-1 and an outlet 322 configured to provide heated coolant to the first reservoir 350-1 or a different reservoir 350-2. However, the invention is not limited thereto.

[0078] In some embodiments, the rear surface 316 of CDU 310 further includes a pipe interface 324 (e.g., first pipe interface 324-1) configured to provide a coolant flow to a first coolant distribution manifold 302-1. In some embodiments, the pipe interface 324 (e.g., first pipe interface 324-1) is further configured to collect the coolant flow provided to the first coolant distribution manifold 302-1 from a second coolant distribution manifold 302-2. For example, in some embodiments, the pipe interface 324 is configured to fluidly couple an inlet 330 of the first coolant distribution manifold 302-1 to CDU 310 and / or fluidly couple an outlet 332 of the second coolant distribution manifold 302-2 to CDU 310. Furthermore, in some embodiments, two coolant pipes 312 are coupled to the pipe interface 324 and housed within one of a plurality of slots 104 of the rack structure 102. Therefore, in some embodiments, the two coolant pipes 312 are configured to extend to the front surface of the rack structure 102 (e.g., the first front edge 140-1 and / or the second front edge 140-2), which allows access to the first and second coolant distribution manifolds. In other words, in some embodiments, the two coolant pipes 312 and the pipe interface 324 allow the CDU 310 to supply fluid to the first coolant distribution manifold 302-1 and / or receive fluid from the second coolant distribution manifold 302-2 using various configurations and / or orientations of the first and second coolant distribution manifolds 302-1 and 302-2.

[0079] In some embodiments, the rear surface 316 of the CDU further includes a first pipe interface 324-1 coupled to one of the first coolant distribution manifold 302-1 and the second coolant distribution manifold 302-2. Furthermore, the front surface 314 of the CDU 310 further includes a second pipe interface 324-2 coupled to the other of the first coolant distribution manifold 302-1 and the second coolant distribution manifold 302-2. Therefore, in some embodiments, the CDU 310 allows coolant flow to be provided at the front or rear of the rack structure 102 via the first coolant distribution manifold 302-1, and receives coolant flow from the second coolant distribution manifold 302-2 at the other of the front or rear of the rack structure 102, providing a compact form factor for the server rack 100, thereby allowing for the placement of multiple rack servers 120 thereon.

[0080] In some embodiments, CDU 310 further includes a coolant pump 408 that allows coolant flow to circulate through a first coolant distribution manifold 302-1 and / or a second coolant distribution manifold 302-2, for example by increasing the flow rate and / or pressure of the coolant flow. In some embodiments, CDU 310 further includes a coolant controller 410 coupled to the coolant pump 408 such that the coolant controller 410 is in electronic communication with the coolant pump 408. In some embodiments, the coolant controller 410 is configured to control the coolant pump 408 to circulate central coolant into the first coolant distribution manifold 302-1 and / or receive (e.g., collect) central coolant from the second coolant distribution manifold 302-2, thereby transferring heat from the rack server 120 to the coolant circulated through the coolant pump 408. In some embodiments, the coolant pump 408 is fluidly coupled between the inlet 320 and the outlet 322 of the CDU 310. However, the invention is not limited thereto. In some embodiments, the coolant controller 410 is coupled to the coolant pump 408 and configured to control the coolant pump 408 to circulate coolant via the channel 712 of the cooling structure 700 from the outlet 142 of the first coolant distribution manifold 302-1 to the inlet 144 of the second coolant distribution manifold 302-2.

[0081] In some embodiments, the server rack 100 includes or is coupled to a plurality of panels configured to convert the server rack 100 into a server cabinet. However, the invention is not limited thereto.

[0082] Figure 8 According to some embodiments, a pre-coolant distribution manifold (e.g., Figure 3A A schematic diagram comparing a first server rack 100A with a second server rack 100B (first coolant distribution manifold 302-1 and second coolant distribution manifold 302-2). Some implementations of server rack 100 use CDU 310 ( Figure 3A to Figure 3DLiquid cooling is implemented using a system where the facility water connection is located in the hot aisle near the rear of server rack 100 in the data center. In some embodiments, in-rack piping and hoses are configured to connect from the rear of server rack 100 (e.g., server rack 100B). For a liquid-cooled server 120, coolant pipe inlets / outlets may be located at the front of server 120. The second server rack 100B includes a plurality of coolant distribution modules (CDMs) 802, each of which is positioned between two computing device modules 106 (e.g., server 120). A CDU 310 acts as an engine to drive coolant through the cooling system, allowing coolant to be injected into the inlet of each CDM and collected from the outlet of each CDM. The CDU can adjust and control the flow rate of coolant and maintain the desired temperature and flow rate. In some embodiments ( Figure 4A In this configuration, CDMs can be arranged parallel to each other and coupled between the inlet and outlet of the CDU.

[0083] Conversely, the first server rack 100A includes a first coolant distribution manifold 302-1 and a second coolant distribution manifold 302-2, both of which are located near the front edge. The first server rack 100A utilizes the lateral space between the mounting rail and the side panel to accommodate coolant delivery hoses or pipes (e.g., Figure 3A The first coolant pipes 312-1 and 312-2 in the system. The coolant transfer hoses or pipes do not occupy any available rack space for the computing nodes (e.g., rack server 120), thus increasing computing density. It should be noted that the coolant transfer hoses (e.g., Figure 3A The first coolant pipe 312-1 and the first coolant pipe 312-2 in the middle are not limited to any particular shape or shape specification. Figure 3B to Figure 3E These are just a few examples.

[0084] In some embodiments, computing device modules 106 (e.g., rack servers 120) are stacked on top of each other in a first server rack 100A without being separated from or leaving space for CDM 802. Conversely, a second server rack 100B requires space between computing device modules 106 to accommodate CDM 802. For example, server rack 100 has a height of 48 rack units (e.g., 48 inches). Each rack server 120 has a height of 3 rack units, and each CDM has a height of 1 rack unit. If arranged according to the first server rack 100A, 16 servers can be accommodated within the height of 48 rack units. If arranged according to the second server rack 100B, 12 servers can be accommodated within the height of 48 rack units, leaving at least 11 one-inch spaces for 11 CDMs. In other words, the first server rack 100A can accommodate a larger number of servers 120 compared to the second server rack 100B.

[0085] In some embodiments, a coolant delivery hose (e.g., Figure 3A The first coolant pipes 312-1 and 312-2 in the first server rack 100A do not use any rack space available for the compute nodes in the first server rack 100A. Instead, coolant delivery hoses (e.g., Figure 3A The first coolant pipes 312-1 and 312-2 utilize the space between the mounting rail and the side panel without affecting the data center layout and deployment. In some embodiments, coolant delivery hoses (e.g., Figure 3A The first coolant pipe 312-1 and the first coolant pipe 312-2 in the middle have a cross-section that can be circular, elliptical or rectangular with rounded edges.

[0086] Figure 9 This is a flowchart of a method 900 for controlling heat dissipation in a server system according to some embodiments. Since the general topology of a server system 100 has been described according to various embodiments of the invention, details of some processes and methods relating to the invention will be described with reference to an example of a method 900 for controlling heat dissipation in a server system, such as a server rack 100.

[0087] Box 902. Referring to box 902, in some embodiments, a method 900 for controlling heat dissipation in a server system includes providing a rack structure 102 to support a plurality of rack servers 120.

[0088] Block 904. Referring to block 904, in some embodiments, the method 900 for controlling heat dissipation in a server system further includes providing a first coolant distribution manifold 302-1 coupled to a first front edge 140-1 of a rack structure 102. In some embodiments, the first front edge 140-1 is configured to extend adjacent to a surface associated with a plurality of rack servers 120. In some embodiments, the first coolant distribution manifold 302-1 includes a plurality of outlets 142 configured to provide coolant flow from the first front edge 140-1 of the rack structure 102 to the plurality of rack servers 120.

[0089] Block 906. Referring to block 906, in some embodiments, a method 900 for controlling heat dissipation in a server system includes providing a second coolant distribution manifold 302-2 coupled to a second front edge 140-2 of a rack structure 102. In some embodiments, the second front edge 140-2 is configured to extend adjacent to a plurality of rack servers 120. In some embodiments, the second coolant distribution manifold 302-2 includes a plurality of inlets 144 configured to collect coolant flows exiting the plurality of rack servers 120 from the second front edge 140-2 of the rack structure 102.

[0090] Therefore, the method 900 for controlling heat dissipation in a server system allows heat generated by the multiple rack servers 120 to be dissipated by supplying cooling fluid (e.g., coolant flow) from a first coolant distribution manifold 302-1 to a second coolant distribution manifold 302-2 via multiple rack servers 120.

[0091] The terminology used in the description of the various described embodiments herein is for the purpose of describing particular embodiments only and is not intended to be limiting. As used in the description of the various described embodiments and the appended claims, the singular forms “a(a)”, “an”, and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term “and / or” as used herein refers to and covers any and all possible combinations of one or more of the associated listed items. It will be further understood that the terms “includes,” “including,” “comprises,” and / or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof. Furthermore, it will be understood that although the terms “first,” “second,” etc., may be used herein to describe various elements, these elements should not be limited by these terms. These terms are used only to distinguish one element from another.

[0092] As used herein, depending on the context, the term "if" may optionally be interpreted as "when," "at," "in response to determining," "in response to detecting," or "according to the determination of." Similarly, depending on the context, the phrase "if determining," or "if [the stated condition or event] is optionally interpreted as "in response to determining," "when [the stated condition or event] is detected," or "in response to detecting [the stated condition or event]," or "according to the determination of detecting [the stated condition or event]."

[0093] For purposes of explanation, the foregoing description has been described with reference to specific embodiments. However, the illustrative discussions above are not intended to be exhaustive or to limit the claims to the precise forms disclosed. Many modifications and variations are possible in light of the foregoing teachings. The embodiments were chosen and described in order to best explain the operating principles and practical applications, thereby enabling others skilled in the art to implement them.

[0094] Although various diagrams illustrate multiple logical phases in a specific order, phases that are not sequentially related can be reordered, and other phases can be combined or decomposed. While some reorderings or other groupings are specifically mentioned, other reorderings or groupings will be apparent to those skilled in the art, and therefore the orderings and groupings presented herein are not an exhaustive list of alternatives. Furthermore, it should be recognized that phases can be implemented in hardware, firmware, software, or any combination thereof.

Claims

1. A server rack, characterized by comprising: a rack structure including a plurality of slots for receiving at least one or more rack servers; a first coolant distribution manifold coupled to a first front edge of the rack structure, the first front edge extending adjacent to the plurality of slots, wherein the first coolant distribution manifold includes a plurality of outlets configured to provide a flow of coolant from the first front edge of the rack structure to the one or more rack servers; and a second coolant distribution manifold coupled to a second front edge of the rack structure, the second front edge extending adjacent to the plurality of slots, wherein the second coolant distribution manifold includes a plurality of inlets configured to collect the flow of coolant from the second front edge of the rack structure exiting the one or more rack servers. The rack structure is disposed on a support surface, and the first coolant distribution manifold and the second coolant distribution manifold extend parallel to a direction perpendicular to the support surface.

2. The server rack of claim 1, wherein, The first front edge is opposite the second front edge, and the plurality of slots is between the first front edge and the second front edge of the rack structure.

3. The server rack of claim 1, wherein, The first front edge is the second front edge, and the first coolant distribution manifold and the second coolant distribution manifold are closely disposed on a same first front edge of the rack structure.

4. The server rack of claim 1, wherein, The server rack includes a third coolant distribution manifold coupled to an opposite front edge of the rack structure different from the first front edge, and the third coolant distribution manifold is configured to provide a supplemental flow of coolant to the one or more rack servers.

5. The server rack of claim 4, wherein, The server rack includes a fourth coolant distribution manifold coupled to an opposite front edge of the rack structure different from the first front edge, and the fourth coolant distribution manifold is configured to collect a respective flow of coolant from the one or more rack servers.

6. The server rack of claim 4, wherein, The plurality of outlets are uniformly distributed over at least a portion of the first coolant distribution manifold, and the plurality of inlets are uniformly distributed over at least a portion of the second coolant distribution manifold.

7. The server rack of claim 1, wherein, further comprising:

8. The server rack of claim 1, wherein, a plurality of rack servers disposed in parallel between the first front edge and the second front edge of the rack structure, each rack server received by a respective subset of the plurality of slots. At least two of the plurality of rack servers are disposed on two immediately adjacent slots of the rack structure, and include a first rack server and a second rack server, and wherein a bottom surface of the first rack server and a top surface of the second rack server have a distance less than a separation threshold.

9. The server rack of claim 8, wherein, characterized in that:

10. The server rack of claim 8, the plurality of rack servers includes a first rack server, and the first rack server includes a cooling structure coupled to a subset of inlets of the second coolant distribution manifold and a subset of outlets of the first coolant distribution manifold; ​ The cooling structure is configured to dissipate heat generated by the first rack server by receiving a first coolant flow from the first coolant distribution manifold, circulating the first coolant flow through portions of the first rack server, and outputting the first coolant flow to the second coolant distribution manifold.

11. The server rack of claim 8, wherein, The plurality of rack servers includes a plurality of graphics processing units configured to implement machine learning operations.

12. The server rack of claim 1, wherein, Further comprising: a coolant distribution unit disposed in one of the plurality of slots of the rack structure, wherein the coolant distribution unit is coupled to the first coolant distribution manifold and the second coolant distribution manifold via two coolant tubes and is configured to provide and collect the coolant flow via the two coolant tubes, and wherein the coolant distribution unit has a front surface facing forward and disposed near the first front edge and the second front edge of the rack structure.

13. The server rack of claim 12, wherein, The coolant distribution unit further includes a back surface opposite the front surface of the coolant distribution unit, and the back surface of the coolant distribution unit further includes a coolant source interface configured to exchange a central coolant flow with a coolant source.

14. The server rack of claim 12, wherein, The coolant distribution unit further includes a back surface opposite the front surface of the coolant distribution unit, and the back surface of the coolant distribution unit further includes a tube interface configured to provide the coolant flow to the first coolant distribution manifold and collect the coolant flow from the second coolant distribution manifold.

15. The server rack of claim 14, wherein, The two coolant tubes are coupled to the tube interface and disposed within the one of the plurality of slots of the rack structure to extend to the front surface to access the first coolant distribution manifold and the second coolant distribution manifold.

16. The server rack of claim 12, wherein: The coolant distribution unit further includes a back surface opposite the front surface of the coolant distribution unit; The back surface of the coolant distribution unit further includes a first tube interface coupled to one of the first coolant distribution manifold and the second coolant distribution manifold; The front surface of the coolant distribution unit further includes a second tube interface coupled to the other of the first coolant distribution manifold and the second coolant distribution manifold.

17. The server rack of claim 12, wherein, The front surface of the coolant distribution unit further includes a tube interface configured to provide the coolant flow to the first coolant distribution manifold and collect the coolant flow from the second coolant distribution manifold.

18. The server rack of claim 12, wherein, The coolant distribution unit further comprises: a coolant pump; a coolant controller coupled to the coolant pump, wherein the coolant controller is configured to control the coolant pump to push a central coolant into the first coolant distribution manifold and collect the central coolant from the second coolant distribution manifold.

19. A server system, characterized by Comprising: a plurality of rack servers; a rack structure to support the plurality of rack servers; a first coolant distribution manifold coupled to a first front edge of the rack structure, the first front edge extending adjacent to the plurality of rack servers, wherein the first coolant distribution manifold includes a plurality of outlets configured to provide a flow of coolant from the first front edge of the rack structure to the plurality of rack servers; and a second coolant distribution manifold coupled to a second front edge of the rack structure, the second front edge extending adjacent to the plurality of rack servers, wherein the second coolant distribution manifold includes a plurality of inlets configured to collect the flow of coolant from the second front edge of the rack structure exiting the plurality of rack servers.

20. A method for controlling heat dissipation in a server system, characterized by, comprising: providing a rack structure to support a plurality of rack servers; providing a first coolant distribution manifold coupled to a first front edge of the rack structure, the first front edge extending adjacent to the plurality of rack servers, wherein the first coolant distribution manifold includes a plurality of outlets configured to provide a flow of coolant from the first front edge of the rack structure to the plurality of rack servers; and providing a second coolant distribution manifold coupled to a second front edge of the rack structure, the second front edge extending adjacent to the plurality of rack servers, wherein the second coolant distribution manifold includes a plurality of inlets configured to collect the flow of coolant from the second front edge of the rack structure exiting the plurality of rack servers.

Images