Tank for cooling computing devices using immersion
The immersion cooling tank system addresses heat dissipation challenges in data centers by immersing devices in a non-conductive liquid, providing efficient heat absorption and dissipation, thus reducing thermal throttling and PUE.
Patent Information
- Application Number
- JP2025526805
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-11-10
- Filing Date
- 2023-11-10
- Publication Date
- 2025-11-14
AI Technical Summary
Data centers face challenges in efficiently dissipating the heat generated by large collections of computing devices, leading to potential damage and increased power consumption, which is reflected in high Power Usage Effectiveness (PUE) ratios.
A cooling tank system is designed to immerse computing devices in a non-conductive liquid refrigerant, utilizing a racking system for structural support and a separator panel to manage refrigerant flow, with a shared pump and radiator system for efficient heat dissipation.
The system effectively reduces thermal throttling, allows for a smaller footprint, and lowers PUE by enhancing heat absorption and dissipation, facilitating scalable and cost-effective data center operations.
Smart Images

Figure 2025537287000001_ABST
Abstract
Description
[Technical Field]
[0001] FIELD OF THE INVENTION The described embodiments relate to a system for cooling a computing device. In some embodiments, the system relates to a cooling tank for use in cooling a computing device. [Background technology]
[0002] A data center typically hosts hundreds, thousands, or tens of thousands of computing devices or servers to perform computing tasks. These computing devices generate a significant amount of heat during operation. The heat generated by the computing devices must be dissipated for the computing devices to operate properly. Otherwise, the computing devices may be damaged due to heat accumulated in the data center. Therefore, cooling systems are required to be installed in data centers to dissipate the heat. Both the computing devices and the cooling systems in a data center consume power. Power usage effectiveness (PUE) is used to measure the effectiveness of power usage, which is defined as the ratio of the total power consumed by the data center to the power delivered to the computing devices or servers performing the computing tasks. For example, a data center consumes a total of 10,000 KW of power, which is used to power servers and other equipment, primarily the cooling system for cooling the servers. At the same time, 8,000 KW of the total power is used to power the servers. Therefore, the PUE for the data center is 10,000KW / 8,000KW = 1.25. A lower PUE typically means less power waste, lower operating costs, and more competitive advantage. There are environmental and commercial benefits to providing a data center with a low PUE.
[0003] It would be desirable to address or ameliorate some of the shortcomings associated with such older methods and systems, or at least provide a useful alternative thereto.
[0004] Throughout this specification, the use of "comprise" or variations such as "comprises" or "comprising" will be understood to mean the inclusion of a stated element, integer, or step, or group of elements, integers, or steps, but not the exclusion of any other element, integer, or step, or group of elements, integers, or steps.
[0005] Any discussion of documents, acts, materials, devices, articles or the like which has been included in this specification shall not be deemed to be an admission that any or all of such matters form part of the prior art base or are common general knowledge in the art relevant to the present disclosure as existing before the priority date of each of the appended claims. Summary of the Invention
[0006] In some embodiments, a cooling tank for cooling computing devices includes a plurality of first racking members configured to engage at least one sidewall of a container, a plurality of second racking members configured to engage with the plurality of first racking members, and a plurality of third racking members configured to engage with the plurality of second racking members. The plurality of third racking members may be adapted to receive one or more computing devices such that the one or more computing devices are mounted within the container when the one or more computing devices are received by the plurality of third racking members. When the plurality of first racking members engage with the at least one sidewall of the container and when each of the plurality of second racking members engages with at least two of the plurality of first racking members, the plurality of first racking members and the plurality of second racking members may form a support structure within the container such that the support structure resists deflection of the at least one sidewall of the container when the container contains a liquid refrigerant.
[0007] The container may further include a separation panel disposed proximate to the first sidewall of the container, the separation panel defining a plurality of fenestrations and defining a return zone between the first sidewall and the separation panel.
[0008] Each of the plurality of first racking members may include one or more first mating structures, and each of the plurality of second racking members may include one or more second mating structures, and the one or more second mating structures may be configured to interact with the one or more first mating structures.
[0009] The one or more first mating structures and the one or more second mating structures may be configured to interact through a plurality of fenestrations defined by the separation panel.
[0010] A first edge of the plurality of third racking members may be substantially parallel to a bottom panel of the container. Each of the one or more computing devices may include at least two support brackets configured to abut against the first edge of the plurality of third racking members. When the at least two support brackets of each of the one or more computing devices abut against the first edge of the plurality of third racking members, the one or more computing devices may be suspended substantially perpendicular to the bottom panel.
[0011] Each of the plurality of third racking members may define a guide portion configured to abut one or more computing devices when the one or more computing devices are installed in the rack.
[0012] The computing device mounting rack may be compatible with one or more of standard rack unit rack members, standard rack unit computing devices, and / or ASIC computing devices.
[0013] One or more of the plurality of first racking members, the plurality of second racking members, and / or the plurality of third racking members may comprise one or more cable support structures.
[0014] The plurality of second racking members and / or the plurality of third racking members may be further configured to route one or more cables configured to engage one or more computing devices.
[0015] In some embodiments, a cooling tank for cooling a computing device may include a container having at least four sidewalls, the sidewalls defining at least four container edges, the container edges being substantially perpendicular to a container bottom surface, and including at least one mounting bracket, each of the at least one mounting bracket including at least one first mounting structure; and a plurality of support structures, each support structure including a set of reinforcement members in contact with the at least four sidewalls, each of the plurality of support structures configured to extend substantially around a perimeter of the container defined by the sidewalls that is parallel to the container bottom surface. Each reinforcement member may include at least one second mating structure configured to interface with the at least one first mounting structure. The reinforcement member may substantially resist deflection of the container wall when the container contains a liquid refrigerant.
[0016] The tank may comprise three support structures, each of which may comprise four reinforcing members.
[0017] The refrigerant tank may include a separator panel disposed within the interior space of the vessel, the separator panel being configured to modify the flow characteristics of the liquid refrigerant.
[0018] The refrigerant tank may include a first set of refrigerant conduits, a second set of refrigerant conduits, and a balance set of conduits configured to transport liquid refrigerant to and / or from the vessel.
[0019] One of the at least four vessel walls may be a first vessel wall. The first set of refrigerant conduits, the second set of refrigerant conduits, and the balance set of conduits may extend between the first vessel wall and the separation panel.
[0020] The first set of refrigerant conduits, the second set of refrigerant conduits, and the balance set of conduits may be configured to transport liquid refrigerant into and / or out of the vessel.
[0021] The set of balancing conduits may be further configured to isolate the tank from one or more connected tanks and / or conduits.
[0022] The refrigerant tank may further comprise at least one set of overflow conduits, which may be in fluid communication with one or more adjacent tanks.
[0023] At least some of the reinforcing members forming at least one of the support structures may have a thickness in the range of 1.6mm to 3mm.
[0024] At least some of the reinforcing members forming at least one of the support structures may have a width in the range 50mm to 100mm.
[0025] The support structures may be positioned so as to be evenly spaced from one another across at least one of the side walls.
[0026] The tank may have a working volume of 1200 liters to 1400 liters of liquid refrigerant.
[0027] The tank may further include insulation disposed on one or more exterior surfaces of the at least four side walls.
[0028] The tank may further comprise at least one exterior cladding panel.
[0029] The tank may further comprise a plurality of cable routing members.
[0030] The refrigerant tank may further include a cover disposed over the opening of the container distal from the bottom panel. The cover may include a body portion. The body portion may include a fastening portion for fastening the body portion to the container, one or more cable fenestrations, one or more closure control mechanisms, and a lid portion hingedly connected to the body portion, the lid portion including one or more viewing windows. The one or more closure control mechanisms may be configured to resist movement of the lid portion from an open position to a closed position.
[0031] The cooling tank may further comprise one or more computing devices and a volume of liquid refrigerant.
[0032] In some embodiments, a system for cooling a computing device may include a plurality of cooling tanks, a heat exchanger, a radiator, at least one liquid refrigerant pump, a volume of liquid refrigerant, a plurality of inlet conduits configured to transport the volume of liquid refrigerant from the at least one liquid refrigerant pump to the plurality of cooling tanks, and a plurality of outlet conduits configured to transport the volume of liquid refrigerant from the plurality of cooling tanks to the heat exchanger, as described herein.
[0033] Some embodiments relate to a cooling tank for cooling a computing device, the cooling tank comprising: a container configured to receive a refrigerant in a cavity of the container, the container including a bottom panel and a plurality of side walls extending from the bottom panel, two of the side walls being disposed opposite one another; a separation panel disposed within the vessel, the separation panel being connected to (i) the oppositely disposed side walls and (ii) the bottom panel so as to divide the vessel cavity into a cooling space and a return space; a perforated panel disposed near the bottom panel of the vessel and connected to (i) the opposing side walls and (ii) the separator panel so as to separate the inlet space from the cooling space; a racking system configured to support computing devices within the cooling space; a refrigerant inlet conduit configured to discharge refrigerant into the inlet space; a refrigerant outlet conduit disposed within the return space and extending out of the vessel; perforations defined in the perforated panel configured to allow passage of a refrigerant from the inlet space to the cooling space for cooling a computing device within the cooling space; The top portion of the separator panel is disposed farther from the bottom panel than the inlet of the refrigerant outlet conduit.
[0034] The inlet of the refrigerant outlet conduit may be configured to receive a plug. The plug may define a second inlet to the refrigerant outlet conduit, the second inlet configured to be disposed farther from the bottom panel than a top portion of the separation panel. The racking system may include a cover plate configured to receive a top portion of one of the computing devices, the top portion being below the top portion of the separation panel.
[0035] The racking system may be connected to one or both of (ii) the separation panel and (ii) at least one of the plurality of side walls to provide structural reinforcement for the vessel. A refrigerant inlet conduit may be disposed within the return space and extend into the inlet space through an aperture in the separation panel. [Brief explanation of the drawings]
[0036] [Figure 1] 1 is a schematic diagram of a cooling system for cooling a computing device, according to some embodiments. [Figure 2A] 1 is a schematic diagram of a cooling system for cooling a computing device, according to some embodiments. [Figure 2B] FIG. 2B is a schematic diagram of the cooling system of FIG. 2A connected to a drain and fill system, according to some embodiments. [Figure 2C] FIG. 2B is a schematic diagram of the cooling system of FIG. 2A connected to a drain and fill system, according to some embodiments. [Figure 3A] 1 is a schematic diagram of a cooling tank, according to some embodiments. [Figure 3B] 1 is a schematic diagram of a cooling tank, according to some embodiments. [Figure 3C] 1 is a schematic diagram of a cooling tank, according to some embodiments. [Figure 3C (inset)] FIG. 3D is a simplified schematic diagram of FIG. 3C. [Figure 3D] 1 is a schematic diagram of a cooling tank, according to some embodiments. [Figure 4] 1 is an image of a mounting arrangement for a cooling tank, according to some embodiments. [Figure 5] 1 is an image of an exterior cladding panel for a cooling tank, according to some embodiments. [Figure 6A] 1 is an image of a cover for a cooling tank, according to some embodiments. [Figure 6B] 1 is an image of a cover for a cooling tank, according to some embodiments. [Figure 6C] 1 is an image of a cover for a cooling tank, according to some embodiments. [Figure 6D] 1 is an image of a cover for a cooling tank, according to some embodiments. [Figure 7A(1)] FIG. 1 is a schematic diagram of a rack system for cooling tanks, according to some embodiments. [Figure 7A(2)] FIG. 1 is a schematic diagram of a rack system for cooling tanks, according to some embodiments. [Figure 7B(1)] FIG. 1 is a schematic diagram of a rack system for cooling tanks, according to some embodiments. [Figure 7B(2)] FIG. 1 is a schematic diagram of a rack system for cooling tanks, according to some embodiments. [Figure 7C(1)] FIG. 1 is a schematic diagram of a rack system for cooling tanks, according to some embodiments. [Figure 7C(2)] FIG. 1 is a schematic diagram of a rack system for cooling tanks, according to some embodiments. [Figure 7D(1)]FIG. 1 is a schematic diagram of a rack system for cooling tanks, according to some embodiments. [Figure 7D(2)] FIG. 1 is a schematic diagram of a rack system for cooling tanks, according to some embodiments. [Figure 7E] FIG. 1 is a schematic diagram of a rack system for cooling tanks, according to some embodiments. [Figure 7F(1)] FIG. 1 is a schematic diagram of a rack system for cooling tanks, according to some embodiments. [Figure 7F(2)] FIG. 1 is a schematic diagram of a rack system for cooling tanks, according to some embodiments. [Figure 7G] FIG. 1 is a schematic diagram of a rack system for cooling tanks, according to some embodiments. [Figure 8] 1 is an image of a cable management system of a rack system for cooling tanks, according to some embodiments. [Figure 9] 10A-10C illustrate plugs for refrigerant and balance conduits according to some embodiments. DETAILED DESCRIPTION OF THE INVENTION
[0037] Large collections of computing devices are used to perform operations such as hosting websites, storing data, and / or engaging in computationally complex operations such as solving proof-of-work equations, rendering complex images, and / or running large neural networks. Large numbers of computing devices operating in close proximity at high processing speeds generate significant amounts of excess thermal energy. To maintain optimal performance, these computing devices must absorb and dissipate or otherwise dissipate the excess thermal energy to prevent the computing devices from thermal throttling, which can lead to slower processing, loss of performance, and potential failure.
[0038] Groups of computing devices may be cooled by moving air between heat-generating components such as central processing units (CPUs), graphical processing units (GPUs), random access memory (RAM), and / or motherboard chipsets. Computing devices may also cool their components using a cooling liquid, such as water, that is routed from one heat-generating component to another to form a water loop, typically attached to a reservoir and pump mechanism. Multiple computing devices may be cooled by immersion cooling, which involves immersing the computing devices in a non-conductive liquid, such as synthetic hydrocarbon oil. The computing devices may be immersed in this non-conductive liquid, allowing the liquid to permeate through the chassis of the computing device and reach the heat-generating components, absorbing the heat and dissipating it.
[0039] Because liquid can be a more effective heat sink, immersion cooling can allow computing devices to be placed closer together when compared to other cooling methods, allowing heat to be passively absorbed in full contact with all parts of the computing device instead of having to be mechanically moved into the surface, such as with traditional water loops or air cooling.
[0040] 1 is a block diagram of a cooling system 100, according to some embodiments. The system 100 may include one or more tanks 300. The system 100 may also include one or more pump systems 110. The system 100 may also include one or more heat sinks 115. The system 100 may also include one or more fluid reservoirs 120. The system 100 may also include one or more control devices 130. The system 100 may also include one or more event logs 140. The system 100 may be used to cool a computing device 103 during operation.
[0041] System 100 can be configured to provide immersion cooling of computing device 103. Thus, system 100 can be housed in a smaller footprint compared to a collection of computing systems that generate the same amount of thermal energy and / or have equivalent combined processing power. Allowing for a smaller footprint can provide a more easily implemented modular system that can be scaled up or down quickly, easily, and in a modular manner.
[0042] System 100 may include a number of conduits connecting components of system 100. The conduits may be configured to conduct a cooling fluid (such as a non-conductive liquid) between components of system 100 to facilitate cooling of computing device 103. The various conduits of system 100 may be formed from tubes, pipes, and / or combinations of tubes and pipes. Pipes are hollow conduits with circular cross-sections that tend to be rated to higher internal pressures and may have rougher inner surfaces compared to tubes. Tubes may be hollow conduits with circular, square, rectangular, and / or elliptical cross-sections that generally are rated to lower internal pressures than pipes but have smoother inner surfaces. Thus, tubes may be better suited to facilitating uniform flow patterns within system 100 and may be better for low-pressure systems and systems where spacing and conduit configuration play a critical role.
[0043] System 100 may also be adapted and / or configured to facilitate substantially similar or identical conditions of system refrigerant throughout most or all portions of system 100 at substantially all times during operation. Similar or identical conditions may be the same volume of system refrigerant at any point in system 100 as at any equivalent point in system 100, e.g., the same volume of liquid in one inlet conduit 150 and another different inlet conduit 150. Similar or identical conditions may be the pressure, pressure differential, and / or maximum velocity pressure at any point in system 100 as at any equivalent point in system 100. When system 100 is operating within normal operating conditions, the system refrigerant throughout system 100 may be considered to be in equilibrium. Similar or identical conditions may also be the same amount of system refrigerant passing through any point in system 100 as passing through any equivalent point in system 100. The present disclosure may achieve this by maintaining a uniform flow regime through the conduits of system 100.
[0044] The tanks 300 may be fluidly connected to other tanks 300, pump system 110, radiator 115, and / or fluid reservoir 120 by one or more fluid conduits. The tanks 300 may comprise one or more computing device racks 102, which may comprise one or more computing devices 103. The tanks 300 may be configured into racks and / or rows of tanks sharing common refrigerant conduits (shown in FIG. 2A ) connecting each tank to each other and to the rest of the system 100. Adjacent tanks 300 may also be fluidly connected to each other by one or more balance conduits and / or one or more overflow conduits.
[0045] The pump system 110 may be in fluid communication with the radiator 115, the fluid reservoir 120, and / or one or more tanks 300 by one or more coolant conduits. The pump system 110 may be configured to pump system coolant throughout the system 100 to collect excess heat energy from the computing device 103 in the tanks 300 for dissipation in the radiator 115.
[0046] In some embodiments, pump system 110 may include one or more fluid pumps 112, 114. Pump system 110 may include multiple fluid pumps depending on the volume of system coolant contained in system 100 and / or the number of tanks 300 in system 100. In some embodiments, fluid pump 112 may be a primary or first coolant pump, and fluid pump 114 may be a secondary, backup, or second coolant pump. Fluid pump 114 may be maintained at an idle speed and / or power usage, such as 50% of full power output of fluid pump 114, and may ramp up to a higher speed and / or power usage upon a trigger event. Trigger events may include a power spike, a malfunction event, a drop in system coolant velocity, an increase in system coolant velocity, and / or any other trigger that may indicate abnormal and / or atypical behavior of system 100. In some embodiments, the fluid pumps 112, 114 may both operate at 50% of their full power to transport system coolant throughout the system, and upon a trigger event, one of the fluid pumps 112, 114 may be reduced to a lower power output and the other of the fluid pumps 112, 114 may have its power output correspondingly increased. The pumps may also be in any other configurations of reduced or increased power relative to each other, such as, for example, 10-90, 20-80, 30-70, 40-60, etc. However, in some cases, a 0-100 or 50-50 configuration may be preferred as this helps facilitate substantially even distribution of the system coolant throughout the system.
[0047] The radiator 115 may be fluidly connected to the fluid pump 110, the fluid reservoir 120, and / or the tank 300 by one or more refrigerant conduits. The radiator 115 may be configured to receive a system refrigerant or another secondary refrigerant, such as water, that absorbs excess heat generated by the computing device 103 and dissipates the heat to the surrounding environment and / or atmosphere. In some embodiments, the radiator 115 may be an adiabatic cooling system configured to receive a system refrigerant or one or more secondary refrigerant fluids, such as air or water.
[0048] In some embodiments, the radiator 115 may comprise one or more heat exchangers 115a. The heat exchanger may be an oil-to-water interface when a system coolant (i.e., oil) flows between the tanks 300 and may transfer collected thermal energy to a volume of water. The radiator may exchange heat with the oil by approximating the oil conduit to the water conduit, allowing thermal energy in the oil to be radiated to the water.
[0049] In some embodiments, radiator 115 may also include, for example, one or more of a water tower, a natural water source, and / or a geothermal conduit system, alone or in combination with other described elements, which may be configured to transfer heat from system 100 to the surrounding environment to cool the system refrigerant before it is returned to system 100.
[0050] Fluid reservoir 120 may be fluidly connected to tank 300, fluid pump 110, and / or radiator 115 by one or more refrigerant conduits. Fluid reservoir 120 may be configured to collect and / or store some or all of the volume of oil within system 100. When system 100 or components of system 100, such as fluid pump 110, tank 300, rack 102, computing device 103, and / or radiator 115, require maintenance, replacement, and / or reconfiguration, oil within system 100 may be transported to fluid reservoir 120 by fluid pump 110 and / or one or more reservoir pumps (not shown). Fluid reservoir 120 may be mechanically isolated from the rest of system 100 until it is necessary to move the oil to and store it in fluid reservoir 120. In some embodiments, fluid reservoir 120 may be a movable container that can be connected or removed from system 100 as needed.
[0051] The control device 130 may be one or more computing devices 103 in communication with one or more electrical control systems (not shown) and / or one or more temperature probes 180 to monitor temperature and / or flow characteristics throughout the system 100. The temperature probes 180 may be installed in the outlet conduit 152, in the return conduit 156, inside the tank 300, and / or at the inlet and / or outlet of the tank 300. In some embodiments, the temperature probes 180 may be positioned proximate to the inlet and / or outlet of the radiator 115. The control device 130 may also communicate with the event log 140 to send operational notifications. In some embodiments, when the control device detects a condition in the system 100 that is outside of normal operating parameters, such as via one or more temperature probes 180, the control device 130 may be configured to communicate a notification to the event log 140. The notifications may be stored in an ordered list in the event log 140, which tracks the performance of the system 100. In some embodiments, control device 130 may also be configured to perform periodic, non-periodic, and / or manual system checks to determine whether system 100 is operating properly. Control device 130 may also continuously monitor the condition of system 100 and provide a continuous stream of information to event log 140.
[0052] Control device 130 may also be configured to monitor the temperature of the system coolant and / or the performance of system 100. Control device 130 may be configured to read one or more temperatures of the system coolant at one or more points in system 100 and adjust the operation of one or more components of the system accordingly. For example, control device 130 may adjust the operation of one or more pipes or valves to increase or decrease the flow rate of fluid through radiator 115. Control device 130 may read the temperature of the system coolant using one or more temperature probes located throughout system 100, such as at the inlet and / or outlet of radiator 115.
[0053] 1 , pump system 110 may be fluidly connected to tank 300 by refrigerant inlet conduit 150 so that system refrigerant may be pumped or otherwise supplied to tank 300. Tank 300 may be fluidly connected to radiator 115 via refrigerant outlet conduit 152. Radiator 115 may be fluidly connected to pump system 110 by refrigerant return conduit 156. In some embodiments, pump system 110 may also be fluidly connected to fluid reservoir 120 by discharge and fill pipes 154.
[0054] FIG. 2A is a schematic diagram of a cooling system 100 for cooling a computing device 103. The computing device 103 is not shown in FIG. 2A to allow other features of the system 100 to be clearly shown. It will be understood that the computing device 103 is included in a tank 300 unless specifically noted otherwise. The cooling system 100 may be used to cool computing devices 103 that may operate in a data center. The cooling system 100 comprises cooling tank(s) 300. As shown in FIG. 2A , the exemplary cooling system 100 includes twelve cooling tanks 300 arranged in two rows positioned substantially parallel to one another. The cooling tanks 300 may be mounted on an assembly table or mounting rack (not shown) or otherwise arranged. In some embodiments, the system 100 may comprise more or fewer than twelve tanks 300. The tanks 300 may be arranged in a single row (i.e., no adjacent rows, as shown in FIG. 2A ), in multiple rows spaced apart at multiple levels (i.e., one or more upper and lower rows), and / or in vertical stacks. For example, the cooling system 100 may include 16 cooling tanks 300 on two decks, with eight cooling tanks 300 on each deck. In FIG. 2A , one row of tanks 300 is shown with a cover 600, while the other row of tanks 300 is shown without a cover to allow viewing of the interior of the tanks 300.
[0055] The following description of elements installed on one or more lower decks also applies to elements installed on one or more upper decks or other deck(s), if present. The following description of a row of cooling tanks 300 on a deck also applies to another row of cooling tanks on the same deck. As another example, the cooling system 100 described with reference to FIG. 2A may be used as a sub-cooling system, and another cooling system 100 may be used as another sub-cooling system. Two sub-cooling systems 100 can be fluidly connected to form a cooling system. Such cooling systems including two or more sub-cooling systems 100 are also described in the present disclosure. A pipe in the present disclosure may be a straight pipe, a bent pipe, a curved pipe, or a combination of pipes of different shapes. A pipe may also include one or more segments that are fluidly connected. Furthermore, a tube in the present disclosure may be a straight tube, a bent tube, a curved tube, or a combination of tubes of different shapes and / or configurations. One or more segments of a pipe may extend in the same direction or in different directions. Furthermore, references to segments of pipe are not intended to define the structure of the pipe, but rather to indicate different portions of the pipe for ease of explanation. In some embodiments, conduit sections may be joined by flange connections.
[0056] For ease of explanation, the multiple cooling tanks 300 may be individually referred to as 300. Any cooling tank 300 may have the same structure and operate in the same manner as any other cooling tank 300 in the system. Each of the cooling tanks 300 is configured to contain a system coolant and is sized to immerse at least a portion of the computing device 103 (not shown in FIG. 2A ) in the system coolant so that the system coolant can absorb heat generated from the computing device 103 to cool the computing device 103. During operation of the cooling system 100 and data center, one or more computing devices 103 are placed in each of the cooling tanks 300, and heat generated from the computing device 103 is absorbed by the system coolant in the cooling tank 300, reducing the temperature of the computing device 103. As a result, the system coolant around the computing device 103 is heated, increasing the temperature of the system coolant. The system coolant may be, for example, a cooling oil.
[0057] The system coolant of the present disclosure can be a type of dielectric fluid. A dielectric fluid is a non-conductive fluid that has very high resistance to electrical breakdown events at high voltages. Electrical or dielectric breakdown occurs when an insulating (i.e., non-conductive) material becomes conductive. The present system can use a dielectric fluid such as an oil, e.g., a synthetic oil, a mineral oil, or a bio-organic oil, or an operating fluid such as 3M's Novec or Fluorinert lines. In some embodiments, the system 100 can use a synthetic hydrocarbon oil because synthetic hydrocarbon oils repel water and other foreign matter.
[0058] The cooling system 100 also includes one or more pairs of refrigerant conduits. In some embodiments, each pair of refrigerant conduits includes an inlet conduit 150 and an outlet conduit 152. The inlet conduit 150 of each set of refrigerant conduits may be fluidly connected to each of the row of cooling tanks 300 to supply system refrigerant into the plurality of cooling tanks 300. The system refrigerant may be supplied into the row of cooling tanks 300 from the bottom of the cooling tanks 300 via the inlet conduit 150 of each of the pairs of refrigerant conduits.
[0059] The outlet conduits 152 of each set of refrigerant conduits are fluidly connected to the row of cooling tanks 300 for transporting system refrigerant carrying heat absorbed from the computing devices 103 out of the row of cooling tanks 300. The heat-carrying system refrigerant is transported out of the cooling tanks 300 via the outlet conduits 152 of each pair of refrigerant conduits.
[0060] The cooling system 100 also includes a radiator 115. The radiator 115 is fluidly connected, directly or indirectly, to each inlet conduit 150 of each pair of refrigerant conduits to supply system coolant into the set of inlet conduits 150. The radiator 115 is also fluidly connected, directly or indirectly, to each outlet conduit 152 of each pair of refrigerant conduits to receive system coolant carrying heat absorbed from the computing devices 103 from the outlet conduit 152 of each pair of refrigerant conduits. The radiator 115 is configured to dissipate heat from the heat-carrying system coolant. Thus, the temperature of the system coolant is reduced, and the system coolant is supplied into the inlet conduit 150 of each pair of refrigerant conduits and then to each row of multiple cooling tanks 300 to cool the computing devices 103 immersed in the system coolant in each row of multiple cooling tanks 300.
[0061] The cooling system 100 also includes a pump system 110 fluidly connected, directly or indirectly, to each of the inlet conduits 150 and outlet conduits 152 of each pair of refrigerant conduits. The pump system 110 is configured to facilitate circulation of the system refrigerant through the multiple cooling tanks 300, the inlet conduits 150, the outlet conduits 152, and the radiators 115. A cooling system configured as described in some embodiments may allow multiple cooling tanks 300 to be connected to a single refrigerant distribution system, which in some embodiments may have only a single pump system 110 and a single radiator 115. The single pump system 110 and single radiator 115 reduce complexity compared to a system having several pumps and radiators, which may reduce power consumption, which may allow for easier and less expensive operation and maintenance.
[0062] In the cooling system 100, the radiator 115 is fluidly connected to a row of multiple cooling tanks 300 via the inlet conduit 150 and outlet conduit 152 of each pair of refrigerant conduits. Additionally, the pump system 110 is fluidly connected to a row of multiple cooling tanks 300 via the outlet conduit 152 of each pair of refrigerant conduits. Such a configuration eliminates the need for multiple cooling tanks 300 to have individual radiators and individual refrigerant pumps for dissipating heat and circulating the system refrigerant, since the radiator 115 and pump system 110 are shared by the multiple cooling tanks 300. Thus, the cooling system 100 enables scalable deployment of data centers; i.e., additional rows of cooling tanks 300 may be added to the cooling system 100 simply by fluidly attaching specific inlet and outlet conduits of the cooling tanks 300 to the system 100.
[0063] The cooling system 100 may also include a water supply pipe (not shown) fluidly connected to the radiator 115 for supplying water (e.g., cold water) to the radiator 115 so that the radiator 115 dissipates heat into the water. The cooling system 100 also includes a water discharge pipe (not shown) fluidly connected to the radiator 115 for dissipating water with heat (i.e., hot water) from the radiator 115.
[0064] In some embodiments, the cooling system 100 may include a drain and fill system 220, as shown in FIGS. 2B and 2C. The drain and fill system 220 may include the refrigerant reservoir 120 and the drain and fill pipes 154 and may be used, for example, when one or more cooling tanks 300 need to be drained for operational requirements and serviceability. The drain and fill system 220 may further include one or more drain and fill pumps (not shown) for transporting fluid into or out of the refrigerant reservoir 120 via the drain and fill conduits 154. The use of multiple tanks 300 connected to one radiator 115 (or heat exchanger 115a) and pump system 110 can allow for fewer moving parts, which can create operational efficiencies and allow for easier and less expensive operation and maintenance.
[0065] The drain and fill system 220 is configured to drain the system refrigerant from one or more cooling tanks 300. The drain and fill system 220 is configured to direct the system refrigerant to one or more cooling tanks 300 to fill the tanks 300 with refrigerant. In this manner, when one or more cooling tanks 300 need to be serviced, the drain and fill system 220 drains the system refrigerant from one or more cooling tanks 300. After servicing is complete, the drain and fill system charges the system refrigerant into the one or more cooling tanks 300. In some embodiments, the system 100 can continue to transport the system refrigerant throughout the system 100 while one or more tanks 300 are being emptied, serviced, and refilled; this process is described in further detail below.
[0066] 3A-3D are schematic diagrams of a cooling tank 300 that may be used in cooling system 100 as one of the cooling tanks 300 (see FIGS. 1 and 2A). FIG. 3A illustrates a perspective view of cooling tank 300 according to some embodiments. FIG. 3B is a top view of cooling tank 300 according to some embodiments. FIG. 3C is a side view of cooling tank 300 according to some embodiments. FIG. 3D is a front view of cooling tank 300 according to some embodiments, and thus FIG. 3C is a left side view of cooling tank 300.
[0067] Cooling tank 300 includes a vessel 305. Vessel 305 forms a working space for containing a liquid refrigerant. In some embodiments, vessel 305 comprises a plurality of connected walls that define an interior volume or cavity, which may be referred to as the working space. Vessel 305 may also comprise a first set of refrigerant conduits 362 and a second set of refrigerant conduits 365.
[0068] 3A, the vessel 305 of the cooling tank 300 comprises a bottom plate or panel 310 having a first edge 315, a second edge 320 adjacent to the first edge 315, a third edge 325 adjacent to the second edge 320 and opposite the first edge 315, and a fourth edge 330 connecting the third edge 325 to the first edge 315. In some embodiments, the first edge 315 is a forward-facing edge aligned with the front surface of the vessel 305 (as seen in FIG. 3D). In some embodiments, the third edge 325 is a rearward-facing edge aligned with the rear surface of the vessel 305. In some embodiments, the second edge 320 is a left-facing edge and the fourth edge 330 is a right-facing edge disposed opposite one another and connecting the front-facing and rear-facing edges of the bottom panel 310. The second edge 320 and the fourth edge 330 may align with the left and right sides of the container 305, respectively.
[0069] The container 305 may further include a first sidewall 340 extending from the first edge 315, a second sidewall 345 extending from the second edge 320, a third sidewall 350 extending from the third edge 325, and a fourth sidewall 355 extending from the fourth edge 330. The sidewalls 340, 345, 350, 355 may be connected to each other and to the bottom panel 310 to define an interior volume / working space of the container 305. The bottom panel 310 may define a bottom surface of the container 305. The sidewalls 340, 345, 350, 355 may define an opening 306 in the container 305. The opening 306 and the bottom panel 310 may be at opposite ends of the container 305. 3D , the first side wall 340 may be the front-facing wall. The third side wall 350 may be the rear-facing wall. The second side wall 345 and the fourth side wall 355 may be left-facing and right-facing walls disposed opposite one another and connecting the front-facing wall 340 and the rear-facing wall 350 of the container 305. The second side wall 345 and the fourth side wall 355 may be aligned with the left and right sides of the container 305, respectively.
[0070] The first set of refrigerant conduits 362 are configured to fluidly connect to a set of outlet pipes or conduits 152, for example, as shown in Figure 2A, for carrying heat-carrying liquid refrigerant out of the cooling tank 300. The second set of refrigerant conduits 365 are configured to fluidly connect to the inlet pipes 150 for supplying liquid refrigerant to the cooling tank 300.
[0071] The cooling tank 300 may include one or more sets of connecting pipes 370. The set(s) of connecting pipes may be configured to fluidly connect the cooling tank 300 to one or more adjacent cooling tanks, such as the cooling tank 300 (see FIGS. 1 and 2A), to enable equalization of liquid refrigerant levels among the adjacent cooling tanks 300. The connecting pipes 370 may include spacers 372, as shown in FIG. 3A and the accompanying detailed view of FIG. 3A. The spacers 372 may space adjacent tanks 300 apart. The connecting pipes 370 allow for uninterrupted overflow between adjacent connected tanks 300 in the event of a significant imbalance or overfill. The spacers 372 may be machined from billet aluminum and use Viton gaskets 374 to provide a seal between the spacers 372 and the sides of the tank 300. The spacers 372 may define apertures 376 for receiving retaining bolts that may be used to secure the spacers 372 in place. The spacer 372 may define a lumen 378 to allow fluid passage through the spacer 372 between the connected tanks 300. A connecting pipe (not shown) may fit within the lumen 378 for fluid passage. The spacer 372 may be approximately 115 mm long, 75 mm high, and 48 mm thick. The aperture 376 may have a diameter of approximately 10 mm. The lumen 378 may be approximately 65 mm in diameter. A plurality of concentric grooves may surround the lumen 378 for accommodating a ring gasket. The spacer 372 may be diamond-shaped, with the apertures 376 on either side of the lumen 378.
[0072] The cooling tank 300 may further include a separation panel 311 (shown in FIG. 3B ) extending in the working space of the vessel 305. The separation panel 311 is configured to separate the working space into a cooling space 312 and a return space 313. The separation panel 311 may extend from proximal to the bottom plate or panel 310 to proximal to the first reinforcement structure 375. In some embodiments, the separation panel 311 is connected to the bottom panel 310. In particular, the separation panel 311 may extend approximately 960 mm from the bottom panel 310. In some embodiments, the separation panel 311 may extend to the top of the tank 300. The computing device 103 is disposed in the cooling space 312 during operation. The separation panel 311 may be configured to control the flow and / or level of the refrigerant within the tank 300 or vessel 305. The separation panel 311 may alternatively be referred to as a "weir wall" because the separation panel 311 facilitates regulation of fluid flow in the tank 300. The separation panel 311 may guide the flow of fluid in the tank 300. The separation panel 311 may determine the fluid level in the tank 300, particularly in the cooling space 312. The separation panel 311 may be removably connected to the vessel 305. In some embodiments, the separation panel 311 is welded to the vessel 305.
[0073] The cooling spaces 312 may be fluidly coupled to or in fluid communication with the set of second refrigerant conduits 365. The return spaces 313 may be fluidly coupled to or in fluid communication with the set of first refrigerant conduits 362. The separation panel 311 may be configured such that liquid refrigerant in the cooling spaces 312 flows into the return spaces 313 due to supplying the liquid refrigerant into the cooling spaces 312 via the set of second refrigerant conduits 365. The set of first refrigerant conduits 362 may be further configured to transport the liquid refrigerant carrying heat absorbed from the computing device 103 out of the return spaces 313.
[0074] Turning now to FIG. 3C , the tank 300 may include a perforated plate 317 that may be configured to further divide the working space of the vessel 305 into a cooling space 312, a return space 313, and an inlet space 318. FIG. 3C (inset) is a simplified schematic of FIG. 3C , illustrating how the perforated plate 317 and separator panel 311 partition the working space into the cooling space 312, the return space 313, and the inlet space 318. In some embodiments, the perforated plate 317 partitions a portion of the cooling space 312 to define the inlet space 318. The inlet space 318 may be configured to receive fresh, or otherwise equivalently cool, liquid refrigerant via a second set of refrigerant conduits 365. The perforated plate 317 may be configured to facilitate circulation and / or even distribution of the liquid refrigerant through and around the cooling space 312.
[0075] The flow of refrigerant through the tank 300 according to the embodiment shown in FIG. 3C will now be described. The refrigerant enters the inlet space 318 via the conduit 365. As the refrigerant gradually enters the inlet space 318, it passes through the perforations in the perforated plate 317 and enters the cooling space 312 containing the computing device 103. The refrigerant absorbs heat released by the computing device 103. To allow for complete immersion of the computing device 103, the top of the separation panel 311 may be higher than the top of the computing device 103. The top of the computing device 103 may be approximately 25 mm below the top of the separation panel 311.
[0076] As refrigerant gradually enters the inlet space 318 and then the cooling space 312, the level of refrigerant in the cooling space 312 increases until the refrigerant reaches the top of the weir wall / separator panel 311. The refrigerant gradually enters the cooling space 312, causing the cooling space 312 to overflow with refrigerant, and the excess refrigerant flows over the top of the weir wall / separator panel 311 and into the return space 313. This flow of refrigerant from the inlet space 318, through the cooling space 312, and into the return space 313 removes and transfers heat from the computing devices 103 in the cooling space 312. The heated refrigerant flows into the return space 313. A first refrigerant conduit 362 in the return space 313 receives the overflowing heated refrigerant and transfers the refrigerant to the radiator 115 via the outlet conduit 152. The inlet of the refrigerant conduit 362 is lower than the top of the separator panel 311. The outlet of the refrigerant conduit 362 may be toward the bottom of the tank 300. An inlet of the refrigerant conduit 362 lower than the separation panel 311 reduces the possibility of air entering the refrigerant conduit 362, thereby reducing the possibility of undesirable vortices developing in the flow of refrigerant through the outlet conduit 152. During operation, the tank 300 may be filled with refrigerant such that the refrigerant level in the cooling space 312 and the return space 313 is above the separation panel 311. The inlet of the refrigerant conduit 362 may be below the refrigerant level in the return space 313. The flow of refrigerant into the tank 300 (via conduit 365) and / or out of the tank 300 (via conduit 362) may create a current or flow that promotes circulation of the refrigerant through the inlet space 318, the cooling space 312, and the return space 313.
[0077] The bottom panel 310, the first sidewall 340, the second sidewall 345, the third sidewall 350, and the fourth sidewall 355 form a working space. A first set of refrigerant conduits 362 and a second set of refrigerant conduits 365 are located between the first sidewall 340 and the separator panel 311.
[0078] In some embodiments, at least one of the bottom panel 310, the first side wall 340, the second side wall 345, the third side wall 350, and the fourth side wall 355 are directly connected to one another, such as by welding each of the walls 340, 345, 350, 355 to one another and the panel 310. In some embodiments, at least one of the bottom panel 310, the first side wall 340, the second side wall 345, the third side wall 350, and the fourth side wall 355 are indirectly connected to one another, such as through a support member or frame. 4 , vertical support member 415 may be secured to the area where first side wall 340 meets second side wall 345, the area where second side wall 345 meets third side wall 350, the area where third side wall 350 meets fourth side wall 355, and / or the area where first side wall 340 meets fourth side wall 355. Vertical support member 415 may extend substantially from bottom plate or panel 310 to the top of tank 300 and extend substantially along the edges of side walls 340, 345, 350, and 355. In some embodiments, side walls 340, 345, 350, and 355 may be secured directly to vertical support member 415, whereby vertical support member 415 forms each vertical edge of each of the outermost portions of tank 300. In some embodiments, the side walls 340, 345, 350, and 355 may be secured to one another at their edges perpendicular to the bottom panel 310, and then the vertical support members 415 may be secured to each of the edges of the tank 300 perpendicular to the bottom panel 310. The vertical support members 415 may be secured to the edges of the tank 300 perpendicular to the bottom panel 310 by welding.
[0079] 3A-3D, the container 305 may be sized to receive a conventional rack unit (RU) server, as shown by way of example in FIGS. 7C-7G. For example, the first edge 315 of the bottom panel 310 may have a length ranging from 1500 mm to 1700 mm. The first side wall 340 may have a width ranging from 1500 mm to 1700 mm when positioned on the bottom panel 310 as shown in FIG. 3A. The third side wall 350 may have the same width as the first side wall 340.
[0080] The second edge of the bottom panel 310 may have a length of 800 mm. The second side wall 345 may have a width of 800 mm when positioned on the bottom panel 310 as shown in Figure 3A. The fourth side wall 355 may have the same width as the second side wall 345.
[0081] First side wall 340, second side wall 345, third side wall 350, and / or fourth side wall 355 may have a height in the range of 1000 mm to 1200 mm when positioned on bottom panel 310 as shown in Figure 3A. Each of side walls 340, 345, 350, and 355 may have the same height.
[0082] The vessel 305, bottom panel 310, and / or sidewalls 340, 345, 350, and 355 may be formed from stainless steel. In some embodiments, the vessel 305 and sidewalls 340, 345, 350, and 355 may be formed from stainless steel in separate processes and then assembled or otherwise fitted together to form the tank 300. The vessel 305 and / or sidewalls 340, 345, 350, and 355 may be formed from another suitable material, such as aluminum, or a similar rust- and / or corrosion-resistant material. In some embodiments, the vessel 305 and sidewalls 340, 345, 350, and 355 may be formed from different materials that are particularly suited for their particular purposes.
[0083] 3A-3D, the tank 300 may include a first reinforcing structure 375, a second reinforcing structure 380, and / or a third reinforcing structure 385. The first reinforcing structure 375, the second reinforcing structure 380, and / or the third reinforcing structure 385 may extend around the container 305 to strengthen the walls of the container 305. Referring now to FIG. 3A, the walls of the container 305 are shown in phantom to illustrate how the first reinforcing structure 375, the second reinforcing structure 380, and / or the third reinforcing structure 385 extend around the container 305. In some embodiments, the first reinforcing structure 375 may include a first rib 375-1, a second rib 375-2, a third rib 375-3, and / or a fourth rib 375-4. The second reinforcing structure 380 may include a first rib 380-1, a second rib 380-2, a third rib 380-3, and / or a fourth rib 380-4. The third reinforcing structure 385 may include a first rib 385-1, a second rib 385-2, a third rib 385-3, and / or a fourth rib 385-4. The first ribs 375-1, 380-1, 385-1 may be disposed on the forward-facing wall 340 of the tank 305. The second ribs 375-2, 380-2, 385-2 may be disposed on the side wall 345 (which may be the left-facing wall) of the tank 305. The third ribs 375-3, 380-3, 385-3 may be disposed on the rearward-facing wall 350 of the tank 305 (best seen in FIGS. 3B and 3C ). The fourth ribs 375-4, 380-4, 385-4 may be disposed on the side wall 355 of the tank 305 (which may be the right-facing wall).
[0084] The first reinforcing structure 375, the second reinforcing structure 380, and / or the third reinforcing structure 385 may be formed by fastening their respective component ribs together, for example, by bolting, welding, and / or adhesive bonding. The rib cross-sections may be formed with profiles including z-sections, c-sections, top hats, and / or box cross-sections. At least some of the ribs may be formed with thicknesses ranging from 1.6 mm to 3 mm. At least some of the ribs may be formed with widths ranging from 50 mm to 100 mm. The dimensions of the ribs may be customized to fit the dimensions of the individual tank.
[0085] FIG. 4 is an image of a mounting arrangement 400, according to some embodiments. Reinforcement structures 375, 380, and 385 may be fixed to one or more mounting brackets 410, which may be attached to a vertical support member 415. At least one gusset plate 412 may be welded to the mounting brackets 410 and / or the vertical support member 415 to strengthen the vertical support member 415 against flexure. As an example, FIG. 4 shows the left front corner of tank 300 (as labeled on FIG. 3A ), with reinforcing structures 380-2, 385-2, 380-1, and 385-1 connected to vertical support member 415 via mounting brackets 410. Vertical support member 415 may be an angle section. In some embodiments, vertical support member 415 may be, for example, a V-channel member. In some embodiments, the reinforcing structures 375, 380, and 385 may be fixedly attached to one or more mounting brackets 410 and abut the side walls 340, 345, 350, and 355, without being directly attached to the side walls 340, 345, 350, and 355. This particular configuration may facilitate ease of assembly and / or disassembly. In some embodiments, the reinforcing structures 375, 380, 385 may be fixedly attached to the side walls 340, 345, 350, and 355, either permanently or removably.
[0086] Each of the first ribs 375-1, 380-1, 385-1, the second ribs 375-2, 380-2, 385-2, the third ribs 375-3, 380-3, 385-3, and the fourth ribs 375-4, 380-4, 385-4 may include a mounting bracket 410 in the form of two end caps 420. The end caps 420 may be secured to the ends of each rib perpendicular to the longitudinal axis of the rib. The end caps 420 may be secured to the ribs via welding. Each end cap may include a mating structure such as a bolt-receiving area, a latching mechanism, or a tab-and-slot arrangement. The mounting bracket 410 may include one or more matching and / or corresponding mating structures that interact with mating structures on one or more end caps of one or more ribs. When the mating structures of the mounting bracket 410 engage with the mating structures of the end caps, the reinforcing structures 375, 380, and 385 may be formed and held in place around the tank 300. The reinforcing structures 375, 380, 385 may abut the side walls 340, 345, 350, and 355 of the tank 300 and sit substantially parallel to the bottom panel 310.
[0087] Reinforcement structures 375, 380, and / or 385 may be formed around tank 300 by securing each end of first ribs 375-1, 380-1, and 385-1, second ribs 375-2, 380-2, 385-2, third ribs 375-3, 380-3, and 385-3, and fourth ribs 375-4, 380-4, and 385-4 to respective mounting brackets 410 via respective end caps 420. When formed around tank 300, reinforcement structures 375, 380, and 385 may resist deflection of the walls of vessel 305 when vessel 305 is filled with refrigerant.
[0088] Reinforcing structures 375, 380, and 385 may be positioned at different predetermined distances relative to bottom panel 310. For example, the centerline of first reinforcing structure 375 may be approximately 900 mm from the bottom surface of bottom panel 310, the centerline of second reinforcing structure 380 may be approximately 600 mm from the bottom surface of bottom panel 310, and / or the centerline of third reinforcing structure 385 may be approximately 300 mm from the bottom surface of bottom panel 310.
[0089] The number of reinforcing structures formed around the tank can range from two to four. For example, there can be two, three, or four reinforcing structures formed around the tank. The structures can be evenly spaced across the depth of the tank. For example, a tank with a depth of 1,200 mm can have three reinforcing structures located 300 mm, 600 mm, and 900 mm from the bottom and / or upper edge of the tank, respectively.
[0090] When fully constructed, tank 300 may be approximately 1700 mm long, 800 mm wide, and 1200 mm high. In some embodiments, each tank 300 may be 1000 mm to 3000 mm long. In some embodiments, each tank 300 may be 400 mm to 2000 mm wide. In some embodiments, each tank 300 may be 600 mm to 2000 mm high. During normal operation, each tank 300 may be configured to hold 1,000 to 2,000 L of cooling fluid. Each tank 300 may be configured to hold, for example, approximately 1,400 L of cooling fluid. Tank 300 may be sized to accommodate a particular standard size computing device racking so that there is sufficient space for multiple racking arrangements, multiple computing devices mounted within and / or outside the racking arrangements, cabling for power, data communications, and / or temperature readings, etc. For example, the tank may be sized to house and / or interface with one or more power distribution units (PDUs) for providing electrical power and / or for transmitting and receiving data from computing devices. In some embodiments, the tank 300 may be sized to house two or more particular types of racking, computing devices, and / or cabling. Racking configurations are described in more detail below.
[0091] In some embodiments, the tank 300 may be configured to hold approximately 1200-1400 liters of liquid refrigerant during operation. In some embodiments, the computing devices 103 disposed within the tank 300 may represent up to approximately 10% of the volume of liquid refrigerant held within the tank 300 during operation.
[0092] 3A-3D , the set of first refrigerant conduits 362 and the set of second refrigerant conduits 365 may be positioned between the separation panel 311 and the first sidewall 340. The tank 300 may also include a set of balance conduits 364 for use in isolating the tank 300 when not in use. The set of first refrigerant conduits 362, the set of second refrigerant conduits 365, and the set of balance conduits 364 may contact the first sidewall 340 and the separation panel 311 such that the set of first refrigerant conduits 362, the set of second refrigerant conduits 365, and the set of balance conduits 364 may increase the rigidity of the separation panel 311. As shown particularly in FIG. 3B , the first set of refrigerant conduits 362, the second set of refrigerant conduits 365, and the set of balance conduits 364 act to reduce the span between attachment points of the separation panel 311 when in contact with the first side wall 340 and the separation panel 311, such as when the separation panel 311 is fixedly attached to the second vessel wall 345 and / or the fourth vessel wall 355.
[0093] The first refrigerant conduits 362 may extend from outside the tank 300 to the inside of the vessel 305. For example, a first end of the first refrigerant conduit 362 may be disposed outside the tank 300, while a second end of the first refrigerant conduit 362 may be disposed inside the vessel 305. The first end of the first refrigerant conduit 362 may be located outside the tank 300 between the second reinforcement structure 380 and the third reinforcement structure 385. In some embodiments, the first end of the set of first refrigerant conduits 362 may extend from proximate to the third reinforcement structure 385 on the exterior of the tank 300 through the first sidewall 340 to the interior of the vessel 305. The first end of the first refrigerant conduit 362 may connect to the outlet conduit 152 to transport heated liquid refrigerant from the cooling tank 300, for example, as shown in FIG. 2A . In some embodiments, the set of first refrigerant conduits 362 may extend through the first sidewall 340 and into the return space 313. The set of first refrigerant conduits 362 may extend between the separation panel 311 and the first sidewall 340, through the return space 313, away from the bottom panel 310, and terminate proximally against a portion of the separation panel 311 distal from the bottom panel 310. The set of first refrigerant conduits 362 may include an external connector 367 and an internal connector 368. The external connector 367 and / or the internal connector 368 may be one or more of a threaded end, a flange-compatible end, a latch end, or a ferrule end. The external connector 367 and the internal connector 368 may facilitate connection of the first refrigerant conduits 362 and the outlet conduit 152.
[0094] The balancing conduits 364 may extend from outside the tanks 300 to the interior of the vessel 305. For example, first ends of the balancing conduits 364 may be disposed outside the tanks 300, while second ends of the balancing conduits 364 may be disposed inside the vessel 305. The first ends of the balancing conduits 364 may be located outside the tanks 300 between the second reinforcement structure 380 and the third reinforcement structure 385. The first ends of the balancing conduits 364 for a first one of the tanks 300 may connect to the first ends of the balancing conduits 364 for a second one of the tanks 300, such as an adjacent one of the tanks 300. In some embodiments, the first ends of the set of balancing conduits 364 may extend from proximate to the third reinforcement structure 385 on the exterior of the tanks 300, through the first sidewall 340, and into the interior of the vessel 305. In some embodiments, the set of balance conduits 364 may extend through the first sidewall 340 into the return space 313. The set of balance conduits 364 may extend between the separation panel 311 and the first sidewall 340, through the return space 313, away from the bottom panel 310, and terminate inside the return space 313 proximal to the first rib 375-1. The balance conduits 364 may include an external connector 367 and an internal connector 368. The external connector 367 and / or the internal connector 368 may be one or more of a threaded end, a flange-compatible end, a latch end, or a ferrule end.
[0095] In some embodiments, the balancing conduit 364 may be fluidly connected to one or more balancing conduits of one or more adjacent tank(s) 300. In some embodiments, the balancing conduit 364 may be configured to account for flow rate variations, and therefore liquid refrigerant volume, within and / or between different tanks 300 in the system 100. The volume of liquid refrigerant in the tank 300 may vary by 5% to 10% of the total operating volume over the course of an extended period of operation. For example, if the tank 300 has an operating liquid refrigerant volume of 1,200 L to 1,400 L, the actual volume of liquid refrigerant in the tank 300 may be 1,080 L to 1,580 L.
[0096] In some embodiments, the balance conduit 364 may be configured to isolate the tank 300 from one or more adjacent tanks and / or the remainder of the system 100. To isolate the tank 300 from the remainder of the system 100 and the adjacent tanks, the balance conduit 364 may be sealed using a plug, such as a threaded plug, that is provided between the separation panel 311 and the first side wall 340 and that may engage a threaded end of the balance conduit 364. For example, the first end of the balance conduit 364 (accessible from the exterior of the tank 300) may include at least one of an external connector 367 and an internal connector 368. The plug 900 is shown in FIG. 9. For clarity, FIG. 9 shows the tank 300 without the front wall 340 so that the separation panel 311 and the conduits 362, 364, 365 are visible. For the avoidance of doubt, the front wall 340 would be present if it were present. During operation, the front wall 340 is present. The plug 900 may include a refrigerant conduit plug 910 for the refrigerant conduit 362. The plug 900 may include a balance conduit plug 920 for the balance conduit 364. The plugs 910, 920 may include corresponding mating features 912, 922 configured to engage with an external connector 367 and / or an internal connector 368 to seal the first end of the balance conduit 364 and thereby isolate the tank 300. In some embodiments, the external connector 367 and / or the internal connector 368 include threads configured to engage with corresponding threads on the plug. When the plugs 910, 920 are connected to their respective conduits 362, 364, the openings to the conduits 362, 364 are sealed so that refrigerant in the return space 313 cannot enter the conduits 362, 364. The plugs 910, 920 may cause the openings of the conduits 362, 364 to extend above the top of the separation panel 311 to reduce the likelihood of refrigerant entering the conduits 362, 364. Specifically, the plugs 910, 920 may cause the openings of the conduits 362, 364 to extend above the top of the fluid in the tank 300 to reduce the likelihood of refrigerant entering the conduits 362, 364.
[0097] 3A-3D , in some embodiments, a second set of refrigerant conduits 365 can extend into the vessel 305 from an open portion or opening 306 of the tank distal from the bottom panel 310. In some embodiments, the second set of refrigerant conduits can extend through the return space 313 between the separation panel 311 and the first sidewall 340. The second set of refrigerant conduits 365 can pass through the perforated plate 317, make a substantially right-angle turn, and extend through the inlet space 318 substantially parallel to the bottom panel 310, away from the first sidewall 340. The second set of refrigerant conduits 365 can terminate substantially proximate to the first sidewall 340.
[0098] In some embodiments, tank 300 may include one or more characterized ball valves 360 (not shown in FIGS. 3A-3D, but shown in FIG. 2A) configured to regulate or otherwise control the flow of liquid refrigerant into and / or out of liquid refrigerant flow locations within tank 300 and / or system 100. The characterized ball valves 360 may be fitted to one or more first refrigerant conduits 362 and / or second refrigerant conduits 365; for example, the characterized ball valves 360 may be attached to the conduits 362, 365 via a flange arrangement, a tri-clover / ferrule arrangement, or by welding.
[0099] The characterized ball valve 360 can be configured to change the amount of flow through the valve via a rotation mechanism, where the degree to which the valve handle or tap is rotated directly correlates to the degree of flow impedance. For example, when the valve handle is rotated 50% from an open position toward a closed position, the flow of liquid refrigerant through the valve is reduced by 50%. In another example, when the valve handle is rotated 30% from an open position toward a closed position, 30% of the flow is blocked and 70% is allowed.
[0100] In some embodiments, the tank 300 may be completely or partially covered by an insulating layer. The insulating layer may be configured to reduce heat leakage from the liquid refrigerant contained within the tank 300 and the exterior space in which the tank 300 is located. The insulating layer may include an insulator, such as thermobreak insulation. Stopping or otherwise reducing the amount of thermal energy radiating from the tank 300 may aid in flow calculations, since flow rates throughout the system 100 may be more easily and / or accurately calculated if the temperature of the refrigerant while in the tank 300 is known and / or can be accurately calculated. Reducing heat radiation may also help maintain a comfortable operating temperature in the server room.
[0101] FIG. 5 is an image of an exterior cladding panel 500 according to some embodiments. The cladding panel 500 comprises a sheet defining an exterior surface 510 and an interior surface 520 opposite the exterior surface 510. The interior surface 520 may face a wall of the container 305, while the exterior surface 510 faces away from the wall. The sheet may define at least one aperture 530 extending between the exterior surface 510 and the interior surface 520. The aperture 530 may be configured to allow heat from the container 305 to pass through the cladding panel 500. The aperture 530 may be configured to allow a user to view the container 305 through the aperture 530, for example, for maintenance purposes. The aperture 530 may be configured to allow a user to hold the panel 500. The cladding panel 500 may include a ridge 540 at one end of the panel 500. The ridge 540 may be defined on the interior surface 520 of the panel 500. The ridges 540 may be configured to engage grooves (not shown) of corresponding shape and size on the container 305, thereby allowing the panel 500 to be secured to the container 305. The cladding panel 500 may define mounting apertures for allowing removable fasteners, such as bolts or screws, to secure the panel 500 to the container 305.
[0102] In some embodiments, the tank 300 may include an exterior cladding panel 500. The exterior cladding panel 500 may be secured to the first sidewall 340, the second sidewall 345, the third sidewall 350, and / or the second sidewall 355. The exterior cladding 500 may be formed from stainless steel or any other lightweight, durable, and / or corrosion-resistant material. The tank 300 may include one or more exterior cladding panels 500. The exterior cladding panels 500 may be secured by, for example, welding, bolting, latches, and / or a tab-and-slot arrangement. The exterior cladding panels 500 may be made from 1.6 mm stainless steel. The exterior cladding panels 500 may be powder coated for protection and / or aesthetic purposes. Insulation may be positioned between the exterior cladding panel 500 and at least one of the walls 340, 345, 350, and 355, with each cladding panel 500 and each tank wall spaced apart to accommodate the insulation. The insulation may include, for example, physically cross-linked closed-cell polyolefin foam with factory-applied reinforcing aluminum foil. The insulation may be high-density foam with an aluminum tape backing. The insulation may be sisal-faced high-density foam insulation with reinforcing silver tape. The insulation may be 20 mm thick. The insulation may be added to the outside of the tank 300, with the cladding panel 500 added on top of the insulation. The combination of the insulation and the exterior cladding panel 500 may provide a thermal barrier around the tank 300 that reduces heat loss from the system.
[0103] 6A, 6B, 6C, and 6D are images of a cover 600 for a tank 300 (not shown). The cover 600 may be secured or otherwise positioned over the opening 306 of the tank 300 distal from the bottom surface (e.g., bottom panel 310) of the tank 300, as shown in FIG. 2A. The cover 600 may include a lid portion 610, a cover attachment portion 615, one or more viewing windows 620, one or more actuation mechanisms 625, and / or a cable management aperture 630. The cable management aperture 630 may include a single large aperture as shown in FIGS. 6A and 6B. In some embodiments, the cable management aperture 630 includes multiple apertures as shown in FIGS. 6C and 6D. The lid portion 610 may be hingedly connected to the cover attachment portion 615. In some embodiments, the lid portion 610 may not be connected to the cover attachment portion 615. The cover mounting portion 615 may be secured to the tank 300 by, for example, a bolt arrangement, a fastener arrangement, welding, or a tab-and-slot mechanism. As illustrated by FIG. 6A , the one or more actuation mechanisms 625 may be pneumatic pistons connected to both the lid portion 610 and the cover mounting portion 615. The one or more actuation mechanisms 625 may be configured to assist in opening and / or closing the lid portion 610. In some embodiments, the lid portion 610 may include one or more sight windows 620. The sight windows 620 may be configured to allow inspection of one or more computing devices 103 (not shown) mounted in one or more rack arrangements disposed inside the tank 300. In some embodiments, the sight windows 620 may include glass or acrylic windows, or may not include glass or acrylic at all. In some embodiments, the lid portion 610 may include as many sight windows 620 as there are computing device racks disposed inside the tank 300. In some embodiments, the lid portion 610 may include a single viewing window 620 configured to allow viewing of all computing devices disposed within the interior of the tank 300 .
[0104] 7A, 7B, 7C, 7D, 7E, 7F, and 7G are schematic diagrams of a racking system 700 that may be used to support at least one of the computing devices 103 inside the tank 300, according to some embodiments. FIG. 7A is a perspective view of the racking system 700, with FIG. 7A(1) showing one embodiment of the racking system 700 and FIG. 7A(2) showing another embodiment of the racking system 700. FIG. 7B is a perspective view of the racking system 700 with the computing device 103 disposed therein, with FIG. 7B(1) showing one embodiment of the racking system 700 and FIG. 7B(2) showing another embodiment of the racking system 700. FIG. 7C is a perspective view of the racking system of FIG. 7B disposed within a tank 300 (tank 300 is partially shown for clarity), with FIG. 7C(1) showing one embodiment of racking system 700 and FIG. 7C(2) showing another embodiment of racking system 700. FIG. 7D is a cross-sectional view of tank 300 showing racking system 700 within tank 300, with FIG. 7D(1) showing one embodiment of racking system 700 and FIG. 7D(2) showing another embodiment of racking system 700. FIG. 7E is a front view of racking system 600. FIG. 7F is a plan view of racking system 700, with FIG. 7F(1) showing one embodiment of racking system 700 and FIG. 7F(2) showing another embodiment of racking system 700. FIG. 7G is a plan view of the racking system of FIG. 7F with computing devices 103 disposed therein.
[0105] 7A(1) and 7A(2), a racking system 700 may include rack mounting members 710 and / or rack securing members 715a, 715b, 720a, and 720b. The rack mounting member 710 may be configured to receive one or more computing device mounting members 725 (as shown in FIGS. 7A(2), 7B(1), and 7B(2)) for mounting the computing devices 103. The rack mounting member 710 may be connected to the rack securing members 715a, 715b, 720a, and 720b. The rack securing members 715a, 715b, 720a, and 720b may be disposed within the vessel 305 of the tank 300. Each of the rack securing members 715a, 715b, 720a, 720b can be connected to at least one of the side walls 340, 345, 350, 355 of the vessel 305. Figure 7A includes simplified dashed outlines of the side walls 340, 345, 350, 355 to show their approximate locations relative to the rack securing members 715a, 715b, 720a, 720b. The rack mounting members 710 are spaced apart within the tank 300 to define a bay 730 between each pair of adjacent rack mounting members 710. The bay 730 is configured to receive a computing device 103.
[0106] The rack securing members 715a may be corner members configured to connect to two adjacent side walls. For example, a first one of the rack securing members 715a is configured to connect to side walls 340 and 345, and a second one of the rack securing members 715a is configured to connect to side walls 340 and 355. The rack securing members 715b may be corner members configured to connect to two adjacent side walls. For example, a first one of the rack securing members 715b is configured to connect to side walls 345 and 350, and a second one of the rack securing members 715b is configured to connect to side walls 350 and 355. The rack securing members 715a may be disposed closer to the front of the tank 300 (e.g., front wall 340), while the rack securing members 715b may be disposed closer to the rear of the tank 300 (e.g., rear wall 350). Rack securing member 720a may be configured to connect to sidewall 340, and rack securing member 720b may be configured to connect to sidewall 350. Rack securing members 715a, 715b, 720a, 720b may also be referred to herein as first racking members 715a, 715b, 720a, 720b. Rack securing members 715a, 715b, 720a, 720b may be angled portions. At least one of the angled portions may define a plurality of perforations or slots configured to receive a connector along the length of the angled portion. Rack securing members 715a, 715b may be a first type of angled portion that is different from the angled portions used in 720a, 720b. For example, the angled portions used in rack securing members 715a, 715b may be substantially L-shaped, while the angled portions used in rack securing members 720a, 720b may be substantially U-shaped.
[0107] The rack mounting member 710 may connect to either the rack securing members 715a and 715b or the rack securing members 720a and 720b. The rack mounting member 710 may be a metal plate or sheet defining perforations. The rack mounting member 710 may also be referred to herein as a second racking member 710. Each rack mounting member of the rack mounting member 710 may connect to at least two of the rack securing members 715a, 715b, 720a, and 720b. For example, a first end of the rack mounting member (second racking member) 710 is connected to the rack securing member (first racking member) 715a, and a second end of the rack securing member (second racking member) 710 is connected to the rack securing member (first racking member) 715b.
[0108] In some embodiments, the rack securing members (first rack members) 715a and 715b receive one of the rack mounting members (second rack members) 710. In some embodiments, the rack securing members (first rack members) 720a and 720b receive two of the rack mounting members (second rack members) 710. When connected, the rack mounting member 710 and the rack securing members 715a, 715b, 720a, 720b may increase the structural strength of the tank 300 by forming a support structure for the vessel 305. The support structure may reduce the unsupported span of the tank side walls 340, 345, 350, 355 and / or connect the side walls to each other, thereby resisting deflection of the side walls 340, 345, 350, 355 when the vessel 305 is filled with liquid refrigerant. Tank 300 may be sized to accommodate a racking system configured to mount 900 mm deep computing systems such as servers.
[0109] 7A(2), 7B(1), and 7B(2), rack mounting member 710 may be configured to receive a plurality of computing device mounting members 725. Computing device mounting member 725 may also be referred to herein as third racking member 725.
[0110] 7A(2) and 7B(2), in some embodiments, the computing device mounting member 725 includes a cover plate 726. According to some embodiments as shown in FIG. 7A(2), the cover plate 726 includes a slot and at least one aperture. The cover plate 726 is configured to engage with the rack mounting member (second racking member) 710 and at least one of the associated rack fixing members (first racking members) 715a, 715b, 720a, 720b of the rack mounting member 710. The cover plate 726 may be positioned on top of the rack mounting member 710 to support the rack mounting member 710.
[0111] 7A(2) shows a partially assembled view with one of the cover plates 726 being lowered into position over the rack mounting member 710, as indicated by the bold arrow. The cover plate 726 may receive or support a portion of the computing device 103 when the computing device 103 is received and mounted in the tank 300.
[0112] FIG. 7B(2) shows an assembled view with all of the cover plates 726 in place on the rack mounting members 710. FIG. 7B(2) shows the computing device 103 received in a bay 730 between adjacent second racking members 710. In some embodiments, the computing device 103 comprises a chassis or casing 731. The casing 731 may enclose components 732 of the computing device 103. The components 732 may include a central processing unit (CPU), a graphical processing unit (GPU), random access memory (RAM), and / or a motherboard chipset. The casing 731 may have at least one open end to allow coolant to enter and pass through the casing 731. The casing 731 may have at least one lifting lug 733 connected to the casing 731. The lifting lugs 733 are configured to allow the casing 731 (and the computing device 103 within the casing 731) to be lowered into the tank 300 and positioned in the bay 730, such as by a crane or winch. The lifting lugs 733 may be aligned with the center of gravity of the computing device 103 so that when the casing 731 (and the computing device 103 within the casing 731) is lifted, the casing 731 remains in an upright orientation that allows the casing 731 to be lowered directly into the bay 730 with minimal or no tilt or other angle of realignment for installation. When multiple casings 731 are received in the bay 730, adjacent ones of the casings 731 may abut one another. The casing 731 may include clips 734 configured to engage with the cover plate 726 when the casing 731 is in the bay 730. The clips 734 may be configured to engage with slots in the cover plate 726.
[0113] Referring to FIG. 7B(1), in some embodiments, the computing device mounting member 725 includes guide members 727. The guide members 727 may be positioned to effectively divide the bay 730 into designated spaces for receiving each of the computing devices 103. The guide members 727 may resemble fins or ridges that extend into the bay 730 but do not extend entirely across the bay 730 defined between adjacent rack mounting members 710. Multiple guide members 727 may be installed on the rack mounting member 710 in a vertical configuration corresponding to the number of designated spaces. The guide members 727 are configured to guide the computing devices 103 as they are lowered (via lifting lugs 733) into their designated spaces. The guide members 727 may space the computing devices 103 within the bay 730. The guide members 727 may abut against a casing 731 containing the computing devices 103.
[0114] The computing device mounting members 725 may be configured to interface with the rack mounting members 710 via, for example, a tab-and-slot arrangement, a friction-fit arrangement, and / or a screw-and-fastener arrangement. The rack mounting members 710 may be configured to accept a plurality of different sizes and / or configurations of computing device mounting members 725, such as standard rack unit (RU) computing device racks and / or RU computing devices and / or application-specific integrated circuit (ASIC) computing devices and / or ASIC computing device racking. The racking system 600 may include a plurality of rack units, each rack unit including at least one rack mounting member 710 and at least one pair of rack fastening members 715 a, 715 b, 720 a, 720 b.
[0115] Figure 7C(1) shows a perspective view of tank 300 including racking system 700. Figure 7C shows only a portion of tank 300 to allow for the racking system 700 and computing devices 103 to be visible. Specifically, side walls 345 and 350 are shown, and side walls 340 and 355 have been removed. Separation panel 311 is also not shown.
[0116] 7C(1) shows, in a partially exploded assembly view, one embodiment of a racking system 700. The racking system 700 includes guide members 727 for the computing devices 103. The guide members 727 may contact the perforated plate 317 at the bottom of the container 305.
[0117] Figure 7C(2) is a perspective view of tank 300 from a reverse angle relative to Figure 7C(1). Figure 7C(2) shows another embodiment of a racking system 700 in tank 300, according to some embodiments. This embodiment of tank 300 has a fourth reinforcing structure 390 similar to reinforcing structures 375, 380, 385 described above. Thus, fourth reinforcing structure 390 has ribs 390-1, 390-2 (with sidewall 345 removed, not shown), 390-3 (with sidewall 350 removed, not shown), and 390-4.
[0118] 7D , in some embodiments, the separator panel 311 can define multiple areas configured to allow the rack mounting member 710 and rack support members 715a, 720a, or portions thereof, to pass through. The rack support members 715a, 720a can be fixedly mounted to the first wall 340 and can include mating structures 740a. The rack mounting member 710 can include corresponding mating structures 740b configured to interface with the mating structures 740a. The mating structures 740a, 740b can pass through the areas 735 and interface to secure the rack support member 710 to the rack support members 720a, 720b.
[0119] Figure 7D(1) is a cross-sectional view of the tank 300 parallel to the sidewall 355 of the tank 300 at approximately the location labeled in Figure 3B. Figure 7D(1) shows one embodiment of the racking system 700 including a third racking member 725, specifically a guide member 727. The computing device 103 is vertically aligned by the guide member 727.
[0120] Figure 7D(2) is a cross-sectional view of the tank 300 from a location similar to Figure 7D(1), except that the refrigerant conduit 365 is shown. Figure 7D(2) shows an embodiment of the racking system 700 with a third racking member 725, specifically a cover plate 726. The computing devices 103 abut against the cover plate 726. The computing devices 103 may be spaced apart from the perforated plate 317 so as not to cover the perforations and potentially impede the flow of refrigerant from the inlet space 318 to the cooling space 312.
[0121] 7B and 7C , each computing device mounting member 725 may have an adjacent corresponding computing device mounting member 725. A computing device 103 may be received within each of the corresponding computing device mounting members 725. In some embodiments, the corresponding computing device mounting members 725 may have similar configurations. In some embodiments, the corresponding computing device mounting members 725 may have different configurations to accommodate asymmetric computing devices. In some embodiments, the computing device mounting member 725 may include one or more mounting points (not shown) for interaction with the computing device 103.
[0122] 7C, 7D, and 7E, the computing system 103 may be mounted in a vertical orientation, i.e., the longitudinal axis of the computing device 103 may be substantially parallel to the first sidewall 340.
[0123] 7C, 7D, and 7E, the end of computing device 103 distal to bottom plate or panel 310 may be positioned substantially below opening 306 or an upper portion of tank 300 distal from bottom plate or panel 310. This configuration is to ensure that computing device 103 is easily and / or continuously immersed in the liquid coolant.
[0124] 7F(1) is a plan view showing one embodiment of a racking system 700 in a tank 300. The embodiment of the racking system 700 shown includes a third racking member 725, specifically a guide member 727. FIG. 7G shows the same view with a computing device 103 within the tank 300.
[0125] 7F(2) is a plan view illustrating one embodiment of a racking system 700 in a tank 300. The embodiment of the racking system 700 shown includes a third racking member 725, specifically a cover plate 726.
[0126] In some embodiments, racking system 700 is connected to at least one of side walls 340, 345, 350, 355. In some embodiments, racking system 700 is connected to separation panel 311. In some embodiments, racking system 700 is connected to both separation panel 311 and at least one of side walls 340, 345, 350, 355. For example, in embodiments in which separation panel 311 is removable, racking system 700 is connected to side wall 340.
[0127] 8 is a perspective view of a cable management system 800, according to some embodiments. Cable management system 800 may include brackets 810, cable runs 815, and rack cable runs 820. Cable runs 820 may run from computing devices 103 to brackets 810, through brackets 810, and to a centrally located control device, such as control device 130. In some embodiments, cable runs may need to be routed through rack cable runs 820 and into cooling space 312.
[0128] The bracket 810 may be 3D printed or injection molded from plastic and / or formed from machined and / or formed metal such as stainless steel. The bracket 810 may be configured to route cabling 820 from a computing device along one or more side walls 340, 345, 350, and / or 355, through the cable management aperture 630, and to and / or through and out of the tank 300.
[0129] Figure 9 has been briefly described above with respect to the use of plugs 910, 920 to isolate the tank 300. Figure 9 will now be described in more detail. Figure 9 shows the inside of the tank 300 with an inlet conduit 365, an outlet conduit 362, and a balance conduit 364, according to some embodiments.
[0130] The balancing conduits 364 may extend from a location near the bottom of the tanks 300 to a location at least partway up the tanks 300 where each tank balancing conduit 300 may have an open end (e.g., a threaded end) so that any system refrigerant above the open ends of the balancing conduits 364 may freely enter and exit the balancing conduits 364 to facilitate balancing of the system refrigerant between the multiple tanks 300 in the system 100.
[0131] The outlet conduits 362 may extend from a location near the bottom of the tank 300 to a location at least partway up the tank 300 where each inlet conduit 362 may have an open end so that any system refrigerant above the open end may freely enter the outlet conduits 362.
[0132] To fluidly isolate the tank from the connected tank, a closure member 910 or 920 may be coupleable to the open end of each of the balance conduit 364 and the outlet conduit 362. According to some embodiments, the closure member 910 and / or 920 may be a plug 910, 920. In some embodiments, the closure member 910 and / or 920 may be threaded to be threaded into the open end of the conduit 362, 364. According to some embodiments, the closure member 910 and / or 920 may be a section of pipe of sufficient length to be coupled to the open end of the outlet conduit 362 or the balance conduit 364 such that when the closure member is in place, the open end of the pipe section is above the level of liquid refrigerant in the tank 300.
[0133] When positioned at the open end of the balancing conduit 364, the closure member 920 can provide a seal that fluidly isolates the balancing conduit 364 from the interior volume of the tank 300. The tank 300 can then be vented via the inlet conduit 365 and / or outlet conduit 362 and removed, replaced, or repaired as needed.
[0134] Similarly, when positioned at the open end of the outlet conduit 362, the closure member 910 provides a seal that fluidly isolates the outlet conduit 362 from the interior volume of the tank 300, thus branching the outlet conduit 152 from the interior volume of the tank 300. The tank 300 can then be vented via the inlet conduit 365 and / or balance conduit 364 and removed, replaced, or repaired as needed.
[0135] In some embodiments, a cooling system for cooling computing device 100 may implement techniques described in PCT Publication No. PCT / AU2021 / 051215.
[0136] A cooling system configured as described in some of the embodiments may allow multiple cooling tanks to be connected to a single refrigerant distribution system, which in some embodiments may have only a single pump system and a single radiator. When multiple tanks are connected to a single refrigerant distribution system, it may be important to control the pressure and supply of refrigerant to each tank to avoid imbalances in the amount of refrigerant among the system's components. Such imbalances, in some embodiments, may cause the tanks to overflow if not corrected. Thus, the described piping system can help evenly distribute refrigerant among the tanks in a system with multiple cooling tanks.
[0137] It will be understood by those skilled in the art that numerous variations and / or modifications may be made to the above-described embodiments without departing from the broad overall scope of the present disclosure, and the present embodiments are, therefore, to be considered in all respects as illustrative and not restrictive.
Claims
1. 1. A cooling tank for cooling a computing device, the cooling tank comprising: a plurality of first racking members configured to engage at least one sidewall of the container; a plurality of second racking members configured to engage the plurality of first racking members; a plurality of third racking members configured to engage with the plurality of second racking members; the plurality of third racking members are adapted to receive one or more computing devices such that when the one or more computing devices are received by the plurality of third racking members, the one or more computing devices are mounted within the container; a cooling tank, wherein when the plurality of first racking members engage with at least one side wall of the container and when each of the plurality of second racking members engages with at least two of the plurality of first racking members, the plurality of first racking members and the plurality of second racking members form a support structure within the container, the support structure resisting deflection of at least one side wall of the container when the container contains a liquid refrigerant.
2. 2. The refrigerant tank of claim 1, wherein the container further comprises a separation panel disposed proximate to a first side wall of the container, the separation panel defining a plurality of fenestrations and defining a return zone between the first side wall and the separation panel.
3. 3. The cooling tank of claim 1, wherein each of the plurality of first racking members comprises one or more first mating structures, and each of the plurality of second racking members comprises one or more second mating structures, the one or more second mating structures being configured to interact with the one or more first mating structures.
4. The cooling tank of claim 3 , wherein the one or more first mating structures and the one or more second mating structures are configured to interact through the plurality of fenestrations defined by the separation panel.
5. a first edge of the plurality of third racking members being substantially parallel to a bottom panel of the container; each of the one or more computing devices includes at least two support brackets configured to abut the first edges of the plurality of third racking members; 5. The cooling tank of claim 1, wherein when the at least two support brackets of each of the one or more computing devices abut the first edges of the plurality of third racking members, the one or more computing devices are suspended substantially vertically from the bottom panel.
6. 6. The cooling tank of claim 1, wherein each of the plurality of third racking members defines a guide portion configured to abut one or more computing devices when the one or more computing devices are installed in the rack.
7. The cooling tank of any one of claims 1 to 6, wherein the plurality of second racking members are compatible with one or more of standard rack unit rack members, standard rack unit computing devices, and / or ASIC computing devices.
8. 8. The cooling tank of claim 1, wherein one or more of the plurality of first racking members, the plurality of second racking members, and / or the plurality of third racking members comprises one or more cable support structures.
9. 9. The cooling tank of claim 1, wherein the plurality of second racking members and / or the plurality of third racking members are further configured to route one or more cables configured to engage with the one or more computing devices.
10. 1. A cooling tank for cooling a computing device, comprising: a container having at least four side walls, the side walls defining at least four container edges, the container edges being substantially perpendicular to a container bottom surface, and comprising at least one mounting bracket, each of the at least one mounting bracket comprising at least one first mounting structure; a plurality of support structures, each support structure comprising a set of reinforcing members in contact with the at least four side walls, each of the plurality of support structures configured to extend substantially around a periphery of the container defined by the side walls, parallel to the container bottom surface; each reinforcement member including at least one second mating structure configured to cooperate with the at least one first mounting structure; A cooling tank, wherein the reinforcing member substantially resists deflection of the vessel wall when the vessel contains a liquid refrigerant.
11. 11. The cooling tank of claim 10, wherein the tank comprises three support structures, each support structure comprising four reinforcing members.
12. 12. The cooling tank of claim 10 or 11, wherein the refrigerant tank comprises a separator panel disposed in the interior space of the vessel, the separator panel configured to modify flow characteristics of the liquid refrigerant.
13. 13. The cooling tank of any one of claims 10 to 12, wherein the cooling tank comprises a first set of refrigerant conduits, a second set of refrigerant conduits, and a balance set of conduits configured to transport liquid refrigerant to and / or out of the vessel.
14. 14. The cooling tank of claim 13, wherein one of the at least four vessel walls is a first vessel wall, and the first set of refrigerant conduits, the second set of refrigerant conduits, and the balance set of conduits extend between the first vessel wall and the separation panel.
15. 15. The cooling tank of claim 13 or 14, wherein the first set of refrigerant conduits, the second set of refrigerant conduits, and the balancing set of conduits are configured to transport liquid refrigerant into and / or out of the vessel.
16. 16. A cooling tank according to any one of claims 13 to 15, wherein the set of balancing conduits is further configured to isolate the tank from one or more connected tanks and / or conduits.
17. 17. The cooling tank of any one of claims 10 to 16, further comprising at least one set of overflow conduits, said overflow conduits being in fluid communication with one or more adjacent tanks.
18. A cooling tank according to any one of claims 10 to 17, wherein at least some of the reinforcing members forming at least one of the support structures have a thickness in the range of 1.6 mm to 3 mm.
19. A cooling tank according to any one of claims 10 to 18, wherein at least some of the reinforcing members forming at least one of the support structures have a width in the range of 50mm to 100mm.
20. A cooling tank according to any one of claims 10 to 19, wherein the support structures are positioned so as to be evenly spaced apart from one another across at least one of the side walls.
21. A cooling tank according to any one of claims 10 to 20, wherein the tank has a working volume of liquid refrigerant of between 1200 litres and 1400 litres.
22. The cooling tank of any one of claims 1 to 21, wherein the tank further comprises insulation disposed on one or more of the exterior surfaces of the at least four side walls.
23. A cooling tank according to any preceding claim, wherein the tank further comprises at least one exterior cladding panel.
24. The cooling tank of any preceding claim, wherein the tank further comprises a plurality of cable routing members.
25. The refrigerant tank further comprises a cover disposed over an opening of the container distal from the bottom panel, the cover comprising: A body portion, the body portion comprising: a fixing portion for fixing the body portion to the container; one or more cable fenestrations, and a body portion including one or more closure control mechanisms; a lid portion hingedly connected to the body portion, the lid portion comprising one or more viewing windows; A cooling tank according to any preceding claim, wherein the one or more closure control mechanisms are configured to resist movement of the lid portion from an open position to a closed position.
26. 27. A cooling tank according to any one or more of the preceding claims, further comprising one or more computing devices and a volume of liquid refrigerant.
27. 1. A system for cooling a computing device, comprising: A plurality of cooling tanks according to any one of claims 1 to 26; A heat exchanger; A heat sink; at least one liquid refrigerant pump; a volume of liquid refrigerant; a plurality of inlet conduits configured to convey the volume of liquid refrigerant from the at least one liquid refrigerant pump to the plurality of cooling tanks; a plurality of outlet conduits configured to convey the volume of liquid refrigerant from the plurality of cooling tanks to the heat exchanger.
28. 1. A cooling tank for cooling a computing device, the cooling tank comprising: a container configured to receive a refrigerant in a cavity of the container, the container comprising a bottom panel and a plurality of side walls extending from the bottom panel, two of the side walls being disposed opposite one another; a separation panel disposed within the vessel, the separation panel connected to (i) the opposing side walls and (ii) the bottom panel so as to divide the vessel cavity into a cooling space and a return space; a perforated panel disposed near the bottom panel of the vessel and connected to (i) the opposing side walls and (ii) the separator panel to separate an inlet space from the cooling space; a racking system configured to support the computing devices within the cooling space; a refrigerant inlet conduit configured to discharge the refrigerant into the inlet space; a refrigerant outlet conduit disposed within the return space and extending out from the vessel; perforations defined in the perforated panel are configured to allow passage of the refrigerant from the inlet space to the cooled space to cool the computing device within the cooled space; A cooling tank, wherein a top portion of the separation panel is disposed farther from the bottom panel than an inlet of the refrigerant outlet conduit.
29. 30. The cooling tank of claim 28, wherein the inlet of the refrigerant outlet conduit is configured to receive a plug.
30. 30. The cooling tank of claim 29, wherein the plug defines a second inlet to the refrigerant outlet conduit, the second inlet configured to be disposed farther from the bottom panel compared to a top portion of the separation panel.
31. 31. The cooling tank of claim 30, wherein the racking system comprises a cover plate configured to receive a top portion of one of the computing devices, the top portion being below the top portion of the separation panel.
32. 32. The cooling tank of any one of claims 28 to 31, wherein the racking system is connected to one or both of: (i) the separation panel; and (ii) at least one of the plurality of side walls to provide structural reinforcement for the vessel.
33. A cooling tank according to any one of claims 28 to 32, wherein the refrigerant inlet conduit is disposed within the return space and extends into the inlet space through an aperture in the separation panel.