Cooperative control method suitable for intelligent calculation center server and cold plate type liquid cooling system
By establishing a real-time power consumption model and optimization method, we coordinate the server of the intelligent computing center and the cold plate liquid cooling system, the supercooling problem of the intelligent computing center is solved, energy efficiency and stability are improved, and the precise matching of cooling capacity and heat dissipation is achieved.
Patent Information
- Application Number
- CN202410937907.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-12
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2044-07-12
AI Technical Summary
The supercooling problem of the Intelligent Computing Center leads to waste of energy consumption. The existing cold plate liquid cooling system is difficult to dynamically match the server's heat dissipation changes, and the regulation of a single branch valve can easily cause drastic changes in the pipeline flow, affecting stability.
By obtaining IT system scheduling data and liquid cooling system data, a real-time server power consumption model, cooling tower power consumption model and water pump power consumption model are established, and real-time joint and timing optimization methods are adopted to deploy virtual machines and cold plate liquid cooling for cold plates. The system carries out collaborative control to optimize the flow rate of the CDU water pump and valve opening to achieve accurate matching between the server and the cold plate liquid cooling system.
It improves the overall energy efficiency and operating stability of the intelligent computing center, reduces the supercooling capacity, and achieves the improvement of cooling capacity utilization efficiency and optimization of energy consumption.
Smart Images

Figure CN118915889A_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of liquid cooling control of intelligent computing centers, and specifically, relates to a collaborative control method suitable for intelligent computing center servers and cold plate liquid cooling systems. Background Art
[0002] As the infrastructure of artificial intelligence technology, the intelligent computing center has been in a stage of rapid development in recent years. Compared with traditional data centers, the power density of the intelligent computing center is higher, and its single rack power can reach more than 40kW, so cold plate liquid cooling systems are often used for cooling. Compared with the servers in the general computing center, the power of the servers in the intelligent computing center changes extremely quickly, but the existing control strategy fails to form an effective coordination between the server and the cooling system, resulting in a serious overcooling problem in the intelligent computing center, causing a huge waste of energy.
[0003] In order to improve the precise cooling capacity of the cold plate liquid cooling system, an effective method currently used is to add electric valves to the inlet / outlet water pipes of the end rack / server of the secondary loop (micromodule loop), and based on the server temperature prediction, the precise control of the cooling capacity is achieved through the linkage of the liquid cooling distribution unit (CDU) and the valve. However, since the length of the secondary loop pipeline is usually short and its hydraulic characteristics are relatively complex, the valve control of a single branch can easily cause drastic changes in the flow of each branch of the entire pipeline network, thus affecting the safety and stability of the intelligent computing center. In addition, due to the limitations of fluid distribution and thermal capacity characteristics, the cooling supply of the liquid cooling system is difficult to dynamically match the changes in the heat dissipation of each intelligent computing server (equipped with GPU). To this end, it is necessary to explore the collaborative control technology of the server and the cold plate liquid cooling system. Summary of the invention
[0004] The present invention provides a collaborative control method applicable to an intelligent computing center server and a cold plate liquid cooling system, so as to solve the technical problem of overcooling that is prone to occur in energy-saving scheduling of the intelligent computing center, thereby improving the overall energy efficiency and operation stability of the intelligent computing center.
[0005] To solve the above technical problems, the embodiments of the present invention adopt the following technical solutions:
[0006] The embodiment of the present invention provides a collaborative control method applicable to an intelligent computing center server and a cold plate liquid cooling system, comprising the following steps:
[0007] Step 10: Obtain IT system scheduling data and liquid cooling system data of the intelligent computing center within a preset time period, and establish a server real-time power consumption model, a cooling tower power consumption model, a water pump power consumption model, and a server temperature rapid prediction model respectively;
[0008] Step 20, based on the server real-time power consumption model, cooling tower power consumption model, water pump power consumption model and server temperature rapid prediction model, adopt an optimization method combining real-time joint and timing sequence to coordinately control virtual machine deployment and cold plate liquid cooling system.
[0009] As a further improvement of an embodiment of the present invention, the IT system scheduling data includes virtual machine CPU resource requirements, virtual machine GPU resource requirements, mapping relationship between virtual machines and servers, CPU utilization rate of each server, GPU utilization rate of each server, real-time power consumption of each server and chip temperature of each server; the liquid cooling system data includes the flow rate of each water pump on the primary side, the power consumption of each water pump on the primary side, the opening degree of each valve on the primary side, the flow rate of each CDU water pump, the power consumption of each CDU water pump, the outdoor wet-bulb temperature, the inlet and outlet water temperature difference of each cooling tower, the approximation degree of each cooling tower, the power consumption of each cooling tower and the flow rate of each cooling tower.
[0010] As a further improvement of the embodiment of the present invention, in step 10, a real-time power consumption model of the server of the intelligent computing center is established according to the IT system scheduling data;
[0011] Specifically include:
[0012] Step 101, filtering out power consumption data of each server at different CPU and GPU usage rates from IT system scheduling data;
[0013] Step 102, establishing a server static power consumption matrix according to the power consumption data of each server when the CPU and GPU usage rates are 0;
[0014] Step 103: According to the data of the change of the real-time power consumption of each server with the CPU usage rate, a multiple linear regression method is used to fit the conversion coefficient of the CPU usage rate and the dynamic power consumption of each server, so as to form a conversion coefficient matrix of the CPU usage rate and the dynamic power consumption; according to the data of the change of the real-time power consumption of each server with the GPU usage rate, a multiple linear regression method is used to fit the conversion coefficient of the GPU usage rate and the dynamic power consumption of each server, so as to form a conversion coefficient matrix of the GPU usage rate and the dynamic power consumption;
[0015] Step 104, combining the server static power consumption matrix, the conversion coefficient matrix of CPU usage and running power consumption, and the conversion coefficient matrix of GPU usage and running power consumption, to obtain the real-time power consumption model of the intelligent computing center server shown in formula (1):
[0016] P PM (t) = P SC (t)+u VM,CPU (t)*MM VM→PM (A(t),F(t))*f h,CPU +u VM,GPU (t)*MMVM→PM (A(t),F(t))*f h,GPU
[0017] Formula (1)
[0018] Where P PM (t) represents the server real-time power consumption matrix, P SC (t) represents the server static power consumption matrix, u VM,CPU (t) represents the CPU resource requirement matrix of the virtual machine, MM VM→PM (A(t), F(t)) represents the mapping matrix between virtual machines and servers, A(t) represents the virtual machine real-time deployment matrix, F(t) represents the virtual machine migration matrix, u VM,CPU (t)*MM VM→PM (A(t), F(t)) represents the CPU usage of each server, f h,CPU Represents the conversion coefficient matrix between CPU utilization and dynamic power consumption, u VM,GPU (t) represents the GPU resource requirement matrix of the virtual machine, u VM,GPU (t)*MM VM→PM (A(t), F(t)) represents the GPU utilization rate of each server, f h,GPU A conversion coefficient matrix representing GPU utilization and dynamic power consumption.
[0019] As a further improvement of the embodiment of the present invention, in step 10, a cooling tower power consumption model shown in formula (2) is established based on the liquid cooling system data:
[0020]
[0021] Where P T (t) represents the real-time power consumption of the cooling tower, P T,e Indicates the rated power consumption of the cooling tower, ΔT T (t) represents the real-time temperature difference between the inlet and outlet water of the cooling tower, ΔT T,e Indicates the rated operating temperature difference of the cooling tower inlet and outlet water, T app (t) represents the real-time approximation of the cooling tower, T app,e Indicates the approximation degree of the rated working condition of the cooling tower, T wb (t) represents the outdoor wet-bulb real-time temperature, T wb,e Indicates the outdoor wet-bulb rated operating temperature, m cw (t) represents the real-time flow rate of the cooling tower, m cw,e represents the rated operating flow rate of the cooling tower, and a, b, c, d, e, f, g, h, i, j, k, l, m, n, and o represent the fitting coefficients of each order term respectively.
[0022] As a further improvement of the embodiment of the present invention, in step 10, based on the liquid cooling system data, a water pump power consumption model shown in formula (3) is established for the primary side water pump and each CDU water pump:
[0023]
[0024] Where P pump (t) represents the real-time power consumption of the water pump, m(t) represents the real-time flow rate of the water pump, and m des Indicates the rated operating flow rate of the pump, P pump,des represents the rated power consumption of the pump, b1, b2, and n represent the fitting coefficients respectively.
[0025] As a further improvement of the embodiment of the present invention, in step 10, a server temperature rapid prediction model is established based on IT system scheduling data and liquid cooling system data;
[0026] Specifically include:
[0027] Step 131, filtering out the mapping relationship between virtual machines and servers, virtual machine CPU resource requirements, virtual machine GPU resource requirements, and the maximum temperature of each server chip from the IT system scheduling data, and filtering out the primary side water pump flow, primary side water pump power consumption, primary side valve opening, each CDU water pump flow, each CDU water pump power consumption, outdoor wet bulb temperature, each cooling tower inlet and outlet water temperature difference, each cooling tower approximation, and each cooling tower power consumption from the liquid cooling system data to form a modeling data set;
[0028] Step 132, based on the modeling data set, the water pump flow of each CDU, the outdoor wet-bulb temperature, the approximation degree of each cooling tower, the water pump flow of each primary side, the opening of each valve on the primary side, the CPU utilization rate of each server and the GPU utilization rate of each server are used as input variables of the convolutional neural network model, and the maximum chip temperature of each server is used as the output variable of the convolutional neural network model. The convolutional neural network model is trained to obtain a server temperature rapid prediction model.
[0029] As a further improvement of the embodiment of the present invention, in step 20, an optimization method combining real-time association and timing sequence is adopted to coordinately control the virtual machine deployment and the cold plate liquid cooling system, including:
[0030] Step 21: When the cloud platform receives a new virtual machine deployment request, it randomly selects a deployable intelligent computing micro-module as the deployment micro-module, and jointly optimizes the deployment position of the new virtual machine in the deployment micro-module and the flow of each CDU pump corresponding to the deployment micro-module, so as to minimize the sum of the power consumption of the server of the deployment micro-module and the corresponding CDU pumps;
[0031] Step 22: At each given moment, first migrate the virtual machines running on each server as a whole to minimize the number of intelligent computing micro-modules turned on; then optimize the flow rate of each CDU pump, the flow rate of each pump in the primary loop, the opening degree of each valve on the primary side, and the proximity of each cooling tower to minimize the total energy consumption of the cold plate liquid cooling system.
[0032] As a further improvement of the embodiment of the present invention, the step 21 specifically includes:
[0033] Step 211, when the cloud platform receives the deployment request of the new virtual machine, it traverses the remaining CPU resources and GPU resources of all active servers according to the CPU resource requirements and GPU resource requirements of the new virtual machine to find a server available for deployment;
[0034] Step 212: If there are servers available for deployment, the intelligent computing micro-module where the servers available for deployment are located is used as the deployment micro-module for the new virtual machine deployment, and the servers available for deployment are used as the optimization variables for the new virtual machine deployment, and step 213 is executed; if the remaining CPU resources and GPU resources of the active servers in all intelligent computing micro-modules cannot deploy new virtual machines, a smart computing micro-module with a dormant server is randomly selected as the deployment micro-module, a dormant server in the deployment micro-module is randomly turned into an active state, a new virtual machine is deployed, and step 214 is executed;
[0035] Step 213, with the optimization goal of achieving the lowest total power consumption of the deployed micromodule after the new virtual machine is deployed, with the optimization constraints that the sum of the used resources of all virtual machines running on each server does not exceed the total rated resources of the server, and the maximum temperature of each server chip does not exceed the preset temperature threshold, a genetic algorithm is used to jointly optimize the deployment position of the new virtual machine deployed micromodule and the water pump flow in each CDU corresponding to the deployed micromodule, so as to obtain the optimal real-time deployment position of the virtual machine and the optimal water pump flow of each CDU; the cloud platform implements the deployment of the new virtual machine according to the optimal real-time deployment position of the virtual machine, and the cold plate liquid cooling system controls the flow of each CDU water pump corresponding to the deployed micromodule according to the optimal water pump flow of each CDU;
[0036] Step 214, with the optimization goal of minimizing the sum of the power consumption of each CDU water pump corresponding to the deployed micromodule after the new virtual machine is deployed, and with the constraint that the maximum temperature of each server chip cannot exceed the preset temperature threshold, a genetic algorithm is used to optimize the flow of each CDU water pump corresponding to the deployed micromodule to obtain the optimal flow of each CDU water pump; the cold plate liquid cooling system controls the flow of each CDU water pump corresponding to the deployed micromodule according to the optimal flow of each CDU water pump.
[0037] As a further improvement of the embodiment of the present invention, the step 22 specifically includes:
[0038] Step 221, at a given moment, calculate the minimum number of active servers required based on the sum of the number of all virtual machines running on all servers in the intelligent computing center and their resource requirements;
[0039] Step 222: According to the required minimum number of active servers, select servers as active servers for the next period according to the order of the intelligent computing micro-module numbers, the order of the rack numbers in each intelligent computing micro-module, and the order of the server numbers on each rack, until the number of selected servers reaches the minimum number of active servers;
[0040] Step 223, according to the load balancing strategy, evenly migrate the existing virtual machines to the selected active servers; hibernate the idle servers;
[0041] Step 224, with the minimum total power consumption of the cold plate liquid cooling system as the optimization goal, and with the maximum temperature of each server chip not exceeding the preset temperature threshold as the constraint, a genetic algorithm is used to optimize the flow rate of each CDU water pump, the flow rate of each primary side water pump, the opening degree of each primary side valve, and the approximation degree of each cooling tower, to obtain the optimal flow rate of each CDU water pump, the optimal flow rate of each primary side water pump, the optimal opening degree of each primary side valve, and the optimal approximation degree of each cooling tower;
[0042] Step 225, the cold plate liquid cooling system regulates the flow of each CDU water pump according to the optimal flow of each CDU water pump, regulates the flow of each primary side water pump according to the optimal flow of each primary side water pump, regulates the opening of each primary side valve according to the optimal opening of each primary side valve, and regulates the approach degree of each cooling tower according to the optimal approach degree of each cooling tower.
[0043] Compared with the prior art, the technical solution of the present invention has the following beneficial effects:
[0044] The present invention provides a collaborative control method for the server and cold plate liquid cooling system of the intelligent computing center. First, the IT system scheduling data and liquid cooling system data of the intelligent computing center within a preset time period are obtained, and a server real-time power consumption model, a cooling tower power consumption model, a water pump power consumption model and a server temperature rapid prediction model are established respectively; then in the control stage, when real-time deployment optimization is adopted, the deployment position of the new virtual machine in the deployment micromodule and the corresponding CDU water pump flow are jointly optimized to improve the real-time matching degree between the server heat dissipation and the secondary loop cooling capacity distribution in the deployment micromodule, so as to reduce the overcooling in the deployment micromodule, thereby realizing the deployment of a single virtual machine. The sum of the power consumption of the server and CDU water pump is the lowest; when using timed sequence optimization, the virtual machines running on each server are first migrated as a whole at a given time node to minimize the number of intelligent computing micro-modules turned on. On this basis, the flow rate of each CDU water pump, the flow rate of each water pump in the primary loop, the opening degree of each valve on the primary side and the proximity of each cooling tower are optimized to achieve the lowest total energy consumption of the cold plate liquid cooling system, and promote the timing high matching between the heat dissipation of the server and the cold distribution of the secondary loop, thereby further improving the cold utilization efficiency of the intelligent computing center; through the coordination of real-time joint optimization and timed sequence optimization, the overall energy efficiency and operation stability of the intelligent computing center can be improved. BRIEF DESCRIPTION OF THE DRAWINGS
[0045] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the embodiments of the present invention will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative work.
[0046] Figure 1 It is a structural module diagram of an intelligent computing center to which the method according to the embodiment of the present invention is applicable;
[0047] Figure 2 The embodiment of the present invention is applicable to the collaborative control method of the intelligent computing center server and the cold plate liquid cooling system;
[0048] Figure 3 is a flow chart of real-time joint optimization in the method of an embodiment of the present invention;
[0049] Figure 4 It is a flow chart of timing sequence optimization in the method of the embodiment of the present invention. DETAILED DESCRIPTION
[0050] The technical solution of the present invention is described in detail below in conjunction with the accompanying drawings.
[0051] The embodiment of the present invention provides a collaborative control method applicable to an intelligent computing center server and a cold plate liquid cooling system, which is applied to Figure 1 In the intelligent computing center shown in the figure. The intelligent computing center includes an intelligent computing micro-module and a cold plate liquid cooling system. The cold plate liquid cooling system is divided into a primary loop (covering the loop part from the cooling tower to each CDU) and a secondary loop (the loop from each CDU to each server). Among them, the primary loop includes a cooling tower and a primary water pump, and there is a one-to-one correspondence between the cooling tower and the primary water pump (by adjusting each primary water pump, the flow of the corresponding cooling tower can be controlled). In addition, electric valves are provided on the return water pipes of each branch of the primary loop, and the opening of each valve can be adjusted as needed. The secondary loop is the loop from each CDU to each server, which is composed of multiple intelligent computing micro-module loops. Due to the limited length of the intelligent computing micro-module loop, hydraulic imbalance is not avoided, and electric regulating valves are usually not set in its loop. Therefore, its loop flow can only be adjusted by the water pump in the CDU, and it is difficult to achieve accurate distribution of cooling capacity.
[0052] The embodiment of the present invention provides a collaborative control method applicable to an intelligent computing center server and a cold plate liquid cooling system, such as Figure 2 As shown, the following steps are included:
[0053] Step 10, obtain the IT system scheduling data and liquid cooling system data of the intelligent computing center within a preset time period; establish a real-time power consumption model of the server of the intelligent computing center based on the IT system scheduling data; establish a cooling tower power consumption model and a water pump power consumption model of the intelligent computing center based on the liquid cooling system data; establish a rapid prediction model of the server temperature of the intelligent computing center based on the IT system scheduling data and the liquid cooling system data.
[0054] Step 20, based on the server real-time power consumption model, cooling tower power consumption model, water pump power consumption model and server temperature rapid prediction model, adopt an optimization method combining real-time joint and timing sequence to coordinately control virtual machine deployment and cold plate liquid cooling system.
[0055] In the above step 10, IT system scheduling data is obtained from the scheduling data stored in the cloud platform. IT system scheduling data includes virtual machine CPU resource requirements, virtual machine GPU resource requirements, mapping relationship between virtual machines and servers, CPU utilization rate of each server, GPU utilization rate of each server, real-time power consumption of each server and chip temperature of each server. Liquid cooling system data is obtained from the management system of the cold plate liquid cooling system. Liquid cooling system data includes the flow rate of each water pump on the primary side, the power consumption of each water pump on the primary side, the opening of each valve on the primary side, the flow rate of each CDU water pump, the power consumption of each CDU water pump, the outdoor wet bulb temperature, the inlet and outlet water temperature difference of each cooling tower, the approximation of each cooling tower, the power consumption of each cooling tower and the flow rate of each cooling tower. Preferably, the preset time period is not less than 24 hours.
[0056] In the above step 10, a server real-time power consumption model is established based on IT system scheduling data using a matrix modeling method.
[0057] Specifically include:
[0058] Step 101 : Filter out the power consumption data of each server at different CPU and GPU usage rates from IT system scheduling data.
[0059] Step 102: Establish a server static power consumption matrix based on the power consumption data of each server when the CPU and GPU usage rates are 0.
[0060] Step 103, based on the data of the change of the real-time power consumption of each server with the CPU usage rate, a multivariate linear regression method is used to fit the conversion coefficient of the CPU usage rate and dynamic power consumption (under the standard working condition of the server, the real-time power consumption minus the static power consumption is the dynamic power consumption) of each server, and a conversion coefficient matrix of CPU usage rate and dynamic power consumption is formed. Based on the data of the change of the real-time power consumption of each server with the GPU usage rate, a multivariate linear regression method is used to fit the conversion coefficient of the GPU usage rate and dynamic power consumption of each server, and a conversion coefficient matrix of GPU usage rate and dynamic power consumption is formed.
[0061] Step 104, combining the server static power consumption matrix, the conversion coefficient matrix of CPU usage and running power consumption, and the conversion coefficient matrix of GPU usage and running power consumption, to obtain the real-time power consumption model of the intelligent computing center server shown in formula (1):
[0062] P PM (t) = P SC (t)+u VM,CPU (t)*MM VM→PM (A(t),F(t))*f h,CPU +u VM,GPU (t)*MM VM→PM (A(t),F(t))*f h,GPU
[0063] Formula (1)
[0064] Where P PM (t) represents the server real-time power consumption matrix, matrix P PM Each element in (t) represents the real-time power consumption model of a server, and each element corresponds to each server one by one. SC (t) represents the server static power consumption matrix. VM,CPU (t) represents the CPU resource requirement matrix of the virtual machine. VM→PM(A(t), F(t)) represents the mapping matrix between virtual machines and servers. It is a function of the virtual machine real-time deployment matrix A(t) and the virtual machine migration matrix F(t) and can be expressed as a (0,1) matrix. For example, Indicates that VM 1 is deployed on server 1, and VM 2 is deployed on server 2.
[0065] u VM,CPU (t)*MM VM→PM (A(t), F(t)) represents the CPU usage of each server, f h,CPU Represents the conversion coefficient matrix between CPU utilization and dynamic power consumption, u VM,GPU (t) represents the GPU resource requirement matrix of the virtual machine, u VM,GPU (t)*MM VM→PM (A(t), F(t)) represents the GPU utilization rate of each server, f h,GPU A conversion coefficient matrix representing GPU utilization and dynamic power consumption.
[0066] In the established real-time power consumption model of the intelligent computing center server, the server real-time power consumption consists of static power consumption, CPU dynamic power consumption and GPU dynamic power consumption. Among them, static power consumption is a fixed value related to server performance, CPU dynamic power consumption is a function of server CPU utilization, and GPU dynamic power consumption is a function of server GPU utilization.
[0067] In the above step 10, based on the liquid cooling system data, the cooling tower power consumption model shown in formula (2) is established:
[0068]
[0069] Where P T (t) represents the real-time power consumption of the cooling tower, P T,e Indicates the rated power consumption of the cooling tower, ΔT T (t) represents the real-time temperature difference between the inlet and outlet water of the cooling tower, ΔT T,e Indicates the rated operating temperature difference of the cooling tower inlet and outlet water, T app (t) represents the real-time approximation of the cooling tower, T app,e Indicates the approximation degree of the rated working condition of the cooling tower, T wb (t) represents the outdoor wet-bulb real-time temperature, T wb,e Indicates the outdoor wet-bulb rated operating temperature, m cw (t) represents the real-time flow rate of the cooling tower, m cw,e represents the rated operating flow rate of the cooling tower, and a, b, c, d, e, f, g, h, i, j, k, l, m, n, and o represent the fitting coefficients of each order term respectively.
[0070] In the above step 10, based on the liquid cooling system data, the water pump power consumption model shown in formula (3) is established for the primary side water pump and each CDU water pump:
[0071]
[0072] Where P pump (t) represents the real-time power consumption of the water pump, m(t) represents the real-time flow rate of the water pump, and m des Indicates the rated operating flow rate of the pump, P pump,des represents the rated power consumption of the pump, b1, b2, and n represent the fitting coefficients respectively.
[0073] In the above step 10, a convolutional neural network model is established, and the water pump flow of each CDU, the outdoor wet-bulb temperature, the approximation of each cooling tower, the water pump flow of each primary side, the opening of each valve on the primary side, the CPU utilization rate of each server, and the GPU utilization rate of each server are used as input variables of the convolutional neural network model, and the maximum chip temperature of each server is used as the output variable of the convolutional neural network model to construct a dynamic mapping relationship between the water pump flow of each CDU, the outdoor wet-bulb temperature, the approximation of each cooling tower, the water pump flow of each primary side, the opening of each valve on the primary side, the CPU utilization rate of each server, the GPU utilization rate of each server and the maximum chip temperature of each server.
[0074] Specifically include:
[0075] Step 131, filter out the mapping relationship between virtual machines and servers, virtual machine CPU resource requirements, virtual machine GPU resource requirements, and the maximum temperature of each server chip from the IT system scheduling data, and filter out the primary side water pump flow, primary side water pump power consumption, primary side valve opening, each CDU water pump flow, each CDU water pump power consumption, outdoor wet bulb temperature, each cooling tower inlet and outlet water temperature difference, each cooling tower approximation, and each cooling tower power consumption from the liquid cooling system data to form a modeling data set. The modeling data set is divided into a training set and a test set according to a 4:1 ratio.
[0076] Step 132, using the water pump flow of each CDU, the outdoor wet-bulb temperature, the approximation of each cooling tower, the water pump flow of each primary side, the opening of each valve on the primary side, the CPU utilization rate of each server (calculated according to the mapping relationship between the virtual machine and the server and the CPU resource demand of the virtual machine) and the GPU utilization rate of each server (calculated according to the mapping relationship between the virtual machine and the server and the GPU resource demand of the virtual machine) as the input variables of the convolutional neural network model, using the maximum chip temperature of each server as the output variable of the convolutional neural network model, using the training set to train the convolutional neural network model, and tuning the hyperparameters such as the number of layers of the model and the number of neurons in each layer during the training process.
[0077] The accuracy of the trained convolutional neural network model is tested using a test set. If the model error meets the requirements (for example, less than 1%), the model is considered qualified and a server temperature rapid prediction model is obtained.
[0078] In the above step 20, a real-time joint and timed sequence optimization method is used to coordinately control the virtual machine deployment and the cold plate liquid cooling system, including:
[0079] Step 21, when the cloud platform receives a new virtual machine deployment request, it randomly selects a deployable intelligent computing micro-module as the deployment micro-module, and jointly optimizes the deployment position of the new virtual machine in the deployment micro-module and the CDU water pump flow corresponding to the deployment module to achieve the minimum sum of the power consumption of the server of the deployment micro-module and the corresponding CDU water pumps.
[0080] Step 22: At each given moment, first migrate the virtual machines running on each server as a whole to minimize the number of intelligent computing micro-modules turned on; then optimize the flow of each CDU pump, the flow of each primary loop pump, the opening of each valve on the primary side, and the proximity of each cooling tower to minimize the total energy consumption of the cold plate liquid cooling system. Preferably, the time period between two adjacent given moments is 3 to 15 minutes.
[0081] Preferably, Figure 3 As shown, step 21 specifically includes:
[0082] Step 211, when the cloud platform receives the deployment request of the new virtual machine, it traverses the remaining CPU resources of all active servers according to the CPU resource requirements and GPU resource requirements of the new virtual machine to find a server available for deployment.
[0083] Step 212, if there are servers available for deployment, the intelligent computing micro-module where the deployable servers are located is used as the deployment micro-module for the new virtual machine deployment, the deployable servers are used as the optimization variables for the new virtual machine deployment, and step 213 is executed; if the remaining CPU and GPU resources of the active servers in all intelligent computing micro-modules cannot deploy new virtual machines, then a smart computing micro-module with a dormant server is randomly selected as the deployment micro-module, a dormant server in the deployment micro-module is randomly turned into an active state, a new virtual machine is deployed, and step 214 is executed.
[0084] Step 213, with the minimum total power consumption of the deployed micro-module after the new virtual machine is deployed as the optimization goal, and with the sum of the used resources of all virtual machines running on each server not exceeding the total rated resources of the server, and the maximum temperature of each server chip not exceeding the preset temperature threshold as the optimization constraints, a genetic algorithm is used to jointly optimize the deployment position of the new virtual machine in the deployed micro-module and the water pump flow in each CDU corresponding to the deployed micro-module, so as to obtain the optimal real-time deployment position of the virtual machine and the optimal water pump flow of each CDU.
[0085] As follows:
[0086] Optimization goal: minP total,PM+CDU,mc (t) = ∑P PM,mc (t)+ΣP pump,CDU,mc (t)
[0087] Optimization constraint: T PM (t)≤T max,PM andΣu VMi in PMk(t) ≤C PM
[0088] Optimization variables: mc (t),m CDU,mc (t)}
[0089] In the formula, ∑P PM,mc (t) represents the sum of the real-time power consumption of each server in the deployed micromodule, ∑P pump,CDU,mc (t) represents the sum of the power consumption of each CDU pump corresponding to the deployed micromodule, T PM (t) represents the maximum temperature of each server chip, T max,PM Indicates the preset temperature threshold, u VMi in PMk(t) represents the sum of resources used by all virtual machines running on each server, C PM Indicates the total rated resources of the server, A mc (t) represents the real-time deployment matrix of virtual machines deploying micromodules, m CDU,mc (t) represents the flow matrix of each CDU pump corresponding to the deployed micromodule.
[0090] The cloud platform implements the deployment of new virtual machines according to the optimal real-time deployment position of the virtual machines, and the cold plate liquid cooling system controls the flow of each CDU water pump corresponding to the deployed micromodule according to the optimal flow of each CDU water pump.
[0091] Step 214, with the optimization goal of minimizing the sum of the power consumption of each CDU water pump corresponding to the deployed micromodule after the new virtual machine is deployed, and with the constraint that the maximum temperature of each server chip cannot exceed the preset temperature threshold, a genetic algorithm is used to optimize the flow of each CDU water pump corresponding to the deployed micromodule to obtain the optimal flow of each CDU water pump.
[0092] As follows:
[0093] Optimization goal: minP total,CDU,mc (t) = ∑P pump,CDU,mc (t)
[0094] Optimization constraint: T PM (t)≤T max,PM
[0095] Optimization variables: {m CDU,mc (t)}.
[0096] The cold plate liquid cooling system controls the flow of each CDU water pump corresponding to the deployed micromodule according to the optimal flow of each CDU water pump.
[0097] In the method of this embodiment, during real-time optimization, first find a server available for new virtual machine deployment from the active servers. If there is one, the intelligent computing micromodule where the deployable server is located is used as the deployment micromodule, and the deployment position of the new virtual machine in the deployment micromodule and the flow rate of each CDU water pump corresponding to the deployment micromodule are jointly optimized, so that the sum of the power consumption of the server deploying the micromodule and the CDU water pump corresponding to the deployment micromodule is minimized; if there is none, a dormant server is randomly started for deployment, and the flow rate of each CDU water pump corresponding to the deployment micromodule is optimized, so that the sum of the power consumption of each CDU water pump corresponding to the deployment micromodule is minimized. Improve the real-time matching between server heat dissipation and secondary loop cooling capacity distribution in the deployment micromodule to reduce the amount of overcooling in the deployment micromodule.
[0098] Preferably, Figure 4 As shown, step 22 specifically includes:
[0099] Step 221, at a given moment, calculate the minimum number of active servers required based on the total number of virtual machines running on all servers in the intelligent computing center and the sum of their resource requirements (calculate the sum of CPU resource requirements and the sum of GPU resource requirements separately).
[0100] Step 222, based on the required minimum number of active servers, select servers as active servers for the next period according to the order of the intelligent computing micro-module numbers, the order of the rack numbers in each intelligent computing micro-module, and the order of the server numbers on each rack, until the number of selected servers reaches the minimum number of active servers.
[0101] Step 223: According to the load balancing strategy, the existing virtual machines are uniformly migrated to the selected active servers. The idle servers are hibernated.
[0102] Step 224, with the minimum total power consumption of the cold plate liquid cooling system as the optimization goal and the maximum temperature of each server chip not exceeding the preset temperature threshold as the constraint, a genetic algorithm is used to optimize the CDU water pump flow, the primary side water pump flow, the primary side valve opening and the cooling tower approximation to obtain the optimal CDU water pump flow, the optimal primary side water pump flow, the optimal primary side valve opening and the optimal cooling tower approximation.
[0103] As follows:
[0104] Optimization goal: minP total,cooling (t) = ∑P pump,CDU (t)+∑P pump,cw (t)+∑P T (t)
[0105] Optimization constraint: T PM (t)≤T max,PM
[0106] Optimization variables: {m CDU (t),m cw (t),V av (t),ΔT app (t)}.
[0107] Where, ΣP pump,CDU (t) represents the sum of the pump power consumption of each CDU, ΣP pump,cw (t) represents the sum of the power consumption of the primary side water pump, ∑P T (t) represents the sum of the power consumption of each cooling tower.
[0108] Step 225, the cold plate liquid cooling system regulates the flow of each CDU water pump according to the optimal flow of each CDU water pump, regulates the flow of each primary side water pump according to the optimal flow of each primary side water pump, regulates the opening of each primary side valve according to the optimal opening of each primary side valve, and regulates the approach degree of each cooling tower according to the optimal approach degree of each cooling tower.
[0109] In the method of this embodiment, during the timing optimization, the virtual machines are first migrated as a whole, and the idle servers after the migration are hibernated, so that the number of intelligent computing micro-modules turned on is minimized, and the location of active servers in a single intelligent computing micro-module is more concentrated, and the total power consumption of the servers is minimized. Then, on this basis, the flow of each CDU pump, the flow of each pump in the primary loop, the opening of each valve on the primary side, and the proximity of each cooling tower are optimized to minimize the total energy consumption of the cold plate liquid cooling system. This promotes a highly timed match between the heat dissipation of the servers in the intelligent computing center and the cooling of the cold plate liquid cooling system, thereby reducing the overall overcooling of the intelligent computing center.
[0110] The method of this embodiment, when there is a new virtual machine deployment request, performs real-time joint optimization of the placement of new virtual machines in a single deployment micromodule and the corresponding CDU water pump flow, so as to improve the real-time matching between server heat dissipation and secondary loop cooling capacity distribution in the deployment micromodule, thereby reducing the amount of overcooling in the micromodule. However, the process of real-time deployment optimization is prone to dispersion of active servers, that is, the deployment of virtual machines that can be accommodated by a single intelligent computing micromodule is dispersed in multiple intelligent computing micromodules. Although the total power consumption of the server has not changed, due to the lack of means for fine-grained control of cooling capacity in the secondary loop, the dispersion of active servers is prone to cause a large amount of cooling capacity waste.
[0111] At each given moment, the virtual machine deployment and cold plate liquid cooling system are optimized and controlled in a timed sequence, where the virtual machines running on each server are first migrated as a whole to minimize the total power consumption of the server and facilitate centralized adjustment of active servers. On this basis, the flow of each CDU pump, the flow of each pump in the primary loop, the opening of each valve on the primary side, and the proximity of each cooling tower are optimized to achieve the lowest overall power consumption of the cold plate liquid cooling system and facilitate the timing height matching between the heat dissipation of the servers in the intelligent computing center and the cooling supply of the cold plate liquid cooling system, thereby reducing the overall overcooling of the intelligent computing center. However, if only the timing sequence optimization is performed, the frequent migration of virtual machines is likely to affect their service quality, and the frequent adjustment of the opening of each valve on the primary side and the proximity of each cooling tower is likely to cause hydraulic imbalance of the primary side pipe network and a significant reduction in the life of the cooling tower fan. Therefore, the time interval of the timing sequence optimization should not be too short, and the long time interval obviously cannot meet the real-time deployment requirements of virtual machines.
[0112] The method of this embodiment coordinates real-time deployment optimization with timing sequence optimization. Through the timing coordination of the two, the cooling efficiency of the intelligent computing center can be significantly improved, and the overall energy efficiency and operation stability of the intelligent computing center can be improved.
[0113] In the method of the present invention, during the operation of the server, the existing virtual machines are automatically released (closed in real time) after completing the task. If all virtual machines on a server are released, the server is regarded as an idle server and will automatically sleep (real-time power consumption is turned to 0).
[0114] The basic principles, main features and advantages of the present invention are shown and described above. Those skilled in the art should understand that the present invention is not limited to the above specific embodiments, and the descriptions in the above specific embodiments and the specification are only for further illustrating the principles of the present invention. Without departing from the spirit and scope of the present invention, the present invention may have various changes and improvements, and these changes and improvements all fall within the scope of the present invention claimed for protection.
Claims
1. A collaborative control method for an intelligent computing center server and a cold plate liquid cooling system, characterized in that: The following steps are involved: Step 10: Obtain IT system scheduling data and liquid cooling system data of the intelligent computing center within a preset time period, and establish a server real-time power consumption model, a cooling tower power consumption model, a water pump power consumption model, and a server temperature rapid prediction model respectively; Step 20, based on the server real-time power consumption model, cooling tower power consumption model, water pump power consumption model and server temperature rapid prediction model, adopt an optimization method combining real-time joint and timing sequence to coordinately control virtual machine deployment and cold plate liquid cooling system.
2. The collaborative control method for the intelligent computing center server and the cold plate liquid cooling system according to claim 1 is characterized in that: The IT system scheduling data includes the CPU resource requirements of the virtual machine, the GPU resource requirements of the virtual machine, the mapping relationship between the virtual machine and the server, the CPU utilization rate of each server, the GPU utilization rate of each server, the real-time power consumption of each server and the chip temperature of each server; the liquid cooling system data includes the flow rate of each water pump on the primary side, the power consumption of each water pump on the primary side, the opening degree of each valve on the primary side, the flow rate of each CDU water pump, the power consumption of each CDU water pump, the outdoor wet-bulb temperature, the inlet and outlet water temperature difference of each cooling tower, the approach degree of each cooling tower, the power consumption of each cooling tower and the flow rate of each cooling tower.
3. The collaborative control method for the intelligent computing center server and the cold plate liquid cooling system according to claim 2 is characterized in that: In the step 10, a real-time power consumption model of the intelligent computing center server is established according to the IT system scheduling data; Specifically include: Step 101, filtering out power consumption data of each server at different CPU and GPU usage rates from IT system scheduling data; Step 102, establishing a server static power consumption matrix according to the power consumption data of each server when the CPU and GPU usage rates are 0; Step 103: According to the data of the change of the real-time power consumption of each server with the CPU usage rate, a multiple linear regression method is used to fit the conversion coefficient of the CPU usage rate and the dynamic power consumption of each server, so as to form a conversion coefficient matrix of the CPU usage rate and the dynamic power consumption; according to the data of the change of the real-time power consumption of each server with the GPU usage rate, a multiple linear regression method is used to fit the conversion coefficient of the GPU usage rate and the dynamic power consumption of each server, so as to form a conversion coefficient matrix of the GPU usage rate and the dynamic power consumption; Step 104, combining the server static power consumption matrix, the conversion coefficient matrix of CPU usage and running power consumption, and the conversion coefficient matrix of GPU usage and running power consumption, to obtain the real-time power consumption model of the intelligent computing center server shown in formula (1): P PM (t)=P SC (t)+u VM,CPU (t)*MM VM→PM (A(t),F(t))*f h,CPU +u VM,GPU (t)*MM VM→PM (A(t),F(t))*f h,GPU Formula (1) Where P PM (t) represents the server real-time power consumption matrix, P SC (t) represents the server static power consumption matrix, u VM,CPU (t) represents the CPU resource requirement matrix of the virtual machine, MM VM→PM (A(t), F(t)) represents the mapping matrix between virtual machines and servers, A(t) represents the virtual machine real-time deployment matrix, F(t) represents the virtual machine migration matrix, u VM,CPU (t)*MM VM→PM (A(t), F(t)) represents the CPU usage of each server, f h,CPU Represents the conversion coefficient matrix between CPU utilization and dynamic power consumption, u VM,GPU (t) represents the GPU resource requirement matrix of the virtual machine, u VM,GPU (t)*MM VM→PM (A(t), F(t)) represents the GPU utilization rate of each server, f h,GPU A conversion coefficient matrix representing GPU utilization and dynamic power consumption.
4. The collaborative control method for the intelligent computing center server and the cold plate liquid cooling system according to claim 2 is characterized in that: In step 10, a cooling tower power consumption model shown in formula (2) is established based on the liquid cooling system data: Where P T (t) represents the real-time power consumption of the cooling tower, P T,e Indicates the rated power consumption of the cooling tower, ΔT T (t) represents the real-time temperature difference between the inlet and outlet water of the cooling tower, ΔT T,e Indicates the rated operating temperature difference of the cooling tower inlet and outlet water, T app (t) represents the real-time approximation of the cooling tower, T app,e Indicates the approximation degree of the rated working condition of the cooling tower, T wb (t) represents the outdoor wet-bulb real-time temperature, T wb,e Indicates the outdoor wet-bulb rated operating temperature, m cw (t) represents the real-time flow rate of the cooling tower, m cw,e represents the rated operating flow rate of the cooling tower, and a, b, c, d, e, f, g, h, i, j, k, l, m, n, and o represent the fitting coefficients of each order term respectively.
5. The collaborative control method for the intelligent computing center server and the cold plate liquid cooling system according to claim 2 is characterized in that: In step 10, based on the liquid cooling system data, a water pump power consumption model shown in formula (3) is established for the primary side water pump and each CDU water pump: Where P pump (t) represents the real-time power consumption of the water pump, m(t) represents the real-time flow rate of the water pump, and m des Indicates the rated operating flow rate of the pump, P pump,des represents the rated power consumption of the pump, b1, b2, and n represent the fitting coefficients respectively.
6. The collaborative control method for the intelligent computing center server and the cold plate liquid cooling system according to claim 2, characterized in that: In the step 10, a server temperature rapid prediction model is established based on IT system scheduling data and liquid cooling system data; Specifically include: Step 131, filtering out the mapping relationship between virtual machines and servers, virtual machine CPU resource requirements, virtual machine GPU resource requirements, and the maximum temperature of each server chip from the IT system scheduling data, and filtering out the primary side water pump flow, primary side water pump power consumption, primary side valve opening, each CDU water pump flow, each CDU water pump power consumption, outdoor wet bulb temperature, each cooling tower inlet and outlet water temperature difference, each cooling tower approximation, and each cooling tower power consumption from the liquid cooling system data to form a modeling data set; Step 132, based on the modeling data set, the water pump flow of each CDU, the outdoor wet-bulb temperature, the approximation degree of each cooling tower, the water pump flow of each primary side, the opening of each valve on the primary side, the CPU utilization rate of each server and the GPU utilization rate of each server are used as input variables of the convolutional neural network model, and the maximum chip temperature of each server is used as the output variable of the convolutional neural network model. The convolutional neural network model is trained to obtain a server temperature rapid prediction model.
7. The collaborative control method for the intelligent computing center server and the cold plate liquid cooling system according to claim 1 is characterized in that: In step 20, a real-time joint and timed sequence optimization method is used to coordinately control the virtual machine deployment and the cold plate liquid cooling system, including: Step 21: When the cloud platform receives a new virtual machine deployment request, it randomly selects a deployable intelligent computing micro-module as the deployment micro-module, and jointly optimizes the deployment position of the new virtual machine in the deployment micro-module and the flow of each CDU pump corresponding to the deployment micro-module, so as to minimize the sum of the power consumption of the server of the deployment micro-module and the corresponding CDU pumps; Step 22: At each given moment, first migrate the virtual machines running on each server as a whole to minimize the number of intelligent computing micro-modules turned on; then optimize the flow rate of each CDU pump, the flow rate of each pump in the primary loop, the opening degree of each valve on the primary side, and the proximity of each cooling tower to minimize the total energy consumption of the cold plate liquid cooling system.
8. The collaborative control method for the intelligent computing center server and the cold plate liquid cooling system according to claim 7, characterized in that: The step 21 specifically includes: Step 211, when the cloud platform receives the deployment request of the new virtual machine, it traverses the remaining CPU resources and GPU resources of all active servers according to the CPU resource requirements and GPU resource requirements of the new virtual machine to find a server available for deployment; Step 212: If there are servers available for deployment, the intelligent computing micro-module where the servers available for deployment are located is used as the deployment micro-module for the new virtual machine deployment, and the servers available for deployment are used as the optimization variables for the new virtual machine deployment, and step 213 is executed; if the remaining CPU resources and GPU resources of the active servers in all intelligent computing micro-modules cannot deploy new virtual machines, a smart computing micro-module with a dormant server is randomly selected as the deployment micro-module, a dormant server in the deployment micro-module is randomly turned into an active state, a new virtual machine is deployed, and step 214 is executed; Step 213, with the optimization goal of achieving the lowest total power consumption of the deployed micromodule after the new virtual machine is deployed, with the optimization constraints that the sum of the used resources of all virtual machines running on each server does not exceed the total rated resources of the server, and the maximum temperature of each server chip does not exceed the preset temperature threshold, a genetic algorithm is used to jointly optimize the deployment position of the new virtual machine deployed micromodule and the water pump flow in each CDU corresponding to the deployed micromodule, so as to obtain the optimal real-time deployment position of the virtual machine and the optimal water pump flow of each CDU; the cloud platform implements the deployment of the new virtual machine according to the optimal real-time deployment position of the virtual machine, and the cold plate liquid cooling system controls the flow of each CDU water pump corresponding to the deployed micromodule according to the optimal water pump flow of each CDU; Step 214, with the optimization goal of minimizing the sum of the power consumption of each CDU water pump corresponding to the deployed micromodule after the new virtual machine is deployed, and with the constraint that the maximum temperature of each server chip cannot exceed the preset temperature threshold, a genetic algorithm is used to optimize the flow of each CDU water pump corresponding to the deployed micromodule to obtain the optimal flow of each CDU water pump; the cold plate liquid cooling system controls the flow of each CDU water pump corresponding to the deployed micromodule according to the optimal flow of each CDU water pump.
9. The collaborative control method for the intelligent computing center server and the cold plate liquid cooling system according to claim 7, characterized in that: The step 22 specifically includes: Step 221, at a given moment, calculate the minimum number of active servers required based on the sum of the number of all virtual machines running on all servers in the intelligent computing center and their resource requirements; Step 222: According to the required minimum number of active servers, select servers as active servers for the next period according to the order of the intelligent computing micro-module numbers, the order of the rack numbers in each intelligent computing micro-module, and the order of the server numbers on each rack, until the number of selected servers reaches the minimum number of active servers; Step 223, according to the load balancing strategy, evenly migrate the existing virtual machines to the selected active servers; hibernate the idle servers; Step 224, with the minimum total power consumption of the cold plate liquid cooling system as the optimization goal, and with the maximum temperature of each server chip not exceeding the preset temperature threshold as the constraint, a genetic algorithm is used to optimize the flow rate of each CDU water pump, the flow rate of each primary side water pump, the opening degree of each primary side valve, and the approximation degree of each cooling tower, to obtain the optimal flow rate of each CDU water pump, the optimal flow rate of each primary side water pump, the optimal opening degree of each primary side valve, and the optimal approximation degree of each cooling tower; Step 225, the cold plate liquid cooling system regulates the flow of each CDU water pump according to the optimal flow of each CDU water pump, regulates the flow of each primary side water pump according to the optimal flow of each primary side water pump, regulates the opening of each primary side valve according to the optimal opening of each primary side valve, and regulates the approach degree of each cooling tower according to the optimal approach degree of each cooling tower.
Citation Information
Patent Citations
Data center energy-saving scheduling method and system
CN109800066A
Novel micromodule system
CN214202293U
Dynamic data structure search method using data semantic classification
KR102590576B1
Mixed-mode data center control system
US9516793B1
Cited By
Data center energy consumption optimization method based on joint multi-objective optimization model
CN119620842A
