Air conditioner room control method and device, equipment and storage medium

Abstract

The present disclosure relates to an air-conditioning machine room control method and device, equipment and storage medium, the method comprises: taking the received operation state parameter of the air-conditioning machine room as the current operation state parameter, selecting one group of action from the preset multiple groups of actions;Get the operation state parameter after executing the action, calculate the action value after executing the action;According to the action value after executing the action or the executed action, judge whether it meets the cycle stop condition: if not, the operation state parameter after executing the action is taken as the current operation state parameter, and the step of selecting one group of action from the preset multiple groups of actions is executed until the cycle stop condition is met;If yes, from all action values, determine the action with the maximum action value under the same operation state parameter, which is used to control the operation of the air-conditioning machine room, so as to obtain the optimal action under different operation states to minimize power consumption and control temperature, thereby improving the energy efficiency of the air-conditioning machine room through the optimal action.

Description

Technical Field

[0001] The present disclosure relates to the technical field of air-conditioning rooms, and in particular to an air-conditioning room control method and apparatus, equipment, and storage medium. Background Art

[0002] The energy consumption of air-conditioning rooms accounts for more than 70% of the energy consumption of air-conditioning systems. Therefore, air-conditioning rooms have become the focus of energy conservation due to their high proportion of energy consumption. Therefore, how to optimize the energy efficiency of air-conditioning rooms has become a technical problem that needs to be solved urgently.

[0003] In existing technology, the energy efficiency of air conditioning rooms is typically optimized by building a neural network model that takes the operating parameters of the air conditioning room as input and the power consumption of the air conditioning room as output. However, the constructed neural network model is complex, making it difficult to obtain a relatively accurate power consumption of the air conditioning room, thus making it difficult to accurately optimize the energy efficiency of the air conditioning room. Summary of the Invention

[0004] In order to solve the above technical problems or at least partially solve the above technical problems, embodiments of the present disclosure provide an air-conditioning room control method and apparatus, equipment, and storage medium.

[0005] In a first aspect, an embodiment of the present disclosure provides a method for controlling an air-conditioning room, the method comprising:

[0006] receiving operating status parameters of the air-conditioning room and selecting a set of actions from a plurality of preset sets of actions under the current operating status parameters to execute the selected action;

[0007] Obtain the running state parameters after the action is executed, calculate the action value after the action is executed, and establish the corresponding relationship between the current running state parameters, the executed action and the action value after the action is executed;

[0008] Determine whether the loop stop condition is met based on the action value after the action is executed or the action executed:

[0009] When the cycle stop condition is not met, the running state parameters after the action is executed are used as the current running state parameters, and the steps of one set of actions selected from the preset multiple sets of actions are executed until the cycle stop condition is met;

[0010] Based on the correspondence between the established operating status parameters, the executed actions and the action values, the action with the largest action value under the same operating status parameters is determined from all the action values ​​calculated after the action is executed, and is used to control the operation of the air-conditioning room, where each operating status parameter represents a preset value range.

[0011] In a possible implementation, before obtaining the operating status parameters after the action is executed, the method further includes:

[0012] Timing starts from the execution of the selected action. When the accumulated time reaches the preset time, the step of obtaining the running status parameters after the execution of the action is executed.

[0013] In a possible implementation, one of the preset multiple groups of actions is a group of actions selected from the preset multiple groups of actions based on a greedy algorithm.

[0014] In one possible implementation, the action value after taking the action is calculated using the following expression:

[0015]

[0016] Among them, Q′(S t , A t ) is the action value after taking action at time t, Q(S t , A t ) is the action value before taking action at time t, α and γ are the penalty coefficient for updating Q and the discount factor for return, R t+1 is the reward after taking the action, π(a|S t+1 ) is the running state parameter S after taking action t+1 The probability of taking action a, Q(S t+1 , a) is the action value before taking action at time t+1.

[0017] In one possible implementation, the reward after taking an action is calculated using the following expression:

[0018]

[0019] Among them, R t+1 is the reward after taking the action, β1 and β2 are proportional coefficients, T ie is the indoor temperature corresponding to the i-th air conditioner, T il is the preset temperature corresponding to the i-th air conditioner, W it is the actual power corresponding to the i-th air conditioner, W ip is the preset power corresponding to the i-th air conditioner.

[0020] In a possible implementation, the loop stop condition includes that the difference between the action value after executing the action and the action value before executing the action is less than or equal to a preset threshold, or the number of times the action is executed is greater than or equal to a preset number.

[0021] In one possible embodiment, the operating status parameters of the air-conditioning room include any several of the following: chilled water inlet temperature, chilled water outlet temperature, cooling water inlet temperature, cooling water outlet temperature, chilled water flow rate, cooling water flow rate, cooling water pump speed, chilled water pump speed, cooling tower fan speed, indoor ambient temperature, outdoor ambient temperature, ambient human flow, weather conditions, total system operating power, and total system operating efficiency; each group of actions in the preset multiple groups of actions includes increasing the chilled water outlet temperature setting value, lowering the chilled water outlet temperature setting value, setting the number of different chillers in operation, increasing the water pump speed setting value, lowering the water pump speed setting value, setting the number of different water pump units in operation, increasing the cooling tower fan speed setting value, lowering the cooling tower fan speed setting value, increasing the cooling water temperature setting value, and lowering the cooling water temperature setting value.

[0022] In a second aspect, an embodiment of the present disclosure provides an air conditioning room control device, comprising:

[0023] A selection module, which is used to receive the operating status parameters of the air-conditioning room and select a set of actions from a plurality of preset sets of actions under the current operating status parameters to execute the selected action;

[0024] A calculation module is used to obtain the running state parameters after the action is executed, calculate the action value after the action is executed, and establish a corresponding relationship between the current running state parameters, the executed action and the action value after the action is executed;

[0025] a judgment module, which is used to judge whether a loop stop condition is met according to an action value after the action is executed or the action executed, and if the loop stop condition is not met, uses the running state parameter after the action is executed as the current running state parameter, and executes the step of selecting one of the preset multiple action groups until the loop stop condition is met;

[0026] A determination module is used to determine the action with the largest action value under the same operating status parameter from all action values ​​calculated after the action is executed based on the correspondence between the established operating status parameters, the executed actions and the action values, and to control the operation of the air-conditioning room, wherein each operating status parameter represents a preset value range.

[0027] In a third aspect, an embodiment of the present disclosure provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus;

[0028] Memory for storing computer programs;

[0029] The processor is configured to implement the above-mentioned air-conditioning room control method when executing the program stored in the memory.

[0030] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program implements the above-mentioned air-conditioning room control method when executed by a processor.

[0031] The above technical solutions provided by the embodiments of the present disclosure have at least some or all of the following advantages compared to the prior art:

[0032] The air-conditioning room control method described in the embodiment of the present disclosure receives the operating status parameters of the air-conditioning room, and selects a set of actions from a plurality of preset action groups under the current operating status parameters to execute the selected action; obtains the operating status parameters after the action is executed, calculates the action value after the action is executed, and constructs a correspondence between the current operating status parameters, the executed action, and the action value after the action is executed; determines whether a loop stop condition is met based on the action value after the action is executed or the executed action: when the loop stop condition is not met, uses the operating status parameters after the action is executed as the current operating status parameters, and executes the step of selecting a set of actions from a plurality of preset action groups until the loop stop condition is met; based on the constructed correspondence between the operating status parameters, the executed action, and the action value, determines the action with the largest action value under the same operating status parameter from all action values ​​calculated after the action is executed, for controlling the operation of the air-conditioning room, wherein each operating status parameter represents a preset value range, and can obtain the optimal action that minimizes power consumption and has appropriate temperature control under different operating states without relying on a neural network model, thereby improving the energy efficiency of the air-conditioning room through the optimal action. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0034] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or related technical descriptions. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0035] Figure 1 The following schematically shows a flow chart of an air-conditioning room control method according to an embodiment of the present disclosure;

[0036] Figure 2 A structural block diagram of an air-conditioning room control device according to an embodiment of the present disclosure is schematically shown; and

[0037] Figure 3The structural block diagram of an electronic device according to an embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION

[0038] To make the objectives, technical solutions, and advantages of the embodiments of the present disclosure more clear, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present disclosure without making any creative efforts shall fall within the scope of protection of the present disclosure.

[0039] See also Figure 1 , an embodiment of the present disclosure provides an air-conditioning room control method, the method comprising:

[0040] S1, receiving the operating status parameters of the air-conditioning room, and selecting a set of actions from a plurality of preset sets of actions under the current operating status parameters to execute the selected action;

[0041] In practical applications, one of the preset multiple groups of actions is a group of actions selected from the preset multiple groups of actions based on a greedy algorithm.

[0042] S2, obtaining the running state parameters after the action is executed, calculating the action value after the action is executed, and constructing the corresponding relationship between the current running state parameters, the executed action and the action value after the action is executed;

[0043] In actual application, the operating status parameters of the air-conditioning room include any number of the chilled water inlet temperature, chilled water outlet temperature, cooling water inlet temperature, cooling water outlet temperature, chilled water flow, cooling water flow, cooling water pump speed, chilled water pump speed, cooling tower fan speed, indoor ambient temperature, outdoor ambient temperature, ambient traffic flow, weather conditions, total system operating power, and total system operating efficiency; each group of actions in the preset multiple groups of actions includes increasing the chilled water outlet temperature setting value, lowering the chilled water outlet temperature setting value, setting the number of different chillers in operation, increasing the water pump speed setting value, lowering the water pump speed setting value, setting the number of different water pump units in operation, increasing the cooling tower fan speed setting value, lowering the cooling tower fan speed setting value, increasing the cooling water temperature setting value, and lowering the cooling water temperature setting value.

[0044] S3, based on the action value after the action is executed or the action executed, determines whether the loop stop condition is met:

[0045] If yes, proceed to step S4;

[0046] If not, proceed to step S5;

[0047] In practical applications, the loop stop condition includes that the difference between the action value after executing the action and the action value before executing the action is less than or equal to a preset threshold, or the number of times the action is executed is greater than or equal to a preset number.

[0048] S4, based on the established correspondence between the operating state parameters, the executed actions, and the action values, determining the action with the largest action value under the same operating state parameter from all action values ​​calculated after the action is executed, for controlling the operation of the air conditioning room, wherein each operating state parameter represents a preset value range;

[0049] In practical applications, the same operating state parameter indicates that each of the multiple operating state parameters has a preset value range. For example, when the operating state parameter includes the ambient temperature T e , indoor temperature T in , chilled water inlet temperature, and current system operating power, the same operating state parameter represents, T e For any value between (30℃, 35℃), T in The temperature is any value between (27°C, 30°C), the chilled water inlet temperature is any value between (25°C, 30°C), and the current system operating power is any value between (300kw, 400kw).

[0050] S5, using the running state parameters after executing the action as the current running state parameters, and executing the steps of selecting one set of actions from the preset multiple sets of actions until the cycle stop condition is met.

[0051] In this embodiment, in step S2, before obtaining the operating status parameters after the action is performed, the method further includes:

[0052] Timing starts from the execution of the selected action. When the accumulated time reaches the preset time, the step of obtaining the running status parameters after the execution of the action is executed.

[0053] In this embodiment, in step S2, the action value after taking the action is calculated by the following expression:

[0054]

[0055] Among them, Q′(S t , A t ) is the action value after taking action at time t, Q(S t , A t ) is the action value before taking action at time t, α and γ are the penalty coefficient for updating Q and the discount factor for return, R t+1 is the reward after taking the action, π(a|S t+1) is the running state parameter S after taking action t+1 The probability of taking action a, Q(S t+1 , a) is the action value before taking action at time t+1.

[0056] In this embodiment, in step S2, the reward after taking the action is calculated using the following expression:

[0057]

[0058] Among them, R t+1 is the reward after taking the action, β1 and β2 are proportional coefficients, T ie is the indoor temperature corresponding to the i-th air conditioner, T il is the preset temperature corresponding to the i-th air conditioner, W it is the actual power corresponding to the i-th air conditioner, W ip is the preset power corresponding to the i-th air conditioner.

[0059] The operating parameters of the air-conditioning room include the ambient temperature T e , indoor temperature T in , chilled water inlet temperature (the temperature of chilled water when it returns to the evaporator after indoor heat exchange), and current system operating power, and multiple groups of actions including setting the chilled water outlet temperature up or down by 2 degrees, and setting the cooling water return temperature up or down by 2 degrees, a total of four actions, are used as examples to explain the application method of the air-conditioning room control method of this embodiment. After adjusting the chilled water outlet temperature and the cooling water return temperature, the relevant operating parameters of the system's water pump unit and cooling tower will also change accordingly, thereby causing power conversion.

[0060] The specific steps are as follows:

[0061] The first step is to establish a temporal difference reinforcement learning model based on the above state variables and multiple action groups, and initialize the action value matrix Q, for example, all values ​​are 0;

[0062] The second step is to collect the model state S at the current moment t , the model state S t Including ambient temperature T e , indoor temperature T in , chilled water inlet temperature, and current system operating power. At this point, the action to be taken at the current moment is determined based on the action value of taking different actions at that moment. Here, the ε-greedy algorithm strategy is used to take action. This strategy means that we have a probability of ε to randomly select an action, and a probability of 1-ε to select the action with the highest action value. For example:

[0063] The current state is S t=(30℃, 27℃, 25℃, 300Kw), check the action values ​​of different actions in this state. As shown above, there are four actions: increase or decrease the chilled water outlet temperature by 2 degrees, increase or decrease the cooling water return temperature by 2 degrees, and decrease or increase the cooling water return temperature by 2 degrees. Since the initialization values ​​of the actions are all 0, randomly take one of the actions A. t .

[0064] The third step is to take action A t And the state at time t, we get the state S at time t+1 t+1 and immediate return R t+1 , then choose A according to action expectation t+1 , and then use S t+1 , A t+1 To update the action value Q(S t , A t ):

[0065]

[0066] Among them, α and γ are the penalty coefficients for updating Q and the discount factor for returns, respectively, and R t+1 That is, the immediate return at time t+1 described above:

[0067]

[0068] The instantaneous return takes into account the difference between the current indoor temperature and the desired temperature, as well as the difference between the current power and the optimal power, and is constrained by coefficients.

[0069] Among them, π(a|S t+1 ) indicates that in S t+1 The probability of taking action a is the same here. If there are 4 actions, then we can have π(a|S t+1 )=1 / 4. For example:

[0070] In the second step, the chilled water temperature is randomly selected to be increased by 2 degrees. Obviously, this is a bad action. As a result, the indoor temperature is higher at time t+1. For example, the ideal temperature is 24°C, and the current temperature is 29°C. The power is slightly reduced, but the immediate return will get a negative value. t When the action value of other actions has not been updated, the next time you encounter S t When the system is in this state, it is highly likely that it will not choose to increase the chilled water outlet temperature by 2 degrees.

[0071] In the fourth step, repeat steps 2 to 4 until the model learns a better action-value matrix, and automatically adjusts the operating parameters of the system through the learned action-value matrix, thereby reducing power consumption and ensuring a more suitable room temperature.

[0072] See also Figure 2 , an embodiment of the present disclosure provides an air-conditioning room control device, comprising:

[0073] A selection module 11 is configured to receive operating status parameters of the air-conditioning room and select a set of actions from a plurality of preset sets of actions under the current operating status parameters to execute the selected action;

[0074] A calculation module 12 is used to obtain the running state parameters after the action is executed, calculate the action value after the action is executed, and establish a corresponding relationship between the current running state parameters, the executed action and the action value after the action is executed;

[0075] a judgment module 13 for judging whether a loop stop condition is met based on an action value after the action is executed or the action executed, and if the loop stop condition is not met, using the running state parameter after the action is executed as the current running state parameter, and executing a step of selecting one of the preset multiple action groups until the loop stop condition is met;

[0076] The determination module 14 is used to determine the action with the largest action value under the same operating status parameter from all action values ​​calculated after the action is executed based on the correspondence between the established operating status parameters, the executed actions and the action values, and is used to control the operation of the air-conditioning room, wherein each operating status parameter represents a preset value range.

[0077] The implementation process of the functions and effects of each unit in the above-mentioned device is specifically described in the implementation process of the corresponding steps in the above-mentioned method, and will not be repeated here.

[0078] For the device embodiments, since they basically correspond to the method embodiments, the relevant parts can be referred to the partial description of the method embodiments. The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the present invention. A person of ordinary skill in the art can understand and implement the present invention without inventive work.

[0079] In the second embodiment described above, any number of the selection module 11, the calculation module 12, the judgment module 13, and the determination module 14 can be combined into one module for implementation, or any one of the modules can be split into multiple modules. Alternatively, at least part of the functions of one or more of these modules can be combined with at least part of the functions of other modules and implemented in one module. At least one of the selection module 11, the calculation module 12, the judgment module 13, and the determination module 14 can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application-specific integrated circuit (ASIC), or can be implemented in hardware or firmware by any other reasonable means of integrating or packaging the circuit, or can be implemented in any one of the three implementation methods of software, hardware, and firmware, or in any appropriate combination of any of them. Alternatively, at least one of the selection module 11, the calculation module 12, the judgment module 13, and the determination module 14 can be at least partially implemented as a computer program module, which can perform the corresponding function when the computer program module is executed.

[0080] Reference Figure 3 As shown, the electronic device provided by the third exemplary embodiment of the present disclosure includes a processor 1110, a communication interface 1120, a memory 1130 and a communication bus 1140, wherein the processor 1110, the communication interface 1120, and the memory 1130 communicate with each other through the communication bus 1140;

[0081] Memory 1130, for storing computer programs;

[0082] The processor 1110 is configured to implement the following air conditioning room control method when executing the program stored in the memory 1130:

[0083] receiving operating status parameters of the air-conditioning room and selecting a set of actions from a plurality of preset sets of actions under the current operating status parameters to execute the selected action;

[0084] Obtain the running state parameters after the action is executed, calculate the action value after the action is executed, and establish the corresponding relationship between the current running state parameters, the executed action and the action value after the action is executed;

[0085] Determine whether the loop stop condition is met based on the action value after the action is executed or the action executed:

[0086] When the cycle stop condition is not met, the running state parameters after the action is executed are used as the current running state parameters, and the steps of one set of actions selected from the preset multiple sets of actions are executed until the cycle stop condition is met;

[0087] Based on the correspondence between the established operating status parameters, the executed actions and the action values, the action with the largest action value under the same operating status parameters is determined from all the action values ​​calculated after the action is executed, and is used to control the operation of the air-conditioning room, where each operating status parameter represents a preset value range.

[0088] The communication bus 1140 can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. The communication bus 1140 can be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, the figure shows only one thick line, but this does not mean that there is only one bus or only one type of bus.

[0089] The communication interface 1120 is used for communication between the electronic device and other devices.

[0090] The memory 1130 may include a random access memory (RAM) or a non-volatile memory, such as at least one disk storage. Alternatively, the memory 1130 may be at least one storage device located away from the processor 1110.

[0091] The above-mentioned processor 1110 can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

[0092] A fourth exemplary embodiment of the present disclosure further provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the aforementioned air conditioning room control method.

[0093] The computer-readable storage medium may be included in the device / apparatus described in the above embodiments, or may exist independently and not be incorporated into the device / apparatus. The computer-readable storage medium carries one or more programs, which, when executed, implement the air conditioning room control method according to the embodiments of the present disclosure.

[0094] According to an embodiment of the present disclosure, a computer-readable storage medium may be a non-volatile computer-readable storage medium, such as, but not limited to, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0095] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or device comprising the element.

[0096] The foregoing description is intended only to provide specific embodiments of the present disclosure, intended to enable those skilled in the art to understand and implement the present disclosure. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure is not to be limited to the embodiments shown herein, but is to be construed in the broadest manner consistent with the principles and novel features claimed herein.

Claims

1. A method for controlling an air-conditioning room, characterized in that: The method comprises: receiving operating status parameters of the air-conditioning room and selecting a set of actions from a plurality of preset sets of actions under the current operating status parameters to execute the selected action; Obtain the running state parameters after the action is executed, calculate the action value after the action is executed, and establish the corresponding relationship between the current running state parameters, the executed action and the action value after the action is executed; Determine whether a loop stop condition is met based on the action value after the action is executed or the action executed. The loop stop condition includes that the difference between the action value after the action is executed and the action value before the action is executed is less than or equal to a preset threshold, or the number of times the action is executed is greater than or equal to a preset number: When the cycle stop condition is not met, the running state parameters after the action is executed are used as the current running state parameters, and the steps of one set of actions selected from the preset multiple sets of actions are executed until the cycle stop condition is met; Based on the established correspondence between the operating state parameters, the executed actions and the action values, the action with the largest action value under the same operating state parameter is determined from all the action values ​​calculated after the action is executed, and used to control the operation of the air-conditioning room. Each operating state parameter represents a preset value range. The following expression is used to calculate the action value after taking the action: in, is the action value after taking action at time t, is the action value before taking action at time t, Update The penalty coefficient and the discount factor of the return, is the reward after taking the action, For Take the following The probability of an action, is the action value before taking action at time t+1, for The operating status at all times, is the operating status at time t, is the action taken at time t, The reward after taking an action is calculated using the following expression: in, is the reward after taking the action, and is the proportionality coefficient, is the indoor temperature corresponding to the i-th air conditioner, is the preset temperature corresponding to the i-th air conditioner, is the actual power corresponding to the i-th air conditioner, is the preset power corresponding to the i-th air conditioner, The instantaneous return takes into account the difference between the current indoor temperature and the desired temperature, as well as the difference between the current power and the optimal power, and is constrained by coefficients.

2. The method according to claim 1, characterized in that Before obtaining the running status parameters after the execution of the action, the method further includes: Timing starts from the execution of the selected action. When the accumulated time reaches the preset time, the step of obtaining the running status parameters after the execution of the action is executed.

3. The method according to claim 1, characterized in that One set of actions in the preset multiple sets of actions is a set of actions selected from the preset multiple sets of actions based on a greedy algorithm.

4. The method according to claim 1, wherein The operating status parameters of the air-conditioning room include any several of the chilled water inlet temperature, chilled water outlet temperature, cooling water inlet temperature, cooling water outlet temperature, chilled water flow, cooling water flow, cooling water pump speed, chilled water pump speed, cooling tower fan speed, indoor ambient temperature, outdoor ambient temperature, ambient human flow, weather conditions, total system operating power, and total system operating efficiency; each group of actions in the preset multiple groups of actions includes raising the chilled water outlet temperature setting value, lowering the chilled water outlet temperature setting value, setting the number of different chillers in operation, raising the water pump speed setting value, lowering the water pump speed setting value, setting the number of different water pump units in operation, raising the cooling tower fan speed setting value, lowering the cooling tower fan speed setting value, raising the cooling water temperature setting value, and lowering the cooling water temperature setting value.

5. An air-conditioning room control device, characterized in that: include: A selection module, which is used to receive the operating status parameters of the air-conditioning room and select a set of actions from a plurality of preset sets of actions under the current operating status parameters to execute the selected action; A calculation module is used to obtain the running state parameters after the action is executed, calculate the action value after the action is executed, and establish a corresponding relationship between the current running state parameters, the executed action and the action value after the action is executed; a judgment module, configured to judge whether a loop stop condition is met based on an action value after the action is executed or the action executed, and if the loop stop condition is not met, using the running state parameter after the action is executed as the current running state parameter, and executing a step of selecting one of the preset multiple action groups until the loop stop condition is met, wherein the loop stop condition includes that the difference between the action value after the action is executed and the action value before the action is executed is less than or equal to a preset threshold, or the number of times the action is executed is greater than or equal to a preset number; The determination module is used to determine the action with the maximum action value under the same operating state parameter from all action values ​​calculated after the action is executed based on the established correspondence between the operating state parameters, the executed actions and the action values, so as to control the operation of the air-conditioning room, wherein each operating state parameter represents a preset value range. The following expression is used to calculate the action value after taking the action: in, is the action value after taking action at time t, is the action value before taking action at time t, Update The penalty coefficient and the discount factor of the return, is the reward after taking the action, For Take the following The probability of an action, is the action value before taking action at time t+1, for The operating status at all times, is the operating status at time t, is the action taken at time t, The reward after taking an action is calculated using the following expression: in, is the reward after taking the action, and is the proportionality coefficient, is the indoor temperature corresponding to the i-th air conditioner, is the preset temperature corresponding to the i-th air conditioner, is the actual power corresponding to the i-th air conditioner, is the preset power corresponding to the i-th air conditioner, The instantaneous return takes into account the difference between the current indoor temperature and the desired temperature, as well as the difference between the current power and the optimal power, and is constrained by coefficients.

6. An electronic device, characterized in that: The processor, the communication interface, the memory and the communication bus are connected to each other via the communication bus. Memory for storing computer programs; The processor is configured to implement the air conditioning room control method according to any one of claims 1 to 4 when executing the program stored in the memory.

7. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the air conditioning room control method according to any one of claims 1 to 4 is implemented.

Images