Model-free self-adaptive water mixing temperature control system and method based on deep reinforcement learning
A model-free self-adaptive and reinforcement learning technology, applied in the direction of self-adaptive control, general control system, control/regulation system, etc., can solve problems such as wasting water resources and difficult temperature regulation, and achieve reliable and accurate mixed water system, avoid The effect of frequent temperature changes
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Method used
Image
Examples
specific Embodiment approach 1
[0046] Specific implementation mode one: combine Figure 1-Figure 3Describe this embodiment. The model-free adaptive mixed water temperature control system based on deep reinforcement learning in this embodiment includes an action network module and a value network module;
[0047] The action network module includes an estimation network module and an evaluation target network module;
[0048] The action network module is used to define the state space and action space of the mixed water system;
[0049] The value network module is used to judge and evaluate the network environment;
[0050] The action network module and the value network module are used to interact with the environment to obtain the DDPG model.
specific Embodiment approach 2
[0051] Specific implementation mode two: combination Figure 1-Figure 3 Describe this embodiment, the model-free adaptive mixed water temperature control method based on deep reinforcement learning in this embodiment, the specific method steps are as follows:
[0052] Step 1, customize the state space and action space of the mixed water system, and establish action network and value network;
[0053] Step 2, train the action network and value network according to the data generated by interacting with the mixed water environment, and obtain the DDPG model of mixed water temperature regulation;
[0054] Step 3: Deploy the DDPG model on the muddy water equipment, communicate with the cloud server in real time, update the equipment model parameters asynchronously, and realize self-adaptive learning of the new muddy water environment.
specific Embodiment approach 3
[0055] Specific implementation mode three: combination Figure 1-Figure 3 Describe this embodiment, the model-free adaptive mixed water temperature control method based on deep reinforcement learning in this embodiment, in step 1, the action network includes: action network, target action network; the value network includes judgment value network , the state space and the action space of the water mixing system of the target value network, the action space of the water mixing system is adjusting the rotation speed A∈[V of the paddle max , V min ], where V max is the maximum speed of temperature regulation, V min =-V max ;
[0056] The state space S is specifically: Which respectively represent: cold water end temperature before mixing, cold water end pressure before mixing, cold water end water flow before mixing, hot water end temperature before mixing, hot water end pressure before mixing, hot water end water flow before mixing , the current temperature after water mi...
PUM
Abstract
Description
Claims
Application Information
- R&D Engineer
- R&D Manager
- IP Professional
- Industry Leading Data Capabilities
- Powerful AI technology
- Patent DNA Extraction
Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.
© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com