Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Energy system operation optimization-oriented reinforcement learning control system

An energy system and reinforcement learning technology, applied in the general control system, adaptive control, control/regulation system, etc., can solve the problems of uneconomical system operation, complex unit structure, low efficiency, etc., and achieve the effect of optimizing operation strategy learning

Active Publication Date: 2021-05-28
HUADIAN ELECTRIC POWER SCI INST CO LTD
View PDF8 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The purpose of the present invention is to overcome the above-mentioned deficiencies in the prior art, and provide a reinforcement learning control system oriented to energy system operation optimization, which solves the problem of energy diversity due to the energy system input fuel, output electricity, cold / heat energy, The control is complicated and other characteristics, the structure of the unit is complex, the coupling is strong, and the manual control often depends on the manual experience. The operation level of different personnel is uneven, which leads to problems such as uneconomical or low efficiency in system operation.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Energy system operation optimization-oriented reinforcement learning control system
  • Energy system operation optimization-oriented reinforcement learning control system
  • Energy system operation optimization-oriented reinforcement learning control system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0039] The present invention will be further described in detail below in conjunction with the accompanying drawings and examples. The following examples are explanations of the present invention and the present invention is not limited to the following examples.

[0040] Example.

[0041] see figure 1 , a reinforcement learning control system for energy system operation optimization, including the following parts:

[0042] 1) System structure

[0043] The reinforcement learning control system includes energy system (such as gas distributed energy system), operation data module (database), benefit evaluation module (reward item), deviation calculation module (punishment item) and agent (operation optimization).

[0044] The energy system includes three parts: energy input, energy supply output, and system control (such as system load regulation).

[0045] The operation data module stores the historical operation data of the energy system, including the energy input, energy ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an energy system operation optimization-oriented reinforcement learning control system, which is suitable for various energy systems, such as a gas distributed energy system and the like, and comprises an energy system (such as a gas distributed energy system), an operation data module (a database), a benefit evaluation module (a reward item), a deviation calculation module (a punishment item) and an intelligent agent (operation optimization). Through online reading and writing of the operation data module (a database), isolation of model training and energy system control is realized. Through reward feedback and punishment feedback of a benefit evaluation and deviation calculation model on an agent (operation optimization) model, intelligent agent (operation optimization) model training under the safe operation requirement of the energy system is realized. The optimal control output obtained through model training acts on the energy system, and online closed-loop control is achieved.

Description

technical field [0001] The invention relates to a reinforcement learning control system oriented to energy system operation optimization, which can be applied to the operation optimization control of various energy systems (such as gas distributed energy systems, etc.). Background technique [0002] Because the energy system inputs fuel, outputs electricity, cold / heat energy, has the characteristics of diverse energy supply and complex control, the unit structure is complex, and the coupling is strong. Manual control often depends on manual experience, and the operation and operation levels of different personnel are uneven. , resulting in uneconomical or inefficient system operation. At the same time, due to the complex process technology of the energy system, many equipments, variable characteristics, and multiple input and output forms, the conventional mechanism modeling is complicated, the accuracy is not enough, and it is more difficult to match the actual system opera...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G05B13/04
CPCG05B13/042
Inventor 王恒涛张宇龙孙思宇柳玉宾纪宇飞程思博
Owner HUADIAN ELECTRIC POWER SCI INST CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products