Smart power grid partition network reconstruction method based on multi-agent reinforcement learning

A reinforcement learning, multi-agent technology, applied in the direction of AC network circuits, electrical components, circuit devices, etc., can solve the problems of slow processing speed, lack of countermeasures for risks, and huge calculation amount of optimization algorithms, so as to achieve good response measures and training. The effect of high efficiency and fast decision-making

Pending Publication Date: 2022-03-01
HARBIN ENG UNIV
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Traditional network reconfiguration relies on optimization algorithms or expert experience. Optimization algorithms often have a large amount of calculation and slow processing speed, which is not conducive to real-time applications
Expert experience lacks the means to deal with possible risks that have never occurred, and it is difficult to solve the increasingly complex power system operation safety issues
In addition, it is difficult to consider the uncertainty of wind power, photovoltaic power generation and load at the same time in traditional network reconfiguration
Before performing network reconfiguration, it is necessary to estimate the operating state of the power grid after network reconfiguration. The accuracy of the estimation directly determines the quality of network reconfiguration actions, which increases the difficulty of network reconfiguration.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Smart power grid partition network reconstruction method based on multi-agent reinforcement learning
  • Smart power grid partition network reconstruction method based on multi-agent reinforcement learning
  • Smart power grid partition network reconstruction method based on multi-agent reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] The present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0042] An automatic decision-making method for smart grid partitions based on multi-agent reinforcement learning, its overall flow chart refers to figure 1 , the method includes the following steps:

[0043] Step 1: Divide the power grid into N regions according to the needs of power grid operation, and construct the basic elements of multi-agent reinforcement learning (MARL), including environment, agent, state, observation, action, and reward function.

[0044] Step 2: Run the power system simulation environment to create the initial operating state data set of the power system.

[0045] Step 3: Construct a deep neural network model, and train the decision-making agent with enhanced inter-agent learning (RIAL).

[0046] Step 4: Use the trained agent to provide strategies for grid control.

[0047] The present invention also inclu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an intelligent power grid partition network reconstruction method based on multi-agent reinforcement learning, and the method comprises the following steps: 1, dividing a power grid into N regions according to the operation demands of the power grid, and constructing the basic elements of the multi-agent reinforcement learning, including environment, agents, states, observation, actions and reward functions; 2, operating the simulation environment of the power system, and creating an initial operation state data set of the power system; 3, constructing a deep neural network model, and training a decision-making agent by applying learning between enhanced agents; and 4, providing a strategy for power grid reconstruction by using the trained intelligent agent. According to the invention, through interaction between multiple agents and a power simulation environment, an optimal network reconstruction strategy is learned offline and is applied to an actual power grid online.

Description

technical field [0001] The invention relates to the field of multi-agent reinforcement learning, in particular to a smart grid partition network reconfiguration method based on multi-agent reinforcement learning Background technique [0002] Network reconfiguration refers to changing the network topology of the power grid, that is, changing the operating state of the tie switch and section switch of the power grid, so as to transfer the load between feeders or distribution stations, thereby changing the operating state of the power grid. When the power grid fails, network reconfiguration can restore the safe and stable operation of the power grid. Traditional network reconfiguration relies on optimization algorithms or expert experience. Optimization algorithms often have a large amount of calculation and slow processing speed, which is not conducive to real-time applications. Expert experience lacks the means to deal with possible risks that have not occurred, and it is di...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H02J3/00G06F30/27G06F113/04
CPCH02J3/00G06F30/27H02J2203/10H02J2203/20G06F2113/04
Inventor 卢芳陈理先王琴姚绪梁兰海刘宏达黄曼磊刘瑜超
Owner HARBIN ENG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products