Interruptible load optimization method based on deep reinforcement learning

A technology to enhance learning and load, applied in neural learning methods, climate sustainability, instruments, etc., can solve the problems of not being able to automatically identify users' electricity consumption habits, not being able to guide power users to use electricity reasonably, and not being able to obtain optimal control strategies , to achieve the effect of ensuring voltage stability and power supply quality, accommodating random output, and guiding reasonable power consumption

Inactive Publication Date: 2020-07-17
STATE GRID CORP OF CHINA +2
View PDF6 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The Chinese invention patent application with the publication number CN 108767883 A discloses a response processing method on the demand side, including: obtaining historical data of power consumption of users, the historical data including historical data of power consumption of fixed power consumption equipment and controllable power consumption The historical data of power consumption of the equipment; the statistics of the historical data are used to identify the abnormal points of the load; the statistics of the historical data of the removed abnormal points of the load are carried out to obtain the average power consumption data in the billing cycle; the controllable power consumption equipment The relationship between power and time is the independent variable, the relationship between the charging and discharging power of the energy storage device and time is the independent variable, the total energy consumption of the preset working cycle of the controllable power consumption device is the constraint, and the capacity of the energy storage device is As a constraint condition, the relationship between the power and time of the controllable power consumption device and the charge and discharge power of the energy storage device and Optimize the relationship between time; process the controllable power consumption device and energy storage device according to the optimization result, and optimize the relationship between the power and time of the controllable power consumption device and the relationship between the charging and discharging power and time of the energy storage device at the same time , which further increases the role of existing equipment in stabilizing power consumption, reduces costs and reduces fluctuations in the power grid, but can only perform statistical analysis on historical data, cannot automatically identify users' electricity consumption habits, and cannot be optimally controlled strategy, cannot guide electricity users to use electricity rationally

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Interruptible load optimization method based on deep reinforcement learning
  • Interruptible load optimization method based on deep reinforcement learning
  • Interruptible load optimization method based on deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] In order to make the purpose, technical solutions and advantages of the present invention clearer, the principles and features of the present invention will be described below in conjunction with the accompanying drawings. The examples given are only used to explain the present invention, and are not used to limit the scope of the present invention.

[0041] Such as figure 1 Shown is a flow diagram of the interruptible load optimization method based on deep reinforcement learning, and the specific steps are as follows:

[0042] (1) Install measurement devices at DER access nodes to make them observable node measurement data. According to the common electricity consumption information collection system, sampling is performed every minute, that is, a total of 1440 sampling points per day. The node power information in the observation sample is obtained by the smart meter. It is worth noting that in order to speed up the learning process, it needs to be normalized, so in ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an interruptible load optimization method based on deep reinforcement learning, and belongs to the field of power distribution network demand response. The method comprises the following steps: acquiring an observation state of a system at a moment t through an intelligent electric meter and a measurement device, and taking the observation state as an observation sample; training a neural network based on a dueling depth Q network (DDQN) by using the acquired observation sample, periodically clearing the observation sample to ensure that the neural network learns the latest observation state, and acquiring the trained neural network through a certain number of calculation iterations; reading the data in the measurement device to acquire the real-time state of a power distribution network; sending to the trained neural network; and screening interruptible load points by using a node voltage within the allowable range after the interruptible load action as a constraint condition and user satisfaction as an index. According to the invention, the power consumption habit of a user can be automatically recognized, a set of interruptible load points meeting the operation condition and having the high user satisfaction are screened out, and the method has good application prospects.

Description

technical field [0001] The invention relates to the field of distribution network demand side management, and more specifically, relates to an interruptible load optimization method based on deep reinforcement learning. Background technique [0002] Distributed energy resource (DER) output has random fluctuations due to the influence of weather factors. Its extensive access to the distribution network leads to a decline in the power quality of the distribution network. Demand-side response is a flexible and fast user-side The response method is that the users of the distribution network directly adjust their own load demand and power consumption mode. It is completely a voluntary participation behavior of the user, which aims to quickly improve demand elasticity and smooth the load curve. effective measures. [0003] The Chinese invention patent application with the publication number CN 108767883 A discloses a response processing method on the demand side, including: obtai...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06Q10/04G06Q10/06G06Q50/06H02J3/14G06N3/04G06N3/08
CPCG06Q10/04G06Q10/06315G06Q50/06G06N3/08H02J3/14G06N3/045Y04S20/222Y02B70/3225
Inventor 李秋燕王利利张艺涵田春筝李科郭新志于昊正付科源马杰孙义豪全少理郭勇杨卓罗潘明威宇李妍王少荣
Owner STATE GRID CORP OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products