Check patentability & draft patents in minutes with Patsnap Eureka AI!

Multi-level converter control method based on reinforcement learning

A technology that reinforces learning and control methods, and is used in output power conversion devices, conversion of AC power input to DC power output, electrical components, etc.

Active Publication Date: 2021-11-02
HUAZHONG UNIV OF SCI & TECH
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Aiming at the defects and improvement needs of the prior art, the present invention provides a control method of a multilevel converter based on reinforcement learning, the purpose of which is to use the reinforcement learning algorithm directly according to the measured Input and output data are used for parameter training to achieve control, omitting many links in the traditional control of multi-level converters, such as PI control, modulation, voltage equalization control, etc.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-level converter control method based on reinforcement learning
  • Multi-level converter control method based on reinforcement learning
  • Multi-level converter control method based on reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0066] A modular multilevel converter (Modular Multilevel Converter, MMC) is one of the basic topologies of the multilevel converter. Here, a single-phase modular multilevel converter topology is taken as an example to describe the technical solution of the present invention in detail. figure 1 It is a topological structure diagram of the modular multilevel converter provided by Embodiment 1 of the present invention. Such as figure 1 As shown, the basic unit of the multilevel converter is a sub-module (SM), the topology includes two bridge arms, and each bridge arm includes N sub-modules and a bridge arm inductance L. u dc Is the DC bus voltage source, and R is the equivalent AC load of the MMC. u p i p are the output voltage and current of the upper bridge arm respectively, u n i n are the output voltage and current of the lower bridge arm respectively, i dc = i p + i n is the direct current, i a is the output current, u a is the output voltage. The modular multil...

Embodiment 2

[0168] Diode-clamped Multilevel Converter (Diode-clamped Multilevel Converter), also known as Neutral-Point-Clamping Multilevel Converter, is one of the basic topologies of multilevel converters , the technical solution of the present invention will be described in detail by taking a diode-clamped multilevel converter topology as an example. Figure 5 It is a topological structure diagram of a single-phase diode-clamped three-level inverter provided in Embodiment 2 of the present invention. Such as Figure 5 As shown, U dc is the DC bus voltage source, two capacitors C on the DC side 1 =C 2 , S a1 , S a2 , S a3 , S a4 and S b1 , S b2 , S b3 , S b4 Main power switch tube, parallel freewheeling diode, D 1 、D 2 、D 3 、D 4 for the clamping diode. R is the load resistance and L is the load inductance. i o is the midpoint current, i dc is the direct current, U dc1 , U dc2 is the voltage of the two capacitors on the DC side, i a is the output current, u a is the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a multi-level converter control method based on reinforcement learning, and belongs to the technical field of direct current transmission. The control method comprises the following steps: constructing a multi-input multi-output neural network by taking processed key electrical quantity as input and taking the probability of occurrence of actions adopted by each effective switch of a multi-level converter as output; using a neural network to control the multi-level converter; and meanwhile, introducing a reward value, and updating internal parameters of the neural network through a reinforcement learning algorithm. Therefore, the reinforcement learning algorithm is applied to the control of the multi-level converter with a relatively complex circuit, a complex circuit model does not need to be known, the parameters of the neural network can be directly updated according to the measured input and output data to realize control, and a plurality of links such as PI control, modulation and voltage-sharing control in the traditional control of the multi-level converter are omitted.

Description

technical field [0001] The invention belongs to the technical field of direct current transmission, and more specifically relates to a control method of a multilevel converter based on reinforcement learning. Background technique [0002] In recent years, with the successful application of power electronic technology in motor drive, reactive power compensation, active power filter and distributed power generation, the research and development of high-voltage and large-capacity power electronic equipment has attracted increasing attention. Restricted by the development level of power electronic devices, the traditional two-level converter topology is difficult to meet the requirements of high-voltage and large-capacity power electronic conversion. The emergence of multi-level converters has changed this situation. Considering the limited withstand voltage of a single device, multi-level converters use multiple devices to share high voltage, and clamp the terminal voltage of p...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): H02M7/487H02M1/32H02J3/18H02J3/01
CPCH02M7/487H02M1/32H02J3/18H02J3/01H02J2203/20Y02E40/30Y02E40/40
Inventor 陈宇姜海洋康勇
Owner HUAZHONG UNIV OF SCI & TECH
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More