Train cooperative operation control method based on reference deep reinforcement learning

A technology of reinforcement learning and operation control, applied in neural learning methods, constraint-based CAD, operation center control systems, etc., can solve problems such as control strategy parameters and devices that cannot be changed

Active Publication Date: 2022-08-09
SOUTHWEST JIAOTONG UNIV
View PDF7 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008]Finally, the previous control algorithms were designed based on the idealized mathematical modeling of the train system and the linear fitting of some nonlinear conditions, so in real In the environment, due to problems such as device wear and aging, it is impossible to change its control strategy parameters according to the equipment

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Train cooperative operation control method based on reference deep reinforcement learning
  • Train cooperative operation control method based on reference deep reinforcement learning
  • Train cooperative operation control method based on reference deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0040] The following combined with the attachment and the specific implementation method to further explain the present invention in detail.

[0041]A co -operating control method based on the reference to deeply enhanced learning is based on the reference. The control framework is figure 1 It shows the following steps:

[0042] Step 1: In the train simulation operating environment, based on vehicle information, road information, the operating speed curve of the front car plan, and the wireless network communication model to establish a co -operating simulation environment of the train in order to conduct preliminary training to strengthen the learning train collaborative control strategy. The emergency braking distance of high -speed trains based on national standards is 350km / h does not exceed 6500m, and the safety distance of the train is D_SAFE t = 7000m.

[0043] Step 2: Consider the delay of communication, according to the previous time the front of the car S 前t-1 , The curr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a train cooperative operation control method based on reference deep reinforcement learning, and the method specifically comprises the steps: building a train cooperative operation simulation environment, setting a train safety distance and the like, and calculating the estimated shortest real-time distance of two trains; setting a reward function, and establishing an input dimensionality reduction reinforcement learning algorithm controller; a reference controller is added, when the train meets a reference control strategy condition, a reference control signal is used for replacing a reinforcement learning control signal, and the part of data is used for optimizing a reinforcement learning control strategy; training the network until the global reward of the network is optimal and the control result is combined with the expectation, and considering that the preliminary training of the network is completed; and loading the reference control strategy and the reinforcement learning control strategy on the real train, and outputting a train control signal according to the real train information to complete the cooperative operation control of the train. According to the method, the optimal strategy training speed is increased, and the robustness of the control strategy in the actual operation process is ensured.

Description

Technical field [0001] The present invention is the field of coordinated control technology of the train, and especially involves a coordinated control method based on the reference to deeply enhanced learning. Background technique [0002] As an important infrastructure and popular transportation of the country, the railway is in the backbone position in China's comprehensive transportation system. With the continuous acceleration of my country's urbanization process and the continuous expansion of urban scale, rail transit construction has entered a period of rapid development, and the role of rail transportation has become more important in the choice of people's travel methods. The scale and quality of the road network, the level of modernization of technical equipment, and the volume of passenger and freight have reached the world's cash or even leading levels. China has become a veritable railway country. [0003] However, China Railway still has insufficient in terms of co...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F30/15G06F30/27G06N3/08B61L27/60G06F111/04
CPCG06F30/15G06F30/27G06N3/08G06F2111/04Y02T10/40
Inventor 黄德青王兴国秦娜
Owner SOUTHWEST JIAOTONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products