Intelligent locomotive operation method and system based on deep reinforcement learning

A technology to strengthen learning and control systems, applied in general control systems, control/regulation systems, instruments, etc., can solve problems such as difficulty in ensuring optimization effects and large manual participation, so as to achieve intelligent optimization of locomotives and avoid manual participation. , reduce the effect of manual participation

Active Publication Date: 2017-06-13
TSINGHUA UNIV +2
View PDF6 Cites 65 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

These studies have relied on manual driving experience to a certain extent, and realized locomotive optimal maneuvering through expert system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Intelligent locomotive operation method and system based on deep reinforcement learning
  • Intelligent locomotive operation method and system based on deep reinforcement learning
  • Intelligent locomotive operation method and system based on deep reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] The technical solution of the present invention will be described in detail below in conjunction with the accompanying drawings and embodiments.

[0038] This embodiment provides a locomotive intelligent control system based on deep reinforcement learning, such as figure 1 As shown, the system includes four modules, namely: data source module, locomotive operating environment learning module, evaluation mechanism learning module and control strategy learning module.

[0039] The data source module is used to preprocess the obtained data sources. The data sources include locomotive operation logs, train operation traffic data, train operation energy consumption information and train operation timetable information. Data preprocessing is to extract locomotives from the data source The operation log and train operation data are sent to the locomotive operation environment learning module as the characteristic data of the locomotive operation environment, which constitute t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an intelligent locomotive operation method and system based on deep reinforcement learning. The system comprises a data source module, a locomotive operation environment learning module, an evaluation mechanism learning module and a control strategy learning module, the data source module provides needed data input for the locomotive operation environment learning module and the evaluation mechanism learning module, and the locomotive operation environment learning module and the evaluation mechanism learning module output an obtained specific operating environment and a reward function value to the control strategy learning module. On the basis of a deep reinforcement learning algorithm, a locomotive operation environment model takes real-time evaluation of the locomotive operation action as feedback information, by rewarding or punishing the current operation action, a reward function is fed back to the control strategy to serve as a reward evaluation value, and the control strategy is combined with the operating state to iteratively update and optimize the strategy. Accordingly, intelligent and optimized locomotive operation can be better achieved, and artificial participation is greatly reduced.

Description

technical field [0001] The invention relates to a locomotive manipulation method and system, in particular to a locomotive intelligent manipulation method and system based on deep reinforcement learning, belonging to the field of locomotive control. Background technique [0002] The automatic driving and optimal manipulation of railway locomotives play an important role in liberating manpower, reducing energy consumption, and improving locomotive punctuality and safety. Due to the complexity of the train operating environment and numerous influencing factors, scholars from various countries have conducted a lot of research on locomotive maneuvering optimization algorithms, which can be roughly divided into three categories: analytical solution methods, numerical optimization methods, and heuristic optimization algorithms. In the application of the analytical solution method, it is generally divided into two types: one is applied to locomotives whose input traction and brakin...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G05B13/04
Inventor 赵曦滨夏雅楠黄晋卢莎任育琦顾明孙家广
Owner TSINGHUA UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products