Method and system for monitoring and early warning rail train driver state in real time based on Kinect

A driver status, real-time monitoring technology, applied in the measurement of pulse rate/heart rate, character and pattern recognition, diagnostic recording/measurement, etc., can solve the problems of lack of error correction mechanism and feedback mechanism, and achieve the effect of avoiding false detection

Active Publication Date: 2017-09-05
CENT SOUTH UNIV
View PDF5 Cites 42 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although this method can reduce misjudgment by drivers to a certain extent, it lacks an error correction mechanism and a feedback mechanism, and cannot fundamentally eliminate misjudgment.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for monitoring and early warning rail train driver state in real time based on Kinect
  • Method and system for monitoring and early warning rail train driver state in real time based on Kinect

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0046] The present invention will be further described below in conjunction with accompanying drawings and examples.

[0047] Such as figure 1 Shown, a kind of real-time monitoring and early warning method of the state of rail train driver based on Kinect comprises the following steps:

[0048] Step 1: Use the Kinect sensor array arranged in front of the cab to collect the driver's working status information;

[0049] The driver's working state information includes the driver's color image data, depth data, bone image data and voice data;

[0050] Step 2: Perform data processing on the driver's working status information;

[0051] Carry out the driver's heart rate detection on the collected driver's color image;

[0052] Extract facial features from the collected color image of the driver, use the Euler video amplification method to read the RGB representative pixels of each frame of facial feature images, use a band-pass filter to filter the RGB representative pixels, and ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method and a system for monitoring and early warning rail train driver state in real time based on Kinect. The method can only use one Kinect sensor to realize multiple functions such as train start detection, monitoring of driver heart rate, fatigue monitoring and misjudgment monitoring by ingeniously setting the Kinect sensor and comprehensively utilizing all detection functions of the Kinect sensor, and can use the Kinect sensor to perform data processing on acquired color image data, depth image data, bone image data and voice data; according to the method, all detection data is combined for use, and the fusion of rail train driver voice information, driver gesture information and train command signal information characteristics are combined, so that the phenomenon that a driver misreads or misjudges a signal or command can be directly avoided from the view of technical scheme; the system is simple in structure and convenient to operate, greatly lowers the cost of a monitoring and early warning system and has effects of accurately monitoring and early warning.

Description

technical field [0001] The invention belongs to the field of rail traffic control, in particular to a Kinect-based method and system for real-time monitoring and early warning of rail train driver status. Background technique [0002] During the train running, the physiological state of the train driver has a great influence on the safe operation of the train. The physiological state of train drivers mainly includes physiological health state and fatigue state. According to the Statistical Yearbook of Traffic Accidents, about 15-20% of railway traffic accidents are related to driver fatigue. Fatigue driving seriously affects the alertness, adaptability and safe driving ability of train drivers. In order to prevent the safety hazards of rail trains caused by fatigue driving, there is a button under the driver's foot in the cab, which requires the driver to step on it once within a certain period of time. Once the specified time is exceeded, the button will issue a warning to...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): A61B5/18A61B5/0205A61B5/11G06K9/62G06K9/00G10L15/22G10L15/26
CPCA61B5/0205A61B5/024A61B5/11A61B5/1103A61B5/1128A61B5/18G10L15/22G10L15/26A61B5/6893A61B5/746G10L2015/223G06V40/16G06V40/113G06V40/193G06V20/597G06F18/2135G06F18/214
Inventor 刘辉李燕飞
Owner CENT SOUTH UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap