Data linkage analysis system based on GYK operation record and vehicle-mounted video

Abstract

The invention discloses a data linkage early warning analysis system based on a GYK operation record and a vehicle-mounted video, and relates to the technical field of rail transit, and the data linkage early warning analysis system comprises the steps that vehicle-mounted equipment collects vehicle operation data and vehicle-mounted video monitoring data respectively and sends the vehicle operation data and the vehicle-mounted video monitoring data to a ground storage analysis server; the ground storage analysis server performs timestamp synchronization and data fusion on the vehicle operation data and the vehicle-mounted video monitoring data, realizes real-time anomaly detection based on fused data, gives an alarm according to a preset early warning level, and transmits alarm information to the vehicle-mounted equipment; in addition, the WEB client is connected with the ground storage analysis server, and supports real-time data synchronous search and manual selection of alarm information. Through linkage analysis of the GYK operation record and the vehicle-mounted video file, intelligent early warning of rail car operation is achieved, and the operation safety and the fault early warning capacity of the rail car are effectively improved. And meanwhile, the operation process is simplified, and the working efficiency is improved.

Description

Technical Field

[0001] The present invention relates to the field of rail transit technology, and more specifically to a data linkage analysis system based on GYK operation records and vehicle-mounted videos. Background Art

[0002] At present, with the development of the rail transit industry and the increase in transportation safety requirements, ensuring the safety of railway vehicle operation has become a focus of attention. As the core driving control equipment of rail vehicles, GYK realizes precise control of rail vehicle speed, while the on-board video monitoring system provides safety assurance and timely feedback of emergency response for rail vehicle operation. At present, the data analysis of the two is carried out independently, with information islands and lack of linkage, which affects the comprehensiveness and accuracy of data analysis.

[0003] In the existing technology, GYK operation records and on-board video files are often analyzed separately, which makes it difficult to conduct effective linkage analysis, resulting in the inability to comprehensively utilize the two types of data for more comprehensive rail vehicle operation monitoring and fault warning. Existing solutions mostly use independent data storage and analysis systems, which fail to achieve data linkage and synchronous analysis, and are difficult to meet the needs of rail vehicle operation safety monitoring.

[0004] Therefore, how to conduct rail vehicle operation linkage analysis and early warning is a problem that technical personnel in this field urgently need to solve. Summary of the invention

[0005] In view of this, the present invention provides a data linkage analysis system based on GYK operation records and on-board videos, which can perform linkage analysis and early warning on rail vehicle operation through GYK operation records and on-board video files.

[0006] In order to achieve the above object, the present invention adopts the following technical solution:

[0007] A data linkage analysis system based on GYK operation records and vehicle-mounted videos, comprising: a vehicle-mounted device, a ground storage and analysis server, and a WEB client, wherein the vehicle-mounted device comprises a GYK device and a vehicle-mounted video monitoring device, which respectively collect vehicle operation data and vehicle-mounted video monitoring data and send them to the ground storage and analysis server; the ground storage and analysis server synchronizes the vehicle operation data and the vehicle-mounted video monitoring data with timestamps and fuses the data, performs real-time anomaly detection based on the fused data, issues an alarm according to a preset warning level, and transmits the alarm information to the vehicle-mounted device; the WEB client is connected to the ground storage and analysis server, and supports real-time synchronous search and manual selection of the fused data and alarm information of the ground storage and analysis server.

[0008] Preferably, the ground storage and analysis server specifically includes: a data processing module, a data fusion module, an anomaly detection module, and an alarm module. The data processing module synchronizes the vehicle operation data and the on-board video surveillance data with timestamps, and performs format conversion processing; the data fusion module performs data fusion on the vehicle operation data and the on-board video surveillance data after the format conversion processing; the anomaly detection module performs anomaly detection on the fused data according to a preset anomaly threshold and generates anomaly detection data; the alarm module issues an alarm of a corresponding warning level according to a preset warning level and the anomaly detection data.

[0009] Preferably, the data processing module includes:

[0010] Time synchronization module: GYK operation records and vehicle video monitoring data are both timestamped, and the two types of data are synchronized based on the timestamp;

[0011] The format conversion processing module processes the two types of data after time stamp synchronization, extracts key frame data and metadata from the vehicle-mounted video surveillance data at preset time intervals, and converts the vehicle operation status in the GYK operation record into a standardized value.

[0012] Preferably, the data fusion module fuses the key frame data, metadata and standardized values, and the fused data is stored in the form of a comprehensive file or a database table.

[0013] Preferably, the metadata in the format conversion processing module includes a timestamp, camera location information, and environmental monitoring data.

[0014] Preferably, the abnormality threshold preset in the abnormality detection module specifically includes:

[0015] Speeding thresholds: 10% over the speed limit is considered minor speeding, and 20% over the speed limit is considered severe speeding;

[0016] Acceleration threshold, deceleration exceeds 5m / s 2 For sudden braking;

[0017] Fatigue driving threshold: closing eyes for more than 2 seconds, more than 10 times per minute;

[0018] Braking system failure threshold, brake pressure fluctuation exceeds 10%, or braking effect does not meet expectations;

[0019] Acceleration abnormal threshold, exceeding 4m / s 2 For abnormal acceleration;

[0020] Frequent braking threshold: more than 5 braking times per kilometer is abnormal.

[0021] Preferably, the preset warning levels in the alarm module specifically include:

[0022] Low-level warning: the vehicle speed exceeds the prescribed speed limit by less than 10%; or the vehicle acceleration or deceleration is between 2-4m / s 2 or the air pressure or braking force of the brake system fluctuates slightly, with the pressure change within ±5%; or the driver closes his eyes for a short period of time for less than 2 seconds;

[0023] Intermediate warning: the vehicle speed exceeds the prescribed speed limit by 10-20%; or the acceleration exceeds 4m / s 2 But not more than 5m / s 2 ; or the brake system air pressure or braking force changes by more than ±10%; or the driver closes his eyes continuously for more than 2 seconds and the number of times is less than 10 times;

[0024] Advanced warning: vehicle speed exceeds the prescribed speed limit by more than 20%; or sudden braking or acceleration, with acceleration exceeding 5m / s 2 ; or the brake pressure or braking force fluctuates abnormally by more than ±15%; or the driver closes his eyes for more than 2 seconds and more than 10 times.

[0025] Preferably, it also includes a backup hard disk, which is used to back up the vehicle operation data and vehicle video monitoring data collected by the vehicle-mounted equipment, and supports importing these data into a ground storage and analysis server through manual operation.

[0026] It can be seen from the above technical solutions that, compared with the prior art, the present invention discloses a data linkage analysis system based on GYK operation records and on-board videos, which realizes the linkage analysis of GYK operation records and on-board video monitoring data, and provides a comprehensive analysis of the operation status of the rail vehicle; through the linkage analysis, more accurate fault warning and operation status monitoring are achieved, thereby improving the operation safety of the rail vehicle; automatic backup and intelligent correlation analysis technology reduce manual operations, simplify work processes, and improve work efficiency; significantly improve the ability of rail vehicle operation monitoring and fault warning, and provide a strong technical guarantee for railway transportation safety. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying creative work.

[0028] Figure 1 A schematic diagram of the structure provided by the present invention;

[0029] Figure 2A schematic diagram of the architecture provided by the present invention;

[0030] Figure 3 This is a data linkage analysis flow chart provided by the present invention. DETAILED DESCRIPTION

[0031] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0032] The embodiment of the present invention discloses a data linkage analysis system based on GYK operation records and vehicle-mounted videos, comprising: a vehicle-mounted device, a ground storage and analysis server, and a WEB client. The vehicle-mounted device comprises a GYK device and a vehicle-mounted video monitoring device, which are respectively used to collect vehicle operation data and vehicle-mounted video monitoring data and send them to the ground storage and analysis server; the ground storage and analysis server synchronizes the vehicle operation data and the vehicle-mounted video monitoring data with timestamps and fuses the data, performs real-time anomaly detection based on the fused data, issues an alarm according to a preset warning level, and transmits the alarm information to the vehicle-mounted device; the WEB client is connected to the ground storage and analysis server, and supports real-time synchronous search and manual selection of the fused data and alarm information of the ground storage and analysis server.

[0033] In a specific embodiment, the vehicle-mounted equipment includes a GYK device and a vehicle-mounted video monitoring device, which are used for vehicle operation data collection and environmental monitoring; the backup hard disk realizes automatic backup of the vehicle-mounted equipment operation video recording, reduces manual dump operations, and improves the reliability of video recording dump; the ground storage and analysis server realizes the storage and linkage analysis processing of the vehicle operation video recording and GYK operation records, and provides a client access interface. It adopts a B / S architecture design and is developed based on the Springboot technology framework. It supports unified conversion and storage of multiple video and voice formats; the WEB client, the end user performs data linkage analysis through the WEB client, supports real-time synchronous search and manual selection functions, and realizes intelligent correlation analysis of operation records and video files. The system synchronizes the GYK operation data collected by the vehicle-mounted equipment and the real-time information of the vehicle-mounted video monitoring to the ground storage and analysis server through a wireless network (such as 4G / 5G).

[0034] In a specific embodiment, Figure 2-3 As shown in the figure, the integrated data and alarm information of the ground storage and analysis server are uploaded to the railway intranet, and then queried by the WEB client through the railway intranet. It can support three-level linkage analysis and viewing of the work area, section, and railway bureau, improving the flexibility and practicality of data analysis.

[0035] In a specific embodiment, the ground storage and analysis server specifically includes: a data processing module, a data fusion module, an anomaly detection module, and an alarm module. The data processing module synchronizes the vehicle operation data and the on-board video surveillance data with the timestamps, and performs format conversion processing; the data fusion module fuses the vehicle operation data and the on-board video surveillance data after the format conversion processing; the anomaly detection module performs anomaly detection on the fused data according to a preset anomaly threshold and generates anomaly detection data; the alarm module issues an alarm of the corresponding warning level according to the preset warning level and the anomaly detection data.

[0036] In a specific embodiment, the data processing module includes:

[0037] Time synchronization module, GYK operation records and vehicle video monitoring data are all equipped with timestamp information, and the two types of data are synchronized based on the timestamp; ensuring that the vehicle's operating status matches the monitoring video in the same time period.

[0038] The format conversion processing module processes the two types of data after time stamp synchronization, extracts key frame data and metadata from the vehicle-mounted video surveillance data at preset time intervals, and converts the vehicle operation status in the GYK operation record into a standardized value. The formats of GYK operation records and video surveillance data are different. In order to achieve unified processing, the system standardizes the data. Specific operations include: converting the vehicle status (such as speed, direction, braking status) in the GYK operation record into a standardized value. Extract key frames and metadata (such as object detection information) from the vehicle-mounted video for use in conjunction with the operation record data. Each record contains the GYK operation status, video clips (or key frames) of the corresponding time period, and extracted environmental monitoring information (such as obstacle detection, driver operation status, etc.).

[0039] In a specific embodiment, the metadata in the format conversion processing module includes a timestamp, camera location information, and environmental monitoring data.

[0040] In a specific embodiment, the abnormality threshold preset in the abnormality detection module specifically includes:

[0041] Speeding thresholds: 10% over the speed limit is considered minor speeding, and 20% over the speed limit is considered severe speeding;

[0042] Acceleration threshold, deceleration exceeds 5m / s 2 For sudden braking;

[0043] Fatigue driving threshold: closing eyes for more than 2 seconds, more than 10 times per minute;

[0044] Braking system failure threshold, brake pressure fluctuation exceeds 10%, or braking effect does not meet expectations;

[0045] Acceleration abnormal threshold, exceeding 4m / s 2 For abnormal acceleration;

[0046] Frequent braking threshold: more than 5 braking times per kilometer is abnormal.

[0047] In a specific embodiment, the preset warning levels in the alarm module specifically include:

[0048] Low-level warning: the vehicle speed exceeds the prescribed speed limit by less than 10%; or the vehicle acceleration or deceleration is between 2-4m / s 2 or the air pressure or braking force of the brake system fluctuates slightly, with the pressure change within ±5%; or the driver closes his eyes for a short period of time for less than 2 seconds;

[0049] Intermediate warning: the vehicle speed exceeds the prescribed speed limit by 10-20%; or the acceleration exceeds 4m / s 2 But not more than 5m / s 2 ; or the brake system air pressure or braking force changes by more than ±10%; or the driver closes his eyes continuously for more than 2 seconds and the number of times is less than 10 times;

[0050] Advanced warning: vehicle speed exceeds the prescribed speed limit by more than 20%; or sudden braking or acceleration, with acceleration exceeding 5m / s 2 ; or the brake pressure or braking force fluctuates abnormally by more than ±15%; or the driver closes his eyes for more than 2 seconds and more than 10 times.

[0051] When a serious situation occurs, the system will automatically take over control and execute operations such as deceleration and parking to avoid accidents; at the same time, early warning information will be sent to the remote command center to help quickly respond to emergencies.

[0052] In a specific embodiment, it also includes a backup hard disk, which is used to back up the vehicle operation data and vehicle video surveillance data collected by the on-board equipment, and supports manual import of these data into the ground storage and analysis server. The on-board video surveillance data and GYK operation records are imported manually from the hard disk, and the terminal user uses the WEB client to perform data linkage analysis. The system transmits and protects user access data through network equipment and security equipment. During the data transmission process, in order to ensure the integrity and reliability of the data, TLS / SSL encryption is used to achieve data security when the WEB user terminal accesses it. The user password must also meet the password complexity requirements for password verification. Security measures are deployed in strict accordance with the security requirements of the railway integrated information network to ensure the accuracy, completeness and reliability of the data.

[0053] The terminal user accesses the server through the WEB linkage client. The client uses the operation record and video intelligent association technology to intelligently associate the records with the video to solve the problem that large quantities of records cannot be associated with the video for analysis. This technology has real-time accuracy: the system can associate the events in the record with the video to ensure that the corresponding video can be located quickly and accurately.

[0054] The linkage analysis process can integrate GYK operation data with video surveillance data to conduct a more comprehensive rail vehicle status analysis. For example, when an acceleration anomaly is detected, the video at the corresponding moment can be viewed synchronously to determine whether there is an obstacle or driver error.

[0055] In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the embodiments can be referred to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part.

[0056] The above description of the disclosed embodiments enables one skilled in the art to implement or use the present invention. Various modifications to these embodiments will be apparent to one skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A data linkage analysis system based on GYK operation records and vehicle-mounted videos, characterized in that: include: On-board equipment, ground storage and analysis server, and WEB client, the on-board equipment includes GYK equipment and on-board video monitoring equipment, which respectively collect vehicle operation data and on-board video monitoring data and send them to the ground storage and analysis server; the ground storage and analysis server synchronizes the vehicle operation data and the on-board video monitoring data with timestamps and fuses the data, performs real-time anomaly detection based on the fused data, issues an alarm according to a preset warning level, and transmits the alarm information to the on-board equipment; the WEB client is connected to the ground storage and analysis server, and supports real-time synchronous search and manual selection of the fused data and alarm information of the ground storage and analysis server.

2. According to claim 1, a data linkage analysis system based on GYK operation records and vehicle-mounted videos is characterized in that: The ground storage and analysis server specifically includes: a data processing module, a data fusion module, an anomaly detection module, and an alarm module. The data processing module synchronizes the vehicle operation data and the on-board video surveillance data with timestamps, and performs format conversion processing; the data fusion module performs data fusion on the vehicle operation data and the on-board video surveillance data after format conversion processing; the anomaly detection module performs anomaly detection on the fused data according to a preset anomaly threshold and generates anomaly detection data; the alarm module issues an alarm of a corresponding warning level according to a preset warning level and the anomaly detection data.

3. The data linkage analysis system based on GYK operation records and vehicle-mounted videos according to claim 2 is characterized in that: The data processing module comprises: Time synchronization module: GYK operation records and vehicle video monitoring data are both timestamped, and the two types of data are synchronized based on the timestamp; The format conversion processing module processes the two types of data after time stamp synchronization, extracts key frame data and metadata from the vehicle-mounted video surveillance data at preset time intervals, and converts the vehicle operation status in the GYK operation record into a standardized value.

4. The data linkage analysis system based on GYK operation records and vehicle-mounted videos according to claim 3 is characterized in that: The data fusion module fuses the key frame data, metadata and standardized values, and the fused data is stored in the form of a comprehensive file or a database table.

5. The data linkage analysis system based on GYK operation records and vehicle-mounted videos according to claim 3 is characterized in that: The metadata in the format conversion processing module includes timestamp, camera location information and environmental monitoring data.

6. The data linkage analysis system based on GYK operation records and vehicle-mounted videos according to claim 2 is characterized in that: The abnormality thresholds preset in the abnormality detection module specifically include: Speeding thresholds: 10% over the speed limit is considered minor speeding, and 20% over the speed limit is considered severe speeding; Acceleration threshold, deceleration exceeds 5m / s 2 For sudden braking; Fatigue driving threshold: closing eyes for more than 2 seconds, more than 10 times per minute; Braking system failure threshold, brake pressure fluctuation exceeds 10%, or braking effect does not meet expectations; Acceleration abnormal threshold, exceeding 4m / s 2 For abnormal acceleration; Frequent braking threshold: more than 5 braking times per kilometer is abnormal.

7. The data linkage analysis system based on GYK operation records and vehicle-mounted videos according to claim 2 is characterized in that: The preset warning levels in the alarm module specifically include: Low-level warning: the vehicle speed exceeds the prescribed speed limit by less than 10%; or the vehicle acceleration or deceleration is between 2-4m / s 2 or the air pressure or braking force of the brake system fluctuates slightly, with the pressure change within ±5%; or the driver closes his eyes for a short period of time for less than 2 seconds; Intermediate warning: the vehicle speed exceeds the prescribed speed limit by 10-20%; or the acceleration exceeds 4m / s 2 But not more than 5m / s 2 ; or the brake system air pressure or braking force changes by more than ±10%; or the driver closes his eyes continuously for more than 2 seconds and the number of times is less than 10 times; Advanced warning: vehicle speed exceeds the prescribed speed limit by more than 20%; or sudden braking or acceleration, with acceleration exceeding 5m / s 2 ; or the brake pressure or braking force fluctuates abnormally by more than ±15%; or the driver closes his eyes for more than 2 seconds and more than 10 times.

8. The data linkage analysis system based on GYK operation records and vehicle-mounted videos according to claim 1 is characterized in that: It also includes a backup hard disk, which is used to back up the vehicle operation data and vehicle video monitoring data collected by the vehicle-mounted equipment, and import the vehicle operation data and vehicle video monitoring data into a ground storage and analysis server through manual operation.

Images