Integrated intelligent cabin system for train driver

Through the integrated intelligent cockpit system, combined with drones and artificial intelligence, the problem of insufficient intelligence of train cockpit systems in the existing technology is solved, efficient information transmission and intelligent verification of driver behavior are realized, and the intelligent operation of trains is improved. and security.

CN118991877APending Publication Date: 2024-11-22CASCO SIGNAL LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202411409569.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-10
Publication Date
2024-11-22

AI Technical Summary

Technical Problem

The existing train cockpit system is not intelligent enough, and drivers need to repeatedly confirm information multiple times. The lack of combination of voice recognition and image recognition technology has led to unfriendly human-computer interaction, low intelligence level, and it is difficult to improve driver behavior inspection.

Method used

Design a collective intelligent cockpit system for train drivers, including train assist management system, driving control system and central control system, use drones to obtain forward images, combine artificial intelligence models for intelligent verification of driver behavior and visual line assistance, Provide voice operation and information communication functions to realize data interaction and self-adjustment.

Benefits of technology

The intelligence and informatization level of train operation has been improved, and the driver's vision is extended through drones, information transmission efficiency and emergency response efficiency have been improved, and drivers' convenience and safety are enhanced.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118991877A_ABST
    Figure CN118991877A_ABST
Patent Text Reader

Abstract

The invention relates to a train driver-oriented integrated intelligent cabin system, which comprises a train auxiliary management system for acquiring train driver end information; the train running control system is used for acquiring train running end information; the central control system is respectively connected with the train auxiliary management system and the train running control system to realize data interaction between the train auxiliary management system and the train running control system; the central control system generates a train running instruction according to the train running end information and the train driver end information and sends the train running instruction to the train running control system, and the train running control system controls train running according to the train running instruction; the train auxiliary management system, the train running control system and the central control system conduct self-running adjustment according to data of the train auxiliary management system, the train running control system and the central control system. The system has the advantage of improving the intelligence and informatization level of train operation.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of train cockpit systems, and in particular to an integrated intelligent cockpit system for train drivers. Background Art

[0002] Improving the driver's driving level and experience is crucial to improving train operation. Currently, there are few targeted solutions to optimize the driver's cockpit side. Existing trains have multiple system human-machine interaction interfaces such as CIR (Cab Integrated Radio communication equipment), ATP (Automatic Train Protection), LKJ (L "train" K "control" J "monitoring", train operation monitoring device) and IDU (interface data unit), and the driver needs to confirm repeatedly.

[0003] Moreover, there is room for improvement in human-machine friendliness and intelligence, for example, there is no interactive information between display programs on the same trains, the level of intelligence in the train driver's cab is insufficient, the auxiliary means for the driver's close sight distance are limited, the level of driver behavior inspection needs to be improved, and the latest AI technologies such as voice recognition and image recognition are not fully integrated. Summary of the invention

[0004] The purpose of the present invention is to provide a collective intelligent cockpit system for train drivers, which has the advantages of improving the intelligence and information level of train operation.

[0005] To achieve the above-mentioned objectives, the present invention provides an integrated intelligent cockpit system for train drivers, the system comprising: a train auxiliary management system for acquiring train driver-side information; a train travel control system for acquiring train operation-side information; a central control system, which is respectively connected to the train auxiliary management system and the train travel control system to realize data interaction between each other; the central control system generates a train operation instruction based on the train operation-side information and the train driver-side information, and sends it to the train travel control system, which controls the train operation according to the train operation instruction; the train auxiliary management system, the train travel control system and the central control system adjust their own operation based on each other's and their own data; the train auxiliary management system comprises: a driver behavior intelligent verification system, a driver sight distance system and a driver operation assistance system; the driver sight distance system includes a drone body, and an observation image of the train's front approach is obtained by installing a camera on the drone body.

[0006] Preferably, the central control system includes a display interaction system, which displays all data received by the central control system; and the basic control of the train auxiliary management system and the train travel control system is realized through the display interaction system.

[0007] Preferably, the train driver-side information is information related to train operation generated with the train driver as the core.

[0008] Preferably, the train operation terminal information is information related to train operation generated with train operation as the core.

[0009] Preferably, the driver behavior intelligent verification system includes: a motion capture module, which obtains the driver's motion information; a motion analysis module, which is connected to the motion capture module, receives and analyzes the driver's motion information, and converts it into the driver's motion results; a motion verification module, which is respectively connected to the motion analysis module and the central control system, and is used to receive the driver's motion results and collect ideal motion results, and then compare and verify the driver's motion results with the ideal motion results, and output the corresponding train driver-side information to the central control system.

[0010] Preferably, the motion capture module, motion analysis module and motion verification module are all implanted with corresponding artificial intelligence models.

[0011] Preferably, the artificial intelligence model adopts a diffusion model, the motion capture module converts the driver's motion information into data code, the motion analysis module analyzes the data code to extract the nodes of key actions in the data code, and the motion verification module verifies the nodes of key actions and outputs corresponding results.

[0012] Preferably, the driver sight distance system further comprises: a plurality of cameras installed on the train body, the cameras are all connected to the central control system, and the central control system displays the captured content in real time.

[0013] Preferably, the driver sight distance system also includes: a drone starting module, which is connected to the central control system and the drone body respectively, and is used to store the parameters and operating programs of the drone, and output drone instructions to the drone body according to the data from the central control system; the drone body performs observation tasks according to the drone instructions of the drone starting module and obtains observation data; a drone data collection module, which is connected to the drone starting module, the drone body and the central control system respectively, receives data from the drone starting module and the drone body, and transmits it to the central control system.

[0014] Preferably, the driver operation assistance system includes: an identity authentication module, which is connected to the central control system, receives identity card information from the central control system and verifies the driver's identity, and sends an auxiliary system start-up instruction when the identity card verification is successful; an object selection module, which is connected to the identity authentication module, and generates a communication instruction when receiving the auxiliary system start-up instruction; an information communication module, which is connected to the object selection module, receives the communication instruction from the object selection module, and realizes information communication according to the communication instruction; the information communication module is also connected to the central control system to realize interaction with the outside world.

[0015] Preferably, the driver operation assistance system includes: a train information calling module, which is connected to the central control system and generates an information calling instruction according to the information calling request from the central control system; a cloud database module, which is connected to the train information calling module and the central control system respectively, and the cloud database module is used to store train information, extract corresponding cloud data according to the received information calling instruction, and transmit it to the central control system to realize interaction with the outside world.

[0016] Preferably, the train control system includes: a train automatic protection device, or / and a train automatic operation device, or / and a locomotive integrated wireless communication device, or / and a train operation monitoring device; any of the above devices are connected to the central control system; the train automatic protection device, or / and the train automatic operation device, or / and the locomotive integrated wireless communication device, or / and the train operation monitoring device all control the train operation according to the train operation instructions.

[0017] Preferably, any of the above devices is provided with a corresponding anti-mistaken-touch module and connected thereto, and when the driver makes an erroneous operation, the anti-mistaken-touch module performs corresponding feedback.

[0018] Preferably, any of the above devices is provided with a corresponding alarm device and connected thereto, and when the alarm device detects dangerous information, an alarm message is sent to the driver; the alarm device sends the dangerous information to the central control system through the corresponding device, and the central control system further sends it to the driver's operation assistance system to realize the relevant information query of the emergency plan.

[0019] Preferably, any of the devices is provided with a corresponding emergency call module and connected thereto, and the emergency call module triggers an emergency call and automatically sends rescue information.

[0020] Preferably, the display interaction system includes: a security protection layer, which is respectively connected to the train driving control system and the train auxiliary management system, receives the train driver side information / train operation side information, and performs a security check on the train driver side information / train operation side information; a human-computer interaction layer, which is connected to the security protection layer signal, receives the checked train driver side information / train operation side information, and displays it.

[0021] A computer-readable storage medium stores a computer program, which, when executed by a processor, implements the aforementioned integrated intelligent cockpit system for train drivers.

[0022] An electronic device includes a processor and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, the aforementioned integrated intelligent cockpit system for train drivers is implemented.

[0023] In summary, compared with the prior art, the integrated intelligent cockpit system for train drivers provided by the present invention has the following beneficial effects:

[0024] First, the present invention proposes an integrated intelligent cockpit system for train drivers to achieve efficient transmission of information.

[0025] Secondly, the present invention proposes a driver sight distance system based on a drone, which supports remote control by the driver and transmits real-time images to the central control system, thereby extending the driver's eyes.

[0026] Third, the present invention proposes an integrated intelligent cockpit system for train drivers, which can enable drivers to obtain more information and help form better posture strategies.

[0027] Fourth, the present invention proposes an integrated intelligent cockpit system for train drivers, which supports voice input, facilitates driver operation, provides operation suggestions for drivers, improves the driver's emergency response efficiency in case of failure, and facilitates the driver to focus on vehicle control observation and operation. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 The figure is a schematic diagram of an embodiment of the driver sight distance system of the present invention.

[0029] Figure 2 It is a schematic diagram of an embodiment of the display interaction system of the present invention.

[0030] Figure 3 The figure is a schematic diagram of an embodiment of the driver behavior intelligent verification system of the present invention.

[0031] Figure 4 The figure is a schematic diagram of an embodiment of the driver behavior intelligent verification system of the present invention.

[0032] Figure 5 A schematic diagram of an embodiment of a collective intelligent cockpit system for train drivers proposed by the present invention. DETAILED DESCRIPTION

[0033] The following will be combined with the attached embodiment of the present invention Figure 1~Attached Figure 5 , the technical solutions, structural features, objectives achieved and effects in the embodiments of the present invention are described in detail.

[0034] It should be noted that the drawings are in a very simplified form and use non-precise proportions. They are only used to conveniently and clearly assist in explaining the embodiments of the present invention, and are not used to limit the conditions for the implementation of the present invention. Therefore, they have no substantive technical significance. Any structural modification, change in proportional relationship or adjustment of size, without affecting the effects and purposes that can be achieved by the present invention, should still fall within the scope of the technical content disclosed by the present invention.

[0035] It should be noted that, in the present invention, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only the elements explicitly listed, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0036] The present invention provides an integrated intelligent cockpit system for train drivers, which is used to facilitate train drivers to handle various situations of train operation, such as inter-train communication, communication between trains and radio block centers, train emergency braking, and capture of train operation environment conditions. The system has the advantages of improving the intelligence and convenience of train operation.

[0037] like Figure 5 As shown, the system comprises:

[0038] Train auxiliary management system, obtains train driver-side information;

[0039] Train control system, obtains train operation information;

[0040] The central control system is connected to the train auxiliary management system and the train driving control system respectively to realize data interaction between them, including receiving information from the train operation end and the train driver end;

[0041] The central control system generates a train operation instruction according to the train operation terminal information and the train driver terminal information, and sends it to the train driving control system. The train driving control system controls the train operation according to the train operation instruction.

[0042] Among them, the train auxiliary management system, train driving control system and central control system can adjust their own operation according to each other's and their own data. For example, the central control system can decide which information transmission strategy to adopt to the outside world according to the priority order of the train driver's end information sent by the train auxiliary management system; the train auxiliary management system can decide which function to enable according to the train operation end information of the train driving control system (see below for details); the train auxiliary management system itself can obtain the driver's operation status according to the train driver's end information and decide whether to record certain scenes (such as driver operation errors).

[0043] Examples of the train driver-side information are as follows: (1) the train driver's action confirmation feedback on the train driving signal; (2) the train driver's voice confirmation feedback on the train driving signal; (3) the train driver's sight range adjustment; (4) the execution status of the train driver and the dispatching center; (5) the train driver's action feedback in emergency situations, etc. In short, the train driver-side information is a series of information related to train operation generated with the train driver as the core.

[0044] Examples of the train operation end information are as follows: (1) the transmission of train operation data; (2) the automatic operation of the train; (3) the activation status of the train automatic protection device; (4) the operation status of the train operation monitoring equipment, etc. In short, the train operation end information is a series of information related to the train operation generated with the train operation as the core.

[0045] Furthermore, in a preferred embodiment, the central control system includes a display interaction system, which can display all data received by the central control system (including train operation end information and train driver end information), so as to facilitate the outside world to read the corresponding situation. In addition, the control of the train auxiliary management system and the train driving control system can be set in the display interaction system, and the driver end can implement the basic control of the train auxiliary management system and the train driving control system through the display interaction system, which is quite convenient. In a specific embodiment, the display interaction system can be implemented by setting a corresponding operating program with a display screen as the core.

[0046] Continue as Figure 5 As shown, the following introduces a specific embodiment of a control system, and will introduce the train auxiliary management system, the train travel control system and the central control system respectively:

[0047] (I) Train auxiliary management system

[0048] The function of the train auxiliary management system is to obtain information from the train driver. In order to ensure the acquisition of information, the train auxiliary management system includes: a driver behavior intelligent verification system, a driver sight distance system and a driver operation assistance system. The following will introduce the three lower-level systems one by one;

[0049] (1) Driver behavior intelligent verification system

[0050] The driver behavior intelligent verification system is mainly designed for the situation that when the train enters or leaves the station, the driver needs to give corresponding action feedback to the instructions of the station attendant or the signal from the train control system, that is, the verification and comparison between the ideal action result (the instruction of the station attendant or the signal from the train control system) and the driver's action result (the driver's action feedback);

[0051] The driver behavior intelligent verification system comprises:

[0052] Motion capture module, to obtain driver motion information;

[0053] The motion analysis module is connected to the motion capture module, receives and analyzes the driver's motion information, and converts it into the driver's motion results;

[0054] The action verification module is connected to the action analysis module and the central control system respectively, and is used to receive the driver's action results and collect ideal action results, then compare and verify the driver's action results with the ideal action results, and output the corresponding train driver-side information to the central control system.

[0055] In order to further optimize the smooth operation of the driver behavior intelligent verification system, an artificial intelligence model can also be used to assist in operation. The motion capture module, motion analysis module and motion verification module can all be implanted into the corresponding artificial intelligence model to achieve operation optimization.

[0056] The specific scenarios are as follows:

[0057] When the train leaves the station, the station attendant gives the corresponding gesture signal for departure on the platform (i.e. the ideal action result); or when the train control system receives relevant signals from the train travel section, the driver needs to make corresponding actions to indicate that he has received them.

[0058] Specifically, the motion capture module automatically collects the driver's gestures (driver motion information), enters the artificial intelligence model for preliminary judgment, and the motion analysis module receives the driver's gestures, and further analyzes the driver's gestures using the artificial intelligence model to obtain the corresponding driver motion results. In this embodiment, the driver's motion result is assumed to be "driving at a safe speed"; at this time, the driver's motion result is transmitted to the motion verification module, and the motion verification module uses the artificial intelligence model for verification within a certain period of time. If the driver's motion result is inconsistent with the ideal motion result, the train driver-side information "the driver did not perform the standard process" is output. As mentioned above, the central control system receives the train driver-side information and then interacts with the outside world, such as communicating the train driver-side information with the wireless block center, and can also communicate with other trains on the same track. The outside world here is the outside world in a broad sense.

[0059] In addition, as mentioned above, the train auxiliary management system, the train driving control system and the central control system can adjust their own operation according to each other's and their own data; the same is true at this time, when the train auxiliary management system outputs the train driver-side information "the driver did not execute the standard process", the other modules of the train auxiliary management system can operate independently, for example, when the train auxiliary management system outputs the information "the driver did not execute the standard process", the remaining modules of the train auxiliary management system automatically query the emergency manual and send it to the driver, automatically start the phone to actively communicate and remind, etc.; for example, the train driving control system can also enter the pre-start mode according to the information ("the driver did not execute the standard process"), that is, the standard response process is pre-set when the condition of "the driver did not execute the standard process" is met, so that when the above situation is met, the train can automatically respond to reduce the operation risk; the central control system can also decide whether to clearly display the information through the display screen according to the information ("the driver did not execute the standard process"), that is, the standard response process is pre-set when the condition of "the driver did not execute the standard process" is met, so that when the above situation is met, the central control system actively intervenes and actively reminds the driver.

[0060] In addition, a diffusion model can be used for the artificial intelligence model. The diffusion model is a method for generating high-quality images by learning the reverse process of noise. The implementation example using the diffusion model is as follows: the motion capture module converts the driver's gesture image (driver motion information) into a data code, the motion analysis module analyzes the data code, and extracts the nodes of key actions in the data code. The action verification module only needs to verify the nodes of key actions and output the corresponding results.

[0061] In addition, the driver's posture and movements can be captured through the driver behavior intelligent verification system to monitor the driver's fatigue status. For example, when the driver is in a fatigued state and the train is running at high speed, the central control system will issue a "safe driving" train operation instruction to the train control system.

[0062] In addition, the driver behavior intelligent verification system can also add a language recognition module. In this case, the driver behavior intelligent verification system records, analyzes, and converts the driver's voice into text information, and retrieves and matches it with the text keywords corresponding to the ideal results, and outputs the corresponding results; the specific principles are as described above and will not be repeated here.

[0063] (2) Driver sight distance system

[0064] The driver sight distance system refers to a system in which the driver in the cockpit observes the train's forward approach. It is a system that assists the driver in observing the driver's sight distance of the train. For example, multiple cameras can be installed on the train body, and the cameras are all connected to the central control system (in this case, the display interaction system of the central control system uses a display screen). The driver can observe the captured environmental information in real time through the central control system. In addition, in order to further save space resources and line resources, solar cells can be installed to power the cameras.

[0065] The above is an example of a driver sight distance system. This embodiment proposes to use a drone to design a driver sight distance system. Under this design, the driver sight distance system includes:

[0066] The drone startup module is connected to the central control system and is used to store the parameters and operating programs of the drone, and output drone instructions based on the data from the central control system; the data from the central control system, such as the driver's operating behavior in the display interaction system of the central control system; the drone startup module converts this operating behavior into drone instructions for the drone, thereby realizing the subsequent process. For example, the drone startup module sets certain conditions for outputting drone instructions. For example, when the central control system receives the driver's multiple confirmations of the posture of the road ahead in the driver's behavior intelligent verification system, when this condition is met, because of the data interaction between them, the drone startup module can obviously obtain the corresponding data, and then start to realize the subsequent process;

[0067] The drone body is connected to the drone start module, performs observation tasks according to the drone instructions of the drone start module, and obtains observation data; generally, the drone body is equipped with a camera for observation, which is not limited here;

[0068] The UAV data collection module is connected to the UAV start module, the UAV body and the central control system respectively, receives data from the UAV start module and the UAV body, and transmits it to the central control system; the purpose of connecting with the UAV start module is to store UAV instructions to facilitate subsequent review operations, etc.; the purpose of connecting with the UAV body is to obtain observation data; the purpose of connecting with the central control system is to realize data transmission (train driver-side information, specifically the observation data used by the driver) and display the corresponding results to the outside world.

[0069] The following is a method of operating the driver's line of sight system under the drone:

[0070] Step S1, pre-set the parameters and running program of the drone startup module. When the startup conditions of the drone startup module are met, the drone startup module sends a drone command to the drone body and enters step S2. If not, keep silent;

[0071] Step S2, the drone body observes the corresponding area according to the drone command and transmits the observation data to the drone data collection module;

[0072] In step S3, the drone data collection module processes the observation data in segments and transmits key information to the central control system.

[0073] Among them, the subdivision processing of step S3 refers to capturing key images of the observed image, such as whether there are obstacles or automatically selecting the best fragment; step S3 can also skip the subdivision processing stage. For example, when the central control system uses a display screen, the observation data is directly transmitted to the display screen of the central control system through the drone data collection module. In this way, information of the corresponding area can be obtained in the form of real-time images, which is convenient for the driver to grasp the environment of the road ahead; at this time, the drone data collection module only plays a role in transmitting the observation data.

[0074] The following is a specific embodiment of a driver sight distance system using a drone, in which the activation condition is "when the train driving control system needs to perform a braking operation". Because when the train performs a braking operation, the driver also needs to perform a corresponding operation, so the driver sight distance system needs to provide the driver with the corresponding situation of the front route; in this embodiment, the central control system uses a display screen;

[0075] Step Q1, the UAV start module meets the start condition (when the train driving control system needs to perform a braking operation and the driver needs to confirm that the route ahead is an idle route), the UAV start module starts running, and the UAV start module sends a UAV command to the UAV body;

[0076] The specific data transmission method will not be described here;

[0077] Step Q2, the drone body observes the corresponding area according to the drone command and transmits the observation data to the drone data collection module;

[0078] Step Q3, the drone data collection module directly transmits the observation data to the central control system;

[0079] Step Q4, the display screen of the central control system directly displays the observation data in real-time image form;

[0080] Step Q5: The driver observes the corresponding area through the display screen and performs auxiliary operations of train braking.

[0081] Among them, the observation method of step Q2 can be automatic mode or active mode; if it is automatic mode, the drone body automatically runs and observes along the front approach track according to the drone command; if it is active mode, the drone command will only start the drone body, and then the driver will fly along the front approach track through remote control of the central control system; other situations can be adjusted as needed.

[0082] Among them, the step Q2 supports the driver to input the operation type to the drone, which includes detection operation, guidance operation, integrity confirmation and other train maintenance operations. Corresponding to the operation type, there are also parameters of the corresponding operation type. The detection operation can specify the parameter as the track number or the default value (indicating the current track). The drone can move forward along the track autonomously until the signal in front, and send the image to the central control system in real time to confirm that the train is free from the signal in front. The guidance operation can input the route number. The drone can move forward along the track route according to the configuration data, and send the image of the front route to the driver's cockpit central control screen in real time; if it is integrity confirmation and other train maintenance operations, the drone will fly backward along the train and send the image data to the driver's central control system. The driver can remotely control the drone to fly to the corresponding area and take the corresponding high-definition image.

[0083] (3) Driver operation assistance system

[0084] The main function of the driver operation assistance system is to assist the driver in communicating with other trains, radio block centers, information centers and other units, so as to facilitate the driver to transmit information and obtain the required information.

[0085] The following describes corresponding embodiments of the driver operation assistance system, and introduces two embodiments, the first of which is information communication and the second is information query.

[0086] 1. Information communication

[0087] The driver operation assistance system comprises:

[0088] The identity verification module is connected to the central control system, receives the ID card information from the central control system and verifies the driver's identity. When the ID card verification is successful, it sends an auxiliary system start-up instruction. Specifically, when the driver needs to use the driver operation auxiliary system, he inputs his own relevant identity information into the identity verification module through the central control system to start the system.

[0089] The object selection module is connected to the identity authentication module, and generates a communication instruction when receiving the auxiliary system startup instruction; wherein the communication instruction includes the selection of the communication object, the identity confirmation of the communication object, the configuration of the communication channel, the setting of the communication channel key, etc.;

[0090] The information communication module is connected to the object selection module, receives the communication instruction from the object selection module, and realizes information communication according to the communication instruction;

[0091] In addition, the information communication module is also connected to the central control system to realize interaction with the outside world; specifically, when the central control system adopts a display screen, the display screen can be used to display real-time data in the information communication process, such as communication time and communication channel; or when the information communication module needs to be set, update and other operations are performed through the central control system; similarly, artificial intelligence can also be introduced into the information communication module to convert the voice content in the information communication into text form for the convenience of the driver to check; among them, the configuration and reception of the counterparty are general settings of technical personnel in this field, which are not the focus of this case and will not be elaborated here.

[0092] Specifically, the following will introduce a specific embodiment in the form of "telephone communication" in the information communication module.

[0093] Step W1, the driver inputs his / her information into the identity authentication module. After passing the identity authentication, the identity authentication module sends an auxiliary system startup instruction to the object selection module and enters step W2; otherwise, the identity authentication module is in a silent state;

[0094] Step W2, the object selection module generates a communication instruction;

[0095] In this embodiment, the communication instruction includes: using telephone communication, the purpose of this communication is related to the train speed;

[0096] Step W3, the information communication module realizes information communication according to the communication instruction;

[0097] During the process of information communication, an automatic recording software module is set inside the information communication module to record the chat content; for overseas trains, a voice translation software module can be equipped to output voice or text in the language selected by the driver, so that automatic translation can be achieved when drivers of different languages ​​on overseas railways communicate with each other.

[0098] In addition, the information communication module supports group chat and group information sharing among multiple drivers, multiple dispatchers, multiple signal workers and other authorized personnel.

[0099] 2. Information Query

[0100] The driver operation assistance system comprises:

[0101] The train information calling module is connected to the central control system and generates an information calling instruction according to an information calling request from the central control system; the information calling request may be data input by the driver through the central control system;

[0102] The cloud database module is connected to the train information calling module and the central control system respectively. The cloud database module is used to store train information, extract corresponding cloud data according to the received information calling instruction, and transmit it to the central control system to realize interaction with the outside world; the expression method is as described above and will not be repeated here.

[0103] Among them, the train information includes but is not limited to train manuals, train maintenance guides, train emergency plans, train historical data, etc.; for example, the operation manuals, maintenance manuals, and emergency response manuals of various ATP (Automatic Train Protection), ATO (Automatic Train Operation), CIR (Cab Integrated Radio communication equipment), LKJ (L "train" K "control" J "monitoring", train operation monitoring device) and other devices in the train control system can be placed in the cloud database module (the aforementioned devices are described in detail later).

[0104] When the display interaction system of the central control system adopts a display screen, the driver can interact with the central control system through touch or voice, so that the central control system sends the corresponding data to the train information call module, generates an information call instruction, and the cloud database module extracts according to the information call instruction; in addition, if the driver describes the information call request through voice, it may correspond to multiple information query results, and the cloud database module returns multiple information query results for the driver to choose. After the driver selects through touch or voice, the target information required by the driver is output; in addition, the cloud database module should also be updated in real time to ensure the accuracy of the required train information.

[0105] At the same time, the driver can also enter his own operation suggestions for a scenario into the cloud database module through the central control system, including the scenario events of the corresponding vehicle model and the corresponding driver operations; after entry, it is in a non-public state at this time. After manual review and confirmation, it can be fixedly recorded in the cloud database module, which is now in a public state for use by other trains.

[0106] (II) Train control system

[0107] The train control system includes: ATP, ATO, CIR, LKJ, and any of the devices is connected to the central control system; ATP or ATO or CIR or LKJ controls the train operation according to the train operation instruction.

[0108] In a preferred embodiment, any of the above devices can be provided with a corresponding anti-mistaken touch module and connected thereto. When the driver makes an erroneous operation, the anti-mistaken touch module provides corresponding feedback; for example, if the anti-mistaken touch module detects that the driver has touched the ATP ceiling speed and caused braking, it will automatically give the driver operation suggestions, including voice suggestions and image display suggestions.

[0109] In a preferred embodiment, any of the above devices can be provided with a corresponding alarm device and connected thereto. When the alarm device detects dangerous information, it sends an alarm message to the driver. At the same time, the alarm device can also send the dangerous information to the central control system through the corresponding device, and the central control system further sends it to the driver's operation assistance system to realize the query of relevant information of the emergency plan.

[0110] In a preferred embodiment, any of the above devices can be equipped with a corresponding emergency call module and connected to it. When the driver determines that the alarm information cannot be handled by himself, the driver is supported to trigger an emergency call through the emergency call module, and automatically send the currently listed positioning data, speed data, equipment alarm and other information to relevant rescue personnel for quick rescue.

[0111] (III) Central Control System

[0112] The main purpose of the central control system is to generate operation instructions and interact with the outside world; as a data interaction platform, this embodiment is described on the basis that the display interaction system is a display screen.

[0113] The central control system includes a display interaction system; the CIR, ATP, LKJ and ATO are connected to the display interaction system; the driver behavior intelligent verification system, the driver sight distance system and the driver operation assistance system are connected to the display interaction system; the display interaction system is only a part of the central control system, and the calculation and other functions in the central control system are not the focus of this case and will not be elaborated here.

[0114] Specifically, the display interaction system includes:

[0115] A safety protection layer, which is connected to the train driving control system and the train auxiliary management system respectively, receives the train driver side information / train operation side information, and performs safety checks on the train driver side information / train operation side information;

[0116] The human-machine interaction layer is connected to the safety protection layer signal, receives the checked train driver-side information / train operation-side information, and displays it; it can be understood that the human-machine interaction layer is the display screen;

[0117] In addition, the human-machine interaction layer is connected to the train driving control system and the train auxiliary management system respectively, and can send corresponding basic instructions to the train driving control system and the train auxiliary management system through the human-machine interaction layer; wherein, the basic instructions refer to simple train control instructions such as system switch, information transmission confirmation, information feedback confirmation, etc., which are different from train operation instructions. The operation steps and operation logic of the basic instructions are simple and do not require complex processes, so they can be transmitted through the human-machine interaction layer;

[0118] The above is the structure of the display interaction system. As mentioned above, in specific applications, the corresponding functions can be realized by using a display screen.

[0119] As described in the display interaction system, the train driver-side information / train operation-side information is first subjected to a security check by the security protection layer. If the result of the security check is "illegal", the corresponding information is discarded. If the check passes, the information enters the human-computer interaction layer for display.

[0120] In a preferred embodiment, in order to ensure the effectiveness of the safety inspection of the train driver side information / train operation side information by the safety protection layer, the safety communication protocol carried by the safety protection layer is RSSP-I (RSSP-I Railway Signal Safety Communication Protocol, national standard, where "RSSP" is "Railway Signal Safety Communication", meaning "Railway Signal Safety Communication") or RSSP-II (RSSP-I Railway Signal Safety Communication Protocol, national standard) or Subset037 (European Radio System Function Interface Specification), etc.; different safety communication protocols can be selected according to actual conditions. In order to ensure the convenience of display in the human-computer interaction layer, the human-computer interaction layer uses html (hypertext mark-up language) to display the train driver side information / train operation side information; or the human-computer interaction layer uses a custom format based on JSON (JavaScript Object Notation, a lightweight data exchange format) to display the train driver side information / train operation side information. For example, if it is to be displayed in an image format, JSON is used to predefine the starting point, width, length, picture content, type information, etc. of the image, and then the corresponding display is realized.

[0121] In specific applications, in order to further optimize the display of train driver-side information / train operation-side information by the human-computer interaction layer, and the process of the human-computer interaction layer sending corresponding basic instructions to the train driving control system and the train auxiliary management system; the human-computer interaction layer can add a language module, the language module, the language module can receive voice input, and the human-computer interaction layer operates by recognizing voice, for example, through voice input "display ATO's running time information", and then realize the corresponding function. In addition, in order to prevent accidental startup, a secondary confirmation process can be set. For example, the first language input will "display ATO's running time information", and at this time, a second voice input "confirm to display ATO's running time information" is performed, so that the human-computer interaction layer can execute the display of ATO's running time information.

[0122] Similarly, when basic instructions are sent to the train auxiliary management system / train travel control system, a second confirmation can also be used. After the second confirmation, it can be sent to the train auxiliary management system / train travel control system. This is as mentioned above and will not be repeated here.

[0123] Of course, the human-computer interaction layer can also be equipped with other modules, such as a weather function module for forecasting weather; or a voice broadcast module for broadcasting text in the form of voice; or a one-key control module for controlling the basic instructions corresponding to the subsystems in the train auxiliary management system and the train driving control system (such as the aforementioned driver behavior intelligent verification system, driver operation assistance system, and driver sight distance system) in a collective form, and realizing the operation of all subsystems in the collection through one-key control; or a three-dimensional space representation module, which can intuitively display the "front and rear vehicle operation status" in the train operation end information in the form of a bird's-eye view on the track, so as to facilitate the driver to further feedback the corresponding dispatching instructions.

[0124] In a preferred embodiment, the central control system may be provided with a corresponding voice control system, which converts voice information into certain command coding data for use by the central control system. The driver is supported to enter commands by voice. Commands can be divided into two categories: general control commands, which do not affect driving safety, including air conditioning control, seat posture control, screen display parameters, and telephone chat control commands. Such commands can be designed as one-time commands, that is, the driver only needs to speak once to execute. Driving control commands, which can affect the driving status of the train, correspond to the operation of the train acceleration and deceleration direction handle. Such commands are designed to be confirmed twice or multiple times, and the confirmation password is different each time.

[0125] The following is an application case of a collective intelligent cockpit system for train drivers proposed by the present invention:

[0126] like Figure 1 and Figure 2 As shown in the figure, since the train restarts on the track and is ready to depart, the train loses the route information ahead due to the restart. The driver sends data to the drone start module through the central control system. The drone start module generates drone instructions. The drone body runs according to the drone instructions and obtains images. The drone data collection module transmits the data to the central control system (such as Figure 2 The display interactive system in the central control system shown in the figure) allows the driver to understand the route information ahead; after the drone completes the operation, it returns to its original position in the train and waits for orders.

[0127] like Figure 2 As shown, the human-computer interaction layer of this case adopts a display screen, and the display screen is set with corresponding programs; as mentioned above, ATP, CIR, and LKJ are respectively connected to the security protection layer, and the human-computer interaction layer uses HTML to display the train driver-side information / train operation-side information. Taking drone operation as an example, the display screen displays several input boxes of "distance", "speed", "operation type", and a video receiving box.

[0128] like Figure 2As shown in the figure, the human-machine interaction layer also describes the information communication function of the driver operation assistance system. The train can also communicate with other trains through the human-machine interaction layer.

[0129] like Figure 3 The figure shows a use case of the driver behavior intelligent verification system. The motion capture module obtains the driver's motion information, and the motion analysis module converts it into the driver's motion result. At this time, the ideal motion result is to confirm that the train has not exceeded the yellow code position. The motion verification module compares and verifies the driver's motion result (track position) with the ideal motion result (the train has not exceeded the yellow code position), and outputs to the central control system that the driver has confirmed that he has not exceeded the yellow code position.

[0130] like Figure 4 As shown, a model architecture is shown, in which the image model and the text model are used to further judge the driver's action behavior, and the big data model can adjust the image model and the text model in real time, so that the judgment can be more accurate.

[0131] Although the content of the present invention has been described in detail through the above preferred embodiments, it should be appreciated that the above description should not be considered as a limitation of the present invention. After reading the above content, it will be apparent to those skilled in the art that various modifications and substitutions of the present invention will occur. Therefore, the protection scope of the present invention should be limited by the appended claims.

Claims

1. A collective intelligent cockpit system for train drivers, characterized in that: The system comprises: Train auxiliary management system, obtains train driver-side information; Train control system, obtains train operation information; The central control system is connected to the train auxiliary management system and the train driving control system to realize data interaction between them; The central control system generates a train operation instruction according to the train operation terminal information and the train driver terminal information, and sends it to the train operation control system, and the train operation control system controls the train operation according to the train operation instruction; The train auxiliary management system, train travel control system and central control system adjust their own operation according to each other's and their own data; The train auxiliary management system includes: a driver behavior intelligent verification system, a driver sight distance system and a driver operation assistance system; the driver sight distance system includes a drone body, and an observation image of the train's front approach is obtained by installing a camera on the drone body.

2. The integrated intelligent cockpit system for train drivers according to claim 1, characterized in that: The central control system includes a display interaction system, which displays all data received by the central control system; and the basic control of the train auxiliary management system and the train travel control system is realized through the display interaction system.

3. The integrated intelligent cockpit system for train drivers according to claim 1 is characterized in that: The train driver-side information is information related to train operation generated with the train driver as the core.

4. The integrated intelligent cockpit system for train drivers according to claim 1, characterized in that: The train operation terminal information is information related to train operation generated with train operation as the core.

5. The integrated intelligent cockpit system for train drivers according to claim 1 is characterized in that: The driver behavior intelligent verification system comprises: Motion capture module, to obtain driver motion information; The motion analysis module is connected to the motion capture module, receives and analyzes the driver's motion information, and converts it into the driver's motion results; The action verification module is connected to the action analysis module and the central control system respectively, and is used to receive the driver's action results and collect ideal action results, then compare and verify the driver's action results with the ideal action results, and output the corresponding train driver-side information to the central control system.

6. The integrated intelligent cockpit system for train drivers according to claim 5, characterized in that: The motion capture module, motion analysis module and motion verification module are all implanted with corresponding artificial intelligence models.

7. The integrated intelligent cockpit system for train drivers according to claim 6, characterized in that: The artificial intelligence model adopts a diffusion model. The motion capture module converts the driver's motion information into data code. The motion analysis module analyzes the data code to extract the key action nodes in the data code. The motion verification module verifies the key action nodes and outputs the corresponding results.

8. The integrated intelligent cockpit system for train drivers according to claim 1, characterized in that: The driver sight distance system also includes: a plurality of cameras installed on the train body, the cameras are all connected to the central control system, and the central control system displays the captured content in real time.

9. The integrated intelligent cockpit system for train drivers according to claim 1, characterized in that: The driver sight distance system also includes: The UAV startup module is connected to the central control system and the UAV body, respectively, and is used to store the parameters and operation programs of the UAV, and output UAV instructions to the UAV body according to the data from the central control system; the UAV body performs the observation task according to the UAV instructions of the UAV startup module and obtains the observation data; The drone data collection module is connected to the drone start module, the drone body and the central control system respectively, receives data from the drone start module and the drone body, and transmits it to the central control system.

10. The integrated intelligent cockpit system for train drivers according to claim 1, characterized in that: The driver operation assistance system comprises: The identity authentication module is connected to the central control system, receives the ID card information from the central control system and verifies the driver's identity. When the ID card verification is successful, it sends an auxiliary system start-up instruction; An object selection module, the object selection module is connected to the identity authentication module, and generates a communication instruction when receiving an auxiliary system startup instruction; The information communication module is connected to the object selection module, receives the communication instruction from the object selection module, and realizes information communication according to the communication instruction; The information communication module is also connected to the central control system to achieve interaction with the outside world.

11. The integrated intelligent cockpit system for train drivers according to claim 1, characterized in that: The driver operation assistance system comprises: The train information calling module is connected to the central control system and generates information calling instructions according to the information calling request from the central control system; The cloud database module is connected to the train information calling module and the central control system respectively. The cloud database module is used to store train information, extract corresponding cloud data according to the received information calling instruction, and transmit it to the central control system to realize interaction with the outside world.

12. The integrated intelligent cockpit system for train drivers according to claim 1, characterized in that: The train control system comprises: Automatic train protection device, or / and automatic train operation device, or / and locomotive integrated wireless communication device, or / and train operation monitoring device; Any of the above devices is connected to the central control system; The train automatic protection device, or / and the train automatic operation device, or / and the locomotive integrated wireless communication device, or / and the train operation monitoring device all control the train operation according to the train operation instructions.

13. The integrated intelligent cockpit system for train drivers according to claim 12, characterized in that: Any of the above devices is provided with a corresponding anti-mistaken-touch module and connected thereto, and when the driver makes an erroneous operation, the anti-mistaken-touch module gives corresponding feedback.

14. The integrated intelligent cockpit system for train drivers according to claim 12, characterized in that: Any of the above devices is provided with a corresponding alarm device and connected thereto. When the alarm device detects dangerous information, it sends an alarm message to the driver. The alarm device sends the dangerous information to the central control system through the corresponding device, and the central control system further sends it to the driver's operation assistance system to realize the relevant information query of the emergency plan.

15. The integrated intelligent cockpit system for train drivers according to claim 12, characterized in that: Any of the above devices is provided with a corresponding emergency call module and connected thereto, and the emergency call module triggers an emergency call and automatically sends rescue information.

16. The integrated intelligent cockpit system for train drivers according to claim 2, characterized in that: The display interaction system comprises: A safety protection layer, which is connected to the train driving control system and the train auxiliary management system respectively, receives the train driver side information / train operation side information, and performs safety checks on the train driver side information / train operation side information; The human-computer interaction layer is connected to the safety protection layer signal, receives the checked train driver-side information / train operation-side information, and displays it.

17. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, an integrated intelligent cockpit system for train drivers as described in any one of claims 1-16 is implemented.

18. An electronic device, characterized in that: It comprises a processor and a memory, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, an integrated intelligent cockpit system for train drivers as described in any one of claims 1 to 16 is implemented.