Integrated intelligent cab system for train driver

Abstract

An integrated intelligent cab system for a train driver. The system comprises: a train auxiliary management system, which acquires train driver-side information; a train operation control system, which acquires train operation-side information; and a central control system, which is separately connected to the train auxiliary management system and the train operation control system to achieve data interaction thereamong. The central control system generates a train operation instruction on the basis of the train operation-side information and train driver-side information, and sends same to the train operation control system. The train operation control system controls the train operation on the basis of the train operation instruction. The train auxiliary management system, the train operation control system and the central control system adjust their own operations on the basis of data from one another and their own data. The present invention has advantages of improving the level of intelligence and informatization of train operation.

Description

An integrated intelligent cockpit system for train drivers Technical Field

[0001] This invention relates to the field of train driver's cab systems, and more particularly to an integrated intelligent cockpit system for train drivers. Background Technology

[0002] Improving driver skills and experience is crucial for enhancing train operation, yet there are few specific solutions designed to optimize the driver's cab. Current trains have multiple human-machine interfaces, including CIR (Cab Integrated Radio communication equipment), ATP (Automatic Train Protection), LKJ (L "train", K "control", J "monitoring"), and IDU (interface data unit), requiring drivers to repeatedly confirm information.

[0003] Furthermore, for example, there is room for improvement in human-machine friendliness and intelligence levels, such as the lack of interactive information between display programs on the same train, insufficient intelligence level in the train driver's cab, limited auxiliary means for drivers with short visibility, and the need to improve the level of driver behavior inspection, as well as the lack of full integration of the latest AI technologies such as voice recognition and image recognition. Technical solutions

[0004] The purpose of this invention is to provide an integrated intelligent cockpit system for train drivers, which has the advantages of improving the intelligence and informatization level of train operation.

[0005] To achieve the above objectives, this invention provides an integrated intelligent cockpit system for train drivers. The system includes: a train auxiliary management system for acquiring information from the train driver; a train driving control system for acquiring information from the train operation terminal; and a central control system connected to both the train auxiliary management system and the train driving control system to enable data interaction between them. The central control system generates train operation commands based on the train operation terminal information and the train driver information, and sends them to the train driving control system. The train driving control system controls the train operation according to the train operation commands. The train auxiliary management system, the train driving control system, and the central control system adjust their own operation based on data from each other and themselves. The train auxiliary management system includes: a driver behavior intelligent verification system, a driver line-of-sight system, and a driver operation assistance system. The driver line-of-sight system includes a drone, which acquires observation images of the train's path forward using a camera mounted on the drone.

[0006] Preferably, the central control system includes a display interaction system, which displays all data received by the central control system; and realizes basic control of the train auxiliary management system and the train driving control system through the display interaction system.

[0007] Preferably, the train driver terminal information is information related to train operation generated with the train driver as the core.

[0008] Preferably, the train operation terminal information is information related to train operation generated with train operation as the core.

[0009] Preferably, the driver behavior intelligent verification system includes: a motion capture module for acquiring driver action information; a motion analysis module connected to the motion capture module for receiving and analyzing driver action information and converting it into driver action results; and a motion verification module connected to both the motion analysis module and the central control system for receiving driver action results and collecting ideal action results, comparing and verifying the driver action results with the ideal action results, and outputting corresponding train driver information to the central control system.

[0010] Preferably, the motion capture module, motion analysis module, and motion verification module are all embedded with corresponding artificial intelligence models.

[0011] Preferably, the artificial intelligence model adopts a diffusion model. The motion capture module converts the driver's motion information into data codes. The motion analysis module analyzes the data codes to extract the nodes of key actions in the data codes. The motion verification module verifies the nodes of key actions and outputs the corresponding results.

[0012] Preferably, the driver's line of sight system further includes: multiple cameras installed on the train body, all of which are connected to the central control system, and the central control system displays the captured content in real time.

[0013] Preferably, the driver's line-of-sight system further includes: a drone start-up module, connected to both the central control system and the drone itself, for storing drone parameters and operating programs, and outputting drone commands to the drone itself based on data from the central control system; the drone itself executes observation tasks and acquires observation data according to the drone commands from the drone start-up module; and a drone data collection module, connected to the drone start-up module, the drone itself, and the central control system, for receiving data from the drone start-up module and the drone itself, and transmitting it to the central control system.

[0014] Preferably, the driver operation assistance system includes: an identity verification module connected to the central control system, which receives ID card information from the central control system and verifies the driver's identity; when the ID card verification is successful, it sends an assistance system start command; an object selection module connected to the identity verification module, which generates a communication command when it receives the assistance system start command; and an information communication module connected to the object selection module, which receives the communication command from the object selection module and performs information communication according to the communication command; the information communication module is also connected to the central control system to enable interaction with the outside world.

[0015] Preferably, the driver operation assistance system includes: a train information retrieval module connected to the central control system, which generates information retrieval instructions based on information retrieval requests from the central control system; and a cloud database module connected to both the train information retrieval module and the central control system, wherein the cloud database module stores train information, extracts corresponding cloud data based on received information retrieval instructions, and transmits it to the central control system to achieve interaction with the outside world.

[0016] Preferably, the train operation control system includes: an automatic train protection device, and / or an automatic train operation device, and / or a locomotive integrated wireless communication device, and / or a train operation monitoring device; each of the above devices is connected to the central control system; the automatic train protection device, and / or the automatic train operation device, and / or the locomotive integrated wireless communication device, and / or the train operation monitoring device all control the train operation according to the train operation command.

[0017] Preferably, any of the devices is equipped with a corresponding anti-accidental touch module and connected to it. When the driver makes a mistake, the anti-accidental touch module provides corresponding feedback.

[0018] Preferably, each of the aforementioned devices is equipped with a corresponding alarm device and connected to it. When the alarm device detects danger information, it issues an alarm message to the driver. The alarm device sends the danger information to the central control system through the corresponding device, and the central control system then sends it to the driver operation assistance system to realize the query of relevant information of the emergency plan.

[0019] Preferably, any of the devices is equipped with a corresponding emergency call module and connected to it. The emergency call module triggers an emergency call and automatically sends rescue information.

[0020] Preferably, the display interaction system includes: a safety protection layer, which is connected to the train driving control system and the train auxiliary management system respectively, receives train driver terminal information / train operation terminal information, and performs safety checks on the train driver terminal information / train operation terminal information; and a human-machine interaction layer, which is signal-connected to the safety protection layer, receives the checked train driver terminal information / train operation terminal information, and displays it.

[0021] A computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the aforementioned integrated intelligent cockpit system for train drivers.

[0022] An electronic device includes a processor and a memory, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, it implements the aforementioned integrated intelligent cockpit system for train drivers. Beneficial effects

[0023] First, this invention proposes an integrated intelligent cockpit system for train drivers to achieve efficient information transmission.

[0024] Secondly, this invention proposes a driver line-of-sight system based on unmanned aerial vehicles (UAVs), which supports remote control by the driver and transmits real-time images to the central control system, thus extending the driver's field of vision.

[0025] Third, this invention proposes an integrated intelligent cockpit system for train drivers, which enables drivers to obtain more information and facilitates the formation of better driving strategies.

[0026] Fourth, this invention proposes an integrated intelligent cockpit system for train drivers, which supports voice input, facilitates driver operation, provides drivers with operation suggestions, improves the efficiency of emergency response in case of driver malfunction, and allows drivers to focus their attention on train control, observation, and operation. Attached Figure Description

[0027] Figure 1 is a schematic diagram of an embodiment of the driver visibility system of the present invention.

[0028] Figure 2 is a schematic diagram of an embodiment of the display interaction system of the present invention.

[0029] Figure 3 is a schematic diagram of an embodiment of the driver behavior intelligent verification system of the present invention.

[0030] Figure 4 is a schematic diagram of an embodiment of the driver behavior intelligent verification system of the present invention.

[0031] Figure 5 is a schematic diagram of an embodiment of the integrated intelligent cockpit system for train drivers proposed in this invention. Embodiments of the present invention

[0032] The technical solutions, structural features, achieved objectives, and effects of the present invention will be described in detail below with reference to Figures 1 to 5 in the embodiments of the present invention.

[0033] It should be noted that the accompanying drawings are in a very simplified form and use non-precise proportions. They are only used to facilitate and clarify the purpose of illustrating the embodiments of the present invention, and are not intended to limit the implementation conditions of the present invention. Therefore, they have no substantial technical significance. Any modifications to the structure, changes in the proportional relationship, or adjustments to the size should still fall within the scope of the technical content disclosed in the present invention, provided that they do not affect the effects and objectives that the present invention can produce.

[0034] It should be noted that, in this invention, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only the expressly listed elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus.

[0035] This invention provides an integrated intelligent cockpit system for train drivers, which facilitates train drivers in handling various situations during train operation, such as inter-train communication, communication between the train and the wireless block center, emergency braking of the train, and capture of train operating environment conditions. This system has the advantages of improving the intelligence and convenience of train operation.

[0036] As shown in Figure 5, the system includes:

[0037] The train auxiliary management system obtains information from the train driver's terminal.

[0038] The train control system acquires information from the train operation terminal.

[0039] The central control system is connected to the train auxiliary management system and the train driving control system respectively, enabling data interaction between them, including receiving information from the train operation terminal and the train driver terminal;

[0040] The central control system generates train operation instructions based on the information from the train operator and the train driver, and sends them to the train driving control system. The train driving control system then controls the train operation according to the train operation instructions.

[0041] The train auxiliary management system, train driving control system, and central control system can adjust their operation based on data from each other and themselves. For example, the central control system can determine the information transmission strategy to be used to the outside world based on the priority order of train driver terminal information sent by the train auxiliary management system; the train auxiliary management system can determine which functions to activate based on train operation terminal information from the train driving control system (see details below); the train auxiliary management system itself can obtain the driver's operation status based on the train driver terminal information and decide whether to record certain scenarios (such as driver operation errors).

[0042] Examples of the train driver terminal information are as follows: (1) Train driver's action confirmation feedback on train operation signals; (2) Train driver's voice confirmation feedback on train operation signals; (3) Train driver's line-of-sight range adjustment; (4) Train driver's execution status with the dispatch center; (5) Train driver's action feedback in emergency situations, etc. In summary, the train driver terminal information is a series of train operation-related information generated with the train driver as the core.

[0043] Examples of the train operation terminal information are as follows: (1) transmission of train operation data; (2) the status of automatic train operation; (3) the activation status of automatic train protection devices; (4) the operation status of train operation monitoring equipment, etc. In summary, the train operation terminal information is a series of train operation-related information generated with train operation as the core.

[0044] Furthermore, in a preferred embodiment, the central control system includes a display interaction system. This system can display all data received by the central control system (including train operation information and train driver information), facilitating external access to relevant information. Additionally, the control settings for the train auxiliary management system and the train driving control system can be integrated into the display interaction system. The driver can then implement basic control of the train auxiliary management system and the train driving control system through the display interaction system, offering considerable convenience. In a specific embodiment, the display interaction system can be implemented using a display screen as its core, with corresponding operating programs configured.

[0045] Continuing with Figure 5, the following describes a specific embodiment of a control system, outlining the train auxiliary management system, the train driving control system, and the central control system:

[0046] (a) Train Auxiliary Management System

[0047] The function of the train auxiliary management system is to obtain information from the train driver's end. In order to ensure the acquisition of information, the train auxiliary management system includes: driver behavior intelligent verification system, driver sight distance system and driver operation assistance system. The three sub-systems will be introduced one by one below.

[0048] (1) Intelligent verification system for driver behavior

[0049] The driver behavior intelligent verification system is designed to address the need for drivers to provide corresponding action feedback to the instructions of station staff or signals from the train operation control system when trains enter or leave stations. In other words, it verifies and compares the ideal action result (instructions from station staff or signals from the train operation control system) with the driver's action result (driver's action feedback).

[0050] The driver behavior intelligent verification system includes:

[0051] The motion capture module acquires driver action information;

[0052] The motion analysis module connects to the motion capture module, receives and analyzes driver motion information, and converts it into driver motion results.

[0053] The action verification module is connected to both the action analysis module and the central control system. It is used to receive the driver's action results and collect the ideal action results, then compare and verify the driver's action results with the ideal action results, and output the corresponding train driver terminal information to the central control system.

[0054] To further optimize the smooth operation of the driver behavior intelligent verification system, artificial intelligence models can be used to assist in its operation. The motion capture module, motion analysis module, and motion verification module can all be embedded into the corresponding artificial intelligence models to achieve operational optimization.

[0055] The specific scenarios in which this applies are as follows:

[0056] When a train departs from the station, the station attendant gives the corresponding hand signal (i.e., the ideal action result) on the platform; or the train control system receives relevant signals from the train's operating section, and the driver needs to take corresponding actions to indicate that the signals have been received.

[0057] Specifically, the motion capture module automatically collects the driver's hand gestures (driver action information), inputs it into an artificial intelligence model for preliminary judgment, and the action analysis module receives the driver's hand gestures and uses the artificial intelligence model to further analyze the driver's hand gestures to obtain the corresponding driver action result. In this embodiment, it is assumed that the driver action result is "driving at a safe speed". At this time, the driver action result is transmitted to the action verification module. The action verification module uses the artificial intelligence model to verify the driver's action result within a certain period of time. If the driver's action result is inconsistent with the ideal action result, the train driver terminal information "driver did not execute the standard procedure" is output. As mentioned above, the central control system receives the train driver terminal information and then interacts with the outside world, such as communicating the train driver terminal information with the radio block center, or communicating with other trains on the same track. Here, "outside world" is used in a broad sense.

[0058] Furthermore, as mentioned earlier, the train auxiliary management system, train driving control system, and central control system can adjust their operation based on data from each other and themselves. Similarly, when the train auxiliary management system outputs the information "driver did not follow standard procedures" to the driver, other modules of the train auxiliary management system can operate independently. For example, when the train auxiliary management system outputs this information, its other modules automatically query the emergency manual and send it to the driver, or automatically initiate proactive telephone communication and reminders. The train driving control system can also enter a pre-start mode based on this information ("driver did not follow standard procedures"), meaning it has pre-set the standard procedures for responding to the condition of "driver did not follow standard procedures," allowing the train to react automatically and reduce operational risks. The central control system can also decide whether to explicitly display this information on the screen, meaning it has pre-set the standard procedures for responding to the condition of "driver did not follow standard procedures," allowing the central control system to proactively intervene and remind the driver when the aforementioned conditions are met.

[0059] In addition, a diffusion model can be used for artificial intelligence models. The diffusion model is a method to generate high-quality images by learning the inverse process of noise. An example of using the diffusion model is as follows: the motion capture module converts the driver's gesture image (driver action information) into the form of data code, the motion analysis module analyzes the data code to extract the nodes of key actions in the data code, and the motion verification module only needs to verify the nodes of key actions and output the corresponding results.

[0060] In addition, the driver's posture and movements can be captured by the driver behavior intelligent verification system to monitor the driver's fatigue state. For example, when the driver is fatigued and the train is running at high speed, the central control system sends a "safe driving" train operation command to the train driving control system.

[0061] In addition, the driver behavior intelligent verification system can also add a language recognition module. In this case, the driver behavior intelligent verification system records, analyzes, and converts the driver's voice into text information, and retrieves and matches it with the text keywords corresponding to the ideal result, and outputs the corresponding result; the specific principle is as described above, and will not be repeated here.

[0062] (2) Driver visibility system

[0063] A driver line-of-sight system refers to a system that allows the driver to observe the train's path from inside the cab. It is a system that assists the driver in observing the train's movement from a distance. For example, multiple cameras can be installed on the train body, and all cameras are connected to the central control system (in this case, the central control system's display and interaction system uses a display screen). The driver can observe the captured environmental information in real time through the central control system. In addition, to further save space and track resources, solar cells can be installed to power the cameras.

[0064] The above is an example of a driver line-of-sight system. This embodiment proposes using a drone to design a driver line-of-sight system. Under this design, the driver line-of-sight system includes:

[0065] The drone startup module, connected to the central control system, stores the drone's parameters and operating program. Based on data from the central control system, it outputs drone commands. This data includes driver actions displayed in the central control system's interactive system. The drone startup module translates these actions into drone commands to initiate subsequent processes. For example, the drone startup module can be configured to output drone commands under specific conditions. For instance, when the central control system receives multiple confirmations of the driver's forward path from the driver's intelligent behavior verification system, and this condition is met, the drone startup module can obtain the necessary data through data exchange and initiate the subsequent processes.

[0066] The drone itself is connected to the drone startup module and executes observation tasks and acquires observation data according to the drone commands from the startup module; generally, the drone itself is equipped with a camera for observation, and there are no restrictions on this.

[0067] The UAV data collection module is connected to the UAV startup module, the UAV itself, and the central control system. It receives data from the UAV startup module and the UAV itself and transmits it to the central control system. The purpose of connecting to the UAV startup module is to store UAV commands for subsequent review operations. The purpose of connecting to the UAV itself is to acquire observation data. The purpose of connecting to the central control system is to transmit data (train driver information, specifically the observation data used by the driver) and display the corresponding results to the outside world.

[0068] The following is an operating method for using a pilot's line-of-sight system under a drone:

[0069] Step S1: Pre-set the parameters and running program of the drone startup module. When the startup conditions of the drone startup module are met, the drone startup module sends drone commands to the drone body and proceeds to step S2. Otherwise, remain silent.

[0070] Step S2: The UAV body observes the corresponding area according to the UAV instructions and transmits the observation data to the UAV data collection module.

[0071] In step S3, the UAV data collection module further processes the observation data and transmits key information to the central control system.

[0072] In step S3, the subdivision processing refers to capturing key images of the observed image, such as whether there are obstacles or automatically selecting the best segment. Step S3 can also skip the subdivision processing stage. For example, when the central control system uses a display screen, the observation data can be directly transmitted to the display screen of the central control system through the UAV data collection module. In this way, information about the corresponding area can be obtained in the form of real-time images, which makes it easier for the driver to grasp the road environment ahead. In this case, the UAV data collection module only plays the role of transmitting the observation data.

[0073] The following is a specific embodiment of a driver's line-of-sight system using a drone, where the activation condition is "when the train's driving control system needs to perform braking operations." Because the driver also needs to perform corresponding operations when the train brakes, the driver's line-of-sight system needs to provide the driver with information about the path ahead. In this embodiment, the central control system uses a display screen.

[0074] Step Q1: When the drone start-up module meets the start-up conditions (when the train driving control system needs to perform braking operation and the driver needs to confirm that the route ahead is clear), the drone start-up module starts running and sends drone commands to the drone body.

[0075] The specific methods of data transmission will not be elaborated here;

[0076] In step Q2, the UAV observes the corresponding area according to the UAV instructions and transmits the observation data to the UAV data collection module.

[0077] In step Q3, the UAV data collection module directly transmits the observation data to the central control system;

[0078] In step Q4, the central control system's display screen directly displays the observation data as a real-time image.

[0079] In step Q5, the driver observes the corresponding area through the display screen and performs auxiliary braking operations on the train.

[0080] In step Q2, the observation can be performed in either automatic or active mode. In automatic mode, the UAV will automatically run along the forward path and observe according to the UAV command. In active mode, the UAV command will only start the UAV, and the pilot will then remotely control it to fly along the forward path through the central control system. Other modes can be adjusted as needed.

[0081] In step Q2, the driver can input the operation type to the drone, including detection, guidance, integrity confirmation, and other train maintenance operations. Each operation type has corresponding parameters. For detection, the parameter can be specified as the track number or a default value (representing the current track). The drone autonomously travels along the track until it reaches the next signal, transmitting images in real-time to the central control system to confirm the clear distance between the train and the signal. For guidance, a route number can be input. The drone, based on the configured data, travels along the track route, transmitting images of the route ahead to the driver's central control screen in real-time. For integrity confirmation and other train maintenance operations, the drone flies backward along the train, transmitting image data to the driver's central control system. The driver can remotely control the drone to fly to the corresponding area and capture corresponding high-definition images.

[0082] (3) Driver operation assistance system

[0083] The main function of the driver operation assistance system is to assist the driver in communicating with other trains, radio block centers, information centers, and other units, so as to facilitate the driver in transmitting and obtaining the information he needs.

[0084] The following describes corresponding embodiments of the driver operation assistance system, introducing two embodiments: the first is information communication, and the second is information query.

[0085] 1. Information communication

[0086] The driver operation assistance system includes:

[0087] The identity verification module connects to the central control system, receives ID card information from the central control system and verifies the driver's identity. When the ID card verification is successful, it sends an auxiliary system start command. Specifically, when the driver needs to use the driver operation auxiliary system, he / she inputs his / her relevant identity information into the identity verification module through the central control system to start the system.

[0088] The object selection module is connected to the authentication module. When it receives the auxiliary system start command, it generates a communication command. The communication command includes the selection of the communication object, the confirmation of the communication object's identity, the configuration of the communication channel, and the setting of the communication channel key.

[0089] The information communication module connects to the object selection module, receives communication instructions from the object selection module, and performs information communication according to the communication instructions;

[0090] In addition, the information communication module is also connected to the central control system to realize interaction with the outside world. Specifically, when the central control system uses a display screen, the display screen can be used to display real-time data during the information communication process, such as communication time and communication channel; or when it is necessary to set the information communication module, the central control system can be used to perform operations such as updates; similarly, artificial intelligence can also be introduced into the information communication module to convert the voice content in the information communication into text form for the driver to view; the configuration and reception of the counterparty are general settings for those skilled in the art and are not the focus of this case, so they will not be described in detail here.

[0091] Specifically, the following will describe a specific implementation using the "telephone communication" format for the information communication module.

[0092] In step W1, the driver inputs their own information into the identity verification module. After successful identity verification, the identity verification module sends an auxiliary system start command to the object selection module, proceeding to step W2; otherwise, the identity verification module remains silent.

[0093] Step W2: The object selection module generates communication instructions;

[0094] In this embodiment, the communication instruction includes: using telephone communication, the purpose of which is a train speed-related issue;

[0095] Step W3: The information communication module performs information communication based on the communication instructions;

[0096] During the information communication process, the information communication module is equipped with an automatic recording module to record chat content; for overseas trains, a voice translation software module can be equipped to output voice or text according to the driver's selected language, so that automatic translation can be achieved when drivers of different languages ​​on overseas railways communicate.

[0097] In addition, the information communication module supports group chat and data sharing among multiple drivers, dispatchers, signalmen, and other authorized personnel.

[0098] 2. Information Inquiry

[0099] The driver operation assistance system includes:

[0100] The train information retrieval module is connected to the central control system and generates information retrieval instructions based on information retrieval requests from the central control system; such information retrieval requests include data input by the driver through the central control system.

[0101] The cloud database module is connected to both the train information retrieval module and the central control system. The cloud database module is used to store train information, extract the corresponding cloud data according to the received information retrieval instructions, and transmit it to the central control system to realize interaction with the outside world; the manifestation method is as described above and will not be repeated here.

[0102] The train information includes, but is not limited to, train manuals, train maintenance guidelines, train emergency plans, and train historical data. For example, the operation manuals, maintenance manuals, and emergency response manuals of various devices in the train driving control system, such as ATP (Automatic Train Protection), ATO (Automatic Train Operation), CIR (Cab Integrated Radio communication equipment), and LKJ (L "train", K "control", J "monitoring"), can be put into the cloud database module (details of the aforementioned devices are described below).

[0103] When the central control system uses a display screen, the driver can interact with the system via touch or voice. The central control system then sends relevant data to the train information retrieval module, generating an information retrieval command. The cloud database module retrieves the information based on this command. Furthermore, if the driver describes their information retrieval request via voice, multiple query results may be available. The cloud database module returns these results for the driver to choose from, allowing them to select via touch or voice and receive the desired information. Additionally, the cloud database module should be updated in real-time to ensure the accuracy of the required train information.

[0104] At the same time, drivers can also input their operational suggestions for a particular scenario into the cloud database module through the central control system. This includes scenario events for the corresponding train model and the corresponding driver operations. After input, the data is initially in a non-public state. After manual review and confirmation, it can be permanently recorded in the cloud database module, at which point it becomes public and can be used by other trains.

[0105] (ii) Train driving control system

[0106] The train control system includes: ATP, ATO, CIR, and LKJ, and any one of these devices is connected to the central control system; ATP, ATO, CIR, or LKJ control the train operation according to the train operation command.

[0107] In a preferred embodiment, any of the devices may be equipped with a corresponding anti-accidental touch module and connected thereto. When the driver makes a mistake, the anti-accidental touch module provides corresponding feedback. For example, if the anti-accidental touch module detects that the driver has touched the ATP roof speed and caused braking, it will automatically give the driver operation suggestions, including voice suggestions and image display suggestions.

[0108] In a preferred embodiment, any of the devices can be equipped with a corresponding alarm device and connected to it. When the alarm device detects danger information, it sends an alarm message to the driver. At the same time, the alarm device can also send the danger information to the central control system through the corresponding device. The central control system then sends it to the driver operation assistance system to realize the query of relevant information of the emergency plan.

[0109] In a preferred embodiment, any of the devices can be equipped with a corresponding emergency call module and connected to it. When the driver determines that the alarm information cannot be handled by himself, the driver can trigger an emergency call through the emergency call module, which will automatically send the currently listed location data, speed data, device alarm and other information to the relevant rescue personnel for rapid rescue.

[0110] (III) Central Control System

[0111] The main purpose of the central control system is to generate calculation instructions and interact with the outside world; as a data interaction platform, this embodiment is described based on the display interaction system being a display screen.

[0112] The central control system includes a display and interaction system; the CIR, ATP, LKJ, and ATO are connected to the display and interaction system; the driver behavior intelligent verification system, driver sight distance system, and driver operation assistance system are connected to the display and interaction system; the display and interaction system is only a part of the central control system, and the calculation and other functions of the central control system are not the focus of this case, so they will not be described in detail here.

[0113] Specifically, the display interaction system includes:

[0114] A safety protection layer is connected to the train driving control system and the train auxiliary management system respectively, receives information from the train driver's end / train operation end, and performs safety checks on the information from the train driver's end / train operation end;

[0115] The human-machine interface layer is connected to the safety protection layer by signal. It receives and displays the information from the train driver's end / train operation end after inspection; the human-machine interface layer can be understood as the display screen.

[0116] In addition, the human-machine interaction layer is connected to the train driving control system and the train auxiliary management system respectively. It can send corresponding basic instructions to the train driving control system and the train auxiliary management system through the human-machine interaction layer. Among them, the basic instructions refer to simple train control instructions such as system switch, information transmission confirmation, and information feedback confirmation. Unlike train operation instructions, the operation steps and logic of basic instructions are simple and do not require complex processes, so they can be transmitted through the human-machine interaction layer.

[0117] The above describes the structure of the interactive display system. As mentioned earlier, in specific applications, a display screen can be used to achieve the corresponding functions.

[0118] As described in the interactive system, train driver information / train operation information is first checked by the security protection layer. If the security check result is "illegal", the corresponding information is discarded. If the check passes, the information enters the human-computer interaction layer for display.

[0119] In a preferred embodiment, to ensure the effectiveness of the safety protection layer's security checks on train driver / train operation information, the safety communication protocol carried by the safety protection layer is RSSP-I (RSSP-I Railway Signal Safety Communication Protocol, national standard, where "RSSP" stands for "Railway Signal Safety Communication"), RSSP-II (RSSP-I Railway Signal Safety Communication Protocol, national standard), or Subset037 (European Radio System Functional Interface Specification), etc.; different safety communication protocols can be selected according to the actual situation. To ensure the convenience of display in the human-computer interaction layer, the human-computer interaction layer uses HTML (hypertext markup language) to display train driver / train operation information; or the human-computer interaction layer uses a custom format based on JSON (JavaScript Object Notation, a lightweight data exchange format) to display train driver / train operation information. For example, if it is to be displayed as an image, JSON is used to predefine the image's starting point, width, length, image content, type information, etc., and then the corresponding display is achieved.

[0120] In practical applications, to further optimize the display of train driver / train operation information by the human-machine interface layer, and the process of the human-machine interface layer sending corresponding basic instructions to the train driving control system and train auxiliary management system, a language module can be added to the human-machine interface layer. This language module can receive voice input, and the human-machine interface layer operates by recognizing voice. For example, by inputting "Display ATO running time information," the corresponding function can be achieved. Furthermore, to prevent accidental activation, a secondary confirmation process can be set up. For example, if the first voice input is "Display ATO running time information," a second voice input of "Confirm display of ATO running time information" is required before the human-machine interface layer can execute the display of the ATO running time information.

[0121] Similarly, when basic commands are sent to the train auxiliary management system / train driving control system, a two-stage confirmation process can also be used. Only after the two-stage confirmation can the commands be sent to the train auxiliary management system / train driving control system. As mentioned earlier, this will not be elaborated upon here.

[0122] Of course, the human-computer interaction layer can also be equipped with other modules, such as a weather function module for weather forecasting; or a voice broadcast module for broadcasting text in voice form; or a one-button control module for controlling the basic instructions of the subsystems in the train auxiliary management system and train driving control system (such as the aforementioned driver behavior intelligent verification system, driver operation assistance system and driver sight distance system) in a set form, and realizing the operation of all subsystems in the set through one-button control; or a three-dimensional space representation module for displaying the "operation status of the front and rear trains" in the train operation end information in the form of an overhead view on the track, which is convenient for the driver to further provide corresponding dispatch instructions.

[0123] In a preferred embodiment, the central control system can be equipped with a corresponding voice control system. This system converts voice information into specific command code data for use by the central control system. Drivers can input commands via voice. Commands can be divided into two categories: general control commands, which do not affect driving safety, including air conditioning control, seat posture control, screen display parameters, and telephone chat control commands. These commands can be designed as one-time commands, meaning the driver only needs to speak them once to execute them. Driving control commands, which affect the train's driving status, correspond to the operation of the train's acceleration / deceleration and direction handles. These commands are designed for secondary or multiple confirmations, with different voice commands for each confirmation.

[0124] The following will introduce an application case of an integrated intelligent cockpit system for train drivers proposed in this invention:

[0125] As shown in Figures 1 and 2, the train restarts on the track in preparation for departure. Due to the restart, the train loses information about the route ahead. The driver sends data to the drone activation module through the central control system. The drone activation module generates drone commands, and the drone itself operates according to the drone commands and acquires images. The drone data collection module transmits the data to the central control system (the display and interaction system in the central control system shown in Figure 2), so that the driver can understand the route ahead. After completing the task, the drone returns to its original position on the train to wait for further instructions.

[0126] As shown in Figure 2, the human-computer interaction layer in this case uses a display screen with corresponding programs set up. As mentioned earlier, ATP, CIR, and LKJ are connected to the safety protection layer respectively. The human-computer interaction layer uses HTML to display information from the train driver's end / train operation end. Taking drone operation as an example, the display screen shows several input boxes such as "distance", "speed", and "operation type", as well as a video receiving box.

[0127] As shown in Figure 2, the human-machine interaction layer also describes the information communication function of the driver operation assistance system. The train can also communicate with other trains through the human-machine interaction layer.

[0128] Figure 3 shows a use case of the driver behavior intelligent verification system. The motion capture module acquires the driver's action information, and the motion analysis module converts it into the driver's action result. At this time, the ideal action result is to confirm that the train has not exceeded the yellow code position. The action verification module compares and verifies the driver's action result (track position) with the ideal action result (train has not exceeded the yellow code position) and outputs to the central control system that the driver has confirmed that he has not exceeded the yellow code position.

[0129] Figure 4 shows a model architecture in which the image model and text model are used to further judge the driver's actions and behaviors, while the big data model can adjust the image model and text model in real time, thereby making the judgment more accurate.

[0130] Although the present invention has been described in detail through the preferred embodiments above, it should be understood that the above description should not be considered as a limitation of the present invention. Various modifications and substitutions to the present invention will be apparent to those skilled in the art after reading the above description. Therefore, the scope of protection of the present invention should be defined by the appended claims.

Claims

1. An integrated intelligent cockpit system for train drivers, characterized in that, The system includes: The train auxiliary management system obtains information from the train driver's terminal. The train control system acquires information from the train operation terminal. The central control system is connected to both the train auxiliary management system and the train driving control system to enable data exchange between them. The central control system generates train operation instructions based on the information from the train operator and the train driver, and sends them to the train driving control system. The train driving control system then controls the train operation based on the train operation instructions. The train auxiliary management system, train driving control system, and central control system adjust their operation based on data from each other and themselves. The train auxiliary management system includes: a driver behavior intelligent verification system, a driver line-of-sight system, and a driver operation assistance system; the driver line-of-sight system includes a drone body, which acquires observation images of the train's path ahead by installing a camera on the drone body.

2. The integrated intelligent cockpit system for train drivers according to claim 1, characterized in that, The central control system includes a display and interaction system, which displays all data received by the central control system; and implements basic control of the train auxiliary management system and the train driving control system through the display and interaction system.

3. The integrated intelligent cockpit system for train drivers according to claim 1, characterized in that, The train driver terminal information refers to information related to train operation generated with the train driver at its core.

4. The integrated intelligent cockpit system for train drivers according to claim 1, characterized in that, The train operation terminal information refers to information related to train operation, which is generated with train operation as the core.

5. The integrated intelligent cockpit system for train drivers according to claim 1, characterized in that, The driver behavior intelligent verification system includes: The motion capture module acquires driver action information; The motion analysis module connects to the motion capture module, receives and analyzes driver motion information, and converts it into driver motion results. The action verification module is connected to both the action analysis module and the central control system. It is used to receive the driver's action results and collect the ideal action results, then compare and verify the driver's action results with the ideal action results, and output the corresponding train driver terminal information to the central control system.

6. The integrated intelligent cockpit system for train drivers according to claim 5, characterized in that, The motion capture module, motion analysis module, and motion verification module are all embedded with corresponding artificial intelligence models.

7. A centralized intelligent cockpit system for train drivers according to claim 6, characterized in that, The artificial intelligence model adopts a diffusion model. The motion capture module converts the driver's motion information into data codes. The motion analysis module analyzes the data codes to extract the nodes of key actions in the data codes. The motion verification module verifies the nodes of key actions and outputs the corresponding results.

8. The integrated intelligent cockpit system for train drivers according to claim 1, characterized in that, The driver visibility system also includes multiple cameras installed on the train body, all of which are connected to the central control system, which displays the captured content in real time.

9. A centralized intelligent cockpit system for train drivers according to claim 1, characterized in that, The driver visibility system also includes: The UAV startup module is connected to both the central control system and the UAV itself. It stores the UAV's parameters and operating program, and outputs UAV commands to the UAV itself based on data from the central control system. The UAV itself executes observation tasks and acquires observation data according to the UAV commands from the UAV startup module. The drone data collection module is connected to the drone startup module, the drone itself, and the central control system. It receives data from the drone startup module and the drone itself and transmits it to the central control system.

10. A centralized intelligent cockpit system for train drivers according to claim 1, characterized in that, The driver operation assistance system includes: The identity verification module connects to the central control system, receives ID card information from the central control system and verifies the driver's identity. When the ID card verification is successful, it sends an auxiliary system start command. An object selection module, which is connected to the authentication module, generates a communication instruction when it receives an auxiliary system startup instruction. The information communication module connects to the object selection module, receives communication instructions from the object selection module, and performs information communication according to the communication instructions; The information communication module is also connected to the central control system to enable interaction with the outside world.

11. The integrated intelligent cockpit system for train drivers according to claim 1, characterized in that, The driver operation assistance system includes: The train information retrieval module is connected to the central control system and generates information retrieval instructions based on information retrieval requests from the central control system. The cloud database module is connected to both the train information retrieval module and the central control system. The cloud database module is used to store train information, extract the corresponding cloud data according to the received information retrieval instructions, and transmit it to the central control system to realize interaction with the outside world.

12. The integrated intelligent cockpit system for train drivers according to claim 1, characterized in that, The train control system includes: Automatic train protection devices, and / or automatic train operation devices, and / or integrated locomotive wireless communication devices, and / or train operation monitoring devices; Each of the aforementioned devices is connected to the central control system; Automatic train protection devices, and / or automatic train operation devices, and / or integrated locomotive wireless communication devices, and / or train operation monitoring devices all control train operation according to train operation commands.

13. A centralized intelligent cockpit system for train drivers according to claim 12, characterized in that, Each of the aforementioned devices is equipped with a corresponding anti-accidental touch module and connected to it. When the driver makes a mistake, the anti-accidental touch module provides corresponding feedback.

14. A centralized intelligent cockpit system for train drivers according to claim 12, characterized in that, Each of the aforementioned devices is equipped with a corresponding alarm device and connected to it. When the alarm device detects danger information, it issues an alarm message to the driver. The alarm device sends the danger information to the central control system through the corresponding device, and the central control system then sends it to the driver operation assistance system to realize the query of relevant information of the emergency plan.

15. A centralized intelligent cockpit system for train drivers according to claim 12, characterized in that, Each of the aforementioned devices is equipped with a corresponding emergency call module and connected to it. The emergency call module triggers an emergency call and automatically sends rescue information.

16. A centralized intelligent cockpit system for train drivers according to claim 2, characterized in that, The display interaction system includes: A safety protection layer is connected to the train driving control system and the train auxiliary management system respectively, receives information from the train driver's end / train operation end, and performs safety checks on the information from the train driver's end / train operation end; The human-machine interface layer is connected to the safety protection layer via signals. It receives and displays the inspected information from the train driver's end / train operation end.

17. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements an integrated intelligent cockpit system for train drivers as described in any one of claims 1-16.

18. An electronic device, characterized in that, It includes a processor and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, it implements an integrated intelligent cockpit system for train drivers as described in any one of claims 1-16.

Images