Method for monitoring a vehicle driver of a rail vehicle

A camera-based monitoring system in rail vehicles addresses the fatigue and failure issues of SIFA by analyzing driver activity and posture, enhancing safety through early health detection and reducing distractions.

WO2026114606A1PCT designated stage Publication Date: 2026-06-04SIEMENS MOBILITY GMBH
View PDF 3 Cites 0 Cited by

Patent Information

Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
SIEMENS MOBILITY GMBH
Filing Date
2025-11-03
Publication Date
2026-06-04

AI Technical Summary

Technical Problem

Existing safety driving systems in rail vehicles, such as the SIFA button, require constant attention from drivers, leading to fatigue and distraction, and are prone to failure due to unconscious operation by experienced drivers during health impairments.

Method used

A camera-based monitoring system in the driver's cab captures and analyzes driver activity and posture, using AI to detect discrepancies and initiate appropriate actions, eliminating the need for the SIFA button and enhancing safety by detecting health limitations early.

Benefits of technology

The system reduces driver fatigue by alleviating duties, prevents distracting actions, and reliably detects health impairments, ensuring timely assistance and maintaining vehicle safety without the limitations of push-button systems.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure EP2025081686_04062026_PF_FP_ABST
    Figure EP2025081686_04062026_PF_FP_ABST
Patent Text Reader

Abstract

The invention relates to a method for monitoring a vehicle driver (TFF) of a rail vehicle (SFZ). Both the activity and body posture of a vehicle driver (TFF) in a driver's cab (FST) of the rail vehicle (SFZ) are detected by means of a camera (4). Images from the camera (4) are transmitted to an evaluation system (ITDM) and are continuously evaluated therein. On the basis of the images, the evaluation system (ITDM) ascertains a specific body posture of the vehicle driver (TFF) and / or a specific activity of the vehicle driver (TFF) and compares said posture and activity with a current operating state of the rail vehicle (SFZ) for the existence of a contradiction. If a contradiction is detected, a predetermined action is initiated for the rail vehicle.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] 202419861

[0002] 1

[0003] Description

[0004] Procedure for monitoring a train driver

[0005] The invention relates to a method for monitoring a driver of a rail vehicle.

[0006] Introduction and State of the Art

[0007] In railway engineering, drivers of rail vehicles (a traction unit, a locomotive, etc.) are monitored for their fitness to drive during the journey.

[0008] For this purpose, it is known to equip the respective vehicles with a so-called "safety driving circuit, SIFA". This must be operated by the driver at specified intervals via a special control element known as the "SIFA button". In the event of irregularities in operation or if the button is not operated within a specified period, an emergency braking maneuver is automatically initiated and carried out to bring the vehicle to a standstill.

[0009] If, for example, a driver is no longer able to safely operate the rail vehicle he is driving due to a disturbance of consciousness, the braking is initiated automatically and carried out without the driver's involvement.

[0010] The required constant operation of the safety driving system demands increased attention from the driver, which may be tiring.

[0011] The driver may also be distracted from other important tasks or other safety-relevant perceptions.

[0012] Furthermore, it is known that due to the monotonous operation of the safety driving circuit, very experienced drivers unconsciously continue to operate it even in the event of a (beginning) health impairment, so that its early functionality is delayed or can be completely ineffective.

[0013] Therefore, although the safety driving circuit described above is simple in design and proven, it remains prone to failure. 202419861

[0014] 2

[0015] Task

[0016] It is therefore the object of the invention described below to provide an improved method for monitoring a vehicle driver or a locomotive driver of a rail vehicle, which reliably supports the vehicle driver in his tasks without fatigue.

[0017] This problem is solved by the features of claim 1 and claim 7.

[0018] Description of the invention

[0019] The invention relates to a method for monitoring a driver or locomotive driver of a rail vehicle. A camera in the driver's cab of the rail vehicle captures both the driver's activity and posture. Images from the camera are transmitted to an evaluation system and continuously analyzed there. Based on the images, the evaluation system determines a specific posture and / or activity of the driver and compares it with the current operating state of the rail vehicle to detect any discrepancies. Upon detection of a discrepancy, a predetermined action is initiated on the rail vehicle.

[0020] Advantageous further developments of the invention are specified in the dependent patent claims.

[0021] Advantages:

[0022] The present invention relieves the driver of some of his duties and thus prevents his fatigue.

[0023] The present invention makes it possible to dispense with the conventional safety driving circuit based on the SIFA button in rail vehicles.

[0024] The present invention detects health limitations in the driver at an early stage, thus significantly increasing safety compared to push-button-based safety driving circuits. 202419861

[0025] 3

[0026] The present invention ensures that the driver does not perform any impermissible or distracting actions, such as operating a private mobile phone, while driving.

[0027] The present invention enables a land-based or stationary control center to reliably detect a driver's health impairment, such as fainting. This allows appropriate assistance measures to be initiated for the driver without delay.

[0028] The present invention also detects incorrect or inadequate operating actions by the vehicle driver.

[0029] Character description:

[0030] The invention is explained in more detail below with the aid of a drawing. The single figure, FIG 1, shows an exemplary embodiment of the invention in an overview.

[0031] In the driver's cab of a rail vehicle, one (or more) electronic camera 4 is installed.

[0032] Their installation location is chosen so that both the activity and posture of a vehicle driver or locomotive driver are recorded at all times throughout the entire driver's cab (FST).

[0033] Camera 4 is connected to an ITDM ("Intelligent Train Driver Monitoring, ITDM") evaluation system via a DATV data connection (e.g., using Ethernet), whereby images from camera 4 are continuously evaluated by the ITDM evaluation system.

[0034] The ITDM evaluation system uses a suitable, artificial intelligence-based evaluation method that has been trained to: recognize and evaluate specific body postures of the train driver (TFF), and / or to recognize and evaluate specific activities of the train driver (TFF), and to recognize and evaluate the operating states of the rail vehicle (SFZ). 202419861

[0035] 4

[0036] The ITDM evaluation system reliably detects at least the following scenarios:

[0037] 1. The vehicle driver TFF is located at the driver's console of the driver's cab FST and operates the rail vehicle SFZ.

[0038] 2. The vehicle operator TFF is located at a side departure device of the driver's cab FST and operates the rail vehicle SFZ,

[0039] 3. The vehicle driver TFF is located at a position on the rear wall of the driver's cab FST,

[0040] 4. The driver TFF is about to leave the driver's cab FST through a door,

[0041] 5. The driver's cab FST is without a driver TFF (i.e., it is empty).

[0042] 6. The vehicle operator TFF is at the control panel of the driver's cab FST, is alert but does not operate the rail vehicle SFZ.

[0043] 7. The vehicle driver TFF is at the driver's console of the driver's cab FST or in the driver's cab FST, is not alert or is distracted,

[0044] 8. The vehicle operator TFF is at the control panel of the driver's cab FST or in the driver's cab FST and is unconscious,

[0045] 9. In addition to the vehicle driver TFF, there are other persons in the driver's cab FST,

[0046] 10. The rail vehicle SFZ is switched off and someone is in the driver's cab FST for more than x minutes.

[0047] 11. Undefined, i.e., none of the above scenarios is reliably detected.

[0048] The identified scenarios 1 to 11 are continuously transmitted to a vehicle control system 2 via a data connection during the operation of the rail vehicle SFZ.

[0049] The control system 2 compares the detected scenario with a currently known vehicle operating state and reacts accordingly in case of deviations between the detected scenario and the current vehicle operating state.

[0050] For example, a response is preferentially initiated at the rail vehicle if the driver (TFF) does not operate the rail vehicle (SFZ) according to specified operating requirements, or is unable to do so. It is therefore the task of the control system 2 to bring the rail vehicle into a safe state in a suitable manner.

[0051] The control system transmits corresponding drive and brake commands to a drive and brake unit 5 of the rail vehicle SFZ. 202419861

[0052] 5

[0053] The control system 2 also communicates with a device 6, which is designed to issue visual and / or audible warnings and is intended for the vehicle operator TFF. This enables the control system 2 to inform or warn the vehicle operator TFF in order to prompt them to perform a necessary operating action.

[0054] Device 6 is preferably integrated into existing systems of the rail vehicle SFZ, for example in a display of the driver's cab FST.

[0055] A data transmission device 3 enables communication between the control system 2 and a land-based or stationary monitoring or control point, so that detected hazards or dangerous situations are transmitted to it.

[0056] Depending on the situation, the inspection authority can then initiate appropriate measures.

[0057] Furthermore, camera 4 in the driver's cab (FST) is connected to data transmission device 3. If the control system 2 detects a hazard, the corresponding camera images are automatically transmitted to the land side.

[0058] Preferably, the vehicle operator TFF is offered the option of preventing this transmission via a display and control unit 7, for example if, in his opinion, there is no danger.

[0059] The display and control unit 7 is preferably integrated into existing systems, for example in a display of the driver's cab (FST).

[0060] The following table lists exemplary reactions or actions of the control system 2 to the various scenarios mentioned above: 202419861

[0061] 6 202419861

[0062] 7 202419861

[0063] 8 202419861

[0064] 9 202419861

[0065] 10

[0066] The times to to t? may be set according to country-specific requirements or be variably adjustable.

Claims

202419861 11 Patent claims 1. A method for monitoring a train driver (TFF) of a rail vehicle (SFZ), in which a camera (4) in a driver's cab (FST) of the rail vehicle (SFZ) records both the activity and posture of a train driver (TFF) there, in which images from the camera (4) are transmitted to an evaluation system (ITDM) and continuously evaluated there, in which, based on the images, the evaluation system (ITDM) determines a specific posture of the train driver (TFF) and / or a specific activity of the train driver (TFF) and compares it with a current operating state of the rail vehicle (SFZ) to detect a discrepancy, in which, upon detection of a discrepancy, a predetermined action is initiated on the rail vehicle.

2. The method of claim 1, wherein the evaluation system (ITDM) for image evaluation uses an evaluation method based on artificial intelligence, and wherein the evaluation method has been trained: - on the recognition and assessment of specific body postures of the driver (TFF), and / or - on the recognition and evaluation of specific driver activities (TFF), and / or - on the detection and evaluation of operating conditions of the rail vehicle (RV), and / or - on the detection of a discrepancy between the posture or activity of the vehicle operator (TFF) and a current operating state of the rail vehicle (SFZ). 202419861 12 3. Method according to claim 1 or 2, wherein the evaluation system (ITDM) detects at least one of the following scenarios, compares it with one of the following current operating states and initiates the corresponding action based on this: 202419861 13 202419861 14 202419861 15 202419861 16 4. Method according to claim 3, - in which recognized scenarios are continuously transmitted to a vehicle control system (2) of the rail vehicle (RV), and - in which the associated action is triggered or initiated by the vehicle control system (2).

5. Method according to claim 4, wherein the vehicle control technology (2) communicates with a stationary control point in order to transmit detected hazards or dangerous situations to it.

6. Method according to claim 5, wherein the images from the camera (4) are automatically transmitted to the control point.

7. Rail vehicle with means configured to carry out the method according to any one of the preceding claims.