Method for operating a rail vehicle, comprising monitoring of the vehicle driver

The method addresses the limitations of current rail vehicle monitoring systems by using biometric monitoring to detect driver impairment and provide real-time feedback, significantly enhancing safety by allowing for early intervention.

WO2025067789A1PCT designated stage expired Publication Date: 2025-04-03SIEMENS MOBILITY GMBH
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
PCT/EP2024/073818
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-09-27
Filing Date
2024-08-26
Publication Date
2025-04-03

AI Technical Summary

Technical Problem

Current rail vehicle operation monitoring systems rely solely on safety driving circuits (SI FA) to detect driver impairment, which may not recognize fatigue or other conditions affecting safe driving until it is too late.

Method used

A method that uses a monitoring device to record biometric features of the driver, such as fatigue levels, and provides real-time feedback to the driver to address impairment conditions, while also integrating with existing safety driving circuits to enhance safety.

Benefits of technology

This solution enhances rail vehicle safety by allowing for early detection of driver impairment, such as fatigue, and provides timely interventions to prevent accidents, thereby improving overall operational safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure EP2024073818_03042025_PF_FP_ABST
    Figure EP2024073818_03042025_PF_FP_ABST
Patent Text Reader

Abstract

The invention relates to a method for operating a rail vehicle (1), in which method a vehicle driver (7) who is driving the rail vehicle (1) is monitored by means of a monitoring device (4, 204, 304). The monitoring device (4, 204, 304) records biometric characteristics of the vehicle driver (7) (A, AA, AAA, AAAA). On the basis of the biometric characteristics, a state of impairment of the vehicle driver (7), which state impairs safe driving of the rail vehicle (1), is detected (B, BB, BBB, BBBB).
Need to check novelty before this filing date? Find Prior Art

Description

[0001] Description

[0002] Method for operating a rail vehicle with driver monitoring

[0003] Regardless of the grammatical gender of a particular term, persons with male, female or other gender identity are included.

[0004] The invention relates to a method for operating a rail vehicle, in which a driver who drives the rail vehicle is monitored by means of a monitoring device. The invention further relates to a device for operating a rail vehicle, comprising: a monitoring device which is configured to monitor a driver who drives the rail vehicle.

[0005] It is generally known to monitor rail vehicle drivers. For example, so-called safety control circuits (Si fa for short) are known, which trigger a safety-related measure if the driver fails to perform a specified action, such as pressing the so-called Si fa button, within a specified time period.

[0006] DE 10 2012 105 160 A1 describes a solution in which the driver's ability to work is monitored. In addition to the safety monitoring system, an attention detection device is provided to determine the driver's level of attention. A control unit is connected to the safety control system on the rail vehicle in such a way that the control unit is configured to activate and deactivate the safety control system depending on the driver's level of attention determined. The described safety device is thus provided in addition to the safety control system on the rail vehicle.

[0007] Against this background, the object of the present invention is to improve the operation of a rail vehicle.

[0008] This object is achieved by a method according to the invention of the type mentioned above, in which the monitoring device records biometric characteristics of the vehicle driver. Based on the biometric characteristics, an impairment of the vehicle driver that impairs the safe operation of the rail vehicle is detected.

[0009] The invention is based on the realization that, in existing multiple units, the driver is monitored exclusively by the safety control system (Si fa). This system warns the driver, for example, via voice output, and prompts them to press one of the Si fa control elements, such as the so-called Si fa button. If the driver fails to react, emergency braking is initiated, for example.

[0010] The inventive solution creates an additional monitoring instance and thus increases safety during rail vehicle operation. Furthermore, the inventive method allows the impairment condition to be detected early (and not only when the driver fails to react).

[0011] According to a preferred embodiment of the method according to the invention, the biometric features represent a state of fatigue of the vehicle driver.

[0012] This is particularly useful because fatigue can impair the safe operation of the rail vehicle, particularly in the event of microsleep. Preferably, a request to move (to the driver) is made in order to at least temporarily remedy the fatigue. The driver can, for example, react by standing up briefly and performing specified movements. Furthermore, the driver can preferably be prompted via a message to acknowledge the movements performed. Acknowledgement is made, for example, by pressing a button.

[0013] According to a further preferred embodiment of the method according to the invention, the monitoring device comprises a portable device which is carried by the driver of the vehicle and has a detection device for detecting the biometric characteristics of the driver of the vehicle.

[0014] The wearable device is preferably (removably) attached to the wrist of the vehicle driver in such a way that the biometric characteristics are captured by the capture device. For example, the wearable device is a wearable device, such as a smartwatch. The capture device is, for example, a heart rate monitor of the wearable device.

[0015] In a preferred development of the above-described embodiment, the biometric features are captured by the capture device. A detection device of the portable device uses the biometric features to determine whether the impairment exists. A notification is issued to the driver that the impairment has been detected.

[0016] The notification is preferably issued via an output device on the portable device. For this purpose, the portable device displays, for example, a notification message and additionally supports the output with a vibration. Alternatively or additionally, the impairment information is transmitted to a mobile device carried by the driver. The notification can be issued via an output device on the mobile device. The mobile device is, for example, a tablet carried by the driver.

[0017] In a preferred development, the portable device is physically and informationally separated from a safety control circuit (Sifa) of the rail vehicle. In this way, the additional monitoring by means of the monitoring device is carried out independently of the safety control circuit. This has the advantage that no further homologation is required for the safety control circuit if the rail vehicle is supplemented with the monitoring device according to the invention (for example, after production and homologation).

[0018] According to a further preferred development of the above-described embodiment, the portable device is connected to the rail vehicle via information technology. The biometric characteristics are recorded by the recording device. A recognition device uses the biometric characteristics to determine whether the impairment condition exists. Impairment information representing the impairment condition is sent to the safety control system of the rail vehicle.

[0019] In this way, the safety control system becomes aware of the impairment and can initiate appropriate measures. For example, a warning or warning message can be issued to the driver via an output device of the safety control system. Alternatively or additionally, monitoring the driver and transmitting the impairment information can serve to relieve the driver of the constant actuation of the safety control system button. If the driver is continuously monitored, it may be preferable to require the driver to actuate the safety control system button only when the impairment is detected.

[0020] If the impairment information indicates that the driver is suffering from an acute health impairment, the warning issued by the output device preferably requests the driver to bring the rail vehicle to a stop immediately. Alternatively or additionally, the safety control system initiates, for example, an emergency braking of the rail vehicle.

[0021] The recognition device is preferably a recognition device of the portable device. For example, the recognition is carried out by means of a computing device of the portable device. This is done, for example, using a recognition algorithm. Alternatively or additionally, the recognition is carried out using an artificial neural network.

[0022] Alternatively or additionally, the detection device is permanently installed in the rail vehicle, for example as part of a server device permanently installed in the rail vehicle.

[0023] According to a further preferred embodiment of the method according to the invention, the monitoring device comprises an optical detection device which detects the face and / or at least one of the eyes of the vehicle driver.

[0024] The optical detection device is, for example, part of a camera system installed in the vehicle. The camera system can be permanently installed during the production of the rail vehicle or retrofitted after production.

[0025] The optical detection device has, for example, an eye scanner that detects the driver's fatigue level based on the movement of the eyes and / or eyelids.

[0026] In a preferred development of this embodiment, the biometric features are captured by the optical capture device. A detection device uses the biometric features to determine whether the impairment exists. An indication that the impairment has been detected is output to the driver by an output device.

[0027] The detection device is preferably part of a monitoring device arranged in the rail vehicle, which has the optical detection device. The monitoring device can be permanently installed during the manufacture of the rail vehicle or retrofitted after the rail vehicle has been manufactured. Alternatively or additionally, the detection device is part of a server device permanently installed in the rail vehicle.

[0028] The output device is, for example, permanently installed in the rail vehicle.

[0029] In a preferred development of this embodiment, the optical detection device and the recognition device are part of a camera device. Impairment information representing the impairment state is sent wirelessly to a mobile device carried by the driver. Upon receipt of the impairment information, the indication that the impairment state has been recognized is output to the driver via the output device of the mobile device.

[0030] In a further preferred development of this embodiment, the optical detection device is connected to the rail vehicle via information technology. The biometric features are detected by the optical detection device. The detection device uses the biometric features to detect whether the impairment condition exists. Information indicating that the impairment condition has been detected is sent to a safety control system. Upon receipt of the impairment information, information indicating that the impairment condition has been detected is output to the vehicle driver via the output device of the safety control system.

[0031] The object mentioned above is further achieved by a computer program. The computer program comprises instructions which, when the program is executed by a computing device, cause the computing device to carry out the method of the type described above. The invention further relates to a computer program product comprising a computer program of this type. The computing device is preferably, at least in part, a computing device of the track-bound vehicle and / or a computing device of a land-based facility.

[0032] The object mentioned at the outset is further achieved by a provision device for the computer program of the type described above, wherein the provision device stores and / or provides the computer program. The provision device is, for example, a storage unit that stores and / or provides the computer program. Alternatively and / or additionally, the provision device is, for example, a network service, a computer system, a server system, in particular a distributed, for example cloud-based computer system and / or virtual computer system, which stores and / or provides the computer program product preferably in the form of a data stream.

[0033] The provision takes place in the form of a program data block as a file, in particular as a download file, or as a data stream, in particular as a download data stream, of the computer program. This provision can also take place, for example, as a partial download consisting of several parts. Such a computer program is, for example, read into a system using the provision device, so that the method according to the invention is executed on a computer.

[0034] The aforementioned object is further achieved by a device of the aforementioned type. In this device according to the invention, the monitoring device is configured to detect biometric characteristics of the vehicle driver. A recognition device is configured to use the biometric characteristics to detect an impairment of the vehicle driver that impairs the safe operation of the rail vehicle.

[0035] The object mentioned at the outset is further achieved by a rail vehicle which comprises a device of the type described above.

[0036] The object mentioned above is further achieved by a system. The system comprises a rail vehicle with a detection device. The system further comprises a monitoring device for a device of the type described above.

[0037] For advantages, embodiments, and design details of the computer program according to the invention, the provision device according to the invention, the device according to the invention, the rail vehicle according to the invention, and the system according to the invention, reference can be made to the above description of the corresponding method features of the method according to the invention for operating a rail vehicle. Exemplary embodiments of the invention are explained in more detail with reference to the drawings. In the drawings:

[0038] Figure 1 shows schematically the structure of a first embodiment of the device according to the invention,

[0039] Figure 2 shows schematically the sequence of a first embodiment of the method according to the invention,

[0040] Figure 3 shows schematically the structure of a second embodiment of the device according to the invention,

[0041] Figure 4 shows schematically the sequence of a second embodiment of the method according to the invention,

[0042] Figure 5 shows schematically the structure of a third embodiment of the device according to the invention,

[0043] Figure 6 shows schematically the sequence of a third embodiment of the method according to the invention,

[0044] Figure 7 shows schematically the structure of a fourth embodiment of the device according to the invention and

[0045] Figure 8 schematically shows the sequence of a fourth embodiment of the method according to the invention.

[0046] Figure 1 shows a rail vehicle 1 with a device 2 for operating the rail vehicle 1. The rail vehicle 1 is, for example, a multiple unit train. The device 2 has a monitoring device 4 as part of a smartwatch 5.

[0047] Figure 2 shows a schematic flow diagram which represents the sequence of the method according to the invention for operating the rail vehicle 1 shown in Figure 1.

[0048] During ferry operation, in the exemplary embodiment shown in Figure 1, the rail vehicle 1 travels along a route 26. The rail vehicle 1 is driven by a driver 7. The driver 7 carries the smartwatch 5, i.e., the smartwatch is attached to the wrist of the driver 7, switched on, and powered on.

[0049] The monitoring device 4 has a detection device 6 as part of the smartwatch 5. In a method step A, the smartwatch 5 detects biometric characteristics of the vehicle driver 7 using the detection device 6. The biometric characteristics include, for example, the pulse, respiration, and blood oxygen saturation. Sensors of the smartwatch 5 are used as the detection device 6 for the detection. These sensors detect biometric characteristics on the wrist of the vehicle driver 7.

[0050] The monitoring device 4 additionally has a detection device 8 which, in a method step B, detects a state of impairment of the vehicle driver 7, wherein the state of impairment impairs the safe driving of the rail vehicle 1. An impairment state of this type is, for example, a state of fatigue of the vehicle driver 7. This is because fatigue can impair the safe driving of the rail vehicle 1, in particular in the event of microsleep. The detection device 8 has a computing device 9 and is part of the smartwatch 5. In other words: the device 2 is designed as a smartwatch 5 and comprises the monitoring device 4. The monitoring device 4 comprises the detection device 6 and the detection device 8.

[0051] Upon detection of the impairment state, in a method step C, an output device 10 of the smartwatch 5 outputs a notification to the driver 7. This notification is, for example, an acoustic notification supported by a vibration of the smartwatch 5. The notification contains, for example, a message displayed on a display 12 of the smartwatch 5, which prompts the driver 7 to move to counteract fatigue.

[0052] If an acute health impairment of the vehicle driver 7 is detected, the message requests the vehicle driver 7 to bring the rail vehicle 1 to a stop immediately.

[0053] Alternatively or additionally, the notification can be issued via a mobile device, for example a tablet, which the vehicle driver 7 carries with him. For this purpose, the smartwatch 5 is connected to the mobile device, for example via Bluetooth. Impairment information representing the impairment is transmitted from the smartwatch 5 to the mobile device. The notification is issued via an output device of the mobile device, for example via a display of the tablet.

[0054] The smartwatch 5 shown in Figure 1 and / or the mobile terminal (not shown) are physically and information-technically separated from the rail vehicle 1, in particular from a safety driving circuit 120 of the rail vehicle 1. Figure 3 shows a second exemplary embodiment of the device 102 according to the invention. Identical or functionally equivalent elements are provided with the same reference numerals as in relation to Figure 1. Figure 4 shows a schematic flow diagram representing the sequence of a second exemplary embodiment of the method according to the invention, which is carried out using the device 102.

[0055] Analogous to the exemplary embodiment described above with reference to Figure 2, in a method step AA the smartwatch 5 records biometric features of the vehicle driver 7 by means of a recording device 6 (the monitoring device 4).

[0056] In contrast to the first exemplary embodiment according to Figures 1 and 2, the smartwatch 5 in the second exemplary embodiment is connected to the rail vehicle 1 for information purposes. In a method step BB, the detection device 8 of the smartwatch 5 detects an impairment of the vehicle driver 7.

[0057] Impairment information representing the impairment state is sent to a safety control circuit 120 of the rail vehicle 1 in a method step CG. This occurs, for example, via a wireless connection 122 between the smartwatch 5 and a wireless interface 123 of the rail vehicle 1.

[0058] Upon receipt of the impairment information, an indication is output to the vehicle driver 7 by means of an output device 124 of the safety driving circuit 120 in a method step DD.

[0059] If the impairment information indicates that the vehicle driver 7 is suffering from an acute health impairment, the notification issued by the output device 124 requests the vehicle driver 7 to bring the rail vehicle 1 to a stop immediately. Alternatively or additionally, the safety drive circuit 120 initiates an emergency braking of the rail vehicle 1 in a method step EE.

[0060] Figure 5 shows a third exemplary embodiment of the device 202 according to the invention. Identical or functionally equivalent elements are provided with the same reference numerals as in relation to Figures 1 or 3. Figure 6 shows a schematic flow diagram representing the sequence of a third exemplary embodiment of the method according to the invention, which is carried out using the device 202.

[0061] In contrast to the first and second exemplary embodiments according to Figures 1 to 4, biometric characteristics of the vehicle driver are recorded in a method step AAA using an optical detection device 230 arranged in the driver's cab. The optical detection device 230 is, for example, part of a camera device. The camera device forms a monitoring device 204.

[0062] The optical detection device 230 detects, in particular, the face and / or at least one of the eyes of the vehicle driver 7. The optical detection device 230 comprises, for example, an eye scanner that detects the fatigue state of the vehicle driver 7 based on the movement of the eyes and / or eyelids.

[0063] A detection device 208 for detecting the impairment state in a method step BBB is, for example, part of the camera device 230. Alternatively or additionally, the detection device can be part of a computing device 211 permanently installed in the rail vehicle. Impairment information representing the detected impairment is sent wirelessly in a method step CCC to a terminal device 234, which the vehicle driver 7 carries with him. The terminal device 234 is, for example, a tablet 235.

[0064] Upon receipt of the impairment information, a notification is issued to the vehicle driver 7 in a method step DDD by means of an output device 224 of the mobile terminal 234. The notification indicates that the impairment state has been detected.

[0065] Figure 7 shows a fourth exemplary embodiment of the device 302 according to the invention. Identical or functionally equivalent elements are provided with the same reference numerals as in relation to Figures 1, 3, or 5. Figure 8 shows a schematic flow diagram representing the sequence of a fourth exemplary embodiment of the method according to the invention, which is carried out using the device 302.

[0066] Analogous to the exemplary embodiment described above with reference to Figure 6, biometric characteristics of the vehicle driver 7 are recorded in a method step AAAA by means of an optical detection device 330 (a monitoring device 304) arranged in the driver's cab. The optical detection device 330 is, for example, part of a camera device.

[0067] In contrast to the third exemplary embodiment according to Figure 6, the monitoring device 304 in the fourth exemplary embodiment is connected to the rail vehicle 1 for information purposes. In a method step BBBB, a detection device 308 of the monitoring device 304 detects an impairment of the vehicle driver 7. In the fourth exemplary embodiment shown, the detection device 308 is part of the camera device. Alternatively or additionally, the detection device can be part of a computing device 311 permanently installed in the rail vehicle.

[0068] Impairment information representing the impairment state is sent to a safety control circuit 120 of the rail vehicle 1 in a method step CCCC. This occurs, for example, via a wireless connection 322 between the monitoring device 304 and a wireless interface 123 of the rail vehicle 1.

[0069] Upon receipt of the impairment information, an indication is output to the vehicle driver 7 by means of an output device 124 of the safety driving circuit 120 in a method step DDDD.

[0070] If the impairment information indicates that the vehicle driver 7 is suffering from an acute health impairment, the notification issued by the output device 124 requests the vehicle driver 7 to bring the rail vehicle 1 to a stop immediately. Alternatively or additionally, the safety drive circuit 120 initiates an emergency braking of the rail vehicle 1 in a method step EEEE.

[0071] Although the invention has been illustrated and described in detail by the preferred embodiment, the invention is not limited to the disclosed examples and other variations can be derived therefrom by those skilled in the art without departing from the scope of the invention.

Claims

Patent claims 1. Method for operating a rail vehicle (1), in which a driver (7) who drives the rail vehicle (1) is monitored by means of a monitoring device (4, 204, 304), characterized in that the monitoring device (4, 204, 304) records biometric features of the driver (7) (A, AA, AAA, AAAA) and, on the basis of the biometric features, an impairment state of the driver (7) which impairs the safe driving of the rail vehicle (1) is recognized (B, BB, BBB, BBBB).

2. Method according to claim 1, characterized in that the biometric features represent a state of fatigue of the vehicle driver (7).

3. Method according to claim 1 or 2, characterized in that the monitoring device (4) comprises a portable device (5) which - is carried by the driver (7) and - a detection device (6) for detecting the biometric characteristics of the vehicle driver (7).

4. Method according to claim 3, characterized in that the biometric features are detected (A, AA) by means of the detection device (6) and by means of a detection device (8) of the portable device (5) it is detected (B, BB) on the basis of the biometric features whether the impairment state exists, and an indication is issued to the vehicle driver (7) (C, DD) that the impairment state has been detected.

5. Method according to claim 4, characterized in that the portable device (5) is physically and informationally separated from a safety driving circuit (120) of the rail vehicle (1).

6. The method according to claim 3, characterized in that the portable device (5) is connected to the rail vehicle (1) in terms of information technology, the biometric features are detected (AA) by means of the detection device (6), a detection device (8) uses the biometric features to detect (BB) whether the impairment state exists, and impairment information representing the impairment state is sent (CG) to the safety driving circuit (120) of the rail vehicle (1).

7. The method according to claim 1 or 2, characterized in that the monitoring device (204, 304) comprises an optical detection device (230, 330) which detects the face and / or at least one of the eyes of the vehicle driver (7) (AAA, AAAA).

8. The method according to claim 7, characterized in that the biometric features are detected by means of the optical detection device (230, 330) (AAA, AAAA), by means of a detection device (208, 308) it is recognized (BBB, BBBB) on the basis of the biometric features whether the impairment state exists, and an indication that the impairment state has been detected is output to the vehicle driver (7) by means of an output device (224, 124) (DDD, DDDD).

9. The method according to claim 8, characterized in that the optical detection device (230) and the recognition device (208) are part of a camera device, impairment information which represents the impairment state is sent wirelessly to a mobile terminal (234) which the vehicle driver (7) carries with him (CCC), upon receipt of the impairment information, the indication that the impairment state has been recognized is output to the vehicle driver (7) by means of the output device (224) of the mobile terminal (234) (DDD).

10. The method according to claim 8, characterized in that the optical detection device (330) is connected to the rail vehicle (1) for information purposes, the biometric features are detected by means of the optical detection device (330) (AAAA), the detection device (308) uses the biometric features to detect (BBBB) whether the impairment state exists, and an indication that the impairment state has been detected is sent to a safety driving circuit (120) (CCCC), and upon receipt of the impairment information, an indication that the impairment state has been detected is output to the vehicle driver (7) by means of the output device (124) of the safety driving circuit (120) (DDDD).

11. A computer program comprising instructions which, when executed by a computing device (9, 211, 311), cause the computing device (9, 211, 311) to carry out the method according to at least one of claims 1 to 10.

12. Provision device for the computer program according to claim 11, wherein the provision device stores and / or provides the computer program.

13. Device for operating a rail vehicle (1), comprising: a monitoring device (4, 204, 304) which is set up to monitor a vehicle driver (7) who is driving the rail vehicle (1), characterized in that the monitoring device (4, 204, 304) is set up to record biometric features of the vehicle driver (7), wherein a recognition device (8, 208, 308) is set up to recognize, on the basis of the biometric features, an impairment state of the vehicle driver (7) which impairs the safe driving of the rail vehicle (1).

14. A rail vehicle comprising a device according to claim 13.

15. System comprising: - a rail vehicle (1) with a detection device (208, 308) and - a monitoring device (204, 304) of a device according to claim 13.

Citation Information

Patent Citations

  • Safety device for rail vehicle, has control unit that provided for activating and deactivating safety control mechanism based on attention state of operator determined by attention determination device

    DE102012105160A1

  • Method and device for operating a vehicle, in particular a railway vehicle

    DE102014215461A1

  • visual field recognition in rail vehicles

    DE102015217339A1

  • Locomotive including operator fatigue monitoring system

    US20170240192A1

  • System, Method, and Apparatus for Detecting Vehicle Operator Conduct

    US20170355378A1