Augmented reality device for a track-bound vehicle and method for operating a track-bound vehicle with an augmented reality device
An augmented reality system in rail vehicles determines and displays target and predicted stop lines, addressing inaccurate stopping issues by enhancing driver precision, thus ensuring all doors are accessible and reducing boarding times.
Patent Information
- Authority / Receiving Office
- EP · EP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2025-08-01
- Publication Date
- 2026-04-01
AI Technical Summary
Modern rail vehicles often fail to accurately stop at designated platforms due to varying braking characteristics, leading to inaccessible doors and increased boarding times, especially in older vehicles lacking advanced speed control systems.
An augmented reality device is used to visually compare a target stop line with a predicted stop line, allowing the driver to adjust speed for precise stopping, with data integration from vehicle sensors and databases to determine optimal stopping positions.
Enables precise vehicle stopping with all doors accessible, reducing boarding times and operational complexity without requiring new type approval, by providing visual guidance through augmented reality displays.
Smart Images

Figure IMGAF001_ABST
Abstract
Description
Technical field
[0001] The invention relates to a method for operating a track-bound vehicle with an augmented reality device, as well as an augmented reality device and a track-bound vehicle with an augmented reality device. Technical background
[0002] Modern rail vehicles, such as passenger railcars, can now be equipped with a speed control system for targeted stops, for example, at a platform. Older rail vehicles, in particular, are less frequently equipped with such a system. However, if a designated stopping area is not observed, it may happen that not all of the rail vehicle's doors are accessible, as they are not reachable from the platform. This can pose a potential hazard to passengers. Consequently, the doors are only selectively opened; that is, the doors not located at the platform remain closed, and / or the rail vehicle's position relative to the platform is readjusted. Both of these factors lead to a significant increase in boarding and alighting times.Although signage indicating the stopping point may be provided along the track, different track-bound vehicles differ in their braking characteristics, meaning that experience from other vehicles cannot be directly transferred and thus even experienced drivers may miss the optimal stopping point.
[0003] Augmented reality devices, such as head-up displays or data glasses, have become well-known for assisted driving.
[0004] The patent applications EP 3 974 284 A1 and EP 4 052 990 A1 disclose such a method and arrangement for the representation of virtual objects embedded in a real environment for a railway vehicle.
[0005] The patent application EP 3 079 966 A1 discloses a device and a method for determining and displaying the likely future location of a railway vehicle. This location can be determined based on the vehicle's state of motion, such as speed, acceleration, and direction of travel. Summary of the invention
[0006] The invention is based on the objective of further simplifying the operation of a track-bound vehicle, in particular a rail vehicle for passenger transport.
[0007] The problem is solved by the subject matter of the independent patent claims. Further developments and embodiments of the invention are found in the features of the dependent patent claims.
[0008] By visually comparing the determined target stop line with the determined predicted stop line, the driver of the track-bound vehicle can easily bring the vehicle to a precise stop by regulating its speed, particularly by braking. This allows a stopping position to be achieved where all boarding doors are within a usable area of the platform. The invention can be easily integrated into existing vehicles without requiring new type approval, as it is merely an assistance system without direct access to vehicle functions, and the driver remains responsible for vehicle control. Nevertheless, the invention relieves the driver of some of the driver's responsibilities. Embodiments of the invention
[0009] An inventive method for operating a track-bound vehicle, in particular a track-bound passenger vehicle, especially a rail vehicle, with an augmented reality device (augmented reality system) comprises the following method steps: Determining at least one target stop line for the track-bound vehicle, in particular for a track-bound passenger vehicle, especially for a rail vehicle, during the operation of the track-bound vehicle, in particular when approaching and / or entering a stop, and displaying at least the determined target stop line on a display of the augmented reality device; determining a predicted stop line as a function of at least one instantaneous speed, in particular a speed profile, of the track-bound vehicle, at which predicted stop line the track-bound vehicle would come to a complete stop at the instantaneous speed, in particular with the speed profile, and displaying the determined predicted stop line on the display of the augmented reality device.
[0010] Data relating to the instantaneous speed profile of the track-bound vehicle include at least data relating to the instantaneous speed and the instantaneous acceleration of the track-bound vehicle.
[0011] An augmented reality device according to the invention is configured to carry out the method according to the invention and includes the means suitable for carrying out the respective method step. It comprises at least one display for showing information, in particular for showing at least the determined target stop line and the determined predicted stop line for the lane-bound vehicle, especially in relation to the lane-bound vehicle's surroundings.
[0012] According to a further embodiment of the invention, the augmented reality device comprises a projector or a head-up display for the driver's cab of a rail-bound vehicle, in particular a passenger rail vehicle. According to a further embodiment, the augmented reality device is a pair of smart glasses for the driver of the rail-bound vehicle.
[0013] A track-bound vehicle according to the invention, in particular a passenger rail vehicle, comprises a driver's cab and at least one augmented reality system according to the invention, particularly in the driver's cab of the track-bound vehicle. The projector or head-up display can be further integrated into the driver's cab of the track-bound vehicle. The data glasses can be designed for use by the driver of the track-bound vehicle, in particular in the driver's cab of the track-bound vehicle.
[0014] To determine the target stop line and / or the predicted stop line, the augmented reality device can be further developed to include a computing unit, for example in the form of a microcomputer.
[0015] First, a target stop line for the track-bound vehicle is determined, particularly using augmented reality technology. This can be further refined using data about a predefined stop line for the track-bound vehicle. The predefined stop line can be determined based on the length of the track-bound vehicle, the number and / or position of its entry doors. Furthermore, the target stop line for the track-bound vehicle can be determined based on data about a stop, particularly a platform, specifying at which stop, and especially at which platform, the track-bound vehicle is to stop. This data can be stored in a database of the track-bound vehicle.The database can therefore contain data on the route of the track-guided vehicle and the stop for the track-guided vehicle, for example in the form of a digital map, as well as data on the track-guided vehicle itself, in particular on the dimensions of the track-guided vehicle, but also on the drive and in particular braking power of the track-guided vehicle or on the current weight of the track-guided vehicle or on other current states of the track-guided vehicle.
[0016] Subsequently, a predicted stop line for the lane-bound vehicle is determined based on at least one instantaneous speed profile of the lane-bound vehicle, at which the lane-bound vehicle would come to a complete stop at that instantaneous speed profile. The predicted stop line is further refined based on additional data. to an instantaneous acceleration of the track-bound vehicle, and / or to an instantaneous position of at least one control element for regulating the drive and / or braking power of the track-bound vehicle, in particular a driving lever position, and / or to an instantaneous position of the track-bound vehicle, and / or to a course of a track or a lane for the track-bound vehicle in the direction of travel of the track-bound vehicle, in particular a track course of a rail vehicle in front of the rail vehicle, and / or to a trajectory of the track-bound vehicle, determined.
[0017] A suitably enhanced augmented reality device is further trained to determine the predicted stop line based on additional data. to an instantaneous acceleration of the track-bound vehicle, and / or to an instantaneous position of at least one control element for regulating the drive and / or braking power of the track-bound vehicle, in particular a driving lever position, and / or to an instantaneous position of the track-bound vehicle, and / or to a course of a track or a lane for the track-bound vehicle in the direction of travel of the track-bound vehicle, in particular a track course of a track of the rail vehicle in front of the rail vehicle, and / or to a trajectory of the track-bound vehicle.
[0018] For this purpose, the track-bound vehicle can be equipped with appropriate sensors to collect data. to an instantaneous acceleration of the track-bound vehicle, and / or to an instantaneous position of at least one control element for regulating the drive and / or braking power of the track-bound vehicle, in particular a driving lever position, and / or to an instantaneous position of the track-bound vehicle, and / or to a course of a track or a lane for the track-bound vehicle in the direction of travel of the track-bound vehicle, in particular a track course of a rail vehicle in front of the rail vehicle, and / or to a trajectory of the track-bound vehicle This includes data on the route of the track-bound vehicle, which can also be stored in the track-bound vehicle's database. The current position of the track-bound vehicle, for example, recorded by a global satellite navigation system, can be compared with the track of the track-bound vehicle.
[0019] Furthermore, the track-bound vehicle may have at least one provisioning device for providing data and information, in particular the aforementioned recorded data and / or data concerning the track and / or the track-guided vehicle stored in the track-bound vehicle's database, to the augmented reality device. This device may include, for example, a communication device for communicating with a communication device of the augmented reality device. The augmented reality device further comprises a communication device for communicating with a communication device of the track-bound vehicle. The communication devices have, in particular, complementary physical or virtual interfaces. The communication device of the augmented reality device is configured, at least, to receive data from the track-guided vehicle.The communication device of the track-guided vehicle is designed at least to send data to the communication device of the augmented reality device.
[0020] A driving lever of a rail vehicle can also be called a driving / braking lever, as it is usually designed to control the driving and braking power of the rail vehicle.
[0021] The output of both the determined target stop line and the determined predicted stop line for the lane-bound vehicle is provided by the augmented reality device on a display of the augmented reality device, for example on the head-up display or on the data glasses, particularly in relation to an environment of the lane-bound vehicle.
[0022] To further support the operator of the track-bound vehicle, operating recommendations for the track-bound vehicle and / or its operator, such as a specific lever position, can be determined and displayed on the augmented reality device, according to a further development of the procedure. This is particularly important for bringing the vehicle to a complete stop at the determined target stop line. If these operating recommendations are followed, the determined target stop line is thus aligned with the determined predicted stop line. The operating recommendations are further developed based on the aforementioned recorded data and / or the data about the track and / or the track-bound vehicle stored in the vehicle's database.
[0023] According to a further embodiment of the invention, a target stopping area for the track-bound vehicle is determined, wherein the target stopping area comprises the target stopping line. The target stopping area has successive boundaries in the direction of travel of the track-bound vehicle. The target stopping line can lie within these boundaries of the target stopping area or form a boundary of the target stopping area.
[0024] Regardless of the grammatical gender of a particular term, persons with male, female or other gender identities are included.
[0025] The invention allows for numerous embodiments. It is explained in more detail with reference to the following figures, each of which illustrates an exemplary embodiment. Identical elements in the figures are designated with the same reference numerals. Exemplary embodiments of the drawing
[0026] Fig. 1 schematically shows a flowchart for an embodiment of the method according to the invention. Detailed description of the exemplary implementations
[0027] In Fig. 1A schematic flowchart for an embodiment of the method according to the invention is shown. In a first process step a., a target stop line for the track-bound vehicle, in particular for a passenger rail vehicle, is determined during its operation, especially when approaching and / or entering a stop. Furthermore, a predicted stop line for the track-bound vehicle is determined, at which the track-bound vehicle would come to a complete stop at the current speed profile, at least on the basis of data on the instantaneous speed profile of the track-bound vehicle, in particular on the basis of data concerning the instantaneous speed and acceleration of the track-bound vehicle.
[0028] Subsequently, in the second step of the process, both determined stop lines are displayed to a driver by the augmented reality device, in particular on a display of the augmented reality device, especially in relation to the surroundings of the track-bound vehicle.
Claims
1. Method for operating a track-bound vehicle with an augmented reality device, characterized by The following process steps are involved: • Determining at least one target stop line for the track-bound vehicle during the driving operation of the track-bound vehicle and displaying at least the determined target stop line on a display of the augmented reality device; • Determining a predicted stop line based on at least data on an instantaneous speed profile of the track-bound vehicle, at which predicted stop line the track-bound vehicle would come to a complete stop at the instantaneous speed profile, and displaying the determined predicted stop line on the display of the augmented reality device.
2. Method according to claim 1, characterized by the fact thatThe predicted stop line is determined in additional dependence on at least data on the current position of at least one control element for regulating the drive and / or braking power of the track-bound vehicle.
3. Method according to one of claims 1 or 2, characterized by the fact that The target stop line is determined depending on data about a route of the track-guided vehicle and / or depending on data about the track-guided vehicle.
4. Method according to claim 3, characterized by the fact that The data relating to the route of the guided vehicle and / or to the guided vehicle itself are provided by the guided vehicle.
5. Method according to any one of claims 1 to 4, characterized by the fact that Operating instructions for the track-bound vehicle are determined and displayed on the augmented reality device's screen.
6. Augmented reality device with at least one display for presenting information, characterized by the fact that the augmented reality device is set up to perform the method according to any one of claims 1 to 5.
7. Augmented reality device according to claim 6, characterized by the fact that It includes a projector or a head-up display for the driver's cab of a track-bound vehicle.
8. Augmented reality device according to claim 6, characterized by the fact that It includes data glasses for the driver of a track-bound vehicle.
9. Augmented reality device according to any one of claims 6 to 8, characterized by the fact that it includes at least one communication device for communication with the track-guided vehicle.
10. Track-bound vehicle, characterized by the fact that it comprises at least one device according to one of claims 6 to 9 for a driver's cab of the track-bound vehicle.
11. Track-bound vehicle according to claim 10, characterized by the fact that it comprises at least one device according to claim 7, which is integrated into the driver's cab of the track-bound vehicle.
12. Track-bound vehicle according to one of claims 10 or 11, characterized by the fact that It includes at least one database for storing data on the route of the track-guided vehicle and / or that the track-bound vehicle has at least one sensor for recording data on an instantaneous speed profile of the track-bound vehicle.
13. Track-bound vehicle according to claim 12, characterized by the fact that It has at least one communication device for communication with the augmented reality device, which is designed to provide the stored and / or recorded data to the at least one augmented reality device.
14. System comprising at least one augmented reality device according to claim 8 and a track-bound vehicle.
15. Use of a device according to claim 8 in a track-bound vehicle for a driver of the track-bound vehicle.
Citation Information
Patent Citations
Method for displaying the course of a safety zone in front of a vehicle or object with a display unit, device for carrying out the method, motor vehicle and computer program
DE102017221191A1
Method for displaying information about the operation of a rail vehicle for traffic participants
EP3079966A2
Method for representing augmented reality and devices for applying the method
EP3974284A1
Secure head-up display in the driver's cab of a railway vehicle
EP4052990A1
Locomotive driver's cab
US20140209757A1