Method, device and computer-readable storage medium with instructions for controlling a display of an augmented reality display device for a means of transport

Abstract

The present invention relates to a method, a device, and a computer-readable storage medium with instructions for controlling a display of an augmented reality display device for a means of transport. The invention further relates to a means of transport in which a method or a device according to the invention is used. In a first step, information about a vulnerable road user located in the vicinity of the means of transport is determined (10). Furthermore, a potential conflict between the means of transport and the vulnerable road user is identified (11). An escalation level is determined for the potential conflict (12), and a conflict area is marked in a contact-analog manner according to the determined escalation level (13). In addition, an acoustic or haptic warning can be issued (14).

Description

[0001] The present invention relates to a method, a device, and a computer-readable storage medium with instructions for controlling a display of an augmented reality display device for a means of transportation. The invention further relates to a means of transportation in which a method or device according to the invention is used.

[0002] Cooperative safety functions using V2X communication have the potential to not only provide support in dangerous situations on the road, but also to enable anticipation that prevents dangerous situations from occurring in the first place. This includes, for example, intersection situations between so-called vulnerable road users and motor vehicles. Vulnerable road users, often referred to as unprotected or endangered road users or VRUs (Vulnerable Road Users), include cyclists, pedestrians, and e-scooter riders. V2X, also known as Car2X, generally stands for "Vehicle-To-Everything," meaning the communication of the vehicle with all surrounding or interacting road users and structures.

[0003] One challenge in designing such functions is that the information must be clearly perceptible and effective in its presentation. Among other things, it is important that the information is provided very early, i.e., sometimes significantly earlier than with conventional assistance systems. At the same time, earlier and more frequent information must not disturb the driver. Currently used concepts pursue various approaches to address these challenges.

[0004] First, there's a classic pop-up in the driver information display, which is often activated together with an advisory tone or warning tone. If activated frequently and early, there's a risk that this will be perceived as annoying. Second, this type of display is not very intuitive and ill-suited to conveying complex information in a short space of time, such as the spatial position or speed of an object.

[0005] The approach of a 3D representation in a conventional display attempts to circumvent this problem. Here, a spatial display of an object is provided, from which, for example, the type of object, position, and speed can be deduced. However, an understanding of the situation is required in order to mentally transfer the scene seen on the display to the surroundings. Furthermore, such displays have the additional disadvantage of requiring the user to look away from the road. Attention must first be drawn to the display, which is associated with similar disadvantages as with pop-up displays. Furthermore, looking away from the road can itself pose a danger.

[0006] Newer approaches attempt to solve this problem with head-up displays (HUDs). In a head-up display, the light rays from a display installed in the dashboard are folded across several mirrors and lenses and reflected onto a projection surface into the driver's eye, allowing them to perceive a virtual image outside the vehicle. In the automotive sector, the windshield often serves as the projection surface, as its curved shape must be taken into account when displaying the image. Alternatively, an additional pane of glass or plastic is sometimes used, positioned on the dashboard between the driver and the windshield.

[0007] With the constant development of virtual and augmented reality technologies and applications, these are also finding their way into automobiles, particularly for head-up displays. Augmented reality (AR) is the enhancement of the real world with virtual elements that are spatially accurately registered in three-dimensional space and enable real-time interaction. Since the term "augmented reality" has prevailed over "erweiterte Realität" (augmented reality) in the German-speaking world, the former will be used below. Augmented reality glasses can also be used as an alternative to displaying AR displays. Augmented reality glasses are worn like normal glasses but have one or more projection units or displays that can be used to project information in front of the wearer's eyes or directly onto the retina.The glasses are designed to allow the wearer to also perceive their surroundings. By highlighting objects and displaying information at their real-life reference location—i.e., through a contact-analog display—environmental information can be directly presented in the driver's field of vision. This direct graphical enhancement of the environment in the form of augmented reality can significantly reduce cognitive transfer requirements.

[0008] Against this background, DE 10 2022 123 218 A1 describes a system for identifying a route conflict with an emergency vehicle. An infrastructure facility receives the location, speed, and trajectory information of an emergency vehicle and transmits it to a motor vehicle. A navigation system of the motor vehicle uses data from a global positioning system and preloaded map data to generate a map containing a roadway and a potential conflict on the roadway between the projected paths of the emergency vehicle and the motor vehicle on the roadway. The potential conflict is visually displayed using a head-up display or a head-down display of the motor vehicle.

[0009] For example, an approach based on augmented reality could highlight vulnerable road users at risk in intersection situations.

[0010] In this context, US 2019 / 0244715 A1 describes a method for displaying an augmented image. In the method, data is collected using a sensor at an intersection and transmitted to a vehicle near the intersection via a short-range communication device. The data is analyzed in the vehicle to determine the location of an object near the intersection. The displayed image is then augmented by enclosing an area around the object with a bounding box.

[0011] US 10,272,780 B2 describes an information display system for supporting safe driving. The shape of a virtual image displaying an outline or frame line of an obstacle is changed according to the risk level of the obstacle to a vehicle. The display position of the virtual image is adjusted according to the driver's viewing angle, thus avoiding a display discrepancy between an actual obstacle and the virtual image.

[0012] However, even the latest head-up displays currently available have a relatively small field of view. If the object being warned about is outside the field of view, the warning cannot be provided, or only in a stylized form, as an icon at the edge of the screen. Delaying the display carries the risk that the collision risk is already too high.

[0013] It is an object of the invention to provide improved solutions for controlling a display of an augmented reality display device for a means of transport, which take into account the size of the field of view.

[0014] This object is achieved by a method having the features of claim 1, by a computer-readable storage medium with instructions according to claim 8, by a device having the features of claim 9, and by a means of transport according to claim 10. Preferred embodiments of the invention are the subject of the dependent claims.

[0015] According to a first aspect of the invention, a method for controlling a display of an augmented reality display device for a means of transport comprises the steps: - Obtaining information about a vulnerable road user in the vicinity of the means of transport; - Determining a potential conflict between the means of transport and the vulnerable road user; - Determining an escalation level for the potential conflict; and - contact-analogous marking of a conflict area by the augmented reality display device according to the determined escalation level.

[0016] According to a further aspect of the invention, a computer-readable storage medium contains instructions that, when executed by a computer, cause the computer to perform the following steps for controlling a display of an augmented reality display device for a means of transportation: - Obtaining information about a vulnerable road user in the vicinity of the means of transport; - Determining a potential conflict between the means of transport and the vulnerable road user; - Determining an escalation level for the potential conflict; and - contact-analogous marking of a conflict area by the augmented reality display device according to the determined escalation level.

[0017] The term "computer" should be understood broadly. In particular, it also includes control units and other processor-based data processing devices. The execution of the aforementioned steps can be performed directly by the computer or involve the computer controlling a component intended to execute a step.

[0018] According to a further aspect of the invention, a device for controlling a display of an augmented reality display device for a means of transport comprises: - an information gathering unit for gathering information on a vulnerable road user in the vicinity of the means of transport; - an analysis unit for determining a potential conflict between the means of transport and the vulnerable road user and for determining an escalation level for the potential conflict; and - a graphics unit for contact-analog marking of a conflict area by the augmented reality display device according to the determined escalation level.

[0019] The solution according to the invention addresses the problems described above by highlighting or marking the conflict area resulting from a predicted conflict situation in the augmented reality display instead of highlighting or marking the specific vulnerable road user. The respective conflict area, e.g. a pedestrian or bicycle crossing, a zebra crossing, etc., is marked in the driver's field of vision in a contact-analog manner. Contact-analog means that the driver has the visual impression that the marking is at the location of the actual conflict area. The marking is preferably carried out in several escalation levels, which indicate the potential conflict and the resulting danger with increasing urgency. The sequence of escalation levels can, for example, be run through automatically when approaching the conflict area.Alternatively or additionally, it can also be considered whether the driver reacts appropriately to the potential conflict, e.g., by braking when approaching a zebra crossing. In such a case, it is possible to stop increasing the escalation level for the marking. Likewise, it can be considered if the probability of a conflict decreases, e.g., because the vulnerable road user has changed their direction of travel. In such a case, it is also possible to reduce the escalation level for the marking.

[0020] According to one aspect of the invention, the information about a vulnerable road user located in the vicinity of the means of transport is determined from sensor data from a sensor system of the means of transport or from received V2X data. Modern means of transport are generally equipped with numerous sensors that allow other road users in the vicinity of the means of transport and their movement to be detected. In addition, data transmitted by other road users or by infrastructure facilities, e.g. V2X data, can also be used. This increases the accuracy of the determined information. In addition, highly accurate map data can also be taken into account, which contains, for example, information about cycle paths and pedestrian paths, including their course and the point of intersection with the roadway.

[0021] According to one aspect of the invention, a first escalation stage involves visually highlighting the conflict area. For example, the conflict area can be highlighted in color. In addition to highlighting using color, the brightness of the marking can also be used for highlighting. Animations of the marking or combinations of these approaches are also possible. An animated representation, for example, a flashing light moving across the marking, allows for further clarification of the potentially dangerous situation.

[0022] According to one aspect of the invention, a navigation instruction is visually highlighted in a second escalation stage. This is particularly advantageous for conflict areas that result from a planned turning maneuver. In this case, navigation instructions are often displayed anyway, for example in the form of navigation arrows. These can be used to indicate a specific conflict situation. For example, the color of the navigation arrows can be changed, e.g. from green to yellow or orange. In addition to highlighting using color, the brightness of the navigation instruction can also be used for emphasis. Animations of the navigation instruction or combinations of these approaches are also possible. Furthermore, it is possible to use only individual navigation arrows or only parts of the navigation arrows to mark the conflict area.

[0023] According to one aspect of the invention, a third escalation stage involves changing the form of the navigation instruction. For example, a navigation arrow adjacent to the conflict area can be deformed into a type of stop line, which can also be displayed in a different color than the remaining navigation arrows, e.g., red. In addition to changing the color of the affected navigation arrow, the brightness of the navigation arrow can also be used for highlighting. Animations of the navigation arrow or combinations of these options are also possible.

[0024] According to one aspect of the invention, in addition to the contact-analog marking of the conflict area, an acoustic or haptic warning is issued. The output of an acoustic or haptic warning can, in principle, occur at any escalation level, but is preferably implemented as a further escalation level. This has the advantage that the driver is not confronted with an excessive number of warnings.

[0025] According to one aspect of the invention, the augmented reality display device is an augmented reality head-up display or augmented reality glasses. Both a head-up display and data glasses are ideally suited to convey augmented reality content to a user. Furthermore, increasing adoption of both technologies is expected, so that the inventive solution can be widely implemented with only minimal additional effort.

[0026] A method according to the invention or a device according to the invention is particularly advantageously used in a means of transport. The means of transport can be any type of transport, e.g., a car, a bus, a motorcycle, or a commercial vehicle, in particular a truck, an agricultural machine, or a construction machine.

[0027] Further features of the present invention will become apparent from the following description and the appended claims taken in conjunction with the figures. Fig. 1 schematically shows a method for controlling a display of an augmented reality display device for a means of transport; Fig. 2 shows a first embodiment of a device for controlling a display of an augmented reality display device for a means of transport; Fig. 3 shows a second embodiment of a device for controlling a display of an augmented reality display device for a means of transport; Fig. Figure 4 schematically represents a means of transport in which a solution according to the invention is implemented; Fig. 5 schematically shows a general structure of a head-up display device for a means of transport; Fig. 6 shows schematically an augmented reality glasses; Fig. Figure 7 shows a situation with a potential conflict between a means of transport and a vulnerable road user; Fig. 8 shows a contact-analogous marking of a conflict area corresponding to a first escalation level; Fig. 9 shows a contact-analogous marking of the conflict area corresponding to a second escalation level; and Fig. 10 shows a contact-analogous marking of the conflict area corresponding to a third escalation level.

[0028] To better understand the principles of the present invention, embodiments of the invention are explained in more detail below with reference to the figures. It is understood that the invention is not limited to these embodiments and that the described features may also be combined or modified without departing from the scope of the invention as defined in the appended claims.

[0029] Fig. 1 schematically shows a method for controlling a display of an augmented reality display device for a means of transport. The augmented reality display device can be, for example, an augmented reality head-up display or augmented reality glasses. In a first step, information about a vulnerable road user in the vicinity of the means of transport is determined 10, e.g. from sensor data from a sensor system of the means of transport or from received V2X data. In addition, a potential conflict between the means of transport and the vulnerable road user is determined 11. An escalation level is determined 12 for the potential conflict, and a conflict area is marked in a contact-analog manner 13 according to the determined escalation level. For example, in a first escalation level, the conflict area can be visually highlighted, while in a second escalation level, for example,Additionally, a navigation instruction is visually highlighted. In a third escalation level, for example, the form of the navigation instruction can be changed. Additionally, an acoustic or haptic warning can be issued. 14

[0030] Fig. 2 shows a simplified schematic representation of a first embodiment of a device 20 for controlling a display of an augmented reality display device for a means of transport. The augmented reality display device can be, for example, an augmented reality head-up display or augmented reality glasses. The device 20 has an input 21 via which sensor data SD, for example image data from a camera 43 or data from a sensor system 44, or V2X data VD received from a data transmission unit 46 can be received. The sensor system 44 can, for example, detect an environment of the means of transport. The device 20 has an information determination unit 22 for determining information I about a vulnerable road user located in the environment of the means of transport based on the received data.An analysis unit 23 is configured to determine a potential conflict K between the means of transport and the vulnerable road user. The analysis unit 23 is also configured to determine an escalation level S for the potential conflict K. A graphics unit 24 is configured to mark a conflict area corresponding to the determined escalation level S using the augmented reality display device in a contact-analog manner. For this purpose, marking data M generated by the graphics unit 24 are output to a control unit 42 of the augmented reality display device via an output 27 of the device 20. Alternatively, merely an instruction A can be output to the control unit 42 to generate a corresponding marking. The control unit 42 can then insert the marking into a display of the augmented reality display device.For example, in a first escalation level S, the conflict area can be visually highlighted, while in a second escalation level S, a navigation instruction can also be visually highlighted. In a third escalation level S, for example, the form of the navigation instruction can be changed.

[0031] The information retrieval unit 22, the analysis unit 23, and the graphics unit 24 can be controlled by a control unit 25. Settings of the information retrieval unit 22, the analysis unit 23, the graphics unit 24, or the control unit 25 can be changed via a user interface 28. The data generated in the device 20 can be stored in a memory 26 of the device 20 if necessary, for example, for later evaluation or for use by the components of the device 20. The information retrieval unit 22, the analysis unit 23, the graphics unit 24, and the control unit 25 can be implemented as dedicated hardware, for example, as integrated circuits. Of course, they can also be partially or completely combined or implemented as software running on a suitable processor, for example, a GPU or a CPU.Input 21 and output 27 can be implemented as separate interfaces or as a combined bidirectional interface. In the example described, device 20 is a standalone component. However, it can also be integrated into the control unit 42 of the augmented reality display device.

[0032] Fig. 3 shows a simplified schematic representation of a second embodiment of a device 30 for controlling a display of an augmented reality display device for a means of transport. The device 30 has a processor 32 and a memory 31. For example, the device 30 is a computer or a control unit. Instructions are stored in the memory 31 which, when executed by the processor 32, cause the device 30 to perform the steps according to one of the described methods. The instructions stored in the memory 31 thus embody a program executable by the processor 32 which implements the method according to the invention. The device 30 has an input 33 for receiving information, for example navigation data or data relating to the surroundings of the means of transport. Data generated by the processor 32 are provided via an output 34.In addition, they can be stored in memory 31. The input 33 and the output 34 can be combined to form a bidirectional interface.

[0033] The processor 32 may include one or more processor units, such as microprocessors, digital signal processors, or combinations thereof.

[0034] The memories 26, 31 of the described embodiments can have both volatile and non-volatile memory areas and can comprise a wide variety of storage devices and storage media, for example hard disks, optical storage media or semiconductor memories.

[0035] Fig. 4 schematically illustrates a means of transportation 40 in which a solution according to the invention is implemented. In this example, the means of transportation is a motor vehicle. The motor vehicle has an augmented reality display device 41 with an associated control unit 42. Furthermore, the motor vehicle 40 has a device 20 for controlling a display of the augmented reality display device 41. The device 20 can, of course, also be integrated into the augmented reality display device 41 or into the control unit 42 of the augmented reality display device 41. Further components of the motor vehicle are a camera 43 and a sensor system 44 for environmental detection, a navigation system 45, a data transmission unit 46, and a series of assistance systems 47, one of which is shown as an example.Using the data transmission unit 46, a connection to service providers can be established, for example, to retrieve map data. Furthermore, V2X communication can be carried out via the data transmission unit 46. A memory 48 is provided for storing data. Data exchange between the various components of the motor vehicle takes place via a network 49.

[0036] Fig. 5 schematically shows a head-up display 50 as an example of an augmented reality display device for a means of transport 40. With the help of the head-up display 50, content can be displayed on a projection surface 53 of the means of transport 40, for example, on the windshield or on an additional pane made of glass or plastic, which is arranged between the driver and the windshield on the dashboard. The displayed content is generated by an imaging unit 51 and projected onto the projection surface 53 with the help of an optical module 52. Typically, the projection takes place in an area of ​​the windshield above the steering wheel. The imaging unit 51 can be an LCD-TFT display, for example. The head-up display 50 is generally installed in a dashboard of the means of transport 40.

[0037] Fig. 6 schematically shows augmented reality glasses 60 as an example of an augmented reality display device. The augmented reality glasses 60 have a camera 61 for capturing environmental data of an environment of the augmented reality glasses 60. An interface 62 connects to an external pose determination device 63 for determining a pose of the augmented reality glasses 60 based on the environmental data. For this purpose, the pose determination device 63 can, for example, detect and evaluate edges or prominent points in the image data. The pose determination device 63 can, of course, also be part of the augmented reality glasses 1. Using a graphics unit 64, the display of the augmented reality glasses 60 can be adapted according to the determined pose. For this purpose, the pose determination device 63 and the graphics unit 64 can exchange data with each other.The graphics unit 64 can, as shown in the example, be part of the augmented reality glasses 60 or be connected to the augmented reality glasses 60 via the interface 62. The display generated by the graphics unit 64 is displayed by a projection unit 65. In the example in . Fig. 6, a monocular display is used, i.e., a display is arranged only in front of one of the user's eyes. The solution described here can of course also be implemented with augmented reality glasses 60 with a binocular display, in which one display is used for each eye, or with a binocular display, in which a common display is used for both eyes.

[0038] In the following, further details of the invention will be explained with reference to Fig. 7 to Fig. 10 will be explained.

[0039] Fig. Figure 7 shows a situation with a potential conflict between a means of transport 40 and a vulnerable road user 70. The means of transport 40 is a motor vehicle whose driver wishes to turn right from the main road 80 into a side street 81 at an intersection 82. On a sidewalk 83 running along the main road 80, there is a pedestrian, a vulnerable road user 70, who is expected to cross the side street 81 at a crossing 84. The planned or probable movements of the two road users 40, 70 result in a conflict area 71 in which a collision between the two road users 40, 70 may potentially occur.Since the pedestrian is located outside the area that can be augmented by an augmented reality display device of the means of transport 40, there is no possibility of directly highlighting the pedestrian for the driver by means of an augmentation.

[0040] The aim of the solution according to the invention is therefore to mark the conflict area 71, in this case the crossing 84 over the side street 81, in the driver's field of vision in a contact-analog manner. For this purpose, map material with sufficiently accurate information about crossings is preferably used to calculate the conflict area 71 relative to the vehicle. This map material can, for example, be taken from high-precision maps available in the means of transport 40 or from messages sent by infrastructure facilities, such as MAPEM messages (MAPEM: MAP Extended Message).

[0041] In the next step, the exact position of the means of transport 40 relative to the crossing 84 is determined using self-localization, so that the angle from which the observer sitting in the means of transport 40 sees the crossing 84 can be calculated. For this purpose, prominent points in the surrounding area can be used, such as sidewalk edges, cycle path markings, etc.

[0042] In the next step, the marker to be displayed is transformed to the exact position of the viewer in the vehicle 40. For this purpose, the existing sensors can be used to determine the viewer's head or eye position relative to the vehicle body. Alternatively, a predefined and calibrated eyebox can be used, within which the eye position is expected.

[0043] The conflict area 71 can now be marked in various escalation stages by the augmented reality display device of the means of transport 40 in a contact-analog manner.

[0044] Fig. Figure 8 shows a contact-analog marking 72 of a conflict area 71 corresponding to a first escalation level. The augmented environment is shown from the perspective of a vehicle driver. In this escalation level, only a visual highlighting of the conflict area 71 occurs. For this purpose, a marking 72 is displayed at the location of the conflict area 71, highlighting the conflict area 71. For example, a real pedestrian crossing can be highlighted in color or a virtual pedestrian crossing can be displayed. In addition to highlighting using color, the brightness of the marking 72 can also be used for highlighting. Animations of the marking 72 are also possible, e.g., in the form of a running light. Combinations of these options can also be provided. In the example of the Fig. 8, the augmented environment additionally has a navigation hint 73 in the form of three navigation arrows 74, 74', 74". In this escalation level in the example shown, the navigation hint 73 is not used to mark the conflict area 71 and can, for example, be displayed in green.

[0045] Fig. Figure 9 shows a contact-analogous marking 72 of the conflict area 71 corresponding to a second escalation level. In addition to displaying a marking 72 at the location of the conflict area 71, the navigation instruction 73 is also used to mark the conflict area 71 in this escalation level. In the example shown, the color of the navigation arrows 74, 74', 74" is changed, e.g., to yellow or orange, which is indicated by the Fig. 8, the modified dashed lines of the navigation arrows 74, 74', 74" are indicated. In addition to highlighting using color, the brightness of the navigation instruction 73 can also be used for highlighting. Animations of the navigation instruction 73 are also possible. Combinations of these options can also be provided. Furthermore, it is possible to use only individual navigation arrows 74, 74', 74" or only parts of the navigation arrows 74, 74', 74" for marking the conflict area 71.

[0046] Fig.10 shows a contact-analogous marking 72 of the conflict area 71 corresponding to a third escalation level. In this escalation level, a change in the form of the navigation instruction 73 also occurs. In the example shown, the right navigation arrow 74" adjacent to the conflict area 71 is deformed into a type of stop line, which is also displayed in a different color than the remaining navigation arrows 74, 74', e.g., red. This is again indicated by the different dashed lines of the navigation arrows 74, 74', 74". In addition, the color of the marking 72 is also changed in this example. In addition to changing the color of the affected navigation arrow 74", the brightness of the navigation arrow 74" can also be used for highlighting. Animations of the navigation arrow 74" or combinations of these options are also possible. List of reference symbols 10 Obtaining information about a vulnerable road user 11 Determining a potential conflict 12 Determining an escalation level 13 Marking a conflict area 14 Issuing a warning 20 Device 21 Entrance 22 Information Investigation Unit 23 Analysis unit 24 graphics unit 25 Control unit 26 storage 27 Exit 28 User interface 30 Device 31 storage 32 processor 33 Entrance 34 Exit 40 motor vehicles 41 Augmented Reality Display Device 42 Control unit of the augmented reality display device 43 Camera 44 Sensor system 45 Navigation system 46 Data transmission unit 47 Assistance system 48 storage 49 Network 50 Head-Up Display 51 Imaging Unit 52 Optical module 53 projection screen 60 augmented reality glasses 61 Camera 62 Interface 63 Pose determination device 64 graphics unit 65 Projection unit 70 Vulnerable road users 71 Conflict area 72 Marking 73 Navigation note 74, 74', navigation arrow 74" 80 Main Street 81 Side Street 82 intersection 83 Sidewalk 84 Crossing A instruction I Information K Conflict M Marking data S Escalation level SD sensor data VD V2X data QUOTES CONTAINED IN THE DESCRIPTION

[0000] This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions. Cited patent literature

[0000] DE 10 2022 123 218 A1

[0008] US 2019 / 0244715 A1

[0010] US 10,272,780 B2

[0011]

Claims

[1] Method for controlling a display of an augmented reality display device (41) for a means of transport (40), comprising the steps: - determining (10) information (I) on a vulnerable road user (70) located in the vicinity of the means of transport (40); - determining (11) a potential conflict (K) between the means of transport (40) and the vulnerable road user (70); - determining (12) an escalation level (S) for the potential conflict (K); and - contact-analogous marking (13) of a conflict area (71) by the augmented reality display device (41) according to the determined escalation level (S). [2] Method according to claim 1, wherein the information (I) relating to a vulnerable road user (70) located in the vicinity of the means of transport (40) is determined from sensor data (SD) of a sensor system (43, 44) of the means of transport (40) or from received V2X data (VD) (10). [3] Method according to claim 1 or 2, wherein in a first escalation stage a visual highlighting of the conflict area (71) takes place. [4] Method according to claim 3, wherein in a second escalation stage a visual highlighting of a navigation instruction (73) takes place. [5] Method according to claim 4, wherein in a third escalation stage a change in a form of the navigation instruction (73) takes place. [6] Method according to one of the preceding claims, wherein in addition to the contact-analog marking (13) of the conflict area (71), an acoustic or haptic warning is issued (14). [7] Method according to one of the preceding claims, wherein the augmented reality display device (41) is an augmented reality head-up display (50) or augmented reality glasses (61). [8] Computer-readable storage medium with instructions which, when executed by a computer, cause the computer to carry out the steps of a method according to one of claims 1 to 7 for controlling a display of an augmented reality display device (41) for a means of transport (40). [9] Device (20) for controlling a display of an augmented reality display device (41) for a means of transport (40), with - an information determination unit (22) for determining (10) information (I) on a vulnerable road user (70) located in the vicinity of the means of transport (40); - an analysis unit (23) for determining (11) a potential conflict (K) between the means of transport (40) and the vulnerable road user (70) and for determining (12) an escalation level (S) for the potential conflict (K); and - a graphics unit (24) for contact-analog marking (13) of a conflict area (71) by the augmented reality display device (41) according to the determined escalation level (S). [10] Means of transport (40) with an augmented reality display device (41), characterized by that the means of transport (40) has a device (20) according to claim 9 or is configured to carry out a method according to one of claims 1 to 7 for controlling a display of the augmented reality display device (41).

Images