Generation of an augmented reality head-up display for a motor vehicle

Abstract

The invention relates to a method, a computer program with instructions and a device for generating a display of an augmented reality head-up display for a motor vehicle. In a first step, the position of the motor vehicle is determined (10). Based on the position of the motor vehicle, a plurality of virtual elements for navigation instructions are then provided (11). In this case, the virtual elements extend on both sides in a transverse direction outside the field of view of the augmented reality head-up display from the perspective of the motor vehicle. Finally, at least those virtual elements are rendered (12) which have a minimum distance to the center of the field of view.

Description

Technical Field

[0001] The invention relates to a method, a computer program with instructions and a device for generating a display of an augmented reality head-up display for a motor vehicle. The invention also relates to a motor vehicle in which the method according to the invention or the device according to the invention is used. Background Art

[0002] As virtual and augmented reality technologies and applications continue to develop, these technologies and applications are also entering the car. Augmented reality (AR) (German "erweiterte ”) is the enrichment of the real world through virtual elements that are correctly recorded in three-dimensional space and allow real-time interaction. Because in the academic circles in the German-speaking area, the expression “AugmentedReality” is relatively “erweiterte " is recognized, so the former is used below. Synonymously, the expression "Mixed Reality" is also used.

[0003] Head-up displays (HUDs) provide a feasible technical implementation for enriching the driver's workplace with a perspective-correct virtual extension. Here, the light beam of the display installed in the dashboard is folded via multiple mirrors and lenses and mirrored into the driver's eyes via a projection surface, so that the driver perceives a virtual image outside the vehicle. As a projection surface, the windshield is often used in the automotive field, and its curved shape must be taken into account when showing it. As an alternative, additional glass made of glass or plastic is also used in part, which is arranged on the dashboard between the driver and the windshield. Due to the visual superposition of the display and the driving scene, less head and eye movements are necessary to read the information. In addition, the adaptation cost for the eyes is reduced because the virtual distance depending on the display is less or even does not need to be adjusted at all.

[0004] In this regard, DE 10 2016 203 080 A1 describes a method for operating a head-up display for a motor vehicle, in which instructions are projected into the driver's field of vision by means of a head-up display depending on current driving data. The current position and driving direction or driving distance of the motor vehicle are detected by means of a satellite-assisted navigation system. In addition, a maneuvering point in the movement path of the motor vehicle is determined. Depending on the distance of the motor vehicle from the maneuvering point, the projection is displayed as a maneuvering arrow of a virtual guardrail.

[0005] Augmented reality offers a wide range of application possibilities for assisting drivers by marking lanes and objects in contact simulation. Most of the relatively close examples relate to the field of navigation. Conventional navigation displays in conventional head-up displays generally show schematic illustrations (e.g. an arrow extending at a right angle to the right as a symbol for turning right in the next scene), while AR displays offer significantly more effective feasibility solutions. Since these displays can be shown as "part of the environment", for example, very effective navigation instructions or hazard warnings can be displayed directly at the real reference position for the driver.

[0006] In this regard, EP 2 899 506 B1 describes a method for operating a head-up display for a vehicle. In the method, the distance between the vehicle and a position for displaying navigation information in the vehicle's surroundings is determined. Using the navigation information and the distance, image information for the head-up display is generated. In this case, the navigation information is presented in the image information in a contact-simulated manner when the distance is less than a first distance threshold, and in an angle-simulated manner when the distance is less than a second distance threshold. The resulting image information is finally provided for the head-up display.

[0007] The recording of virtual information in the driver's real field of vision places very high demands on the technical implementation. In order to be able to display virtual content in reality with precise position and perspective correctness, a very detailed understanding of the vehicle's surroundings and its own movement is necessary. In order for the virtual fade-in to be perspectively correct in the world for the driver, it must be positioned and oriented in three-dimensional space depending on the position of the vehicle. For this purpose, it is necessary to accurately locate the vehicle to several centimeters. However, even with a differential GPS system, only an accuracy of about 2 meters can be obtained. With the help of sensor fusion (for example, GPS and camera data with, for example, lane markings), the accuracy can be improved. However, display errors due to inaccuracies cannot be excluded. For example, an incorrect position determination may cause navigation instructions to be displayed at an unreasonable position.

[0008] The display area of ​​a head-up display in which the display of virtual contents in the windshield can be realized is described by the field of view or field of view (FOV). The field of view specifies the extent of the virtual image in the horizontal and vertical directions in degrees and is approximately limited by the available installation space in the vehicle. In conventional technology, a field of view of approximately 10° x 4° can be realized. An incorrect position determination can result in the navigation instructions to be displayed being outside the field of view of the augmented reality head-up display and therefore not even being displayed. Summary of the invention

[0009] The object of the present invention is to provide a solution for generating a display for an augmented reality head-up display for a motor vehicle which allows a reduction in display errors.

[0010] This object is achieved by a method according to the invention, by a computer program according to the invention with instructions and by a device according to the invention. Preferred embodiments of the invention are the subject matter of the invention.

[0011] According to a first aspect of the invention, a method for generating a display of an augmented reality head-up display for a motor vehicle comprises the following steps:

[0012] - Determine the location of the motor vehicle;

[0013] - providing a plurality of virtual elements for navigation instructions based on the position of the motor vehicle, wherein the virtual elements extend on both sides in a lateral direction out of the field of view of the augmented reality head-up display from the perspective of the motor vehicle, and

[0014] - Render at least those virtual elements which have a minimum distance to the center of the field of view.

[0015] According to another aspect of the present invention, a computer program includes instructions which, when executed by a computer, cause the computer to execute the following steps for generating a display of an augmented reality head-up display for a motor vehicle:

[0016] - Determine the location of the motor vehicle;

[0017] - providing a plurality of virtual elements for navigation instructions based on the position of the motor vehicle, wherein the virtual elements extend on both sides in a lateral direction out of the field of view of the augmented reality head-up display from the perspective of the motor vehicle, and

[0018] - Render at least those virtual elements which have a minimum distance to the center of the field of view.

[0019] Here, the concept of computer should be understood broadly. In particular, it also includes controllers and other processor-based data processing devices.

[0020] The computer program may, for example, be provided for electronic retrieval or be stored on a computer-readable storage medium.

[0021] According to another aspect of the invention, a device for generating a display of an augmented reality head-up display for a motor vehicle has:

[0022] a position determination module for determining the position of the motor vehicle; and

[0023] a graphics module for generating a plurality of virtual elements for navigation instructions based on the position of the motor vehicle, wherein the virtual elements extend on both sides in a lateral direction outside the field of view of the augmented reality head-up display from the perspective of the motor vehicle, and for rendering at least such virtual elements which have a minimum distance to the center of the field of view.

[0024] In order to solve the described problem, the virtual expansion of the display element in the transverse direction is utilized. Additional virtual elements can compensate for the positional accuracy that occurs. In normal situations, these additional elements are not rendered and are therefore also not shown by the augmented reality head-up display. In the first frame, however, at least the virtual elements with the minimum distance relative to the center of the display surface are rendered. In this way, it is achieved that the rendered elements are arranged in the middle of the field of vision as much as possible and are therefore well perceived by the driver. Regardless of the correctness of the position of the motor vehicle detected by the sensor, the correctly positioned navigation prompt is always displayed by the augmented reality head-up display. By showing the virtual expansion of the elements in the transverse direction, it is also ensured that the virtual elements are in the field of vision and can be shown as rendered elements in the augmented reality head-up display in the case of non-orthogonal driving to the turning point. The larger the number of virtual elements or the larger the area in which the additional virtual elements are positioned, the smaller the probability that the navigation prompt cannot be shown due to the existing positioning error.

[0025] According to one aspect of the invention, virtual elements adjacent to the virtual element with the smallest distance from the center of the field of view are additionally rendered. The rendering of the additional elements adjacent to the central element enables a navigation prompt consisting of a plurality of elements (e.g., three consecutive arrows). Since it may happen in this regard that the virtual element is only partially in the field of view, it is meaningful to determine how to move with such a virtual element. In a first embodiment, for a virtual element that is only partially in the field of view of the augmented reality head-up display, only the part of the virtual element that is in the field of view is rendered. In a second embodiment, on the other hand, only the virtual elements that are completely in the field of view of the augmented reality head-up display are rendered. Preferably, the user of the augmented reality head-up display can determine in which manner the display is to be implemented.

[0026] According to one aspect of the invention, virtual elements are rendered with decreasing brightness starting from the center of the field of view toward the edge of the field of view. This type of representation simulates the fading out of navigation instructions toward the edge of the field of view. This ensures, in particular in the case of only partially rendered elements, that no disruptive interruptions occur in the representation at the edge of the field of view.

[0027] According to one aspect of the invention, the virtual elements to be rendered are adapted when the steering angle of the motor vehicle exceeds a threshold value when the motor vehicle position is changed. This measure solves the problem that initially determined elements are moved out of the field of view by the movement of the motor vehicle due to the steering intervention. Since the same steering angle causes a greater relative position change at a greater distance to the virtual element than at a closer distance, the threshold value for the steering angle is preferably dependent on the distance between the motor vehicle and the display location for the navigation instructions. This makes it possible to avoid unstable back-and-forth movements of the elements.

[0028] According to one aspect of the invention, when at least one rendered element is no longer within a predetermined range of the field of view when the position of the motor vehicle changes, an adaptation of the virtual elements to be rendered is performed. In this embodiment, a check is made for each frame whether the elements initially determined for rendering are still within a certain area of ​​the field of view. In the case of a large lateral position change of the vehicle, the object moves out of this area. If the area is selected to be smaller than the total field of view, this is an indicator that the element will soon move out of the field of view if there is a continued change in position. This information is used to render the following virtual elements that are foreseeably moved into the field of view. This ensures that whenever an element is about to leave the field of view, another virtual element is pushed in to compensate for the movement of the vehicle.

[0029] The method according to the invention or the device according to the invention is particularly advantageously used in a vehicle, in particular a motor vehicle. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Further features of the present invention will become apparent from the following description and the appended claims taken in conjunction with the accompanying drawings.

[0031] Figure 1 A navigation prompt for contact simulation is displayed when the vehicle approaches a fork;

[0032] Figure 2 Displaying navigation instructions for contact simulation in the event of lateral positioning error when the motor vehicle approaches a fork;

[0033] Figure 3 A navigation prompt for contact simulation when a motor vehicle approaches a fork in a non-orthogonal manner is shown;

[0034] Figure 4 A method for generating a display for an augmented reality heads-up display for a motor vehicle is schematically shown;

[0035] Figure 5 A first embodiment of a device for generating a display for an augmented reality head-up display of a motor vehicle is shown;

[0036] Figure 6 A second implementation form of an apparatus for generating a display of an augmented reality heads-up display is shown;

[0037] Figure 7 A motor vehicle is schematically shown in which the solution according to the invention is implemented;

[0038] Figure 8 The general structure of an augmented reality head-up display for a motor vehicle is schematically shown;

[0039] Fig. 9 Displaying a navigation prompt using contact simulation generated by the method according to the present invention when the motor vehicle approaches a fork;

[0040] Fig.10 Display of navigation instructions using a contact simulation generated by the method according to the invention in the event of a lateral positioning error when the motor vehicle approaches a fork;

[0041] Fig.11 Display of navigation instructions using a contact simulation generated by the method according to the present invention when a motor vehicle approaches a fork in a non-orthogonal manner;

[0042] Fig.12 A navigation cue for a contact simulation consisting of elements rendered with location-dependent brightness is shown;

[0043] Fig.13 A contact-simulated navigation cue is displayed, which includes the truncated rendered element; and

[0044] Fig.14 The generation of navigation cues for contact simulation using raycasting is shown. DETAILED DESCRIPTION

[0045] In order to better understand the principle of the present invention, the following detailed description of the embodiments of the present invention is given according to the accompanying drawings. It should be understood that the present invention is not limited to these embodiments and the described features can also be combined and modified without leaving the protection scope of the present invention, as defined in the appended claims.

[0046] Figure 1 The navigation prompt 50 is shown as the vehicle 40 approaches a fork in the road. An example turning scenario can be seen from the bird's eye view. Figure 1 In the ideal state shown in FIG, a navigation prompt 50 that appears to be in the right lane and indicates a right turn is displayed by the augmented reality head-up display. The navigation prompt 50 consists of three rendered elements 52 that are completely in the field of view 53 of the augmented reality head-up display.

[0047] Figure 2The navigation instructions 50 are shown for contact simulation in the case of a lateral positioning error, that is to say a positioning error transverse to the direction of travel, when the motor vehicle 40 is approaching a junction. Due to the positioning error, the actual position PT of the motor vehicle 40 deviates from the sensor-determined position PS of the motor vehicle 40. This has the effect that the augmentations generated based on the sensor-determined position PS are virtually positioned outside the assumed field of view 56 (which is also based on the sensor-determined position PS) and are therefore not shown or are only partially shown, although they are actually completely within the actual field of view 53. In the example shown, only a single rendered element 52 is shown.

[0048] Figure 3 The navigation prompt 50 is shown as the vehicle 40 approaches the junction non-orthogonally. Figure 3 As can be seen in , in addition to positioning errors, non-orthogonal approach to the turning point can also lead to the fact that the enhancement is virtually positioned outside the field of view 53 and therefore cannot be displayed or can only be partially displayed. In the example shown, the navigation instructions 50 to be displayed are completely outside the field of view 53, so that no single rendered element is displayed.

[0049] Figure 4 A method for generating a display of an augmented reality head-up display for a motor vehicle is schematically shown. In a first step, the position of the motor vehicle is determined 10. A plurality of virtual elements for navigation instructions are then provided 11 based on the position of the motor vehicle. In this case, the virtual elements extend in a lateral direction on both sides from the perspective of the motor vehicle until outside the field of view of the augmented reality head-up display. Finally, at least such virtual elements are rendered 12, which have a minimum distance to the center of the field of view. In addition, virtual elements adjacent to the central virtual element can also be rendered. It can be provided that, for virtual elements that are only partially in the field of view of the augmented reality head-up display, only the part of the virtual element that is in the field of view is rendered. Alternatively to this, only virtual elements that are completely in the field of view of the augmented reality head-up display are rendered. In both cases, the virtual elements can be rendered with gradually decreasing brightness starting from the center of the field of view towards the edge of the field of view. Preferably, the virtual elements to be rendered are adapted when the steering angle of the motor vehicle exceeds a threshold value in the case of a change in the position of the motor vehicle. Here, the threshold value for the steering angle can depend on the distance between the motor vehicle and the display location for the navigation instructions. Alternatively, an adaptation of the virtual elements to be rendered can take place if, in the event of a change in the position of the motor vehicle, at least one rendered element is no longer within a predefined range of the field of vision.

[0050] Figure 5A simplified schematic illustration of a first embodiment of a device 20 for generating a display for an augmented reality head-up display of a motor vehicle is shown. The device 20 has an input 21, via which image data of a camera 43, data of a sensor system 44 or data of a navigation system 45 can be received, for example. The sensor system 44 can, for example, have a laser scanner or a stereo camera for detecting objects in the surroundings of the motor vehicle. In addition, the device 20 has a position determination module 22, which determines the position of the motor vehicle based on the received data. Based on this position, the graphics module 23 first generates a large number of virtual elements for navigation instructions. Here, these virtual elements extend in the lateral direction on both sides from the perspective of the motor vehicle until outside the field of view of the augmented reality head-up display. The graphics module 23 then renders at least such virtual elements, which have a minimum distance to the center of the field of view. In addition, the graphics module 23 can also render virtual elements adjacent to the middle virtual element. It can be provided here that, for virtual elements that are only partially in the field of view of the augmented reality head-up display, only the part of the virtual element that is in the field of view is rendered. Alternatively to this, only the virtual elements that are completely in the field of view of the augmented reality head-up display are rendered. In both cases, the virtual elements can be rendered with a gradually decreasing brightness starting from the center of the field of view toward the edge of the field of view. Preferably, the virtual elements to be rendered are adapted when the steering angle of the motor vehicle exceeds a threshold value in the case of a change in the position of the motor vehicle as determined by the position determination module 22. Here, the threshold value for the steering angle can depend on the distance between the motor vehicle and the display location for the navigation instructions. Alternatively to this, the virtual elements to be rendered can be adapted when, in the case of a change in the position of the motor vehicle, at least one rendered element is no longer within a predetermined range of the field of view.

[0051] The position determination module 22 and the graphics module 23 can be controlled by a control unit 24. Via the user interface 27, the settings of the position determination module 22, the graphics module 23 or the control unit 24 can be changed if necessary. The data accumulated in the device 20 can be stored in the memory 25 of the device 20 when necessary, for example for later evaluation or for use by the components of the device 20. The position determination module 22, the graphics module 23 and the control unit 24 can be implemented as dedicated hardware, for example as an integrated circuit. Of course, it can also be implemented partially or completely in combination or as software, which runs on a suitable processor, for example on a GPU. The input end 21 and the output end 26 can be implemented as separate interfaces or combined bidirectional interfaces. In the example described, the device 20 is an independent component. However, it can also be integrated in the controller 42 of the augmented reality head-up display device.

[0052] Figure 6A simplified schematic illustration of a second embodiment of a device 30 for generating a display for an augmented reality head-up display of a motor vehicle is shown. The device 30 has a processor 32 and a memory 31. For example, the device 30 is a computer or a controller. In the memory 31, instructions are stored that cause the device 30 to implement the steps according to one of the described methods in the case of implementation by the processor 32. The instructions stored in the memory 31 are thus embodied as a program that can be implemented by the processor 32, which implements the method according to the invention. The device 30 has an input 33 for receiving information, such as navigation data or data about the surroundings of the motor vehicle. The data generated by the processor 32 are provided via an output 34. In addition, they can be stored in the memory 31. The input 33 and the output 34 can be combined into a bidirectional interface.

[0053] Processor 32 may include one or more processor units, such as a microprocessor, a digital signal processor, or a combination thereof.

[0054] The memory 25 , 31 of the described embodiments can have both volatile and non-volatile memory areas and include a wide variety of memories and storage media, such as hard disks, optical storage media or semiconductor memories.

[0055] Figure 7 A motor vehicle 40 is schematically shown in which the solution according to the invention is implemented. The motor vehicle 40 has an augmented reality head-up display 41 with an associated controller 42. In addition, the motor vehicle 40 has a device 20 for generating a display of the augmented reality head-up display 41. The device 20 can of course also be integrated into the augmented reality head-up display 41 or into the controller 42 of the augmented reality head-up display 41. Further components of the motor vehicle 40 are a sensor system 44 and a camera 43 for detecting objects, a navigation system 45, a data transmission unit 46 and a series of auxiliary systems 47, one of which is shown as an example. With the help of the data transmission unit 46, a connection to a service provider can be established, for example for retrieving map data. A memory 48 is present for storing data. The data exchange between the different components of the motor vehicle 40 is carried out via a network 49.

[0056] Figure 8Schematically shows an augmented reality head-up display 41 for a motor vehicle 40, with the help of which content can be displayed on a projection surface 63 of the motor vehicle 40, for example on the windshield or on an additional glass made of glass or plastic, which is arranged between the driver and the windshield on the dashboard. The content shown is generated by an imaging unit 60 and projected onto the projection surface 63 by means of an optical module 61. Usually, the projection is carried out in the area of ​​the windshield above the steering wheel. With the help of an optical component 62 of the optical module 61, the position of the eyebox of the augmented reality head-up display 41 can be adapted. The imaging unit 60 can be, for example, an LCD-TFT display. The augmented reality head-up display 41 is generally installed in the dashboard of the motor vehicle 40.

[0057] The following should be based on Figures 9 to 14 A preferred embodiment of the present invention is described. Here, the solution according to the present invention is explained by taking an illustration of a navigation prompt composed of three consecutive arrows as an example. Obviously, the solution according to the present invention is not limited to this embodiment.

[0058] Fig. 9 A navigation prompt 50 is displayed using a contact simulation generated by the method according to the invention when the motor vehicle approaches a fork in the road. In order to avoid display errors due to lateral positioning accuracy, a virtual expansion of the display elements in the lateral direction is performed. In the specific example, the three arrows are supplemented with further virtual elements 51 in the virtual scene. In normal circumstances, however, the additional virtual elements 51 are not rendered and are therefore not shown by the augmented reality head-up display. In the first frame to be shown, at least the elements with the minimum distance 54 to the center of the display surface or to the center of the field of view 53 are rendered. Optionally, a defined number of further elements can be rendered on both sides. Fig. 9 For example, one further element is rendered to the left and to the right of the central element, so that navigation hint 50 consists of three rendered elements 52 .

[0059] Fig.10 A navigation instruction 50 generated with the contact simulation using the method according to the invention in the case of a lateral positioning error when the motor vehicle 40 approaches a junction is shown. The virtual expansion of the display elements in the lateral direction ensures that a correctly positioned navigation instruction 50 can always be displayed in the augmented reality head-up display, regardless of the correctness of the sensor-detected position PS of the motor vehicle relative to the actual position PT of the motor vehicle 40. Since the virtual element 51 also extends into the assumed field of view 56 determined starting from the sensor-detected position PS, the navigation instruction 50 can consist of three rendered elements 52 as desired.

[0060] Fig.11The navigation instructions generated by the contact simulation according to the method according to the invention are shown when the motor vehicle approaches a junction in a deviating orientation of the motor vehicle. By means of the virtual expansion of the display element in the lateral direction, it is ensured in this case that the virtual element 51 is in the field of view 53 and can be displayed as a rendered element 52 in the augmented reality head-up display.

[0061] The greater the number of virtual elements or the larger the area in which the additional virtual elements are positioned, the lower the probability that a navigation hint cannot be displayed due to an existing positioning error.

[0062] The effect achieved by the described solution is similar to that of a flashlight, whose light cone illuminates virtual elements in the central region of the field of view, making them visible through light reflection. Other virtual elements outside the light cone, on the other hand, do not emit light and are therefore not visible.

[0063] In order to implement the described mechanism, virtual elements can be implemented as reflecting but non-emitting objects in the 3D scene. In this case, the virtual representation of the vehicle has a directional light source at the point of the virtual driver's eyes, which illuminates the central area of ​​the field of view of the augmented reality head-up display. As a result, only the central elements that reflect the light are always visible, while virtual elements outside the field of view are not visible. In this embodiment, it can be provided that the virtual elements are illuminated to different degrees depending on their position. In addition, in this variant, it is not mandatory to show the complete element, but in part only the part of the element that is in the light cone.

[0064] Fig.12 By way of example, a contact-simulated navigation guide 50 is shown, which consists of elements 52 rendered with a brightness that depends on the location. For this purpose, these virtual elements are rendered with a gradually decreasing brightness starting from the center 54 of the field of view 53 toward the edge 55 of the field of view 53. This is shown in FIG. Fig.12 It is represented by the density of the hatching.

[0065] Fig.13 A contact-simulated navigation prompt 50 is shown, which includes a truncated rendered element 52. Virtual elements 51 in the center 54 of the field of view 53 or adjacent to the center 54 are completely illuminated by the virtual light cone, while virtual elements 51 at the edge 55 of the field of view 53 are only partially illuminated by the virtual light cone. Accordingly, only the part of these virtual elements 51 that is within the field of view 53 or illuminated by the virtual light cone is rendered. Here again, location-dependent brightness can be taken into account.

[0066] In an alternative embodiment, a virtual raycast 57 (line of sight) is transmitted at a determined distance through the field of view 53 of the augmented reality head-up display. The generation of the contact-simulated navigation instructions 50 by means of raycasting is described in detail in the following sections. Fig.14 When the ray projection 57 hits the virtual element 51, the corresponding element is completely shown as a rendered element 52 at these points. This enables a discrete display of the display elements. Here, the position of the ray projection 57 can change with the vehicle position.

[0067] The action described above relates to the display of the first frame when approaching a turn prompt. Although this action can also be used for any other frame, this will result in a static display in the head-up display when the vehicle is moving. Augmented reality, however, requires a dynamic adaptation of the display depending on the perspective. This can be achieved by the action method described below. In both action methods, the augmented reality effect is still achieved.

[0068] In a first embodiment, after the element to be displayed for the first frame is determined, the same element is displayed in the subsequent frames, as long as a predefined steering angle is not exceeded. When this steering angle is exceeded, the element to be rendered is adapted, since the initially determined element is expected to move out of the field of view due to the movement of the motor vehicle due to the steering intervention. Since the same steering angle causes a greater relative position change at a greater distance to the virtual element than at a closer distance, a distance-dependent threshold value for the steering angle change is preferably used, which causes an adaptation of the element to be rendered. This makes it possible to avoid an unsteady back-and-forth movement of the element.

[0069] In a second embodiment, a check is made for each frame whether the element initially determined for rendering is still in a certain area of ​​the field of view. In the case of a large lateral change in the vehicle's position, the object moves out of this area. If the area is selected to be smaller than the entire field of view, this is a sign that the element will soon move out of the field of view if there is a further change in position. This information is used to render the following virtual element that is predictably moved into the field of view. This ensures that whenever an element is about to leave the field of view, another virtual element is pushed in to compensate for the vehicle movement.

[0070] List of reference numerals:

[0071] 10 Determine the location of the vehicle

[0072] 11 Provide a large number of virtual elements

[0073] 12 Render at least one virtual element

[0074] 20 Installation

[0075] 21 Input

[0076] 22 Position determination module

[0077] 23 Graphics Module

[0078] 24 Control Unit

[0079] 25 Memory

[0080] 26 Output

[0081] 27 User Interface

[0082] 30 Devices

[0083] 31 Memory

[0084] 32 processors

[0085] 33 Input

[0086] 34 Output

[0087] 40 Motor Vehicles

[0088] 41 Augmented Reality Head-Up Display

[0089] 42 Augmented Reality Head-Up Display Controller

[0090] 43 Camera

[0091] 44 Sensor System

[0092] 45 Navigation System

[0093] 46 Data Transmission Unit

[0094] 47 Auxiliary systems

[0095] 48 Memory

[0096] 49 Network

[0097] 50 Navigation Tips

[0098] 51 Virtual Elements

[0099] 52 rendered elements

[0100] 53 Actual Field of View

[0101] 54 Center of Vision

[0102] 55 The Edge of Vision

[0103] 56 Assumed Horizons

[0104] 57 Ray Casting

[0105] 60 Imaging Unit

[0106] 61 Optical Module

[0107] 62 Optical components

[0108] 63 Projection surface

[0109] PS sensing position

[0110] PT Actual position.

Claims

1. A method for generating a display of an augmented reality head-up display (41) for a motor vehicle (40), comprising the following steps: - determining (10) the position (PS) of the motor vehicle (40); - providing (11) a plurality of virtual elements (51) for navigation instructions (50) based on the position (PS) of the motor vehicle (40), wherein: The virtual elements (51) extend in a transverse direction on both sides from the perspective of the motor vehicle (40) out of the field of view (53) of the augmented reality head-up display (41) and are arranged in a row, and - rendering (12) at least such virtual element (51) having a minimum distance relative to the center (54) of said field of view (53), It is characterized in that When the steering angle of the motor vehicle (40) exceeds a threshold value when the position (PS) of the motor vehicle (40) changes, the virtual element (51) to be rendered is adapted; or The virtual element (51) to be rendered is adapted when, in the event of a significant change in the lateral position (PS) of the motor vehicle (40), at least one rendered element (52) is no longer located within a predefined region of the field of view (53).

2. The method according to claim 1, wherein: Additionally, virtual elements (51) adjacent to the virtual element (51) with the smallest distance to the center (54) of the field of view (53) are rendered (12).

3. The method according to claim 2, wherein: For a virtual element (51) that is only partially within a field of view (53) of the augmented reality head-up display (41), only the portion of the virtual element (51) that is within the field of view (53) is rendered (12).

4. The method according to claim 2, wherein: Only virtual elements (51) that are completely within the field of view (53) of the augmented reality head-up display (41) are rendered (12).

5. The method according to any one of claims 2 to 4, wherein: The virtual element (51) is rendered (12) with a gradually decreasing brightness starting from a center (54) of the field of view (53) toward an edge (55) of the field of view (53).

6. The method according to claim 1, wherein: A threshold value for the steering angle depends on the distance between the motor vehicle (40) and a display location for the navigation instructions (50).

7. A computer program product having instructions which, when executed by a computer, cause the computer to carry out the steps of the method according to any one of claims 1 to 6 for generating a display of an augmented reality head-up display (41) for a motor vehicle (40).

8. A device (20) for generating a display of an augmented reality head-up display (41) for a motor vehicle (40), comprising: - a position determination module (22) for determining (10) a position (PS) of the motor vehicle (40); and - a graphics module (24) for generating a plurality of virtual elements (51) for navigation instructions (50) based on the position (PS) of the motor vehicle (40), wherein: The virtual elements (51) extend in a transverse direction on both sides from the perspective of the motor vehicle (40) beyond the field of view (53) of the augmented reality head-up display (41) and are arranged in a row, and are used to render (12) at least such virtual elements (51) which have a minimum distance to the center (54) of the field of view (53); Characterized in that the graphic module (24) is set to: When the steering angle of the motor vehicle (40) exceeds a threshold value in the event of a change in the position (PS) of the motor vehicle (40) determined by the position determination module (22), an adaptation of the virtual element (51) to be rendered is performed; or The virtual element (51) to be rendered is adapted when, in the event of a significant change in the lateral position (PS) of the motor vehicle (40) determined by the position determination module (22), at least one rendered element (52) is no longer located within a predetermined region of the field of view (53).

9. A motor vehicle (40) with an augmented reality head-up display (41), characterized in that: The motor vehicle (40) has a device (20) according to claim 8 or is configured to carry out a method according to any one of claims 1 to 6 for generating a display of the augmented reality head-up display (41).

Images