Display of contact simulation for preparation of navigation operations

By determining multiple display points on the vehicle's driving path and displaying the display elements for contact simulation, the attention divergence problem caused by the driver switching between contact simulation and static display in the prior art is solved, which improves driving safety and reduces cognitive divergence.

CN113970342BActive Publication Date: 2025-04-01VOLKSWAGEN AG
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202110760518.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2020-07-22
Filing Date
2021-07-06
Publication Date
2025-04-01
Estimated Expiration
2041-07-06

AI Technical Summary

Technical Problem

In the prior art, the driver switches between contact analog display and static display, resulting in a shift in attention, reducing driving safety, while the late visibility of the virtual operation arrows hinders the driver's preparation.

Method used

A plurality of display points are determined on the vehicle's driving path through an augmented reality display device, and display contact simulated display elements, including virtual arrows, at these points, ensuring that the display elements appear in advance before target operation and reducing the driver's cognitive transfer.

Benefits of technology

It realizes preparation for upcoming operations without the driver turning his head to view navigation information, improves driving safety, reduces necessary cognitive transfer work, and helps drivers prepare operations earlier and more accurately through display elements of multiple checkpoint features.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113970342B_ABST
    Figure CN113970342B_ABST
Patent Text Reader

Abstract

The present invention relates to a method for controlling the contact-simulated display of navigation information of an augmented reality display device in order to prepare for a navigation operation of a vehicle; wherein, in a first method step, a target operation and an operating point of the target operation are determined, and in the remaining method steps, display points located on the road in the driving path of the vehicle are determined, and the display points are respectively at a fixed distance from the operating points; then, a contact-simulated display element is generated and output to the augmented reality display device together with its corresponding display point for display by the augmented reality display device. The present invention also relates to a device for executing the method. The present invention also relates to a vehicle having an augmented reality display device and such a device, and also to a computer-readable storage medium containing instructions, which, when executed by a computer, cause the computer to execute the method.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The invention relates to a method for determining and outputting a display element of a contact simulation for preparing an operation of a vehicle, and to a device configured to carry out the method. The invention also relates to a vehicle configured to carry out the method and to a computer-readable storage medium comprising instructions for carrying out the method. Background Art

[0002] In known methods for displaying navigation information, for example on a display installed in the dashboard or the like, it is usually necessary to take the eyes off the road, in particular away from the relevant operating point, in order to perceive the navigation information. In addition, the displayed information still has to be cognitively processed by the driver in relation to the current environment, for example by adapting the content of the map to the actual driving environment. Therefore, contact-simulating displays, such as those produced by augmented reality head-up screens or augmented reality head-up displays known from the prior art, can in principle help improve driving safety. With the aid of such augmented reality head-up screens, display elements can be displayed in the driver's current field of vision, which makes the driver perceive these display elements as an integral part of the environment.

[0003] Document DE 10 2012 216 144 A1 proposes a contact simulation display of navigation information, wherein a virtual arrow is positioned at the point on the road where the vehicle should turn. In addition, a further static display prepares the driver for operation.

[0004] Another method for displaying operation information in a contact-simulated manner is known from document DE 10 2018 203 927 A1. Here, an operation indicator in the form of a virtual arrow is generated, which is displayed vertically on the lane to be driven by the vehicle at the execution position of the operation. The document also proposes an additional static display to prepare the driver for the operation.

[0005] A disadvantage of the known methods is that the user must switch between the contact simulation display and the static display in order to prepare for the operation, which results in a distraction of attention and thus a reduction in driving safety. At the same time, however, if only known virtual operating arrows are used, the future operation becomes visible only later and thus prevents preparation. For example, if the intersection at which the turning maneuver is to be performed is located behind the curve, the operating arrows are visible to the driver only very late. Summary of the invention

[0006] The technical problem to be solved by the present invention is to overcome the disadvantages of the prior art and to provide a method for controlling a contact-simulated display of navigation information, by means of which the driving safety of a vehicle can be improved.

[0007] The technical problem is solved by a method for preparing a navigation operation of a vehicle by controlling a contact-simulated display of navigation information of an augmented reality display device, a device for the method, a corresponding vehicle and a computer-readable storage medium. The invention also discloses a preferred improved design solution.

[0008] According to the present invention, a method is provided for preparing a navigation operation of a vehicle, which method controls a touch-simulated display of navigation information of an augmented reality display device.

[0009] As a contact simulation, according to the present disclosure, it means that the display elements displayed in the current field of view of the driver make the driver feel that these display elements are an inherent part of the environment. According to the present disclosure, an augmented reality display device is a device that can output display elements of contact simulation so that the display elements are displayed in the current field of view of the driver, so that the driver feels that these display elements are a part of the environment. Here, the device can make the virtual display elements appear to be arranged at a certain position in the three-dimensional space of the real world. The augmented reality display device in the vehicle is particularly preferably a head-up screen or a head-up display of the vehicle, wherein the head-up screen is configured to output the display elements of contact simulation. The augmented reality display device is further preferably augmented reality glasses, which are worn by the driver of the vehicle and can communicate with the vehicle. The term "operation" refers to the intervention of the lateral and / or longitudinal guidance of the vehicle by the driver, especially the change of the speed and / or direction of the vehicle. For example, the operation is performed by the driver of the vehicle to keep the vehicle on the desired route. For example, the turning of the vehicle is an operation.

[0010] In the first step of the method according to the invention, a target operation and an operating point of the target operation are determined. Here, the target operation according to the invention is preferably the next operation in time, particularly preferably the next navigation operation in time of a previously determined route, wherein the route has a plurality of navigation operations. However, the operation can also be based on environmental information such as received via traffic broadcasts or sensors of the vehicle. According to the present disclosure, the operating point refers to the execution position of the target operation. For example, if the target operation is to turn right at an angle of 90°, the operating point is the position at which the vehicle must turn right 90° to execute the target operation, in particular the point at which the driver must start turning the steering wheel.

[0011] In a further step of the method according to the invention, a first display point is determined which is at a first fixed distance from the operating point and on a travel path traveled by the vehicle. Preferably, the first display point is determined so that the first display point is in the travel path of the vehicle on the road. In particular, the first display point is determined on the travel path between the current vehicle position and the operating point. The first display point is preferably determined at the center of a track or lane traveled by the vehicle. The first display point is determined by the first fixed distance from the operating point, that is, the relative position of the first display point and the operating point is unchanged. In the context of the method according to the invention, the first display point is therefore a fixed position indication in the three-dimensional space of the real world, at which a first display element simulating a touch representing navigation information should be displayed.

[0012] The first fixed distance is preferably determined by means of the speed of the vehicle. The first fixed distance determined at high speed is greater than at lower speeds to give the driver enough time to prepare for the target operation. It is further preferred that the first fixed distance is determined by means of the position of the vehicle. It is preferred that the first fixed distance is determined by means of the speed of the vehicle and the position of the vehicle.

[0013] In a further step of the method according to the invention, a first display element of a contact simulation is generated and output for display at a first display point by an augmented reality display device. In other words, the first display element of the contact simulation generated and output in this method step is displayed by the augmented reality display device so that the driver of the vehicle perceives that the first display element is placed flat on the road at a position defined by the first display point. Preferably, the first display element of the contact simulation includes navigation information describing the target operation and is displayed at the first display point without changing its position. Preferably, the first display element of the contact simulation consists of at least one arrow that indicates a direction corresponding to the target operation and appears to be placed flat or erected on the road without changing its position. However, variations of the arrow in terms of appearance, spatial positioning and rotation are also preferred.

[0014] In the method according to the invention, in a further step, a second display point is determined which is at a second fixed distance from the operating point and on the travel path traveled by the vehicle. Preferably, the second display point is determined so that the second display point is in the travel path of the vehicle on the road and is at a distance from the operating point which corresponds to the second fixed distance. In particular, a second display point is determined on the travel path between the current vehicle position and the operating point. The second display point is preferably determined at the center of the track or lane traveled by the vehicle. The second display point is determined by the first fixed distance from the operating point, that is, the relative position of the second display point and the operating point is unchanged. In the context of the method according to the invention, the second display point is therefore a fixed position indication in the three-dimensional space of the real world, at which a second display element simulating a touch representing navigation information should be displayed.

[0015] In a further step of the method according to the invention, a second display element of the contact simulation is generated and output for display at a second display point by an augmented reality display device. In other words, the second display element of the contact simulation generated and output in this method step is displayed by the augmented reality display device so that the driver of the vehicle perceives that the second display element is placed flat on the road at a position defined by the second display point. Preferably, the second display element of the contact simulation includes navigation information describing the target operation and is displayed at the second display point without changing its position. Preferably, the second display element of the contact simulation consists of at least one arrow that indicates the direction corresponding to the target operation and appears to be placed flat or erected on the road without changing its position. However, variations of the arrow in terms of appearance, spatial positioning and rotation are also preferred.

[0016] Here, according to the invention, the second fixed distance is smaller than the first fixed distance. In other words, the second display element is displayed closer to the operating point than the first display element. The driver can therefore prepare for the operation to be performed by means of the first and second display elements when approaching the operating point. A continuous user-machine interaction is thus performed to increase driving safety. By displaying at least two display elements at two display points at different distances from the operating point, a navigation aid with a checkpoint feature is advantageously provided, which assists the driver discontinuously or intermittently or intermittently. The driver is therefore prompted in a continuous manner about the operation to be performed, but unlike the continuous display of a changing display element, the driver does not have to pay attention to the gradual changes of the display element.

[0017] The method according to the invention thus advantageously enables the driver of the vehicle to prepare for a target operation with the aid of navigation information displayed in a contact-simulating manner. The display of the desired information in the driver's field of vision significantly improves driving safety, since it is no longer necessary to turn the head to obtain the information. In addition, the contact-simulating display, i.e. the introduction of virtual information into the real world, also reduces the necessary cognitive transfer work. The checkpoint feature according to the invention, which is generated by a plurality of display elements in succession, greatly facilitates the preparation for a target operation solely with the aid of contact-simulating elements. The method according to the invention overcomes the disadvantages of the prior art, such as the late visibility of virtual operating arrows displayed only at the operating point.

[0018] In the preferred design of the method according to the present invention, it is provided that the first display element of the contact simulation outputs in the first time period, and the second display element of the contact simulation outputs in the second time period at least partly located after the first time period. It is preferred that the two display elements output simultaneously, and then the output of the first display element ends earlier than the output of the second display element. It is further preferred that the output of the first display element starts at the first moment. At the second moment, the output of the first display element is ended and the output of the second display element is started, and then the output of the second display element is ended at the third moment. It is also preferred that the output of the first display element is started at the first moment. Then the output of the second display element is started at the second moment after the first moment. At the third moment after the second moment, the output of the first display element is ended, and at the fourth moment after the third moment, the output of the second display element is ended. It is important that more than one display element is at least partially displayed successively in time, and even the display separated in position has a certain degree of overlap in time.

[0019] This preferred embodiment of the method according to the invention also results in an advantageous checkpoint effect in the method according to the invention. Unlike the prior art proposal of continuously outputting a display element simulating a touch, the invention prevents critical obstructions or distractions. At the same time, the continuous output of a plurality of individual display elements along the vehicle's travel path enables the driver to be constantly prepared for the operation.

[0020] According to another preferred embodiment of the method of the present invention, a plurality of display points having corresponding fixed distances from the operating point are determined, and corresponding display elements of the contact simulation are generated and output, wherein the display points are respectively spaced apart in a predetermined manner from one another. In other words, according to this further preferred embodiment of the method of the present invention, more than two display points having corresponding display elements are generated, wherein each display point is located in the driving path of the vehicle on the road at a fixed distance from the operating point. Therefore, the fixed distances of all subsequent display points (e.g. the third display point) relative to the operating point are smaller than the fixed distances of the preceding display points (e.g. the second display point) relative to the operating point. The fixed distances of the display points relative to the operating point are respectively different from one another, thereby forming a spatial interval between the corresponding display points, which is predetermined.

[0021] In a preferred first embodiment, the spacing between the different display points is constant. For example, the display points on the vehicle's travel path are constantly determined at a distance of 50 m from each other. It is also preferred that the spacing between the display points is determined by means of the vehicle's speed. At higher speeds, the spacing is also correspondingly larger, so that the driver has enough time to perceive the subsequent display elements. This can avoid confusing the driver due to display elements that only appear briefly. It is also preferred that the spacing is determined by means of the vehicle's position, particularly preferably as a function of its distance from the operating point. If the distance between the vehicle and the operating point is small at the moment of calculation, the spacing between the display points is preferably small. It is particularly preferred that the spacing is determined by means of the vehicle's speed and the vehicle's position.

[0022] The advantageous checkpoint effect of the invention is further enhanced by means of this preferred embodiment of the method according to the invention. Unlike the prior art, which suggests the uninterrupted output of a display element simulating a contact, the invention prevents critical occlusion or distraction of attention. At the same time, the continuous output of multiple individual display elements along the driving path and for a sufficient period of time for the vehicle enables the driver to continuously prepare for the upcoming operation.

[0023] In a further preferred embodiment, in the method according to the invention, a variable distance between the operating point and the vehicle is additionally determined, and a projection angle is determined for each display element as a function of the determined distance and the corresponding fixed distance from the operating point. The projection angle is preferably determined in this case in that the display element is displayed in a positionally unchanged manner at a display point at a fixed distance from the operating point, that is, as a variable projection angle.

[0024] Here, the variable distance is the distance of the vehicle from the operating point, which is variable based on the movement of the vehicle, that is, depends on the speed of the vehicle. Preferably, the variable distance of the vehicle is determined based on at least one position and at least one speed of the vehicle. Here, the position of the vehicle is preferably determined directly by sensor data. It is also preferred that the position of the vehicle is determined by sensor data and relative to at least one other position. If the position is determined directly by sensor data, it is preferably determined with the help of GPS data. If the position is determined relative to at least one other position, it is preferably determined with the help of a distance sensor. The distance sensor preferably includes a laser. The position of the vehicle is determined relatively based on at least one other position, and the at least one other position is preferably an operating point, a display point or a fixed distance of a display point. The other position can also be an identification of the operating point, such as a road sign.

[0025] The projection angle is the angle at which the augmented reality display device of the vehicle is set so that the corresponding display element of the contact simulation is projected onto the corresponding display point from the driver's line of sight. The projection angle is preferably calculated using the distance between the vehicle and the corresponding display point, which is composed of a variable distance and a fixed distance between the corresponding display point and the operating point. It is also preferred that the height of the augmented reality display device above the road is also additionally included in the calculation of the projection angle. However, other solutions for determining the projection angle are also conceivable.

[0026] In this further preferred embodiment of the method according to the invention, it is also preferred that each display element is displayed at a projection angle equal to a predetermined first limiting angle and is hidden at a projection angle equal to a predetermined second limiting angle. It is preferred that each display element is provided with a predetermined first limiting angle and a predetermined second limiting angle. It is particularly preferred that the limiting angle of a display element is different from the limiting angles of other display elements. It is also preferred that each display element has the same predetermined limiting angle. The limiting angle thus presents itself as an easily realizable control variable for controlling the display of the display element and can also be advantageously associated in a simple manner in the calculation with the variable spacing from the operating point and the fixed distance of the display element.

[0027] In another preferred embodiment of the present invention, it is provided that a distance indication corresponding to the corresponding fixed distance from the operating point is output for each display element. Here, the distance indication is preferably a digital indication, which corresponds to the fixed distance from the display point belonging to the corresponding display element to the operating point. Here, the distance indication is preferably also output in a contact-simulated manner like the corresponding display element. In other words, the distance indication is displayed by the augmented reality display device so that the driver of the vehicle perceives that the distance indication is placed horizontally or vertically next to the corresponding display element on the road in the driving path of the vehicle.

[0028] Preferably, the distance indication is given by a length indication. It is further preferred that the distance indication contains an indication which can correspond to a corresponding fixed distance from the operating point. Such an indication is preferably part of a countdown. For example, preferably the smallest fixed distance to the operating point is configured 1, the next larger configuration 2, and so on. If the distance indication is given by a length indication, it is preferably given by a variable distance from the vehicle to the operating point. The length indication is particularly preferably a corresponding fixed distance from a display point to the operating point, at which the distance indication is displayed together with the display element corresponding thereto.

[0029] This further preferred embodiment of the method according to the invention is particularly advantageous in that, during preparation for an operation, the driver can generally be completely prevented from switching between a contact-simulated and a static display by means of the likewise contact-simulated distance indication, thereby preventing a distraction and thereby further improving driving safety.

[0030] In another preferred embodiment of the present invention, a device for the method according to the present invention as described above is provided, which has an entry interface configured to receive data. The data received by the entry interface is preferably sensor data. The entry interface preferably receives sensor data from an internal sensor of the vehicle. The internal sensor of the vehicle refers to a sensor fixedly installed in the vehicle. Preferably, the sensor data received from the internal sensor is data about the speed of the vehicle. Preferably, data about the position of the vehicle or the speed of the vehicle that can be determined by a GPS sensor, for example. In addition, preferably, the data received by the entry interface is output data of a data processing device of the vehicle. The data processing device of the vehicle is a device that receives sensor data and processes it into output data. For example, a navigation system is a data processing device of the vehicle. The entry interface is preferably capable of receiving operation information that describes the type and location of the operation. The driver can input instructions with the help of the input interface of the vehicle, and the input interface of the vehicle is also the data processing device of the vehicle. It is particularly preferred that the receiving interface of the device according to the present invention is configured to receive the input data of the driver by the input interface.

[0031] The device according to the present invention also includes a control unit, which is configured to determine a target operation and an operation point of the target operation, determine at least one first display point having a first fixed distance from the operation point, and determine at least one second display point having a second fixed distance from the operation point.

[0032] Here, the control unit preferably determines the target operation and the operating point of the target operation by means of data received by the receiving module. Preferably, the control unit can calculate navigation data and thereby determine the target operation and the operating point of the target operation by means of received position data of the vehicle and input data of the driver received from an input interface of the vehicle. It is also preferred that the control unit is designed to determine the target operation and the operating point of the target operation from navigation data received from a navigation system. It is also preferred that the control unit is designed to process the operating information received by means of the access interface.

[0033] The first fixed distance is preferably determined by the control unit with the aid of data received about the speed of the vehicle. In the case of high speeds, the first fixed distance is correspondingly larger in order to give the driver sufficient time to prepare for the target operation. It is further preferred that the first fixed distance is determined with the aid of data received about the position of the vehicle. The first fixed distance is less than the distance between the vehicle and the operating point at the moment of calculating the first fixed distance. The second fixed distance is preferably determined by the control unit with the aid of the speed of the vehicle and with the aid of the first fixed distance. The control unit preferably determines the interval between the first display point and the second display point from the difference between the first fixed distance and the second fixed distance. The interval preferably increases at higher speeds of the vehicle. It is further preferred that the second fixed distance is determined by the control unit with the aid of the first fixed distance and the position of the vehicle. The smaller the distance between the position of the vehicle and the operating point, the smaller the difference between the two distances, i.e. the interval between the two display points, preferably becomes. It is particularly preferred that the first fixed distance and the second fixed distance are determined by the control unit with the aid of the speed of the vehicle and the position of the vehicle, wherein the second fixed distance is less than the first fixed distance.

[0034] Furthermore, the device according to the invention has a graphics module which is designed to generate at least one first display element simulating a contact at a first display point and at least one second display element simulating a contact at a second display point.

[0035] Preferably, the display element for contact simulation is generated by a graphics module so that when the display element for contact simulation is displayed by the augmented reality display device, it is seen by the driver of the vehicle as being on the driving path, in particular lying flat on the road on which the vehicle is traveling at a position defined by the corresponding display point. Preferably, the display element for contact simulation contains navigation information describing the target operation. Preferably, the display element for contact simulation is respectively composed of at least one arrow, which indicates the direction of the target operation and appears to be lying flat or vertically on the road in a fixed position. However, variations of the arrow in terms of appearance, spatial positioning and rotation are also preferred.

[0036] Additionally, the device according to the invention has an output interface, which is configured to output a display point displayed by the augmented reality display device and a display element corresponding to the contact simulation of the display point. In other words, the output interface is configured to output the display point determined by the control unit and the display element generated by the graphics module to the augmented reality display device of the vehicle, so that the augmented reality display device outputs the display element so that the display element appears to the driver as being placed flat on the road at the location of the display point in a contact-simulated manner.

[0037] In a preferred embodiment of the device according to the invention, the device has an I / O module which is formed jointly from an input interface and an output interface.

[0038] In another preferred design of the device according to the present invention, the control unit is additionally configured to calculate the first time period and the second time period, and the output module is configured to output the first time period and the second time period, so that the augmented reality display device outputs the first display element of the contact simulation in the first time period and outputs the second display element of the contact simulation in the second time period at least partially after the first time period. It is preferred that the two display elements are output simultaneously, and then the output of the first display element ends earlier than the output of the second display element. It is further preferred that the output of the first display element starts at a first moment. At a second moment, the output of the first display element is ended and the output of the second display element is started, and then the output of the second display element is ended at a third moment. It is also preferred that at a first moment, the output of the first display element is started. Then at a second moment after the first moment, the output of the second display element is started. At a third moment after the second moment, the output of the first display element is ended, and at a fourth moment after the third moment, the output of the second display element is ended. It is important that the display elements are at least partially displayed successively in time, and even presentations separated in position with a certain degree of overlap in time are also feasible.

[0039] According to another preferred embodiment of the device of the present invention, it is provided that the control unit is configured to determine a plurality of display points with corresponding fixed distances from the operating point, and the image module is configured to generate corresponding display elements of the contact simulation, wherein the display points have a predetermined spacing from each other. In other words, the device of the present invention is configured in this further preferred embodiment to generate more than two display points with corresponding display elements, wherein each display point is located in the driving path of the vehicle on the road at a fixed distance from the operating point. Therefore, the fixed distances of all subsequent display points (e.g. the third display point) relative to the operating point are smaller than the fixed distances of the preceding display points (e.g. the second display point) relative to the operating point. The fixed distances of the display points relative to the operating point are different from each other here, thereby forming a spatial spacing between the corresponding display points, which spacing is predetermined.

[0040] In a preferred first embodiment, the spacing between the different display points is constant. For example, the control unit continuously determines the display points on the vehicle's travel path at a distance of 50 m from each other. It is also preferred that the control unit determines the spacing between the display points here, preferably with the aid of the vehicle's speed. At higher speeds, the spacing is also correspondingly larger in order to give the driver enough time to see the subsequent display elements. This can avoid confusing the driver due to display elements that appear only briefly. It is also preferred that the control unit determines the spacing with the aid of the vehicle's position, particularly preferably as a function of its distance from the operating point. If the vehicle is at a smaller distance from the operating point at the moment of calculation, the spacing between the display points is preferably smaller. It is particularly preferred that the control unit determines the spacing with the aid of the vehicle's speed and the vehicle's position.

[0041] In a further preferred embodiment of the invention, the control unit of the device according to the invention is additionally designed to determine a variable distance between the operating point and the vehicle and to determine a projection angle for each display element as a function of the determined variable distance and the corresponding fixed distance from the operating point. The projection angle is preferably determined by the control unit in this case in such a way that the display element is displayed in a positionally unchanged manner at a display point having a fixed distance from the operating point, that is, as a variable projection angle.

[0042] Here, the variable distance is the distance of the vehicle from the operating point, which is variable based on the movement of the vehicle, that is, depends on the speed of the vehicle. Preferably, the control unit determines the variable distance of the vehicle according to at least one position and at least one speed of the vehicle in this preferred design of the present invention. Here, the position of the vehicle is preferably determined directly by the control unit through sensor data. It is also preferred that the position of the vehicle is determined by the control unit through sensor data and relative to at least one other position. If the position is determined directly by sensor data, it is preferably determined with the help of GPS data. If the position is determined relative to at least one other position, it is preferably determined with the help of data received from a distance sensor. The distance sensor preferably includes a laser. The position of the vehicle is determined relatively based on at least one other position, and the at least one other position is preferably an operating point, a display point, or a fixed distance from a display point. The other position can also be an identification of an operating point, such as a road sign.

[0043] The projection angle is the angle at which the augmented reality display device of the vehicle is set so that the corresponding display element for the touch simulation is projected onto the corresponding display point from the driver's line of sight. The projection angle is preferably determined by the control unit using the distance between the vehicle and the corresponding display point, which is composed of a variable distance and a fixed distance between the corresponding display point and the operating point. It is also preferred that the height of the augmented reality display device above the road is additionally included in the calculation of the projection angle by the control unit. However, other solutions are also conceivable, with which the control unit determines the projection angle.

[0044] In this further preferred design of the device according to the invention, the control unit is also preferably configured to determine a first limit angle and a second limit angle for each display element, and the output interface is configured to output the first limit angle and the second limit angle to the augmented reality display device, so that the augmented reality display device displays each display element at a projection angle equal to the predetermined first limit angle and hides it at a projection angle equal to the predetermined second limit angle. It is preferred that each display element is equipped with a predetermined first limit angle and a predetermined second limit angle. It is particularly preferred that the limit angle of one display element is different from the limit angles of other display elements. It is also preferred that each display element has the same predetermined limit angle.

[0045] In another preferred embodiment of the device according to the invention, it is provided that the image module is also configured to additionally generate a distance indication corresponding to a corresponding fixed distance from the operating point for each display element. Here, the distance indication is preferably also generated as a contact simulation like the corresponding display element. In other words, the generated distance indication is displayed by the augmented reality display device after being output via the output interface of the device according to the invention, so that the driver of the vehicle perceives the distance indication as lying flat or vertically next to the corresponding display element on the road in the driving path of the vehicle. Here, the distance indication is preferably a digital indication, which corresponds to a fixed distance from the display point belonging to the corresponding display element to the operating point and is determined by the control unit.

[0046] Preferably, the distance indication is determined by the control unit as a length indication. It is also preferred that the distance indication contains an indication determined by the control unit that can correspond to a corresponding fixed distance from the operating point. Such an indication is preferably part of a countdown. For example, preferably the control unit sets 1 for the smallest fixed distance to the operating point, 2 for the next larger distance, and so on. If the distance indication is determined as a length indication, it preferably corresponds to a variable distance of the vehicle from the operating point. The length indication is particularly preferably a corresponding fixed distance from the display point to the operating point, at which the distance indication is to be displayed together with the display element corresponding thereto.

[0047] A further aspect of the invention also relates to a vehicle having an augmented reality display device and a device according to the invention for the method according to the invention, as described above.

[0048] Another aspect of the invention relates to a computer-readable storage medium, which contains instructions which, when executed by a computer, in particular by a control unit of a device according to the invention of a vehicle according to the invention as described above, enable the method according to the invention to be performed as described above. The storage medium is preferably a volatile memory, such as a RAM memory, or a non-volatile memory, such as a Flash memory.

[0049] Further preferred embodiments of the invention result from the other features described in the invention.

[0050] Unless otherwise stated, the different embodiments of the invention described in this application can be combined with one another in an advantageous manner. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] The present invention will be further described below in the embodiments according to the accompanying drawings. In the accompanying drawings:

[0052] Figure 1 A schematic flow chart showing the method according to the present invention and a preferred design scheme of the method according to the present invention;

[0053] Figure 2 A schematic diagram showing a vehicle according to the invention and a device according to the invention for carrying out the method according to the invention;

[0054] Figure 3 A top view showing a traffic situation of vehicles according to the present invention;

[0055] Figure 4 A side view showing a traffic situation of a vehicle according to the present invention;

[0056] Figures 5a to 5d The traffic situation from the driver's perspective of a vehicle according to the invention is shown at different times. DETAILED DESCRIPTION

[0057] Figure 1A schematic flow chart of a method 1 according to the invention is shown. In a first step S1, a target operation of a vehicle and an operation point at which the target operation should be initiated are determined. Then a second step S2 of the method according to the invention is performed, in which a first display point is determined, which is located on the road traveled by the vehicle in the vehicle's driving path and has a fixed distance from the operation point. A third step S3 of the method according to the invention comprises generating a first display element of a contact simulation, which is then output to an augmented reality display device of the vehicle, which displays the first display element of the contact simulation at the first display point determined by the second step S2. The driver then perceives the display element of the contact simulation as lying flat on the road at the first display point. In a fourth step S4, a second display point is determined, which is also located on the road in the vehicle's driving path and has a second fixed distance from the operation point. Here, the second fixed distance is smaller than the first fixed distance. Then a second display element of the contact simulation is generated in a fifth step S5 of the method according to the invention, which is also output to the augmented reality display device so that it is displayed at the second display point determined by the fourth step S4.

[0058] exist Figure 1 The schematic flow chart of the method 1 according to the invention is supplemented in order to schematically illustrate a preferred embodiment of the method according to the invention. In this preferred embodiment, it is provided that more than two display points together with the corresponding display elements are determined, generated and output. Therefore, after the fifth step S5 of the method according to the invention, it is determined whether the vehicle has reached the operating point. If not, steps S4 and S5 are repeated. Therefore, in step S4, further display points are determined and in step S5, corresponding further display elements are generated and output. This is in Figure 1 2 is shown in the first alternative 2. If the vehicle reaches the operating point after a possible multiple repetition of steps S4 and S5, the further alternative 3 is selected and step S6 is executed, which terminates this preferred embodiment of the method according to the invention.

[0059] Figure 2According to the invention, a schematic diagram of a vehicle 10 according to the invention and a device 20 according to the invention for executing a method 1 according to the invention is shown. In addition to the device 20 according to the invention, the vehicle 10 also has an augmented reality display device 30 for displaying information of a contact simulation. The augmented reality display device 30 in turn has a control device 31. The vehicle 10 also has a plurality of sensors 11, 12, from which the device 20 according to the invention can receive sensor data. These are internal sensors 11, 12. The sensor 11 is, for example, a speedometer, and the sensor 12 is, for example, a GPS sensor. In addition, the vehicle 10 has a plurality of data processing devices 13, 14, the output data of which are also received by the device 20 according to the invention. Here, the data processing device 13 corresponds to, for example, a navigation system, and the data processing device 14 corresponds to, for example, an input interface.

[0060] According to the present invention, Figure 2 The device 20 shown in FIG. 1 has an access interface 21 which is designed to receive data from sensors 11 , 12 and data processing devices 13 , 14 . The access interface 21 sends the received data to a control unit 24 according to the invention which has an internal memory 25 and a CPU 26 .

[0061] According to the invention, the control unit 24 is designed to determine the target operation and the operating point of the target operation, as specified in method step S1. For this purpose, the CPU 26 processes, for example, navigation information received by the access interface 21 from the navigation system 13. Alternatively, the CPU 26 processes the data of the access interface and the GPS sensor and determines the target operation and the operating point of the target operation with the help of map data stored in the internal memory 25. In addition, the control unit 24 according to the invention is designed to determine the display point and the fixed distance of the display point from the operating point, for which the control unit processes the sensor data of the GPS sensor and the speedometer to determine the display point based on the position of the vehicle and the speed of the vehicle.

[0062] The device 20 according to the present invention also has an image module 23, which is configured to generate a display element for contact simulation at the corresponding display point. Therefore, the image module 23 can communicate with the control unit 24. The image module 23 sends the display element generated at the corresponding display point to the output interface 22 according to the present invention. The output interface 22 is configured according to the present invention to output the display point and the display element corresponding to the display point to the augmented reality display device 30, so that the augmented reality display device can display the display point and the display element. To this end, the output interface communicates with the control device 31 of the augmented reality display device 30.

[0063] Reference Figure 3 , Figure 4and FIG. 5 , the invention is explained using an exemplary illustrated application of the method according to the invention.

[0064] exist Figure 3 1 shows a top view of a traffic situation of a vehicle 10 according to the invention. The vehicle 10 according to the invention is here on the road and is driving to a right-angle bend. Therefore, in the first step S1 of the method according to the invention, the target maneuver of the vehicle 10 is determined to be a right turn, which the vehicle 10 must perform in order to enter the bend at the location of the operating point 40 of the target maneuver. In the illustrated traffic situation, the vehicle 10 is at a variable distance 70 from the operating point 40, wherein, as shown in the figure, the distance is measured from the augmented reality display device 30. The display points 41, 42 determined in the second step S2 and the fourth step S4 of the method according to the invention are displayed on the road flat in the driving path of the vehicle. The first fixed distance 71 of the first display point 41 from the operating point 40 is greater than the second fixed distance 72 of the second display point 42, which results in a spacing 73 between the display points formed by the two distances 71, 72.

[0065] Figure 4 A traffic situation with a vehicle 10 according to the present invention is shown in a side view. In the situation shown here, the vehicle 10 according to the present invention having an augmented reality display device 30 has already passed a first display point 41. Therefore, only a second display point 42 is located on the road between the operating point 40 and the vehicle 10 at a distance 72 from the operating point 40. The augmented reality display device 30 is set to a projection angle 80 in order to display the second display element of the contact simulation so that it is perceived by the driver of the vehicle as being flat on the second display point 42. The projection angle 80 is variable because it depends on the speed of the vehicle 10 and thus on the variable distance 70 between the vehicle 10 and the operating point 40. In addition, the height 74 of the augmented reality display device 30 above the road is taken into account in the calculation of the projection angle. Figure 4 As can be seen in FIG. 8 , the projection angle is the arc tangent of the ratio of the difference between the variable spacing 70 and the fixed distance 72 to the height 74 .

[0066] 5 consists of four parts or sub-images, which are labeled a, b, c and d. Each sub-image presents a traffic situation from the perspective of a driver of a vehicle 10 according to the invention, wherein the traffic situation presented is identical, but at different times.

[0067] Figure 5aThe view of the driver of the vehicle 10 according to the invention on a road on which a target maneuver is to be performed at a distance of 200 meters, which target maneuver has been determined as a right turn in step S1 of the method according to the invention. A first display element 51 and a first distance indication 61 are shown on the driving path of the vehicle 10, which appear to be flat on the road. The display element 51 is formed by an arrow pointing to the right, which indicates the direction of the target maneuver. The arrow is not drawn continuously, but is formed by a plurality of polygons between which the road becomes visible, which advantageously prevents possible covering of traffic-related information by the display element. The distance indication 61 shows "150 meters", which is equal to the length of the first fixed distance 71 from the first display point 41 to the operating point 40. In other preferred embodiments of the method according to the invention, the distance indication can also be generated in such a way that it corresponds to the length of the variable distance 70 from the vehicle 10 to the operating point 40 or shows a part of a countdown.

[0068] exist Figure 5b The figure shows the difference between the driver's perspective and the Figure 5a The same traffic situation in FIG. 1 , at which time the vehicle 10 has already approached the operating point. The first display element 51 and the first distance indicator 61 appear to continue to be fixedly located at the first display point on the road, for which they are currently displayed larger and lower in the field of vision, which results in this three-dimensional impression.

[0069] In order to show that the first display element 51 and the first distance indication 61 are displayed at the first display point 41 without changing their positions, Figure 5a and Figure 5b In each case, the distance y from the first display point to the right-of-way sign is plotted. Due to the fixed position display of the contact-simulated display element 51 and the contact-simulated distance indicator 61, the vehicle 10 according to the invention moves forward, so that the distance remains unchanged. Figure 5b The distance y in appears larger because the vehicle 10 is currently closer to the displayed point.

[0070] In the next Figure 5c The driver's field of view is visible in the vehicle 10 Figure 5bAfter driving further towards the operating point 40. The first display element 51 and the first distance indication 61 are no longer visible now, because the vehicle 10 has already passed them. Instead, the second display element 52 and the second distance indication 62 are now visible, which still appear to be fixedly located on the road in the driving path of the vehicle 10. The second distance indication 62 shows the length of the second fixed distance 72 between the second display point 42 (where the second display element 52 and the second distance indication 62 appear to be located) and the operating point. This length is now only "100 meters" because, according to the invention, the second fixed distance 72 is smaller than the first fixed distance 71. Here, the checkpoint effect of the display elements 51, 52, which is advantageously produced by the invention, is shown again. The vehicle 10 has now passed the first display point 41, so that the driver's sight falls on the second display point 42 with the second display element 52, and he therefore feels that he is driving towards the second checkpoint after passing the first checkpoint. In the specific embodiment of the method according to the invention shown here, second display element 52 and therefore also second distance indication 62 are also displayed at the time when first display element 51 and therefore even first distance indication 61 are hidden.

[0071] Figure 5d The driver's field of vision is shown after the vehicle has moved further toward the operating point. The second display element 52 and the second distance indicator 62 still appear to be located in a fixed position at the second display point 42. This impression is created by the enlargement of the contact-simulated second display element 52 and the contact-simulated second distance indicator 62 and by the fact that the two contact-simulated displays 52, 62 are now displayed lower in the field of vision.

[0072] List of reference numerals:

[0073] S1 Method Step 1

[0074] S2 Method Step 2

[0075] S3 Method Step 3

[0076] S4 Method Step 4

[0077] S5 Method Step 5

[0078] S6 End

[0079] 1 Methods

[0080] 2 Options

[0081] 3 Options

[0082] 10 Vehicles

[0083] 11 Speedometer

[0084] 12 GPS sensor

[0085] 13 Navigation System

[0086] 14 Input Interface

[0087] 20 Installation

[0088] 21 Enter the interface

[0089] 22 Output Interface

[0090] 23 Image Module

[0091] 24 Control Unit

[0092] 25 Internal Memory

[0093] 26 CPU

[0094] 30 Augmented reality display device

[0095] 31 Control Equipment

[0096] 40 operating points

[0097] 41 First display point

[0098] 42 Second display point

[0099] 51 first display element

[0100] 52 Second display element

[0101] 61 First distance indication

[0102] 62 Second distance indicator

[0103] 70 Variable Spacing

[0104] 71 First fixed distance

[0105] 72 Second fixed distance

[0106] 73 Interval

[0107] 74 Height

[0108] 80 projection angle

[0109] y distance

Claims

1. A method (1) for preparing a navigation operation of a vehicle (10) by controlling a contact-simulated display of navigation information of an augmented reality display device (30), comprising the steps of: (S1) determining a target operation and an operation point (40) of the target operation; (S2) determining a first display point (41) having a first fixed distance (71) from an operating point (40) on a travel path traveled by the vehicle (10); (S3) generating and outputting a first display element (51) for displaying a contact simulation at a first display point (41) via an augmented reality display device (30); (S4) determining a second display point (42) having a second fixed distance (72) from an operating point (40) on a travel path traveled by the vehicle (10); and (S5) generating and outputting a second display element (52) for displaying a contact simulation at a second display point (42) via the augmented reality display device (30); wherein a first fixed distance (71) is determined using the speed of the vehicle (10) and the position of the vehicle, wherein the first fixed distance determined in a high speed situation is greater than in a lower speed situation, wherein the second fixed distance (72) is smaller than the first fixed distance (71), The first display element (51) is output in a first time period, and the second display element (52) displayed at a second display point (42) at a second fixed distance (72) from the operating point (40) is output in a second time period at least partially located after the first time period.

2. The method (1) according to claim 1, wherein: A plurality of display points (41, 42) having corresponding fixed distances (71, 72) from an operating point (40) are determined, and corresponding contact-simulated display elements (51, 52) are generated and output, wherein the display points (41, 42) have predetermined intervals (73) relative to each other.

3. The method (1) according to any one of the preceding claims, further comprising the steps of: determining a variable spacing (70) between the operating point (40) and the vehicle (10); and A projection angle (80) is determined for each display element (51, 52) based on the determined spacing (70) and a corresponding fixed distance (71, 72) from the operating point (40).

4. The method (1) according to claim 3, wherein: A variable distance (70) of the vehicle (10) is determined as a function of at least one position and at least one speed of the vehicle (10).

5. The method (1) according to claim 3, wherein: Each display element (51, 52) is displayed at a projection angle (80) equal to a predetermined first limit angle and is hidden at a projection angle (80) equal to a predetermined second limit angle.

6. The method (1) according to claim 1, wherein: A distance indication (61, 62) corresponding to a respective fixed distance (71, 72) from an operating point (40) is output for each display element (51, 52).

7. A device (20) for the method (1) according to any one of claims 1 to 6, comprising: Constructing an input interface (21) for receiving data; and A control unit (24) configured to determine a target operation and an operation point (40) of the target operation, determine at least one first display point (41) having a first fixed distance (71) from the operation point (40), and determine at least one second display point (42) having a second fixed distance (72) from the operation point (40); and A graphics module (23) configured to generate at least one first display element (51) for contact simulation at the first display point (41) and to generate at least one second display element (52) for contact simulation at the second display point (42); and An output interface (22) is configured to output display points (41, 42) displayed by an augmented reality display device (30) and display elements (51, 52) corresponding to contact simulations of the display points (41, 42).

8. A vehicle (10) having an augmented reality display device (30) having a display element provided for displaying a contact simulation and having a device (20) according to claim 7.

9. A computer-readable storage medium comprising instructions which, when executed by a computer, cause the computer to implement the method (1) according to any one of claims 1 to 6.

Citation Information

Patent Citations

  • Contact-analog display, especially of a lane change

    DE102012216144A1

  • Method, device and computer-readable storage medium with instructions for controlling a display of an augmented reality display device for a motor vehicle

    DE102018203927A1

  • A method of operating a head-up display and a head-up display device

    CN107128313A

  • Device for providing navigation information for driver of vehicle, displays numerical instructions of distance of determined display location to driving maneuver to driver of vehicle such that instructions are provided in certain location

    DE102012215038A1