Method for presenting virtual elements

Abstract

The invention relates to a method for presenting at least one virtual element (10) in a display area (12) of at least one display device (14) of a vehicle. The method for presenting a virtual element (10) in a display area (12) of the display device (14) can be implemented in the following way: the virtual element (10) is constructed from at least one first virtual sub-element (20) and at least one second virtual sub-element (22), wherein the first virtual sub-element (20) is arranged in the display area in a perspective manner in front of the second sub-element (22).

Description

Technical Field

[0001] The present invention relates to a method for presenting at least one virtual element in a display area of ​​at least one display device of a vehicle, wherein a three-dimensional space is presented in the display area of ​​the display device, wherein three-dimensional coordinates for positioning the at least one virtual element in the presented three-dimensional space are determined based on at least one data source, wherein the at least one virtual element is transformed as a two-dimensional image into the three-dimensional space presented in the display area of ​​the display device, and wherein the at least one virtual element is presented in the display area of ​​the display device in a driver's field of vision accurately with respect to the three-dimensional space perspective.

[0002] At the same time, the invention relates to a device for presenting at least one virtual element, the device having at least one display device with at least one display area.

[0003] The invention also relates to a vehicle having a device for presenting at least one virtual element. Background Art

[0004] As virtual and augmented reality technologies and applications continue to develop, they are also entering automobiles. Augmented Reality (AR) is the enrichment of the real world with virtual elements that are accurately registered or positioned in three-dimensional space and allow real-time interaction. Head-Up Display (HUD) provides a possible technical implementation solution for enriching the cockpit with corresponding perspective-accurate virtual augmentation.

[0005] In the case of head-up displays, a virtual display is formed by an imaging unit, such as a TFT display, integrated in the instrument panel. The image is deflected via a plurality of mirrors in the direction of the windshield, where the light is reflected into the driver's eyes. The driver perceives the image as a virtual display in the field of vision. In the design of such systems, the area into which the light is reflected is spatially limited in order to achieve a higher brightness due to less light scattering. This area is referred to as the "EyeBox" because the driver's field of vision must be located within this area in order to be able to perceive the virtual image.

[0006] A major problem with head-up displays is that virtual 3D elements located in three-dimensional space must be presented on a 2-dimensional display. This results in these virtual elements not being perceived by the observer as part of the surroundings. Due to the design of the virtual image plane, lines extending forward as an extension of the surroundings on the road may not be perceived as lying on the roadway in part, but as standing up and extending upwards. This perception error is referred to below as the slope effect. In order to reduce this slope effect, human depth perception must be taken into account.

[0007] For example, DE 112017006054 T5 shows a system for presenting virtual elements on a head-up display, wherein the device for presenting virtual elements on a display area of ​​the head-up display has an optical axis, which includes different image realization areas, so that the images presented on the display area have different virtual distances, so that the observer experiences different depth perceptions of these virtual elements.

[0008] A disadvantage is that, when the image distance is increased, more installation space is required for the display device in order to improve the depth perception.

[0009] US 2011 / 0102303 A1 shows a method for presenting virtual elements in the form of turning instructions that gradually predict turning maneuvers as a function of distance. These turning instructions are presented as virtual elements in the driver's field of vision at distances of 90 m, 60 m and 30 m before the turn, for example, and are presented perspectively, if possible. However, there is the risk of the above-mentioned slope effect occurring. Summary of the invention

[0010] The object of the present invention is now to specify a method for displaying virtual elements, a corresponding device and a vehicle, in which the depth perception of the virtual elements within the display area of ​​the display device is improved.

[0011] In the present invention, this object is firstly achieved by forming a virtual element from at least one first virtual subelement and at least one second virtual subelement, wherein the first virtual subelement is arranged perspectively in front of the second subelement in the display area.

[0012] The display area of ​​the display device can be a display in the center area or in the cockpit area, for example in the instrument cluster of the vehicle. Alternatively or additionally, the display area of ​​the display device can be designed as a head-up display. A head-up display is to be understood as a display area in which the driver can maintain his head posture or viewing direction because the information is projected into his field of vision, for example onto the windshield of the vehicle.

[0013] The three-dimensional space presented can preferably describe an area outside the vehicle in the direction of travel. In the case of a head-up display, the display area or three-dimensional space of the display device can be equated with the field of vision through the windshield. The three-dimensional space is then therefore the space in front of the vehicle that is in the field of vision of the driver or co-driver. The corresponding three-dimensional coordinates calculated for the virtual elements can be, for example, Cartesian coordinates.

[0014] The data sources required for calculating these coordinates can be of different types. Preferably, these data sources are vehicle data or navigation data, which are recorded by a positioning sensor device of the vehicle, such as a GPS, a rotation speed sensor or a camera.

[0015] The virtual elements can be different graphic elements and / or buttons, which are presented in the display area of ​​the display device. The virtual elements can have a link to vehicle data and / or depend on the driving characteristics of the vehicle. These data can come from existing driver assistance systems, for example. However, it is also conceivable that the presented virtual elements are not important for the driving characteristics of the vehicle.

[0016] These virtual sub-elements are put together to obtain the entire virtual element. By dividing the virtual element, these sub-elements can be designed differently in order to make the depth perception as realistic as possible for the observer or the driver of the vehicle.

[0017] Further preferred embodiments of the invention result from the remaining features mentioned in the following description.

[0018] For this purpose, a first embodiment of the method according to the invention provides that the first virtual sub-element and the second virtual sub-element are presented with a depth extension, so that the virtual elements are presented smaller and higher as the distance increases in the display area of ​​the display device. In the case of a perspective presentation, the elements presented in the background are usually smaller than the elements in the foreground. That is, a line presented in the display area, which is intended to represent the edge of a lane, for example, can be presented in perspective, so that the virtual sub-elements through which the line is presented gradually reduce their size. In this case, no ramp effect occurs, because the driver has the impression that the line extends into the image plane.

[0019] In another advantageous embodiment of the method according to the invention, it is provided that the first virtual sub-element and the second virtual sub-element have a texture gradient. In this way, in the case of these virtual sub-elements, sub-elements further away in the background can be provided with a different texture than virtual sub-elements further away in the foreground. Thus, a more realistic depth perception can be generated.

[0020] Alternatively or additionally, in another embodiment of the method according to the present invention, it is provided that the first virtual sub-element and the second virtual sub-element have a sharpness gradient. Similar to the above-described embodiment, virtual sub-elements that are farther away in the background may have a higher degree of blurriness than virtual sub-elements that are farther away in the foreground, thereby generating a more realistic depth perception for the driver of the vehicle. Depending on the distance of the three-dimensional object, it may also be reasonable for closer objects in the foreground to have a lower sharpness than three-dimensional objects that are farther away in the background when the distance is small. A combination of the two embodiments is also possible. For this purpose, at least three virtual sub-elements are required, wherein the front virtual sub-element and the rear virtual sub-element each have a higher degree of blurriness than the middle virtual sub-element.

[0021] Likewise alternatively or additionally, in another embodiment of the present invention, it is provided that the first virtual element and the second virtual element have a brightness gradient. Correspondingly, the virtual sub-element further away in the background can have a lower brightness than the virtual sub-element further away in the foreground, in order to design the depth perception to be more realistic for the driver of the vehicle.

[0022] In another embodiment of the method according to the present invention, at least one third virtual sub-element is provided. The third virtual sub-element is arranged perspectively behind the second sub-element in the display area. The first virtual sub-element has a first spacing from the second virtual sub-element, wherein the second virtual sub-element has a second spacing from the third virtual sub-element. The first spacing is greater than the second spacing. The farther the virtual sub-elements are perspectively in the background, the closer they are to each other in order to improve the depth perception of the driver of the vehicle.

[0023] In a preferred embodiment of the invention, the quality of the geometrically accurate presentation of the virtual element is checked as a function of the visual quality of the virtual element for the driver of the vehicle.

[0024] Furthermore, a particularly preferred embodiment of the method according to the invention provides that the quality of the geometrically accurate representation of the virtual element is reduced if the visual quality of the virtual element reaches a predetermined limit value. Depending on the viewing angle of the observer, a perspective-accurate representation can result in the spacing between the virtual sub-elements becoming smaller, so that these virtual sub-elements are no longer perceptible and the sub-objects overlap in the subjective perception.

[0025] The invention therefore provides that in this case 100 percent geometric accuracy is abandoned for a higher visual quality. In this case, this means that instead of keeping the spacing between the sub-objects constant over the entire length of the line, the spacing is increased with increasing distance in three-dimensional space just to the extent that the spacing remains perceptible and the reduction of the spacing also remains perceptible over the entire length.

[0026] The above object is also achieved by a device according to the invention in that the display device is designed to carry out the method according to the invention. The above statements regarding the method according to the invention also apply correspondingly to the device according to the invention.

[0027] The device may be, for example, a navigation system which enables the device according to the invention to implement a graphical output of elements of the contact simulation.

[0028] The above object is also achieved by a vehicle according to the invention having a device for presenting at least one virtual element, wherein the device is designed according to the invention. The above statements regarding the device according to the invention also apply correspondingly to the vehicle according to the invention.

[0029] Unless otherwise indicated in individual cases, the various embodiments of the invention mentioned in this application can be advantageously combined with one another. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] The present invention is then explained in an exemplary embodiment with reference to the accompanying drawings.

[0031] Figure 1 schematically shows the presentation of virtual elements for contact simulation as known from the prior art; and

[0032] Figure 2 The presentation of virtual elements of a contact simulation according to an embodiment of the method of the invention is schematically shown. DETAILED DESCRIPTION

[0033] Figure 1 The conventional prior art presentation of a virtual element 10 in a display area 12 of a display device 14 is shown. In this case, a three-dimensional space 16 is presented in the display area 12 of the display device 14. In this embodiment, the display device is a head-up display. Based on at least one data source, three-dimensional coordinates for positioning at least one virtual element 10 in the presented three-dimensional space 16 are determined.

[0034] Next, the virtual elements 10 are transformed as two-dimensional images 18 into the three-dimensional space 16 presented in the display area 12 of the display device 14. The virtual elements 10 are then presented in the display area 12 of the display device 14 in the driver's field of vision in a perspective-accurate manner relative to the three-dimensional space 16. In the present example, two virtual elements 10 are displayed in the form of lines as the boundaries of the roadway.

[0035] In the case of the presentation of perspectively accurately presented elements, the main problem is that virtual elements 10 located in the three-dimensional space 16 must be presented on the 2-dimensional display area 12. This has the result that these virtual elements 10 are partially not perceived by the observer as part of the surrounding environment. Figure 1 In the embodiment of the present invention, the lines lying on the road and extending forwards are intended to expand the surrounding environment to visualize the lane. However, due to the design of the virtual image plane, these lines cannot be perceived as lying on the lane in part, but are perceived as standing and extending upwards due to the slope effect.

[0036] Figure 2 The diagram shows an embodiment of the method according to the invention, in which the disadvantages of the prior art are avoided. In principle, it is possible to improve the depth perception by means of a stereo imager. With the aid of a stereo imager, it is possible to generate two separate images for the two eyes. As a result, a 3D image is perceived. However, in the case of stereoscopic displays, an accommodation convergence conflict occurs, which can, for example, cause headaches. This effect is often observed, for example, in 3D cinemas.

[0037] exist Figure 2 In the representation, the virtual element 10 is divided into virtual sub-elements 20, 22, 24. Here, the first virtual sub-element 20 is arranged perspectively in front of the second virtual sub-element 22, wherein the third virtual sub-element 24 is arranged perspectively behind the second virtual sub-element 22. In this representation, other virtual sub-elements are also provided.

[0038] By dividing the virtual element 10 into virtual sub-elements 20, 22, 24, the virtual sub-elements 20, 22, 24 can be provided with texture gradients, for example, which can improve the depth perception of these virtual elements. In this case, the first virtual sub-element 20 has a first spacing 26 from the second virtual sub-element 22. The second virtual sub-element 22 has a second spacing 28 from the third virtual sub-element 24. The first spacing 26 is greater than the second spacing 28. Therefore, the farther two virtual sub-elements are arranged in perspective in the background, the smaller the spacing between these virtual sub-elements, thereby improving the depth perception.

[0039] However, depending on the viewing angle of the observer, a perspective-accurate presentation may also result in the spacing 26, 28 between the virtual sub-elements 20, 22, 24 becoming smaller, so that these virtual sub-elements are no longer perceptible and these virtual sub-elements 20, 22, 24 overlap in subjective perception. Therefore, in this embodiment of the method, it is provided that in this case, 100 percent geometric accuracy is abandoned for a higher visual quality. In this case, this means that instead of keeping the spacing 26, 28 between the sub-objects constant over the entire length of the line, these spacings are increased with increasing distance in the three-dimensional space 16 just to the extent that these spacings 26, 28 remain perceptible and the reduction of these spacings 26, 28 also remains perceptible over the entire length.

[0040] In this embodiment, it is additionally provided that the virtual sub-elements 20, 24, 28 and / or the virtual element 10 as a whole have a depth extension, so that the virtual element 10 can be presented smaller and higher as the distance increases in the display area 12 of the display device 14. It is also provided that the virtual sub-elements 20, 24, 28 and / or the virtual element 10 as a whole are provided with a sharpness gradient, which enables the virtual elements 10 to be presented more diffusely the further away they are from a perspective. It is also provided that the virtual sub-elements 20, 24, 28 and / or the virtual element 10 as a whole have a brightness gradient, which enables the virtual elements 10 to be presented darker the further away they are from a perspective.

[0041] Reference numerals list

[0042] 10 Virtual Elements

[0043] 12 Display area

[0044] 14 Display device

[0045] 16 Three-dimensional space

[0046] 18 2D images

[0047] 20 First virtual child element

[0048] 22 Second virtual child element

[0049] 24 The third virtual child element

[0050] 26 First spacing

[0051] 28 Second spacing.

Claims

1. A method for presenting at least one virtual element (10) in a display area (12) of at least one display device (14) of a vehicle, wherein a three-dimensional space (16) is presented in the display area (12) of the display device (14), wherein three-dimensional coordinates for positioning the at least one virtual element (10) in the presented three-dimensional space (16) are determined based on at least one data source, wherein the at least one virtual element (10) is transformed as a two-dimensional image (18) into the three-dimensional space (16) presented in the display area (12) of the display device (14), and wherein the at least one virtual element (10) is perspectively accurately positioned in the display area (12) of the display device (14) relative to the three-dimensional space (16). The invention relates to a virtual element (10) comprising at least one first virtual sub-element (20), at least one second virtual sub-element (22) and at least one third virtual sub-element (24), wherein the first virtual sub-element (20) is arranged perspectively in front of the second virtual sub-element (22) in the display area, wherein the third virtual sub-element (24) is arranged perspectively behind the second virtual sub-element (22) in the display area, wherein the first virtual sub-element (20) has a first spacing from the second virtual sub-element (22), wherein the second virtual sub-element (22) has a second spacing from the third virtual sub-element (24), wherein the first spacing is greater than the second spacing, in, Instead of keeping the spacing between these virtual sub-elements constant throughout the length of the line, these spacings are increased with increasing distance in said three-dimensional space (16) just to the extent that these spacings remain perceptible and the reduction in these spacings also remains perceptible throughout the length, The virtual element (10) is presented in the form of a lane boundary. Wherein, the first virtual sub-element (20) and the second virtual sub-element (22) have a first sharpness gradient, so that the first virtual sub-element (20) has a lower sharpness than the second virtual sub-element (22), and wherein the second virtual sub-element (22) and the third virtual sub-element (24) have a second sharpness gradient, so that the third virtual sub-element (24) has a lower sharpness than the second virtual sub-element (22).

2. The method according to claim 1, characterized in that The first virtual sub-element (20) and the second virtual sub-element (22) are presented with depth stretching, so that the virtual element (10) is presented smaller and higher within the display area (12) of the display device (14) as the distance increases.

3. The method according to claim 1 or 2, characterized in that: The first virtual sub-element (20) and the second virtual sub-element (22) have a texture gradient.

4. The method according to claim 1 or 2, characterized in that: The first virtual sub-element (20) and the second virtual sub-element (22) have a brightness gradient.

5. The method according to claim 1 or 2, characterized in that: The quality of the geometrically accurate presentation of the virtual element (10) is checked based on the visual quality of the virtual element (10) for a driver of the vehicle.

6. The method according to claim 5, characterized in that If the visual quality of the virtual element (10) reaches a predetermined limit value, the quality of the geometrically accurate presentation of the virtual element (10) is reduced.

7. A device for presenting at least one virtual element (10), the device having at least one display device (14) with at least one display area (12), characterized in that: The display device (14) is designed to carry out the method according to any one of claims 1 to 6.

8. A vehicle having a device for presenting at least one virtual element (10), characterized in that The device is designed according to claim 7.

Images