SYSTEM, VEHICLE AND METHOD FOR MULTI-DEPTH AUGMENTED REALITY DISPLAY

The imaging system addresses HUD limitations by generating multi-depth virtual images with flexible installation, enhancing clarity and reducing clutter and installation complexity.

DE112017006054B4Active Publication Date: 2026-02-19CAMBRIDGE ENTERPRISE LTD +1
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
DE112017006054
Authority / Receiving Office
DE · DE
Patent Type
Patents
Current Assignee / Owner
Priority Date
2016-11-30
Filing Date
2017-11-29
Publication Date
2026-02-19
Estimated Expiration
2037-11-29

AI Technical Summary

Technical Problem

Existing head-up displays (HUDs) in vehicles are limited by fixed image depth, leading to clutter and reduced efficiency due to equal emphasis on all information, and face installation challenges in confined spaces with associated costs.

Method used

An imaging system with selectively switchable image realization surfaces at varying distances from the focal point of projection optics, allowing multi-depth virtual image generation and flexible installation.

Benefits of technology

Enables clear, efficient display of multiple depth levels, reducing clutter and optimizing space usage while minimizing component count and installation complexity.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

Imaging system (100) for generating virtual images (1001-1003) with multiple depths on a screen (900), wherein the imaging system (100) comprises: an image realization device (300) for generating a source image (501 - 503), Projection optics (800) for displaying a display image (1001-1003) on the screen (900), wherein the display image is a virtual image corresponding to the source image, wherein the projection optics (800) has an optical axis (810), and wherein the image realization device (300) comprises: a first image realization surface (310) at a first distance along the optical axis (810) from the focal point of the projection optics (800), a second image realization surface (320) at a second different distance along the optical axis (810) from the focal point of the projection optics (800), where the first (310) and second (320) image realization surfaces overlap at least partially, and wherein each of the first and second image realization surfaces (310, 320) comprises a plurality of independently controlled areas, each area being selectively switchable between a transparent state and an image realization state, so that the source image (501-503) can be selectively formed on an area of ​​the first (310) or second (320) image realization surface and projected through the projection optics (800), thereby rendering the display image (1001-1003) on the screen in a first or second apparent depth.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL AREA

[0001] The present disclosure relates to a 3D augmented reality display system, a vehicle comprising the system, and a method for generating virtual images. In particular, but not exclusively, the disclosure relates to a device for generating and projecting multi-depth images onto a display, such as a windshield, for use in a vehicle. Aspects of the invention relate to a device for projecting multi-depth or 3D images onto a windshield. BACKGROUND

[0002] Heads-up displays (HUDs) are well-known displays that project images onto a transparent surface, such as a windshield. Such displays are common in a variety of environments, including vehicles.

[0003] Automotive head-up displays (HUDs) project information about vehicle conditions (speed, etc.) or navigation onto the windshield. These displays are typically limited in size and project the image at a fixed depth to the user. Due to this limited size, the HUD can become cluttered with information that is less relevant to the user. Furthermore, because the image has a fixed depth, all information presented to the user is equally emphasized. This further reduces the efficiency of such displays.

[0004] DE 10 2015 205 871 A1 concerns projection devices for projecting information onto an area of ​​a windshield in a motor vehicle. In particular, DE 10 2015 205 871 A1 concerns so-called head-up display devices and measures for providing depth information for such head-up display devices.

[0005] US 2002 / 0163482A1 concerns three-dimensional (3D) imaging, specifically a multiplanar display system that uses a variety of liquid crystal shutters containing nematic liquid crystals with polymer-stabilized cholesteric textures. These mixtures have optical properties that allow 3D images generated on these shutters to be viewed from a wide viewing angle without turbidity.

[0006] Another consideration is that vehicles typically have limited physical space for installing such systems. Typically, these systems must be integrated into existing spaces within the vehicle or installed in the smallest possible space to minimize the need to remove and reinstall existing components. Furthermore, the introduction and installation of such systems involve costs. SUMMARY OF THE INVENTION

[0007] Aspects and embodiments of the invention constitute a device as claimed in the attached claims.

[0008] According to one aspect of the invention, an imaging system for generating multi-depth virtual images on a screen is provided, wherein the imaging system comprises: an image realization device for forming a source image, a projection optic for reproducing a display image on the screen, wherein the display image is a virtual image corresponding to the source image, wherein the projection optic has an optical axis, and wherein the image realization device comprises: a first image realization surface at a first distance along the optical axis from the focal point of the projection optic, a second image realization surface at a second different distance along the optical axis from the focal point of the projection optic, wherein the first and second image realization surfaces at least partially overlap, and wherein each of the first and second image realization surfaces comprises a plurality of areas.wherein each area is selectively switchable between a transparent state and an aspect ratio state, so that the source image can be selectively formed on an area of ​​the first or second image realization surface and projected through the projection optics, which reproduces the display image on the screen of the display in a first or second apparent depth.

[0009] Optionally, at least one of the first and second image realization surfaces can be moved along the optical axis of the projection optics. By providing an additional range of motion along the optical axis, the distance at which the real image is formed from the focal point of the projection optics can be controlled more precisely.

[0010] Optionally, at least one of the first and second image realization surfaces can be rotated / tilted relative to the optical axis of the projection optics. Introducing a tilt into the image realization surface allows images formed on different parts of the surface to lie within a continuous area at varying distances from the focal point of the projection optics. This controlled deformation of the image realization surface thus increases the available area and the resolution of the virtual image depths.

[0011] Optionally, the screen can display a head-up display.

[0012] Optionally, the first and second image realization surfaces can comprise multiple areas, with each area selectively switchable between the transparent state and the image realization state. This allows a single image realization layer to create multiple images and image configurations simultaneously.

[0013] The state of image realization can be a diffuse state.

[0014] Optionally, at least one of the first and second image rendering surfaces is capable of generating the source image. This eliminates the need for external image generation and results in a compact system with fewer components.

[0015] Optionally, at least one of the first and second image realization surfaces comprises an electroluminescent layer. Such layers can be activated by applying current, which can be localized and modulated as desired.

[0016] Optionally, at least one organic light-emitting diode is included for the first and second image display areas. These can be used for a flexible, multi-color display.

[0017] Alternatively, the imaging system includes an image generation unit for producing the source image to be rendered as a display image on the screen and for projecting the source image onto at least one of the first and second image realization surfaces. The image generation unit can account for predictable image distortions or degradation within the system and project a corrected image to ensure the quality of the final virtual image. Furthermore, the images produced by the image generation unit will typically propagate with distance, so that the images formed closer to the image generation unit (and further from the projection optics) become smaller. This compensates for a magnification effect in the projection optics, ensuring that all virtual images are displayed on the screen at a constant size, regardless of the distance at which the corresponding real images were formed on the image realization surface.

[0018] Optionally, the image realization state of at least one of the first and second image realization surfaces is an optically diffuse state. This creates a surface on which the images of the image generation unit can be selectively captured and formed.

[0019] Optionally, the image generation unit includes a holographic unit for generating computer-generated holograms for projection onto the diffuser.

[0020] Optionally, the image generation unit includes a light field unit for generating 3-dimensional bright-field images for formation on at least one image realization surface.

[0021] The projection of 3-dimensional images by the imaging system makes it possible to display such images with correspondingly different depths on the screen in order to create a convincing representation of a real object.

[0022] Optionally, the system also includes a driver, the driver being configured to selectively switch the at least one image realization surface between the diffuse or transparent state.

[0023] Optionally, the image generation unit includes a laser and the driver is configured to work synchronously with the laser.

[0024] Optionally, the driver can be configured to work synchronously with the holographic unit.

[0025] Optionally, the driver can be configured to work synchronously with the light field unit.

[0026] By synchronizing the control of the state of the image realization surface with the image generation unit, the image generation unit can be controlled so that images are projected only onto the image-generating areas of the image realization surfaces.

[0027] Optionally, the image generation unit, image processing device, and projection optics are arranged along the optical axis of the imaging system. This eliminates the need for deflection optics, which would otherwise complicate the imaging system and increase its overall weight and size.

[0028] Optionally, the image generation unit also includes the focusing optics. This allows for additional fine-tuning or necessary redirection of the resulting virtual images on the screen.

[0029] Optionally, the imaging system also includes a third image realization surface. This further expands the range of available virtual image depths.

[0030] Optionally, it is also possible to use the described invention as a virtual reality system in scenarios where no transparent screen is available.

[0031] Optionally, each image realization area can be a different size and does not need to overlap all other image realization areas. This allows the image processing device to find any necessary arrangement dictated by the requirements and constraints of the respective application.

[0032] Optionally, the imaging system also includes an ambient light sensor configured to adjust the brightness of the displayed virtual images. This sensor provides feedback to either the image generation unit or the image generation layer to increase or decrease the brightness of the real images, thus adjusting the brightness of the corresponding virtual image as needed.

[0033] Optionally, the imaging system can be activated and deactivated both automatically and by human input. This allows the imaging system to activate itself when relevant information is available or requested by a user.

[0034] According to another aspect of the invention, a vehicle is provided which includes an imaging system as described in the preceding aspects.

[0035] According to a further aspect of the invention, a method for generating virtual images with multiple depths on a screen is described, wherein the method comprises: forming a source image with an image processing device, reproducing a display image on the screen via a projection optic with an optical axis, wherein the display image is a virtual image corresponding to the source image and wherein the image processing device comprises: a first image realization surface at a first distance along the optical axis from the focal point of the projection optic, a second image realization surface at a second different distance along the optical axis from the focal point of the projection optic, wherein the first and second image realization surfaces at least partially overlap, and wherein each of the first and second image realization surfaces comprises a plurality of areas.wherein each area is selectively switchable between a transparent state and an image realization state, so that the source image can be selectively formed on an area of ​​the first or second image realization surface and projected through the projection optics, which reproduces the display image on the screen of the display in a first or second apparent depth.

[0036] According to a further aspect of the invention, an imaging system for generating a virtual image with multiple depths on a head-up display screen is provided, wherein the imaging system comprises an image realization device for realizing a first image, a projection optic for reproducing a second image on the head-up display screen, wherein the second image is a virtual image corresponding to the first image, wherein the projection optic has an optical axis, and wherein the image realization device comprises a first image realization surface at a first distance along the optical axis from the focal point of the projection optic, and a second image realization surface at a second different distance along the optical axis from the focal point of the projection optic, wherein the first and second image realization surfaces overlap at least partially.and wherein at least a part of each image realization surface is switchable between a transparent state and an image realization state, so that the first image can be selectively realized on the first or second image realization surface and projected through the projection optics, which reproduces the second image on the screen of the head-up display in a first or second apparent depth.

[0037] According to a further aspect of the invention, an imaging system for generating a virtual image with multiple depths on a screen is provided, wherein the imaging system comprises an image realization device for realizing a first image, a projection optic for reproducing a second image on the screen, wherein the second image is a virtual image corresponding to the first image, wherein the projection optic has an optical axis, and wherein the image realization device comprises a first image realization surface at a first distance along the optical axis from the focal point of the projection optic, a second image realization surface at a second different distance along the optical axis from the focal point of the projection optic, wherein the first and second image realization surfaces overlap at least partially.and wherein at least a part of each image realization surface is switchable between a transparent state and an image realization state, so that the first image can be selectively realized on the first or second image realization surface and projected through the projection optics, which reproduces the second image on the screen in a first or second apparent depth.

[0038] Within the scope of this application, it is expressly provided that the various aspects, embodiments, examples, and alternatives set forth in the preceding paragraphs, in the claims, and / or in the following descriptions and drawings, and in particular their individual features, may be adopted independently or in any combination. That is to say, all embodiments and / or features of an embodiment may be combined in any way and / or combination, unless these features are incompatible. The applicant reserves the right to amend an originally filed claim or to file a new claim accordingly, including the right to amend an originally filed claim to be dependent on another claim and / or to include a feature of another claim, even if it was not originally claimed in this manner. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] One or more embodiments of the invention will now be described by way of example only with reference to the accompanying drawings, in which: Fig. is a schematic representation of the device according to one aspect of the invention; Fig. is a schematic representation of a stacked diffuser image realization unit; Fig. is a schematic representation of an image-generating image realization unit; Fig. is a flowchart of the process for generating the image to be rendered on the head-up display screen; Fig. is a schematic representation of the device according to one aspect of the invention; Fig. is a schematic representation of the device according to one aspect of the invention; Fig. is a schematic representation of the device according to one aspect of the invention; and Fig. is a vehicle according to one embodiment of the invention. DETAILED DESCRIPTION

[0040] In one aspect of the invention, the device and the display are installed in a vehicle, such as a motor vehicle. While the following description refers to a head-up display (HUD) of a motor vehicle, the disclosures and concepts described herein apply to other forms of HUDs (e.g., those installed on other vehicle shapes or wearable platforms such as helmets or goggles) as well as to displays in general.

[0041] In particular, but not exclusively, the disclosure relates to a device for generating and projecting multidimensional 3D augmented reality images onto a screen, such as a windshield, when installed for use in confined spaces, such as a vehicle that can be operated on land (on / off-road or track), under or above sea, in the air, or in space. Examples include, but are not limited to, cars, buses, trucks, excavators, heavy-duty exoskeleton suits, motorcycles, trains, theme park rides; submarines, ships, boats, yachts, jet skis for marine vessels; airplanes, gliders for airplanes, spacecraft, and shuttles for spacecraft. Furthermore, the technology can be integrated into a mobile platform, such as a head / eye protection device for drivers / operators, like a helmet or goggles.Therefore, any activity that requires the wearing of protective helmets / goggles can benefit from this technology. This includes, but is not limited to, motorcyclists / cyclists, skiers, astronauts, exoskeleton operators, military personnel, miners, divers, and construction workers. Furthermore, it can be used in a standalone environment for game consoles, arcade machines, and, in combination with an external 2D / 3D display, as a simulation platform. It can also be used in institutions and museums for educational and entertainment purposes.

[0042] Fig. Figure 1 shows an imaging system 100 consisting of an image generation unit 200 with a projection axis 210. The image generation unit 200 projects light onto the image realization device 300. Source images, e.g., real images 501-503, are formed in the image realization device 300 and then directed by a projection optic 800 with the optical axis 810 onto the screen 900 of the head-up display to generate display images.

[0043] The path of light from the image generation unit 200, via the image realization device 300 and the projection optics 800, to the screen 900 of the head-up display is referred to as the optical path. A person skilled in the art would understand that any number of intermediate reflectors / lenses or other optical components can be placed along the optical path between the image generation unit 200, the image realization device 300, and the projection optics 800 to manipulate the optical path as needed (e.g., to minimize the overall size of the imaging system 100). Such a folding of the optical path to minimize the size of the system is advantageous in embodiments where the device is installed in a motor vehicle, where space is typically limited.

[0044] In use, the real images 501-503 are formed in the image realization device 300 at different distances from the focal point of the projection optics 800, so that each real image 501-503 results in a virtual image 1001-1003 with a different focus (or a different perceived depth) that is visible on the screen 900 of the head-up display.

[0045] Fig. shows an embodiment of an image realization device 300, which in conjunction with the in Fig. The device shown is used.

[0046] In Fig. The image realization device 300 is shown, wherein the image realization device has three image realization surfaces 310, 320, 330. In the Fig. In the illustrated embodiment, the image realization surfaces 310, 320, 330 are arranged planarly and distributed along the projection axis 210. Each image realization surface 310, 320, 330 is centered on the projection axis 210 and runs perpendicular to it. Therefore, the image processing surfaces are, as shown in Fig. shown, arranged so that they are aligned along the projection axis 210.

[0047] The in Fig. The illustrated and detailed embodiment is taught with respect to three image realization surfaces. A person skilled in the art would understand that the exact number of image realization surfaces 310, 320, 330 is not limited to three, but can be any number. Likewise, the surfaces do not need to be perfectly aligned along the optical path as shown, but can overlap only partially or completely. As explained below, it is the use of spaced-apart realization surfaces that makes it possible to selectively generate the image on a specific surface, thereby changing the distance from the focal point of the projection optics and enabling the image to be displayed at different perceived depths on the HUD. This also allows for the simultaneous display of different images at different perceived depths.In the case where each image corresponds to a section of a specific object, the object can be designed to appear as 3D on the HUD. Accordingly, the invention offers a higher degree of flexibility and control with respect to the apparent depth of the projected images by not only controlling a general apparent depth but also allowing the apparent depth of each subsection of an image to be varied independently.

[0048] In one embodiment, each of the image realization surfaces 310, 320, 330 is an optical diffuser with a plurality of areas 401-403. Each area of ​​each image realization device is controllably switchable between a first transparent state and a second optically diffuse state, wherein the transparent areas 401-403 are defined by the shaded areas. Fig. In one embodiment, the degree of transparency and diffusivity of a specific region in the respective transparent or optically diffuse state can be controlled, so that a specific degree of transparency or diffusivity can be achieved. In further embodiments, any number of areas can be used, which together can form the entirety or only a part of an image realization surface 310, 320, 330. Individual areas can be uniform in size and shape, so that a surface is decomposed into regular, addressable areas similar to pixels. Likewise, areas can be of any size and shape, so that images in the image realization device 300 can be directed at a suitable area at a desired depth. In addition, adjacent regions can be controlled together, thereby creating a single region with a larger area.In this way, the effective extent of each region 401-403 is variable. Optical diffusers with addressable regions that can be switched between a first transparent state and a second optically diffuse state are known and commercially available. The switching of the individual regions for each of the image realization surfaces 310, 320, 330 in one embodiment is controlled by a processor (not shown).

[0049] The image generation unit 200 consists of a light source (e.g., a laser) and a spatial light modulator. The person skilled in the art would welcome the use of any suitable imaging device, provided it is capable of generating one or more images on the image realization surfaces 310, 320, 330. Accordingly, in one embodiment, the image generation unit 200 is a holographic unit that generates computer-generated holograms for projection onto the surfaces of the image realization. In an alternative embodiment, the image generation unit 200 is a bright-field unit for generating three-dimensional bright-field images for projection onto the image realization surfaces.

[0050] In one embodiment, the image generation unit 200 further includes an imaging optic for manipulating the real images 501-503 onto the corresponding area of ​​the image realization device 300.

[0051] The 800 projection optics consist of a Fresnel lens, although any suitable focusing optics can be used. Fresnel lenses are preferred because they are cost-effective and require less space than other lenses.

[0052] During operation, the image generation unit 200 projects a series of real images 501-503 onto the image realization surfaces 310, 320, 330.

[0053] Areas 401-403 of image realization surfaces 310, 320, 330 comprise areas that are in a transparent state. Because these areas are transparent, they allow the real images 501-503 to pass through to the next image realization device 310, 320, 330 along the optical path.

[0054] The real images 501-503 are formed on the areas 401-403 of the image realization surfaces 310, 320, 330, which are in an optically diffuse state.

[0055] In the illustrated embodiment of Fig. The area 401 of the image realization layer 330 is in an optically diffuse mode and realizes the real image 501 at a first distance from the focal length of the projection optics 800 (not shown).

[0056] The area 402 of the image generation layers 310 and 330 is in a transparent state, so that a real image 502 can be generated on the area 402 of the image generation layer 320 at a second distance of the length of the projection optics 800.

[0057] Due to the arrangement of the image realization surfaces 310, 320, 330 along the optical path, a real image 501-503 formed on a particular image realization surface 310, 320, 330 is located at a different distance from the focal point of the projection optics 800 than a real image 501-503 formed on a different image realization surface 310, 320, 330. Therefore, when projected onto the screen 900 of the head-up display via the projection optics 800, each real image 501-503 appears as a virtual image 1001-1003 with a different focal level (or a different perceived depth).

[0058] Therefore, the in Fig. The arrangement shown controls the focal length in discrete intervals, i.e., determined by the separation of the image realization surfaces 310, 320, 330. This enables the generation of virtual images 1001-1003 at different depths, thus providing a multidimensional or 3-D image.

[0059] Fig. represents an alternative embodiment in which each of the image realization surfaces 310, 320, 330 is an image generation layer.

[0060] In Fig. The image realization device 300 is shown, wherein the image realization device has three image realization surfaces 310, 320, 330. In the Fig. In the illustrated embodiment, the image realization surfaces 310, 320, 330 are arranged planarly and distributed along the projection axis 210. Each image realization surface 310, 320, 330 is inclined on the projection axis 210, running perpendicular to the projection axis 210. Therefore, the image processing surfaces are, as shown in Fig. shown, arranged so that they are aligned along the projection axis 210.

[0061] In one embodiment, the image-generating layer 350 is an electroluminescent OLED, although any suitable image-generating device can be used. This enables operation without the image-generating unit 200 and reduces the overall size and number of components of the imaging system 100.

[0062] As in the embodiment of the optical diffuser, each of the image-realizing surfaces 310, 320, 330 has a plurality of areas 401-403, each area being controllably switchable between a first transparent state and a second image-generating state. For the sake of clarity, there can be three areas 401-403, but in further embodiments, there can be any number of areas more than two.

[0063] In use, each area of ​​the image realization surface 310, 320, 330 can be switched between an active state (in which the area generates an image) and a transparent state. Each area generates a real image 501-503 in another area 401-403. The non-image-generating areas 401-403 of each image realization surface 310, 320, 330 are selectively switched to a transparent state so that all real images 501-503 preceding them on the optical path can be transmitted to the projection optics 800.

[0064] Each real image 501-503 is generated on an image realization surface 310, 320, 330 at a different distance from the focal point of the projection optics 800, with each real image 501-503 being projected onto the screen 900 of the head-up display and appearing as a virtual image 1001-1003 with a different focus level (or a different perceived depth).

[0065] In an alternative embodiment, one or more image-generating layers 350 can be nested between one or more optical diffusers to provide a hybrid embodiment with two operating modes, each mode being adaptable to operation in a different range of ambient light conditions. Furthermore, the superposition of the optical diffuser 400 and the image-generating layer 350 in this way enables a dual-mode system without the need for a second set of projection optics 800.

[0066] In one embodiment, the switching of the image realization surface between the active and transparent states is controlled by a driver. In another embodiment, the driver can also control the image generation unit 200 such that the image generation unit 200 is selectively deactivated when an image generation layer 350 is present and active.

[0067] Accordingly, the in Fig. configuration shown, as well as the one in Fig. The configuration shown demonstrates that the distance between the real image and the focal point of the projection optics is controlled in discrete intervals, i.e., determined by the separation of the image processing surfaces. This allows the depth of field to be controlled.

[0068] Fig. This is a flowchart of the process for generating the image to be rendered on the screen of the head-up display.

[0069] In one aspect of the invention, the device generates a virtual image that is displayed on the HUD, the HUD being the vehicle's windshield. As is known, a vehicle's windshield is a geometrically distorted shape, i.e., it is not flat. Accordingly, an image projected onto the windshield is distorted, the degree of distortion being influenced by various factors such as the shape of the windshield and the average distance between the windshield and the projected image.

[0070] The device described herein is capable of generating an image that can be displayed at different depths. While generating images at multiple depths on the HUD offers many advantages over a flat, single depth, the image's ability to correct for factors such as the curvature of the windshield leads to further improvements in depth control and image manipulation.

[0071] Advantageously, to reduce the distortion effect in one aspect of the invention, the distortion of the windshield caused by the image generation unit is corrected by software that pre-distorts the image so that the image displayed on the windshield is free of windshield distortion. Such software-based correction eliminates the need for bulky corrective optics and also offers a higher degree of flexibility, allowing it to adapt to different windshields.

[0072] The images displayed on the HUD are generated by an image generation unit. This unit defines the image to be shown on the HUD. For example, the image can contain information about the vehicle's status and other navigation information.

[0073] The term image generation unit refers to the device that determines and generates the base image to be rendered on the HUD. The method described herein is applicable to any suitable type of image generation device.

[0074] The image generation unit comprises an image source that generates the image to be displayed on the HUD. In one embodiment, the image source is an alternator, an OLED display, or another suitable source that generates the image to be displayed. The image source includes a software driver configured to determine and generate the image on the image source.

[0075] The software driver includes a component that determines the content to be displayed. The content generation process is known and is carried out in one aspect using known methods.

[0076] The driver further includes a distortion module, wherein the distortion module is configured to apply a distortion to the generated image, the distortion being calculated such that when the image is displayed on the HUD / windscreen, the image appears undistorted to the end user.

[0077] In step S102, the windshield is modeled as a mirrored surface. In step S102, the shape and slope of the windshield are determined. In one embodiment, since the shape of the windshield is typically constant for a given make and model of vehicle, it is pre-programmed.

[0078] In step S104, the image to be displayed on the HUD is used as the reference input image. Such an image typically changes several times per second.

[0079] In step S106, the input image is separated for each color channel of the image to create one image per color channel.

[0080] In step S108, for each color channel image, the position of each pixel in the image is determined as visualized by a viewer located at a distance from the windshield surface. This is determined using ray reflection to calculate the pixel position based on the average distance of the input pixel (according to step S106), the reflective surface of the windshield (according to step S102), and the average distance between the rendered image and the windshield, i.e., the image depth.

[0081] Therefore, in step S108, the degree of distortion for each color channel image due to the windshield and the physical distances is calculated. This results in a distorted image (where the degree of distortion depends on the physical parameters) for each color channel. This can be achieved by monitoring and adjusting the displacements of certain predefined points on a distorted image to obtain the corresponding distortion parameters.

[0082] In step S110, the individual distorted color channel images are combined. The combined image is the resulting pre-distortion image, since the projection of the pre-distortion image results in the input image being displayed (according to step S104).

[0083] As such, the process offers an improved methodology to ensure that the generated image is free of distortion.

[0084] Diffuser stacks cannot be arranged parallel to the projection axis due to their normality.

[0085] The Fig. show further applications and embodiments according to one aspect of the invention.

[0086] The in the Fig. The device shown uses the same principles as those in the Fig. The device shown, wherein the reference numerals refer to the same features as described in the Fig. are defined.

[0087] Fig. Figure 1 shows an embodiment in which several real images are generated on the same image realization surface 310, 320, 330, but on different areas 402-403 (star and cylinder). Accordingly, these images are generated at the same distance from the focal point of the projection optics 800 and, when projected onto the screen, produce virtual images with the same perceived depth. Simultaneously, each area of ​​each layer is capable of achieving a different degree of transparency or diffusion as desired, so that real images generated on a common layer can be controlled independently of one another. This allows for a higher degree of flexibility and control over the resulting virtual images than would otherwise be the case with image realization surfaces that do not have such independently controlled areas 401-403.

[0088] Fig. This illustrates an application where different sections of a complete image are formed on different areas 401-403 of each image realization surface 310, 320, 330, thereby achieving a range of distances from the focal point of the projection optic 800, and the resulting virtual images lie within a range of apparent depths. This allows the creation of a 3D representation of a larger object, in this case an arrow, with varying apparent depths along its length. This further illustrates how part of an image can be preserved while other parts are processed. In addition to changing the apparent depth across an image, the variable transparency and diffusivity of each area 401-403 of each image realization surface can also be modulated independently, for example, to create a fade-out effect.

[0089] Fig. Figure 1 shows an embodiment in which a laser projector is used. Such a setup means that the virtual images are always in focus, their size depending on the distance of the image generation device 300 from the projector output due to the propagation of the laser projector beam. Accordingly, real images of different sizes can be generated on different surfaces 310, 320, 330 of the image generation device 300 such that the resulting virtual images are then the same size. This eliminates the need for additional optics to enlarge (or demagnetize) the virtual images, thereby reducing both the number of components and the volume of the HUD system.

[0090] Fig. illustrates a vehicle 1 that has the device 3 of the Fig. The device 3 can be represented in an imaging system.

Claims

[1] Imaging system (100) for generating virtual images (1001-1003) with multiple depths on a screen (900), wherein the imaging system (100) comprises: an image realization device (300) for generating a source image (501 - 503), Projection optics (800) for displaying a display image (1001-1003) on the screen (900), wherein the display image is a virtual image corresponding to the source image, wherein the projection optics (800) has an optical axis (810), and wherein the image realization device (300) comprises: a first image realization surface (310) at a first distance along the optical axis (810) from the focal point of the projection optics (800), a second image realization surface (320) at a second different distance along the optical axis (810) from the focal point of the projection optics (800), where the first (310) and second (320) image realization surfaces overlap at least partially, and wherein each of the first and second image realization surfaces (310, 320) comprises a plurality of independently controlled areas, each area being selectively switchable between a transparent state and an image realization state, so that the source image (501-503) can be selectively formed on an area of ​​the first (310) or second (320) image realization surface and projected through the projection optics (800), thereby rendering the display image (1001-1003) on the screen in a first or second apparent depth. [2] Imaging system (100) according to claim 1, wherein at least one of the first (310) and second (320) image realization surfaces is displaceable along the optical axis (810) of the projection optics (800). [3] Imaging system (100) according to a preceding claim, wherein at least one of the first (310) and second (320) image realization surfaces is rotatable and tiltable with respect to the optical axis (810) of the projection optics (800). [4] Imaging system (100) according to a preceding claim, wherein the screen (900) is a display of a head-up display. [5] Imaging system (100) according to a preceding claim, wherein at least one of the first (310) and second (320) image realization surfaces is capable of generating the source image (501 - 503). [6] Imaging system (100) according to claim 5, wherein at least one of the first (310) and second (320) image realization surfaces comprises an electroluminescent layer. [7] Imaging system (100) according to claim 5, wherein at least one of the first (310) and second (320) image realization surfaces comprises an organic light-emitting diode. [8] Imaging system (100) according to a preceding claim, further comprising an image generation unit (200) for generating the source image (501-503) to be displayed as a display image (1001-1003) on the screen (900), and for projecting the source image (501-503) onto at least one of the first (310) and second (320) image realization surfaces. [9] Imaging system (100) according to claim 8, wherein the image realization state of at least one of the first (310) and second (320) image realization surfaces is an optically diffuse state. [10] Imaging system (100) according to claim 9, wherein the image generation unit (200) comprises a holographic unit to generate computer-generated holograms for imaging on the diffuser. [11] Imaging system (100) according to one of claims 8 to 9, wherein the image generation unit (200) comprises a light field unit to generate 3-dimensional light field images for imaging on the at least one image realization surface. [12] Imaging system (100) according to one of claims 9 to 11, wherein the system comprises a driver, the driver being configured to selectively switch the at least one image realization surface (310-330) between the diffuse or transparent state. [13] Imaging system (100) according to claim 12, wherein the image generation unit (200) comprises a laser and the driver is configured to operate synchronously with the laser. [14] Imaging system (100) according to claim 12, when it is dependent on claim 10, wherein the driver is configured to operate synchronously with the holographic unit. [15] Imaging system (100) according to claim 12, when it is dependent on claim 11, wherein the driver is configured to operate synchronously with the light field unit. [16] Imaging system (100) according to any one of claims 8 to 14, wherein the image generation unit (200), the image realization device (300) and the projection optics (800) are arranged along the optical path of the imaging system (100). [17] Imaging system (100) according to any one of claims 8 to 14, wherein the image generation unit (200) further comprises focusing optics. [18] Imaging system (100) according to a preceding claim, further comprising one or more additional image realization surfaces (310-330). [19] Imaging system (100) according to any one of claims 8 to 18, when dependent on claim 8, wherein the image generation unit (200) is configured to generate an input image to be displayed on the screen (900) as a second image, wherein the input image is adjusted to compensate for any distortion due to the screen (900). [20] Imaging system (100) according to a preceding claim, wherein each image realization area (310-330) has a different size. [21] Imaging system (100) according to a preceding claim, further comprising an ambient light sensor configured to adjust the brightness of the displayed virtual images (1001-1003). [22] Imaging system (100) according to a preceding claim, wherein the imaging system (100) can be activated and deactivated both automatically and by human input. [23] Vehicle (1) comprising an imaging system (100) as required in any one of claims 1 to 22. [24] Method for generating virtual images (1001-1003) with multiple depths on a screen (900), the method comprising: Forming a source image (501-503) with an image realization device (300), Reproducing a display image (1001-1003) on the screen (900) via a projection optic (800) with an optical axis (810), wherein the display image (1001-1003) is a virtual image corresponding to the source image (501-501), and wherein the image realization device (300) comprises: a first image realization surface (310) at a first distance along the optical axis (810) from the focal point of the projection optics (800), a second image realization surface (320) at a second different distance along the optical axis (810) from the focal point of the projection optics (800), wherein the first (310) and second (320) image realization surfaces overlap at least partially, and wherein each of the first (310) and second (320) image realization surfaces comprises a plurality of independently controlled areas, each area being selectively switchable between a transparent state and an image realization state, so that the source image (501-503) can be selectively formed on an area of ​​the first (310) or second (320) image realization surface and projected through the projection optics (800), the display image (1001-1003) being reproduced on the screen (900) in a first or second apparent depth.

Citation Information

Patent Citations

  • Display device and head-up display system for a motor vehicle

    DE102015205871A1

  • Multi-planar volumetric display system including optical elements made from liquid crystal having polymer stabilized cholesteric textures

    US20020163482A1