MULTI-DEEP DISPLAY APPARATUS

Abstract

An imaging system for generating virtual images with multiple depths on a screen (22) of a head-up display, wherein the imaging system comprises: an image realization device (14) for generating a source image, projection optics (18) for reproducing a display image on the screen (22), wherein the display image is a virtual image corresponding to the source image, and wherein the image realization device comprises: a light structuring device having a surface (42), wherein the light structuring device is configured to simulate a first lens with a first focal length on the surface (42), wherein the surface (42) and an image realization surface are arranged such that a first source image formed on a first region of the image realization surface and projected by the projection optics generates the display image on the screen (22) at a first apparent depth (24).wherein the light structuring device is further configured to simulate a second, different lens on the surface (42), the second lens having a second focal length, and wherein a second source image formed on the second lens and projected by the projection optics (18) produces a second display image on the screen (22) at a second apparent depth (26); and wherein the light structuring device is further configured to simulate the first and second lenses on the surface (42) of the light structuring device in different areas on the surface (42) and to display the first and second lenses simultaneously.

Description

TECHNICAL AREA

[0001] The present disclosure relates to a 3D augmented reality display system. In particular, but not exclusively, the disclosure relates to a device for generating and projecting multi-depth images onto a display, such as a windshield for use in a vehicle. Aspects of the invention relate to an imaging system and a method for generating multi-depth images on a head-up display screen and a vehicle incorporating the imaging system. BACKGROUND

[0002] Heads-up displays (HUDs) are well-known displays that project images onto a transparent surface, such as a windshield. Such displays are common in a variety of environments, including vehicles.

[0003] Automotive head-up displays (HUDs) project information about vehicle conditions (speed, etc.) or navigation onto the windshield. These displays are typically limited in size and project the image at a fixed depth to the user. Due to this limited size, the HUD can become cluttered with information that is less relevant to the user. Furthermore, because the image has a fixed depth, all information presented to the user is equally emphasized. This further reduces the efficiency of such displays.

[0004] Another consideration is that vehicles typically have limited physical space for installing such systems. Typically, these systems must be integrated into existing spaces within the vehicle or installed in the smallest possible space to minimize the need to remove and reinstall existing components. Furthermore, the introduction and installation of such systems involve costs.

[0005] The aim of the invention is to address at least some of the problems of the prior art. SUMMARY OF THE INVENTION

[0006] Aspects and embodiments of the invention represent a system and method for providing images with multiple depths, and a vehicle incorporating the imaging system as required in the attached claims.

[0007] According to one aspect of the invention, an imaging system for generating multi-depth virtual images on a screen is provided, wherein the imaging system comprises: an image processing device for forming a source image, a projection optic for displaying a display image on the screen, wherein the display image is a virtual image corresponding to the source image, and wherein the image processing device comprises: an image realization surface and a light structuring device having a surface with a first and second area, wherein the light structuring device is configured to simulate a first lens with a first focal length on the first area of ​​the surface, wherein the surface and the image realization surface are arranged such that a first source image, which is formed on a first area of ​​the image realization surface and projected by the projection optic,a first display image is generated on the screen at a first apparent depth, and wherein the light structuring device is further configured to simulate a second lens on the second region of the surface, the second lens having a second focal length, and wherein the surface and the image realization surface are arranged such that a second source image, formed on a second region of the image realization surface and projected by the projection optics, generates a second display image on the screen at a second apparent depth, the first and second lenses being independently configurable. The first source image, generated on the first region of the image realization surface, is imaged by the first lens on the first region of the surface. The second source image, generated on the second region of the image realization surface,The image is projected onto the second area of ​​the surface by the second lens.

[0008] According to a further aspect of the invention, there is a method for generating multi-depth virtual images on a screen, wherein the method comprises: forming a source image with an image processing device, reproducing a display image on the screen via a projection optic, wherein the display image is a virtual image corresponding to the source image, and wherein the image processing device comprises: an image realization surface and a light structuring device having a surface with a first and second area, wherein the light structuring device is configured to simulate a first lens with a first focal length on the first area of ​​the surface, wherein the surface and the image realization surface are arranged such that a first source image, which is formed on a first area of ​​the image realization surface and projected through the projection optic,a first display image is generated on the screen at a first apparent depth, and wherein the light structuring device is further configured to simulate a second lens on the second area of ​​the surface, the second lens having a second focal length, and wherein the surface and the image realization surface are arranged such that a second source image formed on a second area of ​​the image realization surface and projected by the projection optics generates a second display image on the screen at a second apparent depth, the first and second lenses being independently configurable.

[0009] One advantage of the invention is that it provides a system for use in a vehicle that allows information to be displayed at different depths on a transparent screen, i.e., the windshield of the HUD. By providing information at different depths, it is possible to decouple different information content by displaying it at the desired 3D coordinates. The device of the invention allows images (and image parts) to be displayed at different depths, thereby reducing display clutter and allowing greater flexibility in information presentation. For example, a first set of information, such as the vehicle's status (speed / transmission, etc.), can be displayed at a fixed depth. According to another aspect of the invention, the first or second set of information, e.g.,B. Navigation objects, are displayed in a second depth.

[0010] Advantageously, according to one aspect of the invention, the device enables the HUD to display objects at multiple depths. The ability to display information at different depths improves the driving experience compared to conventional head-down displays or current versions of HUDs. It also allows for the simultaneous display of images with multiple depths and dynamically variable image depth for each individual image.

[0011] Optionally, the screen can be the screen of a head-up display.

[0012] Optionally, one or both of the size and focal length of the first and second lenses can be configured independently. Optionally, the image realization surface includes a first surface, wherein the first surface is a diffuse surface configured to display an image. Optionally, the image realization surface further includes a second diffuser, wherein the first and second diffusers overlap at least partially. Optionally, wherein at least a portion of each diffuser is configured to selectively switch between a toggleable state between a first transparent state and a second optical diffusion state. Optionally, wherein the portion of each diffuser configured to selectively switch between a toggleable state between a first transparent state and a second optical diffuse state is controlled by a driver configured to selectively switch between the two states.

[0013] By using multiple diffuse surfaces, the focus path can be varied, thus offering a higher degree of control for displaying images at different depths on the HUD.

[0014] Optionally, the image-generating surface is an electroluminescent device, such as an OLED device. Optionally, the system includes a second electroluminescent device. Optionally, at least a portion of each electroluminescent device can be actively switched between a transparent and an image-generating state.

[0015] The use of the electroluminescence device reduces the space required and also provides means of varying the focal length, thus offering a higher degree of control over the displayed depth of the image.

[0016] Optionally, the system includes an image generation unit for generating the source image to be rendered as a display image on the screen and for projecting the source image onto the image realization surface.

[0017] Optionally, the image realization device for forming the source image and the image generation unit are arranged along the optical axis of the image generation unit.

[0018] Optionally, the image generation unit includes a laser and a 2D scanner mirror for displaying the images on the diffuser.

[0019] Optionally, the image generation unit includes a holographic unit for generating computer-generated holograms for projection onto the diffuser.

[0020] Optionally, the image generation unit includes a brightfield unit for generating 3-dimensional brightfield images for projection onto the diffuser.

[0021] Optionally, the image generation unit can be an LCD projector, an LCoS projector, or a DMD projector.

[0022] According to another aspect of the invention, a vehicle is provided which includes an imaging system as described in the preceding aspects.

[0023] According to a further aspect of the invention, an imaging system for generating multi-depth virtual images on a screen of a head-up display is provided, wherein the imaging system comprises: an image realization device for realizing a first image, a projection optic for rendering a second image on the screen, wherein the second image is a virtual image corresponding to the first image, and wherein the image realization device comprises: a light structuring device with a surface, wherein the light structuring device is configured to simulate a lens with a first focal length on the surface, wherein the surfaces and the image realization surface are arranged such that a first image realized on an area of ​​the image realization surface and projected through the projection optic reproduces the second image on the surface at a first apparent depth.

[0024] According to a further aspect of the invention, an imaging system for generating multi-depth virtual images on a screen is provided, wherein the imaging system comprises: an image realization device for realizing a first image, a projection optic for rendering a second image on the screen, wherein the second image is a virtual image corresponding to the first image, and wherein the image realization device comprises: a light structuring device with a surface, wherein the light structuring device is configured to simulate a lens with a first focal length on the surface, wherein the surfaces and the image realization surface are arranged such that a first image realized on an area of ​​the image realization surface and projected through the projection optic reproduces the second image on the surface at a first apparent depth.

[0025] Within the scope of this application, it is expressly provided that the various aspects, embodiments, examples, and alternatives set forth in the preceding paragraphs, in the claims, and / or in the following descriptions and drawings, and in particular their individual features, may be adopted independently or in any combination. That is to say, all embodiments and / or features of an embodiment may be combined in any way and / or combination, unless these features are incompatible. The applicant reserves the right to amend an originally filed claim or to file a new claim accordingly, including the right to amend an originally filed claim to be dependent on another claim and / or to include a feature of another claim, even if it was not originally claimed in this manner. List of characters

[0026] One or more embodiments of the invention will now be described by way of example only with reference to the accompanying drawings, in which: Fig. is a schematic representation of the device according to one embodiment of the invention; Fig. is a schematic representation of the device according to one embodiment of the invention; Fig. is a schematic representation of the device according to one embodiment of the invention; Fig. is a schematic representation of the device according to one embodiment of the invention; Fig. is a flowchart of the process for generating the image to be rendered on the heads-up display; Fig. is a schematic representation of the device according to one embodiment of the invention; Fig. is a schematic representation of the device according to one embodiment of the invention; and Fig. is a vehicle according to one embodiment of the invention. DETAILED DESCRIPTION

[0027] In one aspect of the invention, the device and the display are located in a vehicle, such as a motor vehicle. 1 , built-in. While the following description refers to a motor vehicle HUD, the disclosures and concepts described herein apply to other forms of HUD (e.g., those installed on other vehicle shapes or wearable platforms such as helmets or goggles) as well as to displays in general, not just HUDs.

[0028] This is particularly relevant when the invention is installed for use in confined spaces, such as a vehicle that can operate on land (on / off-road or on rail), under or above sea, in the air, or in space. Examples include, but are not limited to, cars, buses, trucks, excavators, heavy-duty exoskeleton suits, motorcycles, trains, theme park rides, submarines, ships, boats, yachts, jet skis for marine vessels, airplanes, gliders, spacecraft, and space shuttles. Furthermore, the technology can be integrated into a mobile platform, such as a head / eye protection device for drivers / operators, like a helmet or goggles. Therefore, any activity involving the wearing of protective helmets / goggles can benefit from this technology. These can be worn by motorcyclists / cyclists, skiers, astronauts, exoskeleton operators, military personnel, miners, divers, and construction workers.Furthermore, it can be used in a standalone environment for game consoles, arcade machines, and as a simulation platform with a combination of an external 2D / 3D display. It can also be used in institutions and museums for educational and entertainment purposes.

[0029] Fig. Figure 1 is a schematic representation of the device in one embodiment of the invention.

[0030] Fig. is described with reference to the device that is in a motor vehicle 1 is installed. The person skilled in the art would understand that the invention is applicable in other types of environments where a HUD is required, and not only in motor vehicles.

[0031] In Fig. Figure 1 shows a schematic representation of the device according to a first embodiment.

[0032] The device of Fig. It is configured to project multi-depth images onto a head-up display.

[0033] In Fig. is an image generation unit 10 depicted, with the image generation unit 10 a first projection axis 12 exhibits. The images generated by the image generation unit are projected along the first projection axis. 12 on an image realization device 14 projected. The image realization device 14 projects the images along the axis 12 on a spatial light modulator (SLM) 16 , where the SLM is configured to create a lens pattern on the surface of the SLM 16 to create an image so that the SLM behaves like a digital lens. The image produced by the lens pattern is projected along the axis. 20 through the optics 18 and onto the transparent screen of the head-up display 22projected where it appears as a virtual image depending on the generated lens pattern 24 , 26 , 28 is reproduced at a given optical depth.

[0034] In Fig. is the image generation unit 10 configured to render the source image onto the transparent screen 22 to determine and create. In one embodiment, the image generation unit is 10 It consists of a laser and a 2D scanner mirror. In further embodiments, the image generation unit comprises 10 A holographic unit for generating computer-generated holograms for projection onto the diffuser. In one embodiment, the image generation unit comprises a bright-field unit. Such a bright-field unit is capable of generating three-dimensional light-field images that are projected onto the image realization device. 14have been created. In such an embodiment, the image generation unit is an LCD projector, an LCoS projector, or a DM D projector.

[0035] The person skilled in the art would welcome the use of any suitable light source and imaging means, provided they were capable of projecting one or more images onto the image-realizing device. 14 to produce.

[0036] The image generation unit 10 The generated image is projected along the first projection axis. 12 for the image realization device 14 projected. As with reference to the Fig. , Fig. , Fig. , Fig. and Fig. As described, the image realization device 14 can be implemented in various ways.

[0037] The image realization device 14refers to an area or volume within which an image is generated or reproduced. As described in more detail below, the image realization device is... 14 in one embodiment a diffuse surface or a diffuse volume which is defined by the image generation unit 10 reproduces the projected image. In another embodiment, which refers to Fig. As described, they form the image generation unit 30 and the image realization device 14 a self-illuminating film display like an OLED.

[0038] The image realization device 14 The generated image is processed via the spatial light modulator (SLM). 16 on the windshield of the vehicle 1 projected. The SLM 16 and the optics 18 define a projection optic 20 As described below, SLM enables 16 and the optics 18a variation in the focal length of the projection optics 20 and thus enable the information to be displayed on the windshield at multiple depths. In one embodiment, the optics 18 Adjustable or movable around any axis to allow manipulation of the optical path.

[0039] The SLM 16 It includes a light structuring device configured to simulate the focusing properties of a lens and write them onto a surface. Such SLMs 16 are known and commercially available. Preferably the SLM. 16 configured to write a Fresnel lens pattern onto a surface. Therefore, the focal length of the projection optics can be 20 by varying the SLM 16 The written lens pattern is controlled. In one embodiment, the SLM varies 16The surface lens pattern (and thus the focal length) is modified over time, and in further embodiments, the SLM surface is subdivided. Each partition has a different focal length pattern, thereby providing multiple focal lengths in a single coplanar element. Each partition, and thus its lens, can be configured separately, allowing the SLM to be used in a variety of ways. 16 It is possible to define multiple, separately configurable lenses on the same surface. In one embodiment, each partition is the same size. In an alternative embodiment, one or more partitions have a different size than another partition. In a further embodiment, each partition has a predefined unit size, with adjacent partitions being controllable as a group, thus forming a single, larger partition.

[0040] In other embodiments, the transparent screen is replaced by an invisible screen, such as that used in a virtual reality system.

[0041] The projection optics also include the optics 18 , which can be further configured to vary the focal length.

[0042] Fig. Figure 1 is a schematic representation of a device for generating multi-depth, three-dimensional images according to an embodiment of the invention.

[0043] The in Fig. The device shown uses the same principles as the one in Fig. The device shown is particularly noteworthy. Fig. The device shown is configured to provide multiple focal lengths for the projection optics through the use of an SLM.

[0044] In Fig. is an image generation unit 30 depicted, with the image generation unit 30a first SLM 32 and a first visual impression 34 includes the image generation unit. 30 has a first projection axis 36 The images generated by the image generation unit are projected along the first projection axis. 36 on a diffuser 38 projected. The diffuser 38 projects the images along the projection axis onto a second spatial light modulator 42 The one from the second SLM 42 The generated image is projected along the projection axis through the optics. 46 and onto the head-up display 48 projected where it depends on the second SLM 42 The generated lens pattern is displayed as a virtual image for a given optical depth.

[0045] As with the one relating to Fig. The described device enables the device of Fig. the control of the entire optical projection path to project images to their relevant positions in the perceived 3D scene.

[0046] In the present embodiment, the image generation unit comprises 30 a first SLM 32 and a set of the first imaging optics 34 The second SLM surface 42 The second SLM surface is divided into numerous areas, each with a different focal length pattern. Since the focal length patterns of the second SLM surface are known, the overall focal length profile, and therefore the optical depth of each image, will also be known. Accordingly, it is possible to project the image, or parts of the image, onto the desired section of the second SLM. 42 to select the optical depth with which the image is displayed on the transparent screen of the HUD. 48is reproduced. This makes it possible to project the image at different depths by selectively projecting the image onto a specific part of the second SLM. 42 projected. In this way, the entire optical projection distance can be controlled to project images to their relevant positions in the perceived 3D scene.

[0047] In such embodiments, the first SLM 32 and the initial presentation look 34 configured to place the respective image or part of the image on the desired section of the second SLM 42 to project. A processor (not shown) controls the generation of the images to be displayed. The desired projection depth is determined during image generation. Image generation and depth can be determined in a known manner. Since the image depth depends on the projection of the image onto the corresponding area of ​​the second SLM 42dependent, the processor ensures that the first SLM 32 and the first imaging optics 34 the image on the desired section of the second SLM 42 project to project the image onto the windshield at the desired depth.

[0048] Fig. Figure 1 is a schematic representation of a device for generating multi-depth, three-dimensional images according to an embodiment of the invention.

[0049] It is the device of Fig. depicted, in which the individual diffuser of Fig. through several diffusers arranged one above the other 50 , 52 , 54 , 56 has been replaced. For better understanding, four openings are shown, although in further embodiments any number of openings larger than two can be used.

[0050] The multiple stacked diffusers 50 , 52 , 54 , 56in Fig. Therefore, three image realization surfaces are defined. The image realization surfaces are planar and along the projection axis. 210 distributed, and preferably each image realization surface 50 , 52 , 54 , 56 on the projection axis 210 centered, being normal and parallel to the projection axis 210 proceeds.

[0051] Each image realization surface of the multiple stacked diffusers 50 , 52 , 54 , 56 The projections overlap at least partially along the projection axis. This means that the image projected along the projection axis passes through at least two diffusers.

[0052] In one embodiment, each of the image realization surfaces 50 , 52 , 54 , 56The diffuser is controllably switchable between a first transparent state and a second optically diffuse state. In further embodiments, each image realization surface comprises a plurality of areas (or cells), wherein each area of ​​each cell is individually controllable and switchable between a first transparent state and a second optically diffuse state. Such diffusers are known in the art. In one embodiment, the diffuser is an SmA liquid crystal device.

[0053] During operation, the image generation unit projects 30 a series of real images onto the image realization surfaces 50 , 52 , 54 , 56 Since the image realization surfaces are spatially separated and overlapping, it is therefore possible to selectively choose which of the three image realization surfaces should represent the image by making the surfaces transparent or optically diffuse.

[0054] Accordingly, it is possible to increase or decrease the optical path length between the images displayed on the multilayer diffuser and the transparent screen. Thus, the in Fig. The configuration shown is another means of controlling the depth of the displayed image on the transparent screen.

[0055] Fig. Figure 1 is a schematic representation of a device for generating multi-depth, three-dimensional images according to an embodiment of the invention.

[0056] It is the device of Fig. depicted, in which each of the image realization surfaces 50 , 52 , 54 , 56 an image-generating layer 60 , 62 , 64 , 66 is.

[0057] In one embodiment, the image generation layer 60 , 62 , 64 , 66an electroluminescent device such as an OLED, wherein in further embodiments any suitable imaging means may be used.

[0058] As with the embodiment of the optical diffuser, each of the image realization surfaces 60 , 62 , 64 , 66 Controllably switchable between a first transparent state and a second image-generating state. Preferably, each surface comprises a series of different areas or cells. The in Fig. The described configuration therefore works in the same way as the one described in Fig. Configuration shown.

[0059] In use, each image realization surface generates 60 , 62 , 64 , 66 A real image is projected onto the transparent canvas. The non-image-generating areas of each image-realization surface 60 , 62 , 64 , 66They are in a transparent state, so that all images preceding them on the optical path can be transmitted through the projection optics.

[0060] Since each real image is placed on one of the spaced image realization surfaces 60 , 62 , 64 , 66 The images are generated at different distances from the focal point of the projection optics, with each real image projected onto the projection surface 22 is projected as a virtual image with a different focal plane (or perceived depth) 24 , 26 , 28 appears.

[0061] In the Fig. , Fig. and Fig. is the second SLM 42 a reflective or transflective SLM. As in the Fig. and Fig. as described, the SLM 42 be a transmissive SLM.

[0062] Advantageously, the described configuration allows for greater control of the optical depth of the image projected onto the transparent disc, and thus the placement of objects at different perceived depths on the windshield.

[0063] Fig. This is a flowchart of the process for generating the image to be rendered on the head-up display.

[0064] In one embodiment of the invention, the device generates a virtual image that is displayed on the transparent screen, wherein the transparent screen is a windshield of the vehicle. 1 is. As is known, the windshield of a vehicle is 1a geometrically distorted shape, i.e., it is not flat. Accordingly, an image projected onto the windshield will be distorted, with the degree of distortion being influenced by various factors such as the shape of the windshield and the average distance between the windshield and the projected image.

[0065] The device described herein is capable of generating an image that can be displayed at various depths. While generating images at multiple depths on the transparent screen offers many advantages over a flat, simple depth, the image's ability to correct for factors such as the curvature of the windshield leads to further improvements in depth control and image manipulation.

[0066] Advantageously, to reduce the distortion effect in one aspect of the invention, the distortion of the windshield caused by the image generation unit is corrected by software that pre-distorts the image so that the image displayed on the windshield is free of windshield distortion. Such software-based correction eliminates the need for bulky corrective optics and also offers a higher degree of flexibility, allowing it to adapt to different windshields.

[0067] In an alternative embodiment, the size, configuration, and focal length of the multiple lenses generated on the surface of the light-structuring device are controlled to correct distortions caused by the optics and / or the irregularity of the projection surface. Accordingly, the light-structuring device can perform both distortion correction and depth control by modulating the focal length of discrete areas on its surface. Since each lens is separately and individually configurable, this correction can be applied to each lens independently. In embodiments such as HUDs in a vehicle, this is possible. 1The distance to the image-realizing surface (e.g., the windshield) is constant, and the distortion caused by the image surface would remain constant over time. Therefore, the required distortion correction factor can be calculated and applied to the lens. In one embodiment, the image correction is applied before the image is projected onto the surface (i.e., pre-distortion is applied), so that the distortion-corrected image is displayed.

[0068] In this way, the diffractive optical setup described above allows more than one lens function to be applied to a single layer of an amplitude- and / or phase-modulating surface. Thus, a single SLM can be used to create multiple lenses. 16 A focusing function and a distortion correction function can be achieved.

[0069] Accordingly, using the function I(x) to represent depth control and the function d(x) to represent the correction of distortion induced by optics or windshield, and using a pre-distortion pattern, the entire focusing function can be given by p(x)=I(x).d(x), which is related to the described SLM. 16 can be applied. This eliminates the need for bulky free-form mirrors, which are conventionally used to compensate for distortions.

[0070] The images to be displayed on the transparent screen are generated by an image generation unit. The image generation unit defines the image to be displayed on the transparent screen. For example, the image can contain information about the vehicle's status and other navigation information.

[0071] The term image generation unit refers to the device that determines and generates the base image to be rendered on the transparent screen. The method described herein is applicable to any suitable type of image generation device.

[0072] The image generation unit comprises an image source that generates the image to be displayed on the transparent screen. In one embodiment, the image source is an alternator, an OLED display, or another suitable source that generates the image to be displayed. The image source includes a software driver configured to determine and generate the image on the image source.

[0073] The software driver includes a component that determines the content to be displayed. The content generation process is known and is carried out in one aspect using known methods.

[0074] The driver further includes a distortion module, wherein the distortion module is configured to apply a distortion to the generated image, the distortion being calculated such that when the image is displayed on the transparent screen / windscreen, the image appears undistorted to the end user.

[0075] At step S102 The windshield is modeled as a mirrored surface. At step S102 The shape and slope of the windshield are determined. Since the shape of the windshield is specific to a particular make and model of vehicle. 1 Since it is typically constant, it is pre-programmed in one embodiment.

[0076] At step S104 The image to be displayed on the transparent screen is used as the reference input image. Such an image typically changes several times per second.

[0077] At step S106The input image is separated for each color channel of the image in order to create one image per color channel.

[0078] At step S108 For each color channel image, the position of each pixel in the image is determined as visualized by a viewer located at a distance from the windshield surface. This is determined using ray reflection to calculate the pixel's position based on the average distance of the input pixel (according to step 1). S106 ), the reflective surface of the windshield (according to step S102 ) and the average distance between the rendered image and the windshield, the image depth.

[0079] Therefore, at step S108The degree of distortion for each color channel image is calculated due to the windshield and the physical distances. This results in a distorted image (where the degree of distortion depends on the physical parameters) for each color channel. This can be achieved by monitoring and adjusting the displacements of certain predefined points on a distorted image to obtain the corresponding distortion parameters.

[0080] At step S110 The individual distorted color channel images are combined. The combined image is the resulting pre-distortion image, since the projection of the pre-distortion image causes the input image (according to step 1) to be distorted. S104 ) is displayed.

[0081] As such, the process offers an improved methodology to ensure that the displayed virtual image is free from distortion.

[0082] In further embodiments, the digital lens is used to compensate for windshield distortion. In such embodiments, the phase shift induced by the windshield as the light travels the distance between the digital lens and the windshield is measured or calculated from known software models of the windshield and compensated. In such embodiments, the phase data can be superimposed on the lens profiles generated for the digital lens patterns (as in the Fig. , Fig. , Fig. and Fig. (described). By incorporating such phase data, it is possible to add a digital representation of the optical freeform components. The generated images on the diffuser 38 or the diffusers 50 , 52 , 54 , 56They are therefore displayed as undistorted images. Since the undistorted images are captured via the digital lens 42 When transmitted, the images are subject to a certain degree of distortion. This distortion is subsequently corrected by the deformation caused by the windshield. Therefore, the displayed virtual image is considered to be completely undistorted.

[0083] Fig. 6 is a further device for generating multi-depth, three-dimensional images according to an embodiment of the invention.

[0084] The in Fig. The device shown uses the same principles as those in the Fig. , Fig. and Fig. device shown, wherein the reference numerals refer to the same features as described in the Fig. , Fig. and Fig. are defined.

[0085] In the device in Fig. projects the image generation unit 30 , which was the first SLM32 and the first imaginary optics 34 includes the image on the diffuser 38 As described above, the image is generated depending on the value on the second SLM. 42 generated lens patterns, wherein each lens pattern can be configured independently, preferably via the optics 46 transferred to the display (not shown) at a given optical depth.

[0086] In Fig. is the second SLM 42 , a transmissive SLM. In the context of the Fig. , Fig. and Fig. In the illustrated embodiments, a different type of SLM (e.g., a reflective SLM) is used. This change in the type of SLM 42 Greater flexibility in the optical arrangement is possible.

[0087] Fig. is another device for generating multi-depth, three-dimensional images according to an embodiment of the invention.

[0088] The in Fig. The illustrated embodiment is largely similar to the multi-stacked diffuser design, which, with regard to the Fig. is described. In Fig. is the second SLM 42 However, a transmissive SLM allows for a different device configuration. In particular, as with Fig. The use of transmissive SLM allows the use of different configurations of the device to be used.

[0089] Fig. illustrates a vehicle 1 , that the device 3 the Fig. until Fig. and Fig. , Fig. The device includes 3 can be represented in a mapping system.

Claims

[1] An imaging system for generating virtual images with multiple depths on a screen, wherein the imaging system comprises: an image realization device for generating a source image, Projection optics for displaying an image on the screen, wherein the image being displayed is a virtual image corresponding to the source image, and the image realization device comprises: an image realization surface and a light structuring device having a surface with a first and second area, wherein the light structuring device is configured to simulate a first lens with a first focal length on the first area of ​​the surface, wherein the surface and the image realization surface are arranged such that a first source image formed on a first area of ​​the image realization surface and projected through the projection optics produces a first display image on the screen at a first apparent depth, and wherein the light structuring device is further configured to simulate a second lens on the second area of ​​the surface, wherein the second lens has a second focal length, and wherein the surface and the image realization surface are arranged such that a second source image formed on a second area of ​​the image realization surface and projected through the projection optics produces a second display image on the screen at a second apparent depth, where the first and second lenses can be configured independently of each other. [2] Imaging system according to claim 1, wherein the light structuring device is a spatial light modulation device. [3] Imaging system according to claim 2, wherein the spatial light modulation device is a liquid crystal device (LCD), a liquid crystal on silicon (LCoS) device, or a digital micromirror device (DMD). [4] The imaging system of a preceding claim, wherein the display screen is the screen of a head-up display. [5] The imaging system of a preceding claim, wherein one or both of the size and focal length of the first and second lenses are independently configurable. [6] Imaging system according to a preceding claim, wherein the image realization surface comprises a first surface, the first surface being a diffuse surface configured to generate an image. [7] Imaging system according to claim 6, wherein the image realization surface further comprises a second diffuser, wherein the first and second diffusers overlap at least partially. [8] Imaging system according to claim 7, wherein at least a part of each diffuser is configured to selectively switch between a switchable state between a first transparent state and a second optically diffuse state. [9] Imaging system according to claim 8, wherein the part of each diffuser configured to selectively switch between a first transparent state and a second optically diffuse state is controlled by a driver configured to selectively switch between the two states. [10] The imaging system according to claim 9, wherein the selectively switchable diffuser is an SmA liquid crystal device. [11] The imaging system according to any one of claims 1 to 5, wherein the image realization surface is an electroluminescent device. [12] The imaging system according to claim 8, wherein the electroluminescent device is an OLED device. [13] The imaging system according to one of claims 11 or 12, wherein the system comprises a second electroluminescent device. [14] System according to claim 13, wherein at least one part of each electroluminescent device is actively switchable between a transparent and an image-generating state. [15] The imaging system according to a preceding claim, further comprising an image generation unit for generating the source image to be rendered as a display image on the screen and for projecting the source image onto the image realization surface. [16] The imaging system according to claim 15, wherein the image realization device for forming the source image and the image generation unit are arranged along the optical axis of the image generation unit. [17] Imaging system according to claim 15 or 16, wherein the image generation unit comprises a laser and a 2D scanning mirror for forming the images on the diffuser. [18] Imaging system according to one of claims 15 or 17, wherein the image generation unit comprises a holographic unit to generate computer-generated holograms for imaging on the diffuser. [19] Imaging system according to any one of claims 15 to 18, wherein the image generation unit comprises a light field unit configured to generate three-dimensional light field images for imaging on the image realization surface. [20] Imaging system according to claims 15 to 18, wherein the image generation unit is an LCD projector or LCoS projector or DMD projector. [21] The imaging system according to one of claims 15 to 18 when dependent on claim 4, wherein the image generation unit is configured to selectively direct at least a part of the image to the first or second lens of the spatial light modulation device. [22] Imaging system according to any one of claims 15 to 21 when dependent on claim 12, wherein the image generation unit is configured to generate an input image to be displayed on the screen as the display image, wherein the input image is adjusted to compensate for any distortion caused by the screen. [23] The imaging system according to claim 22, wherein the input image is further adjusted to compensate for any distortion due to the light structuring device. [24] The imaging system of a preceding claim, wherein the system further comprises focusing optics. [25] Imaging system according to claim 24, wherein the focusing optics comprise one or more lenses, the one or more lenses being configured to be dynamically adjustable. [26] The imaging system of all the preceding claims, wherein the first and second lenses are simulated simultaneously. [27] Vehicle comprising an imaging system according to any one of claims 1 to 25. [28] Method for generating virtual images with multiple depths on a screen, the method comprising: Creating a source image with an image realization device, Rendering a display image on the screen via a projection lens, wherein the display image is a virtual image corresponding to the source image, and the image realization device comprises: an image realization surface and a light structuring device having a surface with a first and second area, wherein the light structuring device is configured to simulate a first lens with a first focal length on the first area of ​​the surface, wherein the surface and the image realization surface are arranged such that a first source image formed on a first area of ​​the image realization surface and projected through the projection optics produces a first display image on the screen at a first apparent depth, and wherein the light structuring device is further configured to simulate a second lens on the second area of ​​the surface, wherein the second lens has a second focal length, and wherein the surface and the image realization surface are arranged such that a second source image formed on a second area of ​​the image realization surface and projected through the projection optics produces a second display image on the screen at a second apparent depth, where the first and second lenses can be configured independently of each other. [29] A projection system, vehicle or method, which is substantially as described herein with reference to the accompanying figures.