Light guidance device and display device representing a scene - Patents.com

Abstract

An apparatus is provided that can be used in a display device and that allows for a distinct imaging beam path and a distinct illumination beam path to be implemented within the display device. The present invention relates to a light-guiding device for guiding light. The light-guiding device comprises a light guide, a light coupling device, and a light decoupling device. Light propagates within the light guide via reflections at the boundaries of the light guide. Decoupling of the light from the light guide is provided by the light decoupling device after a predetermined number of reflections of the light at the boundaries of the light guide. There is also provided a display device, particularly a near-eye display device, comprising an illumination device having at least one light source, at least one spatial light modulation device, an optical system, and a light-guiding device.

Description

[Technical field]

[0001] The present invention relates to a light guiding device for guiding light and to a display device for representing a scene, in particular a three-dimensional scene, comprising such a light guiding device. Furthermore, the present invention also relates to a spatial light modulation device and a method for generating a scene reconstructed by a light guiding device. [Background technology]

[0002] Light guiding devices have a wide range of applications, especially in the optical field. In particular, they are used in the field of lasers. Light guides generally have an internal core, which is surrounded by a cladding or cladding layer. Light entering a light guide is usually propagated therein via total internal reflection. This light guiding effect by total internal reflection occurs because the refractive index of the core material is higher than that of the cladding material, or, if no cladding layer is provided, because the refractive index of the light guiding material is higher than that of the surroundings, e.g. air.

[0003] However, light guiding devices or light guides can also be used in other fields, for example in devices for representing a reconstructed scene, in particular in devices for representing a reconstructed, preferably three-dimensional, scene or object point. Such devices can for example be displays or display devices arranged close to the eyes of an observer of the scene, so-called near-eye displays. One near-eye display is for example a head-mounted display (HMD).

[0004] For head mounted displays (HMDs) or similar near-eye displays or display devices, it is desirable to use compact and lightweight optical structures, as such display devices are typically fixed to the user's head, and bulky and heavy configurations would disadvantageously compromise user comfort.

[0005] In the case of an AR (Augmented Reality) HMD, it is further desirable that on the one hand the user is able to perceive his natural environment as much as possible without any obstruction by the HMD, and on the other hand be able to perceive well the content displayed on the HMD itself.

[0006] When a spatial light modulating device and an optical configuration for imaging the spatial light modulating device are used, in this case the optical configuration should be considered such that both light from the spatial light modulating device and light from the observer's natural environment can reach the eye.

[0007] The visibility or field of view is also important for the user's comfort in the HMD. In this case, it is advantageous to have as large a visibility range as possible. However, the representation of a large visibility range combined with high resolution generally requires a spatial light modulation device with a very large number of pixels.

[0008] A holographic head mounted display (HMD) with an observer window is disclosed in US Patent Application Publication No. 2013 / 0222384. Such a head mounted display is shown diagrammatically in FIG. 1, and can achieve a large visible range by splitting the visible range. In this case, different parts of the visible range seen by the observer window are generated in a time-sequential manner using a spatial light modulator 200 and suitable optical systems 400, 500. The advantage of this configuration is that a large visible range is achieved without requiring a large number of pixels of the spatial light modulator, due to the continuous representation.

[0009] Various embodiments are described in U.S. Patent Application Publication No. 2013 / 0222384 to generate multiple images of a spatial light modulator composed of segments or tilings in this manner, however, some of the described embodiments use optical components having relatively large dimensions that address only to a limited extent the requirements for compact and / or lightweight design or usefulness in an AR-HMD.

[0010] For example, the configuration of US Patent Application Publication No. 2013 / 0222384 A1 is shown in Figure 2, which has multiple lenses 800 in close proximity in front of the observer's eyes. Such a configuration is particularly suitable for a VR (Virtual Reality) HMD. However, in an AR-HMD, insofar as the observer can perceive the natural environment through the lenses 800, these lenses 800 have the effect that the natural environment is displayed in a distorted way.

[0011] FIG. 3 is taken from US 2013 / 0222384 A1 and discloses an HMD configuration with multiple mirrors 950, 960, 970. With a proper design of the mirrors as partially transmitting elements, this configuration is in principle also suitable for allowing the observer to perceive his surroundings. This means that this configuration may be suitable for Augmented Reality (AR) applications. However, in order to generate a large visibility range, relatively large mirrors are required. This means that a compact and space-saving version of this configuration may be difficult to achieve.

[0012] An embodiment is also described in US Patent Application Publication No. 2013 / 0222384 using waveguides. Such an embodiment is shown in FIG. 4, with one waveguide 1101 for the left eye of the observer and one waveguide 1102 for the right eye of the observer. In this configuration, the spatial light modulators 201, 202 and the optical units 811, 812 are arranged laterally adjacent to the head of the observer, respectively, and the light is coupled into the thin waveguides 1101, 1102 by gratings 1111, 1112 for each eye. The gratings used as coupling optical units are preferably designed as volume gratings, and the light is coupled into the thin waveguides 1101, 1102 by using them at flat angles, so that the light of all coupling angles propagates in the direction of the waveguide via total internal reflection at two interface surfaces of the waveguides arranged parallel to each other. In this case, the waveguides do not have to be completely flat, but rather can have curved surfaces. However, no quantitative specification of the surface curvature is provided in US2013 / 0222384. The optical deflection device generates various angular spectra, which are coupled into the waveguide in a time-sequential manner. To generate a segmented multiple image, a different angular spectrum is coupled into the waveguide for each segment of the multiple image. The light of one of the angular spectra generated by the optical deflection device is decoupled from the waveguide in the direction of the observer's eye via multiple reflective volume gratings, each designed for a different angular range in terms of its angular selectivity and arranged adjacent to each other.

[0013] The advantage of such a configuration according to FIG. 4 relative to other designs described in US 2013 / 0222384 A1 is that the waveguide is light and compact, and when an observer looks through the waveguide, the observer can also perceive his surroundings. The use of a waveguide is therefore advantageous for an AR configuration. However, the use of a waveguide is not limited to an AR arrangement, but rather is also suitable for a VR arrangement. The waveguide is referred to as thin in US 2013 / 0222384 A1, and no numerical value is given to the thickness.

[0014] The book "Planar Optical Guides for Integrated Optics" by Keigo Iizuka, Elements of Photonics, Volume II chapter 9, is also cited here with regard to light propagation in light guides: "The basis of integrated optics is the planar light guide. Light is guided by a medium with a refractive index higher than that of the surrounding layers.... According to geometrical optics, light propagates by successive total internal reflections with very low losses if certain conditions are met. These conditions are that the layer supporting the propagation must have a refractive index higher than the surrounding medium and that the light must be launched within an angle that satisfies total internal reflection at the upper and lower boundaries. This simple geometrical optics theory fails when the dimensions of the waveguiding recording medium are comparable to the wavelength of light. In this range, the guide supports propagation only for a discrete number of angles. Such a discrete number of angles is called a "propagation mode." In the latter case, light propagation is described by a wave optics approach. Then, the term "waveguide" is typically used. There is no defined geometrical beam profile for such a waveguide.

[0015] In contrast, in this application, the term "light guide" is used to refer to a configuration that is sufficiently thick that light propagation can be described by geometric optics. Such a light guide may, for example, have a thickness of a few millimeters, e.g., 2 mm or 3 mm.

[0016] Holographic displays or display devices are based, among other things, on the effects of diffraction at the apertures of the pixels of a spatial light modulator device and on the interference of coherent light emitted by a light source. Nevertheless, for holographic displays that use geometrical optics to generate a virtual observer window, several important conditions can be formulated and defined:

[0017] On the one hand, the illumination beam path in the display device is important for this purpose. It is used, among other things, to generate a virtual observer window. The spatial light modulation device is illuminated by an illumination device with at least one real or virtual light source. In this case, the light coming from the different pixels of the spatial light modulation device must be directed respectively to the virtual observer window. For this purpose, at least one light source of the illumination device illuminating the spatial light modulation device is usually imaged in an observer plane with a virtual observer window. The imaging of this light source is performed, for example, in the center of the virtual observer window. If the spatial light modulation device is illuminated with a plane wave corresponding to a light source at infinity, for example, the light from the different pixels of the spatial light modulation device emerges perpendicularly from these pixels and is focused in the center of the virtual observer window. In each case, the light that is not perpendicularly emerging but emerges with the same diffraction angle from the various pixels of the spatial light modulation device is also focused in the same respective position in the virtual observer window. In general, however, the virtual observer window can also be laterally displaced with respect to the image of the at least one light source, for example, the position of the image of the at least one light source can coincide with the left or right edge of the observer window.

[0018] On the other hand, the imaging beam path is important in holographic displays or display devices, except for direct-view displays. In an HMD, a magnified image of a spatial light modulation device with small dimensions is generally generated. This is a virtual image that often appears to be at a greater distance to the observer than the distance at which the spatial light modulation device itself is located. Individual pixels of the spatial light modulation device are usually imaged with magnification.

[0019] However, US2013 / 0222384 does not contain any teaching on how the waveguide should be designed so that a clear imaging beam path and a clear illumination beam path are provided, and both the virtual observer window and the image of the spatial light modulator can be generated in a desired manner. In particular, as mentioned above, in a waveguide, it is generally not possible to geometrically describe the beam path. Various optical modes propagating in the waveguide can correspond to different optical paths.

[0020] The construction of a non-holographic HMD with a waveguide is described, for example, in US Patent Application Publication No. 2009 / 303212. The light modulator is imaged therein at infinity. Due to the infinite distance, the optical path of the light does not play a role in the propagation in the waveguide. In simplified terms, the entire path from the image of the pixel of the light modulator to the eye is always infinitely long, even if the path components extending through the waveguide are of different lengths.

[0021] However, in holographic displays, there are constant efforts to enable the representation of three-dimensional (3D) scenes with large depth regions. In general, the aim of such displays is not to represent only content located at a great distance from the observer. Even if the image of the light modulator is located at infinity in the holographic display, the three-dimensional scene is generally represented at a finite distance. In configurations such as those described in US 2009 / 303212, the light modulator itself can be accurately imaged at infinity in the holographic display under certain circumstances. However, accurate reconstruction of object points of the scene could not be performed at a finite distance, i.e. in front of the image of the light modulator.

[0022] A holographic direct-view display generating a virtual observer window includes an illumination beam path. The display comprises an illumination device with at least one light source. For example, the illumination device is designed as a backlight generating a parallel plane wavefront that illuminates the spatial light modulation device. A collimated wavefront corresponds to a virtual light source that illuminates the spatial light modulation device from infinity. The spatial light modulation device can also be illuminated using a diverging or converging wavefront, which corresponds to a real or virtual light source at a finite distance in front of or behind the spatial light modulation device. A field lens focuses the light coming from the spatial light modulation device to the location of the virtual observer window. If no hologram is encoded in the spatial light modulation device, the image of the light source will be in the observer plane, and periodic repetition of this image will occur as a result of the higher diffraction orders. If a suitable hologram is encoded in the spatial light modulation device, the virtual observer window will result close to the zeroth diffraction order. This will be referred to below by stating that the virtual observer window is located in the plane of the light source image. In a holographic direct-view display, the field lens that generates the image of the light source is usually located close to the spatial light modulation device. An observer views the spatial light modulating device at its actual distance without the image of the spatial light modulating device being present, in which case the imaging beam path does not exist.

[0023] In other holographic display devices, such as head-mounted displays (HMD), head-up displays (HUD), or other projection displays, there may be an imaging beam path, as already briefly mentioned. The real or virtual image of the spatial light modulation device seen by the observer is generated in these display devices, and the illumination beam path is still important for the generation of the virtual observer window. Therefore, here, both beam paths, illumination beam path and imaging beam path, are important.

[0024] The case of the presence of imaging beam paths and illumination beam paths may also occur in other display devices, for example stereoscopic display devices. A stereoscopic display device for generating a sweet spot may have, for example, a similar optical configuration to the above-mentioned holographic display, i.e., a collimated illumination of a spatial light modulation device and a field lens, but may also have additional components, such as, for example, a scattering element with a defined scattering angle. If the scattering element is removed from the display device, the field lens generates a light source image in the plane of the sweet spot. By using the scattering element, the light is instead dispersed over an expanded sweet spot that is narrower than the interpupillary distance of the observer. However, the illumination beam path is important in order to be able to fully view the stereoscopic image without vignetting effects. In this case, the 3D stereoscopic display device may also have an imaging beam path, with which the spatial light modulation device is imaged at a certain distance from the observer.

[0025] In the general case, a display device may include lenses or other imaging elements that affect both the illumination beam path and the imaging beam path. For example, a single imaging element may be disposed between the spatial light modulating device and the observer such that the imaging element generates both an image of the spatial light modulating device and an image of the light source in the observer plane.

[0026] In a holographic display device, the typical size of a sub-hologram in the computation of a hologram from a three-dimensional scene depends on the spatial position of the three-dimensional scene relative to the image plane of the spatial light modulation device. Sub-holograms with large dimensions arise, for example, when the scene is located far in front of the image plane of the spatial light modulation device towards the observer. However, large sub-holograms increase the computational effort during hologram computation. In the applicant's WO 2016 / 156287, a method is disclosed for reducing the computational effort by arithmetically introducing a virtual plane of the spatial light modulation device. However, the option of selecting the optical system so that the image plane of the spatial light modulation device is in a suitable position is alternatively desirable, so that a hologram with a sub-hologram with small dimensions can be computed.

[0027] Due to constraints of the optical and / or imaging systems, it is not possible in all cases to generate an image of the spatial light modulation device at a point advantageous for sub-hologram computation. For example, the need to generate a large field of view in a head-mounted display may result in lenses with short focal lengths having to be used close to the observer's eyes. On the other hand, this may make it more difficult to generate an image plane of the spatial light modulation device at a position advantageous for hologram computation if the spatial light modulation device cannot be placed close enough to the lens.

[0028] Generally speaking, optical elements required in the illumination beam path can adversely affect the imaging beam path and vice versa.

[0029] In an alternative design of the holographic display device that generates a virtual observer window, the imaging of the spatial light modulation device can also take place in the virtual observer window. A type of screen, or, if no physical screen is present, a reference plane for the holographic representation of the three-dimensional scene, is provided in the Fourier plane of the spatial light modulation device and thus in the image plane of the light source. In such a display device, the imaging beam path and the illumination beam path are therefore also present, although their meanings with respect to the hologram plane and with respect to the observer plane are interchanged. The virtual observer window is then located in the image plane of the spatial light modulation device and therefore refers to the imaging beam path. The hologram or reference plane for calculating the hologram from the three-dimensional scene is located in the Fourier plane of the spatial light modulation device and therefore refers to the illumination beam path.

[0030] According to WO 2016 / 156287, to calculate the hologram of such a display device, a virtual plane can be placed in the Fourier plane of the spatial light modulator device. Sub-holograms are calculated and summed in this virtual plane. The hologram that can be written to the spatial light modulator device is then determined from the sum hologram by a Fourier transform.

[0031] A display device having an image of the spatial light modulator device in the observer plane can also be used in a modified version to generate a stereoscopic three-dimensional display device design having two planar views for the left and right eye.

[0032] If a properly calculated hologram is written into the spatial light modulating device and the display device includes an illumination device that produces sufficiently coherent light, a two-dimensional image is generated in the Fourier plane of the spatial light modulating device as the Fourier transform of the hologram. Additional scattering elements can be placed in this plane. Alternatively, if the image of the spatial light modulating device were generated in the observer plane without scattering elements, scattering elements could be used to produce a sweet spot. The size of the sweet spot depends on the scattering angle of the scattering elements. Such a configuration can be used, for example, for head-up displays (HUDs).

[0033] The following description is primarily directed to the case where the virtual observer window or sweet spot is in the plane of the light source image. The above description is also applicable to embodiments with an image of the spatial light modulating device in the virtual observer window, either by swapping the imaging beam path with the illumination beam path, or by swapping the plane of the spatial light modulating device with the Fourier plane. Thus, the present invention is not limited to the case where the virtual observer window or sweet spot is in the plane of the light source image.

[0034] As already mentioned briefly, a holographic display device in which problems can occur in both the imaging and illumination beam paths is the display device of US Patent Application Publication No. 2013 / 0222384. Depending on the optical system selected, different light paths can occur for different segments of the multiplexed images under certain circumstances.

[0035] For the imaging beam path, this can mean that the image planes of the spatial light modulation device are located at different depths in the individual segments. In the case of a holographic display device, the different image planes of the spatial light modulation device in different segments can in principle be compensated for, in that sub-holograms are calculated for the individual segments according to the respective image positions of the spatial light modulation device. Object points at a certain distance from the observer can for example be encoded as sub-holograms of object points in front of the spatial light modulation device for a segment with a very distant image of the spatial light modulation device, and object points at a similar distance in a closer image of the spatial light modulation device can be encoded as sub-holograms of object points after the spatial light modulation device. Despite the different distances of the images of the spatial light modulation device from the observer, a coherent three-dimensional scene can be represented. However, it can be disadvantageous that unfavourable image positions for the individual segments of the multiplex image may increase the size of the sub-holograms and therefore the computational effort. The possible displacement of the axial position of the virtual observer window as a result of the different light paths in the individual segments can be even more disadvantageous than the displacement of the images of the spatial light modulation device in the individual segments. The goal of segmentation or tiling is the generation of a uniform virtual observer window, from which a large field of view can be seen. The position of the virtual observer window displaced in depth with respect to the individual segments of the multiple images will in any case adversely affect the perception of the three-dimensional scene. It is therefore necessary to obtain a uniform light source image in the same observer plane in all segments. Furthermore, an image of the spatial light modulation device at an equal or at least similar distance from the observer is additionally generated for all segments. Typically, as disclosed in US Patent Application Publication No. 2013 / 0222384, a light source image is generated in the observer plane in a display device, which is used to generate the segments of the multiple images.The segments are generated by generating images of the spatial light modulator device offset from one another in each individual segment.

[0036] However, segmentation or tiling can also be generated for display devices with an image of the spatial light modulation device in the observer plane. In such display devices, the image of the spatial light modulation device is generated in the same position in all segments in order to generate a uniform virtual observer window for all segments. Instead, the Fourier planes of the spatial light modulation device are displaced relative to each other in the individual segments in order to generate a large field of view. Since higher diffraction orders generally result in a Fourier plane of the spatial light modulation device, such a configuration may be generated, for example, in multiple steps, by generating a non-displaced Fourier plane in a first step and performing filtering in this Fourier plane so that at most one diffraction order is transmitted and the other diffraction orders are filtered out. In a second step, an image of this filtered diffraction order is generated, which is displaced relative to each other in the individual segments in order to generate a large field of view. An alternative is a single-step system with a variable filter, in which all diffraction orders are displaced in a first step, but the aperture of the filter is also displaced so that the same diffraction orders are transmitted in each case. The descriptions made for a display device having a light source image in the observer plane can be correspondingly transferred to a display device having an image of a spatial light modulator device in the observer plane as well.

[0037] The optics for generating the illumination and imaging beam paths in a display device also have aberrations in the general case. For example, in a holographic display device with a light source image in the observer plane, the following effects are obtained: Aberrations in the imaging beam path affect the resolution at which the image of the spatial light modulating device is generated, and possibly also the sharpness and resolution of the three-dimensional scene in which a hologram is encoded on the spatial light modulating device in a holographic display device.

[0038] Aberrations in the illumination beam path can, for example, affect imaging in a sharply bounded virtual observer window: a virtual observer window that is blurred due to aberrations can, for example, result in a vignetting effect, with the result that the entire three-dimensional scene is no longer visible from a certain position within the virtual observer window.

[0039] When an optical element affects the illumination beam path and the imaging beam path, its aberrations generally affect both beam paths. Summary of the Invention

[0040] It is therefore an object of the present invention to provide an arrangement which can be used in a display device and which allows implementing a clear imaging beam path and a clear illumination beam path in the display device. By providing a display device with such an arrangement, in particular a display device arranged close to the user's eyes, it is also possible to generate a wide visible range or field of view. This can preferably be carried out in combination with a segmented multiple image of a spatial light modulation device. It is a further object of the present invention to provide a display device which has a compact and lightweight construction and which allows generating a virtual observer window in each case at the same position for all segments of the multiple image of the spatial light modulation device.

[0041] According to the invention by the features of claim 1 this object is achieved.

[0042] According to the invention a light guiding device is proposed which is particularly suitable for use in close-to-eye displays, in particular here in head-mounted displays, although its use is not limited to these displays.

[0043] Such a light guiding device according to the invention for guiding light comprises a light guide, a light coupling device and a light decoupling device. Light entering the light guide by the light coupling device propagates in the light guide via reflection at the interface surfaces of the light guide, in particular via total internal reflection. Decoupling of the light from the light guide after multiple reflections is performed by the light decoupling device. Decoupling of the light is provided after a predetermined or predefined number of reflections of the light at the interface surfaces of the light guide.

[0044] This means that with the light guiding device according to the invention, after a respective predefined or fixedly defined number of reflections of the light at the interface of the light guide, a decoupling of the light occurs therefrom at different positions within the light guide, so that in this case equal angular ranges of light can be decoupled at different positions of the light guide respectively.

[0045] If the light entering the light guiding device is formed as a light bundle or light field having a plurality of light beams, this may be particularly advantageous in that decoupling of the light beams from the light guide is provided after an equal number of reflections at the boundary surfaces of the light guide for each of all light beams of the light bundle or light field.

[0046] The light field is defined according to the invention by a number of light beams within a certain area, therefore the light field is the sum of all incident light beams.

[0047] For example, when a light guiding device is used for a single segment of a multiple image of a spatial light modulating device in a display device, for example a display device according to US Patent Application Publication No. 2013 / 0222384 A1, light coming from various pixels of the spatial light modulating device is coupled into the light guide of the light guiding device and decoupled again after multiple reflections at the interface surfaces of the light guide, equal in each case for all pixels.

[0048] A defined geometric path exists in the light guide, so that during the propagation of light in the light guide, the path of the light in the light guide and the number of reflections on its interfaces can be specifically determined, so that in this way it is predetermined that after a predetermined number of reflections on the interfaces of the light guide, the light is decoupled therefrom.

[0049] Therefore, according to the invention, a light incidence position on one of the boundary surfaces of the light guide, where the light arrives after a predefined number of reflections, can be determined from the geometric and optical properties of the light guide and the optical properties of the optical coupling device, whereby the light incidence position can be preferably determined by using the thickness and / or, if any, the curvature of the boundary surface of the light guide as the geometric property of the light guide, and the refractive index of the material of the light guide can be used as the optical property of the light guide.

[0050] The geometry of the light guide is here to be understood as the thickness and possible curvature of the light guide, which may vary depending on the embodiment of the light guide. Here, the optical properties of the light coupling device relate to at least one element provided in the light coupling device, for example a grating element. If the light coupling element is a grating element, the optical property that influences the number of reflections of the light in the light guide is the grating period of the grating element. Thus, to determine the desired number of reflections in the light guide, the thickness and possible curvature of the light guide as well as the optical property of the coupling element, in this example the grating period of the grating element, are used and taken into account. From these values, the required or desired number of reflections of the light in the light guide is then determined and defined. The formula for a grating is typically sinβ out = λ / g + sinβ in where g is the grating period, λ is the wavelength of light, and β in is the angle of incidence of light, and β out is the exit angle of the light. However, this formula only applies if the refractive index of the medium in the light path is equal before and after the grating element. If a coupling element is used to couple light from the atmosphere into the recording medium of the light guide, the refractive index of the light guide, n lightguide should be further considered: lightguide sinβ out =λ / g+n air sinβ in .

[0051] For example, a light beam with a wavelength λ=532 nm is incident perpendicularly from the atmosphere on a coupling element, the coupling element has a grating period g=400 nm, and the light guide material has a refractive index n lightguide = 1.6, the angle β is 56.2° out may be calculated, where the light beam propagates after being coupled into the light guide. In a flat light guide with a thickness d=3 mm, the light beam, for example, travels a distance 2dtanβ after reflection on the other side of the light guide. outAfter a reflection of 5 times, the light beam is again decoupled from the light guide at a distance of 5 x 8.96 = 44.8 mm from the coupling position.

[0052] The determined values ​​can preferably be saved or stored in a value table (look-up table). Saving or storing the values ​​of the number of reflections of light determined in this way in a value table can be advantageous in that these values ​​do not need to be determined again in this way, thus reducing the calculation effort. In this case, the values ​​can simply be taken from the value table and used accordingly.

[0053] Since the light guiding device contributes to a better perception of the natural environment in AR applications, it can also be advantageously used, for example, in display devices that are used as AR (Augmented Reality) display devices. In this case, "augmented reality" is generally understood as the visual representation of an information item, which means the extension of an image (video) or scene with a generated additional information item / representation, by overlay and / or superimposition. Of course, the use of such a light guiding device according to the invention is not limited to such AR display devices.

[0054] Further advantageous embodiments and refinements of the invention can be found in the further dependent claims.

[0055] In one advantageous embodiment of the invention, the optical decoupling device is arranged on the light guide such that the position of the optical decoupling device corresponds to the light entrance position, the light entrance position being the position where the light reaches on one of the boundary surfaces of the light guide after a predefined number of reflections. In this way, it is possible to ensure that at a predefined position of the light guide, the light is also decoupled from the light guide. The dimensions of the optical decoupling device in this case include the dimensions of the light bundle entering the optical decoupling device, so that it is always ensured that the light is completely decoupled.

[0056] In a particular embodiment of the invention, the optical decoupling device is controllably designed, and is controllable in such a way that in an actuation state of the optical decoupling device the light is decoupled after a predefined number of reflections, and in another actuation state of the optical decoupling device the light propagates further in the light guide. It is thus possible to control how many reflections the light should be decoupled after in the light guide. Thus the number of reflections at the interface of the light guide can be varied.

[0057] It may further be advantageous if the optical decoupling device is divided into several sections and is designed to be controllable per section, such that the number of reflections of the light at the interface of the light guide can be changed, for example by one first drive state of a section of the optical decoupling device, which corresponds to the light entrance position reached by the light after several reflections, and by another second drive state of a further section of the optical decoupling device, which corresponds to the light entrance position reached by the light after further several reflections. Furthermore, the number of reflections of the light at the interface of the light guide can be further varied by alternating control between various drive states of the sections of the optical decoupling device. The number of reflections can be varied in a particularly advantageous manner by dividing the optical decoupling device into several sections.

[0058] It may be particularly advantageous if the optical coupling device comprises at least one diffraction grating element, preferably a volume grating, or at least one mirror element, and if the optical decoupling device comprises at least one diffraction grating element, in particular a deflection grating element, preferably a volume grating, or at least one mirror element.

[0059] Coupling and decoupling of light into or from a light guide can be performed in one preferred embodiment of the present invention using a grating element, preferably a controllable grating element, for example using a volume grating. If the light guiding device is used in a display device, for example to generate a segmented multiple image of a spatial light modulation device, the decoupling of various segments from the light guide can be controlled, for example, such that at least one controllable grating element of the light decoupling device or individual sections of at least one controllable grating element are controlled for decoupling, i.e., switched on or off. A switched-off grating element of the decoupling device has the consequence, for example, that the light incident on this grating element is not coupled, but is rather reflected, propagates further in the light guide and can be coupled at another position of the light guide after additional reflection.

[0060] Instead of the at least one controllable diffraction grating element, at least one mirror element can also be used in the light decoupling device for coupling and decoupling light. For this purpose, the mirror element can have a mirror surface that is inclined with respect to the surface of the light guide.

[0061] The grating constant of the diffraction grating elements or the tilt angle of the mirror elements with respect to the surface of the light guide can be used as an optical property of the optical coupling device to determine the light incidence position that the light reaches after a given number of reflections.

[0062] It may be particularly preferred if the optical decoupling device comprises at least one passive grating element associated with a switch element, preferably a polarization selective grating element associated with a polarization switch.

[0063] Instead of at least one switchable grating element, the optical decoupling device can also include a passive grating element in combination with a switchable element. For example, the passive grating element can be designed as a polarization-selective grating element, in particular as a polarization-selective Bragg grating element, which polarizes light in one polarization direction and not in another polarization direction. In this case, the polarization-selective grating element can be combined with a polarization switch as a switchable element. In this case, this passive grating element associated with the switch element can be provided on the outer surface or on the cladding layer of the light guide.

[0064] In contrast to polarization gratings with large or larger grating periods, polarization-selective Bragg grating elements have grating periods and Bragg characteristics of <2 μm. Depending on the direction of the circular polarization of the incident beam, the beam is either transmitted without diffraction or diffracted, and the maximum diffraction efficiency is achieved only at the correct angle of incidence. The fabrication of such polarization-selective Bragg grating elements is carried out in two steps. In the first step, the holographic structuring of the layer is carried out by a bulk photoalignment technique of liquid crystal polymer layers, caused by the photoselective cycloaddition of cinnamate ester groups at room temperature. Finally, thermal tempering (heating for a longer time) of the layer above the glass temperature Tg enhances the photoinduced optical anisotropy of the layer and thus the diffraction efficiency of the grating elements.

[0065] Circularly polarized selective Bragg grating elements with high diffraction efficiency (DE>95%), large diffraction angle (e.g., greater than 30°), and wide angle and wavelength acceptance are formed based on photocrosslinkable liquid crystal polymers (LCPs). These grating elements are the result of the specific properties of these photocrosslinkable liquid crystal polymers and a two-step photochemical / thermal treatment. Holographic structuring allows high spatial resolution and arbitrary alignment of the liquid crystal director, as well as high optical quality and thermal and chemical stability of the final grating elements.

[0066] Such grating elements can be used in combination with a polarization switch as a binary switchable deflection element and / or as a switching element for pre-deflection using a field lens. Furthermore, they can also be used as a deflection polarization grating or as a reflective polarization filter. The high usable diffraction angle combined with the high diffraction efficiency makes this type of grating element attractive for head-mounted displays in combination with AR (Augmented Reality) / VR (Virtual Reality) applications because of the system-specified short focal length and large numerical aperture required in head-mounted displays. If two opposing grating elements are used, the deflection angle of the light can be doubled.

[0067] A more extensive description of polarization-selective Bragg grating elements that can be used in optical decoupling devices of light directing devices is provided in the description of the figures below.

[0068] In a further embodiment of the invention, the at least one controllable grating element of the optical decoupling device extends across a predetermined area of ​​the light guide, the grating element being divided into a plurality of switchable sections.

[0069] In one possible decoupling region of the light guide, at least one switchable decoupling element is provided in the form of a grating element. This grating element is divided into switchable sections. By switching on or off a defined part of the grating element, the position of the decoupling of the light from the light guide can be determined and defined. This also applies to passive grating elements associated with the switch element, i.e. for example, polarization-sensitive Bragg grating elements associated with a polarization switch. The passive grating element then extends over a given region of the light guide, where the switch element is divided into individually switchable sections.

[0070] The decoupling element in the form of a switchable grating element may for example be a reflective grating element or a transmissive grating element, where a reflective grating element may be provided on the outside of the light guide and a transmissive grating element may be provided on the inside of the light guide.

[0071] In one particularly preferred embodiment of the invention, a light guide may be provided that is curved in at least one direction in at least some of the sections.

[0072] In certain embodiments, it may be preferred that the light guide has a flat or planar or planar geometry. This is the case, for example, in applications where space saving is important, since flat light guides take up less installation space than curved light guides. In other embodiments, particularly for head-mounted displays, for example, the light guide can also have a curved geometry. In the general case, the light guide can also be composed of straight and curved parts, or parts with different intensities of curvature. For example, the coupling region can be formed flat, while the decoupling region can be formed curved. For example, in the case of a head-mounted display designed like glasses, the flat part of the light guide can be located laterally to the head in the region of the glasses temples, and the curved part can be located in front of the user's eyes. A curved light guide allows the use of a diffraction grating element in the light decoupling device, the decoupling angle of which does not depend on the position of the diffraction grating element on / in the light guide.

[0073] According to the invention, in one advantageous embodiment of the invention, the light guide has, at least in sections, a hollow cylindrical shape, the boundary surfaces of which are formed as sections with different radii of the hollow cylinder. The light guide can, for example, have a shape similar to a semicircle.

[0074] The light coupling device is provided in the coupling region of the light into the light guide of the light guiding device according to the invention. The light coupling device comprises at least one coupling element, for example in the form of a grating element or a mirror element. The grating element can be designed to be controllable and / or switchable. Furthermore, the coupling element can be provided on the outer or inner surface of the light guide. In one embodiment of the coupling element, the coupling element can be designed as a reflective grating element provided on the inner surface of the light guide. The light entering the light guide first passes vertically once through the light guide, is deflected on the inner surface of the light guide by the reflective grating element or mirror element, and then propagates in a zigzag manner through the light guide.

[0075] In one exemplary embodiment, in this case, the propagation angle can be selected such that reflection into the surrounding medium, e.g., air, occurs by total internal reflection at the interface of the light guide. Alternatively, an additional layer, e.g., a dielectric layer stack, can be provided on the inner and outer cladding surfaces or interface surfaces of the light guide. This dielectric layer causes reflection of light incident at a specific or predetermined angle. In this case, the dielectric layer can preferably be designed such that ambient light can pass through the light guide during the AR application when the light guiding device according to the present invention is used in an apparatus for AR application.

[0076] It may therefore further be advantageously provided that the light guide has a dielectric layer on its interface.

[0077] In one particularly advantageous embodiment of the invention, the light deflection angles of the light coupling device and the light decoupling device can be selected to be opposite, such that a light beam incident perpendicularly on the surface of the light guide exits the light guide perpendicularly, i.e. at a right angle. In other words, the light deflection angle of the grating elements of the light coupling device can be opposite to the light deflection angle of the grating elements of the light decoupling device, such that a light beam incident perpendicularly through the outer surface of the light guide exits perpendicularly again from the inner surface of the light guide.

[0078] Alternatively, the light guide of the light directing device may be constructed from glass or optical plastic.

[0079] The grating elements of the optical coupling and / or decoupling devices can be designed to be transmissive or reflective.

[0080] It may be preferred that the dimensions of the light coupling device are larger than the dimensions of the light bundle entering the light guiding device, and the position at which the light bundle is coupled into the light guide is movable within the bounds of the dimensions of the light coupling device. By displacing the coupling position of the light bundle during a given or specified number of reflections within the light guide, the decoupling position of the light bundle exiting the light guide can also be displaced.

[0081] This object is further achieved by an inventive display device as defined in claim 18.

[0082] The display device according to the invention can be designed as a holographic display device or as an autostereoscopic display device.The display device according to the invention can be designed particularly advantageously as a close-to-eye display device, for example a head-mounted display or a head-up display.In this case, the display device comprises an illumination device, at least one spatial light modulation device, an optical system and a light-guiding device according to the invention.

[0083] For the following description of the features of the display device according to the invention, it should first be noted here that for a large field of view, the pupils of an observer of a scene generated using the display device typically rotate differently when the observer views different parts of the field of view. A display device or display with a large field of view and a virtual observer window should generally be understood in the sense of the present application as the virtual observer window rotates together around its center point when the pupils of the observer's eyes rotate. The requirement that the virtual observer window is generated at the same position for all segments of the multiple images of the spatial light modulation device should generally be understood as the virtual observer window may be tilted with respect to each other for each of the various segments of the multiple images, but have a common center point.

[0084] When an observer views various parts of a large field of view and simultaneously rotates his eye, the rotation takes place around the center point of the eye lens, which is located about 12 mm behind the pupil. Thus, a lateral displacement of the pupil position also occurs automatically upon rotation of the eye lens. A rotation of 15° corresponds, for example, to a displacement of the pupil of about 3.2 mm. Thus, in the case of a display device with a large field of view, which is generated, for example, using segmented multiple images of a spatial light modulation device, alternative embodiments can also deliberately take into account this change in pupil position upon rotation of the eye lens, so that the virtual observer windows of the individual segments of the multiple images are shifted accordingly relative to each other. For segments with a spacing of 15° in the field of view, for example, the center points of the virtual observer windows are also displaced by 3.2 mm relative to each other, so as to correspond to the pupil center points upon eye rotation. In this case, each segment deliberately has a slightly displaced position and, possibly, even an inclined alignment of the virtual observer windows.

[0085] The curvature of the light guide can for example be adapted such that this displacement results in a vertical decoupling of light from the light guide at a distance from the light guide surface to the observer.

[0086] In a display device according to the invention, the decoupling of light occurs at different positions within the light-guiding device according to the invention after a corresponding predetermined number of reflections of the light at the interfaces of the light guide.

[0087] As mentioned, a defined geometric path exists in the light guide. Thus, during the propagation of light in the light guide, the light path in the light guide and the number of reflections on the interface of the light guide can be defined. Thus, the length of the light guide used can be predefined, and the focal length of the imaging element of the optical system and the distance of the virtual observer window or sweet spot from the spatial light modulation device and the light guiding device can be set so that a specific imaging beam path and / or illumination beam path can be set. The term "observer area" used is intended to include both the virtual observer window or sweet spot, depending on whether the display device according to the invention is designed as a holographic display device or as a stereoscopic display device.

[0088] In an embodiment of a display device according to the invention, an image of the spatial light modulating device may be generateable by the light directing device and the optical system, the image defining a field of view into which items of scene information encoded in the spatial light modulating device may be reconstructed for viewing through a virtual observer area.

[0089] It may be advantageous if a light source image of the at least one light source of the illumination device or an image of the spatial light modulation device can be generated by the light guiding device and the optical system in the light path after decoupling of the light from the light guiding device.

[0090] In this case, a virtual observer region can be created in the plane of the light source image or in the plane of the image of the spatial light modulator device.

[0091] In a further embodiment of the invention, the light guide of the light guiding device is curved, at least in sections, as a section of a hollow cylinder, and a virtual observer region can be generated in the region of a center point of an arc of the hollow cylinder.

[0092] It may be particularly preferred if multiple images of the spatial light modulating device, consisting of a plurality of segments, are generated by the light directing device and the optical system, the multiple images defining a field of view within which scene information encoded in the spatial light modulating device is reconstructed for observation through a virtual observer region in the plane of the light source image.

[0093] In another embodiment, in this case multiple images of a single diffraction order consisting of multiple segments are generated by the light guiding device and the optical system in the Fourier plane of the spatial light modulator device, the multiple images defining a field of view within which scene information encoded in the spatial light modulator device may be reconstructed for observation through a virtual observer region in the image plane of the spatial light modulator device.

[0094] An image of the spatial light modulator device can be generated by the light directing device and the optical system, this image defining the size of a field of view in which a scene or object can be generated or reconstructed.

[0095] According to the invention, to generate a wide field of view, at least one spatial light modulation device may be imaged multiple times, adjacent to each other and / or above and below or laterally offset with respect to each other. This is performed at a speed such that the chronological compositing of the fields of view is not perceived by the observer. However, the images may also overlap partially or completely.

[0096] The scene or object can be generated in front of, behind or around the spatial light modulator device. In particular, for holographic reconstruction of a scene, the region of scene generation depends on the depth encoding of the scene or object in the hologram.

[0097] The spatial light modulator device can be produced such that it can be imaged in an enlarged manner within the field of view. The surface of the spatial light modulator device can be enlarged within the field of view according to the number of segments to be produced in the multiple images of the spatial light modulator device. In this respect, the image of the spatial light modulator device is produced in an enlarged manner, thus defining the size of the field of view.

[0098] A detailed disclosure of the generation of segmented multiple images of spatial light modulator devices can be found, for example, in US Patent Application Publication No. 2013 / 0222384 A1, the disclosure of which is incorporated herein in its entirety.

[0099] In another embodiment, the optical system can be used to generate the Fourier plane of at least one spatial light modulation device. This can be done, for example, using a 2f configuration, where the SLM is placed in the object-side focal plane of the imaging element and the Fourier plane appears in the image-side focal plane of the imaging element. A filter aperture can be placed in this Fourier plane, which transmits at most one diffraction order and filters out the other diffraction orders. A segmented multiple image of one or more portions of the diffraction orders transmitted by the filter aperture can then be generated by the optical system. This multiple image of the diffraction orders defines the size of the field of view in which a scene or object can be generated or reconstructed.

[0100] According to the invention, to generate a wide field of view, the diffraction orders of at least one spatial light modulation device can be imaged multiple times, adjacent to each other and / or above and below or laterally offset with respect to each other. This is performed at a speed such that the chronological compositing of the field of view is not perceived by the observer. However, the images can also overlap partially or completely.

[0101] The scene or object can be generated in front of, behind or around the Fourier plane of the spatial light modulator device. In particular, for holographic reconstruction of a scene, the region of scene generation depends on the depth encoding of the scene or object in the hologram.

[0102] The diffraction orders of the spatial light modulator device can be generated so that they can be imaged in a magnified manner in the field of view. The diffraction orders in the Fourier plane of the spatial light modulator device can be generated according to the number of segments of the spatial light modulator device to be generated in the field of view, where the images of the diffraction orders are generated in a magnified manner in the Fourier plane of the spatial light modulator device, thus defining the size of the field of view.

[0103] An embodiment with segmented multiple images of at least one spatial light modulating device is described in more detail below, however, these descriptions are equally transferable to the case of segmented multiple images of diffraction orders in the Fourier plane of a spatial light modulating device.

[0104] The use of a light guide in the configuration of a segmented multiple image of at least one spatial light modulator device according to the invention means in particular that, for a single segment of the multiple image of the spatial light modulator device, light from various pixels of the spatial light modulator device is coupled into the light guiding device and decoupled again after multiple reflections of the light at the interface surfaces of the light guide, equal in each case for all pixels of the spatial light modulator device.

[0105] In other words, for the image, or for a single segment of the multiple images, the decoupling of light coming from various pixels of the spatial light modulator device after entering the light guiding device can be provided after multiple reflections at the interface of the light guide, an equal number of times for each of all pixels.

[0106] Furthermore, for different segments of the multiple images, the number of reflections of the light at the interface of the light guide for the generation of one segment may be different from the number of reflections of the light at the interface of the light guide for the generation of another segment. Different segments of the multiple images of the spatial light modulation device can, for example, be formed such that for adjacent segments of the multiple images, different numbers of reflections are performed at the interface of the light guide. However, other configurations are also possible, for example generating equal numbers of reflections of the light at the interface of the light guide for different segments of the multiple images, but using displaced coupling positions or changed coupling angles of the light.

[0107] As already mentioned with respect to the light guiding device according to the invention, the decoupling of light for generating different segments of the multiple images can be controlled, for example, such that at least one grating element or individual sections of at least one grating element of the light coupling device are switched on or off in order to decouple the light. A switched off grating element has the consequence, for example, that light incident on this grating element is not decoupled, but rather is reflected, propagates further in the light guide and can be decoupled at another point in the light guide after an additional reflection.

[0108] Instead of grating elements, the optical decoupling and coupling devices can also include mirror elements, in particular mirror elements with inclined mirror surfaces, which can also be used to couple light into and decouple light from the light-guiding device.

[0109] In an embodiment of the invention, for different segments of multiple images, the number of reflections of the light at the boundary surfaces of the light guide may be equal and the coupling position of the light into the light guide may be different for these segments.

[0110] An optical deflection device may be advantageously provided in front of the light guiding device in the direction of the light to shift the coupling position of the light into the light guide.

[0111] The displacement of the coupling position of the light on the light guide can preferably be performed by an optical deflection device, which for this purpose can comprise at least one diffraction grating element with a settable grating period. For example, the optical deflection device can comprise two diffraction grating elements. The first diffraction grating element then deflects the incident light by a settable angle, and the second diffraction grating element deflects the light deflected by the first diffraction grating element in the opposite direction by an angle with equal absolute value but opposite sign, resulting in or generating an essentially parallel offset of the light.

[0112] In a further advantageous embodiment of the display device, the optical system may be designed as a two-stage optical system, in a first stage an intermediate image of the at least one light source of the lighting device is generated by at least one first imaging element of the optical system, and in a second stage the intermediate image of the light source is imaged by at least one second imaging element of the optical system into a virtual observer region in the light path after the decoupling of the light from the light guide.

[0113] According to the invention, a two-stage optical system can be used in a display device with a light-guiding device. For this purpose, the display device comprises at least one spatial light modulating device and an illumination device which illuminates the spatial light modulating device and comprises at least one light source. In a first step, an intermediate image of the illumination device, i.e. an intermediate image of the at least one light source which the illumination device comprises, and therefore also an intermediate image of the observer area, in particular of the virtual observer window or sweet spot, is generated in the light direction after the spatial light modulating device using at least one first imaging element, for example a lens. In a second step, this intermediate image of the illumination device is imaged in the observer plane, more precisely in the actual virtual observer window or sweet spot, using at least one further or second imaging element, which may be a lens. For this purpose, the light-guiding device is arranged in the display device in the beam path after the second imaging element and the intermediate image of the illumination beam path. The at least one first imaging element simultaneously generates an image of the spatial light modulating device. The second imaging element, which images the illumination device and the virtual observer window or sweet spot, also contributes to the imaging of the spatial light modulating device. By appropriately selecting the focal length of the imaging element of the optical system, a further image of the spatial light modulation device is generated inside the light guiding device, in particular inside the light guide. The intermediate image of the spatial light modulation device inside the light guiding device can be generated only in the deflection direction of the at least one grating element of the optical coupling device in an embodiment of the invention comprising a cylindrical imaging element, while in the direction perpendicular thereto the intermediate image of the spatial light modulation device can be located outside the light guiding device.

[0114] Furthermore, in a particularly advantageous embodiment of the display device, at least one variable imaging system can be provided which is arranged in front of the light-guiding device in the light direction.

[0115] The at least one variable imaging system may be provided near or as close as possible to or in an intermediate image plane of the at least one light source of the illumination device, and / or a variable imaging system may be provided near the spatial light modulator device or in an image plane of the spatial light modulator device.

[0116] The at least one variable imaging system may comprise at least one imaging element, which may be designed as a grating element with a controllably variable period, or as a controllable liquid crystal element, or as at least two lens elements with a variable distance from each other. At least one imaging element of the variable imaging system may be designed as transmissive or reflective. For example, the variable imaging system may comprise two controllable liquid crystal elements as imaging elements, which may both be designed as reflective. For a reflective embodiment of the two liquid crystal elements, a certain distance between the two liquid crystal elements is required. The two liquid crystal elements therefore cannot be positioned exactly at the intermediate image plane of the lighting device. Therefore, the variable imaging system, if it has such liquid crystal elements, should be considered as a whole to be positioned only as close as possible to the intermediate image plane of the lighting device. Thus, a variable imaging system can be provided in or very close to the intermediate image plane of the illumination device, which at the same time represents the intermediate image plane of the virtual observer window or sweet spot. A variable imaging system should be understood here as an imaging system whose focal length is variable. Also, at least one first imaging element of the optical system generates an image of the spatial light modulation device. At least one second imaging element of the optical system, which images the virtual observer window or sweet spot, also contributes to the imaging of the spatial light modulation device. However, it is advantageous since the image of the spatial light modulation device can be displaced in depth using a variable imaging system in or close to the intermediate image plane of the illumination device or the virtual observer window or sweet spot, without affecting the illumination beam path, as well as the position and size of the virtual observer window or sweet spot itself.

[0117] Thus, according to the invention, the image of the spatial light modulating device can be displaced by the variable imaging system for each individual segment of the multiple images of the spatial light modulating device, at least partially compensating for differences in the optical paths of the light through the light guide of the light directing device for the different individual segments. The calculation of how much the image of the spatial light modulating device has to be displaced for each individual segment is performed before the display device is operated.

[0118] Preferably, in this case, the image seen by the observer from the virtual observer window or sweet spot of the spatial light modulation device provides an equal or at least similar depth for all segments of the multiple images. The variable imaging system includes at least one imaging element, which can be designed, for example, as a diffraction grating element (for example, liquid crystal grating (LCG)) with a controllable variable period or as an electrowetting lens or a liquid crystal lens. The variable imaging system can also include, for example, a system of at least two imaging elements in the form of at least two lenses, the distance of which can be variably set relative to each other, for example a kind of zoom objective lens.

[0119] It may be advantageous if a variable prism function or a variable lens function and / or a variable complex phase function is written into at least one controllable imaging element of said at least one variable imaging system.

[0120] A controllable imaging element of the variable imaging system can be placed at the intermediate image plane of the illumination device to change the coupling position of the light into the light guide of the light guiding device. By specifically writing variable prism functions into the controllable imaging element, the coupling position of the light on the light guide can be displaced. In this way, the image of the spatial light modulator device can be displaced laterally within the field of view.

[0121] In such a controllable imaging element of the variable imaging system, for example a phase modulation element such as a diffraction grating element (LCG) with a controllable variable period, furthermore, instead of or in addition to a variable lens or prism function, a variable complex phase function can also be written, which deviates from a simple linear or spherical function. For example, the phase function for aberration correction can be a polynomial. The aberrations can be described, for example, by Zernike polynomials. This procedure is advantageously used for the compensation of aberrations, especially when the display device according to the invention is designed as a holographic display device. It can therefore be advantageously provided that the variable imaging system is arranged in the light source image plane of the illumination device, or in the Fourier plane of the spatial light modulation device, in order to correct aberrations in the imaging beam path.

[0122] When light is coupled into and decoupled from a light guide, for example with the aid of a diffraction grating element, aberrations may result. These aberrations, like astigmatism, can have an effect on the imaging beam path, for example in the horizontal and vertical directions, such that the image of the spatial light modulator device occurs at different distances relative to the observer. Furthermore, different segments can also have different aberrations due to different lengths of the path between the coupling and decoupling elements.

[0123] Correction of aberrations in the imaging beam path can be performed, for example, in combination with determining the amplitude and phase of the hologram during back calculation from the virtual observer window through the light guide to the spatial light modulation device. However, the back calculation is first performed only from the virtual observer window to the intermediate image plane of the illumination device. In particular, in an exemplary embodiment in which there are essentially imaging beam path aberrations and no or only slight illumination beam path aberrations, in the back calculation, the light beams in the intermediate image plane of the illumination device have essentially correct positions, but due to the aberrations, have inaccurate angles compared to the target positions and angles of the direct light beams in the virtual observer window. Therefore, for each light beam, the angle can be corrected by a corresponding local imaging element of the variable imaging system in the intermediate image plane of the illumination device, for example a local deflection grating element. For example, if β(x) is the desired angle of incidence of a light beam at a position x, but β'(x) is the actual angle of incidence of this light beam at this position x, then the correction function Δβ(x)=β(x)-β'(x) is determined using it to at least partially eliminate this aberration. The local grating period of the imaging element of the variable imaging system is determined as g(x)=λ / tan Δβ(x), where λ is the wavelength of the light used. Thus, taking into account the imaging scale from the intermediate image plane of the illumination device to the virtual observer window, the grating period of the imaging element can be changed or adapted so that the position and desired angle of incidence of each individual light beam corresponds to the angle of incidence of the virtual observer window itself.

[0124] The advantage of correcting the aberrations by a phase function in the intermediate image plane of the illumination device is that this correction is preferably independent of the content of the three-dimensional (3D) scene. Therefore, the correction function can be calculated once in each case for each segment of the multiple images of the spatial light modulation device and for intermediate positions of the spatial light modulation device during the continuous displacement of the coupling position of the light in the light guide, stored in a value table and then repeatedly applied to calculate the corresponding grating period.

[0125] A second, similarly designed variable imaging system can also be advantageously positioned in the image plane of the spatial light modulator device to correct aberrations in the illumination beam path and generate a virtual observer region for all segments of the multiple images at the same location.

[0126] By using a variable imaging system in the image plane of the spatial light modulator device instead of the Fourier plane of the spatial light modulator device, aberrations in the illumination beam path generated by at least one diffraction grating element of the optical coupling device and / or optical decoupling device can be corrected during coupling of light into and / or decoupling of light from the light guide.

[0127] In a further advantageous embodiment of the display device, the at least one controllable grating element of the light decoupling device of the light-guiding device may comprise at least one lens function.

[0128] In addition to the variable imaging system, the display device in the optical decoupling device of the light guide device can also include a grating element with at least one lens function instead of a simple grating element. If multiple segments of the spatial light modulation device are generated to generate a large field of view, the lens function can be different for each different segment. However, in another embodiment, the same lens function can be provided for all segments of the multiple images. For example, in a light guide where multiple segments are generated only adjacent to each other in the horizontal direction, but there is only a single segment in the vertical direction, the optical decoupling device can have the same cylindrical lens function for all segments that generate a vertical focus. This lens function contributes to the total focal length of the variable imaging system. This allows the focal length of the variable imaging system to be changed within a set range, which can be reduced.

[0129] A display device according to the invention may advantageously be designed as a head-mounted display having two display devices, each of which is designed in accordance with a display device according to any one of claims 18 to 38 and which is assigned respectively to the left eye of an observer and to the right eye of the observer.

[0130] This object is further achieved by a method having the features of claim 40.

[0131] The method according to the invention for generating a reconstructed scene by means of a spatial light modulation device and a light guide is carried out as follows: the spatial light modulator modulates incident light with desired information of the scene; the light modulated by the spatial light modulator device is coupled into the light guide by an optical coupling device and decoupled from the light guide by an optical decoupling device; The light is decoupled from the light guide after a certain number of reflections at the interface of the light guide.

[0132] Advantageously, an image of the spatial light modulating device or a multiple image of the spatial light modulating device consisting of a number of segments is generated.

[0133] For some of the segments of the multiple images, an intermediate image of the spatial modulation device may be generated within the light guide.

[0134] A first intermediate image of the spatial light modulating device is generated in front of the light guiding device or in front of the light guide in the light direction. Further intermediate images of the spatial light modulating device can be generated such that at least some intermediate images of the segment of the multiple images of the spatial light modulating device are located inside the light guide. Intermediate images of other parts of the segment of the multiple images can also be located outside the light guide.

[0135] Using at least one variable imaging system, which is preferably positioned in the plane of the light source image of at least one light source of the illumination device in the light path before coupling of the light into the light guide, the image of the spatial light modulator device is displaceable with respect to each individual segment of the multiple images such that the different light paths within the light guide resulting for the individual segments are at least partially compensated.

[0136] Using a variable imaging system, aberration correction may be performed for each separate segment of the multiple images by varying at least one optical property of the variable imaging system, a correction function being calculated and stored once in each case for each segment.

[0137] If the tunable imaging system includes, for example, a grating element with a controllably variable period (LCG), a phase function in the form of a polynomial can be written therein for aberration correction.

[0138] The aberration correction for each separate segment of the multiple images may be performed in the intermediate image plane of the illumination device and / or in the amplitude and phase curves of a hologram encoded on the spatial light modulator device.

[0139] It may be advantageous if the calculation of the correction function is performed by numerical inversion of the light path and back tracing of a light beam from a virtual observer region through the light guide to the plane of the light source image of the at least one light source of the lighting device.

[0140] There are various options for configuring the teaching of the invention in an advantageous manner and / or for combining the above and below described exemplary embodiments and / or configurations with one another. For this purpose, reference should be made on the one hand to the claims dependent on the independent claims and on the other hand to the following description of preferred exemplary embodiments of the invention based on the drawings, in which also generally preferred configurations of the teaching are described. In this case, in principle, the invention is described on the basis of the described exemplary embodiments. [Brief description of the drawings]

[0141] The drawings are as follows: [Figure 1] 1 shows a schematic diagram of a holographic display device according to the prior art; [Diagram 2] 2 shows a schematic diagram of a further embodiment of the display device according to FIG. 1; [Diagram 3] 2 shows a schematic diagram of a further embodiment of the display device according to FIG. 1; [Figure 4] 2 shows a schematic diagram of a further embodiment of the display device according to FIG. 1, which is designed as a head-mounted display. [Diagram 5] 1 shows a schematic diagram of a simple display device without a light guide. [Figure 6] 1 shows a schematic diagram of a magnified virtual image of a spatial light modulator device. [Figure 7] 7 shows a schematic diagram of the change in position of the spatial light modulator device in relation to FIG. 6. [Figure 8] 1 shows a schematic diagram of a light guiding device according to the present invention in a first embodiment; [Figure 9] 2 shows a schematic diagram of a light guiding device according to the present invention in a second embodiment. [Figure 10] 3 shows a schematic diagram of a light guiding device according to the present invention in a third embodiment. [Figure 11] 11 shows a schematic diagram of a light guiding device according to the invention according to FIG. 10, in which the light guide is cylindrical in shape. [Figure 12]2 illustrates a schematic illustration of an illumination beam path of a display device having a light guiding device; [Figure 13] 1 shows a schematic of the imaging beam path of a display device, where focal points are formed inside the light guide for each individual pixel. [Figure 14] 3A and 3B illustrate schematic diagrams of displacement of the coupling position of light in an optical deflection device. [Figure 15] 13A-B show schematic diagrams of the inverse calculation for determining the amplitude and phase of a hologram from a virtual observer window through a light guide to a spatial light modulator device. [Figure 16] 16 shows a graphical representation of the intensity distribution in the plane of a spatial light modulator device that may result from back-calculation using FIG. [Figure 17] 1 illustrates a schematic of the back calculation and aberration correction at an intermediate image plane of an illumination device. [Figure 18] 1 shows a schematic representation of a display device according to the invention in the form of a head mounted display; [Figure 19] In a) a flat light guide is shown and in b) a curved light guide with reference to the propagation of light within the light guide. [Figure 20] 1 shows a schematic of a flat light guide, with different light beams being coupled into the light guide at different positions; [Figure 21] 1 illustrates a schematic representation of an embodiment of a light guide device comprising a light guide and a light decoupling device; [Figure 22] 2 shows a schematic diagram of a second embodiment of a light guide device comprising a light guide and a light decoupling device; [Figure 23] 3 shows a schematic diagram of a third embodiment of a light guide device comprising a light guide and a light decoupling device; [Figure 24] 4A illustrates a schematic diagram of a fourth embodiment of a light guide device comprising a light guide and a light decoupling device; [Diagram 25] 5A illustrates a schematic diagram of a fifth embodiment of a light guide device comprising a light guide and a light decoupling device; [Figure 26]6 illustrates a schematic diagram of a sixth embodiment of a light guide device comprising a light guide and a light decoupling device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0142] For simplicity, it is noted that in the figures, identical elements / parts / components have the same reference numerals.

[0143] To understand the exemplary embodiment described here, we first explain the relationship between the imaging and illumination beam paths, as well as the size of the observer area, i.e. virtual observer window or sweet spot, and the field of view in a display device, especially one based on a simple holographic head-mounted display without a light guide. When the term "observer window" is used hereafter, it can also be understood as "sweet spot" if the application is also applicable to a stereoscopic display device. This display device comprises an illumination device, a spatial light modulation device, hereafter called SLM, and an optical system with a lens idealized for the purposes of this description, i.e. a thin lens without imaging errors. Such a display device has a limited field of view and is therefore not suitable for augmented reality applications, hereafter called AR applications. Such a display device is shown diagrammatically in FIG. 5.

[0144] The SLM is illuminated with a plane wave 1 of wavelength λ. The plane wave 1 can for example be generated by an illumination device which comprises a point source and is located at a focal length from a lens of an optical system arranged between the point source and the SLM. A virtual image of the point source at infinity is then generated. The SLM has a pixel pitch p and is located at a distance d from a lens 2 which has a focal length f1. When illuminating the SLM with a plane wave, the illumination device is located at infinity. The illumination device is then imaged in the focal plane BE of the lens 2, i.e. at a distance f1 from the lens 2, which is evident from the top diagram of FIG. 5.

[0145] When a hologram is written into the SLM, a virtual observer window VW of size f1λ / p is generated on the focal plane BE of lens 2. As is apparent from the lower figure of FIG. 5, this can be taken into account in geometric optical modeling by observing the light beams emitted from the pixels of the SLM at the diffraction angles. These light beams are respectively emitted from different pixels of the SLM, and are shown here in different gray scale tones.

[0146] In this case, the field of view is obtained from the arctangent of the ratio of the spatial dimension of the SLM divided by the focal length f1 of lens 2. This means that the horizontal field of view is calculated as arctan(width of SLM) / f1, and the vertical field of view is calculated as arctan(height of SLM) / f1.

[0147] When the SLM has a distance d < f1 from lens 2, according to the imaging equation 1 / d' - 1 / d = 1 / f1, an enlarged virtual image 3 of the SLM is generated at a distance d' from a lens having a magnification β = d' / d. This is schematically shown in FIG. 6. When the SLM has a distance d > f1 from lens 2, a real image is generated instead of a virtual image.

[0148] If the distance of the SLM from lens 2 is changed while its focal length remains unchanged, then the virtual observer window VW, the position and size of the virtual observer window VW, and the field of view 4 accordingly remain the same, and only the position of the image of the SLM is changed. This is schematically shown in FIG. 7. However, for example, if the focal length of lens 2 is changed, then the position of the image of the illumination device, and the position of the virtual observer window VW, and the size of the virtual observer window VW, the size of the field of view 4, and the image position of the SLM all change.

[0149] In particular, the field of view has a fixed relationship to the size of the virtual observer window, since both depend on the focal length f1 of the lens or the optical system of the display device. If the virtual observer window is enlarged, the field of view will be reduced in its size and vice versa. In general, the lens or optical system used will affect both the illumination beam path and the imaging beam path in the display device.

[0150] The optical system of a display device may generally include multiple lenses or imaging elements. The total focal length and principal plane of the system can then be determined according to known methods of geometric optics. The above description therefore applies to the entire system.

[0151] If a light guide is introduced into such a display device having an optical system with multiple imaging elements and initially only a single image of the SLM is used, then the fixed coupling and decoupling positions of the light entering and propagating within the light guide, as well as the light path between the coupling and decoupling positions of the light on the light guide, must therefore be taken into account in the distances between the SLM, the imaging elements of the optical system and the virtual observer window in the imaging beam path and the illumination beam path.

[0152] If a light guide is, for example, introduced between at least one imaging element and the virtual observer window, and an imaging element having a focal length of 60 mm is provided close to the coupling of light into the light guide and the light path through the light guide is 40 mm, the virtual observer window can therefore be generated at a distance of 20 mm from the decoupling side from the light guide.

[0153] FIG. 8 shows an illumination beam path for a display device according to the invention with a light guiding device 5. The light guiding device 5 comprises a light guide 6, a light coupling device 7 and a light decoupling device 8. In this case, the light coupling device 7 and the light decoupling device 8 each comprise at least one mirror element 9, 10. The mirror elements 9, 10 in FIG. 8 are designed as tilted mirror elements. Instead of mirror elements, the light coupling device 7 and the light decoupling device 8 can alternatively also comprise grating elements. The mirrors or grating elements of the light coupling device 7 and the light decoupling device 8 are explained in more detail below. The display device comprises an SLM and an optical system with at least one imaging element. The at least one imaging element is designed here as a lens 11. The SLM and the lens 11 are arranged in front of the light coupling element 7 in the light direction. For simplicity, only three pixels P1, P2 and P3 of the SLM are shown. Light emanating from each pixel P1, P2, P3 of the SLM is guided via a lens 11 to the light-guiding device 5 and enters it. The number of reflections of light to be performed inside the light guide 6 can be determined from the geometry of the light guide 6, i.e. for example the thickness or possible curvature, and the optical properties of the light coupling device 7, in particular the tilt angle of the tilted mirror elements or the grating period if grating elements are used. Depending on where the light is to be coupled into the light guide, a certain number of reflections of light in the light guide 6 is required, which can be defined in advance. These values ​​of the number of reflections for the various decoupling positions can be stored in a value table and are thus available during use and do not have to be calculated again. They therefore only have to be determined once. In FIG. 8 the light in the light guide 6 performs a certain number of reflections at its interface. In this case, after the decoupling of the light from the light-guiding device 5, an image of the illumination device is generated at a certain distance from it. A virtual observer window VW can be generated at this point of the image of the illumination device.

[0154] If a light guiding device 5 is introduced between the SLM and an optical system, here a lens 11, the light path through the light guide 6 will affect the image position of the SLM. For example, if the SLM has a distance of 50 mm from the lens 11, the SLM may be placed 10 mm away from the light guiding device 5 if the light path in the light guide is 40 mm.

[0155] Thus, Figure 8 shows a light guiding device 5 in a display device, where the light of all pixels of the SLM is decoupled again from the light guiding device 5 after a certain number of reflections in the light guide 6. The display device shown in Figure 8 only produces a single image of the SLM.

[0156] However, to be able to generate a large field of view, a segmented multiple image of the SLM should be generated. In such a display device capable of generating a large field of view, the light of the individual segments of the multiple image of the SLM is decoupled from the light guiding device at different positions.

[0157] For example, if light is coupled into the light-guiding device at a fixed position, but decoupled from the light-guiding device at different positions for different segments of the multiple image of the SLM, a different light path through the light guide itself is generated for each segment, as is evident from FIG. 9. This is especially relevant for the illumination beam path. In particular, this means that for a flat or planar light guide in the light-guiding device, which is placed between an imaging element with a fixed focal length and a virtual observer window, the distance of the virtual observer window for decoupling the light from the light guide changes for each segment of the multiple image of the SLM. However, this is disadvantageous, since the entire scene generated with the display device cannot be observed from the same position. The observer has to move his head in order to see a section of the generated scene from each of the various positions. It is therefore important to generate a common virtual observer window in a common position for all segments of the multiple image of the SLM that are at equal distances from the light-guiding device.

[0158] In order to remedy this drawback of different positions of the virtual observer window for different segments of the multiple images of the SLM, the display device comprises a variable imaging system in the beam path. The variable imaging system comprises at least one imaging element, in particular a diffraction grating element with a controllably variable period, or a controllable liquid crystal element, or at least two lens elements whose distance from each other is variable. The imaging element may be at least one lens with a variable focal length. This variable imaging system is arranged in the light direction in front of the optical coupling device of the light-guiding device. The optical properties of the variable imaging system, i.e. for example the focal length or the grating period, are adapted to each segment of the multiple images of the SLM in each case such that a virtual observer window is generated at an equal distance from the decoupling side of the light-guiding device.

[0159] Instead of a simple grating element, the optical decoupling device may further comprise a lens term or lens function that is different for each segment of the multiple image of the SLM and contributes to the total focal length. This facilitates the setting within a certain setting range, if the optical properties of the variable imaging system must be changed within that setting range for the individual segments. However, depending on the arrangement of the variable imaging system, this generally affects both the beam path, the imaging beam path and the illumination beam path. To affect only the illumination beam path, the variable imaging system should be arranged directly on the SLM or in the image plane of the SLM. In a display device with a variable imaging system arranged directly on the SLM, between the SLM and the coupling of light to the light guide, it is generally possible to generate a common virtual observer window at the same position by varying the optical properties of the variable imaging system for the various segments of the multiple image of the SLM. However, as already mentioned, in particular these optical properties of the variable imaging system are related to the size and the field of view of the virtual observer window. Thus, in this design according to FIG. 9, a virtual observer window of different size is generated for the individual segments of the multiple image of the SLM, and the part of the field of view is also of different size for the individual segments. Thus, individual segments of the multiple images of the SLM contribute with different weightings to the total field of view.

[0160] With regard to the virtual observer window, only the smallest observer window size occurring for each one of the segments of the multiple images of the SLM is valid in this case too.

[0161] In particular, if a lens function is also used for the grating elements of the light decoupling device for decoupling the light and the lens function is different for each segment of the multiple image of the SLM, a further problem arises: in general, adjacent segments of the multiple image of the SLM also spatially overlap upon this decoupling of light for the individual segments. Therefore, in order to generate overlapping segments of the multiple image of the SLM, several layers of switchable grating elements have to be generated on top of each other in the light decoupling device. Thus, in one configuration of the light guiding device, it is provided that adjacent segments of the multiple image of the SLM are alternately coupled by grating elements on the front and rear sides or on both sides / interfaces of the light guide of the light guiding device.

[0162] FIG. 9 shows three different views of a display device with a light guiding device 5 and an illumination beam path, whereby three different segments of a multiplexed image of the SLM are generated. Here again the light coupling device 7 comprises at least one mirror element 9, in particular a tilted arranged mirror element. The light decoupling device 8 comprises here instead of a mirror element a grating element 12, here three grating elements. The grating element 12 is designed to be switchable or controllable. This means that the grating element 12 can be switched between an on state and an off state. If the light propagating inside the light guide is decoupled at the grating element 12, this grating element 12 is controlled and switched from the off state to the on state. In this way, the light is no longer reflected at the grating element 12, but rather decoupled from the light guide by the grating element 12. As is clear from FIG. 9, the grating element 12 can be attached to the upper or lower side of the light guide. The lower side of the light guide is the side of the light guide facing the virtual observer window VW. The upper side of the light guide is therefore opposite the lower side of the light guide and is further away from the virtual observer window VW than the lower side. The grating elements 12 on the upper side of the light guide are designed as reflective grating elements and the grating elements 12 on the lower side of the light guide are designed as transmissive grating elements. The SLM shown in Fig. 9 is, respectively, in all three figures, for the sake of simplicity, representative of an SLM and a variable imaging system. Of course, this means that the SLM and the variable imaging system are two separate components that are not connected to each other.

[0163] According to FIG. 9(a), light emitted by an illumination device (not shown) enters the SLM and is thereby modulated with information relating to a segment or image to be displayed. The modulated light passes through the variable imaging system and enters a mirror element 9 of the optical coupling device 7 of the light-guiding device 5. The mirror element 9 reflects the light, which propagates in the light guide 6 by total internal reflection. The light thus propagating in the light guide 6 is reflected at the interface of the light guide and enters a grating element 12 which is switched into the on state. Following the description of FIG. 9(a), for the intermediate segment of the multiple image of the SLM, the decoupling of the light takes place in a switchable reflective grating element 12 on the upper side of the light guide 6. This grating element 12 on the upper side of the light guide 6 not only deflects the light accordingly, but additionally has a lens function. The decoupling of the light for the right segment of the multiple image of the SLM according to FIG. 9(c) and for the left segment according to FIG. 9(b) takes place in each case via a transmission switchable grating element 12 on the lower side of the light guide. These transmission grating elements 12 on the underside of the light guide also have a lens function.

[0164] Furthermore, the focal length of the variable imaging system can be changed before coupling the light of each segment into the light guide 6. In this way, for all three segments of the multiple image of the SLM according to Fig. 9(a)-(c), a virtual observer window can be generated at the same position. However, in this example, for the left segment of the multiple image of the SLM according to Fig. 9(b), the virtual observer window VW has slightly smaller dimensions and therefore the field of view is slightly larger compared to the virtual observer window VW and field of view according to (a). For the right segment of the multiple image of the SLM it is inverted, the virtual observer window VW has slightly larger dimensions and a slightly smaller field of view. The reason for this is that the size of the virtual observer window depends on the light path between the SLM and the virtual observer window according to λ D / p, where D is the path between the SLM and the virtual observer window, which path is furthermore of different length in the individual segments. The size of the SLM is equal, but the distance D from the virtual observer window is larger, so the angle of view is also smaller.

[0165] The positions of the decoupling points of the individual segments of the multiple images of the SLM from the light guide are fixed by the positions of the lens functions in the grating element for decoupling, which positions are different for the individual segments, since it is not possible to perform a continuous displacement of the individual segments, as would be reasonable for certain applications, e.g. gaze tracking, since the light is decoupled using two different lens functions of the grating element.

[0166] The light guides of the light directing device may be formed flat and / or planar, or may be curved.

[0167] Exemplary embodiments each having a curved light guide are described below. In a display device for generating at least one image of the SLM, a curved light guide instead of a planar light guide can have special advantages. On the one hand, illumination beam paths are also possible, which allow a virtual observer window to be generated for a number of segments of a multiple image of the SLM in the same position or location in each case, without the need for the use of a variable imaging system, and thus by a fixed optical system. Furthermore, it is also possible for the virtual observer window to have the same size for a number of segments of a multiple image of the SLM, and thus a partial field of view of equal size is generated in each case for all segments. Thus, all segments of a multiple image of the SLM contribute to the same extent to the overall field of view.

[0168] On the other hand, optical decoupling devices can be used, whose decoupling angle of light does not depend on the position on / in the light guide or light guiding device. In particular, the decoupling angle is equal in each case of decoupling of various segments of the multiple images of the SLM. In particular, this also allows a continuous displacement of the decoupling positions of the segments from the light guide, so that predefined decoupling positions of the segments do not have to be provided.

[0169] In one exemplary embodiment, the curved light guide in the light directing device forms a portion of a circular arc, and the virtual observer window represents the center point of the circle.

[0170] Thus, the inner and outer boundary surfaces of the light guide each form a circular arc, with the inner boundary surface located closer to the virtual observer window having a smaller radius and the outer boundary surface located further away from the virtual observer window having a larger radius, and therefore the two boundary surfaces are not parallel to each other.

[0171] For example, the inner boundary surface has a radius of 30 mm and is located at a distance of 30 mm from the center of the virtual observer window. If the corresponding thickness of the light guide is 5 mm, the outer boundary surface has a radius of 35 mm and is therefore located 35 mm away from the center of the virtual observer window.

[0172] In one preferred exemplary embodiment, the light guide has a cylindrical shape, i.e. the curvature in the above-mentioned form is in one dimension and / or direction and has a linear extension in the dimension perpendicular thereto. For example, in a display device, typically in the form of an HMD, a large field of view in the horizontal direction is assigned greater importance than in the vertical direction, so the light guide is preferably positioned in the display device such that the curvature of the light guide extends in the horizontal direction and a non-curved or flat embodiment of the light guide extends in the vertical direction.

[0173] The light guide may also be formed curved in both dimensions and / or in both directions, in which case the inner and outer boundary surfaces of the light guide have the shape of a portion of a spherical shell, and in each case the center of the virtual observer window represents the midpoint of the sphere.

[0174] A display device having a light guiding device with a light guide curved in at least one direction comprises at least one SLM, an illumination device illuminating the SLM with at least one light source, and an optical system with at least one imaging element, the illumination device, the SLM and the optical system being arranged relative to each other such that in the absence of the light guiding device with the light guide, the optical system images the illumination device in the center of a virtual observer window.

[0175] When a cylindrical light guide is used, the optical system preferably includes a cylindrical imaging element.

[0176] A light directing device having a light guide is then introduced into the display device such that an image of the illumination device produced by the optical system is located at the center of the arc of the light guide, and an illumination beam path extends through the display device such that the light beam is essentially perpendicular to the outer surface of the light guide.

[0177] In a cylindrical light guide, in the non-curved direction of the light guide, a cylindrical lens function is preferably provided in the light decoupling device of the light guiding device, or a cylindrical lens is provided on or near the decoupling side of the light guide, which has a focus in the centre of the virtual observer window in this direction.

[0178] However, if a single parallax hologram encoding is provided, this need for a vertical focus may be omitted. Nevertheless, a lens may be provided on the decoupling side of the light guide or a lens function may be provided in the optical decoupling device, in which case the lens function may also have a focal length that deviates from the distance to the virtual observer window.

[0179] The optical coupling device is provided in a coupling region on the outer or inner surface of the light guide. In this case, the optical coupling device may have at least one grating element for decoupling the light from the light guide, which in one embodiment is a reflective grating element on the inner surface of the light guide. The light then first passes vertically once through the light guide, is deflected on the inner surface by the reflective grating element, and then propagates in a zigzag manner through the light guide.

[0180] The propagation angle of the light can be selected such that reflection occurs by total internal reflection at the interface of the light guide to air. Alternatively, the propagation angle of the light can be selected such that total internal reflection does not occur at the interface to air. In this case, an additional layer, for example a dielectric layer or layer stack, can be provided, which causes reflection of light incident at a certain angle on the layer or layer stack, and thus the light propagates further in the light guide due to reflection at the layer or layer stack. The layer or layer stack can be designed such that ambient light can pass through the light guide, preferably in a possible AR application. In this case, the layer stack selectively has a reflective effect only for a small range of angles, which corresponds to the propagation angle of the light in the light guide. In this way, the display device can also be used for AR applications.

[0181] The optical decoupling device is provided in the light guide at a possible optical decoupling region. The optical decoupling device may comprise at least one passive or controllable or switchable grating element. By switching on or off the grating element or a defined part of the grating element, if it is embodied divided into switchable parts, the position of decoupling of the light from the light guide can be established. If a passive grating element is used, a further switchable element, e.g. a polarization-selective grating element, which in combination with the polarization switch only deflects light of one polarization direction and not of another is therefore required.

[0182] In the case of light propagation in the light guide by total internal reflection, for example, the angle is changed by a grating element of the optical decoupling device such that the angle is smaller than the total internal reflection angle and the light exits the light guide.

[0183] During the propagation of light within the light guide, the light beam is alternately reflected off outer boundary surfaces with larger radii and inner boundary surfaces with smaller radii, which, by way of example, contributes to focal points occurring at equal distances from the decoupling point of the light guide for multiple light beams through the light guide, despite the different lengths of the paths of these light beams after decoupling.

[0184] In particular, the deflection angle of the grating element of the light decoupling device in the above-mentioned display device does not depend on the position of the grating element in the light guide. In the case of a cylindrical light guide, a cylindrical lens function is provided on the grating element or a cylindrical lens is used in the non-curved direction of the light guide close to the light decoupling position, and the focal length of this lens or lens function is also independent of the light decoupling position. This can be, for example, a rectangular grating element with a cylindrical lens function, which is stacked on the inner curved surface of the cylindrical light guide, so that the focusing function acts perpendicular to the curvature direction.

[0185] By switching the optical decoupling device to an ON or OFF state, the light of multiple segments of the multiple images of the SLM can be decoupled from the curved light guide after different numbers of reflections.

[0186] Fig. 10 shows such a curved light guiding device 15 arranged in a display device. In addition to the light guiding device 15 with the light guide 16, the display device comprises an SLM and an optical system, here shown in the form of an imaging element 17. Light is coupled into the light guide 16 by an optical coupling device 18 and, after a certain number of reflections, is decoupled again from the light guide by an optical decoupling device 19. The optical coupling device 18 and the optical decoupling device 19 each comprise at least one diffraction grating element 20, 21. The at least one diffraction grating element 20 of the optical decoupling device 19 is designed to be switchable or controllable and is here divided into individual sections 20-1, 20-2. Section 20-1 of the diffraction grating element 19 is here in the OFF state and section 20-2 in the ON state, so that the light propagating in the light guide is decoupled at section 20-2 of the diffraction grating element 19. When section 20-1 of the grating element 19 is in the on state and section 20-2 is in the off state, the light is decoupled from the light guide after fewer reflections. The light beams originating from the individual pixels P1, P2, P3 of the SLM pass through the imaging element 17 and enter the light guide 16. The light beams then enter the light coupling device 18 provided on the inner surface of the light guide 16. The light coupling device 18 comprises at least one grating element 21, which in this exemplary embodiment is designed to be reflective. The light beams entering the grating element 21 are reflected and deflected so that they propagate via total internal reflection in the light guide 16. The individual light beams are then decoupled from the light guide 16 of the light guide device 15 in the grating element 19, here in section 20-2 of the grating element, after a predefined number of reflections. All light beams for representing an image or a segment of the multiple image of the SLM are decoupled after an equal number of reflections.

[0187] However, instead of different numbers of reflections on different segments of the multiple images of the SLM, a continuous displacement of the decoupling position of the light on / in the light guide is also possible. This can be achieved, for example, by a small displacement of the coupling position of the light accompanied by an equal number of reflections of the light at the interface of the light guide.

[0188] For example, a large field of view can be generated by using different numbers of reflections at the interface of the light guide to generate the individual segments of the multiple image of the SLM for larger steps, and by continuous displacement of the light coupling position for the individual segments of the multiple image of the SLM in between for smaller steps. For example, a field of view of 60° in size can be generated from six non-overlapping segments of 10° each. In this case, the light guide and the grating element of the light coupling device can be designed such that the decoupling position of the light is displaced by 20° from the observer's viewpoint due to additional reflections in the light guide. In addition, due to the displacement of the coupling position, the decoupling position can be displaced by 10° from the observer's viewpoint with a fixed number of reflections.

[0189] For example, a first segment is then generated by decoupling the light after one reflection to a coupling position that is not displaced. A second segment is generated by decoupling the light after one reflection to a coupling position that is displaced by 10°. A third segment is generated by decoupling the light after two reflections to a coupling position that is not displaced. A fourth segment is generated by decoupling the light after two reflections to a coupling position that is displaced by 10°. A fifth segment is generated by decoupling the light after three reflections to a coupling position that is not displaced. A sixth segment is generated by decoupling the light after three reflections to a coupling position that is displaced by 10°.

[0190] Alternatively, small changes in the deflection angle of the light produced by the grating element 20 of the optical coupling device 18 can be used to generate a large field of view. However, for this purpose it is also necessary to design the grating element 20 to be controllable or switchable.

[0191] The displacement of the coupling position of the light on the light guide is performed by an optical deflection device 29, which may preferably include at least one grating element. This is explained in more detail in connection with figure 14. The grating element has a settable grating period. For example, a pair of two grating elements can be used in the optical deflection device, the first of which deflects the light from the SLM and the second of which deflects the light in the opposite direction, resulting in an essentially parallel offset.

[0192] In a display device having a two-stage optical system or a two-stage imaging system of light, i.e. generating an intermediate image of the illumination device, a light deflection device can be placed in the intermediate image plane of the illumination device. As an example, a field of view of about 60° in the direction of the curvature of the light guide can be achieved by a coarse step of 20° after one additional reflection on each of the front and rear sides, and further shifting the coupling position by up to ±10° by the light deflection device.

[0193] For cylindrical light guides, the displacement of the light coupling position on the light guide in the non-curved direction can be performed by a light deflection device. For example, a vertical field of view of size 20° can be composed of two segments of 10° each, and light is coupled either in the lower half or in the upper half of the light guide by displacing the vertical coupling position.

[0194] 11 shows in a perspective view a display device including an SLM, an optical system, again in the form of an imaging element 17, and a light guiding device 22 including a cylindrical light guide 23. As can be seen, in the non-curved direction of the light guide 23, light from different vertical positions V1, V2, V3 of the SLM is coupled into the light guide 23 by an optical coupling device 24. The light propagating in the light guide via total internal reflection is then decoupled by an optical decoupling device 25 and focused by a vertical cylindrical lens function integrated in the optical decoupling device 25 on the decoupling side of the light guide 23 in a virtual observer window VW.

[0195] A continuous displacement of the segments is also reasonable, inter alia, when different sections of the field of view are displayed depending on the content of the preferably three-dimensional (3D) scene to be displayed, or depending on exactly where the observer's eyes look while observing the scene.

[0196] Thus, for example, the HMD can detect exactly which parts of the scene the observer is looking at and, for example, represent only these holographically.

[0197] A two-stage optical system or a display device with two-stage imaging is described in more detail below.

[0198] In a holographic display device, for example an HMD, the SLM is generally imaged. In the case of segmented multiple images, one image of the SLM occurs in each case in each segment. The image of the SLM at a given distance assumes a specific focal length of the imaging elements used in the optical system and a specific distance of the SLM from these imaging elements. In particular, the imaging beam path and the illumination beam path in the display device are generally not independent of each other. The possibly required setting of the illumination beam path can also result in a change of the imaging beam path.

[0199] For example, as mentioned above, in the configuration of a display device using a flat and / or planar light guide and at least one imaging element, e.g. a lens, before coupling in the optical direction to the light guide, the need arises to change the focal length of this at least one imaging element in order to set the same position of the virtual observer window for the various segments of the multiple images of the SLM. If the distance of the SLM from the imaging element is fixed, a change in the focal length of the imaging element results in a change in the imaging position of the SLM. Thus, in a segmented multiple image of the SLM, a different image plane of the SLM results for each segment.

[0200] In another configuration of the display device using a light guide with at least one lens exclusively between the light decoupling device of the light guiding device and the observer's eye or with a lens function integrated in the grating element of the light decoupling device, the focal length of the at least one lens between the light decoupling device and the observer must be equal for all segments of the multiple image of the SLM. However, due to the different optical path lengths of the light of the individual segments of the multiple image of the SLM through the light guide, the distance between the SLM and the at least one lens or lens function in the grating element of the light decoupling device is of different length for each segment. Therefore, in this case, the image of the SLM is generally at a different distance or position for each segment of the multiple image of the SLM.

[0201] It is not necessarily necessary for a holographic display device to have a common image plane for all segments of the multiple image. A 3D scene can also be represented continuously across segment boundaries with different image planes of the SLM, for example by the focal lengths of the sub-holograms of the hologram on the SLM being adapted to the individual segments. An object point of the scene can be represented, for example, in a segment of the multiple image of the SLM by a sub-hologram with a positive focal length (convex lens) if the object point is located in front of the image plane of the SLM of this segment. A neighboring object point at the same depth to the observer but in another segment can be represented, for example, by a sub-hologram with a negative focal length (concave lens) if the object point is located behind the image of the SLM of this segment. However, on the other hand, the hologram calculation is simplified if the image planes of the SLM are at least similar for all segments, i.e. differing, for example, by a few centimeters but not by a few meters.

[0202] When grating elements, especially those having a small period, for example in the range of 1 μm or less, and therefore a large deflection angle, typically greater than 30°, for example between 50° and 60°, are used for coupling and / or decoupling light into or from a light guide, aberrations generally occur in the light beam path.

[0203] In order to keep the aberrations as small as possible, it is preferred to use a pair of grating elements for coupling and decoupling light into and from the light guide. This means that one grating element is provided in the light coupling device and one grating element is provided in the light decoupling device, the two grating elements having essentially opposite and equal deflection angles. In the first grating element, i.e. the grating element of the light coupling device, for example, light incident perpendicularly is deflected by an angle of 60° to the normal. In the second grating element, i.e. the grating element of the light decoupling device, light incident at 60° is deflected to exit the grating element perpendicularly. Thus, after passing through both grating elements, the exit angle of the light from the second grating element corresponds to the angle of incidence of the light on the first grating element. This arrangement of two grating elements in a light guiding device for coupling light into and decoupling light from a light guide is advantageous for keeping small or reducing aberrations of the illumination beam path in a display device, for example in an HMD. The remaining aberrations affect especially the imaging beam path. Due to these aberrations, the position of the image of the SLM can be displaced farther, which is undesirable, compared to the light-guiding device without the use of a grating element in the optical coupling device and / or the optical decoupling device. In particular, this displacement of the image of the SLM occurs mainly in the direction in which the grating element deflects the light, which can result in astigmatism of the SLM image. For example, in the case of a grating element deflecting in the horizontal direction, the horizontal pixel image of the SLM will be at a different depth than the vertical pixel image of the SLM.

[0204] To compensate or reduce the influence of grating elements in the light-guiding device on the position of the image of the SLM, an intermediate image of the SLM can be generated inside the light guide and / or light-guiding device.

[0205] The display device can use a two-stage optical system to generate an intermediate image of the SLM. In addition to this two-stage optical system, the display device then comprises at least one SLM and one illumination device with at least one light source illuminating the SLM. In a first step, the intermediate image of the illumination device and thus also the intermediate image of the virtual observer window to be generated are generated after the SLM in the light direction using at least one first imaging element, e.g. a lens, of the two-stage optical system. In a second step, the intermediate image of the virtual observer window and the intermediate image of the illumination device are imaged in the real virtual observer window or observer plane using at least one second imaging element, e.g. a lens, of the two-stage optical system. In this case, the light guiding device is arranged in the display device in the beam path after the second imaging element and the intermediate image of the virtual observer window. The arrangement with the first and second imaging elements also generates an image of the SLM. The second imaging element, which respectively images the intermediate image of the virtual observer window or the intermediate image of the illumination device, can also contribute to the imaging of the SLM. By appropriately selecting the focal length of the imaging element, a further image of the SLM can be generated inside the light guide of the light guiding device. This intermediate image of the SLM inside the light guide can be generated only in the deflection direction of the grating elements of the optical coupling and / or decoupling device using, for example, a cylindrical imaging element, whereas an intermediate image of the SLM can be located outside the light guide, in a direction perpendicular thereto.

[0206] A display device with a two-stage optical system is shown in Fig. 12. This display device further comprises at least one SLM and a light-guiding device 26. In this case, the light-guiding device 26 is arranged in the light direction after a two-stage optical system with at least two imaging elements 27 and 28. A first imaging element 27 is arranged in the light direction behind the SLM but in the immediate vicinity of the SLM. Fig. 12 shows diagrammatically the illumination beam path of such a display device, in which in this case the imaging element 27 generates an intermediate image ZB of an illumination device (not shown). The intermediate image ZB of the illumination device is then imaged by the imaging element 28 into a virtual observer window VW, which again generates an image of the illumination device. An imaging system 30 can be provided in the plane of the intermediate image ZB, which does not influence the illumination beam path. Its function with respect to the imaging beam path is explained below.

[0207] Figure 13 shows the imaging beam path for the display device according to Figure 12, where a schematic diagram of the imaging beam path is shown in the top figure and a detailed diagram of the circled area in the top figure is shown in the bottom figure. For clarity, in the top figure only light emanating from one pixel of the SLM is shown. As can be seen, after passing through the imaging elements 27 and 28 and the imaging system 30, the light enters the light guide of the light guiding device, propagates in the light guide via total internal reflection and is then decoupled again by the optical decoupling device.

[0208] The circled area in the upper figure is shown in more detail in the lower figure, where not only one light beam but several light beams originating from several pixels of the SLM are shown. From this detailed view it can be seen that by the imaging elements 27, 28 and the imaging system 30, one focal point in the light guide is generated for each individual pixel of the SLM. This means that a further image ZS of the SLM is generated inside the light guide of the light guiding device 26. The imaging system 30 in the plane of the intermediate image ZB of the illumination device has the advantageous property that it only affects the imaging beam path but not the illumination beam path.

[0209] If the imaging system 30 is for example a lens element, the image plane of the SLM can be displaced without inadvertently displacing the position of the virtual observer window by appropriately selecting the focal length of this lens element.

[0210] In this example, the imaging element 28 is also a lens element. Firstly, the focal length of this lens element is selected such that a virtual observer window is created after the light is decoupled from the light guide 26. Taking into account the focal length of the imaging element 28, the focal lengths of the lens elements of the imaging system 30 are selected such that an image ZS of the SLM is created inside the light guide of the light guiding device 26.

[0211] The size of the aberrations in the imaging beam path caused by the grating elements for coupling and decoupling light also depends on the distance between the grating elements, i.e. the distance of the at least one grating element of the optical coupling device from the at least one grating element of the optical decoupling device. Thus, for various segments of multiple images of the SLM in the light guide, where the light propagates different distances in the light guide and therefore has different distances between the grating elements for coupling and decoupling light, such segments also cause aberrations in the imaging beam path that are different for each segment.

[0212] As a solution to the different depth positions of the individual segments of the multiple image of the SLM from the viewpoint of the virtual observer window due to different distances of the individual segments of the multiple image of the SLM from the imaging elements of the optical system due to different path lengths of the light in the light guide or due to aberrations generated by the diffraction grating elements for coupling and decoupling, the following is proposed: As already mentioned, in addition to the two-stage optical system, the display device comprises at least one SLM and one illumination device which illuminates the SLM. In a first step, an intermediate image of the illumination device and therefore also of the virtual observer window is generated after the SLM in the light direction by at least one first imaging element. In a second step, the intermediate image of the illumination device and therefore of the virtual observer window is imaged by at least one second imaging element into the actual virtual observer window. Furthermore, the display device comprises a variable imaging system, for example as shown in FIG. 15. This means that in this case the imaging system 30 in the intermediate image plane ZB is designed to be variable. The variable imaging system 30 is arranged in the intermediate image plane ZB of the virtual observer window or close to this intermediate image plane. The variable imaging system 30 comprises at least one imaging element that can be controllably designed. For example, the focal length of the imaging element may be variable. The arrangement with the first and second imaging elements 27, 28 also produces an image of the SLM. The second imaging element 28, which images the virtual observer window, also contributes to the imaging of the SLM. However, by using an imaging element of the variable imaging system in or as close as possible to the intermediate image plane of the virtual observer window, it is also possible to advantageously displace the image of the SLM without affecting the position and size of the illumination beam path and the virtual observer window itself.The image of the SLM is displaced with respect to each segment of the multiple images of the SLM by an imaging element of the variable imaging system such that different optical paths of the light through the light guide occurring for the individual segments are at least partially compensated for.

[0213] By compensation, a visible image of the SLM observable by the observer through the virtual observer window is obtained at equal or at least similar depth for all segments. The imaging element of the variable imaging system 30 may for example be a system of at least two imaging elements such as a diffraction grating element with a controllable variable period (LCG - Liquid Crystal Grating), an electrowetting lens, a liquid crystal lens or a lens of variable distance, similar to a zoom objective lens.

[0214] The intermediate image of the SLM can also be generated such that this intermediate image of the SLM is located inside the light guide for at least a part of the segment of the multiple image of the SLM, but for another part of the segment the intermediate image of the SLM can also be located outside the light guide.

[0215] By this compensation, preferably the intermediate image of the SLM occurs at a similar distance from the decoupling of light from the light guide for all segments. If an intermediate image occurs in the light guide for all segments, it is true that for segments with a higher number of reflections in the light guide, the intermediate image in the light guide is farther away from the coupling of light than for segments with a lower number of reflections in the light guide.

[0216] The astigmatism that may occur in the imaging of the pixels of the SLM in a single-step optical system due to the use of diffraction grating elements for coupling light into and decoupling light from the light guide can be at least partially compensated for in the above-mentioned two-step system. This may occur in that in the two-step optical system crossed, i.e. arranged perpendicular to each other, cylindrical imaging elements (e.g. cylindrical lenses), each with a variable focal length, or a controllable diffraction grating element with a cylindrical lens function, are used in the intermediate image plane of the virtual observer window, and for each segment of the multiple images of the SLM, the focal lengths of both cylindrical imaging elements are respectively set in such a way that the horizontal and vertical images of the SLM visible through the virtual observer window occur in similar depth planes.

[0217] Furthermore, the continuous displacement of the coupling position of the light on the light guide can be performed by a light deflection device 29, which is arranged in the light direction in the immediate vicinity of the variable imaging system 30 in front of the light guide or light guiding device 26 in the virtual observer window and / or intermediate image plane ZB of the illumination device, as shown in FIG. 14. The light deflection device 29 can for this purpose comprise at least one diffraction grating element that is designed to be controllable or variable. The incident light can thus be deflected accordingly by the light deflection device 29, i.e. the diffraction grating element of the light deflection device can be controlled such that the incident light is deflected in the required direction and thus coupled into the light guide at a different coupling position on the light guide than in the absence of this light deflection by the light deflection device 29. Both FIG. 12 and FIG. 14 show the illumination beam path. The non-displaced coupling position in the light guide without the light deflection device is shown in FIG. 12. The displaced coupling position in comparison thereto is shown in FIG. 14.

[0218] In this way, various coupling positions of the light on the light guide can be generated. The functions of the optical deflection device 29 and the variable imaging system 30 can also be combined in one device or system, so that only one device is needed for both functions. Both the lens function for variable imaging and the prism function for deflection can be written, for example, into the same controllable diffraction grating element.

[0219] In particular, the position of the image of the SLM with respect to the preferably three-dimensional scene to be generated also influences the calculation of the hologram to be encoded on the SLM. Among other things, if all the sub-holograms form a whole hologram or holograms, the size of the sub-holograms depends on how far the object points of the scene are located in front of or behind the image plane of the SLM, the SLM also defining the field of view. If the image of the SLM is placed very close to the virtual observer window through which the observer can observe the reconstructed or generated scene, the sub-hologram is typically very large in its dimensions. In contrast, if the image of the SLM is located very far from the virtual observer window, this may also mean a sub-hologram whose dimensions are large. A three-dimensional scene can also be represented if there is no image of the SLM at all between the virtual observer window and infinity, but instead a real image of the SLM is present behind the virtual observer window. If the distance of the SLM from the imaging element is greater than the focal length of the imaging element, no virtual image is generated. The observer therefore cannot see a sharp image of the SLM. However, if a sub-hologram is encoded in the SLM itself, i.e. not in its image, and its focal length is long enough for an object point to be generated and its distance from the imaging element is less than the focal length of the imaging element, then no virtual image of the SLM is generated, but rather a virtual image of the object point. In this case, however, a sub-hologram whose dimensions are very large is also provided.

[0220] In general, it may be advantageous for the image plane of the SLM to be placed within the three-dimensional scene, so that some of the object points of the scene are located in front of the image of the SLM and another part of the object points are located behind the image of the SLM, for example the image plane is located at a distance of about 1 m or 1.5 m from the virtual observer window. The computational effort for the calculation of the hologram increases with the size of the sub-hologram.

[0221] For example, in a display device with a two-stage optical system and a variable imaging system, the position of the image plane of the SLM can be displaced in individual segments of the multiple images of the SLM by adapting the focal lengths of the imaging elements of the variable imaging system such that the typical or maximum size of the sub-holograms is minimized, thus advantageously reducing the effort for computing the holograms.

[0222] In display devices that do not use a variable imaging system, the calculation of the hologram encoded in the SLM can be performed by a virtual SLM surface with sub-holograms of small average size and an arithmetic transformation for each segment of the SLM's multiple image to the corresponding image surface of the SLM. This can also include a transformation to a real image surface of the SLM behind a virtual observer window. For example, the virtual surface of the SLM is the same for all segments of the SLM's multiple image, but the image surface of the SLM where the transformation is performed is different for each segment according to the image surface generated by the optical system.

[0223] The following description relates to the inverse calculation for determining the amplitude and phase of the sub-holograms taking into account the aberrations of the optical system. As already explained, aberrations also arise in the imaging beam path, for example due to the diffraction grating elements for coupling light into and decoupling light from the light guide, which not only cause undesired displacements of the pixel images of the SLM, but also have the consequence that sharply imaged pixel images of the SLM no longer occur at all.

[0224] In principle, it is possible to use a holographic display device to sharply reconstruct three-dimensional object points of a scene in space, even if the SLM is not sharply imaged. However, under certain circumstances, as typically occurs for holographic direct-view displays or displays with sharp images of the SLM, the phase curve of the sub-hologram has deviations from a simple spherical lens function. The amplitude curve of the sub-hologram can also have deviations from the typical curve, which in the simplest case is a constant amplitude across the sub-hologram.

[0225] We now describe how to check whether a sub-hologram can be correctly represented on the SLM and to determine the amplitude and phase distributions within the sub-hologram that are necessary to reconstruct an object point.

[0226] The method can preferably be performed using software for geometrical optics calculations, which simplifies the execution compared to wave optics calculations in more complex optical systems. First, a calculation of the light propagation from an object point of a preferably three-dimensional scene to a virtual observer window is performed, which is performed as if the object point really exists in space and the optical system is not located between the object point and the virtual observer window. Thus, in the case of a wave optics calculation, the wavefront of the light emanating from the object point is calculated in the virtual observer window. In a simplified geometrical calculation, a light beam is calculated from the object point to various positions in the virtual observer window. Then, a calculation of the wavefront or light beam is performed in reverse from the virtual observer window through the optical system to the SLM.

[0227] This is done, for example, as follows: in the optical calculation, a beam splitter element is introduced in front of the virtual observer window in the light direction and a mirror element is introduced at the position of the virtual observer window. Light from an object point of the three-dimensional scene is coupled at a surface of the beam splitter element, deflected towards the virtual observer window, reflected at the virtual observer window by the mirror element, enters the beam splitter element again, exits through another surface of the beam splitter element and returns from there through the optical system to the SLM. In this way, the amplitude and phase distribution in the sub-hologram for the object point can be determined.

[0228] Or for example, in optical calculations, the virtual observer window can be back-illuminated and a lens can be placed in the virtual observer window, which would generate an object point in the absence of the remaining optical system. For example, to perform a calculation of an object point 1 m away from the virtual observer window, the virtual observer window can be back-illuminated with a plane wave and a lens with a focal length of 1 m can be placed in the virtual observer window. The amplitude and phase distributions in the sub-hologram for the object point can also be calculated in this way.

[0229] In the case of a display device having at least one SLM, several imaging elements of the optical system and a light guiding device, the calculation can for example be performed such that light coming from the virtual observer window enters the light guide of the light guiding device at a light decoupling position, leaves the light guide again at a light coupling position and then propagates further through the imaging element of the optical system to the SLM. The position and size of the sub-hologram results from the position at which the backward propagating light beam enters the SLM.

[0230] FIG. 15 shows a schematic representation of a display device with an SLM, imaging elements 27 and 28 of the optical system, a variable imaging system 30 and a light guiding device 26, in which a back calculation is shown for determining the amplitude and phase distribution of an object point. In this case, a back calculation is performed from the virtual observer window VW through the light guiding device 26 to the SLM, and the values ​​are determined. The object point to be reconstructed can be accurately represented on the SLM, among other things, if the light beams from all positions in the virtual observer window VW are also incident on the SLM in the back calculation. Furthermore, the light beams must be incident on the SLM at an angle equal to or smaller than half the diffraction angle of the SLM. The diffraction angle results from the wavelength λ used and the pixel pitch p of the SLM as λ / p. This condition is generally met when the aberrations in the illumination beam path are small and aberrations are essentially only present in the imaging beam path.

[0231] For wave optics calculations, the amplitude and phase distributions of object points in the sub-hologram can be directly defined by inverse calculations.

[0232] In the geometric calculation, the amplitude and phase distributions are defined as follows: The geometric inverse calculation of the light beam is performed using a very large number of light beams, for example 100,000 light beams. The relative intensity of a pixel in the sub-hologram of the SLM is due to the number of light beams incident on the area of ​​the pixel in the SLM. The relative amplitude can be calculated as the square root of this intensity. For the absolute value of the amplitude, the sum of all the intensities of the pixels in the sub-hologram is set equal to the intensity of the object point. Since the amplitude generally changes continuously in the sub-hologram, it is not necessary to calculate it for each pixel individually, and in a simplified form it can also be interpolated based on the sample points.

[0233] FIG. 16 shows diagrammatically the intensity distribution in the plane of the SLM, obtained by the back-calculation according to FIG. 15. It shows the intensity distribution in the sub-hologram. The sub-hologram shown is in this example approximately triangular in shape, with a narrow, approximately sickle-shaped area of ​​high intensity at the bottom end. This deviates significantly from conventional sub-holograms on the SLM, which have a rectangular shape with a constant amplitude over the area of ​​the sub-hologram. The calculation of the phase values ​​can be performed in particular when there is an inherent connection between the position on the SLM and the angle of incidence of the light beam on the SLM. This means that the light beam cannot be incident on the same position in the SLM with significantly different angles. The lens function written in the sub-hologram can be considered as a diffraction grating with a grating period that varies over its positions. Thus, for each of two adjacent pixels of the SLM, the deflection angle of the light locally corresponds to the local grating period, thereby allowing the difference in the phase values ​​of the two pixels to be defined. Thus, if a phase value is defined for a first pixel, a phase value corresponding to the desired difference can also be defined for each of the adjacent pixels. Thus, the phase values ​​can be defined step by step, starting from one pixel to each of the adjacent pixels.

[0234] Therefore, first the local grating period is determined in a geometric back-calculation from the angle of incidence of the light beam on the SLM. According to the formula tanα=λ / g, where α is the angle of incidence of the light beam and λ is the wavelength of light, the local grating period g is defined as g=λ / tanα. Then Δφ=2*πp / g, where p is the pixel pitch of the complex pixels of the SLM, represents the phase difference of two adjacent pixels required to set this deflection angle. Thus, if the first pixel has a phase value φ0, the second pixel receives a phase value φ0+Δφ.

[0235] For a two-dimensional pixel array of the SLM, the incidence angle is in this case decomposed into horizontal and vertical components. The above formulas are then used, respectively, to determine the local horizontal and vertical grating periods. The phase difference of adjacent pixels is determined from the local grating period from the ratio 2*π*p / g with the pixel pitch p of the complex pixels. For example, if the incidence angle of the light beam on the SLM corresponds to half the diffraction angle, a phase difference of π occurs between adjacent pixels. If the incidence angle of the light beam on the SLM corresponds to, for example, a quarter of the diffraction angle, a phase difference of π / 2 occurs. The phase curve of the sub-hologram is defined using the phase difference and a selectable offset phase value. For example, this offset phase value can be defined such that the phase value of the pixel in the upper left corner of the sub-hologram is set to 0. The local grating period of the sub-hologram generally varies continuously, so that it does not have to be calculated for each pixel pair individually, but rather can be interpolated based on the sample points. The phase determined in this way corresponds to the phase in the sub-hologram of the SLM illuminated with a plane wave. If the illumination wavefront deviates from a plane wave, this is also subtracted from the phase value of the sub-hologram.

[0236] The phase distribution of the illumination wavefront can be optionally determined from geometrical optical calculations and the angle of incidence of the light beam from the illumination device onto the SLM, similar to the explanation above. Such calculations can also be performed offline, and the determined values ​​can be stored in a look-up table for hologram calculation.

[0237] As already mentioned, it is preferable to use a two-stage optical system in the display device that generates the intermediate image plane of the illumination device. In one exemplary embodiment having such a two-stage optical system, a variable imaging system can be provided at the intermediate image plane of the virtual observer window. In this case, the variable imaging system can include, for example, a diffraction grating element with a controllable variable period (LCG).

[0238] Exemplary embodiments have also been described in which in a two-stage optical system with an intermediate image of an illumination device, an optical deflection device is arranged in the intermediate image plane of the illumination device in order to displace the coupling position of the light in the light guide by writing prism functions into at least one grating element of the optical deflection device. This grating element can also be designed, for example, as a grating element with a controllable period. Here again, both the variable imaging system and the optical deflection device can be combined in a single device.

[0239] Further exemplary embodiments of a display device with a two-stage optical system are described below. In this case, in at least one grating element of the variable imaging system and / or the light deflection device, if the grating element is a phase-modulating element, for example a grating element with a controllable variable period (LCG), instead of or in addition to a simple lens or prism function, a complex phase characteristic can also be written so that aberrations can be compensated. For example, this can be performed in combination with the above-mentioned back-calculation from the virtual observer window through the light guide towards the SLM. However, the back-calculation is first performed only from the virtual observer window to the intermediate image plane of the illumination device. In particular, if aberrations are essentially only present in the imaging beam path and no aberrations or only slight aberrations are present in the illumination beam path, the back-calculation will result in a light beam in the intermediate image plane of the illumination device having essentially the correct position, but due to the aberrations, an inaccurate angle compared to the target position and the target angle in the actual virtual observer window. Thus, for each individual light beam, the angle can be corrected by a corresponding local grating element in the intermediate image plane of the illumination device. For example, if β(x) is the desired angle of incidence of a light beam at position x and β'(x) is the actual angle of incidence of this light beam at this position x, then the correction value is Δβ(x)=β(x)-β'(x). The light beam position and the desired angle of incidence correspond to those in the actual virtual observer window, taking into account the imaging scale from the intermediate image plane of the illumination device to the virtual observer window. Similarly as already explained for the inverse calculation in the SLM, the local grating period is defined as g(x)=λ / tan Δβ(x).

[0240] The advantage of the correction of the aberrations in the imaging beam path by a phase function in an intermediate image plane of the illumination device is that this correction is independent of the content of the three-dimensional scene. Therefore, the correction function and / or correction value can be calculated once for each segment of the multiple images of the SLM and once for each possible selection of decoupling positions in case of continuous displacement of the light coupling position and stored in a value table, so that these values ​​can be used repeatedly as required.

[0241] The above-mentioned aberration correction of the sub-hologram in the plane of the SLM by back-calculation to the SLM represents the case where, by appropriate amplitude and phase curves in the sub-hologram, an object point in space can be generated as a sharp point even in the absence of a sharp image of the pixels of the SLM. The use of a variable imaging system in the intermediate image plane of the illumination device, also described, displaces the image of the SLM, but a blurred image may nevertheless be present.

[0242] In comparison, the image of the SLM itself is improved by the aberration correction described here in the intermediate image plane of the illumination device. The image of the SLM pixels becomes sharper and therefore the sub-hologram for the reconstruction of the object points can be more similar to a lens function with a constant amplitude, as also present in direct-view displays. Therefore, due to the small dimensions of the sub-hologram, the computational effort for the computation of the hologram is also reduced. However, both methods, i.e. aberration correction in the intermediate image plane of the illumination device and aberration correction in the amplitude and phase curves of the sub-hologram, can also be combined with each other.

[0243] For example, as shown in Fig. 17, first the back calculation and aberration correction are performed in the intermediate image plane of the illumination device, so that the optical path of the object point in the center of the field section of a single segment of the multiple image of the SLM is calculated at a distance from the virtual observer window that corresponds to the target distance of the SLM image from the virtual observer window to the intermediate image plane of the illumination device. In a sharply imaged SLM, the size of the sub-hologram is only one pixel, since the object point is located at the display plane. The local grating period of the diffraction grating elements of the variable imaging system and / or the optical deflection device in the intermediate image plane ZB of the illumination device is set in such a way that during further back calculation to the SLM, the light beams go together within one pixel in the center of the SLM. Fig. 17 illustrates this on the basis of an example of five light beams that pass from various positions in the virtual observer window (not shown here) through the light guide or guiding device 26 and the imaging element 28 to the intermediate image plane ZB of the illumination device, from where, after matching setting of the grating period of the diffraction grating elements provided there, further through the imaging element 27 to the SLM. For object points that are at different distances from the virtual observer window, but still in the central region of the field of view of the segment of the multiple image of the SLM, the sub-hologram arises as a simple lens function with a focal length of the distance of the object point. However, if the same correction is used in the intermediate image plane ZB of the illumination device for object points located at the edge of the partial field of view of the segment, residual aberrations may nevertheless still be present in the SLM plane. For this purpose, as already explained, in order to further correct the existing aberrations, the angle of incidence in the hologram plane is determined, from which the phase function of the sub-hologram is calculated. Expressed in simplified form, in the central region of the SLM sub-hologram the pixel image is sharp, so there the sub-hologram is used as a lens function without correction, whereas in the edge region of the SLM a sub-hologram with additional aberration correction is used in the SLM plane, since there the pixel image is not sharp.Overall, however, the required aberration correction of the sub-hologram in the SLM plane is in this case also substantially reduced by the use of corrections in the intermediate image plane of the illumination device.

[0244] As already explained for the use of a variable imaging system in the intermediate image plane of the illumination device, this embodiment can be replaced by an alternative embodiment, i.e. the variable imaging system can be replaced by an operation in the virtual SLM plane, a transformation to a virtual observer window and an inverse transformation to the real SLM plane, in this case the real image of the SLM. During this transformation from the virtual SLM plane to the observer plane with the virtual observer window and from there to the plane of the SLM image, a quadratic phase term is added to the phase value in the observer plane according to the distance from the two planes (SLM plane, observer plane). These quadratic phase terms are the equivalent of lens functions. Using a variable imaging system in the intermediate image plane of the illumination device and therefore in the intermediate image plane of the virtual observer window as a method for displacing the SLM image, or instead an arithmetic transformation of the object points to the observer plane, adding a quadratic phase term to the phase value in this plane and an inverse transformation for the purpose of an arithmetic displacement of the SLM image between the virtual plane of the SLM and the real image plane of the SLM, is an alternative process for aberration correction.

[0245] However, it may be advantageous for the aberration correction if, instead of or in addition to using a variable imaging system with a phase element, in the intermediate image plane of the illumination device, a correction is also performed in the form of an arithmetic transformation. Thus, the sub-hologram is calculated in a substantially aberration-free image plane of the SLM and is arithmetically transformed from there into the intermediate image plane of the illumination device. In this intermediate image plane, an inverse aberration correction is performed and the corrected data are thus transformed back into the real aberration-affected image plane of the SLM. For example, if a grating element with a variable, controllable period but with a one-dimensional electrode structure is used, a combination of arithmetic correction and correction by a phase element is reasonable. For example, if two crossed grating elements are used in a variable imaging system or an optical deflection device, phase curves that depend only on the horizontal coordinate or only on the vertical coordinate can be corrected by hardware in one grating element, respectively. Further phase terms or phase functions that are neither horizontally nor vertically independent can be taken into account in the formation of a two-dimensional matrix of phase values ​​in the further arithmetic correction. For this purpose, first a calculation of the correction as a phase curve is performed, then a decomposition of the phase curve into its individual components ph(x,y)=ph1(x)+ph2(y)+ph3(x,y) is performed.

[0246] The correction values ​​can also be determined by back-calculation from a virtual observer window via angle and local grating period, in the case of an arithmetic consideration of aberration correction, as if the correction elements were physically present in the intermediate image plane of the illumination device.

[0247] FIG. 18 shows a schematic representation of an observer's head 31, in which a display device with a light-guiding device 26 is arranged in front of the right eye RA and the left eye LA, respectively. Both display devices form a so-called head-mounted display (HMD) that is attached to the observer's head 31. For better understanding, the beam paths of the respective display devices are shown unfolded. However, in order to provide a suitable HMD, the beam paths of both display devices are in fact folded beam paths. For this purpose, for example, a deflection mirror can be provided between the SLM and the light-guiding device 26, so that in each case the SLM and the imaging elements of the optical system are arranged laterally adjacent to the observer's head 31. In each case, light is coupled from outside the head 31 into the light-guiding device 26 arranged in front of the respective eye LA, RA, propagates therein and is decoupled by an optical decoupling device 25 from the light guide of the light-guiding device 26 towards the observer's eye RA, LA. A respective virtual observer window then results on the pupil of the eye RA, LA, so that the observer can observe the generated or reconstructed scene. In Fig. 18, a curved light guide is used for the light-guiding device 26. In principle, tracking of the virtual observer window is not required in the HMD, since it is fixedly connected to the user's head 31 and therefore no larger positional changes of the user occur. This is because when the user moves, the HMD is also transported to this position at the same time. However, in some circumstances, fine tracking of the virtual observer window may be reasonable if an observer tracking device is suitably provided behind the light-guiding device in the light direction, which observer tracking device for example includes at least one liquid crystal grating element and is designed to track the virtual observer window in at least one direction, preferably horizontally.

[0248] The use of grating elements is mentioned and described herein in various contexts. Display devices, for example HMDs, typically require the use of multiple wavelengths, for example red, green and blue, for the color reconstruction or representation of a scene. For this purpose, for example, light of different wavelengths is applied to the grating elements successively in time, in particular in the case of grating elements with settable periods, which can be set separately for each wavelength, or, when the grating elements are used, for example, as coupling grating elements and decoupling grating elements, grating elements with sufficient wavelength selectivity are used to guide light into or out of the light guide, respectively, so that they act, for example, as grating elements only for one wavelength. In the general case, a stack of multiple grating elements should also be understood as a coupling grating element according to the invention, for example a stack of three grating elements, one grating element for each primary color red, green and blue (RGB) or each wavelength.

[0249] The above description of the invention in general, and also of exemplary embodiments, relates inter alia to display devices having a light guide and / or light guiding device. However, for the sake of clarity, it should be noted that in particular the parts of the description relating to a two-stage optical system, and the determination of sub-holograms by inverse calculation, are also more generally applicable to holographic or stereoscopic display devices that do not have a light guide or light guiding device.

[0250] Generally, a display device with a two-stage optical system is described, in which an SLM is illuminated by an illumination device and an intermediate image of a virtual observer window is generated by at least one first imaging element of the optical system in an intermediate image plane of the illumination device. This intermediate image of the virtual observer window is imaged at the position of the actual virtual observer window by at least one second imaging element of the optical system. In this case, a variable imaging system with at least one imaging element is arranged in the intermediate image plane of the illumination device. Prism functions and / or lens functions and / or phase curves for aberration correction can be written into at least one imaging element.

[0251] The above-mentioned mathematical aberration correction at the intermediate image plane of the illumination device can generally be performed for a two-stage optical system without the use of a light guide or light directing device.

[0252] A typical display device may for example be a holographic projection system, in which a real image of the SLM is generated on a screen, or a head-mounted display which has other components such as conventional lenses or mirrors instead of a light guide.

[0253] Such a display device can be advantageously combined with a system as described, for example, in the applicant's PCT / EP2017 / 071328 in Figs. 7 and 8, where filtering is performed using a filtering element in the intermediate image plane of the illumination device. This filtering is used, for example, to filter out zero order spots or to filter out specific diffraction orders. The disclosure content of this application is incorporated herein in its entirety. Thus, a passive or variable amplitude element for filtering in the intermediate image plane of the illumination device can be combined with at least one phase element of the variable imaging system proposed here to implement a prism or lens function for aberration correction. Furthermore, in addition to filtering, the amplitude element can be additionally used for aberration correction.

[0254] As described in the applicant's PCT / EP2017 / 071328, the lateral displacement of the virtual observer window over one or two diffraction orders can also be combined with the two-stage optical system described herein with a variable phase element in the intermediate image plane of the illumination device. For example, if the lens function for displacing the SLM image in depth is implemented with a phase element or grating element of a variable imaging system for a laterally displaced position of the virtual observer window, the phase element or grating element must be as large in its dimensions as the total area considered, i.e. as many diffraction orders in the intermediate image plane of the illumination device. The position at which the lens function is written on the grating element can also be laterally displaced on this grating element, and the dimensions of the area on the grating element where the lens function is written need only be as large as the area corresponding to the observer window, i.e. at most one diffraction order. Other diffraction orders can for example be filtered out by filtering in the intermediate image plane of the illumination device. It can for example be a controllable filter device that can alternately filter out or transmit the various diffraction orders. In the case of back-calculation from a virtual observer window, for example for aberration correction, only a section of the size of up to one diffraction order, displaced accordingly, is used for the calculation of the correction. In the case of arithmetic correction in a laterally displaced virtual observer window, this can be taken into account in the calculation by a corresponding linear phase term in the hologram or SLM plane.

[0255] In general, it is also possible to use an additional grating element with a controllable variable grating period close to the SLM, which additional grating element is used to displace the position of the intermediate image of the observer window in the intermediate image plane of the illumination device by writing it into a prism function, and in this intermediate image plane it is possible to use a larger phase element or grating element of the variable imaging system, the dimensions of which are large enough to include the entire possible area in which the intermediate image of the observer window can be displaced, and the phase function of the prism function or lens function or the phase function for aberration correction is written only locally in the area of ​​the current position of the intermediate image of the virtual observer window.

[0256] The back-calculation from the virtual observer window through the optical system towards the SLM is only applicable to optical systems associated with light guides and / or light guiding devices and / or two-stage optical systems. However, a combination of the method of back-calculation with a two-stage optical system is particularly advantageously applicable, where the two-stage optical system incorporates a light guide, in particular a curved light guide, in the second imaging step and also comprises a controllable variable imaging system in the intermediate image plane of the illumination device, and where the back-calculation is used in the variable imaging system to determine the aberration corrections which are written in the form of a phase function into the variable imaging system.

[0257] The following discussion generally discusses angles in light guides and specifically the calculation of decoupling positions on the light guide of a light directing device.

[0258] The path that a light beam covers after a defined number of reflections in a light guide can be calculated based on the geometry of the light guide and the optical properties of the optical coupling and decoupling devices.

[0259] In FIG. 19, an example of a flat or planar light guide LGA is shown in diagram (a) and an example of a curved light guide LGB is shown in diagram (b). In FIG. 19(a), light L is coupled into the light guide LGA with thickness d so that it propagates at an angle β to the normal of the light guide LGA. Then, the light L reaches the surface opposite the coupling side after a distance Δx=dtanβ from the coupling position and again reaches the surface where the light was coupled after twice the distance 2Δx=2dtanβ. Therefore, if the light beam L is separated again from the light guide LGA after N reflections, the distance between the coupling side and the separation side is therefore: 2Ndtanβ.

[0260] In Fig. 19(b) light propagation in a curved light guide LGB is shown, which represents a cross section of a circular arc. The inner surface has a radius r1 around the circle center point K, the outer surface has a larger radius r2 around the circle center point K, and the thickness of the light guide LGB is d=r2-r1, and thus the difference between the two radii r1 and r2. Light L is coupled so that it propagates at an angle β to the normal to the inner surface of the light guide LGB, and the light L is incident at a different angle β-γ / 2 to the normal due to the different radii r2 and r1 on the outside of the light guide LGB. After reflection on the outside of the light guide LGB, the light beam L reaches the inside again after covering an angular segment on the circular arc of γ. The following relationship arises from the sine theorem: γ=2*(β-asin(sin(β)r1 / r2))

[0261] Numerical example: if the inner radius of the light guide is 32 mm and the outer radius is 36 mm with angle β of 51.9°, then the angle γ of the section of a 15° arc will result in one reflection of the light on the outside of the light guide before it re-enters the inside of the light guide. For four reflections of the light in the light guide, the light will for example propagate 60° on an arc in the light guide. Thus, from the above formula, the decoupling position on the light guide after a defined number of reflections can be calculated from the known coupling position on the light guide and angle β, even in the case of curved light guides.

[0262] For coupling light into a light guide using a grating element, the known grating formula: sinβ out = λ / g + sinβ in where λ is the wavelength, g is the grating constant of the grating element, and β in is the angle of incidence of light, and β out is the resulting angle of the light as it propagates in the light guide. The lattice equation applies in this form when the entrance and exit media are identical. For light entering from air and propagating in a light guide with refractive index n, the refraction on the interface of the two media should additionally be considered: sinβ inmed =1 / n sinβ inair , where β inmed is the angle of incidence of light on a grating element in a medium with refractive index n, and β inair is the angle of incidence of light in air.

[0263] FIG. 20 shows a flat or planar light guide LG, where it is considered that different light beams of a luminous flux are coupled into the light guide LG at different positions or locations. These various coupling positions are here spaced apart by an interval Δx in As is clear from FIG. 20, the coupling grating element G in For example, two light beams L1 and L2 having different angles α1 and α2 in air are incident on the coupling grating element G. in , are deflected in the light guide LG at different propagation angles β1 and β2.

[0264] In a display device, the angular spectrum for coupling of light into a light guide can result for example from the diffraction angles of an SLM with a given pixel pitch. By appropriately arranging a decoupling grating element on the light guide, it is then possible to decouple both light beams L1 and L2 again from the light guide after one, two or three reflections in the light guide. Figure 20 shows the angular spectrum for coupling of light into a light guide LG with two reflections (N=2) of light at the interface of the light guide LG with a decoupling grating element Gout In the example shown in FIG. 20, decoupling of light from the light guide LG after four reflections at the interface of the light guide will be more difficult. That is to say, the position P where the light beam L1 extending at a smaller angle β1 reaches on the interface of the light guide after four reflections is the same as the position where the light beam L2 extending at a larger angle β2 reaches after three reflections of light at the interface of the light guide LG. If a decoupling grating element is provided at this position, it may inadvertently happen that the light beam L2 extending at the angle β2 has already been decoupled after three reflections in the light guide, and therefore too early. Such undesirable overlapping of the decoupling regions can be avoided for a given size of the coupled light bundle and a given angular spectrum of the coupled light, for example by a suitable selection of the thickness of the light guide and the grating constant of the coupling grating element.

[0265] The following description describes grating elements within optical coupling and decoupling devices more broadly and in more detail.

[0266] As already mentioned, the optical decoupling device for decoupling light from the light guide of the light guiding device may alternatively comprise a controllable grating element or a passive grating element in combination with a polarization switch, however, it is also possible for the optical decoupling device to only comprise a passive grating element.

[0267] Display devices in which multiple images of an SLM composed of segments are generated by a light-guiding device require a switchable grating element or a passive grating element combined with a polarization switch. Display devices in which only a single image of an SLM not composed of segments is generated by a light-guiding device can therefore also comprise only passive grating elements without additional switch elements of a specific configuration. Particular configurations of optical decoupling devices that can be used in light-guiding devices for such display devices are described more broadly below.

[0268] The optical coupling device may also include a grating element. A particular configuration of the grating element may be used in a similar manner for both the optical coupling device and the optical decoupling device. Alternatively, the controllable or passive grating elements may be designed as transmissive or reflective. They may alternatively be arranged, for example, on the inner interface between the light guide core and an outer layer, such as a dielectric layer stack, or on the outer surface of the light guide. The optical decoupling device may also include a combination of reflective and transmissive grating elements. In a display device with a light guiding device, the transmissive grating element is preferably arranged on the interface or surface of the light guide facing the viewer, and the reflective grating element is preferably arranged on the interface or surface of the light guide facing away from the viewer in the optical decoupling device.

[0269] Conversely, the optical coupling device may have a transmissive grating element, preferably on a surface or interface facing away from the viewer, and a reflective grating element, preferably on a surface or interface of the light guide facing the viewer in the display device.

[0270] A grating element generally has a deflection angle that depends on the wavelength. The same grating element typically deflects red light at a larger angle than green or blue light. In the case of a display device with a light guide device, light of different wavelengths, for example red, green, and blue light (RGB), should also be advantageously decoupled from the light guide at the same position or location after an equal predetermined number of reflections of the light in the light guide. Furthermore, light of different wavelengths propagates from the decoupling position of the light guide to the observer area, i.e. the virtual observer window or sweet spot, at the same angle. This is most easily realizable when the coupling angle and decoupling angle of the light are equal for the wavelengths used (red, green, blue (RGB)). For coupling of light into the light guide, it is also possible to use, for example, mirror elements instead of grating elements, which can realize the coupling angle independent of the wavelength.

[0271] The use of grating elements for coupling or decoupling light into or from a light guide and achieving equal angles for different colors or wavelengths requires either the use of different grating elements for each wavelength or the use of a single grating element with a configurable grating period for each color. Volume gratings are known, for example, as they can have limited angular and wavelength selectivity. For example, it is possible to create volume gratings that inherently deflect either only red light, or only green light, or only blue light in an advantageous manner, because they have very low diffraction efficiency at each other wavelength.

[0272] The optical coupling or decoupling device may comprise a stack of three grating elements, for example a volume grating for red light, a volume grating for green light, and a volume grating for blue light. These three volume gratings are each designed to deflect at the same angle the red, green, and blue light incident at the same angle on the volume grating. It is also known that in a volume grating, multiple grating features can be exposed in a single layer. Thus, instead of a grating element stack, the optical coupling or decoupling device may also comprise a single grating element with multiple exposed grating features for the deflection of red, green, and blue light. In the case of a grating element stack, all grating elements may optionally be designed to be switchable and / or controllable. However, multiple passive grating elements are preferably used in combination with a single switch element, for example a polarization switch.

[0273] Another possibility for achieving the same deflection angle in coupling and decoupling of light for various wavelengths is to use grating elements for deflecting multiple wavelengths at different angles in combination with correction grating elements, each of which corrects the deflection angle for a single wavelength so that this deflection angle corresponds to the deflection angle for another wavelength. In such an optical coupling or decoupling device, for example, a first grating element for deflecting multiple wavelengths can be designed as a surface relief grating or a polarization grating, while a further grating element for correcting the deflection angle of one wavelength can each be designed as a volume grating. The first grating element for example deflects red, green and blue light, so that the green light is deflected at the desired angle, but the red light is deflected at an excessively large angle and the blue light is deflected at an excessively small angle. The further provided grating element then performs the correction of the deflection angle of the blue and red light, so that the red, green and blue light are coupled into the light guide at the same deflection angle and decoupled again. For the correction of the deflection angle for each wavelength, it is also possible to use an arrangement of volume gratings with several grating elements per wavelength, for example two grating elements per wavelength. The first volume grating for correcting the deflection angle can perform a pre-deflection in each. The second volume grating can then deflect the pre-deflected light so that the desired exit angle is realized or obtained. In this case, the fact that a volume grating with a large deflection angle generally has a narrower wavelength selectivity than a volume grating with a small deflection angle is utilized. Due to the narrower wavelength selectivity, it is easier to achieve a volume grating that deflects light of only one wavelength.

[0274] In particular, the first grating element of an optical coupling or decoupling device for deflecting multiple wavelengths can be designed as switchable and / or controllable. Another grating element for correcting the deflection angle of one wavelength, respectively, can be designed passively. However, it is also possible that all grating elements of an optical coupling or decoupling device are designed passively. If switchable or switch elements are required for the decoupling of light, the passive grating elements can again be combined with a polarization switch as the switch element. However, all grating elements can alternatively also be designed as switchable and / or controllable.

[0275] In configurations of optical decoupling devices in which passive grating elements are used in combination with a switch element, e.g. a polarization switch, either at least one grating element is itself designed to be polarization selective, i.e. it only deflects light of a defined polarization, or an additional polarizing element is placed between the polarization switch and the grating element.

[0276] In the configuration of an optical decoupling device having only passive grating elements without a switch element, however, only light of a defined polarization should be decoupled, and at least one grating element should itself be designed as polarization-selective, or an additional polarization element should be placed between the polarization switch and the grating element.

[0277] A combination of polarization selectivity, wavelength selectivity, and angle selectivity can be achieved, for example, using certain types of volume gratings. A volume grating having a grating structure made of a liquid crystal material with birefringence and an isotropic material with the same refractive index as the ordinary or extraordinary refractive index of the liquid crystal material can act as a diffraction grating for a first linearly polarized light and as an isotropic material for a second linearly polarized light perpendicular to the first linearly polarized light. Examples of such diffraction gratings are polymer dispersed liquid crystal (PDLC) gratings, polyphemus gratings, or polyclips (polymer liquid crystal polymer slices) gratings. These gratings are hereafter referred to as polarization selective volume gratings (PSVGs). Polarization selective volume gratings based on liquid crystals can also be designed as switchable, by the grating being placed between two electrodes and the orientation of the liquid crystals being changed by an electric field. In a first switching state, hereafter referred to as on, these gratings have a polarizing effect on linearly polarized light, typically p-polarized light, but a non-polarizing effect on linearly polarized light rotated 90° relative to it, typically s-polarized light. In the second switching state, hereafter called OFF, these gratings have no effect on s- or p-polarized light. Certain types of switchable polarization-selective volume gratings are sometimes also called "switchable Bragg gratings (SBG)" in the literature. In this document, the name PSVG is also used for this purpose. A further type of grating that can have high diffraction efficiency in a single diffraction order is the polarization grating (PG). Conventional polarization gratings, for example, polarize left circularly polarized light in the +1 diffraction order and right circularly polarized light in the -1 diffraction order, or vice versa, depending on the design of the grating. In contrast to volume gratings, conventional polarization gratings have a wide angle of acceptance and high efficiency for a variety of wavelengths.

[0278] However, special types of polarization gratings with small grating periods have the property that they only polarize light of a defined circular polarization, but transmit light of a circular polarization with the opposite rotation sense without polarizing it. To distinguish them from polarization-selective volume gratings (PSVGs) and conventional polarization gratings (PGs), we refer to them as Bragg polarization gratings (B-PGs). These gratings are described in more detail below.

[0279] In one configuration of the optical decoupling device with additional polarizing elements, a wire grid polarizer (WGP) is provided on the inner or outer cladding layer of the light guide. Wire grid polarizers are also available as films and can be laminated onto curved surfaces, such as the cladding layer of a curved light guide. A grating element is provided or applied on the outer surface of the wire grid polarizer. The wire grid polarizer has the property of reflecting light of a first linear polarization and transmitting light of a second linear polarization perpendicular thereto. Thus, light of the first polarization is reflected from the wire grid polarizer on the cladding layer of the light guide and then propagates further in the light guide and thus does not reach the grating element at all. Light of the second linear polarization perpendicular thereto passes through the wire grid polarizer and is incident on at least one grating element, for example a grating element stack made of three volume gratings, and if a grating element stack is provided, it can be deflected from the grating element or one of the grating elements and decoupled from the light guide.

[0280] As already mentioned, a switchable or controllable grating element or polarization switch for use in combination with a passive grating element can be divided into sections, each with a separate electrode, and can be used to perform polarization switching within a section by applying an electric field. The term "section" is also intended to include coarse structures according to the invention. For example, a switchable or controllable grating element or switch element, e.g. a polarization switch, can be divided only into three or four coarse sections, each with an individual electrode and a few millimeters wide, e.g. 5 mm to 10 mm. However, it is also possible to finely divide it into a number of smaller sections, e.g. strip-like sections with a width of 0.5 mm.

[0281] The division of a switchable or controllable grating element or switching element into sections may be provided or used in a display device in which either a single image or multiple images made up of segments of the SLM are generated by a light directing device as follows:

[0282] In an embodiment of the display device, the number of reflections of the light in the light guide until decoupling is set by switching on and off certain sections of the switchable or controllable grating element, i.e. by at least one switch element. For this purpose, it may also be provided that certain sections are set in one drive state and other sections are set in another drive state, thereby varying, changing or defining the number of reflections of the light in the light guide.

[0283] In another embodiment of the display device, even for a fixed number of reflections of light at the interface of the light guide, the decoupling position of the light is changed in fine steps by switching on and off certain sections of a switchable or controllable diffraction grating element, i.e. by at least one switch element or by different drive states of the section. This can be used for example to displace the position of a single segment of a multiple image of the SLM in fine steps. This can be used in combination with gaze tracking, for example to position a specific segment of the multiple image in the center of the gaze direction of the observer.

[0284] FIG. 21 shows a schematic light guiding device with a light guide LG and an optical decoupling device, and a polarization switch PS is provided on one side of the optical decoupling device. The polarization switch PS itself can be composed of, for example, a liquid crystal layer between electrodes, to which an electric field can be applied. In this case, the left circularly polarized light CL first propagates in the light guide LG, where, as is evident, the left circularly polarized light CL is coupled to the light guide LG on the left side of FIG. 21 and propagates to the right side via total reflection in the light guide LG. As can be further seen from FIG. 21, the polarization switch PS is divided into two sections, which will be referred to as the left section and the right section, respectively, for simplicity in the following. In the left section, which corresponds to the left side of FIG. 21, the polarization switch PS is controlled not to change the polarization of the incident light. This left section is in the OFF state. In the right section, the polarization switch is controlled to change the polarization of the incident left circularly polarized light CL, so that right circularly polarized light CR is provided after the light passes through this right section of the polarization switch PS. The right side of the polarization switch PS is in the ON state.

[0285] Outside the light guide LG, i.e. after the polarization switch PS, a polarization grating element with volume grating properties, thus the Bragg polarization grating B-PG, is arranged. This Bragg polarization grating B-PG has the property that it deflects right-handed circularly polarized light CR by an angle defined by the grating period of the Bragg polarization grating B-PG, but does not deflect left-handed circularly polarized light CL. An additional carrier substrate, for example made of plastic, can be provided between the polarization switch PS and the Bragg polarization grating B-PG, as well as between the Bragg polarization grating B-PG and the outer surface of the light-guiding device. Such a carrier substrate is shown in FIG. 21, but is not necessary.

[0286] In operation of the light guiding device, the left circularly polarized light CL passing through the left section of the polarization switch PS then enters the Bragg polarization grating B-PG, passes through it undeflected, and enters the interface of the light guide LG of the light guiding device such that total internal reflection TIR occurs. The light then propagates further in the light guide LG. The right circularly polarized light CR passing through the right section of the polarization switch PS enters the Bragg polarization grating B-PG, is deflected by this Bragg polarization grating B-PG, and thus enters perpendicularly to the interface between the light guide LG and the surrounding medium air, and is decoupled from the light guide LG. As mentioned above, a correction grating element can be provided after the Bragg polarization grating B-PG to decouple the light of multiple wavelengths in the light guide LG from the light guide at the same angle.

[0287] FIG. 22 shows a schematic of a light guide device with a wire grid polarizer WGP in an optical decoupling device. Linear s-polarized light S now propagates in the light guide LG of the light guide device. The provided polarization switch PS is again divided into two sections, a right section and a left section. The driving or switched-on state of the left section of the polarization switch PS changes the incident s-polarized light S to p-polarized light P. As can be seen in the right section of the polarization switch PS in the off state, the incident s-polarized light S passes through this section unchanged, so that the s-polarized light S is still present thereafter. The s-polarized light S then enters the wire grid polarizer WGP. The wire grid polarizer WGP reflects the s-polarized light S, which then propagates further in the light guide LG, as indicated by the arrow. In contrast, the converted p-polarized light P in the left section of the polarization switch PS passes through the wire grid polarizer WGP and enters the quarter-wave plate QWP. The quarter-wave plate QWP converts the incident p-polarized light P into right-handed circularly polarized light CR, which then enters the Bragg polarization grating B-PG. After being deflected by this Bragg polarization grating B-PG, the right-handed circularly polarized light CR enters the light guide LG perpendicular to its interface with the surrounding air medium and is decoupled from the light guide LG. The advantage of the light guide device configured in this way is that it can compensate for the imperfect behavior of the polarization switch PS and the quarter-wave plate QWP.

[0288] If less than 100% of the light is changed from s-polarized to p-polarized by the polarization switch PS, this light is therefore reflected by the wire grid polarizer WPG. If less than 100% of the light is changed to circular polarization by the quarter-wave plate QWP, this light is reflected by total internal reflection at the interface and propagates further in the light guide LG. Thus, inadvertent decoupling of interfering light with the wrong polarization from the light guide LG is prevented.

[0289] This light directing device can also be used in combination with corrective grating elements for other wavelengths of the RGB primary colors, so that light of different wavelengths is decoupled from the light guide at equal angles.

[0290] In FIG. 23, a light-guiding device including a wire grid polarizer WGP in the optical decoupling device is shown in a schematic manner, similar to the light-guiding device of FIG. 22. Instead of the Bragg polarization grating B-PG, the optical decoupling device of the light-guiding device now includes a volume grating VG. Here, no quarter-wave plate is provided. The passage of light through the light guide LG and the optical decoupling device is performed similarly to FIG. 22. As is evident, when a part of the polarization switch PS is in the off state, the s-polarized light S is already reflected by the wire grid polarizer WGP. When a part of the polarization switch PS is in the on state, the incident s-polarized light S is converted to p-polarized light P, passes through the wire grid polarizer WGP, and enters the volume grating VG. In this exemplary embodiment, the volume grating VG itself is not designed as polarization selective. It can be, for example, a volume grating made of a conventional photopolymer material. After the p-polarized light P is deflected by the volume grating VP, it enters the light guide LG perpendicular to the interface with the surrounding medium air and is decoupled from the light guide LG.

[0291] A light guiding device with an optical decoupling device is shown diagrammatically in FIG. 24, which differs from FIG. 23 only in that the volume grating VG is designed as reflective. In the OFF state of the polarization switch PS, the incident s-polarized light S is reflected by the wire grid polarizer WGP and propagates further in the light guide LG. However, when a section of the polarization switch PS is in the ON state, the incident s-polarized light is converted by the polarization switch PS into p-polarized light P, passes through the wire grid polarizer WGP and enters the reflective volume grating VG. The p-polarized light P is deflected and reflected by the volume grating VG. The reflected p-polarized light P passes again vertically through the optical decoupling device and the light guide LG and is decoupled from the light guide LG on the other side.

[0292] FIG. 25 shows a schematic representation of a light-guiding device, in which the light decoupling device comprises a switchable polarization-selective volume grating PSVG, for example based on liquid crystal. When the switchable polarization-selective volume grating PSVG is in one driving or off state, both s-polarized light S and p-polarized light P incident on the switchable polarization-selective volume grating PSVG are not deflected, but are rather reflected by total internal reflection at the interface of the light guide LG and then propagate further in the light guide LG, as indicated by the leftmost arrow. However, when the switchable polarization-selective volume grating PSVG is in another driving or on state, the p-polarized light P is decoupled from the light guide LG. However, the s-polarized light S is reflected at the interface of the light guide LG and propagates further in the light guide LG. The volume grating itself is switchable or controllable, where the switchable polarization-selective volume grating PSVG is divided into two sections for better understanding in FIG. 25.

[0293] This allows us to better explain the ability to control the switchable polarization-selective volume grating PSVG in relation to the optical path. Similarly, such a light-guiding device can also be implemented using a switchable Bragg polarization grating, using only circular polarization instead of linear polarization.

[0294] A light-guiding device is shown diagrammatically in FIG. 26, in which the light decoupling device includes a Bragg polarization grating B-PG, which deflects all wavelengths of light at different angles, and a number of volume gratings VG. The number of volume gratings VG forms a volume grating stack with four volume gratings VG1, VG2, VG3, and VG4 in this exemplary embodiment. Light of red wavelength R, light of green wavelength G, and light of blue wavelength B are incident on the Bragg polarization grating B-PG at the same angle. Light of green wavelength G is deflected in this case to exit the Bragg polarization grating B-PG perpendicular to a surface or interface of the light guide LG. Light of red wavelength R and light of blue wavelength B exit the Bragg polarization grating B-PG at different angles, as can be seen based on the dashed and solid arrows in FIG. 26.

[0295] The Bragg polarization grating B-PG is followed by a volume grating stack with four volume gratings VG1, VG2, VG3, and VG4. These volume gratings VG1, VG2, VG3, and VG4 of the volume grating stack are designed as wavelength selective. In this exemplary embodiment, this means that the light G of green wavelength passes undeflected through all four volume gratings VG1, VG2, VG3, and VG4 and is then decoupled from the light guide LG. The light R of red wavelength passes undeflected through the first two volume gratings VG1 and VG2 and is deflected only by the last two volume gratings VG3 and VG4, so that it exits the light guide LG at the same angle as the light G of green wavelength. The light B of blue wavelength is deflected only by the first two volume gratings VG1 and VG2 and passes undeflected through the last two volume gratings VG3 and VG4, and the volume gratings VG1 and VG2 deflect the light of blue wavelength to exit the light guide LG at the same angle as the light G of green wavelength or the light of red wavelength.

[0296] To correct the exit angles of the light for blue and red wavelengths from the light guide, a pair of volume gratings is used in each case, since good wavelength selectivity can be more easily set for larger deflection angles of the volume gratings. For example, light B of blue wavelength is first deflected at a larger angle by the volume grating VG1 before the volume grating VG2 deflects the light of blue wavelength. As a result, the light exits therefrom perpendicular to the surface or boundary surface of the light guide LG.

[0297] The following description relates to the separate effects of the imaging and illumination beam paths in a display device having diffractive elements either in the Fourier plane of the SLM or in the source plane of an illumination device or in the image plane of the SLM.

[0298] In a holographic display device or another preferably three-dimensional display device, such as a volumetric display device, at least one diffractive optical element is used to essentially affect only the illumination beam path or only the imaging beam path. This at least one diffractive optical element was also called a variable imaging system in the above description of the invention. Here, the designation "diffractive optical element" is used in the following, since it is considered to be mainly related to the influence of the illumination beam path and the imaging beam path.

[0299] The influence of only the illumination beam path or only the imaging beam path is achieved by at least one diffractive optical element being arranged in or close to the image plane of the SLM so as to affect only the illumination beam path. Alternatively, at least one diffractive optical element can be arranged in or close to the Fourier plane of the SLM so as to affect only the imaging beam path. In Figs. 12 and 13, for example, at least one diffractive element identified as variable imaging system 30 is arranged in the light source plane of the illumination device, so that it affects only the imaging beam path. Alternatively or additionally, for example, the first imaging element 27, also shown in Figs. 12 and 13, arranged in the plane of the SLM, can have at least one diffractive element that affects only the illumination beam path.

[0300] In three-dimensional display devices in which the source image of at least one light source of the illumination device is present in the observer plane, a diffractive optical element in or near the Fourier plane of the SLM affects the imaging beam path and thus the image plane of the SLM without changing the position and dimensions of the observer area, in particular the virtual observer window. However, a diffractive optical element in or near the image plane of the SLM affects the position and dimensions of the observer area without affecting the image distance of the SLM. In three-dimensional display devices in which the image of the SLM is generated in the observer plane or vice versa, a diffractive optical element in or near the image plane of the SLM affects the position of a reference plane for the hologram calculation, which may be selected as a virtual image plane in the sense of WO 2016 / 156287 A1, for example, without changing the position and dimensions of the observer area. The contents of WO 2016 / 156287 A1 are incorporated herein in their entirety. A diffractive optical element in or near the Fourier plane of the SLM affects the position and dimensions of the observer area without affecting the distance of the reference plane.

[0301] Specific configurations are described in more detail below: In particular, in one configuration of a display device generating a light source image in the observer plane, a two-stage system is used, generating an intermediate image of the observer area or an intermediate image of the light source in the Fourier plane of the SLM, and at least one diffractive optical element is placed in or very close to this intermediate image plane, affecting only the imaging beam path and leaving the position of the observer area unchanged. Such a configuration with a light guide is shown in FIG. 12. In this case, at least one diffractive element or variable imaging system 30 is placed in the intermediate image plane of the illumination device. In general, such a configuration with at least one diffractive element can also be used for devices without a light guide.

[0302] In particular, in display devices which produce a source image in the observer plane, at least one diffractive optical element in the Fourier plane of the SLM may have a lens function which affects the position of the image plane of the SLM.

[0303] In a display device which generates a source image in the observer plane, the position of the image plane of the SLM can preferably be adapted by at least one diffractive optical element in the Fourier plane of the SLM, so that the average size of sub-holograms for the computation of three-dimensional scenes is preferably reduced compared to display devices which do not use diffractive optical elements.

[0304] At least one diffractive optical element in the Fourier plane of the SLM can be designed to correct aberrations in the imaging beam path. At least one diffractive optical element can be designed as controllable. Furthermore, the diffractive optical element can be designed as a liquid crystal grating (LCG). Furthermore, two diffractive optical elements can be used, where a horizontal cylindrical lens function is written into one diffractive optical element and a vertical cylindrical lens function is written into the other diffractive optical element.

[0305] In a display device which generates a source image in an observer plane and generates a large field of view by generating segmented multiple images of the SLM, at least one controllable diffractive optical element is positioned in the Fourier plane of the SLM, whereby a lens function is written into the at least one diffractive optical element for each segment of the multiple images, whereby an image plane of the SLM is generated at a similar or equal distance from the observer for all segments.

[0306] In a display device which generates a light source image at an observer plane, generates a large field of view by generating segmented multiple images of the SLM, and comprises a light guide with different numbers of reflections within the light guide to generate individual segments of the multiple images of the SLM, at least one controllable diffractive optical element may be positioned in the Fourier plane of the SLM to equalize the different optical paths of the light within the light guide for the various segments and generate image planes of the SLM for all segments at similar or equal distances from the observer.

[0307] In a display device which generates a light source image in an observer plane, generates a large field of view by generating segmented multiple images of the SLM, comprises a light guide having different numbers of reflections within the light guide to generate individual segments of the multiple images of the SLM, and at least one diffraction grating element for coupling light into and / or decoupling light from the light guide, at least one controllable diffractive optical element can be positioned in the Fourier plane of the SLM to correct aberrations in the imaging beam path generated by the at least one diffraction grating element.

[0308] In a display device which generates a light source image in an observer plane, generates a large field of view by generating segmented multiple images of the SLM, comprises a light guide having different numbers of reflections within the light guide to generate individual segments of the multiple images of the SLM, and at least one diffraction grating element for coupling light into and / or decoupling light from the light guide, at least one controllable diffractive optical element can be positioned in the image plane of the SLM to correct aberrations in the illumination beam path generated by the at least one diffraction grating element.

[0309] In a display device with a light guide for generating a light source image in an observer plane and for generating a segmented multiple image of the SLM to generate a large field of view and with different number of reflections in the light guide for generating the individual segments of the multiple image of the SLM, at least one controllable diffractive optical element can be arranged in the image plane of the SLM to equalize the different optical paths of the light in the light guide for the various segments of the multiple image of the SLM and to generate an observer area at the same position for all segments. The configuration of this display device is also described below:

[0310] If the curved light guide forms a section of a circular arc with the centre of the observer area as the centre point of the circle, and for such a light guide the decoupling of the light from the light guide after different number of reflections in the light guide follows, due to the use of a diffractive optical element in the image plane of the SLM, it is advantageous since the observer area already arises for all segments of the multiple images of the SLM at the same position, so that no additional correction in this respect is necessary. However, this limits the geometry of the light guides that can be used.

[0311] Thus, the described embodiments having at least one diffractive optical element in the image plane of the SLM also enable the use of other light guides, e.g. flat or planar light guides or curved light guides whose curvature deviates from a circular arc section, and nevertheless an observer region can be generated at the same position for multiple segments.

[0312] In display devices which generate a source image in the observer plane, the focal length of the observer's eyes can be detected in holographic or stereoscopic systems by gaze tracking. The position of the image plane of the SLM can be changed using at least one controllable diffractive optical element in the Fourier plane of the SLM, so that the image plane of the SLM is located at a similar or equal distance from the observer as the distance detected by gaze tracking.

[0313] However, the invention is not limited to the embodiments shown and described herein, for example the exemplary embodiments or embodiments described herein can be correspondingly transferred to a display device generating an image of the SLM in the observer plane.

[0314] The following embodiment will be briefly described as an example: in a display device generating an image of an SLM in an observer plane and generating segmented multiple images of diffraction orders in the Fourier plane of the SLM to generate a large field of view, at least one controllable diffractive optical element can be positioned in the image plane of the SLM, so that a lens function is written into at least one diffractive optical element for each segment, such that the Fourier plane of the SLM is generated as a reference plane for hologram calculation for all segments that are at a similar or equal distance from the observer.

[0315] Polarization-selective Bragg grating elements or Bragg polarization gratings shall also be generally discussed below, which may be advantageously used in an optical decoupling device of a light guide device to decouple light from a light guide, which may be advantageously used in a head mounted display.

[0316] Bragg polarization gratings can be fabricated by bulk photoalignment methods, which guarantee the independence of the molecular orientation of each patterned surface of the alignment layer and allow the formation of tilted interference patterns. For this purpose, it is only necessary to rotate the pattern by the appropriate angle φ. In this case, it is assumed that such tilted holographic polarized light exposure can result in a complex 3D alignment of the LC polymer without the use of additional chemical additives (chiral LC additives) or alignment layers. The LC director is advantageously positioned perpendicular to the in-plane interference pattern. This means that the efficient local birefringence does not depend on the tilt of the interference pattern. This is an advantage of photocrosslinked LC polymers.

[0317] It could be established by simulation that when a right-handed circularly polarized beam is incident on a Bragg polarization grating, diffraction occurs in the -1 diffraction order, where the Bragg polarization grating converts the incident right-handed circularly polarized light to left-handed circularly polarized light. A diffraction efficiency of about 98% occurs in this -1 diffraction order in this case. The other diffraction orders, the zeroth diffraction order and the +1 diffraction order, have negligible diffraction intensity. In contrast, with left-handed circularly polarized light incident on a Bragg polarization grating, diffraction hardly occurs in the -1 and +1 diffraction orders, rather the majority of the light is in the zeroth diffraction order, where there is a diffraction efficiency of about 93%. The left-handed circularly polarized light passes undeflected and is converted to another polarization state through the Bragg polarization grating.

[0318] Due to its small thickness, the Bragg polarization grating has a wide spectral and angular acceptance. For example, the spectral and angular acceptance of a Bragg polarization grating optimized for normal light incidence with a wavelength of λ = 532 nm was measured using right-handed circularly polarized laser beams with wavelengths of 488 nm, 532 nm and 633 nm, and corresponding results were achieved. At this time, the first diffraction order of green wavelengths (η ±1 Bragg polarization gratings with diffraction efficiencies of >90% have been shown to have nearly identical diffraction efficiencies at red and blue wavelengths, which has the advantage that the grating elements can be used across the entire visible spectral range.

[0319] The angular acceptance of the Bragg polarization grating is approximately 35°.

[0320] Such Bragg polarization gratings can be used in a wide range of applications due to their unique properties, such as high optical quality of the thin film, high diffraction efficiency, and wide or broad angular and spectral acceptance. They can also be advantageously used, for example, in head mounted displays (HMDs) and devices for augmented reality (AR) and virtual reality (VR) applications. These grating elements, in combination with a polarization switch, allow very efficient beam deflection of coherent light. The deflection angle of the Bragg polarization grating, i.e. the angle between the two "working" diffraction orders, i.e. the zeroth and the first diffraction orders, was achieved in simulations at 42° in air using a wavelength of 532 nm. The switching contrast, i.e. the ratio of the diffraction efficiencies with opposite circular polarizations, can be about 100. The specific polarization and diffraction properties of the Bragg polarization gratings offer the option of combining several such grating elements in one stack. For example, a grating element stack can include two such grating elements designed for normal light incidence of green light. In operation, such a grating element stack deflects an incident light beam in either the +1 diffraction order or the -1 diffraction order depending on the polarization state of the light, right- or left-circularly polarized. The two grating elements of the grating element stack have the same period of Λ=0.77 μm and the same tilt angle, but with interference patterns of opposite tilt. The rotation angle φ can be kept either +28° or -28° by holographic exposure. After holographic exposure and tempering, the grating elements are fixed to each other using a UV-curable adhesive.

[0321] The right-hand circularly polarized beam incident on the grating element stack is diffracted by the first grating element in its −1 diffraction order and passes through the second grating element without being diffracted due to the large angular deviation from the Bragg angle of the second grating element. The left-hand circularly polarized beam incident on the grating element stack is not diffracted by the first grating element, but rather by the second grating element in the +1 diffraction order. The diffraction efficiency of the grating element stack at diffraction orders ±1 is approximately 85%. Such a grating element stack can provide a diffraction angle of ±42° at a wavelength of 532 nm, resulting in a total deflection angle of 84° in air. Such an effective, large, and symmetric one-step polarization-dependent optical deflection cannot be achieved using a single Bragg polarization grating.

[0322] In particular, such a grating element stack, or just a single Bragg polarization grating, may be used to advantage in a light-guiding device or a display device according to the invention.

[0323] Furthermore, combinations of the embodiments and / or exemplary embodiments are possible. Finally, it should be specifically noted that the exemplary embodiments described above are used only to illustrate the claimed teachings, but do not limit the teachings to the exemplary embodiments.

Claims

1. A near-eye display device, comprising: an illumination device having at least one light source; at least one spatial light modulation device; an optical system; a light directing device; and at least one variable imaging system; the illumination device illuminates the at least one spatial light modulating device; light emitted from the at least one spatial light modulating device passes through the optical system and enters the light directing device; the optical system is configured as a two-stage optical system, by which a light source image of the at least one light source of the illumination device or an image of the at least one spatial light modulation device can be generated; A display device, wherein the at least one variable imaging system is provided near or in an intermediate image plane of the at least one light source of the illumination device or in the image plane of the spatial light modulation device, the at least one variable imaging system comprising at least one imaging element designed as a diffraction grating element having a controllable variable period and configured to shift an image of the spatial light modulation device.

2. The display device of claim 1 , wherein the at least one variable imaging system is disposed in front of the light guiding device in the direction of light.

3. A display device as described in claim 1, wherein a variable imaging system is provided near the spatial light modulation device.

4. 3. A display device according to claim 1 or 2, wherein the at least one imaging element is designed as a controllable liquid crystal element or as at least two lens elements, the distance between which is variable.

5. 5. A display device according to claim 4, wherein a variable prism function or a variable lens function and / or a variable complex phase function is written into at least one controllable imaging element of said at least one variable imaging system.

6. 4. The display device of claim 3, wherein the variable imaging system is positioned in a plane of an image of the at least one light source of the illumination device for correction of aberrations in an imaging beam path.

7. 10. The display device of claim 1, wherein the at least one variable imaging system is positioned in an image plane of the spatial light modulator device for correction of aberrations in an illumination beam path.

8. 2. The display device of claim 1, wherein the at least one variable imaging system is provided for generating a virtual observer region for all segments of the multiple images at the same location.

9. 2. The display device of claim 1, wherein the light guiding device comprises a light guide, a light coupling device, and a light decoupling device, wherein light propagates within the light guide via reflection at an interface of the light guide, and wherein decoupling of the light from the light guide by the light decoupling device is provided after a predetermined number of reflections of the light at an interface of the light guide.

10. 10. The display device of claim 9, wherein when light entering the light guiding device is formed as a light bundle or light field having multiple light beams, decoupling of the light beams from the light guide is provided after reflections at the interface of the light guide an equal number of times for each of all light beams of the light bundle or light field.

11. The display device of claim 1 , wherein an image of the spatial light modulating device is producible by the light directing device and the optical system.

12. The display device of claim 1 , wherein the light source image of the at least one light source of the illumination device or the image of the spatial light modulation device can be generated by the light guiding device and the optical system in the light path after decoupling of light from the light guiding device.

13. The display device of claim 1 , wherein a virtual observer region can be generated in the plane of an image of the light source or in the plane of an image of the spatial light modulator device.

14. 10. The display device of claim 9, wherein the light guide of the light guiding device is curved, at least in sections, as a section of a hollow cylinder, and a virtual observer region can be generated in the region of a center point of an arc of the hollow cylinder.

15. The display device of claim 1 , wherein the formation of the image defines a field of view within which scene information encoded in the spatial light modulation device is reconstructed for observation through a virtual observer region.

16. 10. The display device of claim 9, wherein multiple images of the spatial light modulating device, consisting of a plurality of segments, are generated by the light directing device and the optical system, the multiple images defining a field of view within which scene information encoded in the spatial light modulating device is reconstructed for observation through a virtual observer region in the plane of the light source image.

17. 10. The display device of claim 9, wherein multiple images of certain diffraction orders consisting of a plurality of segments are generated by the light directing device and the optical system in a Fourier plane of the spatial light modulating device, the multiple images defining a field of view within which scene information encoded in the spatial light modulating device is reconstructed for observation through a virtual observer region in the image plane of the spatial light modulating device.

18. A display device as claimed in claim 16 or 17, wherein for the image or for a single segment of the multiple images, the decoupling of light coming from various pixels of the spatial light modulator device after entering the light guiding device is provided after multiple reflections at the interface surfaces of the light guide, an equal number of times for each of all pixels.

19. 18. The display device of claim 17, wherein for different segments of the multiple images, the number of reflections of the light at the boundary surface of the light guide for the generation of one segment is different from the number of reflections of the light at the boundary surface of the light guide for the generation of another segment.

20. 20. The display device of claim 17, wherein for different segments of multiple images, the number of reflections of the light at the boundary surfaces of the light guide are equal and the coupling position of the light into the light guide is different for these segments.

21. 21. A display device as claimed in claim 19 or 20, wherein the images of the spatial light modulator device are shifted by the variable imaging system for each segment of the multiple images, such that different optical paths of the light passing through the light guide are at least partially compensated for for different segments of the multiple images.

22. 10. The display device of claim 9, wherein a light deflection device is provided in front of the light guiding device in the direction of the light to shift a coupling position of the light into the light guide.

23. 10. The display device of claim 9, wherein in a first stage of the two-stage optical system, an intermediate image of the at least one light source of the illumination device is generated by at least one first imaging element, and in a second stage of the two-stage optical system, the intermediate image of the light source is imaged by at least one second imaging element within a virtual observer region in the light path after decoupling of the light from the light guide.

24. 10. The display device of claim 9, wherein at least one controllable grating element of the light decoupling device of the light directing device comprises at least one lens function.

25. A head mounted display having two display devices, each of which is designed according to a display device according to any one of claims 1 to 24 and which is assigned respectively to an observer's left eye and to the observer's right eye.

26. 1. A method for generating a reconstructed scene with a spatial light modulation device and a light guide, comprising: said spatial light modulation device modulating incident light with desired information of said scene; light modulated by the spatial light modulator device is coupled into the light guide by an optical coupling device and decoupled from the light guide by an optical decoupling device; generating a light source image of at least one light source of an illumination device or an image of said spatial light modulation device by a two-stage optical system; providing at least one variable imaging system near or in an intermediate image plane of at least one light source of the illumination device or in the image plane of the spatial light modulation device; an image of the spatial light modulator device is shifted by the at least one variable imaging system comprising at least one imaging element designed as a diffraction grating element with a controllable variable period; The method includes:

27. 27. The method of claim 26, wherein the light is decoupled from the light guide after a predetermined number of reflections at interfaces of the light guide.

28. 27. The method of claim 26, wherein an image of the spatial light modulating device or multiple images of the spatial light modulating device consisting of a plurality of segments are generated.

29. 30. The method of claim 28, wherein for at least a portion of the plurality of segments of the multiple images, an intermediate image of the spatial light modulator device is generated within the light guide.

30. 30. The method of claim 28 or 29, wherein for each individual segment of the multiple images, the images of the spatial light modulator device are shifted by at least one variable imaging system so that different optical light paths within the light guide obtained for the individual segments are at least partially compensated for.

31. 31. The method according to claim 30, wherein for each individual segment of the multiple images, aberration correction is performed by the at least one variable imaging system by changing at least one optical characteristic of the variable imaging system, a correction function being calculated and stored once in each case for each segment.

32. 32. The method of claim 31 , wherein the aberration correction is performed in an intermediate image plane of an illumination device and / or in the amplitude and phase curves of a hologram encoded on the spatial light modulation device.

33. 32. The method of claim 31 , wherein the calculation of the correction function is performed by numerical inversion of the light path and back tracing of a light beam from a virtual observer region through the light guide to a plane of an image of at least one light source of a lighting device.

Images