Near-eye image projection system and wearable device including near-eye image projection system

Abstract

To provide a compact near-eye image projection system and a wearable device including the near-eye image projection system.SOLUTION: A near-eye image projection system according to the present invention comprises: a pin light source that generates a plurality of incident light beams; a spatial light modulator that generates a plurality of modulated light beams to form pin light images on a first plane; an illumination optical system that, on a third plane, guides the incident light beams from the pin light source to the spatial light modulator; and an imaging optical system that, on a fourth plane, guides the modulated light beams along a projection axis to an eyebox region within a second plane parallel to the first plane. The third and fourth planes are substantially parallel to the first plane. The illumination optical system defines a first optical path from the first plane to the second plane and a second optical path from the third plane to the fourth plane. The imaging optical system defines a third optical path from the second plane to the first plane and a fourth optical path from the first plane to the second plane. A wearable device including the aforementioned near-eye image projection system is also provided.SELECTED DRAWING: Figure 1a

Description

[Technical field]

[0001] The present invention relates to a near-eye image projection system with a small form factor. The present invention further relates to a wearable device, such as an augmented or mixed reality or smart glasses, comprising said near-eye image projection system. More particularly, the present invention relates to a near-eye light field projection system. The near-eye light field projection system is provided with a field of view forming capability. [Background technology]

[0002] Light field image projection by sequential spatial light modulation of structured incident light by a spatial light modulator (SLM) typically requires that source light from a light source is shaped by several optical elements separated by a transparent medium of sufficient volume to achieve the required properties of the structured incident light and thus of the projected light field image. Such an arrangement results in bulkier devices that are not suitable for use in applications requiring a small form factor, such as wearable devices like smart glasses. Reducing the optical system by using higher power optical elements such as lenses with shorter focal lengths, freeform optics, etc. still requires a significant volume for light propagation or is penalized by higher standard compensation requirements for the illumination light structure and thus the quality of the projected image degrades, and optical artifacts such as distortion, aberration, and diffraction.

[0003] Patent document 1 (EP3542206A1) discloses a method of light field projection by sequential spatial light modulation of structured light. Patent document 2 (WO2020157562A1) discloses several methods of combining light field projection systems with different types of combiners, and patent document 3 (US20190285897A1) discloses an apparatus using an image pupil expansion with a wave guide in combination with a reflective combiner. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] European Patent Application Publication No. 3542206 [Patent Document 2] International Publication No. 2020 / 157562 [Patent Document 3] US Patent Application Publication No. 2019 / 0285897 Summary of the Invention

[0005] The present disclosure relates to a pin light source generating a plurality of incident light beams; an SLM configured to modulate the plurality of incident light beams to generate a plurality of modulated light beams that form pin light images at a first plane; The present invention relates to a near-eye image projection system comprising illumination optics and imaging optics configured to deliver an incident light beam from a pin light source to an SLM. The imaging optical system is The system is further configured to convey the modulated light beam continuously along a projection optical path from the SLM to an eyebox region in a second plane substantially parallel to the first plane. A pin light source of the illumination optical system is in a third plane and a final projection axis towards the eyebox is in a fourth plane, the third and fourth planes being substantially perpendicular to the first plane, and the illumination optical system comprises a first optical path followed by an incident light beam in a direction from the first plane to the second plane and a second optical path followed by an incident light beam in a direction from the third plane to the fourth plane. The imaging optics comprises a third optical path followed by the modulated light beam in a direction from the second plane to the first plane, and a fourth optical path followed by the modulated light beam in a direction from the first plane to the second plane. The imaging optics further comprises an optical combiner for projecting an image light beam from the modulated light beam and transmitting natural light from the real world towards the eyebox, wherein: the modulated light beam comprises a foveal modulated light beam forming a foveal pinned light image at a first plane and a peripheral modulated light beam forming a peripheral pinned light image at the first plane; The optical combiner reflects the foveated modulated light beam. In A foveal coupler is configured to project the light beam of the foveal image towards the foveal eyebox.

[0006] The near-eye image projection system disclosed herein has a compact form factor and is well suited for augmented and mixed reality or wearable applications such as smart glasses.

[0007] Exemplary embodiments of the invention are described in the description and illustrated in the following drawings. [Brief description of the drawings]

[0008] [Figure 1a] FIG. 1a shows a schematic diagram of a near-eye image projection system including an SLM, illumination optics and imaging optics according to some embodiments. [Figure 1b] FIG. 1b shows a schematic diagram of a near-eye image projection system including an SLM, illumination optics and imaging optics according to some embodiments. [Figure 1c] FIG. 1c shows a schematic diagram of a near-eye image projection system including an SLM, illumination optics and imaging optics according to some embodiments. [Figure 1d] FIG. 1d shows a schematic diagram of a near-eye image projection system including an SLM, illumination optics and imaging optics according to some embodiments. [Figure 1e] FIG. 1e shows a schematic diagram of a near-eye image projection system including an SLM, illumination optics and imaging optics according to some embodiments. [Figure 1f] FIG. 1f shows a schematic diagram of a near-eye image projection system including an SLM, illumination optics and imaging optics according to some embodiments. [Figure 2a] 2a to 2c show illumination optics according to some embodiments. [Figure 2b] FIG. 2b illustrates illumination optics according to some embodiments. [Figure 2c] FIG. 2c illustrates illumination optics according to some embodiments. [Diagram 3] FIG. 3 illustrates the peripheral image insertion optics of the imaging optics according to one embodiment. [Figure 4a] Figure 4a shows the image composed of the light field and peripheral parts as seen from the central eyebox. [Figure 4b] FIG. 4b represents an active central image, where the light field portion of the image is composed of the light field and peripheral portions that are aligned to regions of interest, such as the area where the viewer's gaze is directed from the central eyebox. [Diagram 5] FIG. 5 is a schematic diagram of mixed reality glasses according to an embodiment. [Figure 6] FIG. 6 is a top view of the mixed reality glasses of FIG. 5 worn by a user. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] 1a to 1f show schematic diagrams of a near-eye image projection system 200 according to one embodiment. The near-eye image projection system 200 comprises a pin light source 10 generating a plurality of incident light beams 100a, 100b. The SLM 20 is configured to modulate the plurality of incident light beams 100a, 100b to generate a plurality of modulated light beams 110a, 110b to form pin light images 31, 39 in a first plane 30. The near-eye image projection system further comprises illumination optics configured to continuously convey the incident light beams 100a, 100b from the pin light source 10 to the SLM 20 along projection axes 170a, 170b to eyeboxes 121a, 121b in a second plane 124 substantially parallel to the first plane 30.

[0010] 1a, the illumination optics are in the third plane 38 and the projection axes 170a, 170b are in the fourth plane 125, the third plane 38 and the fourth plane 125 being substantially perpendicular to the first plane 30. The illumination optics are configured to define a first optical path 171, shown parallel (but not necessarily) to the projection axes 170a, 170b in a first direction from the first plane 30 to the second plane 124. The illumination optics may be further configured to define a second optical path 172, shown perpendicular (but not necessarily) to the projection axes 170a, 170b, from the third plane 38 to the fourth plane 125.

[0011] One possible configuration of the illumination optics is shown in Fig. 2a according to one embodiment. The illumination optics comprises a pin light source 10 comprising a plurality of individual pin lights 10a, each pin light 10a adapted to generate at least an incident light beam 100a, 100b. In the particular example of Fig. 2a, the pin light source 10 comprises an array of pin lights 10a in a plane substantially perpendicular to the first plane 30. However, other arrangements of the pin light sources 10 are possible.

[0012] In one aspect, the illumination optics includes a collimating optical element 50 configured to collimate the incident light beam 100a into a narrow line. The collimating optical element 50 may include one or more of a lens, a mirror, a hologram, or any other optical element that performs collimation.

[0013] In one aspect, the illumination optics further comprises an illumination deflection element 61 configured to redirect the incoming pin light 100a, 100b along the first optical path 171. The illumination deflection element 61 may comprise one or more of a redirecting prism, a grating, a hologram, or any other optical element.

[0014] In one aspect, the illumination optics includes an illumination pupil dilator 36a configured to expand the incident light beam 100a, 100b from an entrance to an exit pupil of the illumination pupil dilator 36a. The illumination pupil dilator 36a enables an expanded field of view (FOV) of the projected image.

[0015] In one aspect, the illumination pupil dilation device includes a light guide or illumination The illumination waveguide 36a further comprises an illumination outcoupling element 37a configured to output the incident pin light 100a, 100b along a second optical path 172.

[0016] The collimated incoming light beams 100a, 100b are launched into the illumination waveguide 36a by interaction with the illumination incoupling element 35a. The latter may comprise a diffraction grating, a hologram, a tilted mirror or prism, a stack of semi-reflective interfaces, or any other suitable optical element. The incoming light beams 100a, 100b are propagated by internal reflection while expanding in the plane of the illumination waveguide 36a by interaction with a 1D or 2D folding grating or by other optical elements that expand the incoming light beams 100a, 100b. The illumination outcoupling element 37a may comprise a diffraction grating, a hologram, a tilted mirror or prism array, a stack of semi-reflective interfaces, or any other optical element configured to output the incoming pin light 100a, 100b along the second optical path 172. The illumination outcoupling element 37a can be configured such that the incident light beams 100a, 100b are multiplied with a uniformly distributed intensity and collimated in a direction given by the inclination angle of the incident light beams 100a, 100b, such that the incident light beams 100a, 100b form a second optical path 172.

[0017] The expanded collimated beam in turn illuminates a reflective or transmissive SLM 20. In the case of a transmissive SLM, the incident light components are modulated and propagated to the projection optics.

[0018] 1a, the imaging optics are configured to define a third optical path 173 (shown in the first direction parallel to the projection axes 170a, 170b, although not necessarily) from the second plane 124 to the first plane 30. The imaging optics are further configured to define a fourth optical path 174 (shown in the first direction parallel to the projection axes 170a, 170b, although not necessarily) from the first plane 30 to the second plane 124.

[0019] In an embodiment, the imaging optics comprises an illumination and projection optical element 70. The latter comprises a prism 70 with first and second beam-shaping outer surfaces 52, 53. In the case of a reflective SLM 20 as shown in Fig. 1a, the incoming light beam 100a, 100b leaving the illumination waveguide 36a by the illumination outcoupling element 37a travels along a second optical path 172 through the first and second outer surfaces 52, 53 of the beam-shaping prism 70 to the SLM 20. The first and second outer beam-shaping surfaces 52, 53 may be arranged to concentrate the collimated incoming light beam 100a, 100b on the SLM 20.

[0020] In one aspect, the prism 70 may include a beam splitter 140 configured to be traversed by the input pin lights 100 a, 100 b before they reach the SLM 20 along the second optical path 172 .

[0021] The (reflective) SLM 20 modulates the incident light beam 100a or 100b and reflects the modulated light beam 110a, 110b (image component) back to the prism 70 via the beam-shaping second surface 53 along a second optical path 172. The SLM 20 is further configured to reflect the modulated light beam 110a, 110b with in-plane polarization (s-polarization) or a higher than total internal reflection angle (if the SLM 20 has a digital micromirror device) obtained during modulation at the SLM 20.

[0022] The beam splitter 140 may be further configured to reflect the modulated light beams 110a, 110b generated by the SLM 20 along a third optical path 173. The prism 70 further comprises a third beam-shaping outer surface 54 and a fourth outer surface 58. The modulated light beams 110a, 110b reflected from the beam splitter 140 are reflected off the third beam-shaping outer surface 54 along a fourth optical path 174.

[0023] The third outer beam-shaping surface 54 may be configured to invert the polarization of the modulated light beams 110 a , 110 b relative to the in-plane polarization provided by the SLM 20 .

[0024] In one aspect, the third outer beam-shaping surface 54 is provided with a quarter wave plate 56 configured so that the modulated light beams 110a, 110b along the third optical path 173 are p-polarized.

[0025] The modulated light beams 110a, 110b reflected from the third outer beam-shaping surface 54 pass through a fourth outer beam-shaping surface 58. The fourth outer beam-shaping surface 58 can be configured to collimate the light beams of the pixels of the SLM that constitute the modulated light beams 110a, 110b.

[0026] In one embodiment, the imaging optics comprises an optical combiner 40 configured to receive and project the modulated light beams 110a, 110b and the image light beams 112a, 112b along the projection axes 170a, 170b to the eyeboxes 121a, 121b. The optical combiner 40 is further configured to transmit natural light from the real world 190 towards the eyeboxes 121a, 121b.

[0027] The near-eye image projection system 200 is intended to be worn by an observer for virtual and mixed reality applications. When worn by an observer, the image projection system S1 21a, 121b and exit pupil (or viewpoint) 120 can be configured to be within the observer's eye 90. The image light beams 112a, 112b are projected towards the pupil 130 of the observer's eye 90 such that the image light beams 112a, 112b are projected onto the retina 92.

[0028] The modulated light beams are divided into a foveal modulated light beam 110a that forms a foveal pin light image 31 at a first plane 30 and a first plane and a peripheral modulated light beam 110b forming a peripheral pin light image 39 at 30.

[0029] In one aspect, the imaging optics further comprises a Fourier filter 34 at the first plane 30. The Fourier filter 34 is provided with an imaging deflection element 60a (see FIG. 3) that reflects the modulated light beam 110a at the fovea to the optical combiner 40. The imaging deflection element 60a reflects the modulated light beam 110a at the fovea to the optical combiner 40. Foveal modulation The foveal combiner 41 reflects the light beam 110a and projects the light beam 112a of the foveal image towards the foveal eyebox 121a. The foveal combiner 41 is provided with a transparent or at least partially transparent reflective surface. The reflective surface can be concave and / or ellipsoidal or of any shape adapted to project the light beam 112a of the foveal image towards the foveal eyebox 121a.

[0030] In particular, Figure 1a shows a pin light source 10 generating a single incident foveal light beam 100a, projecting a foveal modulated light beam 110a and a foveal image light beam 112a toward the foveal eyebox 121a. This single incident central light beam 100a is generated by a single pin light (active pin light) 10a of the pin light source 10. The foveal image light beam 112a forms an image at a viewpoint 120 within the foveal eyebox 121a.

[0031] Figure 1b shows a near-eye image projection system 200, in which a single incident foveal light beam 100a is generated by another single pin light 10a of a pin light source 10. A foveal image light beam 112a forms an image at another viewpoint 120 within the foveal eyebox 121a.

[0032] The multiple pin lights 10a of the pin light source 10 can generate multiple incident foveal light beams 100a, and the illumination and imaging optics then project multiple foveal modulated light beams 110a and foveal image light beams 112a towards the foveal eyebox 121a.

[0033] The imaging optics further comprises an imaging mirror 32 configured to reflect the foveated modulated light beam 110a reflected by the imaging deflection element 60a to the foveal coupler 41. The imaging mirror 32 can be positioned proximate to the SLM 20 such that the foveated modulated light beam 110a is reflected by the imaging deflection element 60a towards the SLM 20 and then by the imaging mirror 32 towards the foveal coupler 41. The imaging deflection element 60a comprises a tilted mirror or a prism. The imaging mirror 32 generates a foveated modulator image 114a at a modulator image plane 115 between the imaging mirror 32 and the foveal coupler 41. Each of the imaging deflection elements 60a can be oriented at a different angle (e.g., a mirror or prism can be tilted at a different angle) to create an array of foveal modulator images 114a in which at least some of the foveal modulator images 114a are spatially displaced within the modulator image plane 115 relative to other foveal modulator images 114a. In this case, the foveal combiner 41 allows an array of images to be seen by the observer from the eyebox 121a.

[0034] In one embodiment, the imaging mirror 32 is movable, such as to deflect the foveated modulated light beam 110a reflected by the imaging mirror 32 away from the projection axis 170a, 170b.

[0035] 1c shows a near-eye image projection system 200 in which two foveated modulated light beams 110a are projected along projection axes 170a tilted relative to a central (neutral) projection axis 170b from two incident central light beams 100a generated by pin light source 10. The tilt of projection axis 170a relative to central projection axis 170b is a function of the translation (rotation) of imaging mirror 32.

[0036] In one embodiment, the near-eye image projection system 200 is equipped with an eye-tracking and steering device (not shown) that provides eye-tracking information, and the imaging mirror 32 can then be moved (rotated) according to the eye-tracking information.

[0037] In one aspect, the Fourier filter 34 is further configured to allow the peripheral modulated light beam 110b to pass through the Fourier filter 34 and reach the image injection optics 150 configured to expand the peripheral modulated light beam 110b from a first angle α to a second angle β greater than the first angle α.

[0038] The Fourier filter 34 can thus be configured to split the optical paths of the foveal modulated light beam 110a and the peripheral modulated light beam 110b.

[0039] FIG. 3 illustrates peripheral image injection optics 150 according to one embodiment. In the configuration of FIG. 3, the image injection optics 150 comprises a beam-shaping transmissive surface 151 into which the peripheral modulated light beam 110b is admitted. In FIG. 3, one peripheral modulated light beam 110b is shown. The following discussion considers one peripheral modulated light beam 110b, but also applies to multiple peripheral modulated light beams 110b. The image injection optics 150 further comprises reflective surfaces 152, 153 (mirrors 152, 153) and a beam-shaping reflective surface 154.

[0040] The input peripheral modulated light beam 110b enters the peripheral image injection optics 150 at a first angle α through an aperture 341 in the Fourier filter 34. The aperture 341 coincides with the peripheral pin light image 39 of the peripheral modulated light beam 110b.

[0041] The peripheral modulated light beam 110b enters the peripheral image injection optics 150 through the aperture 341 at a beam angle α. The peripheral modulated light beam 110b propagates through the peripheral image injection optics 150 by internal reflection at the reflective surfaces 152, 153, 154 and expands at a second angle β towards the imaging in-coupling element 35. The peripheral image injection optics 150 creates an image 114b of the peripheral modulator of the SLM 20. In this configuration, the peripheral modulated light beam 110b from each pixel of the image 114b is collimated by the beam shaping reflective surface 154 and admitted by the imaging in-coupling element 35.

[0042] In the embodiment shown in Figures 1a to 1f, the optical combiner 40 comprises a foveal combiner 41 and a peripheral combiner. The peripheral combiner receives the peripheral modulated light beam 110b and transmits the peripheral image light beam 112b along the projection axis 170 to the peripheral eye. S1 21b. A collimated peripheral modulated light beam 110b with an enlarged second (angle) β (the peripheral modulated light beam 110b has a beam from each SLM pixel, which pixel beams are collimated) enters the imaging exit pupil dilator 36 via the imaging in-coupling element 35. The imaging exit pupil dilator is provided with an imaging waveguide 36.

[0043] The imaging waveguide 36 allows the light beam 112b of the peripheral image to exit the imaging waveguide 36 and S1 The peripheral image is provided with an imaging outcoupling element 37 configured to project the peripheral image light beam 112b along a projection axis 170b in the peripheral image sensor 21b. S1 21b is typically used for pupil duplication performed by imaging guide 36. S1 Bigger than 21a.

[0044] FIG. 1d illustrates a near-eye image projection system 200, in which a subset of the peripheral modulated light beams 110b (i.e., one peripheral modulated light beam 110b) is transmitted through the Fourier filter 34 and injected into the imaging waveguide 36, and a peripheral image light beam 112b is projected onto the peripheral eyepiece 34. S1 21b along projection axis 170b.

[0045] FIG. 1e shows a near-eye image projection system 200, in which a subset of the (two) foveal modulated light beams 110a are reflected by the imaging mirror 32 and the foveal combiner 41, and a foveal image light beam 112a is projected onto the foveal eye. S121a along a projection axis 170a. The imaging deflection element 60a can reflect the incoming light beam 110a at different angles such that at least some of the foveal modulator image elements 114a are focused at different positions in the plane 115 relative to the other foveal modulator images 114a.

[0046] FIG. 1f illustrates the near-eye image projection system 200 of FIG. 1e. This illustrates that a subset (i.e., one) of the peripheral modulated light beams 110b is directed into a peripheral combiner (imaging exit pupil dilator 36) and a corresponding peripheral image light beam 112b is directed into the peripheral eyepiece. S1 21b along projection axis 170b.

[0047] 1c, 1e and 1f, the pin source 10, the SLM 20, the prism 70 and the illumination pupil dilation arrangement 36a are represented diagrammatically by a box 200. In FIG.

[0048] The imaging outcoupling element 37 may comprise a volume hologram, an array of grating mirrors or a stack of prisms (semi-transparent interfaces). The outcoupling element 37 and the wave guide 36 are used as peripheral couplers and therefore need to be partially transparent in augmented reality applications. They may be opaque for virtual reality applications or video pass-through (using technology) augmented reality applications. The foveal coupler 41 may comprise a wide range of semi-transparent optical devices such as a volume hologram, a Fresnel type reflector or an ellipsoidal surface with a semi-reflective inner surface.

[0049] The near-eye image projection system 200 enables the projection of the foveal modulated light beam 110a and the peripheral modulated light beam 110b via the optical combiner 40 along the projection axes 170a, 170b as a foveal image light beam 112a and a peripheral image light beam 112b to each eyebox 121a and 121b.

[0050] Other configurations of the illumination optics are possible. For example, in Fig. 2b, the illumination collimating element 50 and the deflection element 61 comprise holograms. In Fig. 2c, the functions of the collimating element 50, the imaging deflection element 60a and the illumination in-coupling element 35a are performed by a single hologram in the diffractive element 35a.

[0051] Figure 4a shows the foveal eyebock S1 21a represents the central region of the field of view. The image comprises a narrow portion 11 of the light field and a wider portion 12 of the peripheral image.

[0052] Figure 4b shows the peripheral eye S1 2 shows an active foveal image as seen from 21a. An active foveal image is obtained when the near-eye image projection system 200 is equipped with an eye tracking and steering device and a movable imaging mirror 32. The narrow field of view portion 11 of the light field can be moved from a central position relative to the wide field of view image 12 according to the observer's line of sight information and the displayed content.

[0053] The present disclosure further relates to a wearable device comprising the image projection system 200.

[0054] 5 is a schematic diagram of mixed reality glasses with an image projection system 200 on each temple according to an embodiment. On the right side of the glasses, the pin light source 10, the SLM 20, the prism 70, the imaging mirror 32, the Fourier filter 34, the illumination pupil dilator 36a and the illumination outcoupling element are represented. The right temple is not shown. The foveal coupler comprises a lens 41 (glass lens). The imaging exit pupil dilator element 36 and the imaging outcoupling element 37 forming the peripheral coupler are embedded in the lens 41. On the left side of the glasses, the image projection system 200 is integrated into the temple.

[0055] Figure 6 is a top view of the mixed reality glasses of Figure 5 worn by a user. The image projection system 200 may be located on only one side of the mixed reality glasses, with the optical combiner 40 arranged in at least one lens 41 of the glasses (as described above). The image projection system 200 may be located in another part of the hinge or temple. The present application provides, for example, the following aspects: [Point 1] a pin light source (10) generating a plurality of incident light beams (100a, 100b); a spatial light modulator (SLM) (20) configured to modulate the plurality of incident light beams (100a, 100b) and to generate a plurality of modulated light beams (110a, 110b) forming pinned light images (31, 39) in a first plane (30); an illumination optical system configured to deliver an incident light beam (100a, 100b) from a pin light source (10) to the SLM (20); A near-eye image projection system (200) comprising: imaging optics configured to continuously convey the modulated light beam (110a, 110b) from the SLM (20) along a projection axis (170a, 170b) to an eyebox region (121a, 121b) in a second plane (124) substantially parallel to the first plane (30); A near-eye image projection system (200) comprising: the illumination optics is in a third plane (38), the projection axis (170a, 170b) is in a fourth plane (125), the third plane and the fourth plane (38, 125) are substantially perpendicular to the first plane (30); the illumination optics defines a first optical path (171) from the first plane (30) to the second plane (124) and a second optical path (172) from the third plane (38) to the fourth plane (125); the imaging optics defining a third optical path (173) from the second plane (124) to the first plane (30) and a fourth optical path (174) from the first plane (30) to the second plane (124); The near-eye image projection system. [Point 2] The projection system of aspect 1, wherein the illumination optical system comprises an illumination pupil dilator (36a) configured to expand an incident light beam (100a, 100b) from an entrance to an exit pupil of the illumination pupil dilator (36a). [Point 3] The projection system of aspect 2, wherein the illumination pupil dilation device comprises an illumination waveguide section (36a) having an illumination incoupling element (35a) configured to input the incident light beam (100a, 100b). [Point 4] The projection system of aspect 3, wherein the illumination waveguide portion (36a) comprises an illumination deflection element (61) configured to redirect the incident light beam (100a, 100b) along a first optical path (171) and an illumination outcoupling element (37a) configured to output the incident light beam (100a, 100b) along a second optical path (172). [Point 5] The projection system according to aspect 3 or 4, wherein the illumination waveguide (36a) further comprises a collimating element (50) configured to collimate the multiple incident light beams (100a, 100b). [Point 6] 6. The projection system according to any one of aspects 3 to 5, wherein the illumination waveguide (36a) comprises a 1D or 2D folded grating configured to interact with the multiple incident light beams (100a, 100b). [Point 7] 7. The projection system according to any one of the preceding aspects, wherein the SLM (20) is reflective. [Point 8] A projection system according to any one of aspects 1 to 7, wherein the imaging optical system comprises a prism (70) having a beam-shaping first outer surface (52) and a beam-shaping second outer surface (53), arranged to be intersected by the incident light beam (100a, 100b) along the second optical path (172). [Point 9] The projection system of aspect 8, wherein the prism (70) further comprises a beam-shaping third outer surface (54) and a beam-shaping fourth outer surface (58) intersected by the multiple incident light beams (100a, 100b) along a third optical path (173). [Point 10] The projection system of aspect 9, wherein the prism (70) further comprises a beam splitter (140) configured to reflect the modulated light beam (110a, 110b) across the incident light beam (100a, 100b) along the second optical path (172) on a third outer surface (54) for beam shaping. [Point 11] A projection system as described in aspect 10, wherein the beam-shaping third outer surface (54) is configured to reflect the modulated light beam (110a, 110b) along a third optical path (173). [Point 12] 12. The projection system according to aspect 10 or 11, wherein the SLM (20) is configured such that the modulated light beams (110a, 110b) are in-plane polarized. [Point 13] the third outer beam-shaping surface (54) is configured to invert the polarization of the modulated light beams (110a, 110b) with respect to the polarization provided by the SLM (20); The projection system of aspect 12, wherein the beam-shaping third outer surface (54) comprises a quarter-wave plate (56) configured to p-polarize the modulated light beam (110a, 110b) along the third optical path (173). [Point 14] 14. The projection system according to any one of aspects 9 to 13, wherein the beam-shaping fourth outer surface (58) is configured to collimate the modulated light beam (110a, 110b). [Point 15] The projection system of any one of aspects 1 to 14, wherein the imaging optical system projects an image light beam (112a, 112b) from the modulated light beam (110a, 110b) and comprises an optical combiner (40) that transmits natural light from the real world (190) towards the eyebox region (121a, 121b). [Point 16] A projection system described in any one of aspects 1 to 15, wherein the modulated light beam comprises a foveal modulated light beam (110a) that forms a foveal pin light image (31) at the first plane (30) and a peripheral modulated light beam (110b) that forms a peripheral pin light image (39) at the first pin light plane (30). [Point 17] The projection system of aspect 16, wherein the optical combiner (40) comprises a foveal combiner (41) configured to reflect the foveal modulated light beam (110a) and project a foveal image light beam (112a) toward the foveal eyebox (121a). [Point 18] 18. The projection system according to any one of the preceding aspects, wherein the imaging optical system comprises a Fourier filter (34) at the first plane (30). [Point 19] The projection system according to aspects 16, 17 and 18, wherein the Fourier filter (34) comprises an imaging deflection element (60a) in the first plane (30) that reflects the foveated modulated light beam (110a) to the foveal combiner (41). [Point 20] The projection system of aspect 19, wherein the imaging optical system comprises an imaging mirror (32) configured to reflect the foveated modulated light beam (110a) reflected by the imaging deflection element (60a) to a foveal combiner (41). [Point 21] The projection system of aspect 20, wherein the imaging mirror (32) is movable to deflect the foveated modulated light beam (110a) reflected by the imaging mirror (32) from the projection axis (170). [Point 22] 22. The projection system of aspect 21, comprising an eye-tracking and steering device for providing eye-tracking information, the imaging mirror (32) being movable according to the eye-tracking information. [Point 23] The projection system of aspects 16 and 18, wherein the Fourier filter (34) is configured to allow the peripheral modulated light beam (110b) to enter the injection optical system (150), and the injection optical system (150) is configured to expand the peripheral modulated light beam (110b) from a first angle (α) to a second angle (β) greater than the first angle (α). [Point 24] The projection system according to aspect 23, wherein the imaging optics comprises an imaging exit pupil dilator (36) configured to receive the peripheral modulated light beam (110b) and project the peripheral image light beam (112b) along a projection axis (170) within the peripheral eyebox region (121b). The projection system of aspect 24, wherein the imaging exit pupil expansion device comprises an imaging waveguide (36), an imaging in-coupling element (35) configured for the peripheral modulated light beam (110b) to enter the imaging waveguide (36), and an imaging out-coupling element (37) configured to project the peripheral image light beam (112b) along a projection axis (170) within the peripheral eyebox region (121B). [Point 26] A wearable device comprising a projection system according to any one of aspects 1 to 25. [Point 27] The wearable device of Aspect 26 comprising mixed reality glasses, wherein the optical combiner (40) comprises at least one of a plurality of lenses of the glasses, and the illumination optics and imaging optics are components within the hinge or are separate parts of the temples. [Explanation of symbols]

[0056] 10 pin light source 10a Working pin light 11 Foveal region of the visual field 12 Peripheral region of vision 13 Peripheral pin light sub-array 20 Optical Light Modulator (SLM) 30 1st plane 31 Foveal pin light image 32 Imaging mirror 34 Fourier Filter 341 Opening 35 Imaging incoupling element 35a Lighting incoupling element 36 Imaging Exit pupil dilator, Imaging Waveguide 36a Illumination pupil dilator, illumination waveguide 37 Outcoupling elements 37a Lighting outcoupling element 38 3rd plane 39 Peripheral pinlight image 40 Optical coupler 41 Foveal connective tissue, lens 50 Collimating Optical Elements 52 First outer surface for beam shaping 53 Beam shaping second outer surface 54 Beam shaping third outer surface 56 1 / 4 wave plate 58 Beam shaping fourth outer surface 61 Lighting deflection element 60a Imaging deflection element 70 Illumination and projection optical elements, prisms 90 eyes 92 Retina 100a Foveal incident light beam 100b Peripheral incident light beam 110a Modulated light beam in the fovea 110b Peripheral modulated light beam 112a Foveated image of light beam 112b Light beam of peripheral image 114a Foveal modulator image 114b Image of the modulator around 115 Modulated Image Plane 120 (multiple) second-pin light images, (multiple) viewpoints 121a Aibok vinegar 121b Aibok vinegar 124 2nd plane 125 4th plane 130 Pupil 140 Beam splitter 150 Image injection optical system 151 Beam-Shaping Transparent Surfaces 152 Reflective Surfaces 153 Reflective Surfaces 154 Beam-Shaping Reflective Surfaces 170a Projection axis 170b Central observation axis 171 1st optical path 172 Second optical path 173 Third optical path 174 4th optical path 190 Real World 200 Image Projection Module

Claims

1. a pin light source (10) generating a plurality of incident light beams (100a, 100b); a spatial light modulator (SLM) (20) configured to modulate the plurality of incident light beams (100a, 100b) and to generate a plurality of modulated light beams (110a, 110b) forming pin light images (31, 39) at a first plane (30); an illumination optical system configured to deliver an incident light beam (100a, 100b) from a pin light source (10) to an SLM (20); A near-eye image projection system (200) comprising: imaging optics configured to continuously convey the modulated light beams (110a, 110b) from the SLM (20) along a projection axis (170a, 170b) to an eyebox region (121a, 121b) in a second plane (124) substantially parallel to the first plane (30); A near-eye image projection system (200) comprising: the illumination optics is in a third plane (38), the projection axis (170a, 170b) is in a fourth plane (125), the third and fourth planes (38, 125) being substantially perpendicular to the first plane (30); the illumination optics defines a first optical path (171) from the first plane (30) to the second plane (124) and a second optical path (172) from the third plane (38) to the fourth plane (125); The imaging optics defines a third optical path (173) from the second plane (124) to the first plane (30) and a fourth optical path (174) from the first plane (30) to the second plane (124). The near-eye image projection system.

2. 2. The projection system of claim 1, wherein the illumination optics comprises an illumination pupil expander (36a) configured to expand an incoming light beam (100a, 100b) from an entrance to an exit pupil of the illumination pupil expander (36a).

3. 3. The projection system of claim 2, wherein the illumination pupil dilation arrangement comprises an illumination waveguide (36a) comprising an illumination in-coupling element (35a) configured to receive the incoming light beam (100a, 100b).

4. 4. The projection system of claim 3, wherein the illumination waveguide (36a) comprises an illumination deflection element (61) configured to redirect an incident light beam (100a, 100b) along a first optical path (171) and an illumination out-coupling element (37a) configured to output the incident light beam (100a, 100b) along a second optical path (172).

5. 5. The projection system of claim 3 or 4, wherein the illumination waveguide (36a) further comprises a collimating element (50) configured to collimate the multiple incident light beams (100a, 100b).

6. 6. The projection system of claim 3, wherein the illumination waveguide (36a) comprises a 1D or 2D folding grating configured to interact with the multiple incident light beams (100a, 100b).

7. The projection system of any one of claims 1 to 6, wherein the SLM (20) is reflective.

8. 8. The projection system of claim 1, wherein the imaging optical system comprises a prism (70) having a beam-shaping first outer surface (52) and a beam-shaping second outer surface (53) arranged to be crossed by the incident light beam (100a, 100b) along the second optical path (172).

9. 9. The projection system of claim 8, wherein the prism (70) further comprises a beam-shaping third outer surface (54) and a beam-shaping fourth outer surface (58) intersected by the multiple incident light beams (100a, 100b) along a third optical path (173).

10. 10. The projection system of claim 9, wherein the prism (70) further comprises a beam splitter (140) configured to be traversed by the incident light beam (100a, 100b) along the second optical path (172) and to reflect the modulated light beam (110a, 110b) on a third outer surface (54) for beam shaping.

11. 11. The projection system of claim 10, wherein the third outer beam-shaping surface (54) is configured to reflect the modulated light beam (110a, 110b) along a third optical path (173).

12. 12. The projection system of claim 10 or 11, wherein the SLM (20) is configured such that the modulated light beams (110a, 110b) are in-plane polarized.

13. the third outer beam-shaping surface (54) is configured to invert the polarization of the modulated light beams (110a, 110b) with respect to the polarization provided by the SLM (20); 13. The projection system of claim 12, wherein the third outer beam-shaping surface (54) comprises a quarter-wave plate (56) configured to p-polarize the modulated light beam (110a, 110b) along the third optical path (173).

14. 14. The projection system of any one of claims 9 to 13, wherein the fourth outer beam-shaping surface (58) is configured to collimate the modulated light beam (110a, 110b).

15. 15. The projection system of claim 1, wherein the imaging optics comprises an optical combiner (40) for projecting an image light beam (112a, 112b) from the modulated light beam (110a, 110b) and for transmitting natural light from the real world (190) towards the eyebox region (121a, 121b).

16. 16. The projection system of claim 1, wherein the modulated light beam comprises a foveal modulated light beam (110a) forming a foveal pin light image (31) at the first plane (30) and a peripheral modulated light beam (110b) forming a peripheral pin light image (39) at the first pin light plane (30).

17. 17. The projection system of claim 16, wherein the optical combiner (40) comprises a foveal combiner (41) configured to reflect the foveal modulated light beam (110a) and project the foveal image light beam (112a) towards the foveal eyebox (121a).

18. 18. The projection system of claim 1, wherein the imaging optics comprises a Fourier filter (34) at the first plane (30).

19. 19. The projection system of claims 16, 17 and 18, wherein the Fourier filter (34) comprises an imaging deflection element (60a) in the first plane (30) that reflects the foveal modulated light beam (110a) to the foveal combiner (41).

20. 20. The projection system of claim 19, wherein the imaging optical system comprises an imaging mirror (32) configured to reflect the foveal modulated light beam (110a) reflected by the imaging deflection element (60a) to a foveal combiner (41).

21. 21. The projection system of claim 20, wherein the imaging mirror (32) is movable to deflect the foveated modulated light beam (110a) reflected by the imaging mirror (32) from the projection axis (170).

22. 22. The projection system of claim 21, comprising an eye-tracking and steering device for providing eye-tracking information, the imaging mirror (32) being movable according to the eye-tracking information.

23. The projection system of claims 16 and 18, wherein the Fourier filter (34) is configured to allow the peripheral modulated light beam (110b) to enter the injection optical system (150), and the injection optical system (150) is configured to expand the peripheral modulated light beam (110b) from a first angle (α) to a second angle (β) greater than the first angle (α).

24. 24. The projection system of claim 23, wherein the imaging optics comprises an imaging exit pupil dilator (36) configured to receive the peripheral modulated light beam (110b) and project a peripheral image light beam (112b) along a projection axis (170) within the peripheral eyebox region (121b).

25. 25. The projection system of claim 24, wherein the imaging exit pupil expansion device comprises an imaging waveguide (36), an imaging in-coupling element (35) configured for the peripheral modulated light beam (110b) to enter the imaging waveguide (36), and an imaging out-coupling element (37) configured to project the peripheral image light beam (112b) along a projection axis (170) within the peripheral eyebox region (121B).

26. A wearable device comprising a projection system according to any one of claims 1 to 25.

27. 27. The wearable device of claim 26 comprising mixed reality glasses, wherein the optical combiner (40) comprises at least one of a plurality of lenses of the glasses, and the illumination optics and imaging optics are components within the hinge or are separate parts of the temples.

Images