Near-eye image projection system and wearable device equipped with a near-eye image projection system

Abstract

To provide a compact near-eye image projection system and a wearable device including the near-eye image projection system.SOLUTION: A near-eye image projection system according to the present invention comprises: a pin light source that generates a plurality of incident light beams; a spatial light modulator that generates a plurality of modulated light beams to form pin light images on a first plane; an illumination optical system that, on a third plane, guides the incident light beams from the pin light source to the spatial light modulator; and an imaging optical system that, on a fourth plane, guides the modulated light beams along a projection axis to an eyebox region within a second plane parallel to the first plane. The third and fourth planes are substantially parallel to the first plane. The illumination optical system defines a first optical path from the first plane to the second plane and a second optical path from the third plane to the fourth plane. The imaging optical system defines a third optical path from the second plane to the first plane and a fourth optical path from the first plane to the second plane. A wearable device including the aforementioned near-eye image projection system is also provided.SELECTED DRAWING: Figure 1a

Description

Technical Field

[0001] The present invention relates to a near-eye image projection system having a small form factor. The present invention further relates to a wearable device comprising the aforementioned near-eye image projection system, such as an augmented reality, mixed reality or smart glasses. More particularly, the present invention relates to a near-eye light field projection system. The near-eye light field projection system is provided with a field of view forming ability.

Background Art

[0002] Light field image projection by sequential spatial light modulation of structured incident light by a spatial light modulator (SLM) typically requires that the light from the light source be shaped by several optical elements separated by a transparent medium of sufficient volume to achieve the required characteristics of the structured incident light and thus the projected light field image. Such an arrangement results in a bulkier device that is not suitable for use in applications that require a small form factor, such as wearable devices like smart glasses. Reducing the size of the optical system by using higher power optical elements such as lenses with shorter focal lengths, freeform optics, etc. still requires a significant volume for light propagation or is disadvantaged by higher compensation requirements due to degradation of the quality of the illumination light structure and thus the projected image, and optical artifacts such as distortion, aberration, and diffraction.

[0003] Patent Document 1 (EP3542206A1) discloses a method of light field projection by sequential spatial light modulation of structured light. Patent Document 2 (WO2020157562A1) discloses several methods of combining different types of couplers in a light field projection system, and Patent Document 3 (US20190285897A1) discloses a device using image pupil expansion having a waveguide section in combination with a reflective coupler.

Prior Art Documents

Patent Documents

[0004] [Patent Document 1] European Patent Application Publication No. 3542206 [Patent Document 2] International Publication No. 2020 / 157562 [Patent Document 3] U.S. Patent Application Publication No. 2019 / 0285897 [Overview of the project]

[0005] This disclosure is, A pin light source that generates multiple incident light beams, An SLM is configured to modulate the aforementioned plurality of incident light beams and generate a plurality of modulated light beams that form a pinned light image in the first plane, This invention relates to a near-eye image projection system comprising an illumination optical system and an imaging optical system configured to deliver an incident light beam from a pin light source to an SLM. The imaging optical system is, It is further configured to continuously carry a modulated optical beam from the SLM along the projection path to an eyebox region in a second plane substantially parallel to the first plane. The pin light source of the illumination optical system is in the third plane, the final projection axis toward the eye box is in the fourth plane, the third and fourth planes are substantially perpendicular to the first plane, and the illumination optical system comprises a first optical path through which an incident light beam continues in the direction from the first plane to the second plane, and a second optical path through which an incident light beam continues in the direction from the third plane to the fourth plane. The imaging optical system includes a third optical path through which a modulated light beam in the direction from the second plane to the first plane continues, and a fourth optical path through which a modulated light beam in the direction from the first plane to the second plane continues. The imaging optical system further includes an optical coupler that projects an image beam from a modulated light beam and transmits natural light from the real world towards the eyebox, and here, The modulated light beam comprises a foveal-modulated light beam that forms a foveal pin image in the first plane, and a peripheral-modulated light beam that forms a peripheral pin image in the first plane. The optical coupler reflects the foveal-modulated light beam. te It features a foveal connector configured to project a light beam of the epigastric image toward the foveal eyebox.

[0006] The near-eye image projection systems disclosed herein have a compact form factor and are well-suited for applications in augmented or mixed reality or wearable devices such as smart glasses.

[0007] Exemplary embodiments of the present invention are described in this document and illustrated in the following drawings. [Brief explanation of the drawing]

[0008] [Figure 1a] Figure 1a shows a schematic diagram of a near-eye image projection system including an SLM, illumination optics, and imaging optics according to several embodiments. [Figure 1b] Figure 1b shows schematic diagrams of near-eye image projection systems including an SLM, illumination optics, and imaging optics according to several embodiments. [Figure 1c] Figure 1c shows schematic diagrams of near-eye image projection systems including an SLM, illumination optics, and imaging optics according to several embodiments. [Figure 1d] Figure 1d shows a schematic diagram of a near-eye image projection system including an SLM, illumination optics, and imaging optics according to several embodiments. [Figure 1e] Figure 1e shows schematic diagrams of near-eye image projection systems including an SLM, illumination optics, and imaging optics according to several embodiments. [Figure 1f] Figure 1f shows schematic diagrams of near-eye image projection systems including an SLM, illumination optics, and imaging optics according to several embodiments. [Figure 2a] Figures 2a to 2c show illumination optical systems according to several embodiments. [Figure 2b] Figure 2b shows illumination optics according to several embodiments. [Figure 2c] Figure 2c shows illumination optics according to several embodiments. [Figure 3] Figure 3 shows a peripheral image insertion optical system of an imaging optical system according to one embodiment. [Figure 4a] Figure 4a shows the image composed of the light field and peripheral portion as seen from the central eyebox. [Figure 4b] Figure 4b shows an active central image, which consists of a light field portion aligned with a region of interest, such as the area where the viewer's gaze is directed from the central eyebox, and a peripheral portion. [Figure 5] FIG. 5 is a schematic view of the composite reality glasses according to an embodiment. [Figure 6] FIG. 6 is a top view of the composite reality glasses of FIG. 5 worn by a user.

MODE FOR CARRYING OUT THE INVENTION

[0009] FIGS. 1a to 1f show schematic views of a near-eye image projection system 200 according to an embodiment. The near-eye image projection system 200 includes a pin light source 10 that generates a plurality of incident light beams 100a, 100b. The SLM 20 is configured to modulate the plurality of incident light beams 100a, 100b to generate a plurality of modulated light beams 110a, 110b and form pin light images 31, 39 on the first plane 30. The near-eye image projection system further includes an illumination optical system configured to continuously carry the incident light beams 100a, 100b from the pin light source 10 to eye boxes 121a, 121b in a second plane 124 substantially parallel to the first plane 30 along projection axes 170a, 170b.

[0010] Referring to FIG. 1a, the illumination optical system is in a third plane 38, the projection axes 170a, 170b are in a fourth plane 125, and the third plane 38 and the fourth plane 125 are substantially perpendicular to the first plane 30. The illumination optical system is configured to define a first optical path 171 shown parallel (not necessarily so) to the projection axes 170a, 170b in a first direction from the first plane 30 to the second plane 124. The illumination optical system may be further configured to define a second optical path 172 (not necessarily required but shown perpendicular to the projection axes 170a, 170b) from the third plane 38 to the fourth plane 125.

[0011] One possible configuration of the illumination optical system is shown in FIG. 2a according to one embodiment. The illumination optical system includes a pin light source 10 having a plurality of individual pin lights 10a, and each pin light 10a is adapted to generate at least incident light beams 100a, 100b. In the specific example of FIG. 2a, the pin light source 10 includes an array of pin lights 10a in a plane substantially perpendicular to the first plane 30. However, other arrangements of the pin light source 10 are possible.

[0012] In one aspect, the illumination optical system includes a collimation optical element 50 configured to collimate the incident light beam 100a into a thin (light) line. The collimation optical element 50 may include any one or more of a lens, a mirror, a hologram, or any other optical element that performs collimation.

[0013] In one aspect, the illumination optical system further includes an illumination deflection element 61 configured to redirect the incident pin lights 100a, 100b along the first optical path 171. The illumination deflection element 61 may include any one or more of a prism, a grating, a hologram, or any other optical element that performs direction conversion.

[0014] In one aspect, the illumination optical system includes an illumination pupil expansion device 36a configured to expand the incident light beams 100a, 100b from the entrance to the exit pupil of the illumination pupil expansion device 36a. The illumination pupil expansion device 36a enables an enlarged field of view (FOV) of the projected image.

[0015] In one aspect, the illumination pupil expansion device includes a light guide portion or illumination a waveguide portion 36a having an illumination in-coupling element 35a configured to input the incident pin lights 100a, 100b. The illumination waveguide portion 36a is further provided with an illumination out-coupling element 37a configured to output the incident pin lights 100a, 100b along the second optical path 172.

[0016] The collimated incident light beams 100a and 100b are incident on the illumination waveguide 36a through interaction with the illumination incoupling element 35a. The latter may comprise a diffraction grating, a hologram, an inclined mirror or prism, a semi-reflective interface laminate, or any other suitable optical element. The incident light beams 100a and 100b propagate by internal reflection, spreading within the plane of the illumination waveguide 36a through interaction with a 1D or 2D folding grating, or by other optical elements that extend the incident light beams 100a and 100b. The illumination outcoupling element 37a may comprise a diffraction grating, a hologram, an inclined mirror or prism array, a semi-reflective interface laminate, or any other optical element configured to output incident pinned light 100a and 100b along the second optical path 172. The illumination out-coupling element 37a can be configured such that the incident light beams 100a and 100b are multiplied with uniformly distributed intensity, collimated in a direction given by the inclination angle of the incident light beams 100a and 100b, and the incident light beams 100a and 100b become the second optical path 172.

[0017] The expanded collimated rays sequentially illuminate the reflective or transmissive SLM20. In the case of a transmissive SLM, the incident light component is modulated and propagated to the projection optical system.

[0018] Referring again to Figure 1a, the imaging optical system is configured to define a third optical path 173 from the second plane 124 to the first plane 30 (although not necessarily illustrated parallel to the projection axes 170a and 170b in the first direction). The imaging optical system is further configured to define a fourth optical path 174 from the first plane 30 to the second plane 124 (although not necessarily illustrated parallel to the projection axes 170a and 170b).

[0019] In the embodiment, the imaging optical system includes illumination and projection optical elements 70. The latter may include a prism 70 having first and second outer surfaces 52 and 53 for beam shaping. In the case of a reflective SLM 20 as shown in Figure 1a, the incident light beams 100a and 100b that exit the illumination waveguide 36a via the illumination outcoupling element 37a pass along the second optical path 172, through the first and second outer surfaces 52 and 53 of the beam-shaping prism 70, and reach the SLM 20. The beam-shaping first and second outer surfaces 52 and 53 can be configured to concentrate the incident light beams 100a and 100b that are collimated onto the SLM 20.

[0020] From one perspective, the prism 70 may include a beam splitter 140 configured such that the incident pin beams 100a and 100b cross the second optical path 172 before they reach the SLM 20.

[0021] (Reflection) The SLM20 modulates the incident light beam 100a or 100b and reflects the modulated light beams 110a and 110b (image components) back to the prism 70 via the second surface 53 that modulates the incident light beam 100a or 100b along the second optical path 172. The SLM20 is further configured to reflect modulated light beams 110a and 110b that are higher than the in-plane polarization (s-polarization) or total internal reflection angle obtained during modulation in the SLM20 (if the SLM20 has a digital micromirror device).

[0022] The beam splitter 140 can be further configured to reflect the modulated light beams 110a and 110b generated by the SLM 20 along the third optical path 173. The prism 70 further comprises a third outer surface 54 and a fourth outer surface 58 for beam shaping. The modulated light beams 110a and 110b reflected by the beam splitter 140 are reflected along the fourth optical path 174 by the beam-shaping third outer surface 54.

[0023] The third outer surface 54 for beam shaping can be configured to reverse the polarization of the modulated light beams 110a and 110b with respect to the in-plane polarization provided by the SLM 20.

[0024] From one perspective, the third outer surface 54 for beam shaping is equipped with a quarter-wave plate 56 configured such that the modulated light beams 110a and 110b along the third optical path 173 are p-polarized.

[0025] The modulated light beams 110a and 110b reflected by the third outer surface 54, which is used for beam shaping, pass through the fourth outer surface 58, which is also used for beam shaping. The fourth outer surface 58, which is used for beam shaping, can be configured to collimate the light beams of the SLM pixels that make up the modulated light beams 110a and 110b.

[0026] In one embodiment, the imaging optical system includes an optical coupler 40 configured to receive modulated light beams 110a, 110b and image light beams 112a, 112b and project them onto eye boxes 121a, 121b along projection axes 170a, 170b. The optical coupler 40 is further configured to transmit natural light from the real world 190 to the eye boxes 121a, 121b.

[0027] The near-eye image projection system 200 is intended to be worn by an observer for virtual and mixed reality applications. When worn by an observer, the image projection system displays an eyebox. S1 The setup can be configured such that 21a, 121b and the exit pupil (or point of view) 120 are within the observer's eye 90. The image light beams 112a and 112b are projected toward the pupil 130 of the observer's eye 90 so that the image light beams 112a and 112b are projected onto the retina 92.

[0028] The modulated light beam consists of a foveal modulated light beam 110a that forms a foveal pin image 31 in the first plane 30, and the first plane The device 30 is equipped with a peripheral modulated light beam 110b that forms a peripheral pin image 39.

[0029] From one perspective, the imaging optical system further includes a Fourier filter 34 on the first plane 30. The Fourier filter 34 is equipped with an imaging deflection element 60a (see Figure 3) that reflects the modulated light beam 110a from the fovea to the optical coupler 40. The imaging deflection element 60a is connected to the foveal coupler 41. Foveal modulation The light beam 110a is reflected and the light beam 112a of the foveal image is projected toward the foveal eye box 121a. The foveal connector 41 is equipped with a transparent or at least partially transparent reflective surface. The reflective surface can be in the shape of at least one of a concave shape and an ellipsoid shape, or any shape adapted to project the light beam 112a of the foveal image toward the foveal eye box 121a.

[0030] In particular, Figure 1a shows a pin light source 10 that generates a single incident foveal light beam 100a, and projects the foveal modulated light beam 110a and the foveal image light beam 112a toward the foveal eyebox 121a. This single incident foveal light beam 100a is generated by a single pin light (active pin light) 10a of the pin light source 10. The foveal image light beam 112a forms an image at the viewpoint 120 within the foveal eyebox 121a.

[0031] Figure 1b shows a near-eye image projection system 200, where a single incident foveal light beam 100a is generated by another single pin beam 10a from a pin light source 10. A foveal image light beam 112a forms an image at another viewpoint 120 within the foveal eyebox 121a.

[0032] Multiple pinned beams 10a from the pinned light source 10 can generate multiple foveal light beams 100a. The illumination optical system and imaging optical system then project multiple foveal modulated light beams 110a and foveal image light beams 112a toward the foveal eye box 121a.

[0033] The imaging optical system further comprises an imaging mirror 32 configured to reflect the foveal modulated light beam 110a, reflected by the imaging deflection element 60a, to the foveal coupler 41. The imaging mirror 32 can be positioned near the SLM20 such that the foveal modulated light beam 110a is reflected by the imaging deflection element 60a, reflected towards the SLM20, and then reflected by the imaging mirror 32 towards the foveal coupler 41. The imaging deflection element 60a may comprise an inclined mirror or a prism. The imaging mirror 32 generates an image 114a of the foveal modulator on the modulator image plane 115 between the imaging mirror 32 and the foveal coupler 41. Since each of the image deflection elements 60a can be oriented at a different angle (for example, the mirrors or prisms can be tilted at different angles), the images 114a of the foveal modulator can be arranged in such a way that at least a portion of the images 114a of the foveal modulator are spatially displaced within the modulator's image plane 115 relative to the images 114a of other foveal modulators. In this case, the foveal coupler 41 allows the observer to view the image arrangement from the eyebox 121a.

[0034] In one embodiment, the imaging mirror 32 is movable in order to deflect the modulated light beam 110a from the fovea, which has been reflected by the imaging mirror 32, away from the projection axes 170a and 170b.

[0035] Figure 1c shows the near-eye image projection system 200, in which two foveal modulated light beams 110a are projected from two incident central light beams 100a generated by the pin light source 10 along a projection axis 170a tilted with respect to the central (neutral) projection axis 170b. The tilt of the projection axis 170a with respect to the central projection axis 170b is the function of the movement (rotation) of the imaging mirror 32.

[0036] In one embodiment, the near-eye image projection system 200 is equipped with an eye-tracking and steering device (not shown) that provides eye-tracking information. The imaging mirror 32 is then movable (rotatable) according to the eye-tracking information.

[0037] From one perspective, the Fourier filter 34 is further configured so that the peripheral modulated light beam 110b passes through the Fourier filter 34 and reaches an image injection optical system 150 configured to expand the peripheral modulated light beam 110b from a first angle α to a second angle β which is greater than the first angle α.

[0038] The Fourier filter 34 can thus be configured to split the optical paths of the modulated light beam 110a in the fovea and the modulated light beam 110b in the periphery.

[0039] Figure 3 shows a peripheral image injection optical system 150 according to one embodiment. In the configuration of Figure 3, the image injection optical system 150 includes a beam-shaping transparent surface 151 into which a peripheral modulated light beam 110b is placed. In Figure 3, one peripheral modulated light beam 110b is shown. In the following discussion, one peripheral modulated light beam 110b is considered, but it can also be applied to multiple peripheral modulated light beams 110b. The image injection optical system 150 further includes reflective surfaces 152, 153 (mirrors 152, 153) and a beam-shaping reflective surface 154.

[0040] The input peripheral modulated light beam 110b enters the peripheral image injection optical system 150 at a first angle α through the aperture 341 in the Fourier filter 34. The aperture 341 coincides with the peripheral pin image 39 of the peripheral modulated light beam 110b.

[0041] The peripheral modulated light beam 110b enters the peripheral image injection optical system 150 at a beam angle α through the aperture 341. The peripheral modulated light beam 110b propagates within the peripheral image injection optical system 150 through internal reflection at the reflective surfaces 152, 153, and 154, expanding at a second angle β as it approaches the imaging incoherence element 35. The peripheral image injection optical system 150 creates the image 114b of the peripheral modulator of the SLM 20. In this configuration, the peripheral modulated light beam 110b from each pixel of the image 114b is collimated by the beam shaping reflective surface 154 and then introduced by the imaging incoherence element 35.

[0042] In the embodiments shown in Figures 1a to 1f, the optical coupler 40 comprises a foveal coupler 41 and a peripheral coupler. The peripheral coupler receives the peripheral modulated light beam 110b and projects the peripheral image light beam 112b along the projection axis 170 to the peripheral ivoc. S1 The system includes an imaging exit pupil dilator 36 configured to project into 21b. A collimated peripheral modulated light beam 110b (the peripheral modulated light beam 110b has beams from each SLM pixel, and these pixel beams are collimated), having an enlarged second (angle) β, is introduced into the imaging exit pupil dilator 36 via an imaging incoupling element 35. The imaging exit pupil dilator is equipped with an imaging waveguide 36.

[0043] The imaging waveguide 36 allows the optical beam 112b of the peripheral image to exit the imaging waveguide 36, and the peripheral ivoc S1 It is equipped with an imaging outcoupling element 37 configured to project the light beam 112b of the peripheral image along the projection axis 170b within 21b. S1 21b is typically a foveal eyebox for pupil replication performed by the imaging waveguide 36. S1 It is greater than 21a.

[0044] Figure 1d shows the near-eye image projection system 200. Here, a subset of the peripheral modulated light beam 110b (i.e., one peripheral modulated light beam 110b) is transmitted through the Fourier filter 34 and injected into the imaging waveguide 36, and the peripheral image light beam 112b is projected into the peripheral eyebox. S1 It is projected along the projection axis 170b within 21b.

[0045] Figure 1e shows the near-eye image projection system 200. Here, a subset of the (two) foveal modulated light beams 110a is reflected by the imaging mirror 32 and the foveal coupler 41, and the foveal image light beam 112a is projected onto the foveal eyebox. S1The light is projected along the projection axis 170a within 21a. The image deflection element 60a can reflect the incident light beam 110a at different angles such that at least some of the image elements 114a of the foveal modulator are focused at different positions in the plane 115 relative to the images 114a of the other foveal modulators.

[0046] Figure 1f shows the near-eye image projection system 200 of Figure 1e. In this figure, a subset (i.e., one) of the peripheral modulated light beam 110b is fed into a peripheral coupler (image exit pupil dilator 36), and the corresponding peripheral image light beam 112b is fed into the peripheral eyebox. S1 It is further shown that the projection is along the projection axis 170b within 21b.

[0047] In Figures 1c, 1e, and 1f, the pin light source 10, SLM 20, prism 70, and illumination pupil dilation device 36a are schematically represented by a box 200.

[0048] The imaging outcoupling element 37 may comprise a volume hologram, an array of diffraction grating mirrors, or a stack of prisms (translucent interface). Since the outcoupling element 37 and the waveguide 36 are used as peripheral couplers, they need to be partially transparent for augmented reality applications. They may be opaque for virtual reality applications or video passthrough (using technology) augmented reality applications. The foveal coupler 41 may comprise a wide range of translucent optical devices, such as a volume hologram, a Fresnel-type reflector, or an ellipsoidal surface with a semi-reflective inner surface.

[0049] The near-eye image projection system 200 enables the projection of the foveal modulated light beam 110a and the peripheral modulated light beam 110b onto the respective eye boxes 121a and 121b via the optical coupler 40, along the projection axes 170a and 170b, as the foveal image light beam 112a and the peripheral image light beam 112b.

[0050] Other configurations of the illumination optical system are possible. For example, in Figure 2b, the illumination collimating element 50 and the deflection element 61 are equipped with holograms. In Figure 2c, the functions of the collimating element 50, the image deflection element 60a, and the illumination incoupling element 35a are performed by a single hologram of the diffraction element 35a.

[0051] Figure 4a shows the foveal eyebox. S1 This represents the central area of ​​the field of view as seen from 21a. The image comprises a narrow field of view 11 of the light field and a wider field of view 12 of the peripheral image.

[0052] Figure 4b shows the surrounding iBox S1 This represents an image of the active fovea as seen from 21a. The active foveal image is obtained when the near-eye image projection system 200 is equipped with an eye-tracking and steering device and a movable imaging mirror 32. The narrow field of view portion 11 of the light field can be moved from its central position relative to the wide field of view image 12 according to the observer's gaze information and displayed content.

[0053] This disclosure further relates to a wearable device comprising an image projection system 200.

[0054] Figure 5 is a schematic diagram of a composite reality pair of glasses according to an embodiment, equipped with an image projection system 200 on each temple. On the right side of the glasses, a pin light source 10, an SLM 20, a prism 70, an imaging mirror 32, a Fourier filter 34, an illumination pupil dilator 36a, and an illumination out-coupling element are shown. The right temple is not shown. The foveal coupler includes a lens 41 (glass lens). The imaging exit pupil dilator element 36 and the imaging out-coupling element 37 that forms the peripheral coupler are embedded in the lens 41. On the left side of the glasses, the image projection system 200 is integrated into the temple.

[0055] Figure 6 is a top view of the mixed reality glasses shown in Figure 5, worn by a user. The image projection system 200 may be located on only one side of the mixed reality glasses, with the optical coupler 40 configured on at least one lens 41 of the glasses (as described above). The image projection system 200 may be located on another part of the hinge or temple. This application offers, for example, the following perspectives. [Perspective 1] A pin light source (10) that generates multiple incident light beams (100a, 100b), A spatial light modulator (SLM) (20) is configured to modulate the plurality of incident light beams (100a, 100b) and generate a plurality of modulated light beams (110a, 110b) that form pinned light images (31, 39) in the first plane (30), An illumination optical system configured to deliver incident light beams (100a, 100b) from a pin light source (10) to an SLM (20), A near-eye image projection system (200) comprising, An imaging optical system configured to continuously transport a modulated light beam (110a, 110b) from the SLM (20) along the projection axis (170a, 170b) to an eyebox region (121a, 121b) in a second plane (124) substantially parallel to the first plane (30), and In a near-eye image projection system (200) equipped with, The illumination optical system is in the third plane (38), the projection axis (170a, 170b) is in the fourth plane (125), and the third and fourth planes (38, 125) are substantially perpendicular to the first plane (30). The illumination optical system defines a first optical path (171) from the first plane (30) to the second plane (124) and a second optical path (172) from the third plane (38) to the fourth plane (125). The imaging optical system defines a third optical path (173) from the second plane (124) to the first plane (30) and a fourth optical path (174) from the first plane (30) to the second plane (124). The near-eye image projection system. [Perspective 2] The projection system according to viewpoint 1, wherein the illumination optical system comprises an illumination pupil dilator (36a) configured to expand the incident light beams (100a, 100b) from the incident to the exit pupil of the illumination pupil dilator (36a). [Perspective 3] The projection system according to viewpoint 2, wherein the illumination pupil dilation device comprises an illumination waveguide (36a) having an illumination incoupling element (35a) configured to receive incident light beams (100a, 100b). [Perspective 4] The projection system according to viewpoint 3, wherein the illumination waveguide (36a) comprises an illumination deflection element (61) configured to redirect the incident light beams (100a, 100b) along a first optical path (171), and an illumination external coupling element (37a) configured to output the incident light beams (100a, 100b) along a second optical path (172). [Perspective 5] The projection system according to viewpoint 3 or 4, wherein the illumination waveguide (36a) further comprises a collimating element (50) configured to collimate the plurality of incident light beams (100a, 100b). [Perspective 6] The projection system according to any one of viewpoints 3 to 5, wherein the illumination waveguide (36a) comprises a 1D or 2D folding grid configured to interact with the plurality of incident light beams (100a, 100b). [perspective 7] The projection system according to any one of viewpoints 1 to 6, wherein the SLM(20) is reflective. [Perspective 8] The projection system according to any one of viewpoints 1 to 7, wherein the imaging optical system comprises a prism (70) having a beam-shaping first outer surface (52) and a beam-shaping second outer surface (53) arranged so that the incident light beams (100a, 100b) along the second optical path (172) cross it. [Perspective 9] The projection system according to viewpoint 8, wherein the prism (70) further comprises a beam-shaping third outer surface (54) and a beam-shaping fourth outer surface (58) through which the plurality of incident light beams (100a, 100b) cross along the third optical path (173). [Perspective 10] The projection system according to viewpoint 9, further comprising a beam splitter (140) configured such that the prism (70) is crossed along a second optical path (172) by an incident light beam (100a, 100b) and the modulated light beam (110a, 110b) is reflected on a beam-shaping third outer surface (54). [Perspective 11] The projection system according to view 10, wherein the third outer surface (54) for beam shaping is configured to reflect the modulated light beams (110a, 110b) along the third optical path (173). [Perspective 12] The projection system according to view 10 or 11, wherein the SLM(20) is configured to cause in-plane polarization of the modulated light beams (110a, 110b). [Perspective 13] The third outer surface (54) for beam shaping is configured such that the polarization of the modulated light beams (110a, 110b) is reversed relative to the polarization provided by the SLM (20). The projection system according to viewpoint 12, wherein the third outer surface (54) for beam shaping comprises a quarter-wave plate (56) configured to p-polarize the modulated light beams (110a, 110b) along the third optical path (173). [Perspective 14] The projection system according to any one of views 9 to 13, wherein the beam-shaping fourth outer surface (58) is configured to collimate the modulated light beams (110a, 110b). [Perspective 15] The imaging optical system comprises an optical coupler (40) that projects an image light beam (112a, 112b) from a modulated light beam (110a, 110b) and transmits natural light from the real world (190) to an eyebox region (121a, 121b), as described in any one of viewpoints 1 to 14. [Perspective 16] The projection system according to any one of viewpoints 1 to 15, wherein the modulated light beam comprises a foveal modulated light beam (110a) that forms a foveal pinpoint image (31) in a first plane (30) and a peripheral modulated light beam (110b) that forms a peripheral pinpoint image (39) in the first pinpoint light plane (30). [Perspective 17] The projection system according to viewpoint 16, comprising a foveal coupler (41) configured to reflect a foveal-modulated light beam (110a) and project a light beam (112a) of the foveal image toward a foveal eyebox (121a). [Perspective 18] The imaging optical system is a projection system according to any one of views 1 to 17, comprising a Fourier filter (34) in a first plane (30). [Perspective 19] The projection system according to views 16, 17, and 18, wherein the Fourier filter (34) comprises an imaging deflection element (60a) in a first plane (30) that reflects the foveal-modulated light beam (110a) to the foveal coupler (41). [perspective 20] The projection system according to viewpoint 19, wherein the imaging optical system comprises an imaging mirror (32) configured to reflect the foveal-modulated light beam (110a) reflected by the imaging deflection element (60a) to a foveal coupler (41). [Perspective 21] The projection system according to viewpoint 20, wherein the imaging mirror (32) is movable so as to deflect the foveal-modulated light beam (110a) reflected by the imaging mirror (32) away from the projection axis (170). [Perspective 22] The projection system according to viewpoint 21, comprising an eye-tracking and steering device that provides eye-tracking information, wherein the imaging mirror (32) is movable according to the eye-tracking information. [Perspective 23] The projection system according to views 16 and 18, wherein the Fourier filter (34) is configured to allow the peripherally modulated light beam (110b) to be incident on the injection optical system (150), and the injection optical system (150) is configured to expand the peripherally modulated light beam (110b) from a first angle (α) to a second angle (β) greater than the first angle (α). [Perspective 24] The projection system according to Viewpoint 23, comprising an imaging exit pupil dilator (36) configured to receive a peripheral modulated light beam (110b) and project a peripheral image light beam (112b) along a projection axis (170) within a peripheral eyebox region (121b). [Viewpoint 25] The projection system according to viewpoint 24, comprising an imaging exit pupil dilation device, an imaging waveguide (36), an imaging incoupling element (35) configured to allow a peripheral modulated light beam (110b) to enter the imaging waveguide (36), and an imaging outcoupling element (37) configured to project a peripheral image light beam (112b) along a projection axis (170) within a peripheral eye box region (121B). [Perspective 26] A wearable device comprising a projection system described in any one of viewpoints 1 to 25. [perspective 27] The wearable device according to Viewpoint 26, comprising mixed reality glasses, wherein the optical coupler (40) comprises at least one of a plurality of lenses of the glasses, and the illumination optical system and imaging optical system are components within the hinge or another part of the temple. [Explanation of Symbols]

[0056] 10-pin light source 10a Operating pin light 11 Foveal region of the visual field 12 Peripheral areas of the field of view 13 Sub-arrangement of peripheral pin light 20 Optical Modulators (SLMs) 30 1st plane 31 Foveal pin image 32 Imaging mirror 34. Fourier Filter 341 Opening 35 Image-forming incoupling element 35a Lighting incoupling element 36 Image formation Exit pupil dilation device, Image formation Waveguide 36a Illumination pupil dilation device, illumination waveguide 37 Outcoupling Elements 37a Lighting Outcoupling Element 38 3rd plane 39 Peripheral pin light image 40 Optical coupler 41 Foveal connector, lens 50 Collimating Optical Elements 52. First outer surface for beam shaping. 53. Second outer surface for beam shaping. 54. Third outer surface for beam shaping 56 1 / 4 wave plate 58. Fourth outer surface for beam shaping 61 Lighting deflection element 60a Image deflection element 70 Optical elements for illumination and projection, prisms 90 eyes 92 Retina 100a Foveal incident light beam 100b Peripheral incident light beam 110a Foveal modulated light beam Modulated light beam around 110b 112a Light beam of foveal image 112b Peripheral image light beam 114a Image of the modulator in the fovea Image of the modulator in the vicinity of 114b 115 Plane of the Modulated Image 120 (multiple) second pin optical images, (multiple) viewpoints 121a I-Vock vinegar 121b Ivoc vinegar 124 2nd plane 125 4th plane 130 Pupil 140 Beam Splitter 150 Image injection optical system 151 Beam shaping transparent surface 152 Reflective surfaces 153 Reflective surfaces 154 Reflective surface for beam shaping 170a Projection axis 170b Central observation axis 171 1st optical path 172 Second optical path 173 Third optical path 174 4th optical path 190 Real World 200 Image Projection Modules

Claims

1. A pin light source that generates multiple incident light beams, A spatial light modulator (SLM) is configured to modulate the plurality of incident light beams and generate a plurality of modulated light beams that form a pin light image in the first plane, An illumination optical system and an imaging optical system configured to deliver an incident light beam from the pin light source to the SLM. A near-eye image projection system comprising: The imaging optical system is further configured to continuously transport a modulated light beam along the projection path from the SLM to an eyebox in a second plane substantially parallel to the first plane. In the aforementioned near-eye image projection system, The pin light source of the illumination optical system is in the third plane, the final projection axis of the projection path toward the eye box is in the fourth plane, and the third and fourth planes are substantially perpendicular to the first plane. The illumination optical system comprises a first optical path through which an incident light beam continues in the direction from the first plane to the second plane, and a second optical path through which an incident light beam continues in the direction from the third plane to the fourth plane. The imaging optical system comprises a third optical path through which a modulated light beam in the direction from the second plane to the first plane continues, and a fourth optical path through which a modulated light beam in the direction from the first plane to the second plane continues, The imaging optical system comprises a prism, and the prism has a first beam-shaping outer surface and a second beam-shaping outer surface, which are arranged to be traversed by the incident light beam along the second optical path. The aforementioned near-eye image projection system.

2. The prism, The near-eye image projection system according to claim 1, further comprising a third beam-shaping outer surface and a fourth beam-shaping outer surface, which are arranged to be traversed by the incident light beam along the third optical path.

3. The prism, The near-eye image projection system according to claim 2, further comprising a beam splitter positioned to be traversed by the incident light beam along the second optical path, and which reflects the modulated light beam toward the third beam-shaping outer surface so that the modulated light beam is reflected on the third beam-shaping outer surface.

4. The near-eye image projection system according to claim 3, wherein the third beam-shaping outer surface is made to reflect the modulated light beam along the third optical path.

5. The near-eye image projection system according to claim 3, wherein the SLM is configured such that the modulated light beam is s-polarized.

6. The third beam-shaping outer surface is configured such that the polarization of the modulated light beam is reversed relative to the polarization provided by the SLM. The outer surface of the third beam shaping plate is a quarter-wave plate such that the modulated light beam along the third optical path becomes p-polarized. The near-eye image projection system according to claim 5.

7. The near-eye image projection system according to claim 2, wherein the fourth beam-shaping outer surface is configured to collimate the modulated light beam.

Images