Near-eye image projection system and wearable device including the near-eye image projection system

Abstract

A near-eye image projection system includes: a point light source that generates an incident light beam; an SLM that generates a modulated light beam that forms a point light image in a first plane; an illumination optical device that transmits the incident light beam from the point light source to the SLM in a third plane; and an imaging optical device that transmits the modulated light beam along a projection axis in a fourth plane to an eye box in a second plane parallel to the first plane. The third and fourth planes are substantially perpendicular to the first plane. The illumination optical device defines a first light path from the first plane to the second plane and a second light path from the third plane to the fourth plane. The imaging optical device defines a third light path from the second plane to the first plane and a fourth light path from the first plane to the second plane. A wearable device including the near-eye image projection system is also described.

Description

Technical Field

[0001] The present invention relates to a near-eye image projection system with a small form factor. The present invention also relates to a wearable device, such as augmented / mixed reality or smart glasses, that includes the near-eye image projection system. More specifically, the present invention relates to a near-eye light field projection system. The near-eye light field projection system can have foveation capability. Background Art

[0002] Light field image projection achieved by sequential spatial light modulation of structured incident light by means of a spatial light modulator (SLM) typically requires shaping the source light from a light source by several optical elements separated by a sufficient volume of transparent medium to achieve the desired properties of the structured incident light and, therefore, the desired properties of the projected light field image. This arrangement results in a bulky device that is not suitable for applications requiring a small form factor, such as wearable devices such as smart glasses. Reducing the optics by using optical elements with higher focal power (e.g., lenses with shorter focal lengths, free-form optics, etc.) still requires a considerable volume for light propagation, or suffers from a lower quality of the illuminated light structure and, therefore, a lower quality of the projected image, and requires higher compensation requirements due to optical artifacts such as distortion, aberrations, diffraction, etc.

[0003] Document EP3542206A1 discloses a method for light field projection by sequential spatial light modulation of structured light. Document WO2020157562A1 discloses several methods for combining light field projection systems with different types of combiners, and document US20190285897A1 discloses a device using image pupil expansion, which has a waveguide combined with a reflective combiner. Summary of the Invention

[0004] The present invention relates to a near-eye image projection system, comprising: a pin-light source that generates a plurality of incident light beams; an SLM configured to modulate the plurality of incident light beams and generate a plurality of modulated light beams, thereby forming a pin-light image in a first plane; an illumination optical device and an imaging optical device configured to transmit the incident light beams from the pin-light source to the SLM. The imaging optical device is further configured to sequentially transmit the modulated light beams from the SLM along a projection axis to an eyebox in a second plane substantially parallel to the first plane. The illumination optical device is in a third plane, and the projection axis is in a fourth plane; the third and fourth planes are substantially perpendicular to the first plane. The illumination optical device defines a first optical path followed by the incident light beam in a direction from the first plane to the second plane, and a second optical path followed by the incident light beam in a direction from the third plane to the fourth plane. The imaging optical device defines a third optical path followed by the modulated light beam in a direction from the second plane to the first plane, and a fourth optical path followed by the modulated light beam in a direction from the first plane to the second plane. The imaging optical device also includes an optical combiner for projecting an image beam from the modulated beam and transmitting natural light from the real world toward the eye frame, wherein the modulated beam includes a foveal fixation modulated beam that forms a foveal fixation point light image at a first plane and a peripheral modulated beam that forms a peripheral point light image at the first plane, and wherein the optical combiner includes a foveal fixation combiner configured to reflect the foveal fixation modulated beam and project the foveal fixation image beam toward the foveal fixation eye frame.

[0005] The near-eye image projection system disclosed herein has a small form factor and is well-suited for wearable applications such as augmented / mixed reality or smart glasses. BRIEF DESCRIPTION OF THE DRAWINGS

[0006] Exemplary embodiments of the present invention are disclosed in the specification and illustrated in the accompanying drawings, in which:

[0007] Figures 1a to 1f shows a schematic diagram of a near-eye image projection system including an SLM, illumination optics, and imaging optics according to several embodiments;

[0008] Figures 2a to 2c shows illumination optics according to several embodiments;

[0009] Figure 3 shows peripheral image injection optics of an imaging optics according to an embodiment;

[0010] Figure 4a represents the image consisting of the light field and the peripheral part as seen from the foveal fixation eye box;

[0011] Figure 4brepresents an active foveal fixation image consisting of a light field and a peripheral portion, wherein the light field portion of the image is aligned with a region of interest, the region of interest being the area to which the viewer's gaze is directed from the foveal fixation eye box;

[0012] Figure 5 is a schematic diagram of mixed reality glasses according to an embodiment; and

[0013] Figure 6 It is worn by the user Figure 5 A top view of mixed reality glasses. DETAILED DESCRIPTION

[0014] Figures 1a to 1f A schematic diagram of a near-eye image projection system 200 according to an embodiment is shown. The near-eye image projection system 200 includes a point light source 10 that generates a plurality of incident light beams 100a, 100b. An SLM 20 is configured to modulate the plurality of incident light beams 100a, 100b and generate a plurality of modulated light beams 110a, 110b, forming point light images 31, 39 on a first plane 30. The near-eye image projection system further includes an illumination optical device configured to sequentially transmit the incident light beams 100a, 100b from the point light source 10 to the SLM 20 along projection axes 170a, 170b, and to the eye boxes 121a, 121b in a second plane 124 substantially parallel to the first plane 30.

[0015] refer to Figure 1a , the illumination optics are in the third plane 38, and the projection axes 170a, 170b are in the fourth plane 125. The third and fourth planes 38, 125 are substantially perpendicular to the first plane 30. The illumination optics are configured to define a first optical path 171, which is shown as being parallel to the projection axes 170a, 170b in a first direction from the first plane 30 to the second plane 124, although this is not required. The illumination optics can also be configured to define a second optical path 172 (shown as being perpendicular to the projection axes 170a, 170b) from the third plane 38 to the fourth plane 125, although this is not required.

[0016] Figure 2a A possible configuration of an illumination optics according to an embodiment is shown. The illumination optics comprises a point light source 10 comprising a plurality of individual point light sources 10a, each point light source 10a being adapted to generate at least one incident light beam 100a, 100b. Figure 2a In the specific example of , the point light sources 10 comprise an array of point light sources 10a in a plane substantially perpendicular to the first plane 30. However, other arrangements of the point light sources 10 are possible.

[0017] In one aspect, the illumination optics include collimating optics 50 configured to collimate the incident light beam 100a into a narrow beam. The collimating optics 50 may include any one or more of lenses, mirrors, holograms, or any other optical element that performs collimation.

[0018] In one aspect, the illumination optics further include an illumination deflection element 61 configured to redirect incident point light 100a, 100b along a first optical path 171. The illumination deflection element 61 may include any one or more of a prism, a grating, a hologram, or any other optical element that performs redirection.

[0019] In one aspect, the illumination optics comprises an illumination pupil expansion device 36a configured to expand the incident light beam 100a, 100b from an entrance to an exit pupil of the illumination pupil expansion device 36a. The illumination pupil expansion device 36a enables an increase in the field of view (FOV) of the projected image.

[0020] In one aspect, the illumination pupil expansion device includes a light guide or illumination waveguide 36a including an illumination incoupling element 35a configured to input incident point light 100a, 100b. The illumination waveguide 36a may also include an illumination outcoupling element 37a configured to output the incident point light 100a, 100b along a second optical path 172.

[0021] Collimated incident light beams 100a, 100b are injected into the illumination waveguide 36a by means of interaction with the illumination incoupling element 35a. The illumination incoupling element 35a may include a diffraction grating, a hologram, an array of tilted mirrors or prisms, a stack of semi-reflective interfaces, or any other suitable optical element. The incident light beams 100a, 100b propagate due to internal reflection while they are expanded in the plane of the illumination waveguide 36a by means of interaction with a 1D or 2D folded grating or by any other optical element that expands the incident light beams 100a, 100b. The illumination outcoupling element 37a may include a diffraction grating, a hologram, an array of tilted mirrors or prisms, a stack of semi-reflective interfaces, or any other optical element configured to output the incident point light 100a, 100b along the second optical path 172. The illumination outcoupling element 37a can be configured such that the incident light beams 100a, 100b leave the illumination waveguide 36a in the following state: the incident light beams 100a, 100b are multiplied with uniformly distributed intensities and are collimated in a direction given by the tilt angle of the injected incident light beams 100a, 100b, which is the second optical path 172.

[0022] The expanded collimated light beam sequentially illuminates a reflective or transmissive SLM 20. In the case of a transmissive SLM, the incident light component is modulated and propagates to the projection optics.

[0023] Reference again Figure 1a The imaging optics are further configured to define a third optical path 173 (shown as being parallel to the projection axes 170a, 170b in the first direction, although this is not required) from the second plane 124 to the first plane 30. The imaging optics are further configured to define a fourth optical path 174 (shown as being parallel to the projection axes 170a, 170b, although this is not required) from the first plane 30 to the second plane 124.

[0024] In an embodiment, the imaging optics comprises an illumination and projection optical element 70. The illumination and projection optical element 70 may comprise a prism 70 comprising first and second beam shaping outer surfaces 52, 53. In the case of a reflective SLM 20, as Figure 1a As shown, the incident light beams 100a, 100b that exit the illumination waveguide 36a along the second optical path 172 through the illumination outcoupling element 37a pass through the first and second beam shaping outer surfaces 52, 53 of the prism 70 before reaching the SLM 20. The first and second beam shaping outer surfaces 52, 53 can be configured to focus the collimated incident light beams 100a, 100b onto the SLM 20.

[0025] In one aspect, the prism 70 can include a beam splitter 140 configured to be passed through by the incident light beams 100 a , 100 b along the second optical path 172 before the incident point light 100 a , 100 b reaches the SLM 20 .

[0026] The (reflective) SLM 20 modulates the incident light beam 100a or 100b and reflects the modulated light beam 110a, 110b (image component) back to the prism 70 along the second optical path 172 via the second beam shaping surface 53. The SLM 20 is also configured to reflect the modulated light beam 110a, 110b having an in-plane polarization (s-polarization) or an angle above total internal reflection (in the case where the SLM 20 includes a digital micromirror device), which is obtained during modulation by the SLM 20.

[0027] The beam splitter 140 can also be configured to reflect the modulated light beams 110a, 110b generated by the SLM 20 along a third optical path 173. The prism 70 also includes third and fourth beam shaping outer surfaces 54, 58. The modulated light beams 110a, 110b reflected by the beam splitter 140 are reflected by the third beam shaping outer surface 54 along a fourth optical path 174.

[0028] The third beam shaping outer surface 54 may be configured to invert the polarization of the modulated beams 110 a , 110 b relative to the in-plane polarization provided by the SLM 20 .

[0029] In one aspect, the third beam shaping outer surface 54 can include a quarter wave plate 56 configured to cause the modulated light beams 110a, 110b along the third optical path 173 to become p-polarized.

[0030] The modulated light beams 110a, 110b reflected by the third beam shaping outer surface 54 pass through the fourth beam shaping outer surface 58. The fourth beam shaping outer surface 58 may be configured to collimate the SLM pixel bundles constituting the modulated light beams 110a, 110b.

[0031] In an embodiment, the imaging optics include an optical combiner 40 configured to receive the modulated light beams 110a, 110b and project image light beams 112a, 112b along projection axes 170a, 170b to the eyeboxes 121a, 121b. The optical combiner 40 is further configured to transmit natural light from the real world 190 toward the eyeboxes 121a, 121b.

[0032] For virtual and mixed reality applications, the near-eye image projection system 200 is intended to be worn by a viewer. The image projection system can be configured so that when it is worn by a viewer, the eye boxes 121a, 121b and the exit pupil (or viewpoint) 120 are within the viewer's eye 90. The image beams 112a, 112b are projected toward the pupil 130 of the viewer's eye 90 so that the image beams 112a, 112b are projected onto the retina 92.

[0033] The modulated light beams may include a foveal fixation modulated light beam 110 a forming a foveal fixation point light image 31 at the first plane 30 and a peripheral modulated light beam 110 b forming a peripheral point light image 39 at the first plane 30 .

[0034] In one aspect, the imaging optics further include a Fourier filter 34 in the first plane 30. The Fourier filter 34 may include an imaging deflection element 60a (see Figure 3 ), which reflects the foveal gaze modulated light beam 110a to the foveal gaze combiner 41 included in the optical combiner 40, so that the foveal gaze combiner 41 reflects the foveal gaze modulated light beam 110a and projects the foveal gaze image light beam 112a toward the foveal gaze eyebox 121a. The foveal gaze combiner 41 may include a transparent or at least partially transparent reflective surface. The reflective surface may be concave and / or elliptical, or have any shape suitable for projecting the foveal gaze image light beam 112a toward the foveal gaze eyebox 121a.

[0035] In particular, Figure 1aThe figure shows a point light source 10 generating a single incident foveal fixation beam 100a, and the projection of a single foveal fixation modulated beam 110a and a foveal fixation image beam 112a onto a foveal fixation eyebox 121a. The single incident foveal fixation beam 100a is generated by a single point light (active point light) 10a of the point light source 10. The foveal fixation image beam 112a forms an image at a viewpoint 120 in the foveal fixation eyebox 121a.

[0036] Figure 1b A near-eye image projection system 200 is shown in which a single incident foveal fixation beam 100a is generated by another single point light source 10a of the point light sources 10. The foveal fixation image beam 112a forms an image at another viewpoint 120 in a foveal fixation eyebox 121a.

[0037] The multiple point lights 10a of the point light source 10 can generate multiple incident foveal gaze beams 100a, and the illumination optics and imaging optics project multiple foveal gaze modulated beams 110a and foveal gaze image beams 112a toward the foveal gaze eyebox 121a.

[0038] The imaging optics may further include an imaging mirror 32 configured to reflect the foveal gaze modulated light beam 110a reflected by the imaging deflection element 60a toward the foveal gaze combiner 41. The imaging mirror 32 may be positioned proximate to the SLM 20 such that the foveal gaze modulated light beam 110a is reflected by the imaging deflection element 60a toward the SLM 20 and reflected back by the imaging mirror 32 toward the foveal gaze combiner 41. The imaging deflection element 60a may include a tilted mirror or a prism. The imaging mirror 32 generates a foveal gaze modulator image 114a in a modulator image plane 115 between the imaging mirror 32 and the foveal gaze combiner 41. Because each imaging deflection element 60a may be oriented at a different angle (e.g., the mirror or prism may be tilted at a different angle), an array of foveal gaze modulator images 114a may be generated in which at least some of the foveal gaze modulator images 114a are spatially displaced relative to other foveal gaze modulator images 114a in the modulator image plane 115. In this case, the foveal gaze combiner 41 will cause the viewer to see the image array from the eye box 121a.

[0039] In an embodiment, the imaging mirror 32 may be movable so as to deflect the foveal-focused modulated light beam 110a reflected by the imaging mirror 32 from the projection axes 170a, 170b.

[0040] Figure 1cA near-eye image projection system 200 is shown in which two foveal fixation modulated light beams 110a from two incident foveal fixation light beams 100a generated by a point light source 10 are projected along a projection axis 170a that is tilted relative to a central (neutral) projection axis 170b. The tilt of the projection axis 170a relative to the central projection axis 170b is based on the movement (rotation) of the imaging mirror 32.

[0041] In one aspect, the near-eye image projection system 200 can include an eye tracking and steering device (not shown) that provides eye tracking information. The imaging mirror 32 can then be moved (rotated) based on the eye tracking information.

[0042] In one aspect, the Fourier filter 34 is further configured to allow the peripheral modulated light beam 110b to pass through the Fourier filter 34 and reach the image injection optical device 150, which is configured to expand the peripheral modulated light beam 110b from the first angle α to a second angle β greater than the first angle α.

[0043] The Fourier filter 34 may thus be configured to separate the optical paths of the foveal fixation modulated light beam 110a and the peripheral modulated light beam 110b.

[0044] Figure 3 A peripheral image injection optic 150 is shown according to an embodiment. Figure 3 In the configuration of , the image injection optics 150 includes a beam shaping transmissive surface 151 to which the peripheral modulated beam 110b is input. Figure 3 , one peripheral modulated beam 110 b is shown. The following discussion considers one peripheral modulated beam 110 b, but is also applicable to multiple peripheral modulated beams 110 b. The image injection optics 150 also includes reflective surfaces 152 , 153 (mirrors 152 and 153 ) and a beam shaping reflective surface 154 .

[0045] The input peripheral modulated light beam 110b enters the peripheral image injection optical device 150 at a first angle α through the opening 341 in the Fourier filter 34. The opening 341 coincides with the peripheral point light image 39 of the peripheral modulated light beam 110b.

[0046] The peripheral modulated light beam 110b is input into the peripheral image injection optics 150 through the opening 341 at a beam angle α. Due to internal reflections on the reflective surfaces 152, 153, and 154, the peripheral modulated light beam 110b propagates within the peripheral image injection optics 150 while it expands to a second angle β toward the imaging in-coupling element 35. The peripheral image injection optics 150 produces a peripheral modulator image 114b of the SLM 20. In this configuration, the peripheral modulated light beam 110b from each pixel of the image 114b is collimated by the beam shaping reflective surface 154 and injected by the imaging in-coupling element 35.

[0047] exist Figures 1a to 1f In the illustrated embodiment, the optical combiner 40 includes a foveal focus combiner 41 and a peripheral combiner, the peripheral combiner including an imaging exit pupil expansion device 36, and the imaging exit pupil expansion device 36 is configured to receive the peripheral modulated light beam 110b and project the peripheral image beam 112b to the peripheral eye box 121b along the projection axis 170. The collimated peripheral modulated light beam 110b with an expanded second β (the peripheral modulated light beam 110b includes a beam from each SLM pixel, and these pixel beams are collimated) is injected into the imaging exit pupil expansion device 36 through the imaging coupling element 35. The imaging exit pupil expansion device may include an imaging waveguide 36.

[0048] The imaging waveguide 36 may include an imaging outcoupling element 37 configured to allow the peripheral image beam 112b to exit the imaging waveguide 36 and be projected into the peripheral eyebox 121b along a projection axis 170b. Due to the pupil replication performed by the imaging waveguide 36, the peripheral eyebox 121b is typically larger than the foveal fixation eyebox 121a.

[0049] Figure 1d A near-eye image projection system 200 is shown, wherein a subset of the peripheral modulated beams 110b (i.e., one peripheral modulated beam 110b) is transmitted through the Fourier filter 34, injected into the imaging waveguide 36, and a peripheral image beam 112b is projected into the peripheral eye box 121b along the projection axis 170b.

[0050] Figure 1e A near-eye image projection system 200 is shown in which a subset of (two) foveal fixation modulated light beams 110a are reflected on an imaging mirror 32 and a foveal fixation combiner 41, and a foveal fixation image beam 112a is projected along a projection axis 170a into a foveal fixation eyebox 121a. The imaging deflection element 60a can reflect the incident light beams 110a at different angles so that at least some of the foveal fixation modulator image elements 114a are focused at different locations in a plane 115 relative to other foveal fixation modulator image elements 114a.

[0051] Figure 1fShown Figure 1e The near-eye image projection system 200 further shows that a subset (i.e., one) of the peripheral modulated light beams 110b is injected into the peripheral combiner (imaging exit pupil expansion device 36), and the corresponding peripheral image light beams 112b are projected into the peripheral eye box 121b along the projection axis 170b.

[0052] exist Figure 1c 、 1e In and 1 f , the point light source 10 , the SLM 20 , the prism 70 and the illumination pupil expansion device 36 a are schematically represented by the box 200 .

[0053] The imaging outcoupling element 37 can include a volume hologram, a diffraction grating mirror array, or a stack of prisms (semi-transparent interfaces). The outcoupling element 37 and the waveguide 36 act as a peripheral combiner and therefore need to be partially transparent in augmented reality applications. They can be opaque for virtual reality applications and video-through augmented reality applications. The foveal gaze combiner 41 can include a variety of semi-transparent optical devices, such as a volume hologram, a Fresnel-type reflector, or an ellipsoidal surface with a semi-reflective inner surface.

[0054] The near-eye image projection system 200 allows the foveal fixation modulated beam 110a and the peripheral modulated beam 110b to be projected along projection axes 170a, 170b via the optical combiner 40 to the eye boxes 121a and 121b as the foveal fixation image beam 112a and the peripheral image beam 112b, respectively.

[0055] Other configurations of illumination optics are contemplated. Figure 2b In , the illumination collimating element 50 and the deflecting element 61 comprise holograms. Figure 2c In FIG. 3 , the functions of the collimating element 50 , the imaging deflection element 60 a and the illumination incoupling element 35 a are performed by a single holographic diffraction element 35 a .

[0056] Figure 4a The foveal fixation region of the field of view as seen from the foveal fixation eye box 121a is shown. The image comprises a narrow field of view light field portion 11 and a wider field of view peripheral image 12.

[0057] Figure 4b represents an active foveal fixation image as seen from the peripheral eye frame 121a. This active foveal fixation image can be obtained when the near-eye image projection system 200 includes an eye tracking and steering device and a movable imaging mirror 32. The narrow field of view light field portion 11 can be moved from a central position relative to the wide field of view image 12 based on information about the viewer's eye fixation or according to the displayed content.

[0058] The present disclosure also relates to a wearable device including the image projection system 200 .

[0059] Figure 5 is a schematic diagram of mixed reality glasses according to an embodiment, which include an image projection system 200 on each temple. On the right side of the glasses, a point light source 10, an SLM 20, a prism 70, an imaging reflector 32, a Fourier filter 34, an illumination pupil expansion device 36a, and an illumination outcoupling element are shown. The right temple is not shown. The foveal focus combiner includes a lens 41 (glass lens). The imaging exit pupil expansion device 36 and the imaging outcoupling element 37 forming the peripheral combiner are embedded in the lens 41. On the left side of the glasses, the image projection system 200 is integrated into the temple.

[0060] Figure 6 For users to wear Figure 5 . The image projection system 200 can be included on only one side of the mixed reality glasses, where the optical combiner 40 is included in at least one lens 41 of the glasses (as described above). The image projection system 200 can be included in another part of the hinge or temple.

[0061] Reference Numbers and Symbols

[0062] 10 point lights

[0063] 10a Active point light

[0064] 11 Foveal fixation area of ​​the visual field

[0065] 12 Peripheral area of ​​the field of view

[0066] 13 Peripheral point photon array

[0067] 20 Optical Light Modulator (SLM)

[0068] 30 First plane

[0069] 31 Foveal fixation light image

[0070] 32 Imaging Mirrors

[0071] 34 Fourier filter

[0072] 341 Opening

[0073] 35 Imaging coupling element

[0074] 35a Illumination coupling element

[0075] 36 Imaging pupil expansion device, imaging waveguide

[0076] 36a Illuminating pupil expansion device, illuminating waveguide

[0077] 37 Peripheral coupling components

[0078] 37a Illumination outcoupling element

[0079] 38 Third Plane

[0080] 39 Peripheral point light image

[0081] 40 Optical Combiner

[0082] 41 Foveal gaze combiner, lens

[0083] 50 Collimating optics

[0084] 52 first beam shaping outer surface

[0085] 53 Second beam shaping outer surface

[0086] 54 third beam shaping outer surface

[0087] 56 Quarter Wave Plate

[0088] 58 fourth beam shaping outer surface

[0089] 61 Illumination Deflection Element

[0090] 60a Imaging deflection element

[0091] 70 Illumination and projection optics, prisms

[0092] 90 Eyes

[0093] 92 Retina

[0094] 100a Foveal fixation of incident beam

[0095] 100b Peripheral incident beam

[0096] 110a Foveal fixation modulated beam

[0097] 110b peripheral modulated beam

[0098] 112a Foveal fixation image beam

[0099] 112b Peripheral image beam

[0100] 114a Foveal gaze modulator image

[0101] 114b peripheral modulator image

[0102] 115 Modulator Image Plane

[0103] 120 Second point light image, viewpoint

[0104] 121a Foveal fixation

[0105] 121b peripheral eye socket

[0106] 124 Second Plane

[0107] 125 Fourth Plane

[0108] 130 pupil

[0109] 140 beam splitter

[0110] 150 Image injection optics

[0111] 151 Beam Shaping Transmission Surface

[0112] 152 Reflective Surfaces

[0113] 153 Reflective Surface

[0114] 154 Beam Shaping Reflective Surfaces

[0115] 170a Projection axis

[0116] 170b Central Visual Axis

[0117] 171 First Light Path

[0118] 172 Second optical path

[0119] 173 Third Light Path

[0120] 174 Fourth Light Path

[0121] 190 Real World

[0122] 200 Image Projection Module

Claims

1. A near-eye image projection system (200), comprising: A point light source (10) generating a plurality of incident light beams (100a, 100b); a spatial light modulator (20) configured to modulate the plurality of incident light beams (100a, 100b) and generate a plurality of modulated light beams (110a, 110b), thereby forming point light images (31, 39) on a first plane (30); illumination optics and imaging optics configured to deliver an incident light beam (100a, 100b) from a point light source (10) to a spatial light modulator (20); and The imaging optics are further configured to sequentially deliver the modulated light beams (110a, 110b) from the spatial light modulator (20) along a projection axis (170a, 170b) to eyeboxes (121a, 121b) in a second plane (124) substantially parallel to the first plane (30); in, the illumination optics are in a third plane (38) and the projection axes (170a, 170b) are in a fourth plane (125), the third and fourth planes (38, 125) being substantially perpendicular to the first plane (30); The illumination optics define a first optical path (171) followed by the incident light beam (100a, 100b) in a direction from the first plane (30) to the second plane (124) and a second optical path (172) followed by the incident light beam (100a, 100b) in a direction from the third plane (38) to the fourth plane (125); and The imaging optics define a third optical path (173) followed by the modulated light beams (110a, 110b) in a direction from the second plane (124) to the first plane (30) and a fourth optical path (174) followed by the modulated light beams (110a, 110b) in a direction from the first plane (30) to the second plane (124); It is characterized by: The imaging optics include an optical combiner (40) for projecting an image beam (112a, 112b) from the modulated light beam (110a, 110b) and transmitting natural light from the real world (190) toward the eye frame (121a, 121b); wherein the modulated light beam comprises a foveal fixation modulated light beam (110a) forming a foveal fixation point light image (31) at a first plane (30) and a peripheral modulated light beam (110b) forming a peripheral point light image (39) at the first plane (30); and The optical combiner (40) includes a foveal gaze combiner (41) configured to reflect a foveal gaze modulated light beam (110a) and project a foveal gaze image light beam (112a) toward a foveal gaze eye frame (121a).

2. The projection system according to claim 1, in, The illumination optics comprises an illumination pupil expansion device (36a) configured to expand an incident light beam (100a, 100b) from an entrance to an exit pupil of the illumination pupil expansion device (36a).

3. The projection system according to claim 2, in, The illumination pupil expansion device comprises an illumination waveguide (36a) comprising an illumination incoupling element (35a) configured to input an incident light beam (100a, 100b).

4. The projection system according to claim 3, in, The illumination waveguide (36a) includes an illumination deflection element (61) configured to redirect an incident light beam (100a, 100b) along a first optical path (171) and an illumination outcoupling element (37a) configured to output the incident light beam (100a, 100b) along a second optical path (172).

5. The projection system according to claim 3, in, The illumination waveguide (36a) further includes a collimating element (50) configured to collimate the plurality of incident light beams (100a, 100b).

6. The projection system according to claim 3, in, The illumination waveguide (36a) includes a 1D or 2D folded grating configured to interact with the plurality of incident light beams (100a, 100b).

7. The projection system according to claim 1, in, The spatial light modulator (20) is a reflective spatial light modulator.

8. The projection system according to claim 1, in, The imaging optics include a Fourier filter (34) in a first plane (30).

9. The projection system according to claim 8, in, The Fourier filter (34) includes an imaging deflection element (60a) in a first plane (30) that reflects the foveal fixation modulated light beam (110a) to the foveal fixation combiner (41).

10. The projection system according to claim 9, in, The imaging optics includes an imaging mirror (32) configured to reflect the foveal gaze modulated light beam (110a) reflected by the imaging deflection element (60a) to the foveal gaze combiner (41).

11. The projection system according to claim 10, in, The imaging mirror (32) is movable to deflect the foveal focused modulated light beam (110a) reflected by the imaging mirror (32) from the projection axis (170).

12. The projection system according to claim 11, Includes eye tracking and steering devices that provide eye tracking information; and in, The imaging mirror (32) is movable based on the eye tracking information.

13. The projection system according to claim 1 or 8, in, The Fourier filter (34) is configured to allow the peripheral modulated light beam (110b) to enter the injection optical device (150), and the injection optical device (150) is configured to expand the peripheral modulated light beam (110b) from a first angle (α) to a second angle (β) greater than the first angle (α).

14. The projection system according to claim 13, in, The imaging optical device includes an imaging exit pupil expansion device (36) configured to receive a peripheral modulated light beam (110b) and project a peripheral image light beam (112b) into a peripheral eye box (121b) along a projection axis (170).

15. The projection system according to claim 14, in, The imaging exit pupil expansion device includes an imaging waveguide (36), the imaging waveguide (36) including an imaging coupling element (35) configured to input a peripheral modulated light beam (110b) into the imaging waveguide (36), and an imaging coupling element (37) configured to project a peripheral image light beam (112b) into a peripheral eye frame (121b) along a projection axis (170).

16. A wearable device comprising a projection system, the projection system comprising: A point light source (10) generating a plurality of incident light beams (100a, 100b); a spatial light modulator (20) configured to modulate the plurality of incident light beams (100a, 100b) and generate a plurality of modulated light beams (110a, 110b), thereby forming point light images (31, 39) on a first plane (30); illumination optics and imaging optics configured to deliver an incident light beam (100a, 100b) from a point light source (10) to a spatial light modulator (20); and The imaging optics are further configured to sequentially deliver the modulated light beams (110a, 110b) from the spatial light modulator (20) along a projection axis (170a, 170b) to eyeboxes (121a, 121b) in a second plane (124) substantially parallel to the first plane (30); wherein the illumination optics are in a third plane (38) and the projection axes (170a, 170b) are in a fourth plane (125), the third and fourth planes (38, 125) being substantially perpendicular to the first plane (30); The illumination optics define a first optical path (171) followed by the incident light beam (100a, 100b) in a direction from the first plane (30) to the second plane (124) and a second optical path (172) followed by the incident light beam (100a, 100b) in a direction from the third plane (38) to the fourth plane (125); and The imaging optics define a third optical path (173) followed by the modulated light beams (110a, 110b) in a direction from the second plane (124) to the first plane (30) and a fourth optical path (174) followed by the modulated light beams (110a, 110b) in a direction from the first plane (30) to the second plane (124); The imaging optical device includes an optical combiner (40) for projecting an image beam (112a, 112b) from a modulated light beam (110a, 110b) and transmitting natural light from the real world (190) toward the eye frame (121a, 121b); wherein the modulated light beam comprises a foveal fixation modulated light beam (110a) forming a foveal fixation point light image (31) at a first plane (30) and a peripheral modulated light beam (110b) forming a peripheral point light image (39) at the first plane (30); and The optical combiner (40) includes a foveal gaze combiner (41) configured to reflect a foveal gaze modulated light beam (110a) and project a foveal gaze image light beam (112a) toward a foveal gaze eye frame (121a).

17. The wearable device according to claim 16, including mixed reality glasses, which The optical combiner (40) is included in at least one lens of the eyeglasses, and the illumination optics and imaging optics are included in a hinge or another part of the temple.

Images