Optical system including selectively activatable facets - Patents.com

Abstract

To solve such a problem that there is a case where illumination of an entire eye or an entire pupil is inefficient, and there is a case where a ghost image is not desired.SOLUTION: In one embodiment, an apparatus is disclosed that includes at least one processor configured to determine a target portion of an eye motion box and to identify a facet of a light-guide optical element that is configured to direct a light beam comprising at least a portion of an image field of view toward the target portion of the eye motion box. The at least one processor is configured to identify a display region of an image generator that is configured to inject the light beam into the light-guide optical element at an angle that, in conjunction with the identified facet, is configured to direct the light beam toward the target portion of the eye motion box. The at least one processor is configured to selectively activate the identified facet and the identified display region to direct the light beam toward the target portion of the eye motion box.SELECTED DRAWING: None

Description

[Technical field]

[0001] The present disclosure relates to optical systems and, more particularly, to optical systems having selectively activatable facets that may be used in near-eye display systems in some embodiments. [Background technology]

[0002] Optical systems, such as near-eye display systems, typically illuminate a user's eye with an image. In some cases, the optical system may illuminate the entire eye or pupil with light rays from the image, regardless of where the pupil is located. In some cases, external light may generate ghost images due to reflections by the optical system. However, illumination of the entire eye or pupil may be inefficient, and ghost images may be undesirable. Summary of the Invention

[0003] In one embodiment, an apparatus is disclosed that includes at least one processor. The at least one processor is configured to determine a target portion of an i-motion box to identify one facet of a plurality of facets of a light-guiding optical element. The identified facet is configured to direct a light beam that includes at least a portion of an image field of view toward the target portion of the i-motion box. The at least one processor is further configured to identify one display region of a plurality of display regions of an image generator. The identified display region is configured to inject a light beam into the light-guiding optical element at an angle configured to cooperate with the identified facet to direct the light beam toward the target portion of the i-motion box. The at least one processor is further configured to selectively activate the identified facet and the identified display region to direct the light beam toward the target portion of the i-motion box.

[0004] In some embodiments, a method is disclosed that includes determining a target portion of an i-motion box and identifying one of a plurality of facets of a light-guiding optical element. The identified facet is configured to direct a light beam that includes at least a portion of an image field of view toward the target portion of the i-motion box. The method further includes identifying one of a plurality of display regions of an image generator. The identified display region is configured to inject a light beam into the light-guiding optical element at an angle that is configured to cooperate with the identified facet to direct the light beam toward the target portion of the i-motion box. The method further includes selectively activating the identified facet and the identified display region to direct the light beam toward the target portion of the i-motion box.

[0005] In one embodiment, an optical system is disclosed. The optical system comprises a light-guiding optical element comprising a plurality of facets. Each facet is selectively activatable between at least a first state in which the facet is configured to allow light rays to transmit through the facet and a second state in which the facet is configured to reflect light rays. When the facet is in the second state, the facet is configured to direct light rays corresponding to an image field toward a target portion of an i-motion box. The optical system further comprises an image generator comprising a plurality of display regions. The display regions are selectively activatable to inject light rays corresponding to the image field into the light-guiding optical element at different angles. The optical system further comprises a controller configured to identify a facet of the plurality of facets. The identified facet is configured to direct light rays including at least a portion of the image field toward a target portion of the i-motion box. The controller is further configured to identify a display region of the plurality of display regions. The identified display region is configured to inject light rays into a light-directing optic that includes at least a portion of the image field at an angle configured to cooperate with the identified facet to direct the light rays toward the target portion of the i-motion box, and the controller is further configured to selectively activate the identified facets and the identified display region to direct the light rays toward the target portion of the i-motion box.

[0006] The foregoing summary is illustrative only and is not intended to be in any way limiting. In addition to the illustrative aspects, embodiments, and features described above, further aspects, embodiments, and features will become apparent by reference to the drawings and the following detailed description. In the drawings, like reference numbers indicate identical or functionally similar elements. [Brief description of the drawings]

[0007] [Figure 1A] FIG. 2 is a schematic diagram of an exemplary optical system with a first facet activated, according to one embodiment. [Figure 1B] 1B is a schematic diagram of an exemplary image generator of the optical system of FIG. 1A with a first display area activated, according to one embodiment. [Figure 2A] FIG. 1B is a schematic diagram of the optical system of FIG. 1A with the second facet activated, according to one embodiment. [Figure 2B] FIG. 1C is a schematic diagram of the example image generator of FIG. 1B with a second display region activated, according to one embodiment. [Figure 3A] FIG. 1B is a schematic diagram of the optical system of FIG. 1A with the third facet activated, according to one embodiment. [Figure 3B] FIG. 1C is a schematic diagram of the example image generator of FIG. 1B with a third display region activated, according to one embodiment. [Figure 4A] FIG. 1B is a schematic diagram of the optical system of FIG. 1A with the fourth facet activated, according to one embodiment. [Figure 4B] FIG. 1C is a schematic diagram of the example image generator of FIG. 1B with a fourth display region activated, according to one embodiment. [Diagram 5] 1A-4B over time, according to one embodiment. [Figure 6A] FIG. 1C is a schematic diagram of the optical system of FIGS. 1A and 1B illustrating the direction of light rays onto the eye using an eye tracking system, according to one embodiment. [Figure 6B] FIG. 1C is a schematic diagram of the optical system of FIGS. 1A and 1B illustrating the direction of light rays onto the eye using an eye tracking system, according to one embodiment. [Figure 7A] FIG. 1C is a schematic diagram of the optical system of FIGS. 1A and 1B illustrating the direction of light rays onto the eye without the use of an eye tracking system, according to one embodiment. [Figure 7B] FIG. 1C is a schematic diagram of the optical system of FIGS. 1A and 1B illustrating the direction of light rays onto the eye without the use of an eye tracking system, according to one embodiment. [Figure 8] 2 is a schematic diagram illustrating the range of available field of view (FOV) of a single activated facet of an exemplary light-directing optical element (LOE) of the optical system of FIG. 1, according to one embodiment. [Figure 9] 2 is a schematic diagram illustrating the difference between the facet-separated FOV and the conjugate FOV of an example LOE of the optical system of FIG. 1 in accordance with one embodiment. [Figure 10A] 1 is a schematic diagram of an exemplary optical system having an additional LOE for two-dimensional (2D) unfolding, according to one embodiment. [Figure 10B] 10B is a schematic diagram of an exemplary image projection assembly of the optical system of FIG. 10A according to one embodiment. [Figure 11A] FIG. 10B is a schematic diagram of the optical system of FIG. 10A including a mixer, according to one embodiment. [Figure 11B] 11B is a schematic diagram of the exemplary image projection assembly of FIG. 10B including the mixer of FIG. 11A according to one embodiment. [Figure 12] FIG. 1 is a schematic diagram of an exemplary LOE showing an external light source creating a ghost image on the eye, according to one embodiment. [Figure 13] 2 is a schematic diagram of the LOE of FIG. 1 that suppresses light from external sources from creating ghost images on the eye, according to one embodiment. [Figure 14] 2 is a schematic diagram of the LOE of FIG. 1 that suppresses light from external sources from creating ghost images on the eye in accordance with another embodiment. [Figure 15] 1 is a schematic diagram of an exemplary LOE illustrating that light rays propagating within the LOE produce ghost images due to reflections off semi-reflective facets, in accordance with one embodiment. [Figure 16A] FIG. 2 is a schematic diagram of an exemplary optical system having an additional LOE for 2D unfolding, according to one embodiment. [Figure 16B] FIG. 16B is a schematic diagram of an exemplary image projection assembly of the optical system of FIG. 16A having facets with selectively activatable segments, according to one embodiment. [Figure 16C] 16B is a schematic diagram of an exemplary image generator of the optical system of FIG. 16A having a selectively activatable display region, according to one embodiment. [Figure 17] FIG. 2 is a flow diagram of an exemplary process, according to one embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0008] In optical systems, such as near-eye display systems, light is output from the display system to a target surface, such as a user's eye, that is in close proximity to the display system. Often, such optical systems illuminate the entire eye or the entire pupil of the eye when projecting an image. In some cases, such comprehensive illumination of the eye or pupil can be costly in terms of power efficiency of the near-eye display system, resulting in reduced battery life or increased power consumption.

[0009] In some cases, an external light source can cause the optical system to present a ghost image to the eye. For example, light rays from an external light source can enter the optical system, be directed onto the eye, and simultaneously be generated by the optical system as a target image. Such ghost images can distract the user, cause glare, or adversely affect the quality of the target image projected to the eye.

[0010] An exemplary optical system 100 will be described with reference to Figures 1A, 1B, 2A, 2B, 3A, 3B, 4A, 4B, and 5. The optical system 100 includes an image projection assembly 110 and a controller 140. In some embodiments, the optical system 100 may also include one or more of an eye tracking system 600 and a light source detection system 602.

[0011] The controller 140 comprises a computing device having one or more processing units, memory, or other components. For example, the controller 140 may comprise a central processing unit (CPU), a field programmable gate array (FPGA), a microcontroller, a dedicated circuit, or any other components. As described in more detail below, the controller 140 is configured to control a projection optical device (POD) to generate and output an image to a light directing optical element (LOE) for projection to the eye.

[0012] In some embodiments, controller 140 may be integrated into image projection assembly 110 or into a device that includes image projection assembly 110, such as glasses, a head mounted display, or another device. In some embodiments, controller 140 may be located remotely from image projection assembly 110. For example, image projection assembly 110 may include a wired or wireless communication device configured to communicate with controller 140. As an example, controller 140 may be included as part of a mobile device, or a computing device separate from image projection assembly 110, or a device that includes image projection assembly 110.

[0013] Eye tracking system 600 is optional and configured to track the position of the pupil of user's eye 180 and provide corresponding position information to controller 140. In some embodiments, eye tracking system 600 may include a camera or other device that may be configured to track the position of the pupil, for example, or that may generate information that can be utilized to determine the position of the pupil.

[0014] The light source detection system 602 is optional and configured to detect light sources, such as the sun, street lights, headlights, or other light sources that may affect the optical system 100, and provide corresponding information, such as the direction of the light source, the intensity of the light source, or any other information regarding the light source, to the controller 140. By way of example, the light source detection system 602 may comprise a camera, an infrared detector, or any other device configured to detect light sources external to the optical system 100 or to generate information that may be utilized by the controller 140 to identify and determine characteristics of the light source, such as the direction, intensity, or any other information regarding the light source.

[0015] The image projection assembly 110 includes a projection optical device (POD) 112 and a light directing optical element (LOE) 114 and is configured to project an image onto a user's eye 180 using one-dimensional (1D) or two-dimensional (2D) pupil dilation.

[0016] The POD 112 comprises an image generator 200, collimating optics 300, or other components, such as, for example, a spatial light modulator (SLM), that may be included in an image projection assembly. In some embodiments, some or all of these components may be arranged on the surface of one or more polarizing beam splitter (PBS) cubes or other prism arrangements. The image generator 200 comprises one or more components that provide illumination, such as a light beam, laser beam, or other form of illumination, corresponding to the image projected onto the user's eye 180. For example, the image generator 200 may comprise a light emitting diode (LED), an organic light emitting diode (OLED) display element, a backlit liquid crystal display (LCD) panel, a micro LED display, a digital light processing (DLP) chip, a liquid crystal on silicon (LCOS) chip, or other components.

[0017] If POD 112 includes an SLM (not shown), the SLM may be implemented as an emissive SLM, including components such as an OLED display element, a backlit LCD panel, a micro LED display, a DLP chip, or another emissive component, or as a reflective SLM, including components such as an LCOS chip. A beam splitter cube block may be interposed between the collimating optics and the SLM to enable delivery of illumination to the surface of the SLM. The SLM may be configured to modulate the projected intensity of each pixel of illumination to generate an image. For example, the SLM may provide a beam of light that diverges from each display pixel in the plane of LOE 114, e.g., in the planes of main LOE surfaces 116 and 118 described below.

[0018] Alternatively, the POD 112 may include a scanning device, such as a high-speed scanning mirror, that scans illumination from a light source across the image plane of the POD 112 while varying the intensity of the illumination synchronously with the pixel-by-pixel motion to project the desired intensity for each pixel.

[0019] The POD 112 also comprises a coupling-in arrangement, e.g., a coupling-in reflector, an angled coupling prism, or any other coupling-in arrangement, for injecting illumination for the image into the LOE 114. In some embodiments, the coupling between the POD 112 and the LOE 114 may include direct coupling, e.g., the POD 112 may contact a portion of the LOE 114, or may include coupling via an additional aperture enlargement arrangement to enlarge the size of the aperture through which the image is injected into the plane of the LOE 114.

[0020] LOE 114 comprises a waveguide including parallel first and second main LOE surfaces 116 and 118 that are not optically active, and edges, as shown, for example, in FIGS. 1A-4B. LOE 114 also comprises a coupling-out array 120 configured to direct illumination from LOE 114 onto a user's eye 180 for projection. In some embodiments, coupling-out array 120 is illustrated as a plurality of parallel surfaces, referred to herein as facets 1221, 1222, 1223, and 1224, arranged within LOE 114 at oblique angles relative to the main LOE surfaces 116 and 118 of LOE 114. Facets 1221, 1222, 1223, and 1224 may be referred to herein collectively or individually as facets 122. In one illustrative embodiment, four facets 1221, 1222, 1223, and 1224 are illustrated in Figures 1A-4B, although in other embodiments, LOE 114 may alternatively include a greater number of facets 122 or a lesser number of facets 122.

[0021] Each facet 122 is selectively activatable between a state in which the facet 122 has a high transmittance of light and a state in which the facet 122 has a high reflectance of light. As an example, in some embodiments, the facet 1221 may be activated to have 100% reflectance and 0% transmittance, and may be deactivated to have 0% reflectance and 100% transmittance. In some embodiments, the amount of reflectance and transmittance may be adjustable for each facet 122, so that, for example, the facet 1221 may be adjusted to have partial reflectance and partial transmittance, such as 25% reflectance and 75% transmittance, 50% reflectance and 50% transmittance, 75% reflectance and 25% transmittance, or any other amount of reflectance and transmittance. As an example, the controller 140 may be configured to selectively activate each facet 122 to adjust its reflectance and transmittance. In some embodiments, the controller 140 may be configured to activate each facet 122 to adjust its reflectance and transmittance for light rays at particular angles or ranges of angles, e.g., high transmittance for light rays at some angles or ranges of angles, and high reflectance for light rays at other angles or ranges of angles.

[0022] Image generator 200 comprises display areas 2021, 2022, 2023, and 2024 that are selectively activatable by controller 140 to generate corresponding light rays L1, L2, L3, and L4 that enter LOE 114 and reflect off primary LOE surfaces 116 and 118 at different angles. Display areas 2021, 2022, 2023, and 2024 may be referred to herein, individually and collectively, as display areas 202. Light rays L1, L2, L3, and L4 may also be referred to herein, individually or collectively, as light rays L. Although four display areas 202 and corresponding light rays L are shown in the exemplary image generator 200 of FIGS. 1B, 2B, 3B, and 4B, in other embodiments, image generator 200 may include a greater or lesser number of display areas 202 and corresponding light rays L. Each display area 202 comprises one or more pixels or other display elements that can be selectively activated by controller 140. In some embodiments, for example, each display area 202 comprises a single pixel. In other embodiments, each display area 202 may comprise a group of pixels, a horizontal line of pixels, a vertical line of pixels, or any other group of pixels.

[0023] 1A-4B , for example, light ray L travels through LOE 114 toward facet 122 by reflecting off primary LOE surfaces 116 and 118. For example, primary LOE surfaces 116 and 118 can provide total internal reflection (TIR) ​​for any light ray L traveling through LOE 114. Light ray L travels through any active facet 122 due to, for example, the high transmittance of active facet 122. When light ray L encounters active facet 122, light ray L is redirected by active facet 122 from LOE 114 toward, for example, eye 180 due to the high reflectance of active facet 122.

[0024] 1A illustrates a first exemplary scenario in which viewing area 2021 and facet 1221 are active and light ray L1 generated by viewing area 2021 travels through LOE 114. In this scenario, viewing areas 2022, 2023, and 2024 and facets 1222, 1223, and 1224 are inactive. Light ray L1 reflects off primary LOE surfaces 116 and 118 and passes through inactive facets 1224, 1223, and 1222, in that order, before reflecting off active facet 1221 and being redirected toward eye 180.

[0025] 2A illustrates a second exemplary scenario in which viewing area 2022 and facet 1222 are active and light ray L2 generated by viewing area 2022 travels through LOE 114. In this scenario, viewing areas 2021, 2023, and 2024 and facets 1221, 1223, and 1224 are inactive. Light ray L2 reflects off primary LOE surfaces 116 and 118 and passes through inactive facets 1224 and 1223, before reflecting off active facet 1222 and being redirected toward eye 180. In this scenario, light ray L2 does not reach facet 1221 because facet 1222 is active and fully reflective, e.g., 100% reflective. In some embodiments, facet 1222 may not be fully reflective even when it is active. In such a case, light ray L2 may reach facet 1221 but is not reflected, since facet 1221 is inactive.

[0026] 3A illustrates a third exemplary scenario in which viewing area 2023 and facet 1223 are active and light ray L3 generated by viewing area 2023 travels through LOE 114. In this scenario, viewing areas 2021, 2022, and 2024 and facets 1221, 1222, and 1224 are inactive. Light ray L3 reflects off main LOE surfaces 116 and 118 and passes through inactive facet 1224 before reflecting off active facet 1223 and being redirected toward eye 180. In this scenario, light beam L3 does not reach facets 1221 and 1222 because facet 1223 is active and fully reflective, e.g., 100% reflective. In some embodiments, facet 1223 may not be fully reflective even when it is active. In such a case, since facets 1221 and 1222 are inactive, light ray L3 may reach one or more of facets 1221 and 1222 but is not reflected.

[0027] 4A illustrates a fourth exemplary scenario in which viewing area 2024 and facet 1224 are active and light ray L4 generated by viewing area 2024 travels through LOE 114. In this scenario, viewing areas 2021, 2022, and 2023 and facets 1221, 1222, and 1223 are inactive. Light ray L4 reflects off active facet 1224 and reflects off primary LOE surfaces 116 and 118 before being redirected toward eye 180. In this scenario, light beam L4 does not reach facets 1221, 1222, and 1223 because facet 1224 is active and is fully reflective, e.g., 100% reflective. In some embodiments, facet 1224 may not be fully reflective even when it is active. In such a case, since facets 1221, 1222, and 1223 are inactive, light ray L4 may reach one or more of facets 1221, 1222, and 1223 but is not reflected.

[0028] 1A-4B, in each figure, a different combination of display regions 202 and facets 122 are active while the generated light rays L1, L2, L3, and L4 are respectively directed towards the eye 180, but at different angles. For example, the relative position of each facet 122 and the pupil of the eye 180 defines what portion of the image field of view (FOV) that can be projected by the facet 122 is directed by each display region 202 to the pupil of the eye 180. In some embodiments, to optimize the energy efficiency of the optical system 100, only a portion of the image FOV that can be projected by each facet 122 is generated by the corresponding display region 202. For example, for a particular portion of the image FOV, the controller 140 may activate only the display region 202 and the corresponding facet 122 that directs that portion of the image FOV to the position of the pupil of the eye 180.

[0029] Referring to FIG. 5, in some embodiments, combinations of display regions 202 and facets 122 may be selectively and sequentially activated to project different portions of the image FOV onto the eye 180 for each frame of the same image.

[0030] As an example, facet 1221 and display region 2021 may be activated at time T1 to direct a first portion of the image FOV of the first frame onto eye 180, facet 1222 and display region 2022 may be activated at time T2 to direct a second portion of the image FOV of the first frame onto eye 180, facet 1223 and display region 2023 may be activated at time T3 to direct a third portion of the image FOV of the first frame onto eye 180, and facet 1224 and display region 2024 may be activated at time T4 to direct a fourth portion of the image FOV of the first frame onto eye 180. , facet 1221 and display region 2021 may be activated at time T5 to direct a first portion of the image FOV of the second frame onto eye 180, facet 1222 and display region 2022 may be activated at time T6 to direct a second portion of the image FOV of the second frame onto eye 180, facet 1223 and display region 2023 may be activated at time T7 to direct a third portion of the image FOV of the second frame onto eye 180, facet 1222 and display region 2022 may be activated at time T8 to direct a fourth portion of the image FOV of the second frame onto eye 180, and so on.

[0031] As described above, portions of the image FOV of a first frame of images may be generated and directed onto eye 180 successively between times T1-T4, while portions of the image FOV of a second frame of images may be generated and directed onto eye 180 between times T5-T8. Times T1-T8 may include any unit of time configured to provide a target frame rate for projecting the frames of images onto eye 180. For example, times T1-T8 may be in milliseconds (ms) or any other unit of measurement.

[0032] Because only one active facet 122 and one corresponding display area 202 are utilized at a time to project a portion of the image FOV onto the eye 180, with the active facet 122 being fully reflective and all other facets 122 being fully transmissive, potentially 100% or nearly 100% of the light rays generated by the image generator 200 are reflected by the active facet 122 to the LOE 114 toward the eye 180, thereby improving the energy efficiency of the POD 112 over optical systems with static semi-reflective facets.

[0033] For example, some LOEs include semi-reflective facets that are configured to direct light rays from the LOE that propagate through the LOE at different angles. In these LOEs, only certain angles of light rays are reflected by each facet, while other angles are allowed to pass through the facet. Because of this effect, a portion of the light provided by the POD to the LOE may be reflected by more than one facet, even if that portion of light is directed toward the user's eye, resulting in wasted power and inefficiency of the POD.

[0034] Additionally, the use of selectively activatable facets 122 and display area 202 allows optical system 100 to provide a larger available image FOV per facet 122 compared to an optical system having a LOE with static semi-reflective facets. For example, each static semi-reflective facet may only be capable of providing light rays to the eye that correspond to a particular image FOV depending on the angle at which the light rays are reflected. Because facets 122 can redirect light from more angles, facets 122 may be fully reflective when activated, allowing a larger available image FOV.

[0035] In some embodiments, facets 122 may be activated by controller 140 in a semi-reflective state, similar to the static semi-reflective facets described above, in which certain angles of light rays are reflected by each facet 122, while other angles are allowed to pass through each facet 122, such that a portion of light provided by POD 200 to LOE 114 may be reflected by more than one facet, even if such portion of light is not directed toward the user's eye. For example, in some embodiments, facets 122 may be activated by controller 140 to mimic the functionality of the static semi-reflective facets described above.

[0036] 6A and 6B, in some embodiments, the controller 140 may utilize position information received from the eye tracking system 600 to determine the position of the pupil 182 of the eye 180 and activate a corresponding combination of display regions 202 and facets 122 to project a portion of the image FOV toward a portion 184 of an eye motion box (EMB) that corresponds to the determined position of the pupil 182 of the eye 180. For example, FIGS. 6A and 6B illustrate the relationship between the portion of the image FOV projected toward the eye 180 by the active facets 1222 and a corresponding display region 2022 of the image generator 200 that generates the portion of the image FOV projected through this portion 184 of the EMB.

[0037] Light rays 204 and 206 connect the edge of facet 1222 and pupil 182 of eye 180. Eye tracking system 600 generates position information corresponding to the position of pupil 182 relative to LOE 114 and provides the position information to controller 140. Controller 140 uses the position information to determine the angle and direction that light rays 204 and 206 need to travel relative to LOE 114 so as to be projected onto a portion 184 of the EMB that corresponds to the position of pupil 182. For example, controller 140 can be configured to determine angles 208 and 210 at which light rays 204 and 206 need to be reflected off facet 1222 relative to primary LOE surface 116 of LOE 114. Angle 212 between light rays 204 and 206 defines the expansion of the image FOV projected by facet 1222 into pupil 182. Angles 208 and 210 of rays 204 and 206 relative to primary LOE surface 116 can be converted to corresponding angles of rays 204 and 206 relative to projector optical axis 214 at the exit of POD 112 using, for example, geometric optics methods, such as the geometric methods of light reflection and refraction. As shown in FIG. 6A, with respect to projector optical axis 214, angle 208 corresponds to angle 216 and angle 210 corresponds to angle 218 at the exit of POD 112. For example, in a system where the center direction of the image FOV is perpendicular to primary LOE surface 116 when emitted toward the EMB or eye pupil and the center direction of the image FOV coincides with the optical axis of POD 112, angle 216 is equal to 90 degrees minus angle 208, and angle 218 is equal to 90 degrees minus angle 210.

[0038] Then, the distortion method can be applied to determine the coordinates X1 and X2 of the activated display area 2022 via the focal length of the collimating optical system 300, angle α, i.e., angle 218, and angle β, i.e., angle 216, according to the following equations (1) and (2): X1 = f × tan(α) (1) X2=f×tan(β) (2)

[0039] In this manner, energy usage by the image projection assembly 110 may be optimized and the energy efficiency of the optical system 100 may be increased, since energy is used to illuminate only the location of the pupil 182 .

[0040] 7A and 7B, in some embodiments, position information regarding the pupil 182 may not be available for use by the controller 140, for example if the eye tracking system 600 is not present or active. In this embodiment, the actual location of the pupil 182 is not known to the controller 140. In such a case, instead of using a portion 184 of the EMB that corresponds to the actual location of the pupil 182, a larger portion 186 of the EMB is used in the calculation. In some embodiments, the portion 186 corresponds to the entire EMB in which the pupil 182 may be located during operation of the optical system 100, while the portion 184 corresponds to only a portion of the EMB. By using the portion 186 instead of the portion 184 as a target, the controller 140 may determine the angle corresponding to the required light ray and activate the corresponding facet 122 and the display area 202 accordingly, in a manner similar to that described above for FIGS. 6A and 6B.

[0041] In some embodiments, the controller 140 may determine that multiple display regions 202 need to be activated to project a portion of the image FOV toward the portion 186 of the EMB. In such a case, the controller 140 may be configured to selectively activate each of the determined display regions 202 to activate a combined display region 220, for example as shown in FIG. 7B, or in some embodiments, to selectively activate only selected pixels of each of the display regions 202 that are necessary to illuminate the portion 186 of the EMB. For example, the display region 220 includes a portion of the display region 2021 and a portion of the display region 2022. In some embodiments, activation of the combined display region 220 may be utilized by the embodiments of FIGS. 6A and 6B even when the eye tracking system 600 is present. For example, in some embodiments, the determined position of the pupil 182 may require activation of a portion of the multiple display regions 202 by the controller 140.

[0042] In some embodiments, the controller 140 may determine that it is necessary to sequentially activate multiple facets 122 for each display region 202 to provide a corresponding image FOV to each possible location of the pupil 182 within the EMB 186. For example, a particular display region 202 may be activated by the controller 140 to provide a particular image FOV or a portion of a particular image FOV to the eye 180. For a particular display region 202 that is activated, each facet 122 is configured to direct the image FOV to a different location when activated. If there is uncertainty regarding the location of the pupil 182, at least some of the facets 122 may be sequentially activated to ensure that the corresponding image FOV is directed to a subset of the positions of the pupil 182 of the EMB 186.

[0043] In some cases, only some of the facets 122 may be configured to direct light from a particular viewing region 202 onto the EMB 186, while other facets 122 may be configured to direct light from the particular viewing region 202 outside of the EMB 186, for example depending on the angle of the light of the LOE 114. In some embodiments, only a group of facets 122 configured to direct light from a particular viewing region 202 onto the EMB 186 may be activated in succession to direct an image FOV from the particular viewing region 202 onto each portion of the EMB 186 where the pupil 182 may be located, while other facets 122 that do not direct an image FOV onto the EMB 186 for the particular viewing region 202 may not be activated. In some embodiments, for example, because each display area 202 provides light to the LOE 114 and facets 122 at a different angle, it may be necessary to sequentially activate a different group of facets 122 for each display area 202 to direct a corresponding image FOV onto each portion of the EMB 186.

[0044] 8, in an illustrative embodiment, the available image FOV that can be projected toward eye 180 for active facets 122 of LOE 114 can be significantly larger than the image FOV that can be projected by static semi-reflective facets as described above, because active facets 122 are fully reflective. This is because, because the light rays are fully transmissive, all light generated by active display area 202, regardless of the angle of the light rays, is reflected by only one active facet 122 and passes through any inactive facets 122. The available image FOV of active facets 122 is limited only by the total internal reflection of primary LOE surfaces 116 and 118 of LOE 114, rather than being able to reflect light at certain angles as is the case with the semi-reflective facets described above.

[0045] For example, as seen in Figure 8, light rays L5 and L6 are generated by corresponding display regions of image generator 200 (Figure 1A) and are reflected by primary LOE surfaces 116 and 118 of LOE 114 until the light rays reach active facet 122. In this example, light ray L5 reflects off primary LOE surface 116 at angle 124 perpendicular to the normal to primary LOE surface 116, while light ray L6 reflects off primary LOE surface 116 at angle 126 relative to the normal to primary LOE surface 116. Light ray L5 is shown reflecting off active facet 122 at a shallow angle, while light ray L6 is shown reflecting off active facet 122 at a steep angle. In one embodiment, angle 124 is the maximum propagation angle of LOE 114, while angle 126 is the critical angle for total internal reflection of LOE 114. For example, angle 124 may be configured as 90 degrees, 85 degrees, or any other value. In some embodiments, maximum usable angle 124 may be based on the manner in which light rays are injected into LOE 114. Angle 124 and angle 126 together define the maximum usable image FOV that can be provided by an individual facet 122.

[0046] The exemplary angles 124 and 126 illustrate the available image FOV that allows the entire active facets 122 to be fully utilized and utilized to project the image FOV anywhere within the EMB onto eye 180. For example, for any eye 180 position, a corresponding display region 202 configured to generate light rays that reflect within LOE 114 at an angle corresponding to the position of eye 180 as the light rays pass through primary LOE surface 116, reflect off active facets 122, and are refracted by primary LOE surface 116, may be selectively activated to present the image FOV to eye 180.

[0047] Because the available image FOV per selectively activatable facet 122 is larger than with static semi-reflective facets, in some embodiments a fewer number of facets 122 may be utilized to provide the same range of image FOV which also increases the efficiency of the optical system 100.

[0048] 9 illustrates an exemplary FOV 136 propagating within LOE 114 and conjugate FOV 130. FOV 136 reflects into conjugate FOV 130 as a result of total internal reflection off of primary LOE surfaces 116 and 118 of LOE 114. As can be seen in FIG 9, active facet 122 divides conjugate FOV 130 into two portions, FOV 132 and FOV 134.

[0049] In the LOE with static semi-reflective facets mentioned above, the semi-reflective facets cannot split the conjugate FOV propagating within the LOE without affecting the resulting image. For example, semi-reflective coatings often have very high reflectivity at large angles of incidence. Due to this very high reflectivity, a portion of the conjugate FOV 130 propagating at angles close to the angle of the semi-reflective facets is reflected by the semi-reflective facets and contributes to a ghost image. To reduce the presence of such ghost images, an optical system with a LOE with semi-reflective facets may provide images either within the FOV 134 at shallow angles, for example, or within the FOV 132 at angles large enough that they are not reflected by the semi-reflective coating, for example, but not within the full conjugate FOV 130 below an angle close to the angle of the facets.

[0050] In an illustrative embodiment, the facets 122 can be deactivated to transmit even high angles of incidence such that their conjugate FOV 130 propagates through the facets without producing ghost images. This results in the ability to utilize the conjugate FOV 130 to generate a larger image FOV for the active facets 122 shown in FIG. 8 compared to the FOV of a LOE with semi-reflective facets. In one exemplary scenario, the LOE 114 can be configured with a refractive index of 1.8 and a critical angle of 33.7 degrees. The FOV propagating within the LOE 114 can be configured with approximately 51.3 degrees, and the FOV output by the active facets 122 of the LOE 114 in this exemplary scenario can be configured with an FOV of approximately 93 degrees.

[0051] 10A and 10B, an exemplary optical system 400 according to another embodiment will be described. As illustrated in FIG. 10A and 10B, like elements have like reference numbers as optical system 100 of FIG. 1A-4B. For example, optical system 400 comprises an image projection assembly 410 comprising a POD 412 and a LOE 414, a controller 440, and other components similar to those described above for optical system 100. LOE 414 comprises main LOE surfaces 416 and 418, and a coupling-out array 420 comprising facets 4221, 4222, 4223, and 4224. In the embodiment of FIG. 10A and 10B, image projection assembly 410 further comprises a LOE 500 disposed between POD 412 and LOE 414.

[0052] LOE 500 comprises a coupling-out arrangement 502 comprising facets 5041, 5042, 5043, 5044, 5045, 5046, and 5047, which may be referred to herein collectively and individually as facets 504. Although illustrated in example optical system 400 of Figures 10A and 10B as comprising seven facets 504, in other embodiments LOE 500 may alternatively comprise a greater or lesser number of facets 504.

[0053] LOE 500 and facet 504 are used for 2D expansion of the LOE exit pupil. In some embodiments, facet 504 may comprise a static semi-reflective facet including a dielectric coating, such as the semi-reflective facets mentioned above. In other embodiments, facet 504 may alternatively comprise a selectively activatable facet similar to facet 122 of FIGS. 1A-4B and may be selectively activatable by controller 440 in a manner similar to that described above with reference to facet 122 to, for example, an inactive state having 100% transmission and 0% reflectance, an active state having 0% transmission and 100% reflectance, or another state having partial transmission and partial reflectance.

[0054] 11A and 11B, another embodiment of optical system 400 is described. In the embodiment of FIG. 11A and 11B, image projection assembly 410 further includes a mixer 506 comprising a semi-reflective surface on the inside of LOE 414 that is parallel to main LOE surfaces 416 and 418. Mixer 506 splits the light beam of LOE 414 as shown by the solid and dashed arrows in FIG. 11A. The split by mixer 506 allows image projection assembly 410 to completely fill the aperture of LOE 414.

[0055] 12, in an exemplary comparison scenario, one or more external light sources 700 and 702 may generate a light ray that enters LOE 714. LOE 714 in this scenario comprises static semi-reflective facets 7221, 7222, 7223, and 7224. As shown in FIG. 12, when a light ray 724 from external light source 700 enters LOE 714, the light ray is split at facet 7224 into a first portion 726 that passes through facet 7224 and exits LOE 714, and a second portion 728 that reflects off facet 7224 and propagates through LOE 714. As can be seen in FIG. 12, first portion 726 does not affect eye 180, while second portion 728 is directed from LOE 714 towards eye 180 by facet 7222. The propagation and direction of second portion 728 of light ray 724 by LOE 714 onto eye 180 in this scenario may result in a ghost image being projected onto eye 180. It is important to note that in most cases, ghost images are due to external sources of light from reflections of light rays off of multiple facets of the LOE; reflections from a single facet do not, in and of themselves, direct light rays from the LOE towards the user's eye.

[0056] 13, LOE 114 is illustrated in another exemplary scenario. In this embodiment, facet 1224 is inactive, so light ray 724 is not split by facet 1224, but instead passes through LOE 114 without affecting eye 180. In addition, active facet 122, in this exemplary scenario facet 1222, is perfectly reflective, so light ray 730 generated by external light source 702 reflects into LOE 114, but is not split by facet 1222 and is not directed towards eye 180. Because facet 1222 is the only active facet, no ghost images are generated by light rays 724 and 730.

[0057] 14, in another example scenario, a parallel ray of light 730 is generated by an external light source 702, with each of rays 732, 734, and 738 entering a different portion of LOE 114 at the same angle. Ray 730 undergoes Fresnel reflection on main LOE surface 116 of LOE 114, for example, because of the angle at which the ray propagates within LOE 114. For example, because of the angle at which ray 730 enters LOE 114, the ray does not pass through main LOE surface 116 in the same manner as ray 724 did in the example scenario of FIG. 13. In such a case, having only a single active facet 1222 may still result in a ghost image that is directed toward pupil 182 of eye 180, as shown, for example, by ray 734. However, if either facet 1221 or 1223 is active, the corresponding light rays 732 and 736 are not directed towards the pupil 182 of the eye 180 and no ghost images are produced.

[0058] The position of the external light source 700 may be determined by the controller 140 using the light source detection system 602 (FIG. 1A), while the position of the pupil 182 may be determined by the controller 140 using the eye tracking system 600 (FIG. 1A). Based on the known positions of the external light source 700 and the pupil 182, the controller 140 is configured to determine which facets 122 may project ghost images onto the pupil 182. In some embodiments, the controller 140 may be configured to skip activation of facets 122 that contribute to ghost images due to the external light source 700 when generating an image. In some embodiments, the controller 140 may be configured to adjust the reflectance of facets 122 that contribute to ghost images due to the external light source 700, for example, the facets 122 may be set to less than 100% reflectance to attenuate ghost images at the expense of having a smaller number of available FOVs to project the generated image onto the pupil 182.

[0059] 15, in an exemplary comparative scenario, LOE 814 receives light ray 824 from a POD (not shown). In this exemplary comparative scenario, LOE 804 comprises static semi-reflective facets 8221, 8222, 8223, and 8224. As light ray 824 propagates through LOE 814, it may be split by one or more facets 822 into multiple portions having different propagation angles. For example, as shown in FIG. 15, light ray 824 is split by semi-reflective facet 8224 into a first portion 826, e.g., a projected image, that travels along the same propagation path as light ray 824, and a second portion 828, e.g., a ghost ray, that has a changed propagation path and angle. In some cases, split portions 826 and 828 of light ray 824 may give rise to a ghost image that is projected onto eye 180 by one or more of facets 822. For example, as seen in FIG. 15 , second portion 828 is partially reflected by facet 8223 onto eye 180, while first portion 826 is partially reflected by facet 8222 onto eye 180, resulting in both an image from first portion 826 and a ghost image from second portion 828 being projected simultaneously onto eye 180.

[0060] The disclosed LOE 114 with selectively activatable facets 122 overcomes this problem because, in an illustrative embodiment, only the facets that direct light rays onto the eye 180 need to be active, and thus there is no opportunity for the light rays to split. Additionally, because the active facets can be set to 100% reflectivity while the inactive facets can be set to 100% transmittance, the light rays received from the POD 112 are fully reflected by the active facets 122 to the LOE 114 and are not affected by the inactive facets 122 in any significant way that would cause ghost images.

[0061] 16A-16C, an exemplary embodiment of optical system 400 is illustrated. In the embodiment of FIGS. 16A-16C, image projection assembly 410 further includes LOE 900 disposed between POD 412 and LOE 414.

[0062] LOE 900 comprises a coupling-out arrangement 902 comprising facets 9041, 9042, 9043, 9044, 9045, 9046, and 9047, which may be referred to herein collectively and individually as facets 904. Although illustrated in example optical system 400 of Figures 16A-16C as comprising seven facets 904, in other embodiments LOE 900 may alternatively comprise a greater or lesser number of facets 904.

[0063] LOE 900 and facet 904 are used for 2D expansion of the LOE exit pupil. In the embodiment of Figures 16A-16C, facet 904 may comprise a selectively activatable facet that is similar to facet 122 of Figures 1A-4B and may be selectively activatable by controller 440 in a manner similar to that described above with reference to facet 122, for example, to an inactive state having 100% transmission and 0% reflectance, an active state having 0% transmission and 100% reflectance, or another state having partial transmission and partial reflectance. In addition, in the embodiment of Figures 16A-16C, facet 904 further comprises selectively activatable segments 908, such as the active segments of facet 9043 shown by solid lines, that may be separately activated or deactivated by controller 440 without activating the entire facet 904. In some embodiments, facet 422 of LOE 414 may also include selectively activatable segments 910, such as the active segment of facet 4223 shown by the solid line, that may be separately activated or deactivated by controller 440 without activating the entire facet 422.

[0064] 16C, the POD 412 includes an image generator 1000 that includes display areas 1002 arranged in a grid. In some embodiments, each display area 1002 may correspond to a pixel of the image generator 1000. In other embodiments, each display area 1002 may correspond to a group of pixels of the image generator 1000. Each display area 1002 is selectively activatable by the controller 440 to project an image onto the LOE 900 via the exit aperture 906. For example, in some embodiments, one or more display areas 1002 may be activated to project an image of a particular FOV.

[0065] As can be seen in FIG. 16B, for a single active facet 904 and segment 908 in LOE 900, and a single active facet 422 and segment 910 in LOE 414, the FOV projected along the X-axis toward eye 180 is defined by the position of the pupil 182 in the optical system involving eye tracking system 600 (FIG. 1A) and the exit aperture 906 of POD 412.

[0066] By knowing the position of the pupil 182, the angle required to direct the light rays toward the position of the pupil 182 may be calculated by the controller 440 in a manner similar to that described above for Figures 6A and 6B. The calculated angle defines the viewing region 1002, facet 904, segment 908, facet 422, and segment 910 that need to be activated to direct the light rays from the exit aperture 906 toward the portion 912 of the EMB that corresponds to the determined position of the pupil 182. In this embodiment, additional calculations may be required due to the addition of the LOE 900 as compared to the calculations performed by the controller 440 for the embodiment of Figures 6A and 6B. For example, using or extending the distortion methods mentioned above in equations (1) and (2), the angles for each ray of the EMB from the display region 1002 to the exit aperture 906, from the exit aperture 906 to segment 908, from segment 908 to segment 910, and from segment 910 to portion 912 can be calculated.

[0067] In an optical system that does not have an eye tracking system 600, a larger portion 186 of the EMB (FIG. 7A) can be used to calculate the angle and direction of the light rays in a manner similar to that described above with reference to FIGS. 7A and 7B.

[0068] An exemplary process for operating optical system 100 with controls for selectively activatable facets 122 and selectively activatable display area 202 will now be described with reference to Figure 17. This process may be performed at least in part by controller 140, eye tracking system 600, POD 112, and LOE 114, or may be performed at least in part by any other portion of optical system 100.

[0069] The process of Figure 17 includes steps 1100-1106. Although the process of Figure 17 is described herein as having particular steps or a particular order of steps, in other embodiments, the process may alternatively perform steps in any order, may include additional steps, may include fewer steps, or may perform only a portion of the steps described below.

[0070] At step 1100, controller 140 determines a target portion of the EMB. For example, in some embodiments, controller 140 may determine the target portion as portion 184 of the EMB using position information obtained from eye tracking system 600 as described above with reference to Figures 6A and 6B. In some embodiments, for example, where eye tracking system 600 is not included or is unavailable, controller 140 may determine the target portion as portion 186 of the EMB as described above with reference to Figures 7A and 7B.

[0071] In steps 1102 and 1104, controller 140 identifies facets 122 of LOE 114 and display areas 202 of image generator 200 that are configured to direct a light beam that includes at least a portion of the image field of view toward a target portion of the EMB. For example, facets 122 and corresponding display areas 202 may be identified by controller 140 as described in the embodiments above. Although steps 1102 and 1104 are illustrated as occurring in a particular order, any other order may be used. Additionally, in some embodiments, steps 1102 and 1104 may comprise a single step.

[0072] At step 1106, the controller 140 selectively activates the identified facets 122 and the identified display areas 202 to direct a light beam toward a target portion of the eye motion box, for example as shown in Figures 1A-4B or other embodiments described above.

[0073] The terms used herein are for the purpose of describing particular embodiments only and are not intended to be limiting of the present invention. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and / or "comprising", as used herein, specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0074] In the following claims, where applicable, the corresponding structures, materials, acts, and equivalents of all means-plus-function or step-plus-function elements are intended to include any structure, material, or act for performing that function in combination with other specifically claimed elements. The disclosed embodiments of the invention have been presented for purposes of illustration and description, but are not intended to be exhaustive or to limit the invention to the disclosed form. Many modifications and variations will become apparent to those skilled in the art without departing from the scope and spirit of the invention. The present embodiments have been chosen and described in order to best explain the principles and practical application of the invention and to enable others skilled in the art to understand the invention in various embodiments with various modifications as suited to the particular use contemplated.

Claims

1. An apparatus comprising: At least one processor, controlling a light-directing optical element comprising a plurality of facets, each of the plurality of facets selectively activatable between at least a first state having a first level of reflectivity and a second state having a second level of reflectivity higher than the first level of reflectivity, the plurality of facets configured to direct a light beam corresponding to a plurality of portions of an image field towards a target portion of an eye-motion box when in the second state; controlling an image generator comprising a plurality of display areas, each of the plurality of display areas selectively activatable to inject a light beam corresponding to one of the plurality of portions of the image field into the light directing optical element at a different angle; For each image frame of the plurality of image frames, a first combination of a first one of the plurality of display areas and a first one of the plurality of facets in the second state for injecting a first light beam at a first angle to project a first portion of an image field of each of the frames of images toward the target portion of the eye motion box at a first time; and and at a second time, continuously controlling a second combination of a second display area of ​​the plurality of display areas to inject a second light beam at a second angle to project a second portion of the image field of view of each of the image frames toward the target portion of the eye motion box, and a second combination of a second facet of the plurality of facets to be in the second state.

2. The at least one processor: controlling the second combination of the second display region of the plurality of display regions to be inactivated and the second facet to be in the first state at the first time; 2. The device of claim 1, configured to control, at the second time, the first combination of the first of the plurality of display regions to be inactivated and the first facet to be in the first state.

3. The apparatus of claim 1 , wherein the first time and the second time of each image frame of the plurality of image frames are selected to provide a target frame rate for projecting the plurality of image frames.

4. 2. The device of claim 1, wherein in the first state, controlled facets of the plurality of facets are fully transmissive and in the second state, the controlled facets of the plurality of facets are fully reflective.

5. 1. A method comprising: controlling a light-directing optical element comprising a plurality of facets, each of the plurality of facets selectively activatable between at least a first state having a first level of reflectivity and a second state having a second level of reflectivity higher than the first level of reflectivity, the plurality of facets configured to direct a light beam corresponding to a plurality of portions of an image field towards a target portion of an eye-motion box when in the second state; controlling an image generator comprising a plurality of display areas, each of the plurality of display areas being selectively activatable to inject a light beam corresponding to one of the plurality of portions of the image field into the light-directing optical element at a different angle; Controlling the light directing optical element and the image generator for each image frame of a plurality of image frames comprises: a first combination of a first one of the plurality of display areas and a first one of the plurality of facets in the second state for injecting a first light beam at a first angle to project a first portion of an image field of each of the frames of images toward the target portion of the eye motion box at a first time; and and continuously controlling, at a second time, a second combination of a second display area of ​​the plurality of display areas to inject a second light beam at a second angle to project a second portion of the image field of each of the image frames toward the target portion of the i-motion box, and a second facet of the plurality of facets to be in the second state.

6. controlling the light directing optical element and the image generator; controlling, at the first time, the second combination of the second display area of ​​the plurality of display areas to be inactivated and the second facet to be in the first state; 6. The method of claim 5, further comprising: controlling, at the second time, the first combination of the first of the plurality of display regions to be inactivated and the first facet to be in the first state.

7. The method of claim 5 , wherein the first time and the second time of each image frame of the plurality of image frames are selected to provide a target frame rate for projecting the plurality of image frames.

8. 6. The method of claim 5, wherein in the first state, a controlled facet of the plurality of facets is fully transmissive and in the second state, the controlled facet of the plurality of facets is fully reflective.

9. 1. A system comprising: a light-directing optical element comprising a plurality of facets, each of the plurality of facets selectively activatable between at least a first state having a first level of reflectivity and a second state having a second level of reflectivity higher than the first level of reflectivity, the plurality of facets configured to direct a light beam corresponding to a plurality of portions of an image field towards a target portion of an eye-motion box when in the second state; an image generator comprising a plurality of display areas, each of the plurality of display areas being selectively activatable to inject a light beam corresponding to one of the plurality of portions of the image field into the light-directing optical element at a different angle; At least one processor, for each image frame of the plurality of image frames: a first combination of a first one of the plurality of display areas and a first one of the plurality of facets in the second state for injecting a first light beam at a first angle to project a first portion of an image field of each of the frames of images toward the target portion of the eye motion box at a first time; and and at least one processor configured to continuously control, at a second time, a second combination of a second display area of ​​the plurality of display areas to inject a second light beam at a second angle to project a second portion of the image field of view of each of the image frames towards the target portion of the eye motion box and a second facet of the plurality of facets to be in the second state.

10. The at least one processor: controlling the second combination of the second display region of the plurality of display regions to be inactivated and the second facet to be in the first state at the first time; 10. The system of claim 9, configured to control, at the second time, the first combination of the first of the plurality of display regions to be inactivated and the first facet to be in the first state.

11. 10. The system of claim 9, wherein the first time and the second time of each image frame of the plurality of image frames are selected to provide a target frame rate for projecting the plurality of image frames.

12. 10. The system of claim 9, wherein in the first state, controlled facets of the plurality of facets are fully transmissive and in the second state, the controlled facets of the plurality of facets are fully reflective.

Images