Time-multiplexed display of virtual content at various depths

Abstract

To provide techniques for operating an optical system.SOLUTION: World light may be linearly polarized along a first axis. When the optical system is operating in accordance with a first state, a polarization of the world light may be rotated by 90 degrees, the world light may be linearly polarized along a second axis perpendicular to the first axis, and zero net optical power may be applied to the world light. When the optical system is operating in accordance with a second state, virtual image light may be projected onto an eyepiece of the optical system, the world light and the virtual image light may be linearly polarized along the second axis, a polarization of the virtual image light may be rotated by 90 degrees, and non-zero net optical power may be applied to the virtual image light.SELECTED DRAWING: Figure 12A

Description

[Background technology]

[0001] (CROSS REFERENCE TO RELATED APPLICATIONS) This application claims the benefit of priority to U.S. Provisional Patent Application No. 62 / 791,441, filed Jan. 11, 2019, and entitled “TIME-MULTIPLEXED DISPLAY OF VIRTUAL CONTENT AT VARIOUS DEPTHS,” the contents of which are incorporated herein in their entirety.

[0002] Modern computing and display technologies have facilitated the development of systems for so-called "virtual reality" or "augmented reality" experiences, in which digitally reproduced images or portions thereof are presented to a user in a manner that appears or may be perceived as real. Virtual reality, or "VR", scenarios typically involve the presentation of digital or virtual image information without transparency to other actual real-world visual inputs. Augmented reality, or "AR", scenarios typically involve the presentation of digital or virtual image information as an extension to the visualization of the real world around the user.

[0003] Despite the advances made in these display technologies, there remains a need in the art for improved methods, systems, and devices relating to augmented reality systems, and particularly display systems. Summary of the Invention [Means for solving the problem]

[0004] The present disclosure generally relates to techniques for improving the performance and user experience of optical systems. More specifically, embodiments of the present disclosure provide systems and methods for operating an augmented reality (AR) device that includes an adaptive lens assembly and / or shutter elements to display virtual content at various depths. Although the present disclosure is described with reference to an AR device, the present disclosure is applicable to various applications in computer vision and image display systems. A description of the present disclosure is provided below with reference to a series of examples.

[0005] Example 1 is a method of operating an optical system, comprising: receiving light associated with a world object in the optical system; linearly polarizing the light associated with the world object along a first axis by a world-side polarizer of the optical system when the optical system is operating according to a first state; rotating a polarization of the light associated with the world object by 90 degrees by a world-side switchable waveplate of the optical system; linearly polarizing the light associated with the world object along a second axis perpendicular to the first axis by a user-side polarizer of the optical system; applying zero net refractive power to the light associated with the world object by a lens assembly of the optical system; projecting light associated with a virtual image onto an eyepiece of the optical system by a projector of the optical system when the optical system is operating according to the second state; outcoupling the light associated with the virtual image towards a user-side polarizer by the eyepiece; and polarizing the light associated with the virtual image by the user-side polarizer. a user-side switchable waveplate; and a lens assembly; and wherein the optical system is operating according to a first state when the world-side switchable waveplate is electrically activated and the user-side switchable waveplate is not electrically activated, and the optical system is operating according to a second state when the user-side switchable waveplate is electrically activated and the world-side switchable waveplate is not electrically activated, and a world-side polarizer is coupled to the world-side switchable waveplate, the world-side switchable waveplate is coupled to an eyepiece at a world side of the eyepiece, the user-side polarizer is coupled to the eyepiece at a user side of the eyepiece, and the lens assembly is coupled to the user-side polarizer, and the user-side switchable waveplate is positioned between two layers of the lens assembly.

[0006] Example 2 is an optical system including a world-side polarizer configured to linearly polarize light associated with a world object along a first axis; a world-side switchable waveplate coupled to the world-side polarizer and configured to rotate a polarization of light associated with the world object by 90 degrees when the optical system is operating according to a first state; an eyepiece coupled to the world-side switchable waveplate; a projector configured to project light associated with a virtual image onto the eyepiece when the optical system is operating according to a second state; and a projector coupled to the eyepiece and configured to linearly polarize light associated with the world object along a second axis perpendicular to the first axis when the optical system is operating according to the first state. An optical system comprising: a user-side polarizer configured to linearly polarize light associated with the world object and light associated with the virtual image along a second axis when operating according to a second state; a lens assembly coupled to the user-side polarizer and configured to apply zero net refractive power to the light associated with the world object when the optical system is operating according to the first state and to apply a non-zero net refractive power to the light associated with the virtual image when the optical system is operating according to the second state; and a user-side switchable waveplate positioned between two layers of the lens assembly and configured to rotate the polarization of the light associated with the virtual image by 90 degrees when the optical system is operating according to the second state.

[0007] Example 3 is a method of operating an optical system comprising: receiving light associated with a world object in the optical system; when the optical system is operating according to a first state, linearly polarizing the light associated with the world object along a first axis by one or more world-side shutter elements of the optical system; rotating the polarization of the light associated with the world object by 90 degrees by the one or more world-side shutter elements; linearly polarizing the light associated with the world object along a second axis perpendicular to the first axis by one or more user-side shutter elements of the optical system; when the optical system is operating according to a second state, projecting light associated with a virtual image onto an eyepiece of the optical system by a projector of the optical system; linearly polarizing the light associated with the world object and the light associated with the virtual image along the second axis by the one or more user-side shutter elements; and rotating the polarization of the light associated with the virtual image by 90 degrees by the one or more user-side shutter elements.

[0008] Example 4 is a method as described in Example 3, further comprising applying zero net refractive power by a lens assembly of the optical system to light associated with the world object when the optical system is operating according to the first state.

[0009] Example 5 is a method as described in Example 3, further including a step of applying a non-zero net refractive power by a lens assembly of the optical system to light associated with the virtual image when the optical system is operating according to the second state.

[0010] Example 6 is a method as described in Example 3, further comprising, when the optical system is operating according to the second state, out-coupling light associated with the virtual image by the eyepiece toward one or more user-side shutter elements.

[0011] Example 7 is the method of example 3, wherein the one or more world-side shutter elements include a world-side polarizer and a world-side switchable waveplate.

[0012] Example 8 is the method of example 7, wherein the one or more user side shutter elements include a user side polarizer and a user side switchable waveplate.

[0013] Example 9 is the method of example 8, wherein the optical system includes a lens assembly.

[0014] Example 10 is the method of example 9, wherein the optical system is operating according to a first state when the world-side switchable waveplate is electrically activated and the user-side switchable waveplate is not electrically activated.

[0015] Example 11 is the method of example 9, wherein the optical system is operating according to a second state when the user-side switchable waveplate is electrically activated and the world-side switchable waveplate is not electrically activated.

[0016] Example 12 is the method of example 9, wherein the world polarizer is coupled to a world switchable waveplate.

[0017] Example 13 is the method of example 9, wherein the world side switchable waveplate is coupled to the eyepiece on a world side of the eyepiece.

[0018] Example 14 is the method of example 9, wherein the user side polarizer is coupled to the eyepiece on the user side of the eyepiece.

[0019] Example 15 is the method of example 9, wherein the lens assembly is coupled to a user-side polarizer.

[0020] Example 16 is the method of example 9, wherein the user-side switchable waveplate is positioned between two layers of the lens assembly.

[0021] Example 17 is an optical system comprising: one or more world-side shutter elements configured to linearly polarize light associated with a world object along a first axis and rotate the polarization of the light associated with the world object by 90 degrees when the optical system is operating according to a first state; an eyepiece coupled to the one or more world-side shutter elements; a projector configured to project light associated with a virtual image onto the eyepiece when the optical system is operating according to a second state; and one or more user-side shutter elements coupled to the eyepiece and configured to linearly polarize light associated with the world object along a second axis perpendicular to the first axis when the optical system is operating according to the first state, linearly polarize light associated with the world object and light associated with the virtual image along the second axis when the optical system is operating according to the second state, and rotate the polarization of light associated with the virtual image by 90 degrees when the optical system is operating according to the second state.

[0022] Example 18 is the optical system of example 17, further comprising a lens assembly coupled to the one or more user-side shutter elements.

[0023] Example 19 is an optical system as described in Example 18, wherein the lens assembly is configured to apply zero net refractive power to light associated with the world object when the optical system is operating according to a first state.

[0024] Example 20 is an optical system described in Example 18, wherein the lens assembly is configured to apply a non-zero net refractive power to light associated with the virtual image when the optical system is operating according to a second state.

[0025] Example 21 is an optical system described in Example 17, wherein the eyepiece lens is configured to externally couple light associated with the virtual image toward one or more user-side shutter elements when the optical system is operating according to a second state.

[0026] Example 22 is the optical system of example 17, wherein the one or more world-side shutter elements include a world-side polarizer and a world-side switchable waveplate.

[0027] Example 23 is the optical system of example 22, wherein the one or more user side shutter elements include a user side polarizer and a user side switchable waveplate.

[0028] Example 24 is the optical system of Example 23, wherein the optical system is operating according to a first state when the world-side switchable waveplate is electrically activated and the user-side switchable waveplate is not electrically activated.

[0029] Example 25 is the optical system of Example 23, wherein the optical system is operating according to a second state when the user-side switchable waveplate is electrically activated and the world-side switchable waveplate is not electrically activated.

[0030] Example 26 is the optical system of example 23, wherein the world-side polarizer is coupled to the world-side switchable waveplate.

[0031] Example 27 is the optical system of example 23, wherein the world side switchable waveplate is coupled to the eyepiece on the world side of the eyepiece.

[0032] Example 28 is the optical system of example 23, wherein the user-side polarizer is coupled to the eyepiece on the user side of the eyepiece.

[0033] Example 29 is the optical system of example 23, wherein the lens assembly is coupled to a user-side polarizer.

[0034] Example 30 is the optical system of example 23, wherein the user-side switchable waveplate is positioned between two layers of the lens assembly.

[0035] Example 31 is a display device comprising: a waveguide assembly configured to guide light in a lateral direction parallel to an output surface of the waveguide assembly, the waveguide assembly further configured to outcouple the guided light through the output surface; and an adaptive lens assembly disposed on a first side of the waveguide assembly, the adaptive lens assembly arranged to receive the outcoupled light from the waveguide assembly and to be selectively switched between a plurality of states having different refractive powers, the adaptive lens assembly comprising a lens stack configured to impart polarization-dependent refractive power to linearly polarized light, the lens stack comprising a birefringent lens and an isotropic lens in contact with each other, the contacting surfaces of the birefringent lens and the isotropic lens forming a conformal interface.

[0036] Example 32 is a display device as described in Example 31, further comprising a second adaptive lens assembly disposed on a second side opposite the first side of the waveguide assembly, the second adaptive lens assembly being configured to be selectively switched between a plurality of states having different refractive powers and configured to impart polarization-dependent refractive power to linearly polarized light, the second lens stack comprising a second birefringent lens and a second isotropic lens in contact with each other, forming a conformal interface therebetween.

[0037] Example 33 is a display device as described in Example 32, wherein the first and second adaptive lens assemblies each further comprise a switchable half-wave plate comprising twisted nematic (TN) liquid crystal (LC) optically coupled to a respective one of the lens stacks or the second lens stack, the switchable half-wave plate being configured to preserve the polarization of linearly polarized light passing therethrough when deactivated and to alter the polarization of linearly polarized light passing therethrough when activated.

[0038] Example 34 is a display device as described in Example 33, further comprising a shutter and a linear polarizer on a second side opposite the first side of the waveguide assembly configured to temporarily alternately block and pass light incident thereon.

[0039] Example 35 is the display device of example 34, wherein the waveguide assembly comprises a cholesteric liquid crystal and is configured to outcouple circularly polarized light.

[0040] Example 36 is the display device of example 35, wherein the waveguide assembly is sandwiched by a pair of quarter wave plates.

[0041] Example 37 is an optical system including a projector configured to emit light, at least one waveguide optically coupled to the projector and configured to receive and redirect light therefrom toward a user, and at least one component positioned adjacent to the at least one waveguide, a shutter assembly controllable to allow a variable amount of ambient light from the user's environment to pass therethrough toward the user, an adaptive lens assembly positioned between the at least one waveguide and the user, the adaptive lens assembly controllable to impart a variable amount of optical power to light passing therethrough toward the user, and control circuitry communicatively coupled to the projector, the shutter assembly, and the adaptive lens assembly. and control circuitry configured to synchronously switch the shutter assembly and the adaptive lens assembly between two or more states including a first state, in which the shutter assembly is configured to allow a first amount of ambient light from the user's environment to pass therethrough towards the user and the adaptive lens assembly is configured to impart a first amount of refractive power to the light passing therethrough, and a second state, in which the shutter assembly is configured to allow a second amount of ambient light from the user's environment to pass therethrough towards the user and the adaptive lens assembly is configured to impart a second amount of refractive power to the light passing therethrough, wherein the second amount of ambient light is less than the first amount of ambient light and the second amount of refractive power exceeds the first amount of refractive power.

[0042] Example 38 is an optical system as described in Example 37, wherein the first amount of ambient light includes a maximum amount of ambient light from the user's environment, for which the shutter assembly is configured to allow passing through towards the user, and the first amount of refractive power includes a minimum amount of refractive power, for which the adaptive lens assembly is configured to impart to the light passing therethrough.

[0043] Example 39 is an optical system described in either Example 37 or 38, wherein in a second state, the control circuitry is configured to cause the projector to emit light representing virtual content that will be perceived by the user as being located at a first depth in front of the user.

[0044] Example 40 is the optical system of Example 39, wherein the control circuitry is configured to determine a second amount of ambient light and a second amount of refractive power based on a first depth in front of the user at which the virtual content will be perceived by the user.

[0045] Example 41 is an optical system as described in Example 39, wherein in a first state, the control circuitry is configured to cause the projector to emit light representing virtual content that will be perceived by the user as being located at a second depth in front of the user, the second depth being greater than the first depth.

[0046] Example 42 is the optical system of example 41, wherein the second depth is substantially equivalent to optical infinity.

[0047] Example 43 is the optical system of example 39, wherein in the first state, the control circuitry is configured to cause the projector not to emit light.

[0048] Example 44 is an optical system described in either example 37 or 38, wherein the control circuitry is configured to synchronously switch the shutter assembly and the adaptive lens assembly between two or more states at a rate greater than or equal to the minimum switching frequency.

[0049] Example 45 is the optical system according to example 44, wherein the minimum switching frequency is 120 Hz.

[0050] Example 46 is an optical system as described in Example 44, further comprising an ambient light sensor configured to measure an intensity of ambient light from the user's environment, and a control circuit network communicatively coupled to the ambient light sensor and configured to further determine a rate at which the shutter assembly and the adaptive lens assembly are synchronously switched between two or more states based on data received from the ambient light sensor.

[0051] Example 47 is the optical system of example 38, for which the adaptive lens assembly is configured to impart to light passing therethrough a minimum amount of refractive power that is about zero.

[0052] Example 48 is an optical system as described in any of the above examples, wherein the second amount of ambient light includes a minimum amount of ambient light from the user's environment, for which the shutter assembly is configured to allow passing through towards the user, and the second amount of refractive power includes a maximum amount of refractive power, for which the adaptive lens assembly is configured to impart to light passing therethrough.

[0053] Example 49 is an optical system comprising: a projector configured to emit light; at least one waveguide optically coupled to the projector and configured to receive and redirect light therefrom towards a user; a shutter assembly having at least one component positioned adjacent to the at least one waveguide, the shutter assembly being controllable to allow a variable amount of ambient light from the user's environment to pass therethrough towards the user; an adaptive lens assembly positioned between the at least one waveguide and the user, the adaptive lens assembly being controllable to impart a variable amount of refractive power to light passing therethrough towards the user; and control circuitry communicatively coupled to the projector, the shutter assembly, and the adaptive lens assembly, the control circuitry configured to synchronously cause the adaptive lens assembly to vary an amount of refractive power imparted to light passing therethrough towards the user and to cause the shutter assembly to vary an amount of ambient light from the user's environment that is allowed to pass therethrough towards the user in inverse proportion to the amount of refractive power imparted by the adaptive lens assembly to light passing therethrough.

[0054] Example 50 is an optical system described in any of the above examples, wherein at least one waveguide is further configured to allow ambient light from the user's environment to pass therethrough toward the user.

[0055] Example 51 is an optical system described in any of the above examples, wherein at least one component of the shutter assembly comprises at least one component positioned between the at least one waveguide and the user's environment.

[0056] Example 52 is an optical system described in any of the above examples, wherein at least one component of the shutter assembly comprises at least one component positioned between the at least one waveguide and the user.

[0057] Example 53 is an optical system described in any of the above examples, wherein at least one component of the shutter assembly comprises at least one component positioned between the at least one waveguide and the adaptive lens assembly.

[0058] Example 54 is an optical system according to any of the preceding examples, wherein the at least one waveguide comprises a plurality of waveguides.

[0059] Example 55 is a non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform, at least in part, the method of any of the above examples.

[0060] Example 56 is an optical system comprising: a projector configured to emit light; at least one waveguide optically coupled to the projector and configured to receive and redirect the light therefrom towards a user; a shutter assembly positioned adjacent to the at least one waveguide, each of the shutter assemblies being selectively switchable between different states configured to allow different amounts of ambient light from the user's environment to pass therethrough towards the user; an adaptive lens assembly positioned between the at least one waveguide and the user, each of the adaptive lens assemblies being selectively switchable between different states configured to impart different amounts of wavefront divergence to light passing therethrough towards the user; and a control circuitry communicatively coupled to the projector, the shutter assembly, and the adaptive lens assembly.

[0061] Example 57 is an optical system as described in Example 56, wherein the control circuitry is configured to synchronously switch the shutter assembly and the adaptive lens assembly between two or more states at a particular rate, the two or more states including: a first state in which the shutter assembly is configured to allow a first amount of ambient light from the user's environment to pass therethrough toward the user and the adaptive lens assembly is configured to impart a first amount of wavefront divergence to the light passing therethrough; and a second state in which the shutter assembly is configured to allow a second amount of ambient light from the user's environment to pass therethrough toward the user and the adaptive lens assembly is configured to impart a second amount of wavefront divergence to the light passing therethrough, wherein the second amount of ambient light is different from the first amount of ambient light and the second amount of wavefront divergence is different from the first amount of wavefront divergence.

[0062] Example 58 is an optical system as described in Example 57, wherein the particular rate at which the shutter assembly and the adaptive lens assembly are synchronously switched between two or more states includes a rate equal to or greater than a minimum switching frequency.

[0063] Example 59 is an optical system described in Example 57 or 58, further comprising an ambient light sensor configured to measure the intensity of ambient light from the user's environment, and a control circuit network communicatively coupled to the ambient light sensor and further configured to determine a particular rate at which the shutter assembly and the adaptive lens assembly are synchronously switched between two or more states based on data received from the ambient light sensor.

[0064] Example 60 is the optical system of example 58 or 59, wherein the minimum switching frequency is 120 Hz.

[0065] Example 61 is an optical system as described in Example 57, wherein a first amount of ambient light for which the shutter assembly is configured to allow passing through towards the user includes a maximum amount of ambient light from the user's environment, and a first amount of wavefront divergence for which the adaptive lens assembly is configured to impart to light passing through it includes a minimum amount of wavefront divergence.

[0066] Example 62 is an optical system described in either of Examples 57 or 61, wherein in a second state, the control circuitry is configured to cause the projector to emit light representing virtual content that will be perceived by the user as being located at a first depth in front of the user.

[0067] Example 63 is an optical system as described in Example 62, wherein the control circuitry is configured to determine at least one of a second amount of ambient light and a second amount of wavefront divergence based on a first depth in front of the user at which the virtual content will be perceived by the user.

[0068] Example 64 is an optical system as described in Example 62, wherein in a first state, the control circuitry is configured to cause the projector to emit light representing virtual content that will be perceived by the user as being located at a second depth in front of the user, the second depth being greater than the first depth.

[0069] Example 65 is the optical system described in Example 64, wherein the second depth is substantially equivalent to optical infinity.

[0070] Example 66 is the optical system described in Example 62, wherein in the first state, the control circuitry is configured to cause the projector not to emit light.

[0071] Example 67 is the optical system of example 61, for which the adaptive lens assembly is configured to impart to light passing therethrough a minimum amount of wavefront divergence that is about zero.

[0072] Example 68 is the optical system of claim 57, wherein the second amount of ambient light is less than the first amount of ambient light and the second amount of wavefront divergence is greater than the first amount of wavefront divergence.

[0073] Example 69 is an optical system described in any of the above examples, wherein the second amount of ambient light includes a minimum amount of ambient light from the user's environment for which the shutter assembly is configured to allow passing through towards the user, and the second amount of wavefront divergence includes a maximum amount of wavefront divergence for which the adaptive lens assembly is configured to impart to light passing therethrough.

[0074] Example 70 is an optical system as described in Example 56, in which the control circuitry is configured to synchronously switch the shutter assembly and the adaptive lens assembly between different states in a manner that results in an inverse relationship between the amount of ambient light from the user's environment allowed to pass therethrough by the shutter assembly toward the user and the amount of wavefront divergence imparted by the adaptive lens assembly to the light passing therethrough toward the user.

[0075] Example 71 is an optical system as described in Example 56, wherein the control circuitry is configured to alternate between at least two different operating modes including a first operating mode in which the control circuitry is configured to control the state of the shutter assembly and the state of the adaptive lens assembly in an asynchronous manner, and a second operating mode in which the control circuitry is configured to control the state of the shutter assembly and the state of the adaptive lens assembly in a synchronous manner.

[0076] Example 72 is an optical system described in Example 71, in which in a second operating mode, the control circuitry is configured to synchronously switch the shutter assembly and the adaptive lens assembly between two or more states, including a first state in which the shutter assembly is configured to allow a first amount of ambient light from the user's environment to pass therethrough toward the user and the adaptive lens assembly is configured to impart a first amount of wavefront divergence to the light passing therethrough, and a second state in which the shutter assembly is configured to allow a second amount of ambient light from the user's environment to pass therethrough toward the user and the adaptive lens assembly is configured to impart a second amount of wavefront divergence to the light passing therethrough, wherein the second amount of ambient light is different from the first amount of ambient light and the second amount of wavefront divergence is different from the first amount of wavefront divergence.

[0077] Example 73 is an optical system as described in Example 71, further comprising one or more cameras configured to capture images of one or both of the user's eyes, wherein the control circuitry is communicatively coupled to the one or more cameras and further configured to alternate between at least two different operating modes based, at least in part, on data received from the one or more cameras.

[0078] Example 74 is the optical system of Example 73, wherein the control circuitry is further configured to determine a depth at which the user's eyes are fixating based on data received from the one or more cameras, and to alternate between at least two different operating modes based, at least in part, on the depth at which the user's eyes are determined to be fixating.

[0079] Example 75 is an optical system as described in Example 71, wherein the control circuitry is further configured to cause the projector to emit light representing virtual content.

[0080] Example 76 is an optical system as described in Example 75, wherein the control circuitry is further configured to determine whether an accommodation-vergence-divergence movement mismatch for the virtual content exceeds a threshold, and to alternate between at least two different operating modes in response to a determination that the accommodation-vergence-divergence movement mismatch for the virtual content exceeds a threshold.

[0081] Example 77 is an optical system as described in Example 75, wherein the control circuitry is further configured to alternate between at least two different operating modes based, at least in part, on a depth in front of the user at which the virtual content will be perceived by the user.

[0082] Example 78 is an optical system described in Example 71, wherein in the first operating mode, the control circuitry is configured to cause the state of at least one of the shutter assembly and the adaptive lens assembly to remain substantially fixed.

[0083] Example 79 is an optical system described in any of the above examples, wherein at least one waveguide is further configured to allow ambient light from the user's environment to pass therethrough toward the user.

[0084] Example 80 is an optical system according to any of the above examples, wherein the at least one component of the shutter assembly comprises at least one component positioned between the at least one waveguide and the user's environment.

[0085] Example 81 is an optical system described in any of the above examples, wherein at least one component of the shutter assembly comprises at least one component positioned between the at least one waveguide and the user.

[0086] Example 82 is an optical system described in any of the above examples, wherein at least one component of the shutter assembly includes at least one component positioned between the at least one waveguide and the adaptive lens assembly.

[0087] Example 83 is an optical system according to any of the above examples, wherein the at least one waveguide comprises a plurality of waveguides.

[0088] Example 84 is an optical system comprising: a projector configured to emit light; at least one waveguide optically coupled to the projector and configured to receive and redirect light therefrom towards a user; and at least one component positioned adjacent to the at least one waveguide; a shutter assembly, each of which is selectively switchable between different states configured to allow different amounts of ambient light from the user's environment to pass therethrough towards the user; and an adaptive lens assembly positioned between the at least one waveguide and the user, each of which is selectively switchable between different states configured to impart different amounts of wavefront divergence to light passing therethrough towards the user; and a combination of the projector, shutter assembly, and adaptive lens. and control circuitry communicatively coupled to the assemblies and configured to synchronously switch the shutter assembly and the adaptive lens assembly between two or more states at a particular rate, the two or more states including a first state in which the shutter assembly is configured to allow a first amount of ambient light from the user's environment to pass therethrough towards the user and the adaptive lens assembly is configured to impart a first amount of wavefront divergence to the light passing therethrough, and a second state in which the shutter assembly is configured to allow a second amount of ambient light from the user's environment to pass therethrough towards the user and the adaptive lens assembly is configured to impart a second amount of wavefront divergence to the light passing therethrough, where the second amount of ambient light differs from the first amount of ambient light and the second amount of wavefront divergence differs from the first amount of wavefront divergence.

[0089] Example 85 is an optical system described in Example 84, wherein the second amount of ambient light is less than the first amount of ambient light and the second amount of wavefront divergence is greater than the first amount of wavefront divergence.

[0090] Example 86 is the optical system of example 84, wherein the particular rate at which the shutter assembly and the adaptive lens assembly are synchronously switched between two or more states includes a rate equal to or greater than a minimum switching frequency.

[0091] Example 87 is an optical system as described in Example 84, wherein in a second state, the control circuitry is configured to cause the projector to emit light representing virtual content that will be perceived by the user as being located at a first depth in front of the user, and the control circuitry is configured to determine at least one of a second amount of ambient light and a second amount of wavefront divergence based on the first depth in front of the user at which the virtual content will be perceived by the user.

[0092] Example 88 is an optical system described in Example 84, wherein at least one component of the shutter assembly includes at least one component positioned between the at least one waveguide and the user.

[0093] Example 89 is an optical system comprising: a projector configured to emit light; at least one waveguide optically coupled to the projector and configured to receive and redirect light therefrom towards a user; a shutter assembly having at least one component positioned adjacent to the at least one waveguide, the shutter assembly being controllable to allow a variable amount of ambient light from the user's environment to pass therethrough towards the user; an adaptive lens assembly positioned between the at least one waveguide and the user, the adaptive lens assembly being controllable to impart a variable amount of wavefront divergence to light passing therethrough towards the user; and control circuitry communicatively coupled to the projector, the shutter assembly, and the adaptive lens assembly, the control circuitry configured to synchronously cause the adaptive lens assembly to vary an amount of wavefront divergence imparted to light passing therethrough towards the user and to cause the shutter assembly to vary an amount of ambient light from the user's environment allowed to pass therethrough towards the user in inverse proportion to the amount of wavefront divergence imparted by the adaptive lens assembly to light passing therethrough.

[0094] Example 90 is an optical system comprising a projector configured to emit light, at least one waveguide optically coupled to the projector and configured to receive and redirect the light therefrom towards a user, and at least one component positioned adjacent to the at least one waveguide, each of the shutter assemblies being selectively switchable between different states configured to allow different amounts of ambient light from the user's environment to pass therethrough towards the user, and an adaptive lens assembly positioned between the at least one waveguide and the user, each of the adaptive lenses being selectively switchable between different states. an adaptive lens assembly selectively switchable between different states configured to impart an amount of wavefront divergence to light passing therethrough towards a user; and control circuitry communicatively coupled to the projector, the shutter assembly, and the adaptive lens assembly, the control circuitry configured to synchronously switch the shutter assembly and the adaptive lens assembly between the different states in a manner that effects an inverse relationship between an amount of ambient light from the user's environment allowed to pass therethrough by the shutter assembly towards the user and an amount of wavefront divergence imparted by the adaptive lens assembly to light passing therethrough towards the user.

[0095] Example 91 is an optical system comprising a projector configured to emit light, at least one waveguide optically coupled to the projector and configured to receive and redirect the light therefrom towards a user, and at least one component positioned adjacent to the at least one waveguide, each of the shutter assemblies being selectively switchable between different states configured to allow different amounts of ambient light from the user's environment to pass therethrough towards the user, and an adaptive lens assembly positioned between the at least one waveguide and the user, each of the adaptive lens assemblies being selectively switchable between different states. an adaptive lens assembly, the adaptive lens assembly being selectively switchable between different states, the shutter assembly being configured to impart different amounts of wavefront divergence to light passing therethrough towards a user; and control circuitry communicatively coupled to the projector, the shutter assembly, and the adaptive lens assembly, the control circuitry configured to alternate between at least two different operational modes, including a first operational mode, the control circuitry configured to control a state of the shutter assembly and a state of the adaptive lens assembly in an asynchronous manner, and a second operational mode, the control circuitry configured to control a state of the shutter assembly and a state of the adaptive lens assembly in a synchronous manner.

[0096] Example 92 is a non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause the one or more processors to perform one or more of the operations performed by the control circuitry of any of the above examples.

[0097] Numerous advantages over conventional techniques are achieved by the methods of the present disclosure. Various embodiments described herein provide a compact, time-multiplexed display that can apply refractive power to virtual image light to provide virtual content at various depths while simultaneously leaving world light undistorted. Various embodiments described herein also provide an adaptive lens assembly that includes a polarization-selective lens stack. In some implementations, the polarization-selective lens stack comprises a birefringent lens, e.g., a Fresnel birefringent lens, and an isotropic lens that are in contact with each other. Such assemblies can be compact (e.g., can have a reduced thickness) and / or lightweight. These assemblies can potentially also provide various advantageous optical functionalities, such as high bandwidth, increased switching speed, reduced chromatic aberration, increased ease of matching, and / or variable refractive power. Some embodiments of the present disclosure provide for replacing conventional front adaptive lens assemblies and shutter assemblies, resulting in smaller / lighter form factors and increased power savings. In addition, the various embodiments described herein can provide an adaptive lens assembly with a relatively low amount of leakage light that may otherwise lead to "afterimage" images. Other advantages of the present disclosure will be readily apparent to those skilled in the art. [Brief description of the drawings]

[0098] [Figure 1] FIG. 1 illustrates an augmented reality (AR) scene as viewed through a wearable AR device according to an embodiment described herein.

[0099] [Diagram 2] FIG. 2 illustrates an example of a display system comprising a pair of adaptive lens assemblies.

[0100] [Diagram 3]Figure 3A illustrates an example of the display system of Figure 2 that uses an adaptive lens to display virtual content to a user in a virtual depth plane, and Figure 3B illustrates an example of the display system of Figure 2 that provides a user with a view of real-world content through the adaptive lens.

[0101] [Figure 4A] 4A-4C illustrate one or more general features of an AR device according to the present disclosure. [Figure 4B] 4A-4C illustrate one or more general features of an AR device according to the present disclosure. [Figure 4C] 4A-4C illustrate one or more general features of an AR device according to the present disclosure.

[0102] [Diagram 5] FIG. 5 illustrates a schematic diagram of a wearable AR device according to the present disclosure.

[0103] [Figure 6] Figure 6A illustrates a cross-sectional view of an exemplary polarization-selective lens stack comprising a birefringent lens and an isotropic lens. Figure 6B illustrates the polarization-selective lens stack of Figure 6A in operation, where linearly polarized light passing therethrough has a first polarization. Figure 6C illustrates the polarization-selective lens stack of Figure 6A in operation, where linearly polarized light passing therethrough has a second polarization.

[0104] [Figure 7] Figure 7A illustrates the polarization-selective lens stack of Figure 6A with annotated parameters. Figure 7B illustrates a cross-sectional and top-down view of an example polarization-selective lens stack comprising a birefringent Fresnel lens and an isotropic lens.

[0105] [Figure 8]8A illustrates a cross-sectional view of an example adaptive lens assembly comprising a polarization-selective lens stack combined with a switchable waveplate comprising twisted nematic liquid crystal. FIG 8B illustrates the switchable waveplate comprising twisted nematic liquid crystal of the adaptive lens assembly illustrated in FIG 8A.

[0106] [Figure 9A] FIG. 9A illustrates a cross-sectional view of an example adaptive lens assembly comprising a first polarization-selective lens stack combined with a first switchable waveplate comprising twisted nematic liquid crystal and a second polarization-selective lens stack combined with a second switchable waveplate comprising twisted nematic liquid crystal.

[0107] [Figure 9B] 9B-9E illustrate the example adaptive lens assembly of FIG. 9A in operation under different configurations configured to provide different optical powers. [Figure 9C] 9B-9E illustrate the example adaptive lens assembly of FIG. 9A in operation under different configurations configured to provide different optical powers. [Figure 9D] 9B-9E illustrate the example adaptive lens assembly of FIG. 9A in operation under different configurations configured to provide different optical powers. [Figure 9E] 9B-9E illustrate the example adaptive lens assembly of FIG. 9A in operation under different configurations configured to provide different optical powers.

[0108] [Figure 10] FIG. 10 illustrates a cross-sectional view of an exemplary display device comprising a waveguide assembly interposed between a first adaptive lens assembly and a second adaptive assembly, each having a polarization-selective lens stack.

[0109] [Figure 11A]FIG. 11A illustrates a cross-sectional view of an exemplary display device comprising a waveguide assembly interposed between a shutter and a linear polarizer on a first side and an adaptive assembly having a polarization-selective lens stack on a second side.

[0110] [Figure 11B] FIG. 11B illustrates a waveguide assembly of the display device of FIG. 11A comprising cholesteric liquid crystals and configured to outcouple circularly polarized light.

[0111] [Figure 11C] FIG. 11C illustrates the example display device of FIG. 11A in operation and in a configuration for viewing a world image.

[0112] [Figure 11D] FIG. 11D illustrates the example display device of FIG. 11A in operation and in a configuration for viewing a virtual image.

[0113] [Figure 12A] FIG. 12A illustrates an example of a display device having a single adaptive lens assembly on the user side of the eyepiece, according to some embodiments of the present disclosure.

[0114] [Figure 12B] FIG. 12B illustrates an example of a display device operating according to a first state, according to some embodiments of the present disclosure.

[0115] [Figure 12C] FIG. 12C illustrates an example of a display device operating according to a second state, according to some embodiments of the present disclosure.

[0116] [Figure 13] FIG. 13 illustrates a method of operating an optical system according to some embodiments of the present disclosure.

[0117] [Figure 14] FIG. 14 illustrates a method of operating an optical system according to some embodiments of the present disclosure.

[0118] [Figure 15] FIG. 15 illustrates an example implementation of a method of operating an optical system according to some embodiments of the present disclosure.

[0119] [Figure 16A] FIG. 16A illustrates an example of a display device operating according to a first state, according to some embodiments of the present disclosure.

[0120] [Figure 16B] FIG. 16B illustrates an example of a display device operating according to a second state, according to some embodiments of the present disclosure.

[0121] [Figure 16C] FIG. 16C illustrates an example of a display device operating according to a third state, according to some embodiments of the present disclosure.

[0122] [Figure 17] FIG. 17 illustrates a simplified computer system according to an embodiment described herein. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0123] Optical see-through (OST) augmented reality (AR) devices can refine the virtual content being presented to a user by applying a refractive power to the virtual image light (i.e., light associated with a virtual image) using one or more adaptive lens assemblies arranged in an optical stack. One problem with such configurations is that the refractive power is necessarily also applied to the world light (i.e., light associated with a world object) passing therethrough, causing a distortion of the perceived world object, thereby diminishing the user experience. Some embodiments described herein overcome these and other problems by providing various shutter elements arranged in an optical stack that can be activated in sequence to produce a result in which the world light is passed through the AR device without distortion, and the virtual image light is given a refractive power from the adaptive lens assemblies, as needed.

[0124] FIG. 1 illustrates an AR scene as viewed through a wearable AR device according to an embodiment described herein. An AR scene 100 is depicted in which a user of the AR technology sees a real-world park-like setting 106 featuring people, trees, buildings in the background, and a concrete platform 120. In addition to these items, the user of the AR technology also perceives that they "see" a robotic figure 110 standing on the real-world platform 120 and a flying cartoon-like avatar character 102 that appears to be an anthropomorphic bumblebee, although these elements (the character 102 and the figure 110) do not exist in the real world. Due to the significant complexity of the human visual perception and nervous system, it is difficult to produce virtual reality (VR) or AR technology that promotes a comfortable, natural-feeling, and rich presentation of virtual image elements among other virtual or real-world image elements.

[0125] FIG. 2 illustrates an example of a display device 200, e.g., a wearable display device, with one or more adaptive lens assemblies including a polarization-selective lens stack, e.g., a pair of adaptive lens assemblies 204, 208, in an optical path 216 interposed by a waveguide assembly 212. As described herein, the waveguide assembly 212 may include a waveguide configured to propagate light (e.g., visible light) under total internal reflection and to outcouple the light in an optical axis extending from (e.g., normal to) a light output surface (e.g., a major surface of the waveguide) of the waveguide. The light may be outcoupled by a diffraction grating in some embodiments. Each of the adaptive lens assemblies 204, 208 may be configured to at least partially transmit the outcoupled light therethrough. In the illustrated embodiment, each of the adaptive lens assemblies 204, 208 may be configured to receive the outcoupled light from the waveguide assembly 212 and to converge or diverge the outcoupled light along an optical axis. Each of the adaptive lens assemblies 204, 208 comprises a polarization-selective lens stack comprising a birefringent lens and an isotropic lens in contact with each other, the contacting surfaces of the birefringent lens and the isotropic lens forming a conformal interface therebetween. Each of the adaptive lens assemblies 204, 208 is configured to be selectively switched between a plurality of states having different refractive powers. That is, each of the adaptive lens assemblies 204, 208 is configured to be selectively switched between a plurality of states in which the individual adaptive lens assemblies are configured to impart different amounts of wavefront divergence or convergence to light passing therethrough. Each of the adaptive lens assemblies 204, 208 can further be configured to modify the polarization state of the outcoupled light passing therethrough when activated (e.g., electrically activated).

[0126] As used herein, an adaptive lens assembly refers to a lens assembly having at least one optical property that can be adjusted, e.g., reversibly activated and deactivated using an external stimulus. Exemplary optical properties that can be reversibly activated and deactivated include refractive power (focal length), phase, polarization, polarization selectivity, transmittance, reflectance, birefringence, and diffractive properties, among other properties. In various embodiments, an adaptive lens assembly is capable of electrically varying the refractive power and polarization state of light passing therethrough.

[0127] In the illustrated embodiment, the pair of adaptive lens assemblies 204, 208 are each configured to be selectively switched between at least two states, where in a first state each is configured to pass the outcoupled light therethrough without altering its polarization state, while in a second state each is configured to alter the polarization state of the outcoupled light passing therethrough. For example, in the second state each of the adaptive lens assemblies 204, 208 reverses the handedness of circularly polarized light, while in the first state each of the adaptive lens assemblies 204, 208 preserves the handedness of circularly polarized light.

[0128] 2, the display device 200 may further comprise a waveguide assembly 212 interposed between the pair of adaptive lens assemblies 204, 208. Each of the waveguide assemblies 204, 208 may be configured to propagate light under total internal reflection in a lateral direction parallel to the major surfaces of the waveguide. Each of the waveguide assemblies 204, 208 may further be configured to outcouple light, for example, in a direction normal to the major surfaces of the waveguide.

[0129] Still referring to FIG. 2 , a first adaptive lens assembly 204 of the paired adaptive lens assembly is disposed on a first side of the waveguide assembly 212, e.g., the side of the world observed by the user, and a second adaptive lens assembly 208 of the paired lens assembly is disposed on a second side of the waveguide assembly 212, e.g., the side of the user's eye. As described below, the paired adaptive lens assemblies 204, 208, as configured, provide the user with virtual content from the waveguide assembly 212 to multiple virtual depth planes, as well as views of the real world. In some embodiments, there is little or no distortion due to the presence of the paired adaptive lens assemblies 204, 208. Virtual content and views of the real world are provided to the user in response to activation of the first and second adaptive lens assemblies 204, 208, as described below with respect to FIGS. 3A and 3B .

[0130] 3A and 3B each illustrate an example of a display device 300A, 300B with an adaptive lens assembly for outputting image information to a user when in operation. The display devices 300A, 300B may correspond to the same display device at different times and / or in different states. In some embodiments, the display devices 300A, 300B are structurally the same in an unpowered state. The display device 300A is used herein to describe outputting a virtual image to a user, while the display device 300B is used herein to describe transmitting a real-world image to a user through the display device 300B. The display devices 300A, 300B include a pair of adaptive lens assemblies 204, 208 configured to be electrically activated, e.g., by application of a voltage or current. In some embodiments, in a deactivated state, e.g., when no voltage or current is applied, the first and second adaptive lens assemblies 204, 208 each have a low, e.g., about zero, optical power. In some embodiments, in an activated state, e.g., when a voltage or current is applied, the first adaptive lens assembly 204 on the world side provides a first net refractive power (P net1 When in the activated state, the second adaptive lens assembly 208 on the user's side may provide a second net refractive power (P net2 However, embodiments are not so limited, and in other embodiments, the first and second adaptive lens assemblies 200A, 200B may provide optical power in a deactivated state, while providing substantially zero optical power when activated.

[0131] 3A illustrates an example of the display system of FIG. 2 displaying virtual content to a user at a virtual depth plane 304, according to some embodiments. As described above, the waveguide assembly 212 interposed between the pair of adaptive lens assemblies 204, 208 comprises a waveguide configured to receive light containing virtual image information and propagate the light under total internal reflection. The waveguide assembly 212 is further configured to outcouple the light towards the user's eye, for example through a diffraction grating. The outcoupled light passes through the user-side adaptive lens assembly 208 prior to entering the user's eye. When activated, the user-side adaptive lens assembly 208 has a second net optical power P net2 , which may have a negative value so that the user sees a virtual image in the virtual depth plane 304.

[0132] In some embodiments, the second net optical power P net2 is electrically adjusted to obtain a second net refractive power (P net2 ) and thereby adjust the distance to the virtual depth plane 304. For example, as the virtual object “moves” closer and farther relative to the user’s eye in the virtual three-dimensional space, the second net optical power P net2 may be correspondingly adjusted such that the virtual depth plane 304 adjusts to track the virtual object. Thus, the user may experience relatively little or no accommodation / vergence-divergence mismatch beyond an acceptable threshold. In some embodiments, the magnitude of the distance to the virtual depth plane 304 may be adjusted in discrete steps, while in some other embodiments, the magnitude of the distance to the virtual depth plane 304 may be adjusted continuously.

[0133] 3B illustrates an example of the display system of FIG. 2 providing a user with a view of real-world content, according to some embodiments. The user-side adaptive lens assembly 208 is activated and provides a second net optical power (P net2 ), the light from the real world passing through the user-side adaptive lens assembly 208 is also activated by the P net2 Thus, objects in the real world may appear out of focus or distorted. To mitigate such distortion, according to embodiments, when activated, the adaptive lens assemblies 204, 208 may be configured to have refractive powers with opposite signs. In some embodiments, light passing through the adaptive lens assemblies 204, 208 is reflected by the first and second net refractive powers P of the world-side and user-side adaptive lens assemblies 204, 208, respectively. net1 , P net2 The optical power of the adaptive lens assembly 208 may be of opposite sign to the sum of the optical powers of the adaptive lens assembly 204 and the waveguide assembly 212. In some embodiments, the waveguide assembly 212 may also have optical power, and the adaptive lens assembly 208 may be configured to account for the distortion caused by both the lens assembly 204 and the waveguide assembly 212. For example, the optical power of the adaptive lens assembly 208 may be of opposite sign to the sum of the optical powers of the adaptive lens assembly 204 and the waveguide assembly 212.

[0134] In some embodiments, the world-side adaptive lens assembly 204 is configured to have a second net optical power P net2 A first net refractive power P having a magnitude close to or equal to, but having the opposite sign net1 As a result, when both adaptive lens assemblies 204, 208 are activated simultaneously, objects in the real world appear relatively unaffected by the optical power of the user-side adaptive lens assembly 208 provided to display virtual content.

[0135] In some embodiments, the first adaptive lens assembly 204, when activated, has a first net optical power P net1 is the second net refractive power P of the user-side adaptive lens assembly 208 net2 For example, the second net refractive power P net2 is adjusted to track a virtual object moving in virtual three-dimensional space, the first net optical power P of the world-side adaptive lens assembly 204 net1 is the combined refractive power P=P net1 +P net2 may be dynamically adjusted so that the magnitude of P may be kept below a predetermined value. Thus, according to an embodiment, objects in the real world have a combined refractive power P = P net1 +P net2 The first net refractive power (P net1 ), along with the second net refractive power (P net2 ) may be prevented from being unacceptably out of focus. As described in more detail below, in some implementations, the wearable display device may include a waveguide assembly and a user-side adaptive lens assembly that are functionally equivalent or similar to the waveguide assembly 212 and the user-side adaptive lens assembly 208, respectively, but may not include a world-side adaptive lens assembly similar to that of the world-side adaptive lens assembly 204. Instead, as described in more detail below, in these implementations, the display device may include one or more shutter elements and may be configured to control such one or more shutter elements in synchronization with the user-side adaptive lens such that objects in the real world are not rendered unacceptably out of focus by the refractive power imparted by the user-side adaptive lens.

[0136] FIG. 4A illustrates one or more general features of an AR device 400 according to the present disclosure. As shown in FIG. 4A, the AR device 400 includes an eyepiece 402 and an adaptive lens assembly 405, which may be functionally equivalent or similar to the waveguide assembly 212 and the user-side adaptive lens assembly 208, respectively, as described above. During operation, the projector 414 of the AR device 400 may project virtual image light 423 (i.e., light associated with a virtual image) onto the eyepiece 402, which may cause a light field (i.e., an angular representation of the virtual content) to be projected onto the user's retina such that the user perceives the corresponding virtual content as being located at a location within the user's environment. For example, the user may perceive the character 102 as being located at or near a first virtual depth and the image 110 as being located at or near a second virtual depth. Although the AR device 400 may include only one adaptive lens assembly 405 (e.g., positioned on the user side of the eyepiece 402, i.e., the side of the eyepiece 402 closest to the user's eye), such an adaptive lens assembly may be capable of imparting a number of different non-zero refractive powers to light passing therethrough. That is, the adaptive lens assembly 405 may be capable of imparting a number of different amounts of at least one of wavefront divergence and collimation to light passing therethrough.

[0137] The AR device 400 may also include one or more shutter elements 403 coupled to a world side of the eyepiece 402 (the side of the eyepiece 402 farthest from the user's eye and closest to the world object 430) and / or a user side of the eyepiece 402. By sequentially electrically activating different elements / layers of the shutter element 403 as described herein, world light 432 associated with the world object 430 may pass through the AR device 400 with a zero net refractive power applied by the lens assembly 405, and virtual image light 423 may pass therethrough with a non-zero (e.g., negative) net refractive power applied by the lens assembly 405. Exemplary dimming components that may represent or be included within the shutter element 403 and other shutter assemblies described herein are described in U.S. patent application Ser. No. 62 / 725,993, filed Aug. 31, 2018 (Attorney Docket No. 101782-005600US-1083563), U.S. patent application Ser. No. 16 / 557,706, filed Aug. 30, 2019, and International Patent Application No. PCT / US2019 / 051188, filed Sep. 13, 2019 (all of which are incorporated by reference in their entirety into this specification).

[0138] In some embodiments, the AR device 400 may include an ambient light sensor 434 configured to detect the world light 432. The ambient light sensor 434 may be positioned such that the world light 432 detected by the ambient light sensor 434 resembles and / or represents the world light 432 impinging on the AR device 400 (e.g., the shutter element 403, the eyepiece 402, and / or the lens assembly 405). In some embodiments, the ambient light sensor 434 may be configured to detect a plurality of spatially resolved light values ​​corresponding to different pixels of a field of view of the AR device 400. In some embodiments, or in the same embodiment, the ambient light sensor 434 may be configured to detect a global light value corresponding to an average light intensity or a single light intensity of the world light 432. The detected ambient light may be used by the AR device 400 to determine a shutter frequency at which the AR device 400 alternates between operating according to a first state or a second state. In some instances, the shutter frequency may exceed the flicker fusion threshold such that the shutter may not be readily perceptible to a user. For example, the shutter frequency may be at least 120 Hz (e.g., 160 Hz or 200 Hz).

[0139] 4B illustrates the AR device 400 operating according to a first state, according to some embodiments of the present disclosure. While operating according to the first state, the projector 414 is turned off and one or more of the shutter elements 403 are electrically activated such that world light 432 passes through the AR device 400 with zero net refractive power applied by the lens assembly 405. As will be shown below, this is accomplished using a world-side polarizer of the shutter element 403 to linearly polarize the world light 432 along a first axis, a world-side switchable waveplate of the shutter element 403 to rotate the polarization of the world light 432 by 90 degrees, and a user-side polarizer of the shutter element 403 to linearly polarize the world light 432 along a second axis perpendicular to the first axis.

[0140] In some embodiments, one or more components of the shutter element 403 are considered to be subcomponents of the lens assembly 405 (i.e., considered to be included within the lens assembly 405). For example, a user-side polarizer of the shutter element 403 may be considered to be a subcomponent of the lens assembly 405. In such embodiments, when the AR device 400 is operating according to a first state, the lens assembly 405 is considered to be switched, activated, and / or controlled to a state that applies zero optical power to light passing therethrough.

[0141] 4C illustrates the AR device 400 operating according to a second state, according to some embodiments of the present disclosure. When operating according to the second state, the projector 414 is turned on and one or more of the shutter elements 403 are electrically activated such that the world light 432 is fully or at least partially reduced, blocked, or dimmed, and the virtual image light 423 passes through the AR device 400 with a non-zero net refractive power applied by the lens assembly 405. As will be shown below, this is accomplished using a world-side polarizer of the shutter element 403 to linearly polarize the world light 432 along a first axis, a user-side polarizer of the shutter element 403 to linearly polarize the world light 432 and the virtual image light 423 along a second axis perpendicular to the first axis, and a user-side switchable waveplate of the shutter element 403 to rotate the polarization of the virtual image light 423 by 90 degrees.

[0142] Similar to those described with reference to FIG. 4B, in some embodiments, one or more components of the shutter element 403 are considered subcomponents of the lens assembly 405 (i.e., are considered to be included within the lens assembly 405). For example, the user-side polarizer of the shutter element 403 may be considered a subcomponent of the lens assembly 405. In such an embodiment, when the AR device 400 is operating according to the second state, the lens assembly 405 is considered to be switched, activated, and / or controlled to a state that applies a non-zero optical power to light passing therethrough. In some examples (e.g., those described with reference to FIGS. 11C and 11D), the polarized eyepiece may also be switched, activated, and / or controlled with each state such that the optical power applied to the light it outcouples may vary.

[0143] 5 illustrates a schematic diagram of a wearable AR device 500 according to the present disclosure. The AR device 500 may include a left eyepiece 502A, a left shutter element 503A, and a left lens assembly 505A arranged in a side-by-side configuration, and a right eyepiece 502B, a right shutter element 503B, and a right lens assembly 505B also arranged in a side-by-side configuration. In some embodiments, the AR device 500 includes one or more sensors, including, but not limited to, a left front facing world camera 506A mounted directly on or near the left eyepiece 502A, a right front facing world camera 506B mounted directly on or near the right eyepiece 502B, a left side facing world camera 506C mounted directly on or near the left eyepiece 502A, a right side facing world camera 506D mounted directly on or near the right eyepiece 502B, a left eye tracker positioned to view the user's left eye, a right eye tracker positioned to view the user's right eye, and an ambient light sensor 534. In some embodiments, the AR device 500 includes one or more image projection devices, such as a left projector 514A optically linked to the left eyepiece 502A, and a right projector 514B optically linked to the right eyepiece 502B.

[0144] Some or all of the components of the AR device 500 may be mounted on the head so that the projected image can be viewed by the user. In one particular implementation, all of the components of the AR device 500 shown in FIG. 5 are mounted on a single device (e.g., a single headset) that can be worn by the user. In another implementation, one or more components of the processing module 550 are physically separate from the other components of the AR device 500 and communicatively coupled thereto by one or more wired and / or wireless connections. For example, the processing module 550 may include a local module 552 on the head-mounted portion of the AR device 500 and a remote module 556 that is physically separate and communicatively linked to the local module 552. The remote module 556 may be mounted in various configurations, such as fixedly attached to a frame, fixedly attached to a helmet or hat worn by the user, built into headphones, or otherwise removably attached to the user (e.g., in a backpack configuration, in a belt-coupled configuration, etc.).

[0145] The processing module 550 may include a processor and associated digital memory, such as non-volatile memory (e.g., flash memory), both of which may be utilized to aid in processing, caching, and storing data. The data may include data captured from sensors (e.g., which may be operatively coupled to the AR device 500 or otherwise attached to the user), such as the camera 506, the ambient light sensor 534, an eye tracker, a microphone, an inertial measurement unit, an accelerometer, a compass, a GPS unit, a wireless device, and / or a gyroscope. For example, the processing module 550 may receive the image 520 from the camera 506. Specifically, the processing module 550 may receive a left front image 520A from the left front facing world camera 506A, a right front image 520B from the right front facing world camera 506B, a left side image 520C from the left facing world camera 506C, and a right side image 520D from the right facing world camera 506D. In some embodiments, the images 520 may include a single image, a pair of images, a video comprising a stream of images, a video comprising a stream of paired images, and the like. The images 520 may be generated and sent to the processing module 550 periodically while the AR device 500 is powered on, or may be generated in response to an instruction sent by the processing module 550 to one or more of the cameras. As another example, the processing module 550 may receive ambient light information from the ambient light sensor 534. As another example, the processing module 550 may receive gaze information from an eye tracker. As another example, the processing module 550 may receive image information (e.g., image brightness values) from one or both of the projectors 514.

[0146] The eyepieces 502A, 502B may each include a transparent or semi-transparent waveguide configured to direct and out-couple light from the projectors 514A, 514B. Specifically, the processing module 550 may cause the left projector 514A to output left virtual image light 522A onto the left eyepiece 502A and the right projector 514B to output right virtual image light 522B onto the right eyepiece 502B. In some embodiments, the eyepieces 502 may each include multiple waveguides corresponding to different colors and / or different depth planes. In some embodiments, the shutter element 503 may be coupled to and / or integrated with the eyepieces 502. For example, the shutter element 503 may be incorporated into a multi-layer eyepiece and may form one or more layers that make up one of the eyepieces 502. In some embodiments, the processing module may electrically activate the shutter elements 503A, 503B using left and right shutter control signals 519A, 519B, respectively. For example, the processing module 550 may apply different voltages to the shutter control signals 519 to cause the AR device 500 to alternate between presenting world light and virtual image light to the user.

[0147] The cameras 506A, 506B may be positioned to capture images that substantially overlap the field of view of the user's left and right eyes, respectively. Thus, the placement of the cameras 506 may be near the user's eyes, but not so close as to obscure the user's field of view. Alternatively or in addition, the cameras 506A, 506B may be positioned to align with the internal coupling locations of the virtual image lights 522A, 522B, respectively. The cameras 506C, 506D may be positioned to capture images, for example, within the user's peripheral vision or to the side of the user outside the user's peripheral vision. The images 520C, 520D captured using the cameras 506C, 506D do not necessarily overlap with the images 520A, 520B captured using the cameras 506A, 506B. Polarization selective lens stack with birefringent and isotropic lenses for adaptive lens assemblies - Patent Application 20070233633

[0148] Various embodiments described herein provide an adaptive lens assembly that includes a polarization-selective lens stack. In some implementations, the polarization-selective lens stack comprises a birefringent lens, e.g., a Fresnel birefringent lens, and an isotropic lens that are in contact with each other. Such assemblies can be compact (e.g., can have a reduced thickness) and / or lightweight. These assemblies can potentially also provide various advantageous optical functionalities, such as high bandwidth, increased switching speed, reduced chromatic aberration, increased ease of matching, and / or variable refractive power. In addition, various embodiments described herein can provide an adaptive lens assembly with a relatively low amount of leakage light that may otherwise lead to a "persistent" image. According to various embodiments, the adaptive assembly comprises a polarization-selective lens stack that comprises a birefringent lens and an isotropic lens, as described herein.

[0149] 6A , to provide images at multiple depth planes with high efficiency over a wide range of the visible spectrum, an adaptive lens assembly according to various embodiments includes a polarization-selective lens stack 600 configured to impart polarization-dependent refractive power to linearly polarized light. The polarization-selective lens stack 600 may comprise a birefringent lens 604 having an optics axis 602 that extends in a lateral direction perpendicular to the direction of light propagation, e.g., the z-direction, e.g., in the x- or y-direction. The birefringence Δn is determined by the extraordinary refractive index n of the birefringent lens 604. e and the normal refractive index n o The birefringent lens 604 can have a radius of curvature R1 such that it is configured to impart a first refractive power p1 to light passing therethrough having a polarization direction parallel to the optical axis, and a second refractive power p2 to light passing therethrough having a polarization direction perpendicular to the optical axis.

[0150] The polarization selective lens stack 600 additionally has a refractive index n c

[0046] The optical system may include an isotropic lens 608 having a second radius of curvature R2 configured to impart to light passing therethrough a third refractive power p3 of opposite sign to the first and second refractive powers p1 and p2.

[0151] In the illustrated embodiment, without limitation, the extraordinary refractive index n e is the normal refractive index n of the birefringent lens 604 o However, the extraordinary refractive index n e In some other embodiments, the normal refractive index n o It should be understood that the number of sigma-based filters may vary.

[0152] In the illustrated embodiment, without limitation, the first radius of curvature R1 and the second radius of curvature R2 are substantially the same magnitude but have opposite signs, R. Furthermore, because R1 and R2 are substantially the same magnitude, the birefringent lens 604 and the isotropic lens 608 are in continuous contact along an interface having a radius of curvature R. That is, the contacting surfaces of the birefringent lens 604 and the isotropic lens 608 form a conformal interface therebetween.

[0153] 6B, the polarization-selective lens stack 600 is illustrated in operation when incident light 612, e.g., linearly polarized light, has a direction of polarization parallel to the direction of the optical system axis 602. Under this condition, light passing through the birefringent lens 604 experiences an extraordinary refractive index n e , and light passing through the isotropic lens 608 experiences a refractive index corresponding to the normal refractive index n o , the lens stack 600 imparts to light a refractive index that corresponds to: [ka] where R represents the radial size of the birefringent lens 604 and the isotropic lens 608.

[0154] 6C, the polarization-selective lens stack 600 is illustrated in operation when incident light 616, e.g., linearly polarized light, has a direction of polarization perpendicular to the direction of the optical axis 602. Under this condition, light passing through the birefringent lens 604 is normally o , which is the same as the index of refraction experienced by light passing through isotropic lens 608, so lens stack 600 imparts to light a refractive power that can be expressed as: [ka] where R represents the radial size of the birefringent lens 604 and the isotropic lens 608.

[0155] 6A-6C, in some embodiments, the isotropic lens 608 may be formed from an isotropic material, such as glass, acrylic, etc. On the other hand, the birefringent lens 604 may be formed from or consist of a birefringent material, such as liquid crystal, according to various embodiments. For example, the birefringent lens 604 may comprise a transparent substrate, such as a glass substrate, having liquid crystal (LC) molecules formed thereon that are elongated along a lateral direction (e.g., x-direction or y-direction) perpendicular to the light propagation direction (e.g., z-direction).

[0156] However, embodiments are not so limited and in other embodiments, the birefringent lens 604 may be formed or comprised of suitable birefringent materials other than LC. For example, the birefringent lens 604 may include, for example, BaB2O4, Be3Al2(SiO3)6, CaCO3, LiNbO3, TiO2, SiC, tourmaline, and ZrSiO4, to name a few. Polarization selective lens stack with birefringent fresnel and isotropic lenses for adaptive lens assemblies - Patent Application 20070233633

[0157] 6A-6C, a lens stack comprising a birefringent lens, e.g., an LC-based birefringent lens, and an isotropic lens, can provide a polarization-selective lens effect. Below, a polarization-selective lens stack comprising a liquid crystal-based birefringent lens configured as a Fresnel lens is described.

[0158] A Fresnel lens may comprise, for example, a thin plate-type lens, which comprises a fractional prismatic structure formed by dividing a conventional curved (e.g., spherical) lens into a set of sections, e.g., concentric annular sections, known as Fresnel zones. The Fresnel zones replace the continuous curvature of a continuous refractive lens with a set of identically shaped surfaces having discontinuities therebetween. Substantial reductions in thickness can be achieved by employing such fractional sections, and lenses with relatively large apertures can be manufactured using smaller volumes of material.

[0159] 7A illustrates a cross-sectional side view of the lens stack 600, described above with respect to FIGS. 6A-6C , annotated with relevant optical dimensions, including the distance R from the focal point to a given location on the birefringent lens 604, the radial distance A from a central axis (e.g., optical axis) of the lens stack 600 to the given location, the angle θ subtended by the distances R and A, and the thickness d of the curved portion of the birefringent lens 604. As described above, in various implementations, the birefringent lens 604 and the isotropic lens 608 have substantially the same radii of curvature, such that the birefringent lens 604 and the isotropic lens 608 are in persistent contact along an interface formed therebetween, having a radius of curvature R.

[0160] FIG. 7B illustrates a cross-sectional side view 700A (top) and a top-down view 700B (bottom) of a lens stack 700 comprising a birefringent Fresnel lens 704 and a counterpart lens, e.g., an isotropic Fresnel lens 708. By employing the Fresnel lens 704, the groove thickness d' of the curved portion of the birefringent lens 704 can be substantially reduced. Despite the substantially reduced thickness d', the lens stack 700 has a corresponding curvature, such as an effective radius of curvature R, which corresponds to the actual radius of curvature R of the conventional lens illustrated with respect to FIG. 7A. Thus, although not illustrated, the lens stack 700A additionally has a radial distance A of a given Fresnel zone or groove 706 from the central axis of the lens stack 700. k and distances R and A k 7B, despite the grooves separating the Fresnel zones, the birefringent Fresnel lens 704 and the isotropic lens 708 are in continuous contact throughout the interface formed therebetween, which has an effective radius of curvature R. In some embodiments, successive Fresnel zones in the radially outward direction are spaced at different radial distances A. k and different distances between adjacent grooves 706. For example, in the illustrated embodiment, the distance between adjacent Fresnel zones is smaller in the radially outward direction of the birefringent Fresnel lens 704. However, embodiments are not so limited, and in other embodiments, the radial distance A of successive Fresnel zones may be smaller than the radial distance A of adjacent Fresnel zones. k can increase linearly with a constant distance between adjacent Fresnel zones while having different groove thicknesses within each zone, providing a similar or identical optical effect as the illustrated embodiment.

[0161] 7B (bottom), a birefringent Fresnel lens 704 is shown comprising multiple concentric Fresnel zones according to some embodiments. kThe birefringent lens 704 has a plurality of grooves 716 that form boundaries of the Fresnel zones 712 at a distance from the central axis represented by d′. According to various embodiments, the groove thickness d′ of the birefringent lens 704 is designed such that the path length is a multiple of the design wavelength λ. This arrangement can create a 2 nm phase jump between the zones, leading to identical wavefronts. The value of d′ can be selected (e.g., optimized) to balance fabrication tolerances and reduce or minimize aberrations that may result from the sharp edges of the grooves 716. In one example, the radius R of the kth Fresnel zone can be calculated by setting the thickness of the curved region to be kd′ according to the following equation: [ka] where k represents the number of Fresnel zones counted from the center of the lens, and the groove thickness d' is constant across the surface of the illustrated birefringent Fresnel lens 704.

[0162] In some embodiments, the birefringent Fresnel lens 704 includes LC. The LC molecules may be laterally aligned or have an elongation direction that extends substantially in the lateral direction 720 (e.g., y direction) indicated by the arrow. In addition, the alignment direction of the LC molecules may be substantially uniform throughout the thickness of the birefringent Fresnel lens 704 without undergoing rotation. That is, the local director n of the LC molecules may be substantially constant laterally across the area of ​​the birefringent Fresnel lens 704 and vertically across its thickness (e.g., in the z direction). The illustrated alignment may be suitable, for example, to provide polarization selectivity for linearly polarized light. In these embodiments, linearly polarized light with a polarization direction (e.g., y direction) parallel to the direction of the LC alignment will be aligned with n e or n o whereas linearly polarized light, with its polarization direction perpendicular to the direction of LC alignment (e.g., x-direction), can experience one of n e or n oAs a result, lens stack 700 provides an optical power of Δn / R for light having one linear polarization while providing substantially zero optical power for light having the other linear polarization, as described above.

[0163] In various embodiments herein, and throughout the specification, the birefringent Fresnel lens 704 can have a typical, local, average, median, maximum, or minimum birefringence Δn of 0.05-0.10, 0.15-0.20, 0.20-0.25, 0.25-0.30, 0.30-0.35, 0.35-0.40, 0.40-0.45, 0.45-0.50, 0.50-0.55, 0.55-0.60, 0.60-0.65, 0.65-0.70, or any value within any range defined by any of these values, e.g., 0.05-0.40. Additionally, the birefringent Fresnel lens 704 can have an intra-layer birefringence (Δn) range of 0.01 to 0.05, 0.05 to 0.10, 0.15 to 0.20, 0.20 to 0.25, 0.25 to 0.30, 0.30 to 0.35, 0.35 to 0.40, or any value within any range defined by any of these values.

[0164] In various embodiments herein, and throughout the specification, the birefringent Fresnel lens 704 has a thickness of about 0.1 μm to 200 μm, 0.1 to 5 μm, 5 to 50 μm, 50 to 100 μm, 100 to 150 μm, 150 to 200 μm, or any range value defined by these values, for example, 5 to 200 μm. Adaptive lens assembly comprising a polarization selective lens stack coupled with a switchable waveplate - Patent Application 20070123633

[0165] To provide images at multiple depth planes with high efficiency over a wide range of the visible spectrum, an adaptive lens assembly according to various embodiments includes a polarization-selective lens stack (e.g., 600 in FIGS. 6A-6C, 700 in FIG. 7B) that comprises a birefringent lens and an isotropic lens. According to various embodiments, the adaptive lens assembly can be selectively switched between multiple states with different refractive powers. Below, an adaptive lens assembly is disclosed in which the selective switching is performed by activating or deactivating a switchable waveplate that is coupled to a polarization-selective lens included within the adaptive lens assembly according to an embodiment.

[0166] 8A, in some embodiments, an adaptive lens assembly 800A is configured to be activated or deactivated by employing a switchable waveplate 804 comprising LC in the same optical path as the above-described polarization-selective lens stack 700, comprising a birefringent Fresnel lens 704 and an isotropic lens 708. The Fresnel lens 704 may be formed using LC or other birefringent materials. The adaptive lens assembly 800A may be selectively switched between different states by electrically activating and deactivating the switchable waveplate 804 (or otherwise changing the state of the waveplate, e.g., by applying different voltages). One example of a switchable waveplate 804 is illustrated with respect to FIG. 8B.

[0167] 8B, in some embodiments, the switchable waveplate 802 may be a half-waveplate or polarization rotator comprising a layer 802 of non-polymerized twisted nematic (TN) liquid crystal (LC), or a reactive mesogen (RM) comprising TN LC molecules configured to be switched in response to application of an electric field across the thickness of the layer 802 of TN LC. The layer 802 of TN LC is disposed between a pair of transparent substrates 812. The transparent substrates 812 each have a conductive transparent electrode 816, 820 formed on an inner surface. In some embodiments, the transparent electrodes 816, 820 may serve as a substrate, and one or both of the substrates 812 may be omitted.

[0168] The surfaces of the transparent electrodes 816, 820 and / or substrate 812 may be configured such that TN LC molecules in contact with or directly adjacent to the upper electrode 816 tend to be oriented with their long axes extending in a first lateral direction, while TN LC molecules in contact with or directly adjacent to the lower electrode 820 tend to be oriented with their long axes extending in a second lateral direction that may intersect, for example, to form an angle of about 90 degrees with the first lateral direction. Thus, the TN LC molecules between the electrodes 816, 820 undergo a twist.

[0169] Still referring to FIG. 8B (left), in operation, in the absence of an electric field across the TN LC layer 802 (deactivated state), the nematic director of the TN LC molecules undergoes a smooth 90 degree twist across the thickness of the TN LC layer 802. As shown, incident light 808 polarized in a first direction (the same direction as the LC molecules closest to the bottom electrode 812) is incident on the TN LC layer 802. The twisted arrangement of the TN LC molecules in the TN LC layer 802 acts as an optical waveguide, rotating the plane of polarization a quarter turn (90 degrees) before the light reaches the top electrode 816. In this state, the TN LC layer 802 acts to shift the polarization direction of linearly polarized light passing therethrough from one linear polarization direction to another. Thus, the transmitted light 806A is polarized in a second direction (the same direction as the LC molecules adjacent to the top electrode 816), opposite to the first direction.

[0170] On the other hand, when a voltage exceeding the threshold voltage (V>Vth) of the TN LC switchable waveplate 804 is applied across the electrodes 816, 820 (right, activated state), the TN LC molecules in the TN LC layer 802 tend to align with the resulting electric field, and the optical wave guiding properties of the TN LC layer 802 described above with respect to the deactivated state are lost. In this state, the TN LC layer 802 serves to preserve the polarization direction of the light passing through it. Thus, the incident light 808 and the transmitted light 806B are polarized in the same first direction (the same direction as the LC molecules closest to the bottom electrode 820). When the electric field is turned off, the TN LC molecules relax back to their twisted state, and the TN LC molecules of the TN LC layer 802 in the activated state return to the configuration of the TN LC molecules of the TN LC layer 802 in the deactivated state (left).

[0171] Still referring to FIG. 8A, in operation, as described above, the polarization-selective lens stack 700 imparts a lens refractive power to incident light 820 passing therethrough, depending on the polarization direction of the incident light 820. After a refractive power is imparted thereto or not, depending on the relative polarization direction of the incident light, the light is incident on the switchable waveplate 804. As described above, the LC of the switchable waveplate 804 is configured such that when activated, e.g., electrically activated, the polarization of linearly polarized light passing therethrough is preserved, while when deactivated, e.g., electrically deactivated, the polarization of linearly polarized light passing therethrough is altered, e.g., flipped or rotated. That is, a linearly vertically polarized (LVP) light beam is converted to a linearly horizontally polarized (LHP) light beam, or vice versa, or the polarization is preserved, depending on whether the switchable waveplate 804 is activated or deactivated.

[0172] In operation, the LC of the birefringent Fresnel lens 704 is configured such that when the polarization direction of the linearly polarized incident light 820 light is parallel to the optics axis of the birefringent Fresnel lens 704, the polarization-selective lens stack 700 imparts a refractive power thereto, as described above with respect to Fig. 6B, while when the polarization direction of the linearly polarized incident light 820 light is perpendicular to the optics axis, the polarization-selective lens stack 700 imparts a substantially zero refractive power thereto, as described above with respect to Fig. 6C. After passing through the birefringent lens stack 700, when activated, e.g., electrically activated, the polarization of the linearly polarized light passing through the switchable waveplate 804 is preserved, while when deactivated, e.g., electrically deactivated, the polarization of the linearly polarized light passing through the switchable waveplate 804 is flipped or rotated due to the reorientation of the liquid crystal molecules.

[0173] With respect to Figures 8A-8B, an adaptive lens assembly is described that includes a passive polarization selective lens stack coupled with a waveplate (Figure 8A) for switchably providing a lens power. The inventors recognize that by arranging a number of such elements, an adaptive lens assembly having a number of different lens powers can be formed. Thus, hereinafter, an embodiment of an adaptive waveplate lens assembly is disclosed that includes a number of passive polarization selective lens stacks coupled with a waveplate. Such an adaptive lens assembly may be integrated with a waveguide on either the user side or the world side to form, for example, a display device as described with respect to Figures 3A and 3B.

[0174] 9A illustrates an example of an adaptive lens assembly 900 comprising a plurality of passive polarization-selective lens stacks and a plurality of waveplates arranged in an alternating manner to impart a plurality, e.g., at least four possible refractive powers, to light passing therethrough. The adaptive lens assembly 900 comprises, in order of light passing therethrough, a first switchable waveplate (HWP1) 804-1, e.g., a half-waveplate, a first polarization-selective lens stack (L1) 700-1, and a second switchable waveplate (HWP2) 804-2, e.g., a half-waveplate, and a second polarization-selective lens stack (L2) 700-2. HWP1 804-1 and HWP2 804-2 are each configured in a manner similar to that described above with respect to FIGS. 8A and 8B. In addition, L1 700-1 and L2 700-2 are configured in a manner similar to that described above with respect to Figures 6A-6C, 7A-7B, and 8A-8B, respectively. However, the first and second polarization-selective lens stacks 700-1, 700-2 have different optical axes, different curvatures (e.g., effective radii of curvature), and / or different birefringence. That is, L1 700-1 has a first optical axis (extending in the vertical or y-direction) and is configured to impart a first refractive power φ1 of Δn1 / R1 or substantially zero to light incident thereon having a polarization direction parallel or perpendicular to the optical axis, respectively, while 700-2 has a second optical axis (extending in the horizontal or x-axis) and is configured to impart a second refractive power φ2 of Δn2 / R2 or substantially zero to light incident thereon having a polarization direction parallel or perpendicular to the optical axis, respectively.

[0175] 9B-9E illustrate the adaptive lens assembly 900 in operation for incident light 820 with polarization parallel to the optical axis of L1 700-1 in four different states corresponding to HWP1 804-1 / HWP2 804-2 being deactivated (OFF) / deactivated (OFF) (FIG. 9B), activated (ON) / activated (ON) (FIG. 9C), off / on (FIG. 9D), and on / off (FIG. 9E). As explained above, HWP1 804-1 and HWP2 804-2 can be turned off and on or deactivated and activated by removing and applying a voltage across the TN LC layer, respectively. Each of HWP1 804-1 and HWP2 804-2 is configured to modify, e.g., rotate or flip, the polarization state of light passing therethrough when electrically deactivated (off), while being configured to substantially pass light without modifying the polarization state of light passing therethrough when activated (on). An electrical signal, e.g., a current signal or a voltage signal, for switching each of HWP1 804-1 and HWP2 804-2 may be provided by a switching circuit (not shown) electrically connected thereto. For illustrative purposes, in the following, both HWP1 804-1 and HWP2 804-2 are TN LC cells with optical axes along the y and x directions, respectively, in their two substrates, similar to FIG. 8B. In the illustrated embodiment, the incident light 820 has a polarization parallel to the y direction, i.e., linear vertical polarization (LVP). However, it should be understood that the polarization axis of the incident light 820 may be polarized in different directions, for example, linear horizontal polarization (LHP), to achieve different optical power states.

[0176] 9B, HWP1 804-1 and HWP2 804-2 are each configured to rotate the polarization of linearly polarized light having one of the LVP and LHP to linearly polarized light having the other of the LVP and LHP in an off state. Thus, in response to passing through HWP1 804-1, incident light 820 having LHP is converted to light 824 having LHP incident on L1 700-1, which imparts substantially zero refractive power (φ1=0) due to the relative orthogonal orientation between the polarization of light 824 and the optical axis of L1 700-1. Then, light 828 having LHP incident on HWP2 804-2 is converted to light 832 having LVP. L2 700-2 imparts substantially zero refractive power (φ=0) due to the relative orthogonal orientation between the polarization of L2 700-2 and the optical axis of L2 700-2. In essence, the adaptive lens assembly 900 imparts a net refractive power φ+φ equal to approximately zero to the incident light 820 with LVP and does not alter its polarization, thereby outputting light 836 with LVP.

[0177] 9C, HWP1 804-1 and HWP2 804-2 are each configured to be in an on state and to preserve the polarization of linearly polarized light passing therethrough. Thus, the polarization of incident light 820, with an LVP, is preserved in light 824 incident on L1 700-1 in response to passing through HWP1 804-1, which imparts a refractive power (φ1) due to the relative parallel orientation between the polarization of light 824 and the optical axis of L1 700-1. The polarization of light 828, with an LVP, incident on HWP2 802-2 is then preserved in light 832. L2 700-2 imparts substantially zero refractive power (φ2=0) due to the relative orthogonal orientation between the polarization of light 832 and the optical axis of L2 700-2. In essence, adaptive lens assembly 900 imparts a net optical power φ1+φ2 equal to approximately φ1 to incident light 820, having an LVP, and outputs light 836, having an LVP.

[0178] 9D, HWP1 804-1 is in an off state and configured to rotate the polarization of linearly polarized light having one of the LVP and LHP to linearly polarized light having the other of the LVP and LHP, while HWP2 804-2 is in an on state and configured to preserve the polarization of the linearly polarized light. Thus, in response to passing through HWP1 804-1, incident light 820 having LVP is converted to light 824 incident on L1 700-1 having HVP, which imparts substantially zero refractive power (φ1=0) due to the relative orthogonal orientation between the polarization of light 824 and the optical axis of L1 700-1. The polarization of light 828 having HVP passing through HWP2 802-2 is then preserved in light 832. Light 832 incident on L2 700-2 has an HVP, which imparts a refractive power (φ2) due to the relative parallel orientation between the polarization of light 832 and the optical axis of L2 700-2. In essence, the adaptive lens assembly 900 imparts a net refractive power φ1+φ2 equal to approximately φ2 to the incident light 820, having an LVP, and outputs light 836, having an LHP.

[0179] 9E, HWP1 804-1 is in an on state and configured to preserve the polarization of linearly polarized light, while HWP2 804-2 is in an off state and configured to rotate the polarization of linearly polarized light having one of the LVP and LHP to linearly polarized light having the other of the LVP and LHP. Thus, the polarization of the incident light 820 having LVP is preserved in the light 824 that is incident on L1 700-1 having LVP in response to passing through HWP1 804-1, which imparts a refractive power (φ1) due to the relative parallel orientation between the polarization of the light 824 and the optical axis of L1 700-1. The light 828 having LVP that passes through HWP2 804-2 is then converted to light 832 having HVP. L2 700-2 imparts a refractive power (φ2) due to the relative parallel orientation between the polarization of light 832 and the optical axis of L2 700-2. In essence, the adaptive lens assembly 900 imparts a net refractive power φ1+φ2 to the incoming light 820, having an LVP, and outputs light 836, having an LHP.

[0180] 9A-9E, for light with linear polarization, four possible net refractive powers (0, φ1, φ2, and φ1+φ2) can be imparted on light passing through adaptive lens assembly 900. Using a numerical example, for φ1=0.75D and φ2=1.5D for the design wavelength, net refractive powers of 0, 0.75D, 1.5D, and 2.25D can be obtained using adaptive lens assembly 900.

[0181] 9A-9E, in conjunction with FIGs. 3A and 3B, in the illustrated embodiment, incident light 820 may represent a light beam incident on either the world-side adaptive lens assembly 204 or the user-side adaptive lens assembly 208. By installing an adaptive lens assembly 900 on one or both sides, for example, the display system described above with respect to FIGs. 3A and 3B can be implemented in accordance with various embodiments as described herein. Display device including an adaptive lens assembly having a polarization selective lens stack coupled to a non-polarizing waveguide assembly - Patent 7326635

[0182] In the following example implementations, an adaptive lens assembly comprising a plurality of switchable polarization-selective lens stacks (e.g., adaptive lens assembly 900, Figures 9A-9E) is integrated into a display device, such as the display devices described above with respect to Figures 2, 3A, and 3B.

[0183] 10 illustrates an exemplary display device 1000 including a waveguide assembly 1012 interposed between a first, or front, adaptive lens assembly (FLA) 1004 and a second, or back, adaptive lens assembly (BLA) 1008. The display device 1000 can be similar to the display devices 300A, 300B described above with respect to FIGS. 3A and 3B. In the illustrated embodiment, the BLA 1008 is configured similarly to the adaptive lens assembly 900 described above with respect to FIGS. 9A-9E and includes a first switchable waveplate (HWP1) 804-1, a first polarization-selective lens stack (L1) 700-1, a second switchable waveplate (HWP2) 804-2, and a second polarization-selective lens stack (L2) 700-2. The first and second polarization-selective lens stacks 700-1, 700-2 have different, e.g., orthogonal optic axes, curvatures (e.g., effective radii of curvature), and / or different birefringence such that L1 700-1 is configured to impart a first refractive power φ1 of n1 / R1 or substantially zero with respect to light incident thereon having a polarization direction parallel or perpendicular to the optic axis, respectively, while L2 700-2 is configured to impart a second refractive power φ2 of n2 / R2 or substantially zero with respect to light incident thereon having a polarization direction parallel or perpendicular to the optic axis, respectively.

[0184] The FLA 1004 includes a third switchable waveplate (HWP3) 804-3, a third polarization-selective lens stack (L3) 700-3, a fourth switchable waveplate (HWP4) 804-4, and a fourth polarization-selective lens stack (L4) 700-4. The third and fourth polarization-selective lens stacks 700-3, 700-4 have different, e.g., orthogonal optical axes, effective radii of curvature, and / or different birefringence such that L3 700-3 is configured to impart a third refractive power φ of n / R or substantially zero to light incident thereon having a polarization direction parallel or perpendicular to the optic axis, respectively, while L4 700-4 is configured to impart a fourth refractive power φ of n / R or substantially zero to light incident thereon having a polarization direction parallel or perpendicular to the optic axis, respectively.

[0185] In various embodiments, the effective radii of curvature of L1 700-1 and L2 700-2 are such that φ1 and φ2 have a first sign, e.g., a positive sign, while the effective radii of curvature of L3 700-3 and L4 700-4 are such that φ3 and φ4 have a second sign opposite to the first sign, e.g., a negative sign. That is, when the three possible non-zero net refractive powers of FLA 1004 (φ1, φ2, and φ1+φ2) may have one of a convergence or divergence effect (e.g., convergence), the three possible non-zero net refractive powers of BLA 1008 (φ3, φ4, and φ3+φ4) may have the other of a convergence or divergence effect (e.g., divergence). In the illustrated embodiment, the FLA 1004 and the BLA 1008 are configured to be substantially identical except for the curvature of the interface between the birefringent lens and the isotropic lens (e.g., one is concave and the other is convex, or vice versa). In particular, the FLA 1004 and the BLA 1008 form mirror images around the waveguide assembly 1012. Thus, as configured, L1 804-1 and L3 804-3 have refractive powers φ1 and φ3, respectively, that are substantially identical in magnitude but opposite in sign, and L2 804-2 and L4 804-4 have refractive powers φ2 and φ4, respectively, that are substantially identical in magnitude but opposite in sign. That is, φ1 is approximately equal to -φ3, and φ2 is approximately equal to -φ4.

[0186] Still referring to Fig. 10, in the illustrated embodiment, the waveguide assembly 1012 is configured to outcouple unpolarized light that has been totally internally reflected. In this configuration, the display device 1000 additionally includes a linear polarizer 1005 between the waveguide assembly 1012 and the BLA 1008, configured to reduce or eliminate, e.g., reflect or absorb, light having a polarization state that does not lead to lensing by the BLA 1008. For example, in an arrangement in which the light 1009 outcoupled from the waveguide assembly 1012, or the light 1020 transmitted unaffected through the FLA 1004 is not linearly polarized, e.g., not LVP, the linear polarizer 1005 serves to linearly polarize the transmitted light and send the incident light 820 into the BLA 1008.

[0187] As configured, the BLA 1008 serves to provide variable refractive power (φ1, φ2, and φ1+φ2) and shape images into multiple depth planes for a virtual image to emerge from the waveguide assembly 1012 towards the user's eye. While the BLA 1008 provides the virtual image by focusing the image from the waveguide assembly 1012 into multiple depth planes, the world image may be distorted by the BLA 1008. The FLA 1004 serves to compensate for the distortion of the world image caused by the BLA 1008 by providing variable refractive power (φ3=-φ1, φ4=-φ2, and φ3+φ4=-(φ1+φ2)) such that the world image is presented to the user's eye without substantial distortion.

[0188] In various embodiments, for example, when deactivated, the FLA 1004 and BLA 1008, respectively, may provide a net optical power (positive or negative) within a range of approximately ±5.0 diopters to 0 diopters, ±4.0 diopters to 0 diopters, ±3.0 diopters to 0 diopters, ±2.0 diopters to 0 diopters, ±1.0 diopters to 0 diopters (including any range defined by any of these values, e.g., ±1.5 diopters). In some embodiments, the FLA 1004 between the waveguide assembly 1012 and the world may have a positive optical power, while the BLA 1008 between the waveguide assembly 1012 and the user may have a negative optical power, such that the optical powers of the FLA 1004 and BLA 1008 compensate each other when viewing the world.

[0189] As described above, as the image of the virtual object produced by the light outcoupled by the waveguide assembly 1012 moves in 3D, the net refractive power of the BLA 1008 on the user side is adjusted to match the changing depth of the virtual depth plane. At the same time, according to an embodiment, the net refractive power of the FLA 1004 is also correspondingly adjusted using switching circuitry so that the view of the real world does not become undesirably defocused or distorted. To address this and other needs, in some embodiments, the display device 1000 comprises a controller (not shown) configured such that when the net refractive power of one of the FLA 1004 and the BLA 1008 is electrically adjusted, the net refractive power of the other of the FLA 1004 and the BLA 1008 is correspondingly adjusted so that the combined net refractive power remains approximately constant, e.g., approximately zero. The controller circuitry and switchable waveplates are configured such that the time to switch between HWPI 804-1, HWP2 804-2, HWP3 804-3, and HWP4 804-4, to adjust the virtual depth plane using the user side adaptive lens assembly 1008, and to compensate for the real world view using the user side adaptive lens assembly 1004 is less than about 100 milliseconds, less than about 50 milliseconds, less than about 10 milliseconds, less than about 5 milliseconds, less than about 1 millisecond, or a value within a range defined by any of these values. Display device including an adaptive lens assembly having a polarization selective lens stack coupled to a polarizing waveguide assembly - Patent 7326635

[0190] 11A illustrates an exemplary display device 1100 according to some embodiments. Similar to the display device described above with respect to FIG. 10, the display device 1100 includes a second adaptive lens assembly (BLA) 1008 including a first switchable waveplate (HWP1) 804-1, a first polarization-selective lens stack (L1) 700-1, a second switchable waveplate (HWP2) 804-2, and a second polarization-selective lens stack (L2) 700-2. However, unlike the display device described above with respect to FIG. 10, the display device 1100 includes a polarizing waveguide assembly 1112 that outcouples polarized light 1108, e.g., circularly polarized light, into the BLA 1008. Thus, the BLA 1008 additionally includes a first quarter-wave plate (QWP1) 1104, e.g., an achromatic quarter-wave plate, configured to convert the RHCP light 1108-R and LHCP light 1108-L outcoupled from the polarizing waveguide assembly 1112 into linearly polarized light 820 incident on the BLA 1008. The BLA 1008 thus operates in a similar manner as described above with respect to FIG.

[0191] However, unlike the display device 1000 of FIG. 10, the display device 1100 does not have an FLA 1004 configured to compensate or offset the undesired refractive power imparted by the BLA 1008 to the world-side light 1020 when the BLA 1008 imparts refractive power to the light from the polarizing waveguide assembly 1112 containing the virtual image information. Instead, the display device 1100 is configured to alternately display the world image and the virtual image. This is achieved by replacing the FLA 1004 (FIG. 10) with a combination of a shutter 1120, a linear polarizer 1116, and a second quarter-wave plate (QWP2) 1114, e.g., an achromatic quarter-wave plate. In the following, the polarizing waveguide assembly 1112 is described with respect to FIG. 11B, followed by the operation principle of the display device 1100 with respect to FIGS. 11C and 11D.

[0192] FIG. 11B illustrates an example of a polarizing waveguide assembly 1112, according to an embodiment. In some embodiments, the polarizing waveguide assembly 1112 is configured to output circularly polarized light, e.g., right-handed (RHCP) or left-handed (LHCP) circularly polarized light. In various embodiments, the polarizing waveguide assembly 1112 may comprise a cholesteric liquid crystal (CLC) layer and / or a CLC grating (CLCG), which in turn comprises liquid crystals arranged to have a plurality of chiral structures. Each chiral structure comprises a plurality of liquid crystal molecules that extend in the layer depth direction by at least a helical pitch and are rotated in a rotation direction successively. The CLC layer or CLCG can be advantageously configured to substantially Bragg reflect elliptically or circularly polarized light with a handedness of polarization that matches the rotation direction of the liquid crystal molecules, while substantially transmitting elliptically or circularly polarized light with a handedness of polarization that is opposite to the rotation direction of the liquid crystal molecules. Based on these properties of CLC layers and CLCGs, various embodiments of display devices disclosed herein have a polarizing waveguide assembly 1112 comprising one or more CLC layers or CLCGs. The polarizing waveguide assembly 1112 may include a CLCG 1150 configured as an out-coupling optical element such as an exit pupil expander (EPE), according to an embodiment. The polarizing waveguide assembly 1112 comprises a waveguide 1104 coupled to the CLCG 1150 and configured to propagate light by total internal reflection (TIR).

[0193] Still referring to FIG. 11B, the liquid crystal molecules of the illustrated CLCG 1150 are continuously rotated in the rotation direction, and the alignment of the liquid crystal molecules of the chiral structure varies periodically in the lateral direction (x, y direction) perpendicular to the layer depth direction (z direction). Due to the rotation alignment of the liquid crystal molecules, when the light 2604 is elliptically / circularly polarized light with a polarization handedness, e.g., one of left-handedness or right-handedness, which matches the direction of rotation of the liquid crystal molecules of the chiral structure, the light 2604 is Bragg-reflected by the CLCG 1150. That is, the rotation alignment of the liquid crystal molecules in the CLCG 1150 is such that the CLCG 1150 selectively Bragg-reflects light with a certain handedness, while non-Bragg-reflecting or transmitting light with the opposite handedness. In addition, because Bragg reflection occurs under diffractive conditions, the Bragg-reflected light 1108 is unidirectional (e.g., most of the light is directed toward one direction upon outcoupling, such as the direction indicated by the arrow 1108 in FIG. 11B). The outcoupling light can preserve a uniform polarization state, which corresponds to the chirality of the CLC material. Thus, when configured as an optical outcoupling element, the CLCG 1150 acts as a polarizer and a unidirectional reflector, which allows for efficient integration with other optical components within the display device 1100.

[0194] As described above, the display device 1100 is configured to alternately display a world image (FIG. 11C) and a virtual image (FIG. 11D). Referring to FIG. 11C, when displaying a world image, the display device 1100 has a configuration 1100C in which both the shutter 1120 and the waveguide assembly 1112 are in an off state. In addition, both HWP-1 820-1 and HWP-2 820-2 are in an on state and an off state, respectively. As configured, the BLA 1008 is configured similarly to the state 900B described above with respect to FIG. 9B. Under this configuration, the unpolarized light 1020 from the world is essentially unaffected and transmitted through the shutter 1120 and linearly polarized by the linear polarizer 1116 into light 1124, e.g., horizontally linearly polarized (LHP). The light 1124 is converted to circularly polarized light 1108-L, e.g., LHCP light, which is incident on the polarizing waveguide assembly 1112. The light 1108-L passes essentially unaffected through the polarizing waveguide assembly 1112 in the off state and is converted by the QWP1 1104 to linearly polarized linearly polarized light 820-2, e.g., LHP. The BLA 1008 is configured to impart substantially zero optical power, similar to the state described above with respect to FIG. 9B, thereby allowing the light 820-2 to pass essentially unaffected as seen by the eye.

[0195] 11D, when displaying a virtual image, the display device has a configuration 1100D in which both the shutter 1120 and the waveguide assembly 1112 are in an on state. Thus, any light 1020 from the world side is blocked, e.g., reflected. Thus, the display device configuration 1100D is configured to display substantially only virtual content outcoupled from the polarizing waveguide assembly 1112, described above with respect to FIG. 11B. Light 1108-R, having circular polarization, e.g., RHCP, is incident on the QWP2 1104, and the BLA 1008 is configured similarly to one of the states 900C-900E described above with respect to FIGS. 9C-9E. Under this configuration, the circularly polarized light 1108-R is converted by the QWP2 1104 into linearly polarized light 820-1, having a polarization direction, e.g., vertical polarization direction (LVP). The BLA 1008 then imparts optical power according to one of the states 900C-900E described above with respect to Figures 9C-9E.

[0196] As described, the display device 1100 is configured to display the world image and the virtual image sequentially. To display both the world image and the virtual image to the user as if they were presented simultaneously, the configurations 1100C (FIG. 11C) and 1100D (FIG. 11D) are time-multiplexed with respect to each other at a suitable frequency so that the human eye perceives them as essentially simultaneous. For example, the shutters 1120 and HWP-1 820-1 and HWP-2 820-2 are alternated at a frequency at least twice as fast as the video refresh rate to minimize any switching artifacts. Advantageously, the display device 1100 can reduce the overall number of optical elements by replacing the FLA 1008 in the display device 1000. To compensate for the reduction in the intensity of the virtual image due to multiplexing and polarization, the intensity of the out-coupled light 1108-R can thus be adjusted according to an embodiment. Display device including a world-side and / or user-side shutter element and a user-side lens assembly - Patents.com

[0197] 12A illustrates an example of a display device 1200 having a single adaptive lens assembly 1208 on a user-side of the eyepiece 1212 (the side of the eyepiece 1212 closest to the user's eye) in accordance with some embodiments of the present disclosure. The lens assembly 1208 may include a variable focus element (VFE) assembly and may be configured to apply positive, negative, or zero optical power to light passing therethrough. The display device 1200 may include one or more world-side shutter elements 1204 coupled to the world-side of the eyepiece 1212 (the side of the eyepiece 1212 farthest from the user's eye and closest to world objects) and one or more user-side shutter elements 1202 coupled to the user-side of the eyepiece 1212. Sequentially, by electrically activating the world-side shutter element 1204 and the user-side shutter element 1202 as described herein, world light 432 may pass through the display device 1200 with a zero net refractive power applied by the lens assembly 1208, and virtual image light 423 may pass therethrough with a non-zero (e.g., negative) net refractive power applied by the lens assembly 1208.

[0198] In the illustrated embodiment, the world-side shutter element 1204 includes a world-side polarizer 1216 and a world-side switchable waveplate 1220. The world-side polarizer 1216 may be positioned closer to the world object 430 such that the world light 432 first passes through the world-side polarizer 1216 prior to passing through the world-side switchable waveplate 1220. In response to passing through the world-side polarizer 1216, the world light 432 is linearly polarized along a first axis. Thus, the world-side polarizer 1216 may comprise a linear polarizer. After passing through the world-side polarizer 1216, the world light 432 passes through the world-side switchable waveplate 1220. When electrically activated, the world-side switchable waveplate 1220 rotates the polarization of the world light 432 by 90 degrees, for example, such that LVP light is converted to LHP light or LHP light is converted to LVP light. When not electrically activated, the world-side switchable waveplate 1220 leaves the world light 432 substantially unaltered.

[0199] In the illustrated embodiment, the user side shutter element 1202 includes a user side polarizer 1214 and a user side switchable waveplate 1218. The user side polarizer 1214 may be positioned closer to the eyepiece 1212 and the world object 430 such that the virtual image light 423 and the world light 432 first pass through the user side polarizer 1214 prior to passing through the user side switchable waveplate 1218. In response to passing through the user side polarizer 1214, the virtual image light 423 and the world light 432 are linearly polarized along a second axis perpendicular to the first axis. Thus, the user side polarizer 1214 may comprise a linear polarizer perpendicular to the world side polarizer. After passing through the user side polarizer 1214, the virtual image light 423 and the world light 432 pass through a first layer of the lens assembly 1208. As described herein, the first layer of the lens assembly 1208 may apply a refractive power to light passing therethrough. After passing through the first layer of the lens assembly 1208, the virtual image light 423 and the world light 432 pass through the user-side switchable waveplate 1214. When electrically activated, the user-side switchable waveplate 1214 rotates the polarization of the virtual image light 423 and the world light 432 by 90 degrees, for example, such that LVP light is converted to LHP light or LHP light is converted to LVP light. When not electrically activated, the user-side switchable waveplate 1214 leaves the virtual image light 423 and the world light 432 substantially unaltered.

[0200] After passing through the user-side switchable waveplate 1218, the virtual image light 423 and world light 432 pass through a second layer of the lens assembly 1208. As described herein, the second layer of the lens assembly 1208 may apply a refractive power to the light passing therethrough to offset or add to the refractive power applied to the light when passing through the first layer. For example, the first and second layers of the lens assembly 1208 may be configured such that when the user-side switchable waveplate 1218 is electrically activated, light passing through both layers has a non-zero net refractive power applied to it, and when the user-side switchable waveplate 1218 is not electrically activated, light passing through both layers has zero net refractive power applied, i.e., no net refractive power applied. Thus, the first and second layers of lens assembly 1208 may be configured to apply a positive refractive power to light having a first linear polarization and a negative refractive power (with equal magnitude) to light having a second linear polarization that is orthogonal to the first linear polarization.

[0201] In some embodiments, the first and second layers of the lens assembly 1208 are diffractive waveplate lenses. In some embodiments, the lens assembly 1208 may take the form of a different type of VFE, such as an LC Fresnel lens, a deformable lens, or the like. In some embodiments, one or more components of the user-side shutter element 1202 are considered subcomponents of the lens assembly 1208 (i.e., are considered to be included within the lens assembly 1208). In one example, the user-side polarizer 1214 is considered a subcomponent of the lens assembly 1208. In another example, the user-side switchable waveplate 1218 is considered a subcomponent of the lens assembly 1208. In another example, both the user-side polarizer 1214 and the user-side switchable waveplate 1218 are considered subcomponents of the lens assembly 1208. Exemplary VFEs and other adaptive lens components that may represent or be implemented as part of one or more of the lens assemblies described herein are disclosed in U.S. patent application Ser. No. 15 / 902,927, filed Feb. 22, 2018 and published Aug. 23, 2018 as U.S. Patent Publication No. 2018 / 0239177, U.S. patent application Ser. No. 15 / 902,927, filed Feb. 22, 2018 and published Aug. 23, 2018 as U.S. Patent Publication No. 2018 / 0239147, and U.S. patent application Ser. No. 15 / 902,927, filed Feb. 22, 2018 and published Aug. 23, 2018 as U.S. Patent Publication No. 2018 / 0239147. No. 15 / 902,814, U.S. Patent Application No. 15 / 933,297, filed March 22, 2018 and published as U.S. Patent Publication No. 2018 / 0275394 on September 27, 2018, and U.S. Patent Application No. 16 / 006,080, filed June 12, 2018 and published as U.S. Patent Publication No. 2018 / 0356639 on December 13, 2018 (all of which are expressly incorporated by reference in their entirety herein).Additional examples of such components are provided in U.S. Provisional Patent Application No. 62 / 639,882, filed March 7, 2018 (Attorney Docket No. MLEAP.180PR), and U.S. Provisional Patent Application No. 16 / 158,041, filed October 11, 2018 (Attorney Docket No. MLEAP.183A), both of which are also expressly incorporated by reference in their entireties herein.

[0202] FIG. 12B illustrates an example of a display device 1200 operating according to a first state, according to some embodiments of the present disclosure. While operating according to the first state, the projector and input optics 1222 are turned off, the world-side switchable waveplate 1220 is electrically activated, and the user-side switchable waveplate 1218 is not electrically activated. The world light 432 is first linearly polarized along a first axis by the world-side polarizer 1216. The polarization of the world light 432 is then rotated 90 degrees by the world-side switchable waveplate 1220. The world light 432 is then linearly polarized by the user-side polarizer 1214 along a second axis perpendicular to the first axis. The first layer of the lens assembly 1208 then applies a first refractive power to the world light 432. The world light 432 then passes through the user-side switchable waveplate 1218 substantially unaltered. The second layer of lens assembly 1208 then applies a second refractive power equal in magnitude to the first refractive power but opposite in sign to the world light 432, thereby canceling the first refractive power. The world light 432 then reaches the user's eye.

[0203] 12C illustrates an example of a display device 1200 operating according to a second state, according to some embodiments of the present disclosure. While operating according to the second state, the projector and input optics 1222 are turned on, the world-side switchable waveplate 1220 is not electrically activated, and the user-side switchable waveplate 1218 is electrically activated. World light 432 impinging on the world-side polarizer 1216 is linearly polarized along a first axis by the world-side polarizer 1216. The world light 432 then passes through the world-side switchable waveplate 1220 substantially unaltered. The world light 432 is then linearly polarized along a second axis perpendicular to the first axis by the user-side polarizer 1214, completely or at least partially reducing, blocking, or dimming the world light 432. In parallel, the virtual image light 423 is projected by the projector and injection optics 1222 onto one or more waveguides of the eyepiece 1212. The virtual image light 423 is then outcoupled by the eyepiece 1212. The virtual image light 423 is then linearly polarized along a second axis by the user-side polarizer 1214. The first layer of the lens assembly 1208 then applies a first refractive power to the virtual image light 423. The polarization of the virtual image light 423 is then rotated 90 degrees by the user-side switchable waveplate 1218. The second layer of the lens assembly 1208 then applies a second refractive power to the virtual image light 423, equal in magnitude and having the same sign as the first refractive power, thereby doubling the applied refractive power. The virtual image light 423 then reaches the user's eye.

[0204] 13 illustrates a method 1300 of operating an optical system according to some embodiments of the present disclosure. One or more steps of the method 1300 may be performed in a different order than in the illustrated embodiment, and one or more steps of the method 1300 may be omitted during implementation of the method 1300. In some embodiments, one or more steps of the method 1300 may be implemented as a computer-readable medium or computer program product comprising instructions that, when executed by one or more computers, cause the one or more computers to perform, at least in part, some or all of the steps of the method 1300. Such a computer program product may be transmitted over a wired or wireless network within a data carrier signal carrying the computer program product.

[0205] In step 1302, light associated with the world object is received at the optical system. In step 1304, the light associated with the world object is linearly polarized along a first axis. In step 1306, it is determined whether the optical system is operating according to a first state or a second state. When the optical system is operating according to the first state, the method 1300 proceeds to step 1308. When the optical system is operating according to the second state, the method 1300 proceeds to step 1314. In step 1308, the polarization of the light associated with the world object is rotated 90 degrees. In step 1310, the light associated with the world object is linearly polarized along a second axis perpendicular to the first axis. In step 1312, zero net refractive power is applied to the light associated with the world object. The light associated with the world object then reaches the user's eye.

[0206] In step 1314, the light associated with the virtual image is projected onto an eyepiece of the optical system. In step 1316, the light associated with the virtual image is outcoupled by the eyepiece. In step 1318, the light associated with the world object and the light associated with the virtual image are linearly polarized along a second axis. In step 1320, the polarization of the light associated with the virtual image is rotated 90 degrees. In step 1322, a non-zero net optical power is applied to the light associated with the virtual image. The light associated with the virtual image then reaches the user's eye.

[0207] 14 illustrates a method 1400 of operating an optical system according to some embodiments of the present disclosure. One or more steps of the method 1400 may be performed in a different order than in the illustrated embodiment, and one or more steps of the method 1400 may be omitted during the performance of the method 1400. One or more steps of the method 1400 may be combined with one or more steps of the method 1300. In step 1402, ambient light is detected by an ambient light sensor. In step 1404, a shutter frequency is determined based on the detected ambient light. In step 1406, the optical system is caused to switch between operating according to a first state and operating according to a second state based on the shutter frequency.

[0208] FIG. 15 illustrates an example implementation of a method 1400 according to some embodiments of the present disclosure. The upper plot of FIG. 15 shows the detected ambient light intensity (e.g., as detected by the ambient light sensor 434, 534) as a function of time. The lower plot of FIG. 15 shows the state switching between the first state and the second state as a function of time, with the times aligned with the upper plot. At time T1, the user of the optical system is in a shaded outdoor area and the detected ambient light has a medium intensity. Based on the detected ambient light at time T1, a first shutter frequency is determined. Determining the shutter frequency may include determining a first period P1, which is the duration during which the optical system is operating according to the first state prior to switching to the second state, and a second period P2, which is the duration during which the optical system is operating according to the second state prior to switching to the first state. Alternatively or in addition, determining the shutter frequency may include determining a ratio P1 / P2, among other possibilities. Between times T1 and T2, the optical system is caused to switch between a first state and a second state based on the first shutter frequency.

[0209] At time T2, the user of the optical system is relocated in a low-light indoor area and the detected ambient light has a low intensity. Based on the detected ambient light at time T2, a second shutter frequency is determined to have a higher ratio P1 / P2 than the first shutter frequency. In other words, to improve the user experience and not overly dim the world light under low-light conditions, the shutter frequency may be adjusted to increase the amount of time that the world light is allowed to pass through the optical system. Between times T2 and T3, the optical system is caused to switch between the first state and the second state based on the second shutter frequency.

[0210] At time T3, the user of the optical system is relocated in an outdoor area with direct sunlight and the detected ambient light has a high intensity. Based on the detected ambient light at time T3, a third shutter frequency is determined to have a ratio P1 / P2 lower than both the first and second shutter frequencies. In other words, to improve the user experience and reduce world light under high light conditions, the shutter frequency may be adjusted to decrease the amount of time that world light is allowed to pass through the optical system. After time T3, the optical system is caused to switch between the first state and the second state based on the third shutter frequency.

[0211] FIG. 16A illustrates an example of a display device 1600 operating according to a first state, according to some embodiments of the present disclosure. The display device 1600 may include one or more components that are functionally equivalent or similar to one or more of those described above with reference to FIGS. 4A-4C, 5, 11A-11D, and / or 12A-12C. For example, the display device 1600 may have a single adaptive lens assembly 1605 on the user side of the eyepiece 1602 (the side of the eyepiece 1602 closest to the user's eye). The lens assembly 1605 may include a VFE assembly and may be configured to apply positive, negative, or zero optical power to light passing therethrough. The display device 1600 may include a shutter element 1603 coupled to the world side of the eyepiece 1602 (the side of the eyepiece 1602 farthest from the user's eye and closest to world objects). While operating according to the first state, the controller 1620 causes the projector 1614 to turn off, the lens assembly 1605 to be deactivated, and the shutter element 1603 to be open. When the shutter element 1603 is opened (i.e., electrically activated), the world light 432 passing therethrough is substantially unaltered. When the lens assembly 1605 is inactive, the lens assembly 1605 imparts zero net refractive power to the light passing therethrough (e.g., world light 432). Thus, while operating according to the first state, the world light 432 may be presented to the user substantially unaltered. As described in more detail below, in some examples, the display device 1600 may hold / maintain the first state for an extended period of time (e.g., indefinitely, or until the display device 1600 is requested to present virtual content to the user).

[0212] 16B illustrates an example of a display device 1600 operating according to a second state, according to some embodiments of the present disclosure. While operating according to the second state, the controller 1620 causes the projector 1614 to turn on, the lens assembly 1605 to activate, and the shutter element 1603 to close. When the shutter element 1603 is closed (i.e., not electrically activated), the world light 432 passing therethrough is substantially blocked. When the projector 1614 is turned on, the virtual image light 423 is projected onto the eyepiece 1602 and then outcoupled by the eyepiece 1602 towards the user's eye. When the lens assembly 1605 is active, the lens assembly 1605 imparts a non-zero net refractive power to the light passing therethrough (e.g., the virtual image light 423). Thus, while operating according to the second state, the display device 1600 may present to the user virtual content that is perceived by the user as being located at one or more of a variety of possible depths. As described in more detail below, in some examples, the display device 1600 may hold / maintain the second state for an extended period of time (e.g., indefinitely, or until the display device 1600 is requested to provide the user with a view of the environment). In some embodiments, the display device 1600 may control the shutter element 1603 and the lens assembly 1605 in a synchronized manner to rapidly alternate between the first and second states at a particular rate or frequency.

[0213] 16C illustrates an example of a display device 1600 operating according to a third state, according to some embodiments of the present disclosure. While operating according to the third state, the controller 1620 causes the projector 1614 to turn on, the lens assembly 1605 to be inactive, and the shutter element 1603 to be open. When the shutter element 1603 is opened (i.e., electrically activated), the world light 432 passing therethrough is substantially unaltered. When the projector 1614 is turned on, the virtual image light 423 is projected onto the eyepiece 1602 and then outcoupled by the eyepiece 1602 towards the user's eye. When the lens assembly 1605 is inactive, the lens assembly 1605 imparts zero net refractive power to the light passing therethrough (e.g., the world light 432 and / or the virtual image light 423). Thus, while operating according to the third state, display device 1600 may present to a user virtual content that is perceived by the user as being positioned at optical infinity.

[0214] Thus, in the third state, the display device 1600 does not need to activate the lens assembly 1605 while injecting light representing the virtual content at optical infinity into the eyepiece 1602, and thus may allow light from the real world to pass through to the user without any issues. As described in more detail below, in some examples, the display device 1600 may hold / maintain the third state for an extended period of time (e.g., to infinity or until the display device 1600 is requested to present virtual content below optical infinity). In some embodiments, the display device 1600 may control the shutter element 1603 and the lens assembly 1605 in synchronization to rapidly alternate between the second state and the third state to rapidly present some virtual content below optical infinity and other virtual content at optical infinity. Similar to what is described with reference to FIGS. 14 and 15, the shutter frequency of switching between the first state, the second state, and / or the third state may be determined based on the detected ambient light and / or the desired brightness of the virtual content.

[0215] As noted above, in some embodiments, the display device 1600 may not synchronously control the shutter element 1603 and the lens assembly 1605 to rapidly alternate between two or more states, but instead may selectively hold / maintain a single state (e.g., one of a first state, a second state, and a third state) or otherwise independently control the shutter element 1603 and the lens assembly 1605 over time. In at least some of these embodiments, the display device 1600 may be configured to alternate between at least two different operating modes including: (i) a first operating mode in which the display device 1600 is configured to control the state of the shutter element 1603 and the state of the lens assembly 1605 independently or otherwise in an asynchronous manner; and (ii) a second operating mode in which the display device 1600 is configured to control the state of the shutter element 1603 and the state of the lens assembly 1605 in a synchronous manner. For example, in a first operating mode, the display device 1600 may hold / maintain or otherwise independently control a single state (e.g., one of a first state, a second state, and a third state), and in a second operating mode, the display device 1600 may synchronously switch the shutter element 1603 and the lens assembly 1605 between two or more states (e.g., two or more of the first state, the second state, and the third state).

[0216] In some embodiments, in the first mode of operation, the display device 1600 may hold / maintain a state similar or equivalent to the second state for an extended period of time (e.g., indefinitely or until the display device 1600 is requested to provide a view of an environment to a user). In at least some such embodiments, the first mode of operation may correspond to a VR mode in which the controller 1620 causes the projector 1614 to turn on, the lens assembly 1605 to be optionally active, and the shutter element 1603 to be closed or otherwise maintained in a relatively dark state. Optionally, in the first mode of operation, the controller 1620 may cause the lens assembly 1605 to switch states as needed to impart an appropriate amount of optical power to the light from the projector. In such examples, controller 1620 may cause display device 1600 to transition into and / or out of a first operational mode based on any of a variety of factors, including user input (e.g., as indicated by data received from one or more sensors, a user interface, an input device, etc.), applications running on display device 1600, user preferences, sensor data, and the like. For example, controller 1620 may switch into a first operational mode to initiate a VR experience in which little or no see-through visibility of the environment in front of it is provided in response to a user launching or ending execution of a particular application on display device 1600, receiving an indication that the user desires to transition into such a mode or exit another mode based on input received through a handheld controller and / or a graphical user interface, and / or the occurrence of one or more other events.Similarly, controller 1620 may switch to exit the first mode of operation in response to the launching or termination of execution of a specific application on display device 1600, receiving an indication that the user desires to exit VR mode or transition to another mode (e.g., AR or MR mode) based on input received through the handheld controller and / or graphical user interface, and / or the occurrence of one or more other events, to exit the VR experience or transition to an AR or mixed reality (MR) experience in which the user is provided with increased see-through visibility of the environment in front of them. Other configurations are possible.

[0217] In other examples, in the first mode of operation, the display device 1600 may hold / maintain a state similar or equivalent to the third state for an extended period of time (e.g., indefinitely or until the display device 1600 is requested to present virtual content at less than optical infinity). In at least some such examples, the first mode of operation may correspond to a mode in which the controller 1620 causes the projector 1614 to turn on, the lens assembly 1605 to be held in a fixed state, and the shutter element 1603 to be held open. Optionally, in the first mode of operation, the controller 1620 may cause the shutter element 1603 to switch between an open state and a closed state. In such examples, the controller 1620 may switch the display device 1600 into and / or out of the first mode of operation based on any of a variety of factors, including a depth at which the user's eyes are determined to be fixated, a depth in front of the user at which the virtual content will be perceived by the user, an accommodation-vergence-divergence movement mismatch with respect to the virtual content, and the like. In some embodiments, the controller 1620 may utilize data from one or more inwardly facing cameras (e.g., images of one or both of the user's eyes) to determine a depth at which the user's eyes are fixated, evaluate the determined depth against a set of criteria, and transition and / or exit the first operational mode based on the results of the evaluation. For example, in these embodiments, the controller 1620 may determine whether an accommodation-vergence-divergence mismatch for the virtual content exceeds one or more predefined thresholds based, at least in part, on the determined depth at which the user's eyes are fixated, and may transition and / or exit the first operational mode in response to determining that the accommodation-vergence-divergence mismatch for the virtual content exceeds one or more predefined thresholds.Exemplary systems and techniques for adjusting wavefront divergence of light representing virtual content for enhanced user perception, comfort, and / or experience that may represent or be implemented as part of one or more of the systems and techniques described herein include, but are not limited to, U.S. patent application Ser. No. 15 / 430,277, filed Feb. 10, 2017 and published on Aug. 17, 2017 as U.S. Patent Publication No. 2017 / 0237974, U.S. patent application Ser. No. 15 / 469,369, filed Mar. 24, 2017 and published Sep. 28, 2019 as U.S. Patent Publication No. 2017 / 0276948, and U.S. patent application Ser. No. 2015 / 0237979, filed Mar. 24, 2017 and published on Sep. 28, 2019 as U.S. Patent Publication No. 2015 / 0237979, No. 16 / 250,931, filed January 17, 2019 and published on August 8, 2019 as U.S. Patent Publication No. 2019 / 0243448, U.S. Patent Application No. 16 / 353,989, filed March 14, 2019 and published on October 10, 2019 as U.S. Patent Publication No. 2019 / 0311527, and U.S. Patent Application No. 16 / 389,529, filed April 19, 2019 and published on October 24, 2019 as U.S. Patent Publication No. 2019 / 0324276, all of which are expressly incorporated herein by reference in their entirety. In some embodiments, one or more of such systems and techniques described in one or more of the aforementioned patent applications may represent or be implemented as part of one or more of the systems and techniques for switching into and / or out of a first mode of operation. Other configurations are also possible.

[0218] In a second mode of operation, the controller 1620 of the display device 1600 may synchronously switch the shutter element 1603 and the lens assembly 1605 between different states in a manner that results in an inverse relationship between an amount of ambient light from the user's environment allowed to pass therethrough by the shutter assembly 1603 toward the user and an amount of wavefront divergence imparted to light passing therethrough by the lens assembly 1605 toward the user. For example, in the second mode of operation, the controller 1620 of the display device 1600 may synchronously switch the shutter element 1603 and the lens assembly 1605 between two states similar or equivalent to a first and second state as described above with reference to Figures 16A and 16B, respectively, or may synchronously switch the shutter element 1603 and the lens assembly 1605 between two states similar or equivalent to a second and third state as described above with reference to Figures 16B and 16C, respectively.

[0219] FIG. 17 illustrates a simplified computer system 1700 according to an embodiment described herein. The computer system 1700 as illustrated in FIG. 17 may be incorporated into a device as described herein. FIG. 17 provides a schematic illustration of one embodiment of a computer system 1700 that may perform some or all of the steps of the method provided by various embodiments. Note that FIG. 17 is intended only to provide a generalized illustration of the various components, any or all of which may be utilized as desired. FIG. 17 thus broadly illustrates a situation in which individual system elements may be implemented in a relatively separated manner or a relatively more integrated manner.

[0220] Computer system 1700 is shown to comprise hardware elements that may be electrically coupled via a bus 1705 or may otherwise communicate as needed. The hardware elements may include one or more processors 1710, including one or more general purpose processors and / or one or more special purpose processors, such as, but not limited to, digital signal processing chips, graphic acceleration processors, and / or the like, one or more input devices 1715, which may include, but are not limited to, a mouse, a keyboard, a camera, and / or the like, and one or more output devices 1720, which may include, but are not limited to, a display device, a printer, and / or the like.

[0221] Computer system 1700 may further include and / or communicate with one or more non-transitory storage devices 1725, which may comprise, but are not limited to, local and / or network accessible storage devices and / or may include, but are not limited to, disk drives, drive arrays, optical storage devices, solid-state storage devices such as random access memory ("RAM"), and / or read-only memory ("ROM"), which may be programmable, flash updatable, and / or the like. Such storage devices may be configured to implement any suitable data storage, including, but not limited to, various file systems, database structures, and / or the like.

[0222] The computer system 1700 may also include a communication subsystem 1719, which may include, but is not limited to, a modem, a network card (wireless or wired), an infrared communication device, a wireless communication device, and / or a chipset, such as, but not limited to, a Bluetooth device, an 802.11 device, a WiFi device, a WiMax device, a cellular communication facility, and / or the like. The communication subsystem 1719 may include one or more input and / or output communication interfaces, allowing data to be exchanged with networks, such as networks described below to give as an example, other computer systems, televisions, and / or any other devices described herein. Depending on the desired functionality and / or other implementation concerns, a portable electronic device or similar device may communicate images and / or other information via the communication subsystem 1719. In other embodiments, a portable electronic device, e.g., a first electronic device, may be incorporated into the computer system 1700, e.g., an electronic device, as an input device 1715. In some embodiments, the computer system 1700 further comprises a working memory 1735, which may include a RAM or ROM device as described above.

[0223] Computer system 1700 may also include software elements, shown as currently residing in working memory 1735, including operating system 1740, device drivers, executable libraries, and / or other code, such as one or more application programs 1745, that may comprise computer programs provided by various embodiments and / or that may be designed to implement methods and / or configure systems provided by other embodiments as described herein. Simply by way of example, one or more procedures described with respect to the methods discussed above may be implemented as code and / or instructions executable by a computer or a processor within a computer, and in certain aspects such code and / or instructions may then be used to configure and / or adapt a general-purpose computer or other device to perform one or more operations in accordance with the methods described.

[0224] A set of these instructions and / or code may be stored on a non-transitory computer-readable storage medium, such as storage device 1725 described above. In some cases, the storage medium may be incorporated within a computer system, such as computer system 1700. In other embodiments, the storage medium may be separate from the computer system, e.g., a removable medium, such as a compact disc, and / or may be provided within an installation package, such that the storage medium may be used to program, configure, and / or adapt a general-purpose computer with the instructions / code stored thereon. These instructions may take the form of executable code that is executable by computer system 1700, and / or may take the form of source and / or installable code that, upon compilation and / or installation onto computer system 1700 using, for example, any of a variety of commonly available compilers, installation programs, compression / decompression utilities, and the like, then takes the form of executable code.

[0225] It will be apparent to those skilled in the art that substantial variations may be made according to specific requirements. For example, customized hardware may also be used and / or particular elements may be implemented in hardware, software, including portable software such as applets, or both. Furthermore, connection to other computing devices, such as network input / output devices, may also be employed.

[0226] As noted above, in one aspect, some embodiments may employ a computer system, such as computer system 1700, to perform methods according to various embodiments of the present technology. According to one set of embodiments, some or all of the procedures of such methods are performed by computer system 1700 in response to processor 1710 executing one or more sequences of one or more instructions, which may be embedded in operating system 1740, and / or other code, such as application program 1745, contained in working memory 1735. Such instructions may be read into working memory 1735 from another computer-readable medium, such as one or more of storage devices 1725. By way of example only, execution of a sequence of instructions contained in working memory 1735 may cause processor 1710 to perform one or more procedures of the methods described herein. Additionally or alternatively, some of the methods described herein may be performed through specialized hardware.

[0227] The terms "machine-readable medium" and "computer-readable medium" as used herein refer to any medium that participates in providing data that causes a machine to operate in a tangible manner. In an embodiment implemented using computer system 1700, various computer-readable media may be involved in providing instructions / code to processor 1710 for execution and / or may be used to store and / or carry such instructions / code. In many implementations, computer-readable media are physical and / or tangible storage media. Such media may take the form of non-volatile or volatile media. Non-volatile media include, for example, optical and / or magnetic disks, such as storage device 1725. Volatile media include dynamic memory, such as, but not limited to, working memory 1735.

[0228] Common forms of physical and / or tangible computer readable media include, for example, a floppy disk, a flexible disk, a hard disk, magnetic tape or any other magnetic medium, a CD-ROM, any other optical medium, punch cards, paper tape, any other physical medium with a pattern of holes, RAM, PROM, EPROM, FLASH-EPROM, any other memory chip or cartridge, or any other medium from which a computer can read instructions and / or code.

[0229] Various forms of computer-readable media may be involved in carrying one or more sequences of one or more instructions to the processor 1710 for execution. By way of example only, the instructions may initially be carried on a magnetic and / or optical disk of a remote computer. The remote computer may load the instructions into its dynamic memory and send the instructions as signals over a transmission medium to be received and / or executed by the computer system 1700.

[0230] The communications subsystem 1719 and / or its components generally receive signals and the bus 1705 may then convey the signals and / or the data, instructions, etc. carried by the signals to the working memory 1735, from which the processor 1710 retrieves and executes the instructions. The instructions received by the working memory 1735 may optionally be stored on a non-transitory storage device 1725 either before or after execution by the processor 1710.

[0231] The methods, systems, and devices discussed above are examples. Various configurations may omit, substitute, or add various procedures or components, as appropriate. For example, in alternative configurations, the method may be performed in a different order than described, and / or various steps may be added, omitted, and / or combined. Also, features described with respect to one configuration may be combined in various other configurations. Different aspects and elements of the configurations may be combined in a similar manner. Also, technology evolves, and thus many of the elements are examples and do not limit the scope of the disclosure or the claims.

[0232] Specific details are given in the description to provide a thorough understanding of the example configurations, including the implementation. However, the configurations may be practiced without these specific details. For example, well-known circuits, processes, algorithms, structures, and techniques are shown without unnecessary detail to avoid obscuring the configurations. This description provides only example configurations and does not limit the scope, applicability, or configuration of the claims. Rather, the foregoing description of the configurations will provide those skilled in the art with an effective description for implementing the described techniques. Various changes may be made in the function and arrangement of elements without departing from the spirit or scope of the present disclosure.

[0233] Also, the configurations may be described as processes, depicted as schematic flow charts or block diagrams. Although the operations may be described as sequential processes, many of the operations may be performed in parallel or simultaneously. In addition, the order of the operations may be rearranged. The processes may have additional steps not included in the figures. Furthermore, embodiments of the method may be implemented by hardware, software, firmware, middleware, microcode, hardware description languages, or any combination thereof. When implemented in software, firmware, middleware, or microcode, the program code or code segments for performing the necessary tasks may be stored in a non-transitory computer-readable medium, such as a storage medium. A processor may perform the tasks described.

[0234] Although several example configurations have been described, various modifications, alternative constructions, and equivalents may be used without departing from the spirit of the disclosure. For example, the aforementioned elements may be components of a larger system, and other rules may take precedence over or otherwise modify the application of the present technology. Also, some steps may take place before, during, or after the aforementioned elements are discussed. Thus, the foregoing description is not intended to be binding on the scope of the claims.

[0235] As used in this specification and the appended claims, the singular forms "a," "an," and "the" include plural references unless the context clearly dictates otherwise. Thus, for example, reference to a "user" includes a plurality of such users, reference to a "processor" includes reference to one or more processors and equivalents thereof known to those skilled in the art, and so forth.

[0236] Additionally, the words "comprise," "comprising," "contains," "containing," "include," "including," and "includes," when used in this specification and the claims that follow, are intended to specify the presence of stated features, integers, components, or steps, but they do not exclude the presence or addition of one or more other features, integers, components, steps, acts, or groups.

[0237] It should also be understood that the examples and embodiments described herein are for illustrative purposes only, and that various modifications or changes in light thereof will be suggested to those skilled in the art and are within the spirit and scope of the present application and the appended claims.

Claims

1. 1. A method of operating an optical system, the method comprising: receiving light associated with a world object; linearly polarizing light associated with the world object along a first axis; When the optical system is operating according to a first state, rotating a polarization of light associated with the world object; linearly polarizing light associated with the world object along a second axis perpendicular to the first axis; When the optical system is operating according to a second state, projecting light associated with a virtual image onto an eyepiece; linearly polarizing the light associated with the world object and the light associated with the virtual image along the second axis; A method comprising:

2. The method of claim 1 , further comprising rotating a polarization of light associated with the virtual image when the optical system is operating according to the second state.

3. The method of claim 1 , further comprising applying zero net refractive power to light associated with the world object when the optical system is operating according to the first state.

4. The method of claim 1 , further comprising applying a non-zero net refractive power to light associated with the virtual image when the optical system is operating according to the second state.

5. The method of claim 1 , further comprising outcoupling light associated with the virtual image when the optical system is operating according to the second state.

6. 1. An optical system comprising: one or more world-side shutter elements, linearly polarizing light associated with a world object along a first axis; rotating a polarization of light associated with the world object when the optical system is operating according to a first state; one or more world-side shutter elements configured to an eyepiece coupled to the one or more world-side shutter elements; a projector configured to project light associated with a virtual image onto the eyepiece when the optical system is operating according to a second state; one or more user-side shutter elements coupled to the eyepiece, linearly polarizing light associated with the world object along a second axis perpendicular to the first axis when the optical system is operating according to the first state; linearly polarizing light associated with the world object and light associated with the virtual image along the second axis when the optical system is operating according to the second state; one or more user-side shutter elements configured to An optical system comprising:

7. The one or more user-side shutter elements further include: The optical system of claim 6 , wherein the optical system is configured to rotate a polarization of light associated with the virtual image when the optical system is operating according to the second state.

8. The optical system of claim 6 , further comprising a lens assembly coupled to the one or more user-side shutter elements.

9. The optical system of claim 8 , wherein the lens assembly is configured to apply zero net refractive power to light associated with the world object when the optical system is operating according to the first state.

10. The optical system of claim 8 , wherein the lens assembly is configured to apply a non-zero net refractive power to light associated with the virtual image when the optical system is operating according to the second state.

11. 7. The optical system of claim 6, wherein the eyepiece is configured to outcouple light associated with the virtual image toward the one or more user-side shutter elements when the optical system is operating according to the second state.

12. The one or more world side shutter elements include A world-side polariscope; World-side switchable waveplate and Including, The one or more user-side shutter elements include: A user-side polarizer; User-side switchable waveplate and The optical system of claim 6 , comprising:

13. 13. The optical system of claim 12, wherein the optical system is operating according to the first state when the world-side switchable waveplate is electrically activated and the user-side switchable waveplate is not electrically activated.

14. 13. The optical system of claim 12, wherein the optical system is operating according to the second state when the user-side switchable waveplate is electrically activated and the world-side switchable waveplate is not electrically activated.

15. The optical system of claim 12 , wherein the world-side polarizer is coupled to the world-side switchable waveplate.

16. 1. An optical system comprising: a projector configured to emit light; at least one waveguide optically coupled to the projector, the at least one waveguide configured to receive and redirect light therefrom towards a user; a shutter assembly comprising at least one component positioned adjacent to the at least one waveguide, the shutter assembly being selectively switchable between different states, each of the shutter assemblies being configured to allow different amounts of ambient light from the user's environment to pass therethrough toward the user; an adaptive lens assembly positioned between the at least one waveguide and the user, the adaptive lens assembly being selectively switchable between different states, each of which is configured to impart a different amount of wavefront divergence to light passing therethrough towards the user; control circuitry communicatively coupled to the projector, the shutter assembly, and the adaptive lens assembly, the control circuitry configured to synchronously switch the shutter assembly and the adaptive lens assembly between two or more states at a particular rate, the two or more states being: a first state, wherein the shutter assembly is configured to allow a first amount of ambient light from the user's environment to pass therethrough toward the user, and the adaptive lens assembly is configured to impart a first amount of wavefront divergence to light passing therethrough; a second state, wherein the shutter assembly is configured to allow a second amount of ambient light from the user's environment to pass therethrough toward the user, and the adaptive lens assembly is configured to impart a second amount of wavefront divergence to light passing therethrough, the second amount of ambient light being different from the first amount of ambient light, and the second amount of wavefront divergence being different from the first amount of wavefront divergence; and a control circuitry including: An optical system comprising:

17. 17. The optical system of claim 16, wherein the second amount of ambient light is less than the first amount of ambient light and the second amount of wavefront divergence is greater than the first amount of wavefront divergence.

18. 17. The optical system of claim 16, wherein the particular rate at which the shutter assembly and the adaptive lens assembly are synchronously switched between the two or more states comprises a rate equal to or greater than a minimum switching frequency.

19. 17. The optical system of claim 16, wherein in the second state, the control circuitry is configured to cause the projector to emit light representing virtual content that will be perceived by the user as being located at a first depth in front of the user, and the control circuitry is configured to determine at least one of the second amount of ambient light and the second amount of wavefront divergence based on the first depth in front of the user at which virtual content will be perceived by the user.

20. The optical system of claim 16 , wherein the at least one component of the shutter assembly comprises at least one component positioned between the at least one waveguide and the user.

Images