Ghost image mitigation in see-through display with pixel array

By employing polarized TFT-LCD panels and dynamic dimming assemblies with index-matching fluids and quarter-wave plates, the visibility and contrast of virtual content in AR systems are enhanced, addressing residual image issues and improving performance under varying light conditions.

JP2024161068AActive Publication Date: 2024-11-15MAGIC LEAP INC
View PDF 9 Cites 0 Cited by

Patent Information

Application Number
JP2024141875
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2019-08-15
Filing Date
2024-08-23
Publication Date
2024-11-15
Estimated Expiration
2040-08-14

AI Technical Summary

Technical Problem

Augmented reality systems face challenges in maintaining clear visibility of virtual content under varying ambient light conditions due to residual images and stray light paths caused by reflections from metal traces and layer index mismatches in dimming assemblies, which affect contrast and viewing fidelity.

Method used

The use of polarized TFT-LCD panels with index-matching fluids and quarter-wave plates to suppress residual images, combined with dynamic dimming assemblies featuring variable birefringence cells and polarizers, modulates light intensity to enhance content visibility and reduce ghost images.

Benefits of technology

This approach significantly improves the visibility and solidity of virtual content by reducing residual images and enhancing contrast, enabling AR devices to function effectively across a wide range of ambient lighting conditions.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024161068000001_ABST
    Figure 2024161068000001_ABST
Patent Text Reader

Abstract

To provide a ghost image mitigation in a see-through display with a pixel array.SOLUTION: A head-mounted apparatus includes an eyepiece that includes a variable dimming assembly and a frame mounting the eyepiece so that a user side of the eyepiece faces toward a user and a world side of the eyepiece opposite to the first side faces away from the user. A dynamic dimming assembly selectively modulates the intensity of light transmitted parallel to an optical axis from the world side to the user side during operation. The dynamic dimming assembly includes a variable birefringence cell having a plurality of pixels each having an independently variable birefringence, a first linear polarizer arranged on the user side of the variable birefringence cell, the first linear polarizer being configured to transmit light propagating parallel to the optical axis linearly polarized along a pass axis of the first linear polarizer orthogonal to the optical axis, and a 1 / 4 wavelength plate arranged between the variable birefringence cell and the first linear polarizer.SELECTED DRAWING: Figure 7A
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] (CROSS REFERENCE TO RELATED APPLICATIONS) This application claims priority to Provisional Application No. 62 / 887,639, filed August 15, 2019, and entitled “GHOST IMAGE MITIGATION IN SEE-THROUGH DISPLAYS WITH PIXEL ARRAYS,” the entire contents of which are incorporated by reference. [Background technology]

[0002] Modern computing and display technologies have facilitated the development of systems for so-called "virtual reality" or "augmented reality" experiences, in which digitally reproduced images or portions thereof are presented to a user in a manner that appears or may be perceived as real. Virtual reality, or "VR", scenarios typically involve the presentation of digital or virtual image information without transparency to other actual real-world visual inputs. Augmented reality, or "AR", scenarios typically involve the presentation of digital or virtual image information as an extension to the visualization of the real world around the user.

[0003] Despite the advances made in these display technologies, there remains a need in the art for improved methods, systems, and devices relating to augmented reality systems, and particularly display systems. Summary of the Invention [Means for solving the problem]

[0004] Segmented attenuation using polarized TFT-LCD panels can significantly increase the visibility and solidity of content without dimming the full field of view of the world. Display light in a diffractive waveguide type see-through AR display sends light in two directions, one toward the user and one toward the world. Back reflections of light traveling toward the world (e.g., from metal traces, conductors, layer refractive index mismatches, and reflective components of the dimming assembly such as TFTs) can appear as a "persistent" image next to the primary display image. This persistent image affects the effective contrast and visual fidelity of the virtual content, and therefore the quality of immersion. Mitigating persistent images and stray light paths due to metal traces, TFTs, layer refractive index mismatches, elements / objects beyond the dimmer, etc. is a challenging problem.

[0005] The systems and techniques disclosed herein leverage the dimmer's polarizing film as both a system optical isolator and an in-dimmer optical isolator, effectively suppressing such "afterimage" images. The addition of an index-matching fluid / gel between the eyepiece cover glass and the dimmer, whose index of refraction is close to that of the first layer of the dimmer, can mitigate afterimages from the first dimmer surface.

[0006] The use of quarter-wave plates (QWPs) with specifically selected achromatic properties can enable liquid crystal dimmers, such as those using electrically controlled birefringence (ECB) cells, to have less polarization leakage, better color performance, and be more color neutral across a relatively wide range of operating conditions.

[0007] The present disclosure generally relates to techniques for improving optical systems under varying ambient light conditions. More specifically, embodiments of the present disclosure provide systems and methods for operating an augmented reality (AR) device with a dimming element. Although the present invention is described with reference to an AR device, the present disclosure is applicable to various applications in computer vision and image display systems.

[0008] In general, in a first aspect, the invention features a head mounted device including an eyepiece, the eyepiece including a dynamic dimming assembly and a frame that mounts the eyepiece such that a user side of the eyepiece faces toward a user of the head mounted device and a world side of the eyepiece opposite the first side faces away from the user during use of the head mounted device. The dynamic dimming assembly is configured to selectively modulate an intensity of light transmitted parallel to an optical axis from the world side of the eyepiece to the user side of the eyepiece during operation of the head mounted device. The dynamic dimming assembly includes a variable birefringence cell having a plurality of pixels, each having an independently variable birefringence; a first linear polarizer arranged on a user side of the variable birefringence cell, the first linear polarizer configured to transmit light propagating parallel to the optical axis that is linearly polarized along a pass axis of the first linear polarizer that is orthogonal to the optical axis; a quarter-wave plate arranged between the variable birefringence cell and the first linear polarizer, the fast axis of the quarter-wave plate being aligned with respect to the pass axis of the first linear polarizer, the quarter-wave plate converting linearly polarized light transmitted by the first linear polarizer to circularly polarized light; and a second linear polarizer on the world side of the variable birefringence cell.

[0009] The implementation of the head mounted device can include one or more of the following features and / or features of other aspects. For example, the dynamic dimming assembly further includes an optical retarder arranged between the variable birefringence cell and the second linear polarizer. The optical retarder can be a second quarter wave plate. The optical retarder is an A-plate with a retardation greater than that of the quarter wave plate. The difference between the retardation of the optical retarder and the retardation of the quarter wave plate can correspond to the residual retardation of the variable birefringence cell in the minimum birefringence state.

[0010] The variable birefringence cell can include a layer of liquid crystal. The liquid crystal can be configured in an electrically controllable birefringence mode. In some embodiments, the layer of liquid crystal is a vertically aligned liquid crystal layer. The liquid crystal can be a nematic phase liquid crystal.

[0011] The pixels of the variable birefringence cell can be actively addressed pixels.

[0012] The eyepiece may further include a see-through display mounted within a frame on the user side of the variable dimming assembly. The see-through display may include one or more waveguide layers arranged to receive light from the light projector and direct the light toward the user during operation of the head-mounted device. The head-mounted device may include one or more index matching layers arranged between the see-through display and the variable dimming assembly.

[0013] In some embodiments, the dynamic dimming assembly includes one or more anti-reflective layers.

[0014] In another aspect, the invention features an augmented reality system that includes a head-mounted device.

[0015] In general, in another aspect, the invention features a head mounted device including an eyepiece having a dynamic dimming assembly and a frame that mounts the eyepiece such that a user side of the eyepiece faces toward a user of the head mounted device and a world side of the eyepiece opposite the first side faces away from the user during use of the head mounted device. The dynamic dimming assembly is configured to selectively modulate an intensity of light transmitted parallel to an optical axis from the world side of the eyepiece to the user side of the eyepiece during operation of the head mounted device. The dynamic dimming assembly includes a layer of liquid crystal, a circular polarizer arranged on the user side of the liquid crystal layer, and a linear polarizer on the world side of the liquid crystal layer.

[0016] Embodiments of the head-mounted device can include one or more of the following features and / or other aspect features. For example, the circular polarizer can include a linear polarizer and a quarter wave plate. The head-mounted device can include an A-plate arranged between the linear polarizers on the world side of the liquid crystal layer.

[0017] The head mounted device can include a pixelated cell that includes a layer of liquid crystal, the pixelated cell being an actively addressed pixelated cell.

[0018] In general, in a further aspect, the invention features a method of operating an optical system. The method may include receiving light associated with a world object at the optical system. The method may also include projecting a virtual image onto an eyepiece. The method may further include determining, based on the detected information, a portion of a system field of view of the optical system to be at least partially dimmed. The method may further include adjusting a dimmer to reduce an intensity of light associated with the world object within the portion of the system field of view.

[0019] In some embodiments, the optical system includes a light sensor configured to detect light information corresponding to light associated with the world object. In some embodiments, the detected information includes light information. In some embodiments, the light information includes a plurality of spatially resolved light values. In some embodiments, the light information includes a global light value. In some embodiments, the optical system includes an eye tracker configured to detect gaze information corresponding to an eye of a user of the optical system. In some embodiments, the detected information includes gaze information. In some embodiments, the gaze information includes a pixel location that intersects with a gaze vector of the user's eye. In some embodiments, the gaze information includes one or more of a pupil location of the user's eye, a center of rotation of the user's eye, a pupil size of the user's eye, a pupil diameter of the user's eye, and a cone and rod location of the user's eye. In some embodiments, the method further includes detecting image information corresponding to the virtual image. In some embodiments, the detected information includes image information. In some embodiments, the image information includes a plurality of spatially resolved image brightness values. In some embodiments, the image information includes a global image brightness value.

[0020] In some embodiments, the method further includes determining a plurality of spatially resolved dimming values ​​for the portion of the system field of view based on the detected information. In some embodiments, the dimmer is adjusted according to the plurality of dimming values. In some embodiments, the dimmer comprises a plurality of pixels. In some embodiments, the dimmer is adjusted to completely block light intensity associated with world objects in all of the system field of view. In some embodiments, the method further includes adjusting a brightness associated with the virtual image. In some embodiments, the virtual image is characterized by an image field of view. In some embodiments, the image field of view is equal to the system field of view. In some embodiments, the image field of view is a subset of the system field of view.

[0021] In general, in another aspect, the invention features an optical system. The optical system may include a projector configured to project a virtual image onto an eyepiece. The optical system may also include a dimmer configured to dim light associated with the world object. The optical system may further include a processor communicatively coupled to the projector and the dimmer. In some embodiments, the processor is configured to perform operations including determining, based on the detected information, a portion of a system field of view of the optical system to be at least partially dimmed. In some embodiments, the operations may also include adjusting the dimmer to reduce an intensity of light associated with the world object within the portion of the system field of view.

[0022] In some embodiments, the optical system further includes a light sensor configured to detect light information corresponding to light associated with the world object. In some embodiments, the detected information includes light information. In some embodiments, the light information includes a plurality of spatially resolved light values. In some embodiments, the light information includes a global light value. In some embodiments, the optical system further includes an eye tracker configured to detect gaze information corresponding to an eye of a user of the optical system. In some embodiments, the detected information includes gaze information. In some embodiments, the gaze information includes a pixel location that intersects with a gaze vector of the user's eye. In some embodiments, the gaze information includes one or more of a pupil location of the user's eye, a center of rotation of the user's eye, a pupil size of the user's eye, a pupil diameter of the user's eye, and a cone and rod location of the user's eye. In some embodiments, the operation further includes detecting image information corresponding to the virtual image. In some embodiments, the detected information includes image information. In some embodiments, the image information includes a plurality of spatially resolved image brightness values. In some embodiments, the image information includes a global image brightness value.

[0023] In some embodiments, the operations further include determining a plurality of spatially resolved dimming values ​​for a portion of the system field of view based on the detected information. In some embodiments, the dimmer is adjusted according to the plurality of dimming values. In some embodiments, the dimmer comprises a plurality of pixels. In some embodiments, the dimmer is adjusted to completely block light intensity associated with world objects in all of the system field of view. In some embodiments, the operations further include adjusting a brightness associated with the virtual image. In some embodiments, the virtual image is characterized by an image field of view. In some embodiments, the image field of view is equal to the system field of view. In some embodiments, the image field of view is a subset of the system field of view.

[0024] Numerous advantages can be achieved by the methods of the present disclosure over conventional techniques. For example, the AR devices described herein may be used in light levels that vary from dark indoors to bright outdoors by globally dimming and / or selectively dimming the ambient light reaching the user's eyes. An embodiment of the present invention enables AR and virtual reality (VR) capabilities within a single device by attenuating world light by more than 99% using a pixelated dimmer. An embodiment of the present invention also uses a variable focus element to mitigate vergence-divergence accommodation conflicts using discrete or sustained variable depth plane switching techniques. An embodiment of the present invention improves the battery life of an AR device by optimizing projector brightness based on the amount of detected ambient light. Other advantages will be readily apparent to one skilled in the art. The present invention provides, for example, the following: (Item 1) 1. A head-mounted device, comprising: an eyepiece having a variable dimming assembly; a frame that mounts the eyepiece such that during use of the head mounted device, a user side of the eyepiece faces towards a user of the head mounted device and a world side of the eyepiece opposite a first side faces away from the user; Equipped with a dynamic dimming assembly configured to selectively modulate an intensity of light transmitted parallel to an optical axis from a world side of the eyepiece to a user side of the eyepiece during operation of the head mounted device, the dynamic dimming assembly comprising: a variable birefringence cell comprising a plurality of pixels each having an independently variable birefringence; a first linear polarizer arranged on a user side of the variable birefringence cell, the first linear polarizer configured to transmit light propagating parallel to the optical axis that is linearly polarized along a pass axis of the first linear polarizer that is orthogonal to the optical axis; a quarter-wave plate arranged between the variable birefringence cell and the first linear polarizer, the fast axis of the quarter-wave plate being aligned with a pass axis of the first linear polarizer, the quarter-wave plate converting linearly polarized light transmitted by the first linear polarizer into circularly polarized light; a second linear polarizer on the world side of the variable birefringence cell; A head-mounted device comprising: (Item 2) Item 2. The head-mounted device of item 1, wherein the dynamic dimming assembly further comprises an optical retarder arranged between the variable birefringence cell and the second linear polarizer. (Item 3) 3. The head-mounted device of claim 2, wherein the optical retarder is a second quarter-wave plate. (Item 4) 3. The head-mounted device of claim 2, wherein the optical retarder is an A-plate with a retardation greater than that of the quarter wave plate. (Item 5) 3. The head-mounted device of claim 2, wherein the difference between the retardation of the optical retarder and the retardation of the quarter-wave plate corresponds to the residual retardation of the variable birefringence cell in a minimum birefringence state. (Item 6) Item 2. The head-mounted device of item 1, wherein the variable birefringence cell comprises a layer of liquid crystal. (Item 7) 7. The head-mounted device of item 6, wherein the liquid crystal is configured in an electrically controllable birefringence mode. (Item 8) 7. The head mounted display of claim 6, wherein the layer of liquid crystal is a vertically aligned liquid crystal layer. (Item 9) 7. The head mounted display of claim 6, wherein the liquid crystal is a nematic phase liquid crystal. (Item 10) 2. The head-mounted display of claim 1, wherein the pixels of the variable birefringence cell are actively addressed pixels. (Item 11) 2. The head-mounted device of item 1, wherein the eyepiece further comprises a see-through display mounted within a frame on the user side of the variable dimming assembly. (Item 12) Item 12. The head-mounted device of item 11, wherein the see-through display comprises one or more waveguide layers arranged to receive light from a light projector and direct the light towards the user during operation of the head-mounted device. (Item 13) Item 13. The head-mounted device of item 12, further comprising one or more refractive index matching layers arranged between the see-through display and the variable dimming assembly. (Item 14) Item 14. The head-mounted device of item 1, wherein the dynamic dimming assembly comprises one or more anti-reflective layers. (Item 15) 2. An augmented reality system comprising the head-mounted device described in item 1. (Item 16) 1. A head-mounted device, comprising: an eyepiece having a variable dimming assembly; a frame that mounts the eyepiece such that during use of the head mounted device, a user side of the eyepiece faces towards a user of the head mounted device and a world side of the eyepiece opposite a first side faces away from the user; Equipped with a dynamic dimming assembly configured to selectively modulate an intensity of light transmitted parallel to an optical axis from a world side of the eyepiece to a user side of the eyepiece during operation of the head mounted device, the dynamic dimming assembly comprising: A layer of liquid crystal; a circular polarizer disposed on a user side of the liquid crystal layer; a linear polarizer on the world side of the liquid crystal layer; A head-mounted device comprising: (Item 17) Item 17. The head-mounted device of item 16, wherein the circular polarizer comprises a linear polarizer and a quarter-wave plate. (Item 18) Item 18. The head-mounted device of item 17, further comprising an A-plate arranged between linear polarizers on the world side of the liquid crystal layer. (Item 19) 17. The head-mounted device of claim 16, comprising a pixelated cell comprising a layer of liquid crystal, the pixelated cell being an actively addressed pixelated cell. [Brief description of the drawings]

[0025] [Figure 1] FIG. 1 illustrates an augmented reality (AR) scene as viewed through a wearable AR device according to some embodiments described herein.

[0026] [Figure 2A] FIG. 2A illustrates one or more general features of an AR device in accordance with the present invention.

[0027] [Figure 2B] FIG. 2B illustrates an example of an AR device in which the area to be dimmed is determined based on detected light information.

[0028] [Figure 2C] FIG. 2C illustrates an example of an AR device in which the dimmed area is determined based on a virtual image.

[0029] [Figure 2D] FIG. 2D illustrates an example of an AR device in which the dimmed area is determined based on line of sight information.

[0030] [Diagram 3] FIG. 3 illustrates a schematic diagram of a wearable AR device in accordance with the present invention.

[0031] [Figure 4] FIG. 4 illustrates a method for operating an optical system.

[0032] [Diagram 5] FIG. 5 illustrates an AR device with an eyepiece and a pixelated dimming element.

[0033] [Figure 6A] FIG. 6A is a front view of an exemplary optically transmissive spatial light modulator ("SLM") or display assembly for a see-through display system according to some embodiments of the present disclosure.

[0034] [Figure 6B] FIG. 6B is a schematic side view of the exemplary SLM or display assembly of FIG. 6A.

[0035] [Figure 7A] FIG. 7A illustrates an example of a see-through display system in a first state.

[0036] [Figure 7B] FIG. 7B illustrates the embodiment of the see-through display system of FIG. 7A in a second state that is different from the first state.

[0037] [Figure 8A] FIG. 8A illustrates another see-through display system embodiment in a first state.

[0038] [Figure 8B] FIG. 8B illustrates the embodiment of the see-through display system of FIG. 8A in a second state that is different from the first state.

[0039] [Figure 9] FIG. 9 illustrates an example of a see-through display system according to some embodiments of the present disclosure.

[0040] [Figure 10] FIG. 10 illustrates an example of a see-through display system according to another embodiment of the present disclosure.

[0041] [Figure 11] FIG. 11 illustrates an example of a see-through display system according to yet another embodiment of the present disclosure.

[0042] [Figure 12] FIG. 12 is a schematic diagram of an exemplary computer system useful with the see-through display system. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0043] Detailed Description An ongoing technical challenge for optical see-through (OST) augmented reality (AR) devices is the variation in opacity and / or visibility of virtual content under varying ambient light conditions. The problem is exacerbated in extreme lighting conditions, such as a completely dark room or outdoors in completely bright sunlight. The embodiments disclosed herein can reduce (e.g., solve) these and other problems by dimming the world light at different spatial locations within the field of view of the AR device. In such a variable dimming arrangement, the AR device can determine the portions of the field of view to be dimmed and the amount of dimming to apply to each portion based on various information detected by the AR device. This information may include detected ambient light, detected line of sight information, and / or detected brightness of the virtual content being projected. The functionality of the AR device can be further improved by detecting a direction associated with the ambient light, for example, by detecting multiple spatially resolved light intensity values. This can improve the battery life of the AR device by dimming only the portions of the field of view where dimming is required and / or increasing the projector brightness within certain portions of the field of view. Thus, the embodiments disclosed herein can enable the use of AR devices in a much wider variety of ambient lighting conditions than previously considered possible.

[0044] FIG. 1 illustrates an AR scene as viewed through a wearable AR device according to some embodiments described herein. An AR scene 100 is depicted in which a user of the AR technology sees a real-world park-like setting 106 featuring people, trees, buildings in the background, and a concrete platform 120. In addition to these items, the user of the AR technology also perceives that they "see" a robotic figure 110 standing on the real-world platform 120 and a flying cartoon-like avatar character 102 that appears to be an anthropomorphic bumblebee, although these elements (the character 102 and the figure 110) do not exist in the real world. Due to the significant complexity of the human visual perception and nervous system, it is difficult to produce virtual reality (VR) or AR technology that facilitates a comfortable, natural-feeling, and rich presentation of virtual image elements among other virtual or real-world image elements.

[0045] 2A illustrates one or more general features of an exemplary AR device 200. The AR device 200 includes an eyepiece 202 and a dynamic dimmer 203 that are configured to be transparent or semi-transparent when the AR device 200 is in an inactive or off mode such that a user may view one or more world objects 230 when looking through the eyepiece 202 and the dynamic dimmer 203. As illustrated, the eyepiece 202 and the dynamic dimmer 203 are arranged in a side-by-side configuration to form a system field of view that is visible to a user when looking through the eyepiece 202 and the dynamic dimmer 203. In some embodiments, the system field of view is defined as the entire two-dimensional area occupied by one or both of the eyepiece 202 and the dynamic dimmer 203. Although FIG. 2A illustrates a single eyepiece 202 and a single dynamic dimmer 203 (for illustrative reasons), typically the AR device 200 includes two eyepieces and two dynamic dimmers, one for each eye of the user.

[0046] During operation, the dynamic dimmer 203 may be adjusted to vary the intensity of world light 232 transmitted from the world object 230 to the eyepiece 202 and the user, thereby providing a dimmed area 236 in the system field of view that transmits less world light than other areas of the dynamic dimmer 203. The dimmed area 236 may be a portion or subset of the system field of view and may be partially or fully dimmed. A partially dimmed area will transmit a percentage of the incident world light, while a fully dimmed area will block substantially all of the incident world light. The dynamic dimmer 203 may be adjusted according to multiple spatially resolved dimming values ​​for the dimmed area 236.

[0047] Furthermore, during operation of the AR device 200, the projector 214 may project a virtual image 222 onto the eyepiece 202, which may be viewed by the user along with world light 232. Projecting the virtual image 222 onto the eyepiece 202 causes a light field 223 (i.e., an angular representation of the virtual content) to be projected onto the user's retina such that the user perceives the corresponding virtual content as being located at a location within the user's environment. Note that the virtual content (character 102 and statue 110) are depicted in FIGS. 2A-2D as displayed in the eyepiece 202 for illustrative purposes only. The virtual content may actually be perceived by the user at various depths beyond the eyepiece 202. For example, the user may perceive the statue 110 as being located approximately the same distance as the world object 230 (i.e., the platform 120) and the character 102 as being located closer to the user. In some embodiments, the dynamic dimmer 203 may be positioned closer to the user than the eyepiece 202 and may therefore reduce the intensity of light associated with the virtual image 222 (i.e., the light field 223). In some embodiments, two dynamic dimmers may be utilized, one on each side of the eyepiece 202.

[0048] As depicted, the AR device 200 includes an ambient light sensor 234 configured to detect world light 232. The ambient light sensor 234 may be positioned such that the world light 232 detected by the ambient light sensor 234 resembles and / or represents the world light 232 impinging on the dynamic dimmer 203 and / or the eyepiece 202. In some embodiments, the ambient light sensor 234 may be configured to detect multiple spatially resolved light values ​​corresponding to different pixels of the dynamic dimmer 203. In some embodiments, or in the same embodiment, the ambient light sensor 234 may be configured to detect a global light value corresponding to an average light intensity or a single light intensity of the world light 232. Other possibilities are also contemplated.

[0049] 2B illustrates the AR device 200 in a state in which a dimmed area 236 is determined based on detected light information corresponding to world light 232. Specifically, the ambient light sensor 234, in this example, detects world light 232 from the sun 233 and may further detect a direction and / or portion of the system field of view through which the world light 232 associated with the sun passes through the AR device 200. In response, the dynamic dimmer 203 sets the dimmed area 236 and is adjusted to cover the portion of the system field of view that corresponds to the detected world light, reducing the intensity of world light from the sun 233 to the eyepiece 202 and the user. As shown, the dynamic dimmer 203 is adjusted to reduce the transmitted intensity of world light 232 at the center of the dimmed area 236 by an amount greater than the ends of the dimmed area 236.

[0050] 2C illustrates the AR device 200 in a state in which the dimmed area 236 is determined based on the location of the virtual image 222 in the field of view. Specifically, the dimmed area 236 is determined based on the virtual content perceived by the user resulting from the user observing the virtual image 222. In some embodiments, the AR device 200 may detect image information including, among other possibilities, the location of the virtual image 222 (e.g., the location in the system's field of view and / or the corresponding location of the dynamic dimmer 203 through which the user perceives the virtual content) and / or the brightness of the virtual image 222 (e.g., the brightness of the perceived virtual content). As illustrated, the dynamic dimmer 203 may set the dimmed area 236 and adjust to cover a portion of the system field of view that corresponds to the virtual image 222, or alternatively, in some embodiments, the dimmed area 236 may cover a portion of the system field of view that is not aligned with the virtual image 222. In some embodiments, the dimming value of the dimmed area 236 may be determined based on the brightness of the world light 232 and / or the virtual image 222 detected by the ambient light sensor 234.

[0051] 2D illustrates the AR device 200 in a state in which the dimmed area 236 is determined based on line-of-sight information corresponding to the user's eye. In some embodiments, the line-of-sight information includes the user's line-of-sight vector 238 and / or a pixel location of the dynamic dimmer 203 where the line-of-sight vector 238 intersects with the dynamic dimmer 203. As illustrated, the dynamic dimmer 203 may set the dimmed area 236 and adjust to cover a portion of the system field of view that corresponds to the intersection (or intersection area) between the line-of-sight vector 238 and the dynamic dimmer 203, or alternatively, in some embodiments, the dimmed area 236 may cover a portion of the system field of view that does not correspond to the intersection (or intersection area) between the line-of-sight vector 238 and the dynamic dimmer 203. In some embodiments, the dimming value of the dimmed area 236 may be determined based on the world light 232 detected by the ambient light sensor 234 and / or the brightness of the virtual image 222. In some embodiments, the line-of-sight information may be detected by an eye tracker 240 mounted on the AR device 200.

[0052] 3 illustrates a schematic diagram of a further exemplary wearable AR device 300. The AR device 300 includes a left eyepiece 302A and a left dynamic dimmer 303A arranged in a side-by-side configuration, and a right eyepiece 302B and a right dynamic dimmer 303B arranged in a side-by-side configuration. As depicted, the AR device 300 includes one or more sensors including, but not limited to, a left front facing world camera 306A mounted directly on or near the left eyepiece 302A, a right front facing world camera 306B mounted directly on or near the right eyepiece 302B, a left side facing world camera 306C mounted directly on or near the left eyepiece 302A, a right side facing world camera 306D mounted directly on or near the right eyepiece 302B, a left eye tracker 340A positioned to observe the user's left eye, a right eye tracker 340B positioned to observe the user's right eye, and an ambient light sensor 334. The AR device 300 also includes one or more image projection devices, such as a left projector 314A optically linked to the left eyepiece 302A, and a right projector 314B optically linked to the right eyepiece 302B.

[0053] Some or all of the components of the AR device 300 may be head-mounted so that the projected image may be viewed by the user. In some implementations, all of the components of the AR device 300 shown in FIG. 3 are mounted on a single device (e.g., a single headset) that can be worn by the user. In some implementations, the processing module 350 is physically separate and communicatively coupled to the other components of the AR device 300 by one or more wired and / or wireless connections. For example, the processing module 350 may be mounted in various configurations, such as fixedly attached to a frame, fixedly attached to a helmet or hat worn by the user, built into headphones, or otherwise removably attached to the user (e.g., in a backpack configuration, in a belt-coupled configuration, etc.).

[0054] The processing module 350 may include a processor 352 and associated digital memory 356, such as non-volatile memory (e.g., flash memory), both of which may be utilized to aid in processing, caching, and storing data. The data may include data captured from sensors (e.g., which may be operatively coupled to the AR device 300 or otherwise attached to the user), such as the camera 306, the ambient light sensor 334, the eye tracker 340, a microphone, an inertial measurement unit, an accelerometer, a compass, a GPS unit, a wireless device, and / or a gyroscope. For example, the processing module 350 may receive the image 320 from the camera 306. Specifically, the processing module 350 may receive a left front image 320A from a left front facing world camera 306A, a right front image 320B from a right front facing world camera 306B, a left side image 320C from a left side facing world camera 306C, and a right side image 320D from a right side facing world camera 306D. In some embodiments, the images 320 may include a single image, a pair of images, a video comprising a stream of images, a video comprising a stream of paired images, and the like. The images 320 may be generated and sent to the processing module 350 periodically while the AR device 300 is powered on, or may be generated in response to an instruction sent by the processing module 350 to one or more of the cameras. As another example, the processing module 350 may receive light information from the ambient light sensor 334. As another example, the processing module 350 may receive gaze information from one or both of the eye trackers 340. As another example, the processing module 350 may receive image information (e.g., image brightness values) from one or both of the projectors 314.

[0055] The eyepieces 302A and 302B each include a transparent or semi-transparent waveguide configured to direct light from the projectors 314A and 314B. Specifically, the processing module 350 may cause the left projector 314A to output a left virtual image 322A onto the left eyepiece 302A (to project a corresponding light field associated with the left virtual image 322A onto the user's retina) and the right projector 314B to output a right virtual image 322B onto the right eyepiece 302B (to project a corresponding light field associated with the right virtual image 322B onto the user's retina). In some embodiments, the eyepieces 302 each include multiple waveguides corresponding to different colors and / or different depth planes. In some embodiments, the dynamic dimmer 303 may be coupled to and / or integrated with the eyepieces 302. For example, one of the dynamic dimmers 303 may be incorporated into a multi-layer eyepiece and may form one or more layers that make up one of the eyepieces 302.

[0056] Cameras 306A and 306B may be positioned to capture images that substantially overlap the field of view of the user's left and right eyes, respectively. Thus, the placement of cameras 306 may be near the user's eyes, but not so close as to obscure the user's field of view. Alternatively or in addition, cameras 306A and 306B may be positioned to align with the internal binding locations of virtual images 322A and 322B, respectively. Cameras 306C and 306D may be positioned to capture images to the side of the user, e.g., within the user's peripheral vision or outside the user's peripheral vision. Images 320C and 320D captured using cameras 306C and 306D do not necessarily overlap with images 320A and 320B captured using cameras 306A and 306B.

[0057] 2A-2D 。 For example, in some embodiments, the functionality of the eyepiece 302, the dynamic dimmer 303, the projector 314, the ambient light sensor 334, and the eye tracker 340 may be similar to the eyepiece 202, the dynamic dimmer 203, the projector 214, the ambient light sensor 234, and the eye tracker 240, respectively. In some embodiments, the functionality of the processing module 350 may be implemented by two or more sets of separately stored but communicatively coupled electronic hardware components. For example, the functionality of processing module 350 may be performed by electronic hardware components stored in a computing device that is physically tethered to the headset, stored in the headset in conjunction with one or more electronic devices in the headset's environment (e.g., smartphones, computers, peripheral devices, smart appliances, etc.), one or more remotely located computing devices (e.g., servers, cloud computing devices, etc.), or a combination thereof. One example of such a configuration is described in further detail below with reference to FIG. 12.

[0058] 4 illustrates an example method 400 for operating an optical system (e.g., AR device 200 or 300). In general, operation of the optical system can include performing the steps of method 400 as shown in FIG. 4 or in a different order, and not all of the steps need to be performed. For example, in some embodiments, one or more of steps 406, 408, and 410 may be omitted during performance of method 400. One or more steps of method 400 may be performed by a processor (e.g., processor 352) or some other component within the optical system.

[0059] In step 402, light (e.g., world light 232) associated with an object (e.g., world object 230) is received at the optical system. The object may be a real-world object such as a tree, a person, a house, a building, the sun, etc., that is viewed by a user of the optical system. In some embodiments, the light associated with the object is initially received by a dynamic dimmer (e.g., dynamic dimmer 203 or 303) or an aesthetic lens external to the optical system. In some embodiments, the light associated with the object is considered to be received at the optical system when the light reaches one or more components of the optical system (e.g., when the light reaches a dynamic dimmer).

[0060] In step 404, a virtual image (e.g., virtual image 222 or 322) is projected onto an eyepiece (e.g., eyepiece 202 or 302). The virtual image may be projected onto the eyepiece by a projector (e.g., projector 214 or 314) of the optical system. The virtual image may correspond to a single image, a pair of images, a video consisting of a stream of images, a video consisting of a stream of paired images, and the like. In some embodiments, a virtual image is considered to be projected onto the eyepiece when any light associated with the virtual image reaches the eyepiece. In some embodiments, projecting the virtual image onto the eyepiece causes a light field (i.e., an angular representation of the virtual content) to be projected onto the user's retina such that the user perceives the corresponding virtual content as being located at a location within the user's environment.

[0061] During steps 406, 408, and 410, information may be detected by the optical system, for example, using one or more sensors of the optical system. In step 406, light information corresponding to light associated with the object is detected. The light information may be detected using a light sensor (e.g., ambient light sensor 234 or 334) mounted on the optical system. In some embodiments, the light information includes a plurality of spatially resolved light values. Each of the plurality of spatially resolved light values ​​may correspond to a two-dimensional position in the system field of view. For example, each of the light values ​​may be associated with a pixel of the dynamic dimmer. In other embodiments, or in the same embodiment, the light information may include a global light value. The global light value may be associated with the entire system field of view (e.g., an average light value of light impinging on all pixels of the dynamic dimmer).

[0062] In step 408, gaze information corresponding to the eye of a user of the optical system is detected. The gaze information may be detected using an eye tracker (e.g., eye tracker 240 or 340) mounted on the optical system. In some embodiments, the gaze information includes a gaze vector of the user's eye (e.g., gaze vector 238). In some embodiments, the gaze information includes one or more of a pupil position of the user's eye, a center of rotation of the user's eye, a pupil size of the user's eye, a pupil diameter of the user's eye, and a cone and rod location of the user's eye. The gaze vector may be determined based on one or more components of the gaze information, such as a pupil position, a center of rotation of the eye, a pupil size, a pupil diameter, and / or a cone and rod location. When the gaze vector is determined based on the cone and rod locations, it may be further determined based on light information (e.g., global light values) to determine an origin of the gaze vector within a retinal layer of the eye that contains the cone and rod locations. In some embodiments, the line of sight information includes pixels or groups of pixels of the dynamic dimmer where the line of sight vector intersects with the dynamic dimmer.

[0063] In step 410, image information is detected that corresponds to a virtual image (e.g., virtual image 222 or 322) projected by the projector onto the eyepiece. The image information may be detected by the projector, by a processor (e.g., processor 352), or by a separate light sensor. In some embodiments, the image information includes one or more locations in the dynamic dimmer through which the user perceives the virtual content when the user views the virtual image. In some embodiments, the image information includes a plurality of spatially resolved image brightness values ​​(e.g., brightness of the perceived virtual content). For example, the image brightness values ​​may each be associated with a pixel of the eyepiece or the dynamic dimmer. In one particular implementation, when the processor sends instructions to the projector to project the virtual image onto the eyepiece, the processor may determine the spatially resolved image brightness values ​​based on the instructions. In another particular implementation, when the projector receives instructions from the processor and projects the virtual image onto the eyepiece, the projector sends the spatially resolved image brightness values ​​to the processor. In another particular implementation, an optical sensor positioned on or near the eyepiece detects and transmits spatially resolved image brightness values ​​to the processor. In other embodiments, or in the same embodiment, the image information includes a global image brightness value. The global image brightness value may be associated with the entire system field of view (e.g., an average image brightness value for the entire virtual image).

[0064] In step 412, a portion of the system field of view that will be at least partially dimmed is determined based on the detected information. The detected information may include light information detected during step 406, line of sight information detected during step 408, and / or image information detected during step 410. In some embodiments, the portion of the system field of view is equal to the entire system field of view. In various embodiments, the portion of the system field of view may be equal to 1%, 5%, 10%, 25%, 50%, or 75% of the system field of view, etc. In some embodiments, different types of information may be weighted differently in determining the portion that will be at least partially dimmed. For example, line of sight information, when available, may be weighted more heavily than light information and image information in determining the portion that will be at least partially dimmed. In one particular implementation, each type of information may be used independently to determine a different portion of the system field of view that will be at least partially dimmed, and then the different portions may be combined into a single portion using an AND or OR operation.

[0065] At step 414, a plurality of spatially resolved dimming values ​​for the portion of the system field of view are determined based on the detected information. In some embodiments, the dimming values ​​are determined using a formulaic approach based on the desired opacity or visibility of the virtual content. In one particular implementation, the visibility of the virtual content may be calculated using the following equation: [ka] where V is the visibility and I max is the brightness of the virtual image as indicated by the image information, and I backwhere V is related to the light value associated with the world object as indicated by the light information (which may be modified by the determined dimming value), and C is the desired contrast (e.g., 100:1). For example, a visibility equation may be used at each pixel location of the dimmer to calculate a dimming value for the particular pixel location using the brightness of the virtual image at the particular pixel location and the light value associated with the world object at the particular pixel location.

[0066] In step 416, the dimmer is adjusted to reduce the intensity of light associated with objects within the portion of the system field of view. For example, the dimmer may be adjusted such that the intensity of light associated with objects impinging on each pixel location of the dimmer is reduced according to the dimming value determined for that particular pixel location. As used in this disclosure, adjusting the dimmer may include initializing the dimmer, activating the dimmer, powering up the dimmer, modifying or altering a previously initialized, activated, and / or powered up dimmer, and the like. In some embodiments, the processor may send data to the dimmer indicative of both the portion of the system field of view and the plurality of spatially resolved dimming values.

[0067] At step 418, the projector is adjusted to adjust the brightness associated with the virtual image. For example, in some embodiments, it may be difficult to achieve a desired opacity or visibility of the virtual content without increasing or decreasing the brightness of the virtual objects. In such embodiments, the brightness of the virtual image may be adjusted before, after, simultaneously, or in parallel with adjusting the dimmer.

[0068] 5 illustrates an AR device 500 with an eyepiece 502 and a pixelated dimming element 503, which consists of a spatial grid of dimming areas (i.e., pixels) that can have different levels of dimming independent of one another (i.e., they are independently variable). Each dimming area may have an associated size (e.g., width and height) and an associated spacing (e.g., pitch). As shown, the spatial grid of dimming areas may include one or more dark pixels 506 that provide full dimming of incident light and one or more clear pixels 508 that provide full transmission of incident light. Adjacent pixels in the pixelated dimming element 503 may abut (e.g., when the pitch is equal to the width) or may be separated by a gap or channel (e.g., when the pitch is greater than the width).

[0069] In various embodiments, the pixelated dimming element 503 uses liquid crystal technology. Such technology typically includes a layer of liquid crystal material (e.g., having a nematic phase) aligned to one or more electrode layers such that the liquid crystal material can be reoriented in response to an electric field strength applied to the pixel (e.g., by applying a potential difference across the liquid crystal layer using electrodes on opposite sides of the liquid crystal layer). Examples of liquid crystal modes include twisted nematic ("TN") or vertically aligned ("VA") liquid crystals. Electrically controlled birefringent ("ECB") liquid crystal modes can also be used. Liquid crystal phases other than the nematic phase, such as ferroelectric liquid crystals, can also be used. In some embodiments, dye-doped or guest-host liquid crystal materials can also be used.

[0070] FIG. 6A depicts a front view of an exemplary optically transmissive spatial light modulator ("SLM") or display assembly 603 for a see-through display system. Similarly, FIG. 6B depicts a schematic cross-sectional view of the exemplary SLM or display assembly of FIG. 6A. In some embodiments, the optically transmissive SLM or display assembly 603 may form all or part of an external cover of an augmented reality system. The assembly 603 may correspond to an optically transmissive controllable dimming assembly, for example, similar to or comparable to one or more of the dimming assemblies described herein, optically transmissive LCDs, optically transmissive OLED displays, and the like. In some implementations, the assembly 603 of FIGS. 6A-6B may correspond to one or more of components 203, 303a, 303B, and 503 as described above with reference to FIGS. 2A-2C, 3, and 5, respectively. Additional examples of controllable dimming assembly architectures and control schemes are described in further detail in U.S. Provisional Patent Application No. 62 / 725,993, U.S. Provisional Patent Application No. 62 / 731,755, U.S. Provisional Patent Application No. 62 / 858,252, and U.S. Provisional Patent Application No. 62 / 870,896, all of which are incorporated by reference in their entireties herein.

[0071] In the example of Figures 6A-6B, the assembly 603 includes a liquid crystal layer 618 sandwiched between an outer electrode layer 616A and an inner electrode layer 616B, which in turn is sandwiched between an outer polarizer 612A and an inner polarizer 612B. The outer and inner polarizers 612A, 612B may be configured to linearly polarize unpolarized light passing therethrough. The assembly 603 includes an outer substrate layer 620A positioned between the outer polarizer 612A and the outer electrode layer 616A, and an inner substrate layer 620B positioned between the inner polarizer 612B and the inner electrode layer 616B. The substrate layers 620A and 620B support the electrode layers 616A and 616B, and are typically formed from an optically transparent material such as glass or plastic. The assembly 603 further includes an outer optical retarder 614A (e.g., an A-plate) positioned between the outer polarizer 612A and the outer electrode layer 616A, and an inner optical retarder 614B (e.g., an A-plate) positioned between the inner polarizer 612B and the inner electrode layer 616B.

[0072] As mentioned above, in some implementations, the assembly 803 may include or correspond to an ECB cell. Advantageously, the ECB cell can be configured to modulate, for example, circularly polarized light, e.g., to change the ellipticity of the circularly polarized light.

[0073] In operation, the outer polarizer 612A imparts a first polarization state (e.g., linearly polarized along the vertical direction in FIG. 6A) to the ambient light propagating therethrough toward the user's eye. Then, depending on their orientation, the liquid crystal molecules contained within the liquid crystal layer 618 further rotate / retard the polarized ambient light as it traverses the liquid crystal layer 618. For example, the liquid crystal layer 618 can rotate linearly polarized light such that the plane of polarization is different from the plane of polarization of the first polarization state. Alternatively or in addition, the liquid crystal layer can retard the polarized light, e.g., convert linearly polarized light to elliptical or circular polarization. In general, the amount of rotation / retardation depends on the birefringence of the liquid crystal material, its orientation, and the thickness of the liquid crystal layer 618. The amount of rotation / retardation also depends on the electric field applied to the liquid crystal layer 618, e.g., by applying a potential difference across the outer and inner electrode layers 616A, 616B. It follows that the amount of polarization rotation imparted by the pair of electrode layers 616A, 616B and the liquid crystal layer 618 can be varied from pixel to pixel according to the voltages applied to the electrode layers at each individual pixel.

[0074] The retardation of the polarization is also affected by the outer and inner optical retarders 614A, 614B. For example, the use of a quarter-wave plate as the outer optical retarder 614A serves to retard the linearly polarized light transmitted by the polarizer 612A and convert the linearly polarized light to circularly polarized light, with the fast axis of the quarter-wave plate appropriately oriented (e.g., at 45°) with respect to the pass axis of the linear polarizer.

[0075] Finally, the inner polarizer 612B may transmit light of a second different polarization state (e.g., horizontally polarized) compared to the outer polarizer 612A. The second polarization state may be orthogonal to the polarization state imparted on the ambient light by the outer polarizer 612A. In such a situation where the cumulative effect of the liquid crystal layer 618 and the outer and / or inner optical retarders 614A, 614B rotates the polarization transmitted by the outer polarizer 612A, the inner polarizer 612B will transmit the light transmitted by the outer polarizer 612A, albeit rotated 90 degrees. Alternatively, if the cumulative effect of the liquid crystal layer 618 and the optical retarders 614A and 614B leaves the polarization state of the light from the polarizer 612A unchanged, it will be blocked by the inner polarizer 612B. Thus, the inner polarizer 612B may allow portions of the ambient light in the second polarization state to pass therethrough unaffected and may attenuate portions of the ambient light in polarization states other than the second polarization state. The amount of polarization rotation may be controlled on a pixel-by-pixel basis by the electric field strength applied to the liquid crystal layer at each pixel, allowing the light transmission of the device 603 to be controlled on a pixel-by-pixel basis.

[0076] In general, the pixel structure of the electrode layers may vary depending, for example, on the nature of the liquid crystal layer, pixel size, etc. In some embodiments, one of the outer electrode layer 616A and the inner electrode layer 616B may correspond to a layer of individually addressable electrodes (i.e., pixels) arranged in a two-dimensional array. For example, in some examples, the inner electrode layer 616B may correspond to an array of pixel electrodes, each of which may be selectively controlled by the assembly 603 and generate a separate electric field / voltage in conjunction with the outer electrode layer 616A, which may correspond to a single planar electrode. In some examples, one or both electrodes of the outer and inner electrode layers 616A, 616B may be made from an optically transparent conductive material, such as indium tin oxide ("ITO").

[0077] As shown in FIGS. 6A-6B, the assembly 603 also includes metal line traces or conductors 617a-n. Each pixel electrode in the array of pixel electrodes of the assembly 603 is electrically coupled to a corresponding thin film transistor ("TFT"), which is in turn electrically coupled to a corresponding pair of metal line traces or conductors in the plurality of metal line traces or conductors 617a-n. Such metal line traces or conductors are positioned in the "permeable gap" regions between the pixels (e.g., pixel electrodes of the inner electrode layer 616B) and are further electrically coupled to one or more circuits to drive or otherwise control the state of each pixel. In some embodiments, such one or more circuits may include a chip-on-glass ("COG") component 622. The COG component 622 may be disposed on a layer of glass in the assembly 603, such as the inner glass layer 620B. In some implementations, the COG component 622 may be laterally offset from the array of pixels (e.g., the array of pixel electrodes of the inner electrode layer 616B). In this manner, the COG component 622 of assembly 603 may be positioned outside the user's field of view ("FOV"), obscured by the housing or other components of the see-through display system, or a combination thereof. Pixels that use active switching elements, such as TFTs, are said to be "actively addressed."

[0078] FIG. 7A illustrates an example of a see-through display system 700 in a first state (state "A"). Similarly, FIG. 7B illustrates the see-through display system 700 in a second state (state "B") that is different from the first state (state "A"). As shown in FIGS. 7A-7B, system 700 includes an eyepiece 702 and an optically transmissive SLM or display assembly 703. In some examples, eyepiece 702 of FIGS. 7A-7B corresponds to one or more of components 202, 302A, 302B, and 502, described above with reference to FIGS. 2A-2C, 3, and 5, respectively. In some implementations, assembly 703 of Figures 7A-7B may correspond to one or more of components 203, 303a, 303B, 503, and 603 as described above with reference to Figures 2A-2C, 3, 5, and 6A-6B, respectively.

[0079] The eyepiece 702 of the system 700 includes three waveguides 1210, 1220, and 1230. Each of the three waveguides 1210, 1220, and 1230 may correspond to, for example, a different light color and / or depth of virtual content. As shown in FIGS. 7A-7B , the eyepiece 702 further includes internal coupling optical elements 1212, 1222, and 1232 disposed on the waveguides 1210, 1220, and 1230, respectively. The internal coupling optical elements 1212, 1222, and 1232 may be configured to couple light into the waveguides 1210, 1220, and 1230, respectively, for propagation via total internal reflection (TIR). In addition, the eyepiece 702 also includes outcoupling diffractive optical elements 1214, 1224, and 1234 disposed on the waveguides 1210, 1220, and 1230, respectively. The outcoupling diffractive optical elements 1214, 1224, and 1234 may be configured to couple light out of the waveguides 1210, 1220, and 1230, respectively, toward one or both eyes of a viewer of the system 700. As can be seen in FIG. 7A, in a first state (state "A"), no light is coupled into or out of the eyepiece 702.

[0080] In the example of FIG. 7B , system 700 is in a second, different state (state “B”) in which light is (i) coupled into waveguides 1210, 1220, and 1230 using internal coupling optical elements 1212, 1222, and 1232, (ii) propagates through waveguides 1210, 1220, and 1230 via total internal reflection (TIR), and (iii) coupled out of waveguides 1210, 1220, and 1230 using external coupling diffractive optical elements 1214, 1224, and 1234. As each light path 1240, 1242, and 1244 incoupls at locations 1212, 1222, and 1232, respectively, and impinges on a separate outcoupling diffractive optical element 1214, 1224, or 1234 (not depicted, outcoupled light from paths 1222 and 1232) disposed on waveguides 1210, 1220, and 1230, it diffracts the light both towards the viewer and away from the viewer towards the world side of the device. This light propagation is depicted as multiple beamlets each propagating in two opposing directions, one towards the viewer represented by light beam 3010, and one away from the viewer represented by light beam 3020.

[0081] The light beam 3020 propagating away from the viewer may produce undesirable effects if it reflects off elements of the system in its path, as these reflections may reach the viewer as stray light. For example, reflections of this light from the subsequent waveguide 1220 may interfere with the light beam 3010, increasing the blur and / or reducing the contrast of the image projected by the system 700. Furthermore, in some circumstances, the light beam 3020 may reflect off one or more components of the assembly 703, such as one or more metal line traces or conductors of the assembly 703 comparable to or similar to the metal line traces or conductors 617a-n of the assembly 603 as described above with reference to FIGS. 6A-6B, which may produce "afterglow" images and other undesirable artifacts. Waveguide optical systems employing pupil expander technology may further exacerbate these problems.

[0082] 8A and 8B respectively illustrate an example of a see-through display system 800 in a first state (state "A") and a second state (state "B") that is different from the first state (state "A"). As shown in FIGS. 8A-8B, system 800 includes an eyepiece 702 and an optically transmissive SLM 803. In some examples, eyepiece 702 of FIGS. 8A-8B may correspond to eyepiece 702 of FIGS. 7A-7B, but may further include an outer glass cover 1250A and an inner glass cover 1250B positioned on either side of the waveguide stack.

[0083] In some implementations, the assembly 803 of Figures 8A-8B may correspond to one or more of the assemblies 603 and 703 as described above with reference to Figures 6A-6B and 7A-7B, respectively, but the inner and outer optical retarders 614A and 614B are quarter-wave plates (QWPs) 624A and 624B, respectively. The outer and inner QWPs 624A, 624B serve to convert linearly polarized light passing therethrough to circularly polarized light. For example, light propagating from the viewer's environment towards the viewer may become linearly polarized as it passes through the outer polarizer 612A and subsequently become circularly polarized as it passes through the outer QWP 624A. Similarly, light propagating toward assembly 803 away from the viewer, such as one or more portions of light beam 3020, may become linearly polarized as it passes through inner polarizer 612B and subsequently become circularly polarized as it passes through inner QWP 624B. As can be seen in FIG. 8A, in a first state (state "A"), no light is coupled into or out of eyepiece 702.

[0084] In the example of FIG. 8B, system 800 is in a second, different state (state "B"), where light is coupled out of eyepiece 702 in two directions, one toward the viewer represented by ray 3011, and one away from the viewer represented by ray 3021. Rays 3011 and 3021 may represent portions of a light beam similar to beams 3010 and 3020 as described above with reference to FIG. 7B. As shown in FIG. 8B, as ray 3021 propagates away from eyepiece 702 and toward assembly 803, ray 3021 becomes linearly polarized as it passes through inner polarizer 612B, and subsequently becomes circularly polarized as it passes through inner QWP 624B. Upon reaching one or more metal line traces or conductors of assembly 803, light beam 3021 may be reflected back toward eyepiece 702, which may effectively reverse the handedness of the circular polarization of light beam 3021 (i.e., left-handed circularly polarized light becomes right-handed circularly polarized light upon reflection, and vice versa). Upon passing through inner QWP 624B on its way back toward eyepiece 702, the circular polarization is converted back to linear polarization, but polarized orthogonally to the pass state of polarizer 612B. Thus, the reflected light is attenuated (e.g., blocked) by polarizer 612B. In this manner, system 800 reduces the effect of a "afterglow" image that may be produced as a result of light from eyepiece 702 reflecting back toward the viewer from components of assembly 803.

[0085] In some embodiments, the inner optical retarder 614A is a quarter-wave plate and the outer optical retarder 614B is an A-plate (e.g., a uniaxially birefringent film with its fast axis in the plane of the plate) with retardation slightly different from the quarter-wave retardation. For example, in some implementations, the liquid crystal may retain some residual birefringence even under its state of lowest birefringence. This may occur, for example, due to the orientation of the liquid crystal molecules near an alignment layer in the liquid crystal layer. At and near the alignment layer, the liquid crystal molecules may retain their alignment even in the presence of the maximum electric field strength applied by the electrode structure. It is possible to compensate for such residual retardation of the liquid crystal material by increasing the retardation of the outer optical retarder 614B above the quarter-wave retardation. For example, the outer optical retarder 614B can be an A-plate with a quarter wave retardation of 5 nm or more (e.g., up to 50 nm, 10 nm or more, 15 nm or more, 20 nm or more, 25 nm or more, 30 nm or more, 35 nm or more, 40 nm or more, 45 nm or more). Compensating for the residual retardation of the liquid crystal layer can reduce light leakage through the dynamic dimmer.

[0086] The fast axes of the inner and outer optical retarders are generally aligned with respect to the alignment direction of the liquid crystal layer and the pass axes of the inner and outer polarizers such that the dynamic dimmer provides a large dynamic range with good dimming ratio in its darkest state. In some embodiments, the inner and outer optical retarders have their fast axes oriented at 45° with respect to the pass axes of their adjacent polarizers. The fast axes of the inner and outer optical retarders can be oriented at 90° with respect to each other. In some embodiments, the fast axis of the outer optical retarder is oriented at 90° with respect to the alignment direction of the liquid crystal layer at the world boundary of the liquid crystal layer.

[0087] In general, the performance of the dynamic dimmer is optimized for at least one light propagation direction at at least one wavelength. For example, the performance of the dynamic dimmer can be optimized for "on-axis" light, i.e., light incident normal to the layers of the stack forming the dynamic dimmer. In some embodiments, the performance of the dynamic dimmer is optimized for green light, e.g., light with a wavelength of 550 nm. Furthermore, the performance of the dynamic dimmer may be optimized for one wavelength along one light propagation direction, but in general, the dimmer will be configured to provide adequate performance over a range of angles and wavelengths. For example, the dynamic dimmer can be configured to provide adequate performance (e.g., a dynamic range above a minimum performance threshold) over a range of light propagation angles the same size or larger than the field of view of a display. Furthermore, the performance can be adequate over a range of operating wavelengths (e.g., spanning the color gamut of the display). To achieve adequate performance over a range of wavelengths, in some implementations, achromatic optical components, such as achromatic optical retarders, can be used. An achromatic A-plate (eg, an achromatic quarter-wave plate) can be provided, for example, by using two or more different birefringent materials having different dispersion.

[0088] FIG. 9 illustrates a further example of a see-through display system 900. The system 900 of FIG. 9 may correspond to the system 800 of FIGS. 8A-8B, but may further include an outer antireflective layer 626A and an inner antireflective layer 626B. The outer antireflective layer 626A may be positioned adjacent to the outer polarizer 612A, while the inner antireflective layer 626B may be positioned adjacent to the inner polarizer 612B. The outer and inner antireflective layers 626A, 626B may serve to further reduce the presence of undesirable effects such as "afterglow" images by limiting the reflection of light from being coupled out of the eyepiece 702. In some circumstances, at least some such reflections may be the result of mismatched refractive indices (i.e., Fresnel reflections) between different layers of the display system 900 or between air and layers of the display system 900. The antireflective layers may reduce such reflections. A variety of different suitable antireflective layers can be used, including single or multi-layer antireflective films. Such layers can be optimized for on-axis light or for light at some other non-normal incidence angle. Such layers can be optimized for one or more visible wavelengths. In some embodiments, the antireflective layer is optimized for light having a wavelength in the green portion of the visible spectrum, e.g., at or near the maximum photopic sensitivity of the human eye. Examples of antireflective layers for use in eyepieces are described in U.S. Patent Application No. 16 / 214,575, filed December 10, 2018, and published June 13, 2019 as U.S. Patent Publication No. 2019 / 0179057, which is expressly incorporated herein by reference in its entirety.

[0089] FIG. 10 illustrates yet another example of a see-through display system 1000. The system 1000 of FIG. 10 may correspond to the system 900 of FIG. 9, but may further include a second outer QWP 634A and a second inner QWP 634B. The second outer QWP 634A is positioned adjacent to the outer polarizer 612A, while the second inner QWP 634B is positioned adjacent to the inner polarizer 612B. The second QWP 634A may serve to further reduce the presence of undesirable effects such as a "persistence" image by modulating the polarization state of light that travels away from the viewer and passes through the outer polarizer 612A such that the light is attenuated by the outer polarizer 612A when reflected from one or more objects in the vicinity of the system 1000 (e.g., beyond the assembly 803). Similarly, the inner QWP 634B may serve to further reduce the presence of undesirable effects such as "afterglow" images by modulating the polarization state of light traveling toward the viewer and passing through the inner polarizer 612B such that the light is attenuated by the inner polarizer 612A when reflected from one or more components of the system 1000 positioned between the inner polarizer 612B and the viewer.

[0090] FIG. 11 illustrates another example of a see-through display system 1100. The system 1100 of FIG. 11 may correspond to the system 1000 of FIG. 10, but may include an index-matched layer 628 instead of component 626B. The index-matched layer 628 may be a layer of material (e.g., gel or optical adhesive) that has a refractive index that is comparable or similar to that of the second inner QWP 634B or any layer of the assembly 803 closest to the eyepiece 702. The inclusion of an index-matching layer may serve to further reduce the presence of undesirable effects such as "afterglow" images by reducing Fresnel reflections of light from the eyepiece 702 incident on the assembly 803.

[0091] In some implementations, the see-through display system may include some or all of the components from one or more of each of Figures 8A-11. Other configurations, including see-through display systems with different combinations of components from one or more of each of Figures 8A-11, are also possible. Although described primarily in the context of optically transmissive spatial light modulators and displays, it should be understood that one or more of the configurations and techniques described herein may be utilized in other systems involving see-through pixel arrays.

[0092] Some implementations described herein can be implemented as one or more groups or modules of digital electronic circuitry, computer software, firmware, or hardware, or in a combination of one or more of them. Although different modules can be used, each module need not be distinct, and multiple modules can be implemented on the same digital electronic circuitry, computer software, firmware, or hardware, or combinations thereof.

[0093] Some implementations described herein can be implemented as one or more computer programs, i.e., one or more modules of computer program instructions encoded on a computer storage medium for execution by or to control the operation of a data processing apparatus. The computer storage medium can be or be included in a computer readable storage device, a computer readable storage substrate, a random or serial access memory array or device, or a combination of one or more of them. Furthermore, a computer storage medium is not a propagating signal, but a computer storage medium can be a source or destination of computer program instructions encoded in an artificially generated propagating signal. A computer storage medium can also be or be included in one or more separate physical components or media (e.g., multiple CDs, disks, or other storage devices).

[0094] The term "data processing apparatus" encompasses all kinds of apparatus, devices, and machines for processing data, including, by way of example, a programmable processor, a computer, a system on a chip, or a plurality or combination of the above. The apparatus may include special purpose logic circuitry, such as a field programmable gate array (FPGA) or an application specific integrated circuit (ASIC). In addition to hardware, the apparatus may also include code that creates an execution environment for the computer program, such as code that constitutes a processor firmware, a protocol stack, a database management system, an operating system, a cross-platform runtime environment, a virtual machine, or a combination of one or more of these. The apparatus and execution environment may implement a variety of different computing model infrastructures, such as web services, distributed computing, and grid computing infrastructures.

[0095] A computer program (also known as a program, software, software application, script, or code) can be written in any form of programming language, including compiled or interpreted languages, declarative, or procedural languages. A computer program may, but need not, correspond to a file in a file system. A program can be stored within a portion of a file that holds other programs or data (e.g., one or more scripts stored in a markup language document), within a single file dedicated to the program, or within multiple cooperating files (e.g., files that store one or more modules, subprograms, or portions of code). A computer program can be deployed to run on one computer or on multiple computers located at one facility or distributed across multiple facilities and interconnected by a communication network.

[0096] Some of the processes and logic flows described herein can be implemented by one or more programmable processors that execute one or more computer programs and perform actions by operating on input data and generating output. The processes and logic flows can also be implemented by special purpose logic circuitry, such as an FPGA (field programmable gate array) or an ASIC (application specific integrated circuit), and an apparatus can also be implemented as such.

[0097] Processors suitable for executing computer programs include, by way of example, both general-purpose and special-purpose microprocessors and processors of any kind of digital computer. Generally, a processor will receive instructions and data from a read-only memory or a random access memory or both. A computer includes a processor for performing actions according to the instructions and one or more memory devices for storing instructions and data. A computer may also include, or be operatively coupled to, one or more mass storage devices for storing data, such as magnetic, magneto-optical, or optical disks, for receiving data or transferring data, or both. However, a computer need not have such devices. Devices suitable for storing computer program instructions and data include all forms of non-volatile memory, media, and memory devices, including, by way of example, semiconductor memory devices (e.g., EPROM, EEPROM, flash memory devices, and others), magnetic disks (e.g., internal hard disks, removable disks, and others), magneto-optical disks, and CD-ROM and DVD-ROM disks. The processor and memory may be supplemented by, or incorporated in, special purpose logic circuitry.

[0098] To provide for interaction with a user, the operations can be implemented on a computer having a display device (e.g., a monitor or another type of display device) for displaying information to the user, and a keyboard and pointing device (e.g., a mouse, trackball, tablet, touch-sensitive screen, or another type of pointing device) by which the user may provide input to the computer. Other types of devices can be used to provide interaction with the user as well, e.g., feedback provided to the user can be any form of sensory feedback, e.g., visual feedback, auditory feedback, or tactile feedback, and input from the user can be received in any form, including acoustic, speech, or tactile input. Additionally, the computer can interact with the user by sending documents to and receiving documents from a device used by the user, e.g., by sending a web page to a web browser on the user's client device in response to a request received from the web browser.

[0099] A computer system may include a single computing device or multiple computers operating in close proximity to each other or generally remotely and typically interacting through a communications network. Examples of communications networks include local area networks ("LANs") and wide area networks ("WANs"), networks between networks (e.g., the Internet), networks with satellite links, and peer-to-peer networks (e.g., ad hoc peer-to-peer networks). The relationship of client and server may arise by virtue of computer programs running on separate computers and having a client-server relationship to each other.

[0100] 12 illustrates an exemplary computer system 1200 including a processor 1210, a memory 1220, a storage device 1230, and an input / output device 1240. Each of the components 1210, 1220, 1230, and 1240 may be interconnected, for example, by a system bus 1250. The processor 1210 may process instructions for execution within the system 1200. In some implementations, the processor 1210 is a single-threaded processor, a multi-threaded processor, or another type of processor. The processor 1210 may process instructions stored in the memory 1220 or on the storage device 1230. The memory 1220 and the storage device 1230 may store information within the system 1200.

[0101] The input / output device(s) 1240 provide input / output operations for the system 1200. In some implementations, the input / output device(s) 1240 may include one or more of a network interface device, e.g., an Ethernet card, a serial communication device, e.g., an RS-232 port, and / or a wireless interface device, e.g., an 802.11 card, a 3G wireless modem, a 4G wireless modem, etc. In some implementations, the input / output device(s) may include a driver device configured to receive input data and send output data to another input / output device, e.g., the wearable display device 1260. In some implementations, mobile computing devices, mobile communication devices, and other devices may also be used.

[0102] The methods, systems, and devices discussed above are examples. Various configurations may omit, substitute, or add various procedures or components, as appropriate. For example, in alternative configurations, the method may be performed in a different order than described, and / or various steps may be added, omitted, and / or combined. Also, features described with respect to one configuration may be combined in various other configurations. Different aspects and elements of the configurations may be combined in a similar manner. Also, technology evolves, and thus many of the elements are examples and do not limit the scope of the disclosure or the claims.

[0103] Specific details are given in the description to provide a thorough understanding of the example configurations, including the implementation. However, the configurations may be practiced without these specific details. For example, well-known circuits, processes, algorithms, structures, and techniques are shown without unnecessary detail to avoid obscuring the configurations. This description provides only example configurations and does not limit the scope, applicability, or configuration of the claims. Rather, the foregoing description of the configurations will provide those skilled in the art with an effective description for implementing the described techniques. Various changes may be made in the function and arrangement of elements without departing from the spirit or scope of the present disclosure.

[0104] Although several example configurations have been described, various modifications, alternative constructions, and equivalents may be used without departing from the spirit of the disclosure. For example, the aforementioned elements may be components of a larger system, and other rules may take precedence over or otherwise modify the application of the present technology. Also, some steps may take place before, during, or after the aforementioned elements are discussed. Thus, the foregoing description is not intended to be binding on the scope of the claims.

[0105] As used in this specification and the appended claims, the singular forms "a," "an," and "the" include plural references unless the context clearly dictates otherwise. Thus, for example, reference to a "user" includes a plurality of such users, reference to a "processor" includes reference to one or more processors and equivalents thereof known to those skilled in the art, and so forth.

[0106] Additionally, the words "comprise," "comprising," "contains," "containing," "include," "including," and "includes," when used in this specification and the claims that follow, are intended to specify the presence of stated features, integers, components, or steps, but they do not exclude the presence or addition of one or more other features, integers, components, steps, acts, or groups.

[0107] It should also be understood that the examples and embodiments described herein are for illustrative purposes only, and that various modifications or changes in light thereof will be suggested to those skilled in the art and are within the spirit and scope of the present application and the appended claims.

Claims

1. A method comprising: The method includes modulating, using a dynamic dimming assembly, an intensity of ambient light transmitted parallel to an optical axis from a world side of the dynamic dimming assembly to a user side of the dynamic dimming assembly; The dynamic dimming assembly comprises: A first electrode layer; A second electrode layer; and a liquid crystal layer disposed between the first electrode layer and the second electrode layer; a circular polarizer disposed on the user side of the liquid crystal layer; a linear polarizer on the world side of the liquid crystal layer; an optical retarder arranged between the liquid crystal layer and the linear polarizer; Equipped with Modulating the intensity of the ambient light includes: linearly polarizing the ambient light using the linear polarizer; and using the first electrode layer, the second electrode layer and the liquid crystal layer to at least one of rotate the polarization of the light and take into account the polarization of the light; circularly polarizing the ambient light using the circular polarizer; A method comprising:

2. The method of claim 1, wherein at least one of rotating the polarization of the light or taking into account the polarization of the light includes applying a voltage to at least one of the first electrode layer or the second electrode layer.

3. The liquid crystal layer comprises a plurality of actively addressed pixels; 2. The method of claim 1, wherein applying the voltage to at least one of the first electrode layer or the second electrode layer rotates the polarization of the light on a pixel-by-pixel basis by the first electrode layer, the second electrode layer, and the liquid crystal layer.

4. The method of claim 1, further comprising transmitting light to a user from a see-through display positioned on the user side of the dynamic dimming assembly.

5. The method of claim 4, wherein at least a portion of the light transmitted from the see-through display to the user is received from one or more light projectors.

6. The method of claim 4, wherein the light from the see-through display represents augmented reality content.

7. The method of claim 4, wherein the ambient light is transmitted through one or more refractive index matching layers arranged between the see-through display and the dynamic dimming assembly.

8. The circular polarizer comprises a second linear polarizer and a first quarter-wave plate; The method of claim 1 , wherein circularly polarizing the ambient light comprises using the second linear polarizer and the first quarter wave plate.

9. The optical retarder comprises: a second quarter wave plate, or an A-plate with a retardation greater than that of the first quarter wave plate; The method of claim 1 , wherein the at least one of 10. The dynamic dimming assembly, comprising: an A-plate arranged between the linear polarizer on the world side of the liquid crystal layer and the liquid crystal layer; The method of claim 1 , wherein the ambient light is transmitted from the linear polarizer through the A-plate to the liquid crystal layer.

11. The dynamic dimming assembly, comprising one or more anti-reflective layers; The method of claim 1 , wherein the ambient light is transmitted through the one or more anti-reflective layers.

Citation Information

Patent Citations

  • Liquid crystal video projector

    JP1992310914A

  • Liquid crystal display device

    JP2005055638A

  • Liquid crystal display device

    JP2006126728A

  • Head-mounted information input / output device and head-mounted information input / output method

    JP2014035668A

  • Lighting control film

    JP2017062362A