Vision control system for near-eye displays

Abstract

The vision control system includes an electrochromic insert and at least two peripheral contacts. The electrochromic insert includes at least two transparent electrodes and is configured for placement on the sides of a head-worn frame of the near-eye display system. The peripheral contacts extend to the transparent electrodes.

Description

[Background technology]

[0001] background Near-eye display technology has recently emerged as an emerging consumer technology. In head-worn systems, for example, binocular near-eye displays provide 3D stereo vision for virtual reality (VR) presentations. When implemented using see-through optics or pass-through video, near-eye displays enable mixed and augmented reality (AR) presentations, where VR elements are blended into the user's natural field of view. Summary of the Invention

[0002] overview One aspect of the present disclosure relates to a vision control system including a near-eye display system coupled to a head-worn frame, a vision system that provides pass-through video to the near-eye display system, and an electrochromic insert having at least two peripheral contacts and control circuitry. The electrochromic insert is disposed on one side of the head-worn frame with the peripheral contacts each extending to at least two transparent electrodes. The control circuitry is electrically coupled to the peripheral contacts and configured to apply a voltage to the peripheral contacts in accordance with a control signal to change the transmittance of the electrochromic insert.

[0003] Another aspect of the present disclosure relates to a vision control system having an electrochromic insert and at least two peripheral contacts. The electrochromic insert includes at least two transparent electrodes and is configured for placement on one side of a head-worn frame of a near-eye display system. The peripheral contacts extend to the transparent electrodes.

[0004] Another aspect of the present disclosure relates to a method for operating a vision control system having an electrochromic insert disposed on one side of a head-worn frame of a near-eye display system, the method including: (a) receiving a control signal; and (b) electrically biasing at least two peripheral contacts electrically coupled to at least two transparent electrodes of the electrochromic insert in accordance with receiving the control signal, wherein and wherein the optical transmittance of the electrochromic insert is changed in response to the electrical bias applied to the transparent electrodes.

[0005] This Summary is provided to introduce in general form a selection of concepts further described in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. The claimed subject matter is not limited to implementations that solve any disadvantages noted in any part of this disclosure. [Brief explanation of the drawings]

[0006] BRIEF DESCRIPTION OF THE DRAWINGS [Figure 1] 1 illustrates aspects of an exemplary vision control system with an integrated near-eye display system. [Figure 2] 1 illustrates an exemplary monocular system aspect of a near-eye display system. [Figure 3] 1 illustrates an exemplary electrochromic insert embodiment of a vision control system. [Figure 4] 1 is a hypothetical graph of transmittance versus applied voltage for an example electrochromic insert. [Figure 5] 10 illustrates another exemplary electrochromic insert embodiment of a vision control system. [Figure 6] 1 illustrates another exemplary embodiment of a vision control system. [Figure 7]1 illustrates an aspect of an exemplary method for operating a vision control system. [Figure 8] 1 illustrates other exemplary vision control system aspects. [Figure 9] 1 illustrates other exemplary vision control system aspects. [Figure 10] 1 illustrates other exemplary vision control system aspects. [Figure 11A] 1 shows an embodiment of a stereoscopic display projection. [Figure 11B] 1 shows an embodiment of a stereoscopic display projection. [Figure 12] 1 illustrates an embodiment of an exemplary computer system. DETAILED DESCRIPTION OF THE INVENTION

[0007] Detailed Description A defining feature of VR is its ability to immerse the user in a fully immersive virtual experience. However, there are scenarios in which it is desirable or necessary to allow reality to interrupt, break, or blend with the user's virtual experience. For example, a user may want to pause the VR experience to take an important phone call or to interact with a visitor. Scenarios in which the VR experience is paused and then quickly resumed should be handled smoothly by the technology with minimal user effort. Ideally, users should not be required to remove their VR headset and then put it back on after a short period of time.

[0008] In VR headsets equipped with a vision system capturing the real world, pass-through video from the vision system to the near-eye display is a useful feature for managing the above-mentioned scenarios. The pass-through video can switch according to voice commands or external sounds, other forms of user input, or motion detected around the headset. However, pass-through video solutions can be imperfect due to practical limitations on the field of view (FOV) that the near-eye display is configured to provide or the vision system capturing the real world is configured to capture. More specifically, pass-through video may lack wide-angle content that corresponds to the full range of the user's natural peripheral vision.

[0009] The present disclosure provides a series of vision control systems that address the above-mentioned challenges and provide further advantages. Common to each of the vision control systems is an electrochromic insert positioned on the opposing peripheral side of the near-eye display frame. The electrochromic insert can be opaque in an unpowered state to prevent actual image representations from the user's surroundings from interfering with the VR experience. However, the electrochromic insert is coupled to control circuitry configured to increase the light transmittance of the insert in accordance with an appropriate control signal. As discussed above in connection with pass-through video, the control signal can be activated in accordance with any desired trigger activation condition, such as user input or motion detected around the headset.

[0010] In some vision control systems, the electrochromic insert is partially dimmable, either continuously or in discrete steps, so that the brightness of the peripheral image representation it allows can be adjusted relative to the brightness of the pass-through video. In some vision control systems, the electrochromic insert is detachable from the near-eye display frame, and it can be placed, for example, in a window in a side shield attached to the frame.

[0011] Referring now to the drawings, Figure 1 illustrates an embodiment of an exemplary vision control system 102. The vision control system is configured to be worn by a user and to exert active control over visual image representations received by the user. As a result, the vision control system can present and / or control an immersive virtual reality for the benefit of the user. In the example illustrated in Figure 1, the vision control system 102 includes a near-eye display system 104 coupled to a head-worn frame 106.

[0012] The near-eye display system 104 is configured to display still or moving images within the user's field of view. In some examples, the near-eye display system presents computer-generated holographic image representations that the user can interact with (e.g., manipulate). To support these functions, the vision control system 102 specifically includes an on-board computer 108 having a processor 110 and associated computer memory 112. In the example shown in FIG. 1 , the head-worn frame 106 takes the form of a visor. In other examples, the head-worn frame can take the form of goggles, a helmet, safety glasses, or the like.

[0013] The near-eye display system 102 is configured for binocular image display. To this end, the near-eye display system includes a right monocular system 114R that presents a right display image 116R in front of the user's right eye, and a left monocular system 114L that presents a left display image 116L in front of the user's left eye. For stereoscopic display, the right and left display images can be configured with appropriate stereoscopic parallax (see below) to display a three-dimensional subject or scene.

[0014] FIG. 2 illustrates an embodiment of an exemplary monocular system 214 of a near-eye display system. The monocular system includes a display projector 218 configured to form a display image 216. The display projector includes a high-resolution spatial light modulator (SLM) 220 illuminated by a light emitter 222. The light emitter can include a light-emitting diode (LED) or a laser diode, and the SLM can include, for example, a liquid crystal on silicon (LCOS) or a digital micromirror device (DMD). The SLM and the light emitter are operably coupled to a vision control system computer (such as computer 108 of FIG. 1). The computer controls the SLM's matrix of independent light-guiding pixel elements such that the SLM modulates light received from the light emitter and thereby forms the display image 216. By controlling the light modulation spatially as well as temporally, the computer can cause the display projector to project a synchronized sequence of display images (i.e., video). In the example shown in FIG. 2, the display image is formed by reflections from the SLM. In other examples, the display image can be formed by transmission through a suitably configured transmissive SLM. Display projectors based on other technologies, such as organic LED arrays, micro LED (μLED) arrays, scanning laser projectors, etc., are also envisioned.

[0015] In monocular system 214, display light from display projector 218 passes through a physical aperture of finite size. Optics downstream of the display projector focus the display light onto the user's right or left anatomical pupil. In doing so, the downstream optics direct the display light through an entrance pupil, defined as the image of the physical aperture at the anatomical pupil location. Due to the small size of the physical aperture and / or other features of modular system 214, the entrance pupil may be too small to reliably align with the user's anatomical pupil. Therefore, monocular system 214 includes magnification optics 224. The magnification optics is configured to receive the display light through a relatively small entrance pupil and emit the display light onto an enlarged exit pupil, which may be large enough to cover the entire area where the user's pupil is likely to be located. Such an area is referred to as the "eyebox."

[0016] Magnification optics 224 is configured to receive display image 216 from display projector 218 and emit a magnified version 216' of the display image toward pupil location 226. In the illustrated example, the magnification optics includes a light guide 228, an entrance grating 230, and an exit grating 232. The magnification optics may also include other gratings not shown in FIG. 2. The term "grating" should be understood broadly herein to include any type of diffractive optical element (DOE), regardless of whether the element includes a pattern of elongated diffractive features. Non-limiting example gratings include a surface-relief type grating having a series of closely spaced channels formed on a light guide, or a volume grating formed within a light guide material, or a refractive index-modulated grating.

[0017] The entrance grating 230 is a diffractive structure configured to receive the display image 216 and couple the display image light into the light guide 228. After coupling into the light guide, the display light propagates through the light guide by total internal reflection (TIR) ​​from the front and back surfaces of the light guide. The exit grating 232 is a diffractive structure configured to controllably emit the display light propagating from the light guide in the direction of the pupil position 226. To this end, the exit grating includes a series of light extraction features arranged from weak to strong in the direction of propagation of the display light through the light guide so that the display light is emitted at a uniform intensity along the length of the exit grating. As a result, the expansion optics 224 can be configured to expand the exit pupil of the display projector 218 to fill or slightly overfill the user's eyebox, providing desirable image quality and user comfort.

[0018] In some examples, the magnification optics 224 may magnify the exit pupil of the display projector 218 in only one direction, such as the horizontal direction, where most significant eye movement occurs. Here, the display projector itself may provide a large enough exit pupil, either by design or through a vertical pre-magnification stage, so that vertical magnification within the light guide is unnecessary. In other examples, the magnification optics 224 may be configured to magnify the exit pupil in both the horizontal and vertical directions. In such examples, display light propagating in a first direction within the light guide may encounter a rotating grating (not shown in FIG. 2 ) having multiple diffractive features arranged from weak to strong in the first direction. The rotating grating may be configured to rotate light diffracted by the diffractive features so that it propagates in a second direction while remaining unmagnified in the first direction. The collimated beams of magnified light then encounter the exit grating 232 and are coupled out of the waveguide as described above. Despite the usefulness of diffractive optical elements for coupling light to and from optical waveguides, in-coupling and out-coupling optical elements based on reflection, refraction, and / or scattering are also envisioned as alternatives to DOEs.

[0019] Referring again to FIG. 1 , the vision control system 102 includes a left side shield 134L (as well as a complementary right side shield, not shown in FIG. 1 ). Each side shield is configured to block ambient light from reaching the user's eyes when the user is wearing the frame 106. The light-blocking feature is important for providing an immersive VR experience, especially when relatively low-brightness virtual image representations are presented. In examples where the monocular system 114 is substantially opaque, the side shields 134 primarily block ambient light from peripheral directions. In some examples, the left side shield 134L is configured for attachment to the left side of the frame 106. In some examples, the side shield may conform to the contours of the user's face and may be referred to as a "face gasket." In some examples, the side shield may be detachable from the frame worn on the head. This feature allows the side shield to be easily cleaned or replaced. In the illustrated example, the side shield 134L includes a cutout or window 136 surrounded by an opaque boundary. In other instances, the window may be borderless. In still other instances, the vision control system may not have side shields at all.

[0020] The vision control system 102 includes a vision system 138 configured to combine frames 106 and provide pass-through video to the near-eye display system 104. The vision system 138 includes at least one real-world camera 140 configured to capture video of a scene in front of the vision control system. More specifically, the real-world camera may have an optical axis oriented in a forward direction and an FOV that spans approximately ±50 degrees horizontally and approximately ±40 degrees vertically relative to the optical axis. Wider and narrower FOVs are also contemplated.

[0021] The vision system 138 includes a video mixing engine 142 that is configured to mix video from a camera capturing the real world with virtual image representations from a hologram engine 144 of the computer 108. As a result, the vision system is configured to simulate an AR experience based on pass-through video from the camera capturing the real world augmented with the virtual image representations from the hologram engine.

[0022] The vision system 138 includes a motion detection engine 146 configured to detect motion around the head-worn frame 106. To this end, the motion detection engine receives input from an inertial measurement unit (IMU) 148. The IMU is mechanically coupled to the frame and includes a linear accelerometer, an electronic gyroscope, and (optionally) an electronic compass. The motion detection engine periodically evaluates changes in images captured by the camera 140 capturing the real world in light of concurrent changes in the frame's orientation. Image changes inconsistent with changes in orientation are registered as subject motion, which, in some examples, can be localized to one or more angles within the user's FOV. As a result, the vision system implements a motion sensor suitable for purposes herein. In other examples, different types of motion sensors, such as sonar- or lidar-based motion sensors, can be used. In these and other examples, the motion detection engine 146 or any other suitable motion sensor can be configured to activate control signals in accordance with motion detection around the head-worn frame 106. As described in further detail herein, the control signal may have the effect of pausing the immersive VR experience and allowing the user to observe more of the external scene.

[0023] The vision control system 102 includes a touchpad 150 configured to receive user input in the form of a finger touch or tap. While this form of input can serve various functions in the vision control system, in some instances it specifically signals a user's desire to pause the immersive VR experience and observe more of the external scene. Thus, the touchpad can be configured to activate an appropriate control signal in response to the detection of a finger touch or tap. In other instances, a mechanical switch or dial can be used in place of a touchpad. In still other instances, the user's position (i.e., of the frame 106) can be used as an indicator of an intent to remain immersed or to exit the VR experience. In other words, a control signal can be activated when the user moves out of a predefined "fenced area."

[0024] The vision control system 102 includes an audio input system 152. In the illustrated example, the audio input system includes a microphone 154, an audio amplifier 156, and a speech recognition engine 158. The audio amplifier is configured to amplify the audio signal from the microphone. The amplified audio signal may be received at the speech recognition engine 158, which is configured to recognize specific voice commands from a user. More generally, the audio input system is configured to activate a control signal pursuant to detection of a sound picked up by the microphone. In some examples, the audio input system activates a control signal upon detection of any sound louder than a predetermined threshold. In other examples, the audio input system activates a control signal upon detection of a recognized voice command, such as, for example, "Show me the world."

[0025] Vision control system 102 includes control circuitry 160 configured to control the blending of real and virtual image representations received by the user. To this end, the control circuitry is configured to receive control signals from one or more vision control system components. Such components may include, among other things, motion detection engine 146, touchpad 150, and / or audio input system 152. In response to receiving the control signals, the control circuitry causes video blending engine 142 to increase the proportion of pass-through video to near-eye display 104 and decrease the proportion of holographic content. In this scenario, the user can instantly observe as much of the real world as possible through vision system 138 without having to remove frames 106.

[0026] As described above, a challenge with this solution is that the FOV of the near-eye display 104 and / or the real-world camera 140 may be limited relative to the user's anatomical FOV, which may be as wide as 180 degrees horizontally. In other words, a user receiving only pass-through video may lack sufficient peripheral vision to feel comfortable without removing the frame 106 when a real-world image is desired or required. Reduced peripheral vision can be particularly frightening for the user when a real-world image is presented in an unexpected manner, such as in response to a barking dog or an unknown person entering the room. To address this challenge and provide additional benefits, a left electrochromic insert 162L is positioned on the left side of the head-mounted frame 106 (and a right electrochromic insert is positioned on the right side, not shown in FIG. 1 ). In configurations with side shields 134, each electrochromic insert can be configured to be received within a corresponding side shield, such as within a window or cutout in the side shield. In some examples, each electrochromic insert is configured to be detachable from the corresponding side shield, which in some configurations may itself be detachable from the frame 106. The electrochromic inserts provide the important technical advantage of controllably blocking light from the left and right sides of the vision control system that may reach the user's eyes. In some examples, the electrochromic inserts may be flexible, bendable, and / or curveable.

[0027] In some configurations, the electrochromic insert can include opposing transparent electrodes and a polymer film structure disposed between the opposing transparent electrodes. FIG. 3 illustrates a further embodiment of an example electrochromic insert 362. In the electrochromic insert 362, a polymer film structure 364 is sandwiched between transparent electrodes 366 and 366′. In some examples, each transparent electrode can comprise a degenerately doped semiconductor film, such as indium tin oxide (ITO) or fluorine-doped tin oxide (FTO). In some examples, each transparent electrode can comprise a microwire mesh. Peripheral contacts 368 extend to transparent electrode 366, and peripheral contacts 368′ extend to transparent electrode 366′. The peripheral contacts provide the important technical effect of transmitting a controllable electrical bias to the opposing transparent electrode. In this example, a first electrochromic conductive layer 370 is disposed adjacent to first transparent electrode 366, and a second electrochromic conductive layer 370' is disposed adjacent to second transparent electrode 366'. An ion-conducting layer 372 is disposed between the first and second electrochromic conductive layers.

[0028] In some examples, each electrochromic conductive layer comprises a film of redox-active material. The film can have an ion-conducting and / or ion-porous structure extending through its thickness to provide a high area density of redox-active sites electronically coupled to the adjacent transparent electrode. The ion-conducting layer 372 can comprise a polyelectrolyte filled with exchangeable counterions. The ion-conducting layer can penetrate the electrochromic conductive layers to some extent, allowing the exchangeable counterions of the ion-conducting layer to access (transfer between) the redox-active sites of both electrochromic conductive layers. This mechanism provides local charge balance when one electrochromic conductive layer is oxidized and the other is reduced. The ion-conducting layer also functions as a barrier to direct electronic coupling between the first and second electrochromic conductive layers. In a typical example, the redox-active material of the first electrochromic conductive layer is different from that of the second electrochromic conductive layer, with at least one of the electrochromic conductive layers comprising a material whose light transmittance changes with oxidation state. This material could be, for example, a transition metal oxide (e.g., tungsten oxide) or a mixture of transition metal oxides. When a temporary electrical bias is applied across the transparent electrodes, one of the electrochromic conductive layers is oxidized and the other is reduced, resulting in a net change in light transmittance across the polymer film structure 364.

[0029] Despite the usefulness and efficiency of the configurations described herein, it should be noted that electrochromic inserts based on other physicochemical effects are also contemplated. In some electrochromic inserts, for example, a polymer film structure may include a polymer-dispersed liquid crystal (PDLC) layer sandwiched between opposing transparent electrodes. In the absence of an applied electrical bias, randomly aligned liquid crystal molecules may scatter light passing through the film, thereby reducing light transmittance. However, when an electrical bias is applied, the electric field between the electrodes aligns the liquid crystal molecules with respect to the optical axis, thereby reducing the scattering cross section and increasing light transmittance. To support reversible bleaching of the electrochromic insert 362, a control circuit 360 is electrically coupled to the peripheral contacts 368 and 368′ and configured to apply a voltage to the peripheral contacts in accordance with the control signal, as described above. When no bias is applied to the electrodes 366 and 366′, the electrochromic insert 362 is relaxed to a low light transmittance state. As the voltage between transparent electrodes 366 and 366' is increased, the electrochromic insert becomes relatively more transmissive in proportion to the magnitude of the applied voltage. Thus, the control circuit provides the important technical effect of controlling the light transmittance of the electrochromic insert so that light reaching the user's eye from the left and right sides can be controllably blocked. Figure 4 is a hypothetical graph of light transmittance as a function of applied voltage for an electrochromic insert having a polymer film structure disposed between opposing transparent electrodes. Generally, the light transmittance of the electrochromic insert varies in response to the electrical bias applied to its transparent electrodes. Typically, the change in transmittance is substantially independent of wavelength in the visible spectrum. As shown in the graph, intermediate applied voltages provide intermediate light transmittances.

[0030] FIG. 5 shows another embodiment of an electrochromic insert 562. The electrochromic insert 562 includes a common transparent electrode 566′ and a series of opposing transparent electrodes 566A-566D stacked parallel to the common electrode. In this configuration, each opposing electrode is independently biased via a corresponding peripheral contact 568. In the illustrated example, the electrochromic layers 570 and 570′ and the ion-conducting layer 572 are segmented and aligned with the series of opposing transparent electrodes. In other examples, the layers may be continuous. In a vision control system incorporating the electrochromic insert 562, the control circuit 560 can, in some scenarios, be configured to individually bias each of the peripheral contacts by applying different voltages to the respective electrodes. This feature can be used to provide a controlled gradation of light transmittance along the electrochromic insert.

[0031] 6 shows another embodiment of an electrochromic insert 662L. The electrochromic insert 662L is curved from the left side to the bottom of the head-worn frame 606 so that light originating from below the device can be controllably blocked. In the vision control system, the side shield 634L includes an opaque border 673 surrounding a window through which the electrochromic insert is exposed. More generally, the vision control system may include any number of electrochromic inserts in one or more different locations on the head-worn frame, which may be integrated into or detachable from the frame.

[0032] 7 illustrates an embodiment of an example method 700 of operating a vision control system as disclosed herein. As described above, the vision control system includes an electrochromic insert located on one side of a head-worn frame of a near-eye display system.

[0033] Method 700 includes operations for checking for specific forms of user input, which may signal a user's desire or need to observe more of the real world. Any of these operations may be omitted, or others may be added, depending on the implementation. For example, at 774A, the vision control system checks for a finger touch on the touchpad of the head-worn frame and, if a finger touch is detected, activates a control signal at 774B. At 774C, the vision control system checks for sound from a microphone of an audio input system and, if a sound louder than a predetermined threshold is picked up, activates a control signal. In some examples, the audio input system can perform voice recognition on sounds received from the microphone and can activate a control signal if the user utters a specific voice command. Thus, in some examples, a control signal can be activated according to input from a user of a near-eye display system disposed within the head-worn frame.

[0034] At 774D of method 700, a motion sensor in the vision control system checks for detected motion around the head-worn frame, and if motion above a predetermined value is detected, the vision control system activates a control signal.

[0035] At 774E, the video mixing system of the vision control system enables pass-through video from the camera capturing the real world to the near-eye display system in response to receiving the control signal. At 774F, the control circuit of the electrochromic insert biases at least two peripheral contacts electrically coupled to at least two transparent electrodes of the electrochromic insert in response to receiving the control signal, thereby increasing the light transmittance of the electrochromic insert and thereby increasing the user's peripheral vision of the real world.

[0036] As described above, the control signals for enabling pass-through video and for bleaching the electrochromic insert can be activated according to user input, audio input, and / or detected motion. In some examples, the exact same control signal that enables pass-through video also causes the electrochromic insert to bleach. In other examples, pass-through video is enabled according to a first control signal, and the electrochromic insert is bleached according to a second control signal that is separate from the first control signal. Furthermore, user input, audio input, and / or motion detection can be mapped to separate first and second control signals in any useful manner. In one non-limiting example, motion detection can activate only the first control signal, while user input or audio input can activate both the first and second control signals. In another non-limiting example, motion detected substantially in front of the vision control system can activate the first control signal, while motion to the side of the head-worn frame can activate the second control signal. In general, the triggering operation of the control circuit can be compatible with virtually any suitable control scheme. Thus, in a configuration where the first and second control signals are separate, the video mixing engine at 774E can receive the first control signal and, in response, enable pass-through video from the camera capturing the real world to the near-eye display. At 774F, the control circuit can receive the second control signal and, in response, increase the voltage applied between the transparent electrodes on opposite sides of the electrochromic insert.

[0037] In the example shown in FIG. 1 , the near-eye display system 104 is fully integrated within the vision control system 102. A similar configuration is shown in FIG. 8 , where the side shields 834 are detachable from the head-worn frame 806 and electrochromic insert 862. Detachable side shields provide the important technical advantage of allowing the side shields (which are in constant contact with the user's face) to be cleaned using products that may not be suitable for use on the headset's electronic components. In other examples, the vision control system may be an add-on to the near-eye display system. This approach allows the vision control system to be offered to owners of compatible near-eye display systems in the aftermarket. Furthermore, this may allow the vision control and near-eye display system components to be cleaned, inspected, and / or replaced separately.

[0038] In this spirit, FIG. 9 illustrates another embodiment of a vision control system 902. The vision control system 902 includes an electrochromic insert 962 configured for placement on the left side of a head-worn frame 906 of a near-eye display system. As described above, the electrochromic insert includes at least two transparent electrodes, with at least two peripheral contacts 968 and 968′ each extending to the at least two transparent electrodes. The vision control system 902 includes a side shield 934 configured for attachment to the left side of the head-worn frame. In the example shown in FIG. 9, the side shield is detachable from the head-worn frame 906. The peripheral contacts 968 and 968′ are configured to detachably mate with corresponding contacts 976 and 976′ of the head-worn frame, and control circuitry disposed within the head-worn frame is electrically coupled to the peripheral contacts via the corresponding contacts. In this example, the peripheral contacts extend to a peripheral edge 979 of the side shield 934.

[0039] FIG. 10 illustrates yet another embodiment of a vision control system 1002. The vision control system 1002 includes an electrochromic insert 1062 configured for placement on the left side of a head-worn frame 1006 of a near-eye display system. As described above, the electrochromic insert includes at least two transparent electrodes, with at least two peripheral contacts 1068 and 1068′ each extending to at least two transparent electrodes. The vision control system 1002 includes a side shield 1034 configured for attachment to the left side of the head-worn frame. In the example shown in FIG. 10, the side shield 1034 is detachable from the head-worn frame. The peripheral contacts 1068 and 1068′ are configured to detachably mate with corresponding contacts 1076 and 1076′ of the head-worn frame, and control circuitry located within the head-worn frame is electrically coupled to the peripheral contacts via the corresponding contacts. The peripheral contacts are disposed on a peripheral edge 1079 of the electrochromic insert. Here, the electrochromic inserts are detachable from the side shields 1034 and are configured for attachment to the sides of a head-worn display frame.

[0040] The embodiments of the drawings and descriptions should not be construed in a limiting sense, as numerous modifications, extensions, and omissions are contemplated. In the above description, all of the vision control systems have electrochromic inserts because this technology provides efficient, lightweight, and low-noise bleaching of the side windows of the near-eye display frame. In other examples, the side windows may include electromechanically or piezoelectrically actuated shutters or irises. In still other examples, the vision control system may be configured to pump opaque fluid into the side windows when low transmittance is desired and to withdraw the opaque fluid when high transmittance is desired.

[0041] In the above description, various electrochromic inserts have minimal transmittance in the unbiased state (as shown in FIG. 4 ) and become increasingly transmittant as the applied voltage increases. This functional dependence may be advisable for engineering efficiency and to conserve power in typical usage scenarios. However, the opposite functional dependence—e.g., the inversion of the graph in FIG. 4 —is also contemplated. Furthermore, the term “electrochromic” is not intended to limit the underlying cause of the dependence of optical transmittance on applied electrical bias. This term applies herein not only to redox-active film structures that change absorption as a function of bias, but also to structures such as PDLC films in which an applied electric field affects the anisotropic scattering cross section of the film. Furthermore, it should be understood that certain technical terms in materials chemistry, such as “redox-active” and “oxidation state” above, have equivalents in the alternative language of materials physics. Accordingly, the distribution of oxidation states of redox-active species can be related to the energy band occupancy of a semiconductor.

[0042] The following provides further context for the operation of the near-eye display system herein. Briefly referring back to FIG. 2, each display image formed by monocular system 214 is a virtual image presented at a predetermined distance Z in front of user 0. Distance Z is referred to as the “focal plane depth” of the display image. In some monocular systems, the value of Z is a fixed function of design parameters of display projector 218, entrance grating 230, exit grating 232, and / or other fixed-function optics. Based on the permanent configuration of these structures, the focal plane can be positioned at a desired depth. In one example, Z can be set to “infinity” so that each optical system presents the display image in the form of a collimated beam. In another example, Z can be set to 33 centimeters, which requires the optical system to present each display image in the form of a diverging beam. In some examples, Z can be selected at design time and can remain constant for all virtual image representations presented by the display system. Alternatively, the optical system can be configured with electronically adjustable optical power to allow Z0 to vary dynamically according to the range of distances over which the virtual image representation is to be presented.

[0043] Binocular near-eye display systems utilizing fixed or variable focal planes can have the ability to present virtual display image representations that are perceived as being located at a controlled, variable distance in front of or behind the focal plane. This effect can be achieved by controlling the horizontal disparity of each pair of corresponding pixels in the right and left stereo images, as described below with reference to Figures 11A and 11B.

[0044] FIG. 11A shows right and left image frames 1180R and 1180L overlaid on top of each other for ease of illustration. The right image frame surrounds a right display image 1116R, and the left image frame surrounds a left display image 1116L. When viewed simultaneously through near-eye display system 102, the right and left display images may appear to a user as a 3D hologram 1182 constructed from individually rendered positions. Each position i on the visible surface of the hologram corresponds to a corresponding pixel (X i ,Y i ) and the associated depth coordinate Z i The desired depth coordinate can be simulated as follows:

[0045] First, the distance Z to the focal plane F of the near-eye display system is selected. Then, the depth coordinate Z for every position i on the visible surface of the hologram is established. This is done by adjusting the positional parallax of the two pixels corresponding to position i in the right and left display images relative to their respective image frames. In Figure 11B, the pixel corresponding to position i in the right image frame is i and the corresponding pixel in the left image frame is denoted as L i In FIG. 11B, the positional disparity is positive—i.e., R i is the L in the overlaid image frame. i A positive positional parallax causes position i to appear behind the focal plane F. If the positional parallax is negative, the position will appear in front of the focal plane. Finally, the right and left display images are superimposed (if there is no parallax, R i and L i are coincident), the position will appear to be located directly on the focal plane. Without binding this disclosure to any particular theory, the positional parallax D can be related to Z, Z0, and the user's interpupillary distance (IPD) by the following equation:

number

[0046] In some examples, computer 108 maintains a model of a Cartesian space in front of the user, in a frame of reference fixed to near-eye display system 102. The user's pupil positions are mapped onto this space, as are image frames 1180R and 1180L, each positioned at a predetermined depth Z. Each position i on the viewable surface of the image representation is then assigned a coordinate X in the common frame of reference. i , Y i , and Z i The visible surface of hologram 56 is constructed with i=1, where i is the pupil position of the user's right eye and i is the pupil position of the user's left eye. For each position on the visible surface, two line segments are constructed, the first line segment for the pupil position of the user's right eye and the second line segment for the pupil position of the user's left eye. The pixel R in the right display image corresponding to position i is i is taken to be the intersection of the first line segment in the right image frame 1180R. Similarly, pixel L of the left display image i is also obtained to be the intersection point of the second line segment in left image frame 1180L. This procedure provides the appropriate amount of shifting and scaling to correctly render the visible surface, thereby placing all positions i at the appropriate distance and with the appropriate field of view. In some instances, the scheme outlined above can be facilitated by a real-time estimation of the user's pupil position. In instances where pupil estimation is not attempted, a suitable proxy for pupil position, such as the center of rotation of the pupil position or the eyeball position, can be used instead.

[0047] Referring again to FIG. 2, controlling the stereo disparity of images confined to a focal plane is adequate for rendering a three-dimensional effect, but it is less adequate for shifting the entire display image back and forth within the user's field of view. To resolve depth within a complex scene, the human visual cortex interprets multiple visual cues (e.g., occlusion and motion parallax) in addition to the neurologically coupled eye movements of binocular vergence and lens accommodation. Stereo disparity stimulates binocular vergence cues but not accommodation cues. Rather, the user's lenses remain focused on a fixed focal plane, regardless of the depth value signaled by stereo disparity. However, when the disparity changes, the focal plane does not move, and a dissonance is perceived between the two eye movement cues, which can result in user discomfort.

[0048] Thus, the monocular system 214 of FIG. 2 can be configured to change the focal plane at which the virtual display image representation is presented. In the illustrated example, the monocular system includes a variable-focus lens 284 of variable optical power. The computer 108 is configured to control the focusing bias of the variable-focus lens so that the display light is imaged onto a focal plane positioned at a variable, controlled distance from the pupil position 226. In a stereoscopic near-eye display system, this control feature can be achieved in combination with appropriate control of stereo disparity, as described above. The monocular system 214 of FIG. 2 also includes a fixed-focus lens 286 in series with the variable-focus lens 284 and configured to pre-bias the vergence of the display light emitted from the magnification optics 224.

[0049] When applied in an AR display system, the variable-focus lens 284 and / or the fixed-focus lens 286 will change the vergence of external light received from the side opposite the user. Accordingly, in FIG. 2 , the monocular system 214 further includes a variable compensation lens 288 with variable optical power and a fixed compensation lens 290. In some examples, the fixed optical power of the fixed compensation lens 290 can oppose and substantially reverse the fixed optical power of the fixed-focus lens 286. Additionally, while controlling the focusing bias so that the display light is focused onto a focal plane positioned at a controlled, variable distance from the user 100, the computer 108 can synchronously control the compensation bias of the variable compensation lens so that external light reaches the user with a constant vergence.

[0050] As mentioned above, the methods herein may be implemented in conjunction with a computer system of one or more computing devices. Such methods and processes may be implemented as an application program or service, an application programming interface (API), a library, and / or other computer program product.

[0051] 12 provides a schematic representation of a computer system 1208 configured to provide some or all of the computer system functionality disclosed herein. The computer system 1208 can have the form of a personal computer, an application-server computer, or any other computing device. The computer system 1208 includes a logic system 1210 and a computer memory system 1212. The computer system 1208 may optionally include a display system 1292, an input system 1294, a network system 1296, and / or other systems not shown in the drawing.

[0052] Logic system 1210 includes one or more physical devices configured to execute instructions. For example, the logic system can be configured to execute instructions that are part of at least one operating system (OS), application, service, and / or other program construct. The logic system can include at least one hardware processor (e.g., a microprocessor, central processor, central processing unit (CPU), and / or graphics processing unit (GPU)) configured to execute software instructions. Additionally or alternatively, the logic system can include at least one hardware or firmware device configured to execute hardware and firmware instructions. The processor of the logic system can be single-core or multi-core, and the instructions executed thereon can be configured for sequential, parallel, and / or distributed processing. Individual components of the logic system can optionally be distributed among two or more separate devices, which can be remotely located and / or configured for coordinated processing. Aspects of the logic system can be virtualized and executed by remotely accessible networked computing devices arranged in a cloud computing configuration.

[0053] The computer memory system 1212 includes at least one physical device configured to temporarily and / or permanently store computer system information, such as data and instructions, that are executable by the logic system 1210. When the computer memory system has more than one device, the devices may be co-located or remotely located. The computer memory system 1212 may include at least one volatile, non-volatile, dynamic, static, read / write, read-only, random access, sequential access, location read addressable, file read addressable, and / or content read addressable computer memory device. The computer memory system 1212 may include at least one removable and / or embedded computer memory device. When the logic system executes instructions, the state of the computer memory system 1212 may be transformed, for example, to hold different data.

[0054] Aspects of logic system 1210 and computer memory system 1212 may be integrated together in one or more hardware logic components, which may include, for example, at least one program or application specific integrated circuit (PASIC / ASIC), program or application specific standard product (PSSP / ASSP), system on a chip (SOC), or complex programmable logic device (CPLD).

[0055] Logic system 1210 and computer memory system 1212 may cooperate to instantiate one or more logic devices or engines. As used herein, the terms “device” and “engine,” respectively, collectively refer to cooperating hardware, firmware, software, instructions, and / or any other components that provide computer system functionality. In other words, devices and engines are never abstract concepts and always have tangible form. A device or engine may be instantiated by a single computing device, or it may include two or more subcomponents instantiated by two or more different computing devices. In some implementations, a device or engine includes a local component (e.g., a software application executed by a computer system processor) that cooperates with a remote component (e.g., a cloud computing service provided by a network of one or more server computer systems). Software and / or other instructions that give a particular device or engine its functionality may optionally be stored as one or more non-executing modules on one or more computer memory devices.

[0056] The devices and engines (used throughout the above description) may be implemented using any suitable combination of machine learning (ML) and artificial intelligence (AI) techniques. Non-limiting examples of techniques that may be incorporated in one or more device implementations include support vector machines, multi-layer neural networks, convolutional neural networks (spatial convolutional networks for processing images and / or videos and / or any other suitable convolutional neural networks configured to convolve and / or pool features across one or more temporal and / or spatial dimensions), recurrent neural networks (e.g., long-short-term memory networks), associative memories (e.g., lookup tables, hash tables, Bloom filters, neural Turing machines, and / or neural random access memories), unsupervised spatial and / or clustering methods (e.g., nearest neighbor algorithms, topological data analysis, and / or k-means clustering), and / or graphical models (e.g., (hidden) Markov models, Markov random fields, (hidden) conditional random fields, and / or AI knowledge bases).

[0057] When included, the display system 1292 can be used to present a visual representation of the data maintained by the computer memory system 1212. The visual representation can, in some examples, have the form of a graphical user interface (GUI). The display system can include one or more display devices utilizing virtually any type of technology. In some implementations, the display system can include one or more virtual, augmented, or mixed reality displays.

[0058] When included, input system 1294 may include or interface with one or more input devices. The input devices may include sensor devices or user input devices. Examples of user input devices include a keyboard, a mouse, or a touch screen.

[0059] When included, network system 1296 can be configured to communicatively couple computer system 1208 with one or more other computer systems. The network system can include wired or wireless communication devices compatible with one or more different communication protocols. The network system can be configured for communication over personal, local, and / or wide area networks.

[0060] The present disclosure is presented by way of example and with reference to the accompanying drawing figures. Components, process steps, and other elements that may be substantially identical in one or more of the figures are identified in a coordinated manner and described with minimal repetition. It should also be noted, however, that elements identified in a coordinated manner may differ to some extent. It should further be noted that the figures are schematic and generally not drawn to scale. Rather, various drawing scales, aspect ratios, and numbers of components shown in the figures may be intentionally distorted to facilitate observation of particular features or relationships.

[0061] In conclusion, one aspect of the present disclosure is directed to a vision control system having a near-eye display system coupled to a head-worn frame, a vision system that provides pass-through video to the near-eye display system, and an electrochromic insert having at least two peripheral contacts and a control circuit. The electrochromic insert is disposed on one side of the head-worn frame with the peripheral contacts each extending to at least two transparent electrodes. The control circuit is electrically coupled to the peripheral contacts and configured to apply a voltage to the peripheral contacts in accordance with a control signal to change the light transmittance of the electrochromic insert.

[0062] In some implementations, the electrochromic insert is configured to be received within a side shield configured for attachment to a side of a head-worn frame. In some implementations, the vision control system further includes a motion sensor, wherein the control signal is activated in response to motion detection by the motion sensor. In some implementations, the vision control system further includes a microphone, wherein the control signal is activated in response to detection of sound picked up by the microphone.

[0063] Another aspect of the present disclosure is directed to a vision control system having an electrochromic insert and at least two peripheral contacts. The electrochromic insert includes at least two transparent electrodes and is configured for placement on one side of a head-worn frame of a near-eye display system. The peripheral contacts extend to the transparent electrodes, and the optical transmittance of the electrochromic insert varies in response to an electrical bias applied to the transparent electrodes.

[0064] In some implementations, the peripheral contacts are configured to removably mate with corresponding contacts on a frame worn on the head. In some implementations, the peripheral contacts are disposed on a peripheral edge of the electrochromic insert. In some implementations, the vision control system further includes side shields configured for attachment to the sides of a frame worn on the head, wherein the peripheral contacts extend to the peripheral edges of the side shields. In some implementations, the electrochromic insert is detachable from the side shields configured for attachment to the sides of a frame worn on the head. In some implementations, the vision control system further includes a control circuit electrically coupled to the peripheral contacts and configured to apply a voltage to the peripheral contacts in accordance with the control signal to change the light transmittance of the electrochromic insert. In some implementations, a voltage applied between at least two transparent electrodes increases the light transmittance of the electrochromic insert. In some implementations, the electrochromic insert includes a polymer dispersed liquid crystal film disposed between at least two transparent electrodes. In some implementations, the at least two transparent electrodes include first and second transparent electrodes, and the electrochromic insert includes a first electrochromic conductive layer adjacent to the first transparent electrode, a second electrochromic conductive layer adjacent to the second transparent electrode, and an ion-conductive layer intermediate the first and second electrochromic conductive layers. In some implementations, the at least two transparent electrodes include a common electrode and a series of opposing electrodes stacked parallel to the common electrode, where each opposing electrode is independently biased via an independent contact, and the electrochromic and ion-conductive layers are segmented in registration with the series of opposing electrodes. In some implementations, the electrochromic insert is curved from the side of the frame worn on the head to the top or bottom of the frame worn on the head.In some implementations, the vision control system further includes a near-eye display system coupled to the head-worn frame and a camera for capturing images of the real world.

[0065] Another aspect of the present disclosure is directed to a method of operating a vision control system having an electrochromic insert disposed on one side of a head-worn frame of a near-eye display system. The method includes: (a) receiving a control signal; and (b) electrically biasing at least two peripheral contacts electrically coupled to at least two transparent electrodes of the electrochromic insert in accordance with the receipt of the control signal. The light transmittance of the electrochromic insert changes in response to the electrical bias applied to the transparent electrodes.

[0066] In some implementations, the control signals are initiated according to input from a user of a near-eye display system positioned within a head-worn frame, hi some implementations, the control signals are initiated according to a voice command from the user.

[0067] It should be understood that the configurations and / or methods described herein are illustrative in nature, and that these specific embodiments or examples should not be considered limiting, since numerous variations are possible. A particular routine or method described herein may represent one or more of any number of processing strategies. Thus, various acts illustrated and / or described may be performed in the sequence illustrated and / or described, in other sequences, in parallel, or omitted. Similarly, the order of processes described above may be changed. In this spirit, the phrase "based at least partly on" is intended to remind the reader that functional and / or conditional logic shown herein operating in combination with the illustrated logic to provide additional benefits does not require or preclude appropriate additional logic. The subject matter of the present disclosure includes all novel and non-obvious combinations and subcombinations of the various processes, systems, and configurations disclosed herein, as well as other features, functions, acts, and / or properties, as well as any and all equivalents thereof.

Claims

1. 1. A vision control system, comprising: a near-eye display system coupled to a head-worn frame; an electrochromic insert disposed on one side of the frame worn on the head, the electrochromic insert including at least two transparent electrodes; at least two peripheral contacts each extending to said at least two transparent electrodes; a control circuit electrically coupled to the peripheral contacts and configured to apply a voltage to the peripheral contacts in accordance with a control signal to modify the light transmittance of the electrochromic insert; a vision system including at least one real-world camera and configured to provide pass-through video to the near-eye display system; A vision control system comprising:

2. 2. The vision control system of claim 1, wherein the electrochromic insert is configured to be received within a side shield configured for attachment to the side of the head-worn frame.

3. The vision control system of claim 1 , further comprising a motion sensor, wherein the control signal is activated in accordance with motion detection by the motion sensor.

4. The vision control system of claim 1 , further comprising a microphone, wherein the control signal is activated according to the detection of a sound picked up by the microphone.

5. 1. A vision control system, comprising: an electrochromic insert configured for placement on one side of a head-worn frame of a near-eye display system, the electrochromic insert including at least two transparent electrodes, the light transmittance of the electrochromic insert varying in response to an electrical bias applied to the transparent electrodes; at least two peripheral contacts each extending to said at least two transparent electrodes; A vision control system comprising:

6. The vision control system of claim 5 , wherein the peripheral contacts are configured to removably mate with corresponding contacts on the head-worn frame.

7. The vision control system of claim 5 , wherein the peripheral contacts are disposed on a peripheral edge of the electrochromic insert.

8. 6. The vision control system of claim 5, further comprising side shields configured for attachment to the sides of the head-worn frame, the peripheral contacts extending to peripheral edges of the side shields.

9. 6. The vision control system of claim 5, wherein the electrochromic insert is detachable from a side shield configured for attachment to the side of the head-worn frame.

10. 6. The vision control system of claim 5, further comprising a control circuit electrically coupled to the peripheral contacts and configured to apply a voltage to the peripheral contacts in accordance with a control signal to change the light transmittance of the electrochromic insert.

11. The vision control system of claim 5 , wherein a voltage applied between the at least two transparent electrodes increases the light transmittance of the electrochromic insert.

12. The vision control system of claim 5 , wherein the electrochromic insert comprises a polymer dispersed liquid crystal film disposed between the at least two transparent electrodes.

13. 6. The vision control system of claim 5, wherein the at least two transparent electrodes include first and second transparent electrodes, and the electrochromic insert includes a first electrochromic conductive layer adjacent to the first transparent electrode, a second electrochromic conductive layer adjacent to the second transparent electrode, and an ion conductive layer located intermediate the first and second electrochromic conductive layers.

14. 14. The vision control system of claim 13, wherein the at least two transparent electrodes include a common electrode and a series of opposing electrodes stacked parallel to the common electrode, each of the opposing electrodes being independently biased via an independent contact, and the electrochromic-conductive layer and the ion-conductive layer being segmented in registration with the series of opposing electrodes.

15. The vision control system of claim 5 , wherein the electrochromic insert is curved from the side of the frame worn on the head to the top or bottom of the frame worn on the head.

16. The vision control system of claim 5 , further comprising a near-eye display system coupled to the head-worn frame and a camera for capturing images of the real world.

17. 1. A method of operating a vision control system, the method comprising: receiving a control signal; electrically biasing at least two peripheral contacts electrically coupled to at least two transparent electrodes of an electrochromic insert disposed on one side of a head-worn frame of the near-eye display system in response to receiving the control signal; Including, The method wherein the light transmittance of the electrochromic insert varies in response to an electrical bias applied to the transparent electrode.

18. 20. The method of claim 17, wherein the control signal is activated according to input from a user of a near-eye display system disposed within the head-worn frame.

19. The method of claim 18 , wherein the control signal is activated according to a voice command of the user.

20. 18. The method of claim 17, further comprising detecting motion about the head-worn frame, and wherein the control signal is activated in accordance with the detection of the motion.

Images