Diopter adjustment for head mounted displays using electrically controllable lenses

Abstract

Provided is a head mounted display (HMD) with diopter adjustment capability using electrically controllable lenses. The electrically controllable lens may, or can be coupled to, a pair of lens tubes of the HMD, and is configured to direct light emitted by a display panel of the HMD toward an eye of a user wearing the HMD. The processor may be configured to execute computer executable instructions stored in the memory to provide a control signal to the electrically controllable lens to adjust an optical power of the electrically controllable lens.

Description

Cross-references to related applications

[0001] This application is an international application claiming the benefit and priority of U.S. Provisional Application No. 63 / 589,099, filed October 10, 2023, entitled “DIOPTER ADJUSTMENT FOR A HEAD-MOUNTED DISPLAY USING ELECTRICALLY-CONTROLLABLE LENSES,” the entire contents of which are incorporated herein by reference for all purposes. Background Technology

[0002] Head-mounted displays (HMDs) are used in a wide variety of fields, including engineering, medical, military, and video gaming. HMDs present graphical information or images to users as part of a virtual reality (VR), augmented reality (AR), and / or mixed reality (MR) environment. For example, when playing VR video games, users can wear an HMD to immerse themselves in the virtual environment. Some HMD users have vision impairments, such as nearsightedness, farsightedness, or astigmatism. However, for such users, wearing their prescription glasses under the HMD may cause discomfort.

[0003] This provides technical solutions for improving and enhancing these and other systems. Attached Figure Description

[0004] Figure 1 A perspective view of an example HMD having a pair of example electrically controllable lenses and a pair of lens tubes to which the electrically controllable lenses can be coupled, according to an embodiment disclosed herein.

[0005] Figure 2 A front view of a pair of example electrically controllable lenses according to an embodiment disclosed herein is shown, the optical power of which can be adjusted by providing a control signal to the electrically controllable lenses.

[0006] Figure 3 A side view of an electrically controllable lens according to an embodiment disclosed herein is illustrated, along with techniques for using the electrically controllable lens to increase or decrease the optical power of the electrically controllable lens.

[0007] Figure 4 This is a flowchart of an example process for providing vision correction to a user by controlling an electrically controllable lens of an HMD based on user input provided by a user wearing the HMD, according to embodiments disclosed herein.

[0008] Figure 5 This is a flowchart of an example process for simulating a light field display in an HMD using an electrically controllable lens, according to embodiments disclosed herein.

[0009] Figure 6 Example components of a system in which the technology disclosed herein can be implemented, according to embodiments disclosed herein, are illustrated. Detailed Implementation

[0010] Approximately 50% of HMD users have visual impairments, such as myopia, hyperopia, astigmatism, or other eye conditions. These users can wear their HMD without their prescription glasses (e.g., eyeglasses, contact lenses, etc.), but in doing so, they will not be able to see the images displayed through the HMD clearly. The severity of a user's blurred vision depends on the severity of their visual impairment. Most HMDs do not have enough space to accommodate prescription glasses, making it uncomfortable for visually impaired users even if they could wear their prescription glasses under the HMD. Another option for visually impaired users is to wear prescription contact lenses under the HMD. However, many users do not own, dislike, or cannot wear contact lenses for a variety of reasons. Furthermore, sweating can cause problems with contact lenses. For example, if a contact lens wearer moves around frequently while wearing the HMD, such as during a physical VR experience, the user may start to sweat, and their contact lenses may absorb moisture generated inside the HMD, making them uncomfortable to wear. Users with visual impairments can order custom-prescribed lens adapters for their HMDs, but these lens adapters are only custom-made for individual users, which makes them useless for other users with different eye prescriptions (e.g., friends or family).

[0011] Furthermore, techniques, devices, and systems for providing refractive adjustment capabilities to an HMD using electrically controllable lenses are described herein. The HMD described herein can take many forms, including helmets, face shields, goggles, masks, glasses, or any other head-mounted device and / or eye-mounted device suitable for wearing on a user's head. The HMD may include one or more display panels that display images (e.g., frames) for viewing by a user wearing the HMD. In some instances, the images are rendered by an application that may execute on the HMD and / or on a separate computing device (e.g., a personal computer, video game console, etc.) communicatively coupled to the HMD (wired or wirelessly). Additionally, in some instances, a user may interact with the HMD by operating one or more handheld controllers to further engage in VR, AR, and / or MR environments.

[0012] The HMD may further include an optical subsystem that uses one or more optical elements to direct light from the display panel toward the user's eyes. The optical subsystem configures the HMD as a near-eye display by using one or more optical elements to focus light emitted from the display panel toward the user's eyes, which are relatively close to the display panel. Various types and combinations of different optical elements can be used to bend light from the display panel so that the display panel appears farther away to the user than it actually is. For example, the optical subsystem may include, but is not limited to, apertures, lenses (e.g., Fresnel lenses, convex lenses, concave lenses, etc.), filters, etc. The optical elements of the optical subsystem may be housed within a pair of lens tubes of the HMD. The lens tubes are positioned in front of the display panel and, when the user is wearing the HMD, are positioned between the user's eyes and the display panel. Although the HMD's optical subsystem may be designed to correct one or more optical errors (e.g., barrel distortion, pincushion distortion, longitudinal chromatic aberration, lateral chromatic aberration, spherical aberration, coma, field curvature, etc.), the optical elements within the lens tubes (e.g., lenses) may still be designed for users without visual impairment (i.e., users with "good" vision).

[0013] Therefore, a system including an HMD may include one or more electrically controllable lenses. The electrically controllable lenses described herein can be used in conjunction with the HMD for purposes such as refractive adjustment. That is, the system's processor can provide control signals to the electrically controllable lenses to adjust their optical power. For example, the optical power of the electrically controllable lens can be increased to decrease its focal length, or the optical power can be decreased to increase its focal length. In some instances, using electrically controllable lenses for refractive adjustment allows for the simulation of a user's prescription eyeglasses. This, in turn, allows visually impaired users to view images displayed on the HMD's display panel clearly and sharply without having to wear their prescription eyeglasses (e.g., glasses, contact lenses, etc.) below the HMD.

[0014] In some instances, a user wearing an HMD can provide user input to adjust the optical power of an electrically controllable lens. The type of user input and the type of device receiving the user input for diopter adjustment can vary depending on the specific implementation. For example, the HMD may include dedicated controls (e.g., actuators, such as rotary knobs) that can be operated by the user's fingers to adjust the optical power of the electrically controllable lens. As another example, the user can provide user input to adjust the optical power of the electrically controllable lens via a handheld controller, such as by interacting with user interface elements presented on the display panel of the HMD using the handheld controller. In some instances, the user can issue a voice command to adjust the optical power of the electrically controllable lens, and this voice command can be detected by the HMD's microphone to achieve diopter adjustment. Regardless of the type of user input or the type of device and / or control receiving the user input, the system's processor can be configured to provide control signals to the electrically controllable lens to adjust its optical power at least in part based on the user input. Diopter adjustment is intuitive for HMD users, as they can increase or decrease the optical power of the electrically controllable lens as needed until the displayed image appears clear and sharp to them.

[0015] In some instances, a pair of electrically controllable lenses can be used with an HMD. In these instances, each electrically controllable lens can be controlled independently of the other electrically controllable lenses. This ability to control each electrically controllable lens independently allows for vision correction to be provided to users with different prescriptions for each eye. Furthermore, in addition to myopia and hyperopia, electrically controllable lenses can be used to correct astigmatism and other possible eye conditions, as described in more detail below. The electrically controllable lenses described herein are also "universal" in the sense that they can be used by multiple different users with different eyeglass prescriptions (e.g., different users in the same household). Therefore, the electrically controllable lenses described herein are an improvement on conventional lens adapters that can only be used by users with a specific eyeglass prescription because their optical power cannot be adjusted.

[0016] The use of electrically controllable lenses for diopter adjustment in a Hidden Camera (HMD) eliminates the need for moving parts (e.g., movable lenses) and mechanical adjustment mechanisms within the HMD. Conventional diopter adjustment mechanisms, such as Alvarez lenses, require more space within the HMD to accommodate lens movement. In contrast, the electrically controllable lenses described herein allow for the saving of this valuable space within the HMD (e.g., by using space for other useful components) or otherwise reducing the size and weight of the HMD to provide a lightweight HMD with relatively small form parameters. Eliminating moving parts for diopter adjustment also means that the HMD is less prone to failure. Electrically controllable lenses can also be made into planar lenses of substantially uniform thickness. In view of the above, the electrically controllable lenses described herein offer numerous technical benefits compared to conventional diopter adjustment mechanisms that rely on mechanical moving parts, such as Alvarez lenses. This constitutes an improvement in the optical technology used in HMDs.

[0017] The technologies, devices, and systems described herein can provide additional enhancements and benefits to replace or supplement vision correction for visually impaired users. For example, the electrically controllable lenses described herein can be used to simulate light field displays, enabling users wearing HMDs to perceive depth in the displayed image. For instance, a series of control signals can be provided to the electrically controllable lenses in sync with the refresh rate of the HMD's display panel, as described in more detail below. By changing the control signals provided to the electrically controllable lenses in sync with updates to the HMD's display panel, the viewing user can perceive depth in the displayed image, thereby providing a more immersive viewing experience for users wearing HMDs.

[0018] Also disclosed herein are HMDs configured to implement the techniques and processes disclosed herein, and systems for storing computer-executable instructions for implementing the techniques and processes disclosed herein. Although the techniques and systems disclosed herein are generally discussed by way of example in the context of video game applications, and specifically VR game applications, it should be understood that the techniques and systems described herein can provide benefits for other applications, including but not limited to non-VR applications (e.g., AR applications, MR applications, etc.) and / or non-gaming applications, such as industrial machine applications, defense applications, robotics applications, etc.

[0019] Figure 1A perspective view of an example HMD 102 is illustrated, comprising a pair of example electrically controllable lenses 100(1), 100(2) (collectively referred to as 100) according to embodiments disclosed herein, and a pair of lens tubes 104(1), 104(2) (collectively referred to as 104) to which the electrically controllable lenses 100 can be coupled. In some instances, the HMD 102 is a standalone HMD 102 (sometimes referred to as an “integrated” HMD 102) that includes most, if not all, of the components described herein and is capable of operating without or with minimal assistance from a separate computer. In these instances, the standalone HMD 102 is still communicatively coupled to one or more handheld controllers. In some instances, the HMD 102 is a component of a distributed system that may include the HMD 102, one or more handheld controllers, and at least one additional computer that is separate from but communicatively coupled to the HMD 102 and one or more handheld controllers. Reference is made below. Figure 6 A more detailed description of the various specific implementations of the system, including the HMD 102.

[0020] Systems including the HMD 102 may include one or more processors for executing applications (e.g., video games) to render associated video content (e.g., a series of images) on the display panel of the HMD 102. In some instances, the HMD 102 may represent a VR headset for use in VR systems, such as for use with VR gaming systems. However, the HMD 102 may additionally or alternatively be implemented as an AR headset for AR applications, an MR headset for MR applications, or a headset for VR, AR, and / or MR applications unrelated to gaming (e.g., industrial applications, robotics applications, military / weapon applications, medical applications, etc.). In AR, the user of the HMD 102 sees virtual objects overlaid on a real-world environment, while in MR, the user of the HMD 102 sees an interactive view combining real-world and computer-generated elements, and in VR, the user of the HMD 102 typically does not see a real-world environment but is fully immersed in a virtual environment, as perceived via the display panel and optics (e.g., lenses) of the HMD 102. It should be understood that in some VR systems, a passthrough image of the user's real-world environment can be displayed alongside virtual images to create an enhanced VR environment within the VR system. This VR environment is thus enhanced with real-world images (e.g., overlaid on the virtual world), and / or the user of the HMD 102 can switch between viewing a virtual environment and their real-world environment. The examples described herein primarily relate to the VR-based HMD 102; however, it should be understood that the HMD 102 is not limited to specific implementations in VR applications.

[0021] exist Figure 1 In this context, the display panels of the HMD 102 are not visible because they are located inside the HMD 102's housing. It should be understood that the HMD 102 may include a single display panel or multiple display panels, such as the left and right display panels in a pair of stereoscopic display panels. One or more display panels of the HMD 102 may be used to present a series of image frames (sometimes referred to herein as "images" or "frames") that can be viewed by a user wearing the HMD 102. It should be understood that the HMD 102 may include any number of display panels (e.g., more than two display panels, a pair of display panels, or a single display panel). Therefore, the term "display panel," as used herein in the singular, may refer to the display panel in a pair of display panels of a dual-panel HMD 102, or it may refer to a single display panel of an HMD 102 having any number of display panels (e.g., a single-panel HMD 102 or a multi-panel HMD 102).

[0022] The HMD 102 may further include an optical subsystem that uses one or more optical elements to guide light emitted by the display panel toward the user's eyes. The optical subsystem may include various types and combinations of different optical elements. Figure 1 Examples depict a pair of lenses 106(1), 106(2) (collectively referred to as 106) disposed within a pair of lens tubes 104. In some instances, the lenses 106 are fixed in the correct position within the lens tubes 104 and may include any suitable type of lens, such as Fresnel lenses, convex lenses, concave lenses, etc. The lens tubes 104 are positioned in front of the display panel of the HMD 102. In a dual-panel HMD 102, a stereo frame buffer can render pixels on both display panels of the HMD 102, and the resulting image can be viewed stereoscopically through the pair of lenses 106. In a single-panel HMD 102, the HMD 102 may include a single display panel, and each lens 106 is used for viewing a corresponding image displayed on at least a portion of the display panel by one of the user's eyes. Furthermore, when the user wears the HMD 102, the lens tubes 104 (and the lenses 106 disposed therein) are positioned between the user's eye and the display panel. Although the optical elements of HMD 102 (e.g., lens 106) may be designed to correct one or more optical errors (e.g., barrel distortion, pincushion distortion, longitudinal chromatic aberration, lateral chromatic aberration, spherical aberration, coma, field curvature, etc.), lens 106 may still be designed for use by users without visual impairment (i.e., users with “good” vision).

[0023] Therefore, a system including HMD 102 may include one or more electrically controllable lenses 100 configured to direct light emitted by the display panel of HMD 102 toward the eyes of a user wearing HMD 102. Figure 1 A pair of electrically controllable lenses 100(1) and 100(2) are illustrated, but it should be understood that in some instances the system may include a single electrically controllable lens 100. Figure 1 The depicted electrically controllable lens 100 can be used in conjunction with the HMD 102 for purposes such as diopter adjustment. That is, the system's processor can provide control signals to the electrically controllable lens 100 to adjust its optical power. For example, the optical power of the electrically controllable lens 100 can be increased to decrease its focal length, or the optical power of the electrically controllable lens 100 can be decreased to increase its focal length. In some instances, using the electrically controllable lens 100 for diopter adjustment allows for the simulation of a user's prescription glasses. This, in turn, allows visually impaired users to view images displayed on the HMD 102's display panel clearly and sharply without having to wear their prescription glasses (e.g., eyeglasses, contact lenses, etc.) under the HMD 102.

[0024] In some instances, the electrically controllable lens 100 is an accessory to the HMD 102. In these instances, the electrically controllable lens 100 may be referred to as an "electrically controllable lens accessory" or an "electrically controllable lens adapter." In some instances, users can visit the website of the HMD 102 supplier to purchase the HMD 102 online. During this purchase experience (e.g., at checkout), the option to purchase the electrically controllable lens 100 as an accessory to the HMD 102 may be presented to the user. Users with visual impairments (e.g., myopia, hyperopia, astigmatism, etc.) may choose to purchase the electrically controllable lens 100 to avoid having to wear their prescription glasses under the HMD 102 to view images displayed via the HMD 102 clearly and sharply. In this example, the user may receive a delivery package that specifically includes the HMD 102 and the electrically controllable lens 100. As an accessory to the HMD 102, the electrically controllable lens 100 may be configured to be coupled by the user of the HMD 102 to a pair of lens tubes 104. The electrically controllable lens 100 can be coupled to the lens tube 104 in a variety of ways. Typically, the size and shape of the electrically controllable lens 100 can be configured to fit onto, around, and / or over the lens tube 104. For example, the electrically controllable lens 100 may include a generally flat, transparent substrate with a generally circular shape similar to that of lens 106 and / or lens tube 104. The electrically controllable lens 100 may further include an edge of material (e.g., rubber, plastic, silicone, etc.) surrounding the transparent substrate at its periphery. This edge of material may have a lip configured to fit around the front surface of the lens tube 104. In some instances, the electrically controllable lens 100 may be secured to the lens tube 104 by means of a press-fit or snap-fit ​​between the electrically controllable lens 100 and the lens tube 104. In this way, the electrically controllable lens 100 is prevented from detaching from the lens tube 104 after coupling (e.g., a user may have to apply a threshold amount of pulling force to the electrically controllable lens 100 to remove it from the lens tube 104). In some instances, magnetic elements may be used to couple the electrically controllable lens 100 to the lens tube 104. For example, each electrically controllable lens 100 may have a magnet embedded in the outer edge of a material surrounding a transparent substrate of the lens 100, and corresponding magnets of opposite polarities may be disposed in or on the corresponding lens tube 104, near the front of the lens tube 104, wherein the electrically controllable lens 100 engages the lens tube 104. In this example, the attraction between a pair of magnets prevents the electrically controllable lens 100 from detaching from the lens tube 104. As another example, adhesives may be used to couple the electrically controllable lens 100 to the lens tube 104, such as reusable tape disposed on the surface of the electrically controllable lens 100 and on the surface of the lens tube 104 that engages the surface of the electrically controllable lens 100. In some instances, one or more fasteners (e.g., hooks, rings, latches, pins, tabs, screws, etc.) may be used to couple the electrically controllable lens 100 to the lens tube 104.These are merely exemplary methods of coupling the electrically controllable lens 100 to the lens tube 104, and other coupling techniques may be utilized.

[0025] As an accessory to HMD 102, the electrically controllable lens 100 may be removably coupled to lens tube 104, but the term "coupled" as used herein is not limited thereto. That is, in some instances, the electrically controllable lens 100 may be permanently coupled to lens tube 104. This may be the case where the electrically controllable lens 100 is built into HMD 102 during manufacturing. In this example, the electrically controllable lens 100 can be considered as part of the optical subsystem of HMD 102. That is, as an accessory, once the electrically controllable lens 100 is coupled to lens tube 104, the electrically controllable lens 100 becomes part of the optical subsystem of HMD 102. In any case, when a user wears HMD 102, the electrically controllable lens 100 is configured to be positioned between lens 106 (which is located within lens tube 104) and the user's eye. Generally, as used herein, the term "coupled" may refer to indirect or direct coupling between elements. As used herein, the term "coupling" may also refer to removable or permanent coupling between components, as mentioned above. A component is removably coupled if a user or another entity can decouple it. A component is permanently coupled if a user or another entity cannot decouple it without damaging or significantly harming it, or without excessive effort to disassemble it using tools or machinery. As used herein, the term "coupling" may be interpreted as connection, attachment, bonding, joining, joining, connecting, linking, fastening, or binding. Unless otherwise stated herein, the term "coupling" will be interpreted as a mechanically coupled component, not an electrical or communicatively coupled component. However, it should be understood that mechanical coupling of components can result in electrical and / or communicative coupling between multiple components of a system.

[0026] Because lens 100 is electrically controllable for diopter adjustment, lens 100 is configured to receive control signals from a processor to adjust the optical power of the electrically controllable lens 100. Therefore, each electrically controllable lens 100 may include components that electrically and / or communicatively couple the electrically controllable lens 100 to a processor that provides control signals for diopter adjustment. Figure 1In some instances, the electrically controllable lens 100 includes wireless receivers 108(1), 108(2) (collectively referred to as 108) configured to receive control signals (and / or other data) using any suitable wireless protocol (e.g., Bluetooth, Near Field Communication (NFC), etc.). In some instances, a user of the HMD 102 may perform one or more steps to wirelessly pair the electrically controllable lens 100 with a processor (or a device including a processor) that provides control signals for diopter adjustment. In some instances, a transceiver (e.g., a transceiver for the HMD 102 or a transceiver for another device) may be used to wirelessly transmit control signals (and / or other data) from the processor to the electrically controllable lens 100. In some instances, the electrically controllable lens 100 may include physical connectors, ports, pins, wires, etc., to facilitate a wired connection to the HMD 102 (e.g., using a ribbon cable, flexible printed circuit (FPC), etc.) to receive control signals (and / or other data) via the HMD 102. For example, the electrically controllable lens 100 may include a Universal Serial Bus (USB) connector (or port) configured to engage with a corresponding USB connector (or port) on the lens tube 104 when the user couples the electrically controllable lens 100 to the lens tube 104. USB is merely an example, and other wired protocols may be used. In these instances, the electrically controllable lens 100 may use any suitable wired protocol to receive control signals (and / or other data). In some instances, the electrically controllable lens 100 may receive power from the power source of the HMD 102 (e.g., one or more batteries), in which case the power may be received via a wireless receiver 108 and / or via physical connectors, ports, pins, wires, etc., of the electrically controllable lens 100. In some instances, the electrically controllable lens 100 includes an onboard power source, such as one or more batteries, which may be rechargeable whenever the electrically controllable lens 100 is coupled to the HMD 102 and when the electrically controllable lens 100 receives power from the power source of the HMD 102. Additionally or alternatively, one or more batteries of the electrically controllable lens 100 may be recharged whenever the electrically controllable lens 100 is plugged into a power outlet (e.g., via a power cord) and / or placed on or near a wireless (e.g., inductive) charger / charging station.

[0027] Figure 2A front view of a pair of example electrically controllable lenses 100 according to embodiments disclosed herein is illustrated, the optical power of which can be adjusted via providing control signals 200(1), 200(2) (collectively referred to as 200) to the electrically controllable lenses 100. In some instances, the electrically controllable lenses 100 comprise liquid crystal (LC) material (e.g., LC molecules). For example, each electrically controllable lens 100 may comprise two generally flat transparent (e.g., glass) substrates surrounded by the edges of the material, wherein the LC material is disposed between the transparent substrates and contained therein (e.g., sealed) (e.g., sealed within the transparent substrates by the edges of the material). Electrodes (e.g., indium tin oxide (ITO)) may be plated onto the transparent substrates such that the electrodes are in contact with the LC material between the transparent substrates, and the LC material may also be divided into individual units (or pixels) to provide controllability at any suitable resolution (e.g., at the LC unit or pixel level). When control signal 200 is provided to the electrically controllable lens 100, a corresponding driving signal can be applied to the LC unit electrodes (e.g., via an integrated circuit driver IC) to apply an electric field across the LC unit, thereby changing the orientation of the LC material (e.g., LC molecules) in the LC unit. Controlling the orientation of the LC material (e.g., LC molecules) of the electrically controllable lens 100 allows control over the phase (e.g., optical phase) of the light passing through the electrically controllable lens 100, thus “shaping” the light beam as it leaves the electrically controllable lens 100. In other words, the refractive index can be controlled by controlling the orientation of the LC material (e.g., LC molecules). Because each electrically controllable lens 100 may include multiple units of LC material, the electrically controllable lens 100 can function similarly to a gradient index (GRIN) lens, except that the refractive index can be dynamically controlled or tuned (radially) in the XY plane via control signal 200, whereas a conventional GRIN lens cannot control the refractive index to change instantaneously. In other words, control signal 200 can create any desired refractive index distribution in the direction perpendicular to the optical axis; the optical axis corresponds to... Figure 1 The Z-axis in the diagram.

[0028] Therefore, the control signal 200 can cause the electrically controllable lens 100 to have a first optical power at its center 202 and a second optical power at its periphery 204, the second optical power being different from the first optical power. Figure 2In one example, the first electrically controllable lens 100(1) is tuned to have a first optical power of 1.5 diopter (D) at the center 202(1) of the electrically controllable lens 100(1) and a second optical power of 1.6 D at the periphery 204(1) of the electrically controllable lens 100(1). As mentioned, the second electrically controllable lens 100(2) can be configured to be controlled independently of the first electrically controllable lens 100(1). For example, as Figure 2 As shown, the second electrically controllable lens 100(2) can be tuned to have a first optical power of 1.4 D at the center 202(2) of the electrically controllable lens 100(2) and a second optical power of 1.55 D at the periphery 204(2) of the electrically controllable lens 100(2). These are merely exemplary diopter values, and it should be understood that the electrically controllable lens 100 can be tuned to have any suitable diopter value. By tuning the electrically controllable lens 100 to have a gradient refractive index in the XY plane, the control signal 200 can thereby cause the electrically controllable lens 100 to adjust the phase of the light passing through its respective centers 202(1), 202(2) by a first amount, and adjust the phase of the light passing through its respective peripheries 204(1), 204(2) by a second amount different from the first amount. In some instances, the optical power can be varied from the center 202 of the lens 100 to the periphery 204 of the lens 100 according to a quadratic function (e.g., a quadratic refractive index variation from the center 202 to the periphery 204). It should be understood that the control signal 200 can apply a corresponding drive signal to the LC cell electrode via any suitable electrical parameter, such as voltage or current, which in turn causes an electric field to be applied across the LC cell, thereby changing the orientation of the LC material (e.g., LC molecules) and adjusting the optical power of the electrically controllable lens 100 according to the radial (XY) positioning on the lens 100.

[0029] As mentioned above, in some instances, the user wearing the HMD 102 can provide user input to adjust the optical power of the electrically controllable lens 100. Figure 2 The examples illustrate how to implement user-controlled diopter adjustment using an actuator in the form of a rotatable knob 206 (or dial). Figure 2The diagram also illustrates how each electrically controllable lens 100 can be controlled independently of the other electrically controllable lenses 100. For example, a user wearing the HMD 102 can rotate the first knob 206(1) clockwise or counterclockwise to increase or decrease the optical power of the first electrically controllable lens 100(1) independently of the second electrically controllable lens 100(2), and / or a user can rotate the second knob 206(2) clockwise or counterclockwise to increase or decrease the optical power of the second electrically controllable lens 100(2) independently of the first electrically controllable lens 100(1). In this way, the first electrically controllable lens 100(1) can be tuned to have a first optical power, and the second electrically controllable lens 100(2) can be tuned to have a second optical power different from the first optical power.

[0030] In some instances, rotatable knobs 206(1), 206(2) may be provided on the HMD 102 (e.g., on the outer surface of the housing of the HMD 102) to provide dedicated controls operable by a user's fingers for adjusting the optical power of the electrically controllable lens 100. However, as mentioned above, the type of user input and the type of device receiving user input for diopter adjustment may vary depending on the specific implementation. For example, the HMD 102 may include "up" and "down" buttons, sliders, touch sensors (e.g., touchpads), etc., and the user may use any of these types of controls or different types of controls to adjust the optical power of the electrically controllable lens 100. As another example, the user may provide user input via a handheld controller to adjust the optical power of the electrically controllable lens 100, such as by interacting with user interface elements presented on the display panel of the HMD 102 using the handheld controller. In this example, the interactive user interface elements for diopter adjustment may initially appear blurry to a visually impaired user until the user adjusts the optical power to enable clear and sharp viewing of the displayed image. Therefore, the interactive user interface elements for diopter adjustment can be presented in a relatively large font (or size), so that the user interface elements can still be immediately recognized by the user, even if they appear blurry before diopter adjustment is performed. In some instances, the user can issue voice commands (e.g., “increase the optical power of the left lens” or “decrease the optical power of both lenses”) to adjust the optical power of the electrically controllable lens 100, and this voice command can be detected by the microphone of the HMD 102 to achieve diopter adjustment. In some instances, the user wearing the HMD 102 can provide user input to adjust the optical power of a specific area of ​​the electrically controllable lens 100 in the XY plane. For example, a user can provide user input to adjust the optical power at any suitable granularity level at the center 202 of lens 100, at the periphery 204 of lens 100, in the intermediate region between the center 202 and the periphery 204 of lens 100, at the upper half of lens 100, at the lower half of lens 100, at the left half of lens 100, at the right half of lens 100, and / or at any other region of lens 100. Adjustment of the optical power of sub-regions of the electrically controllable lens 100 can be achieved via an interactive user interface element and by providing user input via a handheld controller to interact with the interactive user interface element, and / or by pressing a dedicated control (e.g., knob 206) to switch between regions of lens 100 and subsequently adjusting the optical power by rotating knob 206.In some instances, user interface elements allow a user to input, search, and / or select an eye prescription, and the electrically controllable lens 100 can be automatically controlled (e.g., via control signal 200) to set the optical power at an appropriate level for the vision correction provided to the user's eye prescription. Regardless of the type of user input or the type of device receiving the user input, the system's processor can be configured to provide control signal 200 to the electrically controllable lens 100 to adjust the optical power of the electrically controllable lens 100 at least in part based on the user input. The diopter adjustment is intuitive for the user wearing the HMD 102, as the user can increase or decrease the optical power of the electrically controllable lens 100 as needed until the displayed image appears clear and sharp to the user. This diopter adjustment enables the redirection of light passing through the lens 100 at any desired angle toward the eye of the user wearing the HMD 102.

[0031] Figure 3 A side view of an electrically controllable lens 100 according to an embodiment disclosed herein is illustrated, along with techniques for increasing or decreasing the optical power of the electrically controllable lens 100. Figure 3 At the top, an example is shown where a user wearing the HMD 102 has provided user input to increase the optical power of the electrically controllable lens 100, such as by rotating the knob 206 associated with the electrically controllable lens 100 clockwise. This causes the system's processor to provide a control signal 200 to the electrically controllable lens 100, which redirects light 300 leaving the electrically controllable lens 100. Figure 3 The light 300 in the diagram represents light emitted by the display panel of the HMD 102. Therefore, before reaching the eye 302 of the user wearing the HMD 102, the light 300 passes through the electrically controllable lens 100, as the electrically controllable lens 100 is coupled to the lens tube 104 of the HMD 102. In this example scenario, the control signal 200 can control the electrically controllable lens 100 so that the light 300 converges after leaving the electrically controllable lens 100, which can be used to correct farsightedness (hyperopia). Therefore, when the light 300 approaches the eye 302 of the user wearing the HMD 102, the light 300 can be refocused (e.g., the focus of the light 300 can be adjusted via the control signal 200) to change the angle at which the light 300 leaves the electrically controllable lens 100. Figure 3In the example at the top, four exemplary rays (or beams) 300(1), 300(2), 300(3), and 300(4) are shown to illustrate how the refractive index of the electrically controllable lens 100 can be tuned in a manner that the refractive index changes (radially) across the lens 100 in the XY plane. That is, rays 300(2) and 300(3) closer to the center 202 of the lens 100 can leave the lens 100 at a first angle (acute angle), while rays 300(1) and 300(4) farther from the center 202 of the lens 100 can leave the lens 100 at a second angle (acute angle) smaller than the first angle (acute angle). That is, rays 300(1) and 300(4) farther from the center 202 of the lens 100 can converge at a steeper angle than rays 300(2) and 300(3) closer to the center 202 of the lens 100. Therefore, in some instances, the generally flat electrically controllable lens 100 can still be controlled (e.g., via control signal 200) to be used as a curved (convex) lens.

[0032] exist Figure 3 At the bottom, another scenario is illustrated where a user wearing HMD 102 has provided user input to reduce the optical power of the electrically controllable lens 100, such as by rotating the knob 206 associated with the electrically controllable lens 100 counterclockwise. This causes the system's processor to provide a control signal 200 to the electrically controllable lens 100, which redirects light 300 leaving the electrically controllable lens 100. In this example scenario, the control signal 200 can control the electrically controllable lens 100 so that light 300 diverges after leaving the electrically controllable lens 100, which can be used to correct myopia (nearsightedness). Therefore, when light 300 approaches the eye 302 of the user wearing HMD 102, light 300 can be refocused (e.g., the focus of light 300 can be adjusted via control signal 200) to change the angle at which light 300 leaves the electrically controllable lens 100. Figure 3In the example at the bottom, four exemplary rays (or beams) 300(5), 300(6), 300(7), and 300(8) are shown to illustrate how the refractive index of the electrically controllable lens 100 can be changed (radially) across the lens 100 in the XY plane. That is, rays 300(6) and 300(7) closer to the center 202 of the lens 100 can leave the electrically controllable lens 100 at a first angle (acute angle), while rays 300(5) and 300(8) farther from the center 202 of the lens 100 can leave the electrically controllable lens 100 at a second angle (acute angle) smaller than the first angle (acute angle). That is, rays 300(5) and 300(8) farther from the center 202 of the lens 100 can diverge at a steeper angle than rays 300(6) and 300(7) closer to the center 202 of the lens 100. Therefore, in some instances, the generally flat electrically controllable lens 100 can still be controlled (e.g., via control signal 200) to be used as a curved (concave) lens.

[0033] In some instances, when purchasing the HMD 102, the user can provide information about their visual impairment and / or their eye prescription, and the electrically controllable lens 100 can be pre-configured (e.g., by the HMD 102 supplier) with settings set for optical power that are at least partially based on the information provided by the user when purchasing the HMD 102. For example, if a user is purchasing the HMD 102 online, they may be asked questions such as “Are you nearsighted?”, “Are you farsighted?”, and / or “Do you have astigmatism?”, and the user can provide answers to those questions, allowing the HMD 102 supplier to pre-configure the electrically controllable lens 100 before shipping it to the user. In some instances, the user can provide their eye prescription to the HMD 102 supplier, which allows the supplier to pre-configure the electrically controllable lens 100 with even more precise optical power settings. Pre-configuring the electrically tunable lens 100 enables it to provide the correct optical power initially close to that of the user, and the user can subsequently fine-tune the diopter adjustment to improve the sharpness and clarity of the displayed image. Thus, if, for example, the user's vision is severely impaired, the user does not have to experience a severely blurred image.

[0034] In some instances, the package containing the electrically controllable lens 100 may include an information booklet that guides the user in adjusting the optical power of the electrically controllable lens 100 to correct a specific visual impairment. For example, the booklet may include a list of recommended optical power settings for different ophthalmic prescriptions. In some instances, the user may download an application containing similar refractive adjustment information to an electronic device (e.g., a mobile phone, tablet, etc.), and / or the downloaded application may guide the user through a series of steps to adjust the optical power of the electrically controllable lens 100 in a manner suitable for their specific eye prescription.

[0035] In some instances, the eye-tracking components of the HMD 102 (e.g., light sources, sensors, etc.) can be used to automatically determine the eye prescription of a user wearing the HMD 102 and adjust the optical power of the electrically controllable lens 100 based on the determined eye prescription without user intervention. For example, the eye-tracking light source and eye-tracking sensor can perform ray-tracking techniques, where light (e.g., infrared IR light) is reflected from the user's eyes to determine (e.g., estimate) their eye prescription, and the determined eye prescription can be provided as input to a function, model, etc., to determine a control signal 200 for adjusting the electrically controllable lens 100 to provide vision correction for the user wearing the HMD 102.

[0036] In some instances, virtual objects can be presented on the display panel of the HMD 102 at different sizes and / or "distances" within a virtual scene, allowing the user's eye to focus on a specific virtual object within the scene. In some instances, as part of a computer-driven diopter adjustment process, the processor can provide control signals 102 to the electrically controllable lens 100 to switch between different optical power settings. In some instances, the user wearing the HMD 102 can provide feedback during this process to indicate whether the virtual objects appear clear and sharp to the user and / or which virtual objects appear clear and sharp. This allows the processor to adjust the optical power of the electrically controllable lens 100 based on user feedback.

[0037] The process described herein is illustrated as a set of boxes in a logic flowchart, representing a sequence of operations that can be implemented in hardware, software, firmware, or a combination thereof (i.e., logic). In the context of software, a box represents a computer-executable instruction that performs the enumerated operations when executed by one or more processors. Typically, computer-executable instructions include routines, programs, objects, components, data structures, etc., that perform a specific function or implement a specific abstract data type. The order in which the operations are described is not intended to be construed as limiting, and any number of described boxes can be combined in any order and / or in parallel to implement the process.

[0038] Figure 4 This is a flowchart of an example process 400 for providing vision correction to a user by controlling an electrically controllable lens 100 of an HMD 102 based on user input provided by a user wearing an HMD 102, according to an embodiment disclosed herein. For the purposes of discussion, process 400 is described with reference to the preceding drawings. Furthermore, process 400 can be implemented by a system including an HMD 102 and an electrically controllable lens 100, and the HMD 102 may have a display panel, a pair of lens tubes 104, and the electrically controllable lens 100 may be coupled to the lens tubes 104; or removably coupled to the HMD 102 as an accessory, or permanently coupled as part of the optical subsystem of the HMD 102.

[0039] At 402, the system's processor can determine whether it has received user input data indicating that a user wearing HMD 102 has provided user input to adjust the optical power of the electrically controllable lens 100 of HMD 102. As described above, the type of user input and the type of device receiving user input for diopter adjustment can vary depending on the specific implementation. For example, at block 402, the processor can monitor user input data indicating that the user has provided user input via dedicated controls of HMD 102, such as actuators (e.g., a rotary knob 206 (or dial)), "up" or "down" buttons, sliders, touch sensors (e.g., a touchpad), etc. As another example, at block 402, the processor may monitor user input data indicating that the user has interacted with user interface elements presented on the display panel of HMD 102 via a handheld controller, such as by using the handheld controller (e.g., joystick, touchpad, button A, button B, button X and / or button Y, trigger, buffer, scroll wheel, etc.) to adjust the optical power of the electrically controllable lens 100 for diopter adjustment. In some instances, at block 402, the processor may detect user input data indicating that the microphone of HMD 102 has detected a voice command issued by the user for adjusting the optical power of the electrically controllable lens 100. If no such user input data is received, process 400 may follow the "No" path from block 402 to continue monitoring for the reception of user input data for diopter adjustment. Once the processor receives such user input data, process 400 may follow the "Yes" path from block 402 to block 404.

[0040] At 404, the processor may determine whether user input data is associated with a first (e.g., left) electrically controllable lens 100(1) or a second (e.g., right) electrically controllable lens 100(2). If dedicated controls are provided (e.g., on HMD 102) for independently adjusting the optical power of each electrically controllable lens 100, the determination at box 404 may include determining which dedicated controls the user has operated. For example, if a first actuator (e.g., first knob 206(1)) is associated with the first (e.g., left) electrically controllable lens 100(1), the user input data received at box 402 may indicate that the user provided user input via the first actuator (e.g., first knob 206(1)), and therefore the determination at box 404 is that the first (e.g., left) electrically controllable lens 100(1) will be controlled for diopter adjustment. If the second actuator (e.g., the second knob 206(2)) is associated with the second (e.g., the right) electrically controllable lens 100(2), then the user input data received at box 402 indicates that the user provides user input via the second actuator (e.g., the second knob 206(2)), and therefore the determination at box 404 is that the second (e.g., the right) electrically controllable lens 100(2) will be controlled for diopter adjustment. In another example, the user input data received at box 402 indicates that the user provides user input via a handheld controller to interact with user interface elements presented on the display panel of the HMD 102, and if the user interface elements are associated with controlling the first (e.g., the left) electrically controllable lens 100(1), then the processor determines at box 404 that the first (e.g., the left) electrically controllable lens 100(1) will be controlled for diopter adjustment. On the other hand, if the user interface element is associated with controlling a second (e.g., right) electrically controllable lens 100 (2), the processor determines at box 404 that the second (e.g., right) electrically controllable lens 100 (2) will be controlled for diopter adjustment. In another instance, user input data received at box 402 may indicate that the user has issued a voice command specifying which electrically controllable lens 100 they wish to control for diopter adjustment. It should be understood that in some instances, two electrically controllable lenses 100 can be controlled simultaneously, in which case process 400 may follow both the "left" path and the "right" path from box 404. However, to illustrate how the electrically controllable lenses 100 can be controlled independently of each other, process 400 is described as following either the "left" or "right" path from box 404. Thus, if the determination at box 404 is that user input data is associated with the first (e.g., left) electrically controllable lens 100 (1), process 400 may follow the "left" path from box 404 to box 406.

[0041] At 406, the processor can determine whether to increase or decrease the optical power of the first (e.g., left) electrically controllable lens 100(1). For example, if the first knob 206(1) is associated with the first (e.g., left) electrically controllable lens 100(1), the user input data received at box 402 can indicate that the user rotates the first knob 206(1) in a first direction (e.g., counterclockwise), and therefore the determination at box 406 can be to decrease the optical power of the first (e.g., left) electrically controllable lens 100(1). On the other hand, if the user input data received at box 402 indicates that the user rotates the first knob 206(1) in a second direction (e.g., clockwise), the determination at box 406 can be to increase the optical power of the first (e.g., left) electrically controllable lens 100(1). In another instance, the user input data received at box 402 may indicate that the user provides user input via a handheld controller to interact with a user interface element associated with the first (e.g., left) electrically controllable lens 100(1) in some way (e.g., sliding a virtual slider to the left or right), which allows the processor to determine at box 406 whether to increase or decrease the optical power of the first (e.g., left) electrically controllable lens 100(1). In another instance, the user input data received at box 402 may indicate that the user issues a voice command indicating that the user wants to increase or decrease the optical power of the first (e.g., left) electrically controllable lens 100(1). If the determination at box 406 is to decrease the optical power of the first (e.g., left) electrically controllable lens 100(1), then process 400 may follow a “decrease” path from box 406 to box 408.

[0042] At 408, the processor may provide a control signal 200(1) to the first (e.g., left) electrically controllable lens 100(1) to reduce the optical power of the first (e.g., left) electrically controllable lens 100(1) based at least in part on user input data received at block 402. In some instances, the optical power may be adjusted incrementally such that, in response to receiving user input data, the optical power is reduced by a predetermined amount (e.g., 0.01 D, 0.1 D, 0.5 D, 1 D, etc.) at block 408. In some instances, the user input data specifies the amount by which the optical power will be adjusted. For example, the amount of rotation of knob 206 may correspond to a specific amount of adjustment to the optical power of the electrically controllable lens 100, where a larger amount of rotation of knob 206 corresponds to a larger amount of optical power adjustment, and a smaller amount of rotation of knob 206 corresponds to a smaller amount of optical power adjustment. These concepts may be applied to other types of user input, such as the amount by which a user moves a virtual slider on a graphical user interface, the degree of a swipe gesture provided via a touch sensor, etc. In some instances, a control signal 200(1) provided at block 408 to the first (e.g., left) electrically controllable lens 100(1) causes a corresponding drive signal (e.g., via a driver IC) to be applied to the LC unit electrodes of the first (e.g., left) electrically controllable lens 100(1), thereby applying an electric field across the LC material units in the first (e.g., left) electrically controllable lens 100(1) and altering the orientation of the LC material (e.g., LC molecules). As described above, by controlling the orientation of the LC material (e.g., LC molecules) via the control signal 200(1), the phase of the light 300 passing through the first (e.g., left) electrically controllable lens 100(1) at a specific XY position on the lens 100(1) can be adjusted. In other words, the refractive index of the lens 100(1) can be controlled by controlling the orientation of the LC material (e.g., LC molecules) of the lens 100(1) via the control signal 200(1). In some instances, the control signal 200(1) provided at box 408 can be perpendicular to the optical axis (e.g., Figure 1A refractive index distribution is created along the Z-axis. For example, a control signal 200(1) provided at box 408 can cause a first (e.g., left) electrically controllable lens 100(1) to have a first optical power at its center 202(1) and a second optical power at its periphery 204(1), the second optical power being different from the first optical power. In other words, a control signal 200(1) provided at box 408 can cause the first (e.g., left) electrically controllable lens 100(1) to adjust the phase of light 300 passing through its center 202(1) by a first amount and adjust the phase of light 300 passing through its periphery 204(1) by a second amount different from the first amount. In some instances, a control signal 200(1) provided at box 408 can create a refractive index distribution modeled on a quadratic function (e.g., a quadratic refractive index change from the center 202(1) to the periphery 204(1). In some instances, the control signal 200(1) provided at block 408 can be applied via any suitable electrical parameter, such as voltage or current, to the LC cell electrode of the first (e.g., left) electrically controllable lens 100(1), which in turn results in the application of an electric field across the LC cell, thereby altering the orientation of the LC material (e.g., LC molecules) according to the radial (XY) positioning on the lens 100(1) and tuning the optical power of the first (e.g., left) electrically controllable lens 100(1).

[0043] At 410, after the control signal 200(1) is provided at block 408, the processor can determine whether to adjust for astigmatism. For example, user input data received at block 402, or additional user input data received after receiving user input data at block 402, may indicate that the user has provided user input to adjust the axis (for astigmatism correction, for example, by selecting a number in the range of 0 to 180). If at block 410, the processor determines to avoid adjusting for astigmatism (e.g., if the user input data indicates that the user has not provided user input for adjusting the axis for astigmatism correction), then process 400 may follow the "No" path from block 410 and may return to block 402 to continue monitoring the reception of additional user input data for diopter adjustment. If at block 410, the processor determines to adjust for astigmatism, then process 400 may follow the "Yes" path from block 410 to block 412.

[0044] At 412, the processor may provide a control signal 200(1) to the first (e.g., left) electrically controllable lens 100(1) to adjust the axis (e.g., adjust to a number in the range of 0 to 180) based at least in part on received user input data or additional user input data for astigmatism adjustment. In some instances, the control signal 200(1) provided to the first (e.g., left) electrically controllable lens 100(1) at block 412 causes a corresponding drive signal (e.g., via a driver IC) to be applied to the LC unit electrodes of the first (e.g., left) electrically controllable lens 100(1), so that an electric field is applied across the units of the LC material in the first (e.g., left) electrically controllable lens 100(1), thereby changing the orientation of the LC material (e.g., LC molecules) so that the optical power is adjusted to be aligned with the axis for astigmatism correction. After the control signal 200(1) is provided at block 412, process 400 may return to block 402 to continue monitoring the reception of additional user input data for diopter adjustment.

[0045] Returning to box 406, if it is determined that the optical power of the first (e.g., left) electrically controllable lens 100(1) needs to be increased, process 400 can follow an “increase” path from box 406 to box 414, wherein the processor can provide a control signal 200(1) to the first (e.g., left) electrically controllable lens 100(1) to increase the optical power of the first (e.g., left) electrically controllable lens 100(1) based at least in part on the user input data received at box 402. As described above, the optical power can be adjusted incrementally such that, in response to receiving user input data, the optical power is increased by a predetermined amount (e.g., by 0.01 D, 0.1 D, 0.5 D, 1 D, etc.) at box 414. In some instances, the optical power of the first (e.g., left) electrically controllable lens 100(1) (e.g., based on the amount of rotation of knob 206, the amount of movement of a virtual slider by the user on a graphical user interface, the degree of swipe gesture provided via a touch sensor, etc.) increases by an amount specified in the user input data. In some instances, a control signal 200(1) provided at block 414 to the first (e.g., left) electrically controllable lens 100(1) causes a corresponding drive signal (e.g., via a driver IC) to be applied to the LC unit electrodes of the first (e.g., left) electrically controllable lens 100(1), causing an electric field to be applied across the units of the LC material in the first (e.g., left) electrically controllable lens 100(1), thereby altering the orientation of the LC material (e.g., LC molecules). In some instances, the control signal 200(1) provided at block 414 can be perpendicular to the optical axis (e.g., Figure 1A refractive index distribution is created along the Z-axis. For example, a control signal 200(1) provided at box 414 can cause a first (e.g., left) electrically controllable lens 100(1) to have a first optical power at its center 202(1) and a second optical power at its periphery 204(1), the second optical power being different from the first optical power. In other words, a control signal 200(1) provided at box 414 can cause the first (e.g., left) electrically controllable lens 100(1) to adjust the phase of light 300 passing through its center 202(1) by a first amount and adjust the phase of light 300 passing through its periphery 204(1) by a second amount different from the first amount. In some instances, a control signal 200(1) provided at box 414 can create a refractive index distribution modeled on a quadratic function (e.g., a quadratic refractive index change from the center 202(1) to the periphery 204(1). In some instances, the control signal 200(1) provided at block 414 can, via any suitable electrical parameter, such as voltage or current, cause a corresponding drive signal to be applied to the LC cell electrode of the first (e.g., left) electrically controllable lens 100(1), which in turn results in an electric field being applied across the LC cell, thereby altering the orientation of the LC material (e.g., LC molecules) according to the radial (XY) positioning on the lens 100(1) and tuning the optical power of the first (e.g., left) electrically controllable lens 100(1). After the control signal 200(1) is provided at block 414, blocks 410 and 412 of process 400 can be performed as described above.

[0046] Returning to box 404, if it is determined that the user input data received at box 402 is associated with the second (e.g., right) electrically controllable lens 100(2), then process 400 can follow a “right” path from box 404 to box 416, where the processor can determine whether to increase or decrease the optical power of the second (e.g., right) electrically controllable lens 100(2). For example, if the second knob 206(2) is associated with the second (e.g., right) electrically controllable lens 100(2), then the user input data received at box 402 could indicate that the user rotates the second knob 206(2) in a first direction (e.g., counterclockwise), and therefore the determination at box 416 could be to decrease the optical power of the second (e.g., right) electrically controllable lens 100(2). On the other hand, if the user input data received at box 402 indicates that the user rotates the second knob 206(2) in a second direction (e.g., clockwise), the determination at box 416 could be to increase the optical power of the second (e.g., right) electrically controllable lens 100(2). In another example, the user input data received at box 402 could indicate that the user provides user input via a handheld controller to interact with a user interface element associated with the second (e.g., right) electrically controllable lens 100(2) in some way (e.g., sliding a virtual slider to the left or to the right), which allows the processor to determine at box 416 whether to increase or decrease the optical power of the second (e.g., right) electrically controllable lens 100(2). In another example, the user input data received at box 402 could indicate that the user issues a voice command indicating that the user wants to increase or decrease the optical power of the second (e.g., right) electrically controllable lens 100(2). If the determination at box 416 is to reduce the optical power of the second (e.g., right) electrically controllable lens 100(2), then process 400 can follow a “reduction” path from box 416 to box 418.

[0047] At 418, the processor may provide a control signal 200(2) to the second (e.g., right) electrically controllable lens 100(2) to reduce the optical power of the second (e.g., right) electrically controllable lens 100(2) based at least in part on the user input data received at block 402. As described above, the optical power may be adjusted incrementally such that, in response to receiving user input data, the optical power is reduced by a predetermined amount (e.g., 0.01 D, 0.1 D, 0.5 D, 1 D, etc.) at block 418. In some instances, the optical power of the second (e.g., right) electrically controllable lens 100(2) is reduced by an amount specified in the user input data (e.g., based on the amount of rotation of knob 206, the amount of movement of a virtual slider by the user on the graphical user interface, the degree of swipe gesture provided via a touch sensor, etc.). In some instances, a control signal 200(2) provided at block 418 to the second (e.g., right) electrically controllable lens 100(2) causes a corresponding drive signal (e.g., via a driver IC) to be applied to the LC unit electrodes of the second (e.g., right) electrically controllable lens 100(2), such that an electric field is applied across the LC material units in the second (e.g., right) electrically controllable lens 100(2), thereby altering the orientation of the LC material (e.g., LC molecules). In some instances, the control signal 200(2) provided at block 418 can be perpendicular to the optical axis (e.g., Figure 1A refractive index distribution is created along the Z-axis. For example, the control signal 200(2) provided at box 418 can cause the second (e.g., right) electrically controllable lens 100(2) to have a first optical power at its center 202(2) and a second optical power at its periphery 204(2), which is different from the first optical power. In other words, the control signal 200(2) provided at box 418 can cause the second (e.g., right) electrically controllable lens 100(2) to adjust the phase of the light 300 passing through its center 202(2) by a first amount and adjust the phase of the light 300 passing through its periphery 204(2) by a second amount different from the first amount. In some instances, the control signal 200(2) provided at box 418 can create a refractive index distribution modeled on a quadratic function (e.g., a quadratic refractive index change from the center 202(2) to the periphery 204(2). In some instances, the control signal 200(2) provided at block 418 can cause a corresponding drive signal to be applied to the LC cell electrode of the second (e.g., right) electrically controllable lens 100(2) via any suitable electrical parameter (such as voltage or current). This, in turn, results in an electric field being applied across the LC cell, thereby altering the orientation of the LC material (e.g., LC molecules) according to the radial (XY) positioning on the lens 100(2) and tuning the optical power of the second (e.g., right) electrically controllable lens 100(2). After the control signal 200(2) is provided at block 418, blocks 410 and 412 of process 400 can be executed, as described above, only with respect to the second (e.g., right) electrically controllable lens 100(2).

[0048] Returning to box 416, if it is determined that the optical power of the second (e.g., right) electrically controllable lens 100(2) is to be increased, process 400 can follow an "increase" path from box 416 to box 420, wherein the processor can provide a control signal 200(2) to the second (e.g., right) electrically controllable lens 100(2) to increase the optical power of the second (e.g., right) electrically controllable lens 100(2) based at least in part on the user input data received at box 402. As described above, the optical power can be adjusted incrementally such that, in response to receiving user input data, the optical power is increased by a predetermined amount (e.g., decreased by 0.01D, 0.1D, 0.5D, 1D, etc.) at box 420. In some instances, the optical power of the second (e.g., right) electrically controllable lens 100(2) (e.g., based on the amount of rotation of knob 206, the amount of movement of a virtual slider by the user on a graphical user interface, the degree of swipe gesture provided via a touch sensor, etc.) increases by an amount specified in the user input data. In some instances, a control signal 200(2) provided at block 420 to the second (e.g., right) electrically controllable lens 100(2) causes a corresponding drive signal (e.g., via a driver IC) to be applied to the LC unit electrodes of the second (e.g., right) electrically controllable lens 100(2), causing an electric field to be applied across the LC material units in the second (e.g., right) electrically controllable lens 100(2), thereby altering the orientation of the LC material (e.g., LC molecules). In some instances, the control signal 200(2) provided at block 420 can be perpendicular to the optical axis (e.g., Figure 1A refractive index distribution is created along the Z-axis. For example, a control signal 200(2) provided at box 420 can cause a second (e.g., right) electrically controllable lens 100(2) to have a first optical power at its center 202(2) and a second optical power at its periphery 204(2), the second optical power being different from the first optical power. In other words, a control signal 200(2) provided at box 420 can cause the second (e.g., right) electrically controllable lens 100(2) to adjust the phase of light 300 passing through its center 202(2) by a first amount and adjust the phase of light 300 passing through its periphery 204(2) by a second amount different from the first amount. In some instances, a control signal 200(2) provided at box 420 can create a refractive index distribution modeled on a quadratic function (e.g., a quadratic refractive index change from the center 202(2) to the periphery 204(2). In some instances, the control signal 200(2) provided at box 420 can, via any suitable electrical parameter, such as voltage or current, cause a corresponding drive signal to be applied to the LC cell electrode of the second (e.g., right) electrically controllable lens 100(2), which in turn results in an electric field being applied across the LC cell, thereby altering the orientation of the LC material (e.g., LC molecules) according to the radial (XY) positioning on the lens 100(2) and tuning the optical power of the second (e.g., right) electrically controllable lens 100(2). After the control signal 200(2) is provided at box 420, blocks 410 and 412 of process 400 can be performed with respect to the second (e.g., right) electrically controllable lens 100(2), as described above. As indicated by the return arrow from box 412 to box 402, process 400 can iterate as the user continues to adjust the optical power of the electrically controllable lens 100 until the view of the displayed image is clear and sharp to the user.

[0049] Figure 5 This is a flowchart of an example process 500 for simulating a light field display in an HMD 102 using an electrically controllable lens 100, according to the embodiments disclosed herein. For the purposes of discussion, process 500 is described with reference to the preceding drawings. Furthermore, process 500 can be implemented by a system including an HMD 102 and an electrically controllable lens 100, and the HMD 102 may have a display panel, a pair of lens tubes 104, and the electrically controllable lens 100 may be coupled to the lens tubes 104; or may be removably coupled to the HMD 102 as an accessory, or permanently coupled as part of the optical subsystem of the HMD 102. It should also be understood that process 500 can be performed in conjunction with process 400.

[0050] At point 502, the system's processor can cause the display panel of the HMD 102 to display video content (e.g., a series of images) over a series of frames. For example, the processor can execute an application (e.g., a video game) to render associated video content (e.g., a series of images) on the display panel of the HMD 102. Furthermore, frames can be rendered at a target frame rate and / or the display panel can have a refresh rate (e.g., fixed or variable) at which images corresponding to the rendered frames are presented on the display panel of the HMD 102.

[0051] At 504, the processor can provide a series of control signals 200 to the electrically controllable lens 100 in synchronization with the refresh rate of the display panel of the HMD 102. The control signals 200 provided to the electrically controllable lens 100 at frame 504 can adjust the optical power of the electrically controllable lens 100. In this way, a first control signal 200 in the series of control signals 200 provided at frame 504 can adjust the optical power of the electrically controllable lens 100 to a first optical power, and a second control signal 200 in the subsequent series of control signals 200 can adjust the optical power of the electrically controllable lens 100 to a second optical power that may be different from the first optical power, and so on. Therefore, the control signals 200 can vary over time and can be provided in synchronization with the refresh rate of the display panel of the HMD 102. For a pair of electrically controllable lenses 100(1), 100(2), the series of control signals 200 provided at frame 504 may include subframes 506 and 508. At 506, for example, the processor may provide a first series of control signals 200(1) to the first (e.g., left) electrically controllable lens 100(1) in synchronization with the refresh rate of the display panel of HMD 102, and / or at 508, for example, the processor may provide a second series of control signals to the second (e.g., right) electrically controllable lens 100(2) in synchronization with the refresh rate of the display panel of HMD 102.

[0052] Therefore, according to process 500, an electrically controllable lens 100 can be used to simulate a light field display, which enables the user wearing the HMD 102 to receive a sense of depth in the displayed image. By changing the control signal provided to the electrically controllable lens 100 in sync with updates to the HMD's display panel, the viewer can perceive depth in the displayed image, thus providing a more immersive viewing experience for the user wearing the HMD 102. In other words, process 500 is a technique for providing a control signal 200 to the electrically controllable lens 100 so that the control signal 200 is temporally synchronized with the image displayed on the HMD 102's display panel. This provides a temporal variation of optical power to the electrically controllable lens 100, thereby providing the user's brain with angular information associated with the displayed image, in addition to intensity information.

[0053] Figure 6 Example components of a system 600, which may implement the technologies disclosed herein, are illustrated according to embodiments thereof. As mentioned above, system 600 may include a standalone HMD 102, an electrically controllable lens 100, and possibly one or more handheld controllers 601. Alternatively, system 600 may be a distributed system comprising the HMD 102, the electrically controllable lens 100, possibly one or more handheld controllers 601, and one or more additional computers 603 communicatively coupled to the HMD 102. Figure 6 In this context, the auxiliary computer 603 may represent a host computer and / or a remote system. For example, system 600 may include a host computer communicatively coupled to HMD 102 and possibly to handheld controller 601. In some instances, the host computer may be co-located with HMD 102 and handheld controller 601 in the same environment, such as a home of a user wearing HMD 102 and holding handheld controller 601. The host computer, HMD 102, and handheld controller 601 may be communicatively coupled together wirelessly and / or via a wired connection. For example, devices 102 / 601 / 603 may exchange data using Wi-Fi, Bluetooth, Radio Frequency RF, and / or any other suitable wireless protocol. Additionally or alternatively, devices 102 / 601 / 603 may include one or more physical ports to facilitate wired connections (e.g., tethers, cables, etc.) for data transmission therebetween. In some instances, system 600 may include a remote system in addition to or in place of a host computer located in the environment of HMD 102 and handheld controller 601. The remote system may be communicatively coupled to the host computer and / or HMD 102 via a wide area network such as the Internet. Thus, a remote system may represent one or more server computers located at one or more remote geographical locations relative to the geographical locations of HMD 102 and handheld controller 601. In other instances, the network may represent a local area network (LAN), and although the remote system is considered to be remote from HMD 102, it may be located, for example, in the same building as HMD 102. HMD 102, handheld controller 601, and attached computer 603 (e.g., host and / or remote system) collectively represent a distributed system.

[0054] By being communicatively coupled together, the HMD 102, handheld controller 601, and auxiliary computer 603 can be configured to work collaboratively to output video and / or audio content via the HMD 102. Therefore, at least some of the components, programs, and / or data described herein, such as processor 602, application 612, etc., executable by processor 602, may reside on the auxiliary computer 603. Alternatively, as mentioned above, the components, programs, and / or data may reside entirely on the HMD 102, such as in a standalone HMD 102. The auxiliary computer 603 can be implemented as any type of computing device and / or any number of computing devices, including but not limited to personal computers (PCs), laptops, desktop computers, portable digital assistants (PDAs), mobile phones, tablets, set-top boxes, game consoles, server computers, wearable computers (e.g., smartwatches), or any other electronic device capable of transmitting / receiving data.

[0055] HMD 102 may be implemented as a device to be worn by a user (e.g., on the user's head). In some embodiments, HMD 102 may be head-mounted, such as by allowing the user to secure HMD 102 to his / her head using a fixation mechanism (e.g., an adjustable strap) sized to surround the user's head. In some embodiments, HMD 102 includes a VR, AR, or MR head-mounted device that includes a near-eye or near-to-eye display. Therefore, the terms "wearable device," "wearable electronic device," "VR head-mounted device," "AR head-mounted device," "MR head-mounted device," and "head-mounted display (HMD)" are used interchangeably herein to refer to device 102. However, it should be understood that these types of devices are merely examples of HMD 102, and it should be understood that HMD 102 may be implemented with a variety of other form parameters.

[0056] In the illustrated embodiments, system 600 includes one or more processors 602 and memory 604 (e.g., computer-readable medium 604). In some embodiments, processor 602 may include CPU 606, GPU 608, both CPU 606 and GPU 608, a microprocessor, digital signal processor, or other processing units or components known in the art. Alternatively or in addition, the functions described herein may be performed at least in part by one or more hardware logic components. Examples, but not limited to, exemplary types of hardware logic components that may be used include field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), system-on-a-chip systems (SOCs), complex programmable logic devices (CPLDs), etc. Furthermore, each processor in processor 602 may have its own local memory, which may also store program modules, program data, and / or one or more operating systems.

[0057] Memory 604 may include volatile and non-volatile memory, removable and non-removable media implemented by any method or technology for storing information, such as computer-readable instructions, data structures, program modules or other data. Such memory includes, but is not limited to, Random Access Memory (RAM), Read-Only Memory (ROM), Electrically Erasable Programmable ROM (ROMEPROM), flash memory or other memory technologies, Compact Disk ROM (CD-ROM), Digital Versatile Disk DVD (DVD) or other optical storage devices, magnetic tape cassettes, magnetic tape, disk storage devices or other magnetic storage devices, Redundant Array of Independent Disks (RAID) storage systems, or any other medium that can be used to store desired information and can be accessed by a computing device. Memory 604 may be implemented as a Computer-Readable Storage Media (CRSM), which may be any available physical medium that the processor 602 can access to execute instructions stored on memory 604. In one basic embodiment, the CRSM may include RAM and flash memory. In other specific implementations, the CRSM may include, but is not limited to, ROM, EEPROM, or any other non-transient and / or tangible medium that can be used to store desired information and can be accessed by the processor 602.

[0058] Typically, system 600 may include logical components (e.g., software, hardware, and / or firmware, etc.) configured to implement the technologies, functionalities, and / or operations described herein. Computer-readable medium 604 is shown as including a wide variety of modules, such as instructions, data repositories, etc., which may be configured to execute on processor 602 to perform the technologies, functionalities, and / or operations described herein. Several example functional modules are shown stored in computer-readable medium 604 and capable of executing on processor 602; however, the same functionality may alternatively be implemented in hardware, firmware, or as a system-on-a-chip (SoC) and / or other logical components.

[0059] For the benefit of other modules, the operating system module 610 may be configured to manage the hardware within and coupled to the system 600. Furthermore, in some cases, the system 600 may include one or more applications 612 stored in memory 604 or otherwise accessible by the system 600. In some instances, applications 612 include game applications (e.g., video games, such as VR video games). However, the system 600 may include any number or type of applications and is not limited to the specific examples shown herein. The diopter adjustment component 614 may be configured to perform the techniques described herein to adjust the optical power of the electrically controllable lens 100. For example, the diopter adjustment component 614 may be configured to perform processes 400 and / or 500 as described above.

[0060] Typically, system 600 has an input device 616 and an output device 618. In some instances, input device 616 may include a handheld controller 601. In some implementations, one or more microphones 620 may be used as input device 616 to receive audio input, such as user voice input. In some implementations, one or more cameras 622 or other types of sensors 624, such as an inertial measurement unit (IMU) 626, may be used as input device 616. For example, IMU 626 may be configured to detect head movements of a user wearing HMD 102, including for gesture input purposes. Sensor 624 may further include sensors for generating motion, positioning, and orientation data, such as gyroscopes, accelerometers, magnetometers, color sensors, or other motion, positioning, and orientation sensors. Sensor 624 may also include sub-parts of the sensor, such as a series of active or passive markers that can be viewed externally by a camera or color sensor to generate motion, positioning, and orientation data. For example, a VR headset may include multiple markers, such as reflectors or light (e.g., infrared or visible light), on its exterior. These markers can provide one or more reference points for software interpretation when viewed by an external camera or illuminated by light (e.g., infrared or visible light) to generate motion, positioning, and orientation data. Sensor 624 may include a light sensor sensitive to light (e.g., infrared or visible light) projected or broadcast by a base station in the environment of HMD 102. IMU 626 may be an electronic device that generates calibration data based on measurement signals received from accelerometers, gyroscopes, magnetometers, and / or other sensors suitable for detecting motion, correcting errors associated with IMU 626, or some combination thereof. Based on the measurement signals, such motion-based sensors, such as IMU 626, can generate calibration data indicating an estimated positioning of HMD 102 relative to HMD 102. For example, multiple accelerometers may measure translational motion (forward / backward, up / down, left / right), and multiple gyroscopes may measure rotational motion (e.g., pitch, yaw, and roll). For example, IMU 626 can rapidly sample measurement signals and calculate the estimated location of HMD 102 based on the sampled data. For instance, IMU 626 can integrate the measurement signals received from the accelerometer over time to estimate the velocity vector, and integrate the velocity vector over time to determine the estimated location of a reference point on HMD 102. A reference point is a point that can be used to describe the location of HMD 102. While a reference point is typically defined as a point in space, in a variety of embodiments, the reference point is defined as a point within HMD 102 (e.g., the center of IMU 626). Alternatively, IMU 626 provides the sampled measurement signals to an external console (or other computing device) that determines calibration data.

[0061] Sensor 624 can operate at a relatively high frequency to provide sensor data at a high rate. For example, sensor data can be generated at a rate of 1000 Hz (or one sensor reading per millisecond). This results in one thousand readings per second. When the sensor generates so much data at this rate (or even higher), the dataset used to predict motion is quite large, even over relatively short time periods on the order of tens of milliseconds. As mentioned, in some embodiments, for the purpose of tracking the location and / or orientation, attitude, etc., of HMD 102 in three-dimensional (3D) space, sensor 624 may include a light sensor sensitive to light emitted by a base station in the environment of HMD 102. The calculation of location and / or orientation may be based on the timing characteristics of the light pulses and the presence or absence of light detected by sensor 624.

[0062] In some embodiments, the additional input device 616 may be provided in the form of a keyboard, keypad, mouse, touchscreen, joystick, etc. In some instances, the HMD 102 may omit the keyboard, keypad, or other similar mechanical input. In some instances, the HMD 102 may include control mechanisms such as basic volume control buttons for increasing / decreasing volume, as well as power and reset buttons. In some instances, as described above, the HMD 102 includes dedicated controls for diopter adjustment via the electrically controllable lens 100, such as actuators (e.g., a rotary knob 206 (or dial)), "up" or "down" buttons, sliders, touch sensors (e.g., a touchpad), etc.

[0063] Output device 618 may include a display or display panel 628 (e.g., a pair of stereoscopic display panels). The display panel 628 of HMD 102 may utilize any suitable type of display technology, such as an emitting display that uses light-emitting elements (e.g., light-emitting diodes (LEDs)) to present light emitted during frames on the display panel 628. As examples, the display panel 628 of HMD 102 may include a liquid crystal display (LCD), an organic light-emitting diode (OLED) display, an inorganic light-emitting diode (ILED) display, or any other suitable type of display technology for HMD applications. Output device 618 may further include, but is not limited to, light elements (e.g., LEDs), vibrators for creating tactile sensations, and one or more speakers (e.g., external ear speakers).

[0064] System 600 may include a power source 630, such as one or more batteries. For example, HMD 102 may be powered by one or more batteries, and / or handheld controller 601 may be powered by one or more batteries. Additionally or alternatively, HMD 102 and / or handheld controller 601 may include a power cord port for connection to an external power source via a wired means such as a cable.

[0065] System 600 (e.g., HMD 102, electrically controllable lens 100, and / or handheld controller 601) may further include a communication interface 632, such as a wireless unit coupled to transceiver 633 and / or an antenna to facilitate wireless connectivity to a network. In some instances, transceiver 633 is configured to facilitate the wireless transmission of control signals from processor 602 to electrically controllable lens 100. Such wireless units may implement one or more of a wide variety of wireless technologies, such as Wi-Fi, Bluetooth, Radio Frequency (RF), etc. It should be understood that HMD 102, electrically controllable lens 100, and / or handheld controller 601 may further include physical ports to facilitate wired connections to a network, connected peripherals (including computer 603, such as a host computer that may be a PC, game console, etc.), or plug-in network devices that communicate with other wireless networks.

[0066] HMD 102 may further include an optical subsystem 634 that uses one or more optical elements to direct light from the electronic display panel 628 to the user's eye 302. The optical subsystem 634 may include a wide variety of types and combinations of different optical elements, including but not limited to apertures, lenses 106 (e.g., Fresnel lenses, convex lenses, concave lenses, etc.), filters, etc. In some embodiments, one or more optical elements in the optical subsystem 634 may have one or more coatings, such as an anti-reflective coating. The amplification of the image light 300 by the optical subsystem 634 makes the larger display panel 628 physically smaller, lighter, and consumes less power. Additionally, the amplification of the image light 300 increases the field of view (FOV) of the displayed content (e.g., an image). For example, the FOV of the displayed content allows the displayed content to be presented using almost the entire user's FOV (e.g., 120 to 150 degrees diagonally) and, in some cases, the entire user's FOV. AR applications may have a narrower FOV (e.g., approximately 40 degrees FOV). The optical subsystem 634 may be designed to correct one or more optical errors, such as, but not limited to, barrel distortion, pincushion distortion, longitudinal chromatic aberration, lateral chromatic aberration, spherical aberration, coma, field curvature, etc. In some embodiments, the content provided to the electronic display panel 628 for display is pre-distorted, and the optical subsystem 634 corrects the distortion when it receives content-based image light from the electronic display panel 628. The optical subsystem 634 may further include the aforementioned lens tube 104 of the HMD 102 and the electrically controllable lens 100 described herein.

[0067] HMD system 600 may further include eye-tracking system 636 for generating eye-tracking data. Eye-tracking system 636 may include, but is not limited to, eye-tracking sensors, such as cameras or other optical sensors within HMD 102, to capture image data (or information) of the user's eyes 302, and eye-tracking system 636 may use the captured data / information to identify the pupils and / or other landmarks of the eyes 302 to determine eye orientation, 3D positioning of the eyes 302, interpupillary distance, interocular distance, motion vectors including torsion and rotation (i.e., roll, pitch, and yaw), and / or gaze direction of each eye 302. In one example, light, such as infrared light, is emitted from a light source within HMD 102 and reflected from each eye 302. The reflected light is received or detected by eye-tracking sensors (e.g., cameras) of eye-tracking system 636 and analyzed to extract eye rotation from changes in the infrared light reflected by each eye. Many methods for tracking the user's eyes 302 may be used by eye-tracking system 636. Therefore, the eye-tracking system 636 can track up to six degrees of freedom (i.e., 3D positioning, roll, pitch, and yaw) for each eye 302, and can estimate a gaze point (i.e., the 2D position or orientation (or 3D position or orientation in a virtual scene) that the user is looking at, from at least a subset of the quantities tracked by the combination of the two eyes 302 of the user wearing the HMD 102. This gaze point can be mapped to a position on the display panel 628 to predict where the user will look based on a single subset (e.g., a row) or a continuous subset (e.g., a continuous set of rows) of pixels on the display panel 628. For example, the eye-tracking system 636 can integrate information from past measurements, measurements identifying the user's head positioning, and 3D information describing the scene presented by the display panel 628. Thus, information regarding the positioning and orientation of the user's eyes is used to determine the gaze point in the virtual scene that the user is looking at, as presented by the HMD 102, and to map that gaze point to a position on the display panel 628 of the HMD 102.

[0068] System 600 may further include a head tracking system 638. The head tracking system 638 may utilize one or more sensors from sensor 624 to track head movements, including head rotation, of a user wearing the HMD 102. For example, the head tracking system 638 may track up to six degrees of freedom of the HMD 102 (i.e., 3D positioning, roll, pitch, and yaw). These calculations may be performed at each frame in a series of frames, allowing application 612 to determine how to render the scene in the next frame based on head positioning and orientation. In some embodiments, the head tracking system 638 is configured to generate head tracking data based on current and / or past data and / or known / implicit scanout delays of various subsets of pixels in the display system, which can be used to predict the future pose (positioning and / or orientation) of the HMD 102. This is because application 612 is required to render frames before the user actually sees the light 300 on the display panel 628 (and thus sees the image). Therefore, the next frame can be rendered based on this future prediction of head positioning and / or orientation made at an earlier point in time. The rotation data provided by the head tracking system 638 can be used to determine the direction and amount of rotation of the HMD 102 in any suitable unit of measurement. For example, the direction of rotation can be simplified and output as a positive or negative horizontal direction and a positive or negative vertical direction, corresponding to left, right, up, and down. The amount of rotation can be expressed in units such as degrees, radians, etc. Angular velocity can be calculated to determine the rotation rate of the HMD 102.

[0069] System 600 may further include a controller tracking system 640. The controller tracking system 640 may utilize one or more sensors from sensor 624 to track controller movement. For example, the controller tracking system 640 may track up to six degrees of freedom (i.e., 3D positioning, roll, pitch, and yaw) of a controller 601 held by a user. These calculations may be performed at each frame in a series of frames, allowing application 612 (e.g., a video game) to determine how to render a virtual controller and / or virtual hand in the scene in the next frame based on the controller's positioning and orientation. In some embodiments, the controller tracking system 640 is configured to predict the future positioning and / or orientation of the controller 601 based on current and / or past data, as described above with respect to head tracking system 638.

[0070] Although the subject matter has been described in structurally specific language, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features described. Rather, the specific features are disclosed as illustrative forms for implementing the claims.

Claims

1. A system comprising: A head-mounted display (HMD), the head-mounted display (HMD) comprising: Display panel; and A pair of lens tubes; A pair of electrically controllable lenses, the pair of electrically controllable lenses including a first electrically controllable lens and a second electrically controllable lens, the pair of electrically controllable lenses being configured as follows: Coupled to the pair of lens tubes; and The light emitted by the display panel is directed toward the eyes of the user wearing the HMD; Processor; and The memory stores computer-executable instructions that, when executed by the processor, cause the processor to: Provide a first control signal to the first electrically controllable lens to adjust the first optical power of the first electrically controllable lens; and A second control signal is provided to the second electrically controllable lens to adjust the second optical power of the second electrically controllable lens.

2. The system according to claim 1, wherein the first control signal causes the first electrically controllable lens to: The phase of the light passing through the center of the first electrically controllable lens is adjusted by a first amount; and The phase of the light passing through the periphery of the first electrically controllable lens is adjusted to a second quantity that is different from the first quantity.

3. The system according to claim 1, wherein: When executed by the processor, the computer-executable instructions further cause the processor to receive first user input data, the first user input data indicating that the user has provided first user input to adjust the first optical power of the first electrically controllable lens; and The first control signal is provided to the first electrically controllable lens based at least in part on the first user input data.

4. The system according to claim 3, wherein: When executed by the processor, the computer-executable instructions further cause the processor to receive second user input data, the second user input data indicating that the user has provided second user input to adjust the second optical power of the second electrically controllable lens; and The second control signal is provided to the second electrically controllable lens based at least in part on the second user input data.

5. The system of claim 1, wherein the pair of electrically controllable lenses are accessories of the HMD and are configured to be coupled to the pair of lens tubes by the user.

6. The system according to claim 1, further comprising a transceiver, wherein: The first control signal is wirelessly transmitted to the first electrically controllable lens via the transceiver; and The second control signal is wirelessly transmitted to the first electrically controllable lens via the transceiver.

7. The system according to claim 1, wherein: The HMD further includes a pair of lenses disposed within the pair of lens tubes; and The pair of electrically controllable lenses are configured to be positioned between the pair of lenses and the eyes of the user wearing the HMD.

8. The system of claim 1, wherein the computer-executable instructions, when executed by the processor, further cause the processor to: A first series of control signals, including the first control signal, are provided to the first electrically controllable lens in synchronization with the refresh rate of the display panel; and A second series of control signals, including the second control signal, are provided to the second electrically controllable lens in sync with the refresh rate of the display panel.

9. A method, the method comprising: The processor receives user input data indicating that a user wearing a head-mounted display (HMD) has provided user input to adjust the optical power of the electrically controllable lenses of the HMD; as well as The processor provides control signals to the electrically controllable lens, at least in part based on the user input data, to adjust the optical power of the electrically controllable lens.

10. The method of claim 9, wherein the control signal causes the electrically controllable lens to have: The first optical power at the center of the electrically controllable lens; and A second optical power at the periphery of the electrically controllable lens, the second optical power being different from the first optical power.

11. The method of claim 9, wherein the electrically controllable lens is a first electrically controllable lens in a pair of electrically controllable lenses of the HMD, the pair of electrically controllable lenses including the first electrically controllable lens and the second electrically controllable lens, the method further comprising: The processor receives second user input data, which indicates that the user has provided second user input to adjust the second optical power of the second electrically controllable lens; as well as The processor provides a second control signal to the second electrically controllable lens, at least in part based on the second user input data, to adjust the second optical power of the second electrically controllable lens.

12. A system comprising: A head-mounted display (HMD), the head-mounted display (HMD) comprising: Display panel; and A pair of lens tubes; A pair of electrically controllable lenses, which are coupled to or can be coupled to the pair of lens tubes and are configured to guide light emitted by the display panel toward the eyes of the user wearing the HMD; Processor; and The memory stores computer-executable instructions that, when executed by the processor, cause the processor to provide control signals to one of the pair of electrically controllable lenses to adjust the optical power of the electrically controllable lens.

13. The system of claim 12, wherein each of the pair of electrically controllable lenses is independently controllable.

14. The system of claim 12, wherein the control signal causes the electrically controllable lens to: The phase of the light passing through the center of the electrically controllable lens is adjusted by a first amount; and The phase of the light passing through the periphery of the electrically controllable lens is adjusted to a second quantity that is different from the first quantity.

15. The system according to claim 12, wherein: When executed by the processor, the computer-executable instructions further enable the processor to receive user input data, the user input data indicating that the user has provided user input to adjust the optical power of the electrically controllable lens; and The control signal is provided to the electrically controllable lens based at least in part on the user input data.

16. The system of claim 12, wherein the pair of electrically controllable lenses are accessories to the HMD and are configured to be coupled to the pair of lens tubes by the user.

17. The system according to claim 12, wherein: The HMD further includes a pair of lenses within the pair of lens tubes; and The pair of electrically controllable lenses are configured to be positioned between the pair of lenses and the eyes of the user wearing the HMD.

18. The system of claim 12, wherein the computer-executable instructions, when executed by the processor, further cause the processor to provide the electrically controllable lens with a series of control signals, including the control signals, in synchronization with the refresh rate of the display panel.

19. The system according to claim 12, wherein: The electrically controllable lens is the first electrically controllable lens in the pair of electrically controllable lenses; and When executed by the processor, the computer-executable instructions further cause the processor to provide a second control signal to the second electrically controllable lens of the pair of electrically controllable lenses to adjust the second optical power of the second electrically controllable lens.

20. The system of claim 19, wherein the second optical power is different from the optical power of the first electrically controllable lens.

Images