Adjustment of adjustable lenses in electronic devices

Abstract

This provides adjustment for adjustable lenses in electronic devices. [Solution] The electronic device may include a lens module having an adjustable lens. The adjustable lens may be capable of operating in multiple modes, such as normal mode, presbyopia relief mode, near-focus mode, and negative power boost mode. While operating, the electronic device can collect data and adjust the adjustable lens based on the collected data. The adjustable lens may switch from normal mode to presbyopia relief mode depending on whether a nearby object is being viewed through the lens module. The adjustable lens may switch from normal mode to negative power boost mode depending on whether the ambient light level is low and / or the level of eye fatigue is high. The adjustable lens may switch between modes over a transition period. An output device may notify the user when the adjustable lens changes modes.

Description

Technical Field

[0001] This application claims priority to U.S. Patent Application No. 18 / 625,114, filed Apr. 2, 2024, U.S. Provisional Patent Application No. 63 / 515,505, filed Jul. 25, 2023, and U.S. Provisional Patent Application No. 63 / 499,906, filed May 3, 2023, the entire disclosures of which are hereby incorporated by reference.

Background Art

[0002] This application generally relates to electronic devices, and more particularly, to wearable electronic device systems.

[0003] An electronic device may be configured to be worn by a user. For example, a head-mounted device may be provided with a head-mount structure that enables the device to be worn on the user's head. The head-mounted device may include an optical system having lenses.

[0004] A head-mounted device typically includes lenses having a certain shape and characteristics. Without due care, this type of lens may be difficult to adjust to optimally present content to each user of the head-mounted device.

Summary of the Invention

[0005] An electronic device may include a head-mount support structure, one or more sensors coupled to the head-mount support structure, and a lens module coupled to the head-mount support structure. The lens module may include an adjustable lens configured to change from a first mode in which the lens module has a first spherical refractive power to a second mode in which the lens module has a second spherical refractive power greater than the first spherical refractive power in response to a determination that an object nearby is being viewed through the lens module based on data from the one or more sensors.

[0006] The electronic device may include a head-mounted support structure, one or more sensors coupled to the head-mounted support structure, and a lens module coupled to the head-mounted support structure. The lens module may include an adjustable lens configured to change from a first mode in which the lens module has a first spherical refractive power to a second mode in which the lens module has a second spherical refractive power less than the first spherical refractive power, based on data from one or more sensors.

[0007] The electronic device may include a head-mounted support structure, a lens module coupled to the head-mounted support structure, which includes an adjustable lens configured to change from a first mode in which the lens module has a first spherical refractive power to a second mode in which the lens module has a second spherical refractive power different from the first spherical refractive power, and an output device coupled to the head-mounted support structure. The output device may be configured to provide an output indicating that the adjustable lens has changed from the first mode to the second mode. [Brief explanation of the drawing]

[0008] [Figure 1] This is a schematic diagram illustrating an exemplary electronic device according to several embodiments.

[0009] [Figure 2] This is a plan view of an exemplary head-mounted device having a lens module according to several embodiments.

[0010] [Figure 3] This is a side view of an exemplary lens module according to several embodiments.

[0011] [Figure 4] These are side views of exemplary adjustable lenses in different adjustment states according to several embodiments. [Figure 5] These are side views of exemplary adjustable lenses in different adjustment states according to several embodiments.

[0012] [Figure 6] This is a state diagram illustrating exemplary operating modes of adjustable lenses in electronic devices according to several embodiments.

[0013] [Figure 7] This is a side view of an exemplary head-mounted device having an electrooculography (EOG) sensor, according to several embodiments.

[0014] [Figure 8] This is a side view of an exemplary head-mounted device having an electromyography (EMG) sensor, according to several embodiments.

[0015] [Figure 9] This is a flowchart illustrating exemplary methods for operating an electronic device having an adjustable lens, according to several embodiments. [Modes for carrying out the invention]

[0016] A schematic diagram of an exemplary electronic device is shown in Figure 1. As shown in Figure 1, the electronic device 10 (sometimes called a head-mounted device 10, system 10, head-mounted display 10, etc.) may have a control circuit 14. In addition to being a head-mounted device, the electronic device 10 may be other types of electronic devices such as a cellular phone, laptop computer, speaker, computer monitor, electronic wristwatch, or tablet computer. The control circuit 14 may be configured to perform operations within the head-mounted device 10 using hardware (e.g., dedicated hardware or circuitry), firmware, and / or software. The software code and other data for performing operations in the head-mounted device 10 are stored in a non-temporary computer-readable storage medium (e.g., a tangible computer-readable storage medium) within the control circuit 14. The software code may be referred to as software, data, program instructions, instructions, or code. Non-temporary computer-readable storage media (sometimes commonly referred to as memory) may include non-volatile memory such as non-volatile random-access memory (NVRAM), one or more hard drives (e.g., magnetic drives or solid-state drives), one or more removable flash drives, or other removable media. Software stored in non-temporary computer-readable storage media may be executed on the processing circuits of the control circuit 14. The processing circuitry may include application-specific integrated circuits with processing circuits, one or more microprocessors, digital signal processors, graphics processing units, central processing units (CPUs), or other processing circuits.

[0017] The head-mounted device 10 may include an input / output circuit 16. The input / output circuit 16 may be used to allow the user to provide user input to the head-mounted device 10. The input / output circuit 16 may also be used to collect information about the environment in which the head-mounted device 10 is operating. Output components within the circuit 16 may allow the head-mounted device 10 to provide output to the user.

[0018] As shown in Figure 1, the input / output circuit 16 may include a display such as a display 18. The display 18 can be used to display images to the user of the head-mounted device 10. The display 18 may be a transparent or translucent display, so that the user can observe physical objects through the display, while computer-generated content is overlaid on the physical objects by presenting computer-generated images on the display. The transparent or translucent display may be formed from a transparent or translucent pixel array (e.g., a transparent organic light-emitting diode display panel) or from a transparent structure such as a display device that provides images to the user through a beam splitter, holographic coupler, or other optical coupler (e.g., a display device such as a liquid crystal on silicon display). Alternatively, the display 18 may be an opaque display that blocks light from physical objects when the user operates the head-mounted device 10. In this type of configuration, a pass-through camera can be used to display physical objects to the user. The pass-through camera may capture images of the physical environment, and the images of the physical environment may be displayed on the display for the user to view. Additional computer-generated content (e.g., text, game content, other visual content) may optionally be overlaid on the physical environment image to provide the user with an augmented reality environment. If the display 18 is opaque, the display may also optionally display the computer-generated content entirely (e.g., without displaying the physical environment image).

[0019] The display 18 may include one or more optical systems (e.g., lenses), sometimes referred to as an optical assembly, that enable a viewer to view an image on the display 18. It is also possible to create images for both eyes with a single display 18 or to display images using a pair of displays 18. In a configuration of multiple displays (e.g., a left-eye display and a right-eye display), the focal length and position of the lenses may be selected so that any gap that exists between the displays is not visible to the user (i.e., the image of the left display and the image of the right display overlap or are seamlessly merged). A display module (sometimes referred to as a display assembly) that generates different images for the user's left and right eyes may be referred to as a stereoscopic display. A stereoscopic display may be capable of presenting two-dimensional content (e.g., user notifications with text) and three-dimensional content (e.g., simulations of physical objects such as cubes).

[0020] Examples of the device 10 that includes a display are merely illustrative, and the display 18 may be omitted from the device 10 if desired. The device 10 may include an optical pass-through area where real-world content is visible to the user directly or through an adjustable lens.

[0021] The input / output circuit 16 may include a variety of other input / output devices. For example, the input / output circuit 16 may include one or more speakers 20 configured to play audio and one or more microphones 26 configured to capture audio data from the user and / or the physical environment around the user.

[0022] The input / output circuit 16 may also include one or more cameras, such as an inward-facing camera 22 (e.g., facing the user's face when the head-mounted device is worn on the user's head) and an outward-facing camera 24 (facing the physical environment around the user when the head-mounted device is worn on the user's head). The cameras 22 and 24 may capture visible light images, infrared images, or any other desired type of image. The cameras may be stereo cameras, if desired. In one possible configuration, the inward-facing camera 22 can capture an image used for a gaze detection operation. The outward-facing camera 24 may capture the pass-through video of the head-mounted device 10.

[0023] As shown in FIG. 1, the input / output circuit 16 may include a position and motion sensor 28 (e.g., a compass, gyroscope, accelerometer, and / or other device for monitoring the location, orientation, and motion of the head-mounted device 10, a satellite navigation system circuit such as a global positioning system circuit for monitoring the user's location, etc.). For example, using the sensor 28, the control circuit 14 can monitor the current direction in which the user's head is oriented with respect to the surrounding environment (e.g., the user's head pose). One or more of the cameras 22 and 24 can also be considered part of the position and motion sensor 28. The cameras can be used for face tracking (e.g., by capturing images of the user's jaw, mouth, etc. while the device is worn on the user's head), for body tracking (e.g., by capturing images of the user's torso, arms, hands, legs, etc. while the device is worn on the user's head), and / or for position determination (e.g., using visual odometry, visual inertial odometry, or other simultaneous localization and mapping (SLAM) techniques).

[0024] The input / output circuit 16 may also include other sensors and input / output components, if desired. As shown in Figure 1, the input / output circuit 16 may include an ambient light sensor 30. The ambient light sensor may be used to measure the ambient light level around the head-mounted device 10. The ambient light sensor may measure light at one or more wavelengths (e.g., visible light and / or infrared light of different colors).

[0025] The input / output circuit 16 may include a magnetometer 32. The magnetometer may be used to measure the strength and / or direction of the magnetic field around the head-mounted device 10.

[0026] The input / output circuit 16 may include a heart rate monitor 34. The heart rate monitor may be used to measure the heart rate of a user wearing the head-mounted device 10 using any desired technique.

[0027] The input / output circuit 16 may include a depth sensor 36. The depth sensor may be a pixelated depth sensor (configured to measure multiple depths across a physical environment, for example) or a point sensor (configured to measure a single depth within a physical environment). Whether the depth sensor is a pixelated depth sensor or a point sensor, it may use phase detection (e.g., phase detection autofocus pixels) or light detection and ranging (LIDAR) to measure depth. Any combination of depth sensors can be used to determine the depth of a physical object in the physical environment.

[0028] The input / output circuit 16 may include a temperature sensor 38. The temperature sensor may be used to measure the user temperature of the head-mounted device 10, the temperature of the head-mounted device 10 itself, or the ambient temperature of the physical environment around the head-mounted device 10.

[0029] The input / output circuit 16 may include a touch sensor 40. The touch sensor may be, for example, a capacitive touch sensor configured to detect touches from the user of a head-mounted device.

[0030] The input / output circuit 16 may include a humidity sensor 42. The humidity sensor may be used to detect the presence of moisture (e.g., water) on, inside, or around the head-mounted device.

[0031] The input / output circuit 16 may include a gas sensor 44. The gas sensor may be used to detect the presence of one or more gases (e.g., smoke, carbon monoxide, etc.) in or around the head-mounted device.

[0032] The input / output circuit 16 may include a barometer 46. The barometer may be used to measure atmospheric pressure, which may be used to determine the altitude of the head-mounted device.

[0033] The input / output circuit 16 may include an eye-tracking sensor 48 (sometimes called an eye-tracking device 48 or eye-tracking system 48). The eye-tracking sensor 48 may include a camera and / or other eye-tracking sensor components (e.g., a light source that emits a beam of light so that the reflection of the beam from the user's eye can be detected) to monitor the user's eyes. The eye-tracking device 48 faces the user's eyes and can track the user's gaze. A camera in an eye-tracking system may be used to determine the location of the user's eyes (e.g., the center of the user's pupil), the direction the user's eyes are directed (the direction of the user's gaze), the size of the user's pupil (e.g., the amount of gradual spatial adjustment of light modulation and / or other optical parameters, and / or one or more of these parameters, and / or an area in which one or more of these optical parameters are adjusted based on pupil size), the current focus of the user's eye lens (e.g., whether the user is focused on near or far vision, which can be used to assess whether the user is daydreaming or thinking strategically or tactically), and / or to monitor other gaze information. Cameras in eye-tracking systems are sometimes called inward-facing cameras, gaze detection cameras, eye-tracking cameras, or eye-monitoring cameras. If desired, other types of image sensors (e.g., infrared and / or visible light-emitting diodes and photodetectors) may also be used to monitor the user's gaze. The use of an eye-tracking camera in the eye-tracking device 48 is merely illustrative.

[0034] The input / output circuit 16 may include a button 50. The button may include a mechanical switch that detects user pressure during operation of the head-mounted device.

[0035] The input / output circuit 16 may include an optical proximity sensor 52. The optical proximity sensor may include a light source (e.g., an infrared light source) and an image sensor (e.g., an infrared image sensor) configured to detect the reflection of emitted light to determine proximity to a nearby object.

[0036] The input / output circuit 16 may include one or more electrooculography (EOG) sensors 53. Electrooculography is a technique for measuring the electrical potential between the front and back of a human eye. To measure the potential, one or more electrode pairs may be placed in contact with the skin on both sides of the eye (e.g., above and below the eye, or left and right of the eye). In this specification, electrodes used to measure electrooculographic potential may be referred to as electrooculography sensors or EOG sensors.

[0037] The input / output circuit 16 may include a Global Positioning System (GPS) sensor 54. The GPS sensor may determine the location information of the head-mounted device. The GPS sensor may include one or more antennas used to receive GPS signals. The GPS sensor may also be considered part of the position and motion sensor 28.

[0038] The input / output circuit 16 may include one or more electromyography (EMG) sensors 55. Electromyography is a technique for measuring electrical activity in response to nerve stimulation of muscles. Therefore, an EMG sensor can determine when a muscle is engaged. One or more electrode pairs can be placed in contact with the skin to measure the electrical activity associated with a muscle. In this specification, electrodes used to measure potentials for electromyography may be referred to as EMG sensors.

[0039] The input / output circuit 16 may include any other desired components (e.g., capacitive proximity sensors, other proximity sensors, strain gauges, pressure sensors, audio components, vibration motors, light-emitting diodes, other light sources, and other tactile output devices).

[0040] The head-mounted device 10 may also include a communication circuit 56 that enables the head-mounted device to communicate with external devices (e.g., portable devices such as tethered computers, handheld devices, laptop computers, one or more external servers, or other electrical equipment). The communication circuit 56 can be used for both wired and wireless communication with external devices.

[0041] The communication circuit 56 may include a radio frequency (RF) transceiver circuit formed from one or more integrated circuits, a power amplifier circuit, a low-noise input amplifier, a passive RF component, one or more antennas, a transmission line, and other circuits for processing RF radio signals. Radio signals can also be transmitted using light (for example, using infrared communication).

[0042] The radio frequency transceiver circuit in the wireless communication circuit 56 includes wireless local area network (WLAN) communication bands such as the 2.4GHz and 5GHz Wi-Fi® (IEEE 802.11) bands, wireless personal area network (WPAN) communication bands such as the 2.4GHz Bluetooth® communication band, cellular low band (LB) (e.g., 600~960MHz), cellular low-midband (LMB) (e.g., 1400~1550MHz), cellular midband (MB) (e.g., 1700~2200MHz), cellular high band (HB) (e.g., 2300~2700MHz), cellular ultra-high band (UHB) (e.g., 3300~5000MHz), or other cellular communication bands of approximately 600MHz to approximately 5000MHz (e.g., 3G band, 4G band). It can handle cellular telephone communication bands such as LTE bands and 5G New Radio Frequency Range 1 (FR1) bands below 10 GHz, near-field communications (NFC) bands (e.g., at 13.56 MHz), satellite navigation bands (e.g., L1 global positioning system (GPS) band at 1575 MHz, L5 GPS band at 1176 MHz, Global Navigation Satellite System (GLONASS) band, BeiDou Navigation Satellite System (BDS) band, etc.), ultra-wideband (UWB) communication bands supported by the IEEE 802.15.4 protocol, and / or other UWB communication protocols (e.g., a first UWB communication band at 6.5 GHz and / or a second UWB communication band at 8.0 GHz), and / or any other desired communication band.

[0043] Radio frequency transceiver circuits may include millimeter-wave / centimeter-wave transceiver circuits that support communication at frequencies of approximately 10 GHz to 300 GHz. For example, a millimeter-wave / centimeter-wave transceiver circuit can support communication in the extremely high frequency (EHF) or millimeter-wave communication band of approximately 30 GHz to 300 GHz, and / or in the centimeter-wave communication band (sometimes called the super high frequency (SHF) band) of approximately 10 GHz to 30 GHz. As an example, a millimeter-wave / centimeter-wave transceiver circuit can support communication in the IEEE K communication band of approximately 18 GHz to 27 GHz, and the K band of approximately 26.5 GHz to 40 GHz. a Communication bandwidth, approximately 12GHz~18GHz K u The communication band can support communication in the V communication band of approximately 40GHz to 75GHz, the W communication band of approximately 75GHz to 110GHz, or any other desired frequency band of approximately 10GHz to 300GHz. If desired, the millimeter-wave / centimeter-wave transceiver circuit can support IEEE 802.11ad communication at 60GHz (e.g., the WiGig or 60GHz Wi-Fi band around 57-61GHz) and / or the 5th generation mobile network or 5th generation wireless system (5G) new radio (NR) frequency range 2 (FR2) communication band of approximately 24GHz to 90GHz.

[0044] Antennas within the wireless communication circuit 56 may include antennas having resonant elements formed from loop antenna structures, patch antenna structures, inverted F antenna structures, slot antenna structures, planar inverted F antenna structures, helical antenna structures, dipole antenna structures, monopole antenna structures, or hybrids of these designs. Different types of antennas may be used for different bandwidths and combinations of bandwidths. For example, one type of antenna may be used to form a local radio link, and another type of antenna may be used to form a remote radio link antenna.

[0045] During operation, the head-mounted device 10 can communicate with external devices 60 using the communication circuit 56. The external devices 60 may include one or more external servers, electronic devices paired with the head-mounted device 10 (such as cellular phones, laptop computers, speakers, computer monitors, electronic watches, tablet computers, earphones, etc.), vehicles, and Internet of Things (IoT) devices (such as remote controls, light switches, doorbells, locks, smoke detectors, lighting, thermostats, ovens, refrigerators, stoves, grills, coffee makers, toasters, microwave ovens, etc.).

[0046] The electronic device 10 may have a housing structure (e.g., housing walls, straps, etc.) as shown by the exemplary support structure 62 in Figure 1. In a configuration where the electronic device 10 is a head-mounted device (e.g., a pair of glasses, goggles, a helmet, a hat, etc.), the support structure 62 may include a head-mounted support structure (e.g., a helmet housing, a head strap, temples of a pair of glasses, a goggle housing structure, and / or other head-mounted structures). The head-mounted support structure may be configured to be worn on the user's head during operation of the device 10 and may support a control circuit 14, an input / output circuit 16, and / or a communication circuit 56.

[0047] Figure 2 is a plan view of the electronic device 10 in an exemplary configuration in which the electronic device 10 is a head-mounted device. As shown in Figure 2, the electronic device 10 may include support structures (see, for example, support structure 62 in Figure 1) used to house the components of the device 10 and to mount the device 10 on the user's head. These support structures may include, for example, structures that form housing walls and other structures for the main unit 62-2 (e.g., outer housing walls, lens module structures, etc.), and spectacle temples or other auxiliary support structures such as structure 62-1 that help hold the main unit 62-2 on the user's face.

[0048] The electronic device may include optical modules such as optical module 70. The electronic device may include left and right optical modules corresponding to the user's left and right eyes, respectively. The optical module corresponding to the user's left eye is shown in Figure 2.

[0049] Each optical module 70 includes a corresponding lens module 72 (sometimes called a lens stack-up 72, lens 72, or adjustable lens 72). The lens 72 may include one or more lens elements arranged along a common axis. Each lens element may have any desired shape and may be formed from any desired material (e.g., having any desired refractive index). The lens elements may have unique shapes and refractive indices, which can be combined to focus light (e.g., from a display or the physical environment) in a desired manner. Each lens element of the lens module 72 can be formed from any desired transparent material (e.g., glass, polymer materials such as polycarbonate or acrylic, crystals such as sapphire, etc.).

[0050] Module 70 may be optionally positioned individually relative to the user's eye and to some of the housing wall structures of the main unit 26-2 using a positioning circuit such as a positioner 58. The positioner 58 may include a stepping motor, a piezoelectric actuator, a motor, a linear electromagnetic actuator, and / or other electronic components for adjusting the position of the display, the optical module 70, and / or the lens module 72. The positioner 58 may be controlled by the control circuit 14 during the operation of the device 10. For example, the positioner 58 can be used to adjust the spacing between modules 70 (and thus the spacing between the left and right lenses of module 70) to match the interpupillary distance (IPD) of the user's eye. In other examples, the lens module may include an adjustable lens element. The curvature of the adjustable lens element can be adjusted in real time by the positioner 58 to compensate for the user's visual acuity and / or viewing condition.

[0051] Each optical module may optionally include a display, such as display 18 in Figure 2. As previously mentioned, the display may be omitted from device 10 if desired. In this type of configuration, the device may still include one or more lens modules 72 (for example, through which the user views the real world). In this type of configuration, real-world content may be selectively focused for the user.

[0052] Figure 3 is a cross-sectional side view of an exemplary lens module having multiple lens elements. As shown, the lens module 72 includes a first lens element 72-1 and a second lens element 72-2. Each surface of the lens element may have any desired curvature. For example, each surface may be convex (e.g., spherical convex, cylindrical convex, or non-spherical convex), concave (e.g., spherical concave, cylindrical concave, or non-spherical concave), a combination of convex and concave, or a freeform surface. A spherically curved surface (e.g., spherical convex or spherical concave) may have a constant radius of curvature across the surface. In contrast, a non-spherical curved surface (e.g., non-spherical concave or non-spherical convex) may have a varying radius of curvature across the surface. A cylindrical surface may be curved only around one axis, rather than around multiple axes like a sphere. In some cases, one of the lens surfaces may have a non-spherical surface that changes from convex (e.g., at the center) to concave (e.g., at the edge) at different positions on the surface. This type of surface may be called a non-spherical surface, a non-spherical surface that is mostly convex (e.g., the majority of the surface is convex and / or the surface is convex at its center), a free-form surface, and / or a free-form surface that is mostly convex (e.g., the majority of the surface is convex and / or the surface is convex at its center). A free-form surface may include both convex and concave portions, and / or curvature defined by a polynomial series and expansion. Alternatively, a free-form surface may have varying convex or varying concave curvature (e.g., different portions with different radii of curvature, portions with curvature in one direction, and different portions with curvature in two directions). In this specification, a free-form surface that is primarily convex (for example, a surface that is mostly convex and / or convex at its center) may still be referred to as a convex surface, and a free-form surface that is primarily concave (for example, a surface that is mostly concave and / or concave at its center) may still be referred to as a concave surface. In an example shown in Figure 3, lens element 72-1 has a convex surface facing the display 18 and a concave surface on the opposite side. Lens element 72-2 has a convex surface facing lens element 72-1 and a concave surface on the opposite side.

[0053] One or both of the lens elements 72-1 and 72-2 may be adjustable. In one example, lens element 72-1 is a non-adjustable lens element, and lens element 72-2 is an adjustable lens element. The adjustable lens element 72-2 may be used, for example, to adapt to a user's eyeglass prescription. The shape of lens element 72-2 can be adjusted when the user's eyeglass prescription changes (without having to replace any other components in the device 10). In another possible use case, a first user having a first eyeglass prescription (or not having an eyeglass prescription) may use the device 10 having lens element 72-2 having a first shape, and a second different user having a second eyeglass prescription may use the device 10 having lens element 72-2 having a second shape different from the first shape. Lens element 72-2 may have adjustable lens power and / or provide variable amount or orientation astigmatism correction to provide prescription correction for the user.

[0054] The example of a lens module 72 containing two lens elements is merely illustrative. In general, a lens module 72 may contain any desired number of lens elements (e.g., one, two, three, four, more than four, etc.). Any subset or all of the lens elements may be optionally adjustable. Any of the adjustable lens elements in the lens module may optionally be a fluid-filled adjustable lens. The lens module 72 may also contain any desired additional optical layers to manipulate the light passing through the lens module (e.g., a partial reflection mirror that reflects 50% of the incident light, a linear polarizer, a phase difference plate such as a quarter-wave plate, a reflection polarizer, a circular polarizer, a reflection circular polarizer, etc.).

[0055] In one possible configuration, the lens element 72-1 may be a removable lens element. In other words, the user can easily remove and replace the lens element 72-1 in the optical module 70. This makes the lens element 72-1 customizable. If the lens element 72-1 is permanently fixed to the lens assembly, the lens power provided by the lens element 72-1 cannot be easily changed. However, by making the lens element 72-1 customizable, the user can select the lens element 72-1 that best suits their eye and place the appropriate lens element 72-1 in the lens assembly. The lens element 72-1 may be used, for example, to adapt to the user's eyeglass prescription. If the eyeglass prescription changes, the user can replace the lens element 72-1 with an updated lens element (without having to replace any other components in the electronic device 10). The lens element 72-1 may have adjustable lens power and / or provide a variable amount of astigmatism correction to provide prescription correction for the user. The lens element 72-1 may include one or more mounting structures configured to be attached to the optical module 70, the lens element 72-2, the support structure 26, or a corresponding mounting structure included in another structure within the electronic device 10.

[0056] In contrast to lens element 72-1, lens element 72-2 does not have to be a removable lens element. Therefore, lens element 72-2 may also be called a permanent lens element, a non-removable lens element, etc. The example of lens element 72-2 being a non-removable lens element is merely illustrative. In another possible configuration, lens element 72-2 may be a removable lens element (similar to lens element 72-1).

[0057] As mentioned above, one or more of the adjustable lens elements may be fluid-filled lens elements. An example in which the lens element 72-2 in Figure 3 is a fluid-filled lens element is described herein. When the lens element 72-2 is a fluid-filled lens element, the lens element may include one or more components that define the surface of the lens element 72-2. These components are also called lens elements. In other words, the adjustable lens element 72-2 (sometimes called the adjustable lens module 72-2, adjustable lens 72-2, adjustable lens 72-2, etc.) may be formed by a plurality of individual lens elements.

[0058] Figure 4 is a cross-sectional side view of an adjustable fluid-filled lens element 72-2. As shown, a fluid-filled chamber 82 (sometimes called chamber 82 or fluid chamber 82) containing fluid 92 is interposed between lens elements 84 and 86. The fluid 92 may be a liquid, gel, or gas having a predetermined refractive index (and therefore sometimes called liquid 92, gel 92, or gas 92). The fluid may also be called refractive index matching oil, optical oil, optical fluid, refractive index matching material, or refractive index matching liquid. The lens elements 84 and 86 may have the same refractive index or different refractive indices. The fluid 92 filling the chamber 82 between lens elements 84 and 86 may have the same refractive index as lens element 84 but a different refractive index as lens element 86, the same refractive index as lens element 86 but a different refractive index as lens element 84, the same refractive index as lens elements 84 and 86, or a different refractive index as lens elements 84 and 86. The lens elements 84 and 86 may have a circular footprint, an elliptical footprint, or any other desired footprint (e.g., an irregular footprint).

[0059] The amount of fluid 92 in the chamber 82 may be a constant volume or an adjustable volume. If the amount of fluid is adjustable, the lens module may also include a fluid reservoir and fluid control components (e.g., a pump, a stepping motor, a piezoelectric actuator, a motor, a linear electromagnetic actuator, and / or other electronic components that apply force to the fluid in the fluid reservoir) for selectively transferring the fluid between the fluid reservoir and the chamber.

[0060] The lens elements 84 and 86 may be transparent lens elements formed from any desired material (e.g., glass, polymer materials such as polycarbonate or acrylic, crystals such as sapphire, etc.). Each of the lens elements 84 and 86 may be an elastomer, semi-rigid, or rigid. Elastomer lens elements may be formed from natural or synthetic polymers with a low Young's modulus for high flexibility. For example, the elastomer film may be formed from a material having a Young's modulus of less than 1 GPa, less than 0.5 GPa, or less than 0.1 GPa.

[0061] A semi-rigid lens element may be formed from a semi-rigid material that is rigid and solid but not inflexible. For example, a semi-rigid lens element may be formed from a thin layer of polymer or glass. A semi-rigid lens element may be formed from a material having a Young's modulus greater than 1 GPa, greater than 2 GPa, greater than 3 GPa, greater than 10 GPa, greater than 25 GPa, etc. A semi-rigid lens element may be formed from polycarbonate, polyethylene terephthalate (PET), polymethyl methacrylate (PMMA), acrylic, glass, or any other desired material. The properties of a semi-rigid lens element may result in the lens element becoming rigid along a first axis when it is bent along a second axis perpendicular to the first axis, or more generally, the product of its two curvatures along the principal axes of curvature remaining substantially constant when it is bent. This is in contrast to elastomer lens elements, which remain flexible along the first axis even when the lens element is curved along a second axis perpendicular to the first axis. The properties of the semi-rigid lens element can enable it to form a cylindrical lens with adjustable lens power and an adjustable axis.

[0062] The rigid lens element may be formed from glass, polymer materials such as polycarbonate or acrylic, or crystals such as sapphire. Generally, the rigid lens element does not need to deform when pressure is applied to the lens element within the lens module. In other words, the shape and position of the rigid lens element may be fixed. Each surface of the rigid lens element may be planar, concave (e.g., spherical, non-spherical, or cylindrical concave), or convex (e.g., spherical, non-spherical, or cylindrical convex). The rigid lens element may be formed from a material having a Young's modulus of more than 25 GPa, more than 30 GPa, more than 40 GPa, or more than 50 GPa.

[0063] One or more structures, such as the lens housing 90 (sometimes called housing 90, lens chassis 90, chassis 90, support structure 90, etc.), may also define the fluid-filled chamber 82 of the lens element 72-2.

[0064] Figure 5 is a side cross-sectional view of the lens element 72-2 showing an exemplary adjustment of its shape. As shown, during the adjustment of the lens element 72-2, the lens element 84 can be biased in direction 94 at multiple points along its circumference (for example, point forces are applied in direction 94 at multiple points). In this way, the curvature of the lens element 84 (and therefore the lens power of the lens module 72-2) can be adjusted.

[0065] There are several options for how to manipulate the shape of the lens element 84. In one possible configuration, multiple actuators (e.g., linear actuators) can be coupled around the lens element. The actuators may, for example, be evenly distributed around the lens element 84. Each actuator (e.g., linear actuator) may be coupled to a separate part of the lens element 84, and the position of the separate part of the lens element 84 in the Z direction may be controlled by selectively moving the separate part of the lens element 84 up and down (e.g., in the Z direction in Figures 4 and 5). Lens shaping elements (e.g., ring-shaped elements) may optionally be coupled to both the lens element 84 and the actuators.

[0066] The example of the adjustable lens element 72-2, which is a fluid-filled lens element, is merely illustrative. In general, the adjustable lens element 72-2 may be any desired type of adjustable lens element having an adjustable refractive power.

[0067] Figure 6 is a state diagram showing various operating modes of the adjustable lens 72-2. Generally, the adjustable lens 72-2 can be adjusted to compensate for the user's vision. As shown in Figure 6, the adjustable lens is operable in normal mode 102. In normal mode, the adjustable lens can be set to compensate for the user's eyeglass prescription. This may be the baseline mode used during normal operation of the head-mounted device 10. When the adjustable lens 72-2 is in normal mode 102, the lens module 72 can provide refractive power that matches the user's eyeglass prescription.

[0068] The adjustable lens 72-2 may be capable of operating in one or more additional modes. Figure 6 shows how the adjustable lens can operate in presbyopia relief mode 104, near-focus mode 106, and negative power boost mode 108.

[0069] Presbyopia relief mode 104 can be used when the user has presbyopia (a refractive error that reduces the eye's ability to focus on near objects). In presbyopia relief mode, the adjustable lens can be adjusted to have an additional positive refractive power. For example, in presbyopia relief mode 104, the spherical refractive power of the adjustable lens can be increased by a positive magnitude compared to normal mode 102. The magnitude of the increase in the spherical refractive power of the adjustable lens in mode 104 compared to mode 102 may be at least 0.25 diopters, at least 0.5 diopters, at least 1 diopter, at least 1.5 diopters, at least 2 diopters, less than 3 diopters, 0.5 to 3 diopters, 1 to 2 diopters, etc. In general, the spherical refractive power can be adjusted to any desired diopter value in presbyopia relief mode 104.

[0070] The near-focus mode 106 can be used when a user without presbyopia is focusing on a nearby object. When a user without presbyopia is focusing on a nearby object, the refractive power of the adjustable lens can be relaxed (for example, shifted to near 0 diopters). For example, an adjustable lens that normally has negative spherical refractive power in mode 102 can increase its spherical refractive power in mode 106, and an adjustable lens that normally has positive spherical refractive power in mode 102 can decrease its spherical refractive power in mode 106. This can be particularly useful for myopic (nearsighted) users. For myopic users, the adjustable lens normally has negative spherical refractive power in mode 102.

[0071] The magnitude of the change in spherical refractive power of the adjustable lens in mode 106 compared to mode 102 can be at least 0.25 diopters, at least 0.5 diopters, at least 1 diopter, at least 1.5 diopters, at least 2 diopters, at least 4 diopters, at least 6 diopters, less than 8 diopters, less than 3 diopters, 0.5 to 3 diopters, 1 to 2 diopters, etc. In general, the spherical refractive power can be adjusted to any desired diopter value in near-focus mode 106.

[0072] In modes 104 and 106, a threshold distance may exist that defines a nearby object. In other words, an object closer to the head-mounted device 10 than the threshold distance may be considered a nearby object, and an object further away from the head-mounted device 10 than the threshold distance may not be considered a nearby object. Any desired distance can be used as the threshold distance (e.g., 1 meter, less than 1 meter, greater than 1 meter, etc.).

[0073] The negative power boost mode 108 may be used by users who can benefit from a greater negative refractive power in low light level conditions and / or when their eyes are fatigued (e.g., myopic users). Under these conditions, an adjustable lens that normally has negative spherical refractive power in mode 102 may have its spherical refractive power reduced in mode 108.

[0074] The magnitude of the change in spherical refractive power of the adjustable lens in mode 108 compared to mode 102 can be at least 0.25 diopters, at least 0.5 diopters, at least 1 diopter, at least 1.5 diopters, at least 2 diopters, at least 4 diopters, at least 6 diopters, less than 8 diopters, less than 3 diopters, 0.5 to 3 diopters, 1 to 2 diopters, etc. In general, the spherical refractive power can be adjusted to any desired diopter value in negative power boost mode.

[0075] Consider a first user with a spectacle prescription of -3 diopters for spherical refractive power. In this example, the first user also has presbyopia. In normal mode 102, the adjustable lens 72-2 may have a spherical refractive power of -3 diopters. In presbyopia relief mode 104, the adjustable lens 72-2 may have a spherical refractive power of -2 diopters. In negative power boost mode, the adjustable lens 72-2 may have a spherical refractive power of -4 diopters.

[0076] Consider a second user with a spectacle prescription of -6 diopters for spherical refractive power. In this example, the second user does not have presbyopia. In normal mode 102, the adjustable lens 72-2 may have a spherical refractive power of -6 diopters. In near-focus mode 106, the adjustable lens 72-2 may have a spherical refractive power of -1 diopter. In negative power boost mode, the adjustable lens 72-2 may have a spherical refractive power of -8 diopters.

[0077] Consider a third user who does not have a prescription for glasses but has presbyopia. In normal mode 102, the adjustable lens 72-2 may have a spherical refractive power of 0 diopters. In presbyopia relief mode 104, the adjustable lens 72-2 may have a spherical refractive power of +2 diopters.

[0078] The adjustable lens 72-2 can be adjusted between modes 102, 104, 106, and 108 based on various factors. The adjustable lens 72-2 may be set to mode 102 by default. If the head-mounted device 10 determines that the user is looking at a nearby object, the adjustable lens may be switched to mode 104 (if the user has presbyopia) or mode 106 (if the user does not have presbyopia). If the head-mounted device 10 determines that the light level is low, the adjustable lens may be switched to mode 108. If the head-mounted device 10 determines that the user is experiencing high eye strain, the adjustable lens may be switched to mode 108.

[0079] The EOG sensor 53 and EMG sensor 55 may be used to collect information used to determine the optimal mode of the adjustable lens 72-2 (for example, one of modes 102, 104, 106, and 108).

[0080] As described above, one or more EOG sensors 53 may be distributed around each of the user's eyes during the operation of the head-mounted device. Figure 7 is a side view of the head-mounted device 10 showing the EOG sensors 53. As shown, the support structure 62-2 may extend in a ring shape around the central opening. The user's eyes can be aligned with the central opening (and can see the physical environment through the central opening) when the head-mounted device is fitted to the user's head.

[0081] An optional nasal bridge portion 62-3 (sometimes referred to as a nasal bridge support structure 62-3, nasal bridge support structure portion 62-3, etc.) may be included in the head-mounted device. The nasal bridge portion 62-3 may be aligned with the user's nose when the head-mounted device is fitted to the user's head. The nasal bridge portion may define at least partially a first opening aligned with a first eye 302 and a second opening aligned with a second eye 304. Each individual eye can see the physical environment and / or the displayed image through the individual opening. An adjustable lens 72-2 may be aligned with each eye within each individual opening.

[0082] In the example shown in Figure 7, the first pair 53-1 (sometimes called EOG electrodes) of the EOG sensor 53 are formed on both sides of the eye 302. Specifically, the first electrode is formed on the support structure 62-2 above the eye 302, and the second electrode is formed on the support structure 62-2 below the eye 302. The second pair 53-2 of the EOG sensor 53 are formed on both sides of the eye 304. Specifically, the first electrode is formed on the support structure 62-2 above the eye 304, and the second electrode is formed on the support structure 62-2 below the eye 304. The third pair 53-3 of the EOG sensor 53 are formed on both sides of the eye 302. Specifically, the first electrode is formed on the support structure 62-2 on the left side of the eye 302, and the second electrode is formed on the nasal bridge portion 62-3 on the right side of the eye 302. A fourth pair 53-4 of the EOG sensor 53 is formed on both sides of the eye 304. Specifically, the first electrode is formed on the support structure 62-2 on the right side of the eye 304, and the second electrode is formed on the nasal bridge portion 62-3 on the left side of the eye 304.

[0083] The EOG sensor may be formed as part of a support structure 62-2 that contacts the user's face when the head-mounted device is worn on the user's head. The location of the EOG sensor in Figure 7 is merely illustrative. In general, the EOG sensor may be positioned at any desired location within the head-mounted device that is comfortable for the user while still allowing the EOG sensor to contact the user's skin and collect the desired data. The EOG sensor may be integrated into a rigid support structure that contacts the user's skin during operation, a flexible component (e.g., foam) that contacts the user's skin during operation, or the like.

[0084] EOG sensors can detect the user's eye rotation with sufficient precision and accuracy to reliably determine how far away the user's eyes are focused. For example, when the user is looking at a distant object, the EOG sensor can detect a first amount of rotation / convergence in the eye, while when the user is looking at a nearby object, the EOG sensor can detect a second amount of rotation / convergence in the eye that is different from the first amount.

[0085] As mentioned above, one or more EMG sensors 55 may be incorporated into the head-mounted device 10. The EMG sensors may, for example, be used to sense the contraction of the user's trapezius muscle. There is a correlation between the contraction of the ciliary muscle of the human eye and the contraction of the trapezius muscle. When the user is looking at a nearby object, the ciliary muscle contracts. When the user is looking at a distant object, the ciliary muscle relaxes. Therefore, ciliary muscle activity is greater when the user is looking at a nearby object than a distant object. Similarly, trapezius muscle activity may be greater when the user is looking at a nearby object than a distant object. By sensing trapezius muscle activity, the EMG sensor 55 may be able to reliably determine how far away the user's eyes are focused.

[0086] The EMG sensor 55 may include one or more electrodes that come into contact with the user's skin and the user's trapezius muscle or nearby. Figure 8 is a plan view of an exemplary head-mounted device showing possible locations for the EMG sensor 55. Figure 8 shows a support structure 62-2 that forms a main unit (for example, housing a lens module 70 having adjustable lenses 72-2) and a support structure 62-1 that helps hold the main unit 62-2 on the user's face. The support structure 62-1 may include eyeglass temples 63 (for example, a first eyeglass temple on the left side of the device and a second eyeglass temple on the second side of the device) and / or a strap 65.

[0087] Figure 8 shows how the EMG sensor 55-1 may be positioned on the eyeglass temple 63. The eyeglass temple may have a first end and a second opposing end, with the first end coupled to the main unit 62-2. The EMG sensor may be positioned on the second end of the eyeglass temple. In some cases, the eyeglass temple may be configured to extend below the user's ear when the head-mounted device 10 is mounted on the user's head, such that the EMG sensor 55-1 contacts the user's skin, in or near the user's trapezius muscle.

[0088] Figure 8 also shows an example in which the EMG sensor 55-2 is positioned on the strap 65. In Figure 8, the strap 65 extends between the eyeglass temples 63. This example is illustrative, and the strap 65 may instead be connected directly to the main unit 62-2, if desired. The strap may have an EMG sensor 55-2 configured to be positioned on or near the user's trapezius muscle when the head-mounted device 10 is worn on the user's head.

[0089] Figure 9 is a flowchart illustrating an exemplary method for operating a head-mounted device 10 having adjustable lenses. In step 202, the head-mounted device may collect data. The data may be collected from an external device 60, from one or more sensors within the device 10, from one or more output devices within the device 10, and so on.

[0090] In step 202, the head-mounted device 10 may wirelessly receive information from the external device 60. The information received from the external device may, for example, indicate whether the user is actively looking at the external device and / or the distance between the external device and the head-mounted device. The received information may include raw data (e.g., accelerometer data indicating a wake-up gesture) and / or a notification that the external device is being actively looked at (which does not necessarily have to include raw data). The external device 60 may estimate the distance between the head-mounted device 10 and the external device using ultra-wideband (UWB) communication and / or depth sensing (e.g., using a LIDAR sensor in the external device).

[0091] The head-mounted device 10 may collect data from one or more sensors in step 202. Sensors used to collect data in step 202 may include an inward-facing camera 22, an outward-facing camera 24, a microphone 26, a position and motion sensor 28, an ambient light sensor 30, a magnetometer 32, a heart rate monitor 34, a depth sensor 36, a temperature sensor 38, a touch sensor 40, a humidity sensor 42, a gas sensor 44, a barometer 46, an eye-tracking sensor 48, a button 50, a light-based proximity sensor 52, an EOG sensor 53, a GPS sensor 54, an EMG sensor 55, and the like.

[0092] For example, images from the outward-facing camera 24 may help identify whether the user is actively looking at a nearby object. Position and motion sensors 28 can recognize head gestures associated with a user looking at a nearby object. Ambient light sensor 30 may detect low ambient light levels that trigger a negative power boost mode 108. Depth sensor 36 may help identify whether the user is actively looking at a nearby object. Touch sensors 40 and / or buttons 50 can collect user input used to manually adjust the adjustable lenses. Eye-tracking sensor 48 may help identify whether the user is actively looking at a nearby object and / or determine pupil size information used to assess light levels and / or eye fatigue. EOG sensor 53 can sense the user's eye rotation to detect whether the user is focusing on a nearby or distant object. GPS sensor 54 can identify the location of the head-mounted device that affects the adjustment of the adjustable lenses 72-2. The EMG sensor 55 can detect the contraction of the user's trapezius muscle to indicate whether the user is focusing on a nearby object or a distant object.

[0093] Generally, data from any one of the following can influence the adjustment of the adjustable lens 72-2: the inward-facing camera 22, the outward-facing camera 24, the microphone 26, the position and motion sensor 28, the ambient light sensor 30, the magnetometer 32, the heart rate monitor 34, the depth sensor 36, the temperature sensor 38, the touch sensor 40, the humidity sensor 42, the gas sensor 44, the barometer 46, the eye-tracking sensor 48, the button 50, the light-based proximity sensor 52, the EOG sensor 53, the GPS sensor 54, and the EMG sensor 55.

[0094] In step 202, the head-mounted device 10 may collect data associated with one or more output devices. The data associated with an output device may include information about whether the output device is powered on and / or the type of content being presented if the output device is powered on. For example, the data collected in step 202 may include information about whether the display 18 in the head-mounted device 10 is operating and what type of content is being presented on the display 18.

[0095] The data collected in step 202 may further include information about the number and / or types of applications installed on the head-mounted device 10, the number and / or types of applications currently running on the head-mounted device 10, and information from the applications running on the head-mounted device 10.

[0096] The data collected in step 202 may include any other desired information (e.g., time, length of time the head-mounted device 10 was in operation, calendar information of the head-mounted device user, etc.).

[0097] In general, any of these types of data can affect the adjustment of the adjustable lens 72-2.

[0098] Next, in step 204, the head-mounted device 10 can adjust the adjustable lens (for example, the adjustable lens 72-2 based on the collected data). Adjusting the adjustable lens may include adjusting from normal mode 102 to presbyopia relief mode 104 (as in step 206), adjusting from normal mode 102 to near-focus mode 106 (as in step 208), adjusting from normal mode 102 to negative power boost mode 108 (as in step 210), or any other desired adjustment.

[0099] The adjustment from normal mode 102 to presbyopia relief mode 104 may be performed in response to a determination that a user with presbyopia is looking at a nearby object. The determination that the user is looking at a nearby object may be based on information received from an external device 60 (e.g., indicating that the external device 60 is being actively viewed and is near the head-mounted device 10). The determination that the user is looking at a nearby object may be based on information from one or more sensors within the head-mounted device 10 (e.g., the outward-facing camera 24 may identify a nearby object, the depth sensor 36 may determine that an object is nearby, the eye-tracking sensor 48 may identify that the user's gaze is directed towards a nearby object, etc.). The determination that the user is looking at a nearby object may also be based on the user's calendar information (e.g., indicating that the user is working and therefore likely to be looking at a computer screen at close range). The determination that the user is looking at a nearby object may also be based on location information from the GPS sensor 54 (e.g., indicating that the user is at work and therefore likely to be looking at a computer screen at close range). The determination that the user is looking at a nearby object may also be based on any other desired data collected in step 202.

[0100] The adjustment from normal mode 102 to near-focus mode 106 may be performed in response to a determination that a user without presbyopia is looking at a nearby object. The determination that a user is looking at a nearby object may be based on information received from an external device 60 (e.g., indicating that the external device 60 is being actively viewed and is near the head-mounted device 10). The determination that a user is looking at a nearby object may be based on information from one or more sensors within the head-mounted device 10 (e.g., the outward-facing camera 24 may identify a nearby object, the depth sensor 36 may determine that an object is nearby, the eye-tracking sensor 48 may identify that the user's gaze is directed towards a nearby object, etc.). The determination that a user is looking at a nearby object may also be based on the user's calendar information (e.g., indicating that the user is working and therefore likely to be looking at a computer screen at close range). The determination that a user is looking at a nearby object may also be based on location information from the GPS sensor 54 (e.g., indicating that the user is at work and therefore likely to be looking at a computer screen at close range). The determination that a user is looking at a nearby object may also be based on any other desired data collected in step 202.

[0101] The adjustment from normal mode 102 to negative power boost mode 108 may be performed in response to a determination that the light level is low. The determination that the light level is low may be based on the time of day (e.g., whether the time is before sunrise or after sunset), sensor data (e.g., data from the ambient light sensor 30, one or more images from the inward-facing camera 22 and / or outward-facing camera 24, pupil size information from the eye-tracking sensor 48, etc.), information from the external device 60 (e.g., ambient light data from the external device 60), and / or any other desired data collected in step 202.

[0102] The ambient light level measured by the ambient light sensor 30 can be compared to a threshold. When the ambient light level falls below the threshold, the adjustable lens may switch from normal mode 102 to negative power boost mode 108.

[0103] The pupil size measured by the inward-facing camera 22 and / or the eye-tracking sensor 48 can be compared to the user's baseline pupil size and / or threshold. When the pupil size is greater than the user's baseline pupil size and / or threshold, the adjustable lens may switch from normal mode 102 to negative power boost mode 108.

[0104] The adjustment from normal mode 102 to negative power boost mode 108 may be performed in response to a determination that the eye fatigue level is high. The determination that the eye fatigue level is high may be based on the time of day (e.g., if it is late in the day), sensor data (e.g., data from eye-tracking sensor 48, heart rate monitor 34, outward-facing camera 24, ambient light sensor 30, etc.), information from external devices 60 (e.g., active browsing time information from external electronic devices), and / or any other desired data collected in step 202.

[0105] The head-mounted device 10 may compare the current time with a threshold time. If the current time is later than the threshold time, the adjustable lens may switch from normal mode 102 to negative power boost mode 108.

[0106] The head-mounted device 10 may compare the active browsing time received from the external device 60 with a threshold. If the active browsing time is greater than the threshold (indicating potential eye fatigue), the adjustable lens may switch from normal mode 102 to negative power boost mode 108.

[0107] The adjustments in step 204 may include adjustments based on the display content (e.g., the type of content displayed on the display 18), adjustments in response to an external electronic device (e.g., a cellular phone, a wristwatch, a vehicle infotainment system, etc.) detecting gaze on the external electronic device, the ambient light level detected by the ambient light sensor 30, and the pupil size measured by the gaze tracking sensor 48 and / or the inward-facing camera 22. As an example, the data collected in step 202 may include the virtual image distance (VID) of the augmented reality display content presented using the display 18, and the adjustments in step 204 may include adjustments based on the virtual image distance. The adjustments in step 204 may include adjusting the lens power for people who cannot adapt to the current virtual image distance, and / or adjusting the lens power to help the user focus on the displayed content. In some cases, the virtual image distance may be adjusted by the display 18 based on the user's visual acuity (e.g., the VID may be set to infinity for people with presbyopia and to a smaller value for people without presbyopia).

[0108] In some cases, the display 18 may have a function in the rendering pipeline to apply selective blur to the displayed content, highlighting the location where the user should focus and pointing out the remaining elements that should be out of focus and / or at a different distance.

[0109] The display 18 may change the chromaticity of the presented content based on the time of day. For example, the display 18 may reduce the proportion of blue light displayed at night. The lens may be adjusted in step 204 based on the chromatic content and operating mode of the display 18.

[0110] The adjustment in step 204 may include adjustments to one or more lenses in a display having a waveguide. For example, the display may include a waveguide, a front bias lens, and a rear bias lens. In step 204, the front bias lens and / or the rear bias lens may be adjusted to shift the virtual content distance.

[0111] The adjustments performed in step 204 may be carried out gradually over a transition period having a certain duration. The duration of the transition period may be greater than 0.01 seconds, greater than 0.1 seconds, greater than 0.5 seconds, greater than 1 second, greater than 10 seconds, greater than 1 minute, greater than 10 minutes, less than 10 seconds, less than 1 second, etc. The transition period may differ depending on the type of transition. For example, the transition period for switching between modes 102 and 104 may be different from the transition period for switching between modes 102 and 108. If desired, the duration of the transition period may be adjusted based on any of the data collected in step 202. As an example, the transition period between modes 102 and 104 may have a first duration in some situations (e.g., if it is determined that the user is playing sports), but a second duration in other situations (as determined using the data from step 202).

[0112] It is known that in certain medical conditions, a user's prescriptions can change over time. Therefore, the adjustments made in step 204 can compensate for changes in the user's prescriptions that are caused over time by the medical condition, based on the user's medical condition.

[0113] The adjustments performed in step 204 may be used to balance the monocular field of view.

[0114] As shown in Figure 9, the head-mounted device 10 may, in step 212, present the user with an output that identifies the adjustable lens adjustment. The output may be presented before, during, and / or after the adjustment in step 204. The output may include visual output presented by the display 18 (e.g., icons, text notifications, or other visual indicators). Alternatively or in addition thereto, the output may include audio output presented by the speaker 20 (e.g., chimes, sound effects, songs, voice notifications, or other audible indicators). Alternatively or in addition thereto, the output may include haptic output from a haptic output device.

[0115] The output in step 212 may include displaying an arrow or other indicator that conveys the type of adjustment being made in step 204. For example, when switching to presbyopia relief mode 104, the display 18 may present an arrow or other indicator that identifies the lens as being optimized for short distances (e.g., reading). If the user is reading from an external electronic device, the display 18 may present an arrow pointing to the external electronic device when adjusting the lens in step 204. An output may be presented in step 212 in both cases: when the adjustment to the lens is performed automatically based on sensor data, and when the adjustment to the lens is performed manually by the user using user input.

[0116] Display 18 may be presenting augmented reality content when the adjustment in step 204 is performed. In this case, the size of the augmented reality content may be adjusted in step 212 to compensate for the lens adjustment.

[0117] In the configuration described herein, the lens module 72 may have a baseline refractive power that compensates for the user's eyeglass prescription. The adjustable lens 72-2 can then be adjusted to the baseline refractive power if desired during operation of the head-mounted device (e.g., by switching between modes 102, 104, 106, and 108 and adjusting the baseline refractive power if the user's prescription changes).

[0118] In some cases, a user may have different prescriptions for different use cases (e.g., a first prescription for reading and a second prescription for driving). In this case, the adjustable lens may be adjusted to change the total refractive power of the lens module between the different prescriptions. In the flowchart of Figure 9, the adjustable lens may, if desired, be adjusted in step 204 between a first mode for the first prescription and a second mode for the second prescription. Adjusting between a first mode for the first prescription and a second mode for the second prescription may be done based on location information (e.g., the first mode may be more likely to be used in a work or home environment), sensor data (e.g., identifying when the user is driving), calendar information (e.g., calendar information may identify when the user is working and therefore needs to use the first prescription), etc.

[0119] Generally, a user can set any desired number of preset modes for the adjustable lens 72-2 and assign any desired trigger to switch to those modes. For example, a user can define an office mode, a theater mode, and a sports mode. When it is determined that the user is working in an office, the adjustable lens may be switched to office mode. When it is determined that the user is watching visual content in a theater, the adjustable lens may be switched to theater mode. When it is determined that the user is playing sports, the adjustable lens may be switched to sports mode.

[0120] Generally, adjustable lenses can automatically switch to a given mode when a trigger associated with that mode is detected.

[0121] While using the head-mounted device 10, the user may be guided to adjustments made by the adjustable lens 72-2 at any desired pace. For example, the user may want to make additional adjustments over a period of several hours, weeks, months, etc., to ensure a comfortable adaptation period. The pace may be controlled directly by the user of the head-mounted device 10 or by an authorized third party (e.g., an optometrist).

[0122] The user may manually select lens adjustments based on recommendations from device 10, the lens adjustments may be performed automatically by device 10, and / or the user may decide when to perform automatic adjustments and when to perform manual adjustments.

[0123] Generally, an authorized third party (e.g., an optometrist) can adjust any aspect of the behavior of an adjustable lens if desired.

[0124] The head-mounted device 10 can generally be used as an alternative to glasses for vision correction, if the user desires.

[0125] In Figure 9, the adjustment in step 204 is performed automatically based on the data collected from step 202. However, this example is merely illustrative. If desired, the head-mounted device 10 may instead suggest adjustments to the adjustable lenses and await user input to approve or reject the adjustments. The head-mounted device may suggest adjustments using a display 18, a speaker 20, or a tactile output device such as a vibration motor. The user may approve or reject the suggested adjustments by pressing a button 50, touching a touch sensor 40, providing eye-tracking input using an eye-tracking sensor 48, providing voice commands using a microphone 26, and / or using any other desired user input.

[0126] It should be noted that the adjustment in step 204 may be performed manually based on user input provided to the head-mounted device 10. The user may provide user input to components on the head-mounted device 10 (for example, by pressing button 50, touching touch sensor 40, providing eye-tracking input using eye-tracking sensor 48, or providing voice commands using microphone 26). In another possible configuration, the user may provide user input to a paired electronic device (e.g., an external device 60 such as a cellular phone or wristwatch). The external device may transmit commands to the head-mounted device 10 for the adjustable lenses based on the user input to the external device. Input devices that receive user input for adjusting the adjustable lenses may include a digital crown or other rotatable input mechanism, an elongated touch sensor, and the like.

[0127] If desired, the lens module 72 may include an adjustable tinting function. In other words, the lens module 72 may include a layer or lens element having adjustable transparency. The transparency of the adjustable transparency layer may be adjusted based on any of the data collected in step 202. The transparency may be adjusted across the entire lens module or in only a subset of the lens module. For example, in sunny outdoor conditions with bright ambient light, the lens module may be tinted (e.g., the transparency of the adjustable transparency layer is reduced). If desired, the tint may be lower at the bottom of the field of view of the lens module 72 than the rest of the field of view of the lens module 72, allowing the user to view a watch or cellular phone through the more transparent portion of the lens module.

[0128] If desired, adjustments to adjustable lenses may be disabled manually or automatically for a specific period of time. For example, a user may request that adjustments be disabled while driving. A user may also request that adjustments be automatically disabled at any desired location and / or during any desired activity.

[0129] According to one embodiment, an electronic device is provided comprising a head-mounted support structure, one or more sensors coupled to the head-mounted support structure, and a lens module coupled to the head-mounted support structure, wherein the lens module includes an adjustable lens configured to change from a first mode in which the lens module has a first spherical refractive power to a second mode in which the lens module has a second spherical refractive power greater than the first spherical refractive power, in response to a determination, based on data from one or more sensors, that a nearby object is being viewed through the lens module.

[0130] According to another embodiment, one or more sensors include depth sensors, and data from one or more sensors includes data from depth sensors.

[0131] According to another embodiment, one or more sensors include outward-facing cameras, and data from one or more sensors includes data from outward-facing cameras.

[0132] According to another embodiment, one or more sensors include eye-tracking sensors, and data from one or more sensors includes data from eye-tracking sensors.

[0133] According to another embodiment, the adjustable lens is configured to change from a first mode to a second mode during a transition period having a duration of more than 0.5 seconds.

[0134] According to another embodiment, the electronic device includes an output device configured to provide an output indicating that the adjustable lens is changing from a first mode to a second mode.

[0135] According to another embodiment, the output device includes a display.

[0136] According to another embodiment, the output device includes a speaker.

[0137] According to another embodiment, the output device includes a haptic output device.

[0138] In another embodiment, the first mode is a normal mode, and the second mode is a presbyopia relief mode.

[0139] According to one embodiment, an electronic device is provided comprising a head-mounted support structure, one or more sensors coupled to the head-mounted support structure, and a lens module coupled to the head-mounted support structure, wherein the lens module includes an adjustable lens configured to change from a first mode in which the lens module has a first spherical refractive power to a second mode in which the lens module has a second spherical refractive power less than the first spherical refractive power, based on data from one or more sensors.

[0140] According to another embodiment, the first spherical refractive force is a negative spherical refractive force.

[0141] According to another embodiment, one or more sensors include ambient light sensors, and the data from one or more sensors includes data from the ambient light sensors.

[0142] According to another embodiment, the adjustable lens is configured to change from a first mode to a second mode in response to the ambient light level detected by the ambient light sensor falling below a threshold.

[0143] According to another embodiment, one or more sensors include eye-tracking sensors, and data from one or more sensors includes data from eye-tracking sensors.

[0144] According to another embodiment, one or more sensors include a camera, and data from one or more sensors includes data from the camera.

[0145] According to another embodiment, the adjustable lens is configured to change from a first mode to a second mode based on data from one or more sensors and based on time.

[0146] According to another embodiment, the adjustable lens is configured to change from a first mode to a second mode based on data from one or more sensors and location information.

[0147] According to another embodiment, the adjustable lens is configured to change from a first mode to a second mode based on data from one or more sensors and calendar information.

[0148] According to another embodiment, one or more sensors include electrooculography sensors.

[0149] According to another embodiment, one or more sensors include electromyography sensors.

[0150] According to one embodiment, an electronic device is provided, which includes a head-mounted support structure, a lens module coupled to the head-mounted support structure and including an adjustable lens configured to change from a first mode in which the lens module has a first spherical refractive power to a second mode in which the lens module has a second spherical refractive power different from the first spherical refractive power, and an output device coupled to the head-mounted support structure and configured to provide an output indicating that the adjustable lens has changed from the first mode to the second mode.

[0151] The above is merely illustrative, and various modifications may be made to the described embodiments. The aforementioned embodiments may be implemented individually or in any combination.

Claims

1. It is an electronic device, Head-mounted support structure, One or more sensors coupled to the head-mount support structure, A lens module coupled to the head-mount support structure, wherein the lens module is A lens module including an adjustable lens, configured to change from a first mode having a first spherical refractive power to a second mode having a second spherical refractive power greater than the first spherical refractive power, in response to a determination that a nearby object is being viewed through the lens module based on data from one or more sensors, An electronic device comprising: an output device configured to provide an output indicating that the adjustable lens is changing from the first mode to the second mode.

2. The electronic device according to claim 1, wherein the one or more sensors include a depth sensor, and the data from the one or more sensors includes data from the depth sensor.

3. The electronic device according to claim 1, wherein the one or more sensors include an outward-facing camera, and the data from the one or more sensors includes data from the outward-facing camera.

4. The electronic device according to claim 1, wherein the one or more sensors include an eye-tracking sensor, and the data from the one or more sensors includes data from the eye-tracking sensor.

5. The electronic device according to claim 1, wherein the adjustable lens is configured to change from the first mode to the second mode during a transition period having a duration of more than 0.5 seconds.

6. The electronic device according to claim 1, wherein the output device comprises a display.

7. The electronic device according to claim 1, wherein the output device comprises a speaker.

8. The electronic device according to claim 1, wherein the output device comprises a tactile output device.

9. The electronic device according to claim 1, wherein the first mode is a normal mode and the second mode is a presbyopia relief mode.

10. It is an electronic device, Head-mounted support structure, One or more sensors coupled to the head-mount support structure, A lens module coupled to the head-mount support structure, wherein the lens module is An electronic device comprising: a lens module having an adjustable lens configured to change from a first mode in which the lens module has a first spherical refractive power to a second mode in which the lens module has a second spherical refractive power less than the first spherical refractive power, based on data from one or more sensors, wherein the one or more sensors include an ambient light sensor, and the data from the one or more sensors includes data from the ambient light sensor.

11. The electronic device according to claim 11, wherein the first spherical refractive power is a negative spherical refractive power.

12. The electronic device according to claim 11, wherein the adjustable lens is configured to change from the first mode to the second mode in response to the ambient light level detected by the ambient light sensor falling below a threshold.

13. The electronic device according to claim 11, wherein the one or more sensors include an eye-tracking sensor, and the data from the one or more sensors includes data from the eye-tracking sensor.

14. The electronic device according to claim 11, wherein the one or more sensors include a camera, and the data from the one or more sensors includes data from the camera.

15. The electronic device according to claim 11, wherein the adjustable lens is configured to change from the first mode to the second mode based on the data from one or more sensors and based on time.

16. The electronic device according to claim 11, wherein the adjustable lens is configured to change from the first mode to the second mode based on the data from one or more sensors and based on location information.

17. The electronic device according to claim 11, wherein the adjustable lens is configured to change from the first mode to the second mode based on the data from one or more sensors and based on calendar information.

18. The electronic device according to claim 11, wherein one or more sensors include an electrooculogram sensor.

19. The electronic device according to claim 11, wherein one or more sensors include an electromyography sensor.

20. It is an electronic device, Head-mounted support structure, A lens module coupled to the head-mount support structure, comprising an adjustable lens configured to change from a first mode in which the lens module has a first spherical refractive power to a second mode in which the lens module has a second spherical refractive power different from the first spherical refractive power; and An electronic device comprising: an output device coupled to the head-mounted support structure, wherein the output device is configured to provide an output indicating that the adjustable lens is changing from a first mode to a second mode.

Images