Head-mounted display attachment device and test system
The dark adaptation accessory for HMDs addresses the limitations of conventional HMDs by providing controlled bleaching light and safety features, enabling accurate dark adaptation testing with reduced user discomfort and eye protection.
Patent Information
- Application Number
- JP2025517941
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-09-28
- Filing Date
- 2023-09-27
- Publication Date
- 2025-10-28
AI Technical Summary
Conventional head-mounted displays (HMDs) are inadequate for dark adaptation testing due to limitations in providing bleaching light intensity and susceptibility to ambient light interference, which can lead to user discomfort and potential eye damage, and obstruct camera functionality.
A dark adaptation accessory is designed to attach to HMDs, featuring a light-tight case with LEDs for controlled bleaching light emission, safety circuitry to prevent overexposure, and apertures for camera and microphone functionality, ensuring accurate data collection while shielding the eyes from unwanted light.
The accessory enables precise dark adaptation testing by providing necessary bleaching light intensity while protecting the user's eyes and maintaining environmental awareness through sensor data collection, reducing the risk of discomfort and damage.
Smart Images

Figure 2025535674000001_ABST
Abstract
Description
[Technical Field]
[0001] CROSS-REFERENCE TO RELATED APPLICATIONS
[0001] This application claims the benefit of priority to U.S. Patent Application No. 17 / 936,235, filed September 28, 2022, and U.S. Patent Application No. 17 / 936,246, filed September 28, 2022, the contents of which are incorporated herein by reference in their entireties. [Background technology]
[0002] background
[0002] Head-mounted displays are useful for various types of health-related tests, such as dark adaptation tests and other eye-related tests. Such tests provide data useful for determining eye-related conditions. During dark adaptation tests, the eye's photoreceptors are excited through one or more cycles of exposing the eye to dark or illuminated conditions. Readings obtained during such tests can be used to diagnose eye-related information (e.g., age-related macular degeneration) and other types of health information (e.g., blood sugar). Summary of the Invention [Means for solving the problem]
[0003] overview Head-mounted display (HMD) devices can measure ocular responses during dark adaptation testing or other tests involving exposing the eyes to various stimuli. Measured physiological changes can be paired with user-provided input indicating when the user detected the target stimulus. However, despite the advantages HMDs can offer for eye-related tests, hardware limitations prevent typical HMDs from being used for some types of tests, such as dark adaptation testing. For example, general-purpose HMDs are designed for ocular comfort over lengthy user sessions and are therefore not configured to provide the light intensity required to bleach the retina as needed during dark adaptation testing. Furthermore, while bleaching light is a necessary component of many tests, conventional tests may fail to account for user or programming errors that can overexpose users to bleaching light. Such overexposure can lead to discomfort and long-term eye damage. Additionally, attachments to HMDs can obscure one or more HMD cameras, thereby prohibiting positioning actions that rely on visual data provided by the HMD cameras.
[0004] Some embodiments may overcome this technical problem by using a dark adaptation accessory configured to attach to an HMD (e.g., a wearable dark adaptation attachment configured to attach over one or more transparent lenses of the HMD). The accessory device may be compatible with a head-mounted display capable of displaying stimuli and measuring eye-related information while exposing the eyes to bleaching light. The accessory device may include a light-tight case shaped to encompass at least the lenses of the head-mounted display, the light-tight case designed to shield light from the HMD when both the HMD and the dark adaptation accessory device are properly worn. The dark adaptation accessory device may also include an attachment body secured to the front end of the light-tight case, the attachment body including various electronics for performing the bleaching operation. The attachment body may include a set of light-emitting diodes (LEDs) to emit light at a bleaching intensity. In some embodiments, the set of LEDs is directed toward the front end of the light-tight case. The light emitted by the set of LEDs may be visible through the lenses of the HMD. Additionally, the light-tight case may include a set of openings through which the HMD's camera or microphone may continue to collect data.
[0005]
[0005] The attachment body may also include circuitry at least partially enclosed within the attachment body, which may include an integrated circuit, a microprocessor, a microcontroller, or the like. The circuitry may include controller circuitry in electrical communication with the set of LEDs configured to control light emission of the set of LEDs. The circuitry may also include safety circuitry in electrical communication with the set of LEDs for deactivating the set of light emitting diodes independently of the controller circuitry. Independent safety circuitry for the set of LEDs may reduce the possibility of user or program error exposing a user to destructive amounts of bleaching light.
[0006]
[0006] Various other aspects, features, and advantages of the present invention will become apparent through the detailed description of the invention and the accompanying drawings attached hereto. It should also be understood that both the foregoing summary and the following detailed description are exemplary and therefore do not limit the scope of the present invention. As used in this specification and the claims, singular articles and infinitives include plural references unless the context clearly dictates otherwise. Additionally, as used in this specification and the claims, the term "or" means "and / or" unless the context clearly dictates otherwise. Additionally, as used herein, "a portion" refers to some or all (i.e., all) of a given item (e.g., data) unless the context clearly dictates otherwise. Furthermore, "a set" can refer to either the singular or the plural (e.g., "a set of items" can refer to one item or multiple items).
[0007] BRIEF DESCRIPTION OF THE DRAWINGS
[0007] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and, together with the description, serve to explain the principles of the invention. [Brief explanation of the drawings]
[0008] [Figure 1A]
[0008] FIG. 1 is a first diagram of an exemplary head-mounted display (HMD) / accessory system according to one or more embodiments. [Figure 1B]
[0009] FIG. 2 is a second diagram of an exemplary HMD and accessory system according to one or more embodiments. [Figure 2]
[0010] FIG. 2 is a diagrammatic view of an attachment body of an attachment device according to one or more embodiments. [Figure 3]
[0011] 1 depicts an HMD and accessory system for use in conjunction with a computer system according to one or more embodiments. [Figure 4]
[0012] 1 is a flowchart of operations for conducting a dark adaptation test by using an accessory device according to one or more embodiments. [Figure 5] 1 is a flowchart of operations for performing testing with an HMD and accessory device system according to one or more embodiments. [Figure 6]
[0013] FIG. 1 is a block diagram of a computer system that can be used to implement features of some embodiments. DETAILED DESCRIPTION OF THE INVENTION
[0009] Detailed Description
[0014] In the following specification, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of embodiments of the present invention. However, it will be understood by those skilled in the art that some embodiments of the present invention may be practiced without these specific details or with equivalent arrangements. In other cases, well-known structures and devices are shown in block diagram form in order to avoid unnecessarily obscuring embodiments of the present invention.
[0010]
[0015] Head-mounted displays (HMDs) are versatile devices capable of performing various types of virtual reality or augmented reality operations. These HMDs allow users to test a subject's health by exposing the subject to various visual or auditory stimuli and collecting readings of the subject's responses to the visual or auditory stimuli in the form of eye-related readings. Such readings can provide valuable information, such as blood glucose levels, bleaching recovery time, etc. This information can then be used to diagnose health conditions such as diabetes, glaucoma, or age-related macular degeneration.
[0011]
[0016] In many cases, the visual stimuli that an HMD can emit may be limited in terms of color or brightness. For example, an HMD may be unable to emit bleaching light that would adequately bleach rhodopsin in the eye. Without the ability to provide such bleaching light, typical systems may produce inaccurate results or may require the use of room-scale bleaching equipment. Furthermore, in the case of HMDs that include one or more transparent lenses, ambient light or light from other sources may contaminate or otherwise invalidate eye-related readings made by the HMD.
[0012]
[0017] To overcome these and other problems, some embodiments may augment an HMD with an attachment device to further expose the subject's eyes to bleaching light in order to shield them from undesired light. It should be noted that the attachment device may be referred to as an attachment, accessory, or accessory device in some instances, and these terms are not limited in any way with respect to the HMD. In some embodiments, the attachment device for an HMD may maintain the environmental awareness capabilities provided by the HMD by including a series of apertures that allow the HMD sensors to continue acquiring data from its environment. For example, the attachment device may include one set of apertures that allow a camera on the HMD to continue collecting visual data and another set of apertures that allow a microphone on the HMD to continue collecting auditory data from the HMD's environment. Additionally, by including an attachment device for emitting bleaching light, the attachment device may include additional safety circuitry that protects the subject's eyes from excessive exposure to the bleaching light.
[0013]
[0018] 1A is a first diagram of an exemplary head-mounted display (HMD) and accessory system according to one or more embodiments. The HMD and accessory system 100 includes an HMD 101, a light-tight case 140, and an attachment body 110 secured to the light-tight case 140. The HMD and accessory system 100 is bisected into left and right sections by a sagittal plane 191 and may be separated into upper and lower sections by a transverse plane 192. The attachment body 110 is shown as an accessory body for the HMD 101 and may be separate from the HMD 101, although some embodiments may integrate the attachment body 110 with the HMD 101 such that the attachment body 110 may be more fully integrated with the HMD 101.
[0014]
[0019] The HMD 101 includes a foam member 121, which can be used to cushion the head when the light-tight case 140 is worn on the head. The HMD 101 can include a set of cameras that can be used to capture visual information, a set of microphones that capture auditory information, an orientation sensor that captures the orientation of the attachment device relative to the floor, etc. The set of cameras of the HMD 101 can include outward-facing cameras 151-154 that capture visual information of the environment surrounding the HMD 101. The set of cameras of the HMD 101 can also include an inward-facing camera that captures eye-related information such as the position or orientation of the eyes. The HMD 101 can include additional cameras not shown in FIG. 1A or 1B. In some embodiments, the set of outward-facing cameras of the HMD can be adjacent to the transparent lens of the HMD. Furthermore, as used in this disclosure, these cameras can be on either side of the transparent lens by being symmetrical to each other about the sagittal plane 191. For example, outward-facing camera 151 may be on the opposite side of the clear lens from outward-facing camera 154 .
[0015]
[0020] As shown in FIG. 1B , light-tight housing 140 includes cavity 124. When the subject's head is wearing HMD and accessory system 100, the subject's face may cover cavity 124 such that light is shielded from cavity 124. In some embodiments, the lenses of the HMD may be positioned inside cavity 124 such that light from an external source is blocked from inside cavity 124 and does not enter the lenses of the HMD. Light-tight housing 140 may shield light from the cavity by forming a light seal using a lip 160 of light-tight housing 140, which may be constructed from a plastic material such as a plastic polymer. As used in this disclosure, a light source may include a direct source of light (such as the sun, a light bulb, a light-emitting diode (LED), etc.). A light source may also include an indirect source of light (such as a mirror or reflection from a surface).
[0016]
[0021] Light-tight housing 140 includes multiple apertures 141-144 and may include additional apertures not shown in FIG. 1A or 1B . Multiple apertures 141-144 may be aligned with light-tight housing 140 so that outward-facing cameras 151-154 of HMD 101 can capture images or other types of information through apertures 141-144. As used in this disclosure, an aperture may be considered aligned with a camera if the camera can acquire images or other visual data through the aperture. Furthermore, an aperture may be aligned with multiple cameras if the aperture is large enough so that each of the multiple cameras can capture visual information through the aperture. For example, apertures 142-143 may be replaced by a single aperture such that outward-facing cameras 152-153 are aligned with the single aperture. Additionally, although not shown, light-tight housing 140 may include a second microphone aperture symmetrical to microphone aperture 182 about sagittal plane 191. Further, the light-tight casing 140 may include a microphone opening 182, through which a microphone 183 of the HMD 101 may record audio from the surrounding environment of the HMD 101. Additionally, while the light-tight casing may be described with three openings, light-tight casings having other numbers or configurations of openings are possible. For example, the light-tight casing may include one opening, two openings, three openings, four or more openings, other numbers of openings, etc. For example, the light-tight multiple openings may include at least six openings, and at least one of the six openings may be configured to align with a microphone or other audio recording device.
[0017]
[0022] When the light-tight case 140 is positioned to enclose the HMD, the holes 141-144 allow the HMD's cameras to capture peripheral visual or other information while still blocking light from one or more lenses of the HMD. By allowing the HMD's cameras, microphones, or other sensors to remain functional while the HMD is enclosed by the light-tight case 140, the HMD may be able to perform operations that rely on data from the sensors while still shielding the wearer's eyes from unwanted light. In some embodiments, the HMD and accessory system 100 may be used as a dark adaptation testing device. For example, the HMD 101 may collect visual information via outward-facing cameras 151-154 while partially within the light-tight case 140 to determine the HMD's position during dark adaptation testing without affecting the light perceived by the wearer of the HMD 101.
[0018]
[0023] The attachment body 110 is secured to the front end (i.e., forward end) of the light-tight case 140 so that the rear end (i.e., back end) of the attachment body 110 faces the cavity 124. Then, when the light-tight case 140 fits over the HMD, the LEDs of the attachment body 110 may emit light. The light may pass through the lenses of the HMD and be visible to the eye. In some embodiments, the attachment body 110 may be detachable from the light-tight case 140. Alternatively, the attachment body 110 may be permanently secured to the light-tight case 140. In some embodiments, the front end of the light-tight case 140 may be shaped such that light is shielded from the cavity formed by the light-tight case 140 without the need for the attachment body 110 to be attached to the light-tight case 140.
[0019]
[0024] The attachment body 110 includes a middle portion 112, which is positioned over the nasal protrusion 130 of the light-tight case 140. The middle portion 112 may be thinner along the vertical axis of the attachment body 110 compared to the left or right sections of the attachment body 110. The nasal protrusion 130 may include an opening 131 toward the bottom of the HMD and accessory system 100, and a person's nose may fit inside the nasal protrusion 130. In some embodiments, the nasal protrusion 130 may include a non-rigid member 132, such as a foam member or an elastic member. The non-rigid member 132 may block light from reaching the cavity 124 through the opening 131.
[0020]
[0025] Although attachment body 110 and light-tight housing 140 are shown as symmetrical with respect to sagittal plane 191, other embodiments are possible. For example, some embodiments may include a set of openings on the left section of light-tight housing 140 while having no openings on the right section of light-tight housing 140. Alternatively, some embodiments may include an attachment body that is asymmetric in shape or that can fit into the light-tight housing in an asymmetric manner.
[0021]
[0026] In some embodiments, attachment body 110 and light-tight housing 140 may be physically separate components. Alternatively, in some embodiments, attachment body 110 and light-tight housing 140 may be part of a unitary structure or may be otherwise fused thereto. Furthermore, while lip 160 may be a flexible polymer in some embodiments, lip 160 may include alternative materials, or may include additional materials in other embodiments. For example, lip 160 may be made of or otherwise include a foam cushion, a rigid material, or the like.
[0022]
[0027] FIG. 2 is a diagram of an attachment body of an attachment device according to one or more embodiments. The rear end of the attachment body 200 is shown with attachment members 221-226, which can secure the attachment body to a light-tight case at multiple attachment positions. As used in this disclosure, attachment member can include any item or combination of items used to attach one object to another at each attachment position. Attachment members can include threaded members such as screws, bolts, nuts, male coupling members, female coupling members, etc. Additionally, some embodiments can use more than one type of attachment member. For example, attachment members 221-224 can include screws, and attachment members 225-226 can include bolts. Various other types of coupling mechanisms or materials can be used. For example, attachment members 221-226 can include snap fasteners, adhesives, solder, other metals, etc.
[0023]
[0028] The attachment body 200 may include a first LED 231 and a second LED 232. The attachment body 200 may also at least partially enclose a controller circuitry 250, which is in electrical communication with the LEDs 231-232. The controller circuitry 250 may include an integrated circuit, microprocessor, microcontroller, or other circuitry for controlling the operation of the LEDs 231-232. The attachment body 200 may also include an interface 252, through which a computing device may send commands to and receive data from the controller circuitry 250. For example, the interface 252 may include a wireless network antenna such that the controller circuitry may receive commands to activate or deactivate the LEDs 231-232 via wireless messages received by the interface 252. The first and second LEDs may be positioned at a rear end of the attachment body 200, which may be secured to a front end of the light-tight case.
[0024]
[0029] Each of the first LED 231 and the second LED 232 may be part of a panel of LEDs or a separate collection of LEDs. For example, the first LED 231 may be surrounded by other LEDs to form a first set of LEDs. The second LED 232 may be surrounded by other LEDs to form a second set of LEDs. The first LED 231 and the second LED 232 may be approximately symmetrical about the sagittal plane 291 of the attachment body 200. As used in this disclosure, a first item may be approximately symmetrical to a second item about a point, line, or plane if the distance from the edge of the first item to the point, line, or plane is within 25% of the distance from the edge of the second item to the point, line, or plane. In some embodiments, the distance between the first LED 231 and the second LED 232 may be determined based on an approximation of the distance between two retinas. With respect to a person's head, the distance between the first LED 231 and the second LED 232 can be 40 millimeters (mm) or more, 50 mm or more, 60 mm or more, or some other value or more. For example, the distance between the first LED 231 and the second LED 232 can be 45 mm, 50 mm, 55 mm, 60 mm, 62 mm, 65 mm, or some other value. Furthermore, the LEDs 231-232 can be configured to illuminate the eye to meet illumination area size requirements. For example, the LEDs can be configured to illuminate a region of the eye such that at least one arc of the illuminated region has a larger arc size, such as 1 degree, greater than 1 degree, 2 degrees, greater than 2 degrees, etc.
[0025]
[0030] The first and second LEDs 231-232 are positioned at a location below the transverse plane 292 of the attachment body 200. The location of the first and second LEDs 231-232 may be advantageous for some types of bleaching operations, such as bleaching operations that target the inferior visual meridian of the eye. While the first and second LEDs 231-232 are below the transverse plane 292, other embodiments may include an attachment body with one or more LEDs above the transverse plane of the attachment body. An LED above the transverse plane of the attachment body may be more suitable for illuminating the superior visual meridian of the eye.
[0026]
[0031] The attachment body 200 may also include safety circuitry 260, which may also be in electrical communication with the LEDs 231-232. In some embodiments, the safety circuitry 260 may be simpler than the controller circuitry 250 in terms of the number of circuit components or the capabilities of each circuit component. The safety circuitry 260 may operate independently of the controller circuitry 250 and may be configured to deactivate the LEDs 231-232 under certain conditions. In some embodiments, such conditions may relate to overexposure to bleaching light. As used in this disclosure, bleaching light is light having sufficient intensity ("bleaching intensity") to bleach the photoreceptors of the eye such that vision in the eye is temporarily impaired or eliminated. For example, the LEDs may emit bleaching light by emitting at a light output above a bleaching threshold, which may be greater than 1000 lumens (e.g., 1200 lumens, 1300 lumens, 1400 lumens, etc.).
[0027]
[0032] The safety circuitry may include a set of relays for deactivating the LEDs 231-232 when the set of LEDs emits a bleaching light for a duration threshold. Alternatively or additionally, the safety circuitry may include a microcontroller configured to deactivate the set of LEDs based on a determination that the set of LEDs has emitted a bleaching light for the duration threshold. The duration threshold may vary based on testing, patient biology, or other factors and may be greater than 1 second, greater than 3 seconds, greater than 5 seconds, greater than 10 seconds, etc. For example, some embodiments may set the duration threshold equal to 6 seconds or some other duration less than 10 seconds.
[0028]
[0033] Safety circuitry 260 may inhibit over-bleaching in various ways. In some embodiments, safety circuitry 260 may be configured such that LED power consumption can be used as a threshold to determine whether bleaching light is being generated by a set of LEDs. For example, safety circuitry 260 may be configured to deactivate first LED 231 if the power consumption of LED 231 exceeds a threshold and is maintained for a duration threshold. Such operation may be useful when first LED 231 operates as a variable brightness LED capable of emitting both bleaching and non-bleaching light, and the brightness of first LED 231 may depend on the amount of power provided to first LED 231.
[0029]
[0034] Although safety circuitry 260 is shown as a single unit in electrical communication with both first LED 231 and second LED 232, other embodiments may include multiple safety circuitry that are independent of each other and connected to different sets of LEDs. For example, the attachment body may include first safety circuitry connected to the first set of LEDs and second safety circuitry connected to the second set of LEDs, and controller circuitry may be connected to and capable of controlling both the first and second sets of LEDs.
[0030]
[0035] Alternatively, the safety circuitry 260 may be configured to account for LEDs that emit a bleaching light by default. For example, the first LED 231 may be constructed such that activation of the first LED 231 is sufficient to generate a bleaching light. The safety circuitry 260 may be configured to account for such types of LEDs by deactivating the first LED 231 based on a determination that the first LED 231 has current passing through it for a duration longer than the duration threshold. Furthermore, instead of measuring power directly, the safety circuitry may receive measurements from a brightness sensor that indicate whether the first LED 231 is emitting a bleaching light. In some embodiments, the first LED 231 may be deactivated based on a set of readings provided by the brightness sensor that indicate that the first LED 231 is emitting a bleaching light for a duration longer than the duration threshold.
[0031]
[0036] In some embodiments, one or more LEDs on the attachment body may be movable along one or more directions. For example, a first LED 231 may be slidable horizontally along a set of tracks 241 and vertically along a set of tracks 242. Similarly, a second LED 232 may be slidable horizontally along a set of tracks 243 and vertically along a set of tracks 244. In some embodiments, the movable LEDs may be moved directly (e.g., by applying a force to the LEDs). Alternatively, some embodiments may include a lever or other mechanism for reconfiguring the position of one or more LEDs on the attachment body.
[0032]
[0037] 3 depicts an HMD and accessory system used in conjunction with a computer system according to one or more embodiments. A subject 395 may wear an HMD 301, which may include a computing device 307, which may include a processor, microprocessor, controller, or other circuitry. In some embodiments, the subject's eye 396 may be able to see light provided by a light source 399 through a lens 370 of the HMD 301 when the lens 370 is not within the accessory device 302, which may include a light-tight case 340 and an attachment body 310. The HMD 301 may include an inward-facing camera for capturing eye-related information and a set of outward-facing cameras, including an outward-facing camera 382.
[0033]
[0038] In some embodiments, accessory device 302 may be placed on top of HMD 301. Light-tight case 340 may include a cavity 324 that may contain a portion of HMD 301 such that lens 370 is within cavity 324. Additionally, light-tight case 340 may include a neutral density filter 334. Neutral density filter 334 may be secured to light-tight case 340 via filter coupler 333.
[0034]
[0039] When light-tight case 340 is positioned over HMD 301, light from light source 399 may be blocked from lens 370 by light-tight case 340. However, opening 342 may allow outward-facing camera 382 to continue capturing visual information from the surroundings. For example, outward-facing camera 382 may continue to read light information from light source 399 via light passing through opening 342 from the outside.
[0035]
[0040] The attachment body 310 includes an LED 332, which may emit bleaching light, and the bleaching light may be light having a spectrum and irradiance such that the retina is bleached. For example, the LED 332 may emit bleaching light having a wavelength or set of wavelengths within the visible spectrum of the human eye (i.e., wavelengths between 380 nm and 700 nm). Various types of wavelength spectra may be used as bleaching light. For example, the bleaching light may include light having a spectrum centered at 550 nm, which is longer than the bleaching threshold. The bleaching threshold may represent a threshold luminous intensity such that light having a luminous intensity higher than the threshold may be considered sufficient bleaching light to bleach the photoreceptors. For example, the bleaching light may have a luminous intensity of 1.0×10 4 cd / sm 2 is equal to 1.0 x 10 4 cd / sm 2 Higher, 1.0 x 10 5 cd / sm 2 is equal to 1.0 x 10 5 cd / sm 2 , or some other value (1.8×10 4 cd / sm 2 ) may have a higher luminosity than
[0036]
[0041] In some embodiments, a user may initiate an eye-related test by using a computing system 380 in communication with the HMD 301 and an attachment device including the attachment body 310 and the light-tight case 340. The computing system 380 may include a standalone computer capable of operating without connecting to another computing device outside of a local network. Alternatively, or in addition, the computing system 380 may include a computing system that receives program instructions or required data from an external data source that is not available over the local network.
[0037]
[0042] In some embodiments, the computing system 380 may initiate an operation to perform a dark adaptation test or another eye-related test. The computing system 380 may communicate with the HMD 301 via a wireless or wired connection. For example, the computing system 380 may send a wireless message to the computing device 307 to initiate a dark adaptation test or another vision test. Similarly, the computing system 380 may communicate with the light-tight case 340 or the attachment body 310 via a wired or wireless connection. For example, the computing system 380 may send a command to the attachment body 310 via a Bluetooth® connection, which may cause the attachment body 310 to activate the LED 332.
[0038]
[0043] In some embodiments, the computing system 380 may communicate with both the HMD 301 and the attachment body 310 to perform one or more operations. For example, the HMD 301 may present an initial set of commands to the subject 395 and request a response from the subject 395. After the subject 395 provides the requested response (e.g., pressing a button, making a statement, etc.), the computing system 380 may send a first set of instructions to the HMD 301 to calibrate the readings to more accurately measure eye-related data related to the eye 396. After the HMD 301 sends a message to the computing system 380 that the calibration operation is complete, the computing system 380 may send an instruction to the attachment body 310 to emit a bleaching light. The computing system 380 may determine the location of the fixation point based on the eye-related readings and the known position of the LED 332 and send a message to the HMD 301 to cause the HMD 301 to display a visual stimulus at the fixation point on the lens 370. After receiving a message from the HMD 301 that the eye 396 has set its gaze to a fixation point, the computing system 380 may send a message to the attachment body 310 causing the attachment body 310 to emit a bleaching light using the LED 332.
[0039]
[0044] In some embodiments, an application executed by the computing device 307 of the HMD 301 may be used to control the operation of components or other electronic components of the attachment body 310. For example, the application executed by the computing device 307 may initiate a vision test program and send a wireless message to the circuitry of the attachment body 310 to activate the LED 332 by using the wireless headset communication subsystem 303. The wireless message may be based on one of various types of communication standards, such as the Bluetooth standard, the Wi-Fi Direct standard, the near field communication (NFC) standard, the ZigBee standard, the 6LoWPAN standard, etc.
[0040]
[0045] In some embodiments, an application executed by computing device 307 may retrieve data from inward-facing camera 383 and send instructions to control LED 332 based on this data. For example, computing device 307 may execute an application to implement a Viola-Jones object detection framework to detect eyes in a set of images by using a boosted feature classifier based on video data provided by inward-facing camera 383. In some embodiments, the application may determine a size associated with the eyes and determine whether this size meets a minimum threshold. For example, computing device 307 may detect pupil size based on images collected by inward-facing camera 383 and use a set of classifiers to determine whether the pupil size meets a threshold. In response to determining that the pupil size meets the threshold, computing device 307 may activate LED 332 by sending a wireless message to attachment body 310 via wireless headset communication subsystem 303. After receiving the wireless message from the computing device 307, the circuitry 311 of the attachment body 310 may activate the LED 332 based on the parameters of the wireless message. Additionally, the application executed by the computing device 307 may enable additional sensor data to trigger activation of the LED 332, such as by receiving voice commands captured from the microphone 381 and movement detected by the outward-facing camera 382, by sensing a set of contacts on the body of the HMD 301, etc.
[0041]
[0046] In some embodiments, the computing device 307 may modify instructions to the LED 332 based on the detected pupil size. For example, the computing device 307 may reduce the intensity of light emitted by the LED 332 in response to detecting a larger pupil size. For example, the computing device 307 may send a first message to the attachment body 310 to cause the LED 332 to emit light with a greater intensity if the pupil size is less than 4 mm, and to emit light with a lesser intensity if the pupil size is greater than 4 mm. Further, some embodiments may determine that the pupil is insufficiently bleached based on data provided by the inward-facing camera 383 and extend the emission period of the LED 332. Alternatively or additionally, the LED 332 may be part of an LED panel so that more LEDs can be activated for smaller pupil sizes. Furthermore, some embodiments may use a function that indicates a negative correlation between pupil size and the amount of light from the LED 332 or an LED panel that includes the LED 332. For example, some embodiments may use a function L=(K 1-r )*K2" may be used, where L is the luminous intensity, "K1" is a first constant, "r" is the retinal size, and "K2" is a second constant. Some embodiments may dynamically determine the current used to activate LED 332 or the total number of LEDs to activate the bleaching operation based on the calculated luminous intensity "L".
[0042]
[0047] In some embodiments, a test application executed by the computing device 307 may detect that the subject 395's gaze location is focused on a target user interface (UI) element or that the subject is looking in a target direction based on data collected by the inward-facing camera 383. In response, the application may send a command to the attachment body 310 to activate the LED 332. For example, the HMD 301 may display a set of commands that cause the subject 395 to look at the target UI location. In some embodiments, the target UI location may be represented by a target area associated with the target UI location, such that a gaze location determined to be within the target area is considered focused on the target UI location. In response to determining that the gaze location of the eye 396 is focused on the target UI location based on images provided by the inward-facing camera 383, the application may activate the LED 332. Additionally, the application may send another message to the attachment body 310 to turn off the LED 332 based on a determination that the target UI location is no longer the focus of the user's gaze. Alternatively, some embodiments may forgo waiting for the subject 395 to focus on a particular UI location or direction before activating the LEDs 332. Some embodiments may determine the gaze location or direction of the eye 396, determine a subset of the set of LEDs that is close to the gaze location or direction, and activate this subset of LEDs to bleach or stimulate the eye 396.
[0043]
[0048] Some embodiments may perform a calibration operation to determine LED intensity, the number of LEDs to activate, activation duration, or another LED operating parameter. For example, some embodiments may obtain feedback from the subject 395 after an initial test session indicating that the LED intensity was too unfavorable. Based on the feedback, some embodiments may then adjust the amount of current through the LEDs 332 during subsequent test sessions by having the user reduce the total current. Some embodiments may further combine the subject's feedback with other feedback to update the default set of parameters sent by the computing device 307 when activating other subjects' LEDs 332.
[0044]
[0049] The application may then send a second message to the circuitry to deactivate LED 332 after a predetermined bleaching duration threshold has been met. Alternatively or additionally, the application may be triggered by a user command (e.g., a button press, a voice command, etc.) or in response to sensor data (e.g., sensor data captured by outward-facing camera 382) to activate or deactivate the bleaching light. Further, sensor data captured by inward-facing camera 383 of computing device 307 may cause computing device 307 to send a message to circuitry in attachment body 310. For example, an application executed by computing device 307 may determine that the user's eyes are closed or not bleaching properly based on a set of images captured by inward-facing camera 383, and in response activate LED 332 or extend the period of activation of LED 332.
[0045]
[0050] FIG. 4 is a flowchart of operations for conducting a dark adaptation test using an accessory device according to one or more embodiments. Some embodiments may obtain a set of eye readings as indicated by block 404. Various types of eye-related readings may be collected from the eye using multiple sensors. Eye-related readings may include an image of the eye, eye color, brightness of a section of the eye, or other information that may be captured by a camera or another type of sensor. Additionally, such readings may be processed to determine other types of eye-related information (such as pupil size or another size measurement of one or more features of the eye, color of one or more features of the eye, eye orientation, etc.). For example, some embodiments may collect and process eye-related readings to determine eye-related information such as the angle of the eye relative to the eye's focal point and a reference direction (horizontal or vertical), etc. Other eye-related readings may include retinal infrared light reflectance measurements, other light reflectance measurements, motion sensor readings, etc. As described elsewhere in this disclosure, some embodiments may determine the position of the eye relative to an illumination component, such as an LED. Some embodiments may continue to measure eye-related data throughout an operation, and, as described elsewhere in this disclosure, some embodiments may adjust one or more parameters of the operation in response to the measurements.
[0046]
[0051] In some embodiments, sensors used to measure eye-related data may be attached to the HMD. For example, the HMD may include a set of inward-facing cameras to measure eye responses to stimuli. Alternatively or additionally, sensors used to measure eye-related data may be attached to a light-tight case or attachment body. For example, a light-tight case enclosing a portion of the HMD may include an infrared camera or another type of sensor for measuring eye-related information.
[0047]
[0052] Some embodiments may present a visual stimulus for fixation of gaze, as indicated by block 412. Some embodiments may present the visual stimulus throughout the course of the test motion. For example, some embodiments may present a circular shape with a diameter of 1 degree at a predetermined fixation location.
[0048]
[0053] Some embodiments may determine the location of the visual stimulus designed for fixation based on the eye-related readings described with respect to block 404. For example, some embodiments may use the eye-related readings to determine a fixation position that will cause the eye, fixed in the fixation position, to be a predetermined number of angles from the LED or within a predetermined range from the LED. The predetermined number of angles or predetermined range may vary based on the particular application or type of movement. For example, some embodiments may determine the fixation position such that the visual stimulus location is 6 degrees above the bleaching location. In such a configuration, the bleaching LED may provide bleaching light centered 6 degrees on the lower visual meridian of the eye. Some embodiments may then display the visual stimulus at a fixed location on the lenses of the HMD or otherwise present the visual stimulus on a surface that can be viewed through the lenses of the HMD.
[0049]
[0054] Some embodiments may generate a warning if a sensor detects that the eye has crossed a threshold for the angular distance between its gaze and a fixation point. For example, some embodiments may determine that the eye has shifted its focus from a fixation point by more than 30% based on sensor measurements obtained from a sensor in an HMD, and in response, present a warning by using the HMD.
[0050]
[0055] Some embodiments may adjust the stimulus luminance based on measurements while the stimulus is being presented. For example, some embodiments may continuously measure the pupil radius. Some embodiments may then determine a new stimulus luminance by multiplying the predetermined luminance of the stimulus by a factor that is inversely proportional to the pupil radius or a function that is directly correlated with the pupil radius. For example, some embodiments may multiply the predetermined luminance by the value 2 / x 2where "x" may be the value of the pupil radius in millimeters.
[0051]
[0056] Some embodiments may present a bleaching light as directed by block 428. As described elsewhere in this disclosure, some embodiments may send a message to a device that includes the bleaching light (such as an attachment body that includes LEDs capable of emitting the bleaching light). The attachment body may include controller circuitry that may cause the LEDs to emit the bleaching light and may further determine which subset of LEDs in the set of LEDs to activate. The LEDs may be caused to emit a bleaching light that is at least 4 degrees in diameter on the surface of the retina.
[0052]
[0057] Some embodiments may combine the brightness of the HMD with light emitted from the LED of the attachment body to generate a white light. For example, some embodiments may use the HMD to display a first light on the lens. Then, some embodiments may activate the LED of the attachment body, and the light from the LED and the HMD may combine to form the white light. For example, some embodiments may determine that the eye is fixed in a first position and further determine that the LED of the attachment body will illuminate at a horizontal angle 6 degrees below the eye. In response, some embodiments may display the light by using the HMD at a horizontal angle 6 degrees below the eye, such that the light from the LED and the light displayed by the HMD are aligned with the center of the eye.
[0053]
[0058] In some embodiments, the device used to provide the bleaching light may include multiple LEDs capable of emitting bleaching light. Some embodiments may then determine which of the multiple LEDs to activate to most effectively bleach the retina. For example, some embodiments may determine that the fixation position is at a predetermined location and, in response, select an LED that is at least 6 degrees below the fixation position. After activation, the selected LED may emit the bleaching light.
[0054]
[0059] Some embodiments may determine whether the bleaching light duration satisfies a set of deactivation criteria, as indicated by block 432. In some embodiments, the attachment body used to emit the bleaching light may include safety circuitry to prevent unsafe durations of the bleaching light. The safety circuitry or computing device may include a set of deactivation criteria to prevent the device from emitting the bleaching light and thereby prevent the emission of unsafe amounts of bleaching light. In some embodiments, satisfying the set of deactivation criteria may include satisfying a threshold, which may be a duration threshold, a power consumption threshold, or the like. In many cases, the bleaching light may be deactivated if the device emits the bleaching light for longer than the duration threshold.
[0055]
[0060] Some embodiments may use safety circuitry that is in electrical communication with the LEDs but operates independently of the controller circuitry or other circuitry used to control the LEDs. The safety circuitry may include various types of electronic components, such as a relay or a microcontroller, that may be configured to deactivate the LEDs. The electronic components of the safety circuitry may be configured to determine that the bleaching light duration has exceeded a duration threshold in response to determining that the LEDs have been provided with at least a predetermined amount of power for at least the duration threshold. For example, some embodiments may use a microcontroller in the safety circuitry to determine whether a set of LEDs has consumed enough power to exceed a power threshold. The power threshold may be 0.001 watts (W), greater than 0.001 W, 0.1 W, greater than 0.1 W, or some other value. In response to determining that the set of LEDs has a power consumption that satisfies a power threshold (e.g., by being greater than the power threshold, by being equal to or greater than the power threshold, etc.), some embodiments may determine that the light emission period of the set of LEDs satisfies a duration threshold (e.g., by being greater than the duration threshold, by being equal to or greater than the duration threshold, etc.). In some embodiments, the duration threshold may be 0.01 seconds, a value less than 0.01 seconds, 1 second, a value less than 1 second, 5 seconds, a value less than 5 seconds, 6 seconds, a value less than 6 seconds, 10 seconds, a value less than 10 seconds, etc.
[0056]
[0061] In some embodiments, the operation for determining whether a set of LEDs should be deactivated may be performed by other circuitry or a computing device separate from the attachment body. For example, the attachment device may include safety circuitry that deactivates the LEDs if they are used for more than six seconds. The attachment device's controller circuitry may retrieve instructions from a computing system that cause the controller circuitry to deactivate the LEDs if they are used for more than one second.
[0057]
[0062] In some embodiments, the operation of determining whether the set of LEDs should be deactivated may include obtaining data from a sensor in the HMD or from another device that is physically separate from the attachment device. For example, the HMD may provide retinal size or measured rhodopsin content to a computer system, which may then determine whether the measurements provided by the HMD satisfy a set of deactivation criteria. If the computer system determines that the measurements provided by the HMD satisfy the set of deactivation criteria, the computer system may send a command to the attachment device circuitry to deactivate the LEDs of the attachment device. In response to a determination that the set of deactivation criteria is satisfied, operations of process 400 may proceed to block 436. Otherwise, operations of process 400 may proceed to block 450.
[0058]
[0063] Some embodiments may deactivate the device that emits the bleaching light, as indicated by block 436. As described elsewhere in this disclosure, the attachment device may include controller circuitry for controlling the activation or deactivation of the LEDs and may also include safety circuitry for deactivating the LEDs independent of instructions sent by the control circuitry. Further, some embodiments may send an error message or other indicator to the computing device that the safety circuitry has been activated to deactivate one or more LEDs. Additionally, some embodiments may identify stages in a multi-stage operation that require multiple iterations to achieve light emission.
[0059]
[0064] Some embodiments may perform a post-bleaching test operation as instructed by block 450. As described elsewhere in this disclosure, a bleaching operation may be used as part of a dark adaptation test. After bleaching the eye, some embodiments may display a visual stimulus (e.g., a flashing light) and wait for a subject's response indicating that the subject's photoreceptors have sufficiently recovered to perceive the visual stimulus. Alternatively, some embodiments may simultaneously display the flashing light and the bleaching light. For example, some embodiments may simultaneously display the flashing light on the HMD lenses while also using an LED to emit the bleaching light. After receiving the subject's response, some embodiments may record the duration between when the LED was prevented from displaying the bleaching light and when the subject responded. Some embodiments may then determine whether the duration satisfies a recovery threshold; a determination that the time required for the subject to respond is longer than the recovery threshold may indicate an eye-related or health condition.
[0060]
[0065] 5 is a flowchart of operations for performing a test with an HMD and accessory device system according to one or more embodiments. Some embodiments may execute an application on the HMD (as indicated by block 504). The HMD may include a set of processors and memory that stores program code, and the set of processors may execute the program code to run the application on the HMD. In some embodiments, the HMD may obtain the program code used to run the application or a portion of the program code via an online platform. For example, a user may access an online platform and select an application, which causes the HMD to download the application's program code via the online platform.
[0061]
[0066] In some embodiments, actions performed by an HMD may be performed by multiple applications corresponding to different sets of program code. For example, as described elsewhere in this disclosure, some embodiments may capture images with one set of cameras using a first application and process the images with a second application to determine pupil size or other eye-related information. While some embodiments may be described as performing actions by a single application, it should be understood that any action, combination of actions, or sub-action of an action may be performed by multiple applications. Furthermore, one or more actions described as being performed by an HMD may be performed by another computing device (such as another mobile computing device near the HMD, a remote computing device, etc.).
[0062]
[0067] In some embodiments, the HMD may be triggered by one or more stimuli (such as presenting a visual stimulus or sending a message that triggers a bleaching light) to perform other actions described in this disclosure. For example, some embodiments may configure the HMD with an application that causes the HMD to perform one or more actions described in this disclosure based on visual stimuli captured by a set of outward-facing sensors in the HMD. The visual stimuli may include images, luminance measurements, infrared measurements, etc. For example, an application running on the HMD may perform an action to generate a set of values representing target motion or target shape based on shape, motion type, or other information. Such information may be determined based on a set of images collected by the HMD's outward-facing cameras. Some embodiments may then determine whether the target motion, target shape, or other information satisfies a set of visual stimulus criteria. In response to determining that a set of visual stimulus criteria have been satisfied, some embodiments may initiate a test operation that causes the HMD to perform one or more of the operations described in this disclosure (such as collecting eye-related readings as described by block 508, determining eye-related information as described by block 512, determining whether a set of light activation criteria have been satisfied as described by block 532, etc.).
[0063]
[0068] Various types of applications, modules, services, etc. may be used to determine the presence of a particular shape, detect a certain type of motion, or perform other actions based on object recognition. For example, some embodiments may collect image data from an outward-facing camera and provide it to a machine learning application that detects the presence of a hand and may further determine the shape or orientation of the hand. After determining that the detected hand is to be controlled to exhibit a particular gesture, the application may cause the HMD to perform one or more actions described in this disclosure. For example, some embodiments may send a message to the accessory in response to detecting the gesture, causing the accessory to emit a bleaching light. Alternatively or additionally, some embodiments may capture images from the outward-facing camera of the HMD and determine a brightness value based on a set of images. In response to determining that the brightness value is below the brightness threshold, some embodiments may initiate a test operation, including one or more of the operations described by blocks 508, 512, 532, etc.
[0064]
[0069] In some embodiments, the HMD may be configured to wait for an audio stimulus and initiate a test operation in response to receiving the audio stimulus. The audio stimulus may be received by a microphone of the HMD and may require that the stimulus be received as a particular type of sound or sequence of sounds. Alternatively or additionally, some embodiments may treat the audio stimulus as a voice-activated stimulus and determine whether the audio stimulus satisfies one or more audio-related criteria. For example, some embodiments may determine whether a natural language processing application outputs a particular word or set of words when the audio stimulus is provided, regardless of whether the audio stimulus is provided by a particular user's voice, etc. After receiving the audio stimulus and determining whether the audio stimulus satisfies one or more associated audio stimulus criteria, some embodiments may initiate one or more operations described in this disclosure (e.g., operations described by block 508, block 512, block 532, etc.).
[0065]
[0070] Some embodiments may collect eye-related readings (as indicated by block 508) through a set of cameras or other sensors in the HMD. The eye-related readings may include images, such as images collected by a camera. For example, some embodiments may collect eye-related readings in a set of inward-facing cameras. In some embodiments, the HMD may collect other types of eye-related readings (such as reflectometry measurements, ellipsometry measurements, etc.). When collecting readings, some embodiments may collect a series of readings (such as collecting video of the eye over a duration).
[0066]
[0071] In some embodiments, the HMD may present visual stimuli to the eyes, causing the eyes to change their gaze and focus on the visual stimuli. Some embodiments may collect eye-related readings during the presentation of a series of visual stimuli. For example, some embodiments may present a series of dots on the HMD lenses for a 30-second duration and collect images of the eyes with an inward-facing camera during this 30-second duration. Some embodiments may acquire images of each set of eyes as each respective stimulus of the series is displayed on the HMD lenses. Some embodiments may then use this information to derive eye gaze locations and other types of eye-related information, as described elsewhere in this disclosure. For example, some embodiments may determine the gaze location of each respective stimulus presented on the HMD lenses. Some embodiments may activate a bleaching light in response to determining that the gaze location is focused on a target area. For example, some embodiments may set each target region of each stimulus to fall within a threshold range of the presentation location of each stimulus, where the threshold range may represent a linear distance, an angular distance, or the like.
[0067]
[0072] Some embodiments may determine pupil size or other additional eye-related information based on the set of eye-related readings, as indicated by block 512. Some embodiments may use the eye-related readings to determine additional eye-related information. The additional eye-related information may include information such as whether the eye is open or closed, a percentage representing the degree to which the eye is open, pupil size, eye color, eye orientation, other descriptors of the eye, a health condition related to the eye, a health condition of the person having the eye, etc.
[0068]
[0073] Some embodiments may determine eye-related information by using a set of classifiers in an application executed by the HMD. For example, some embodiments may perform some operations to detect image regions indicating the presence of eyes by providing the image to the set of classifiers. Some embodiments may then use a second set of classifiers or another set of implemented algorithms to determine pupil size based on the pixels of the image region. For example, some embodiments may perform edge detection method operations to first draw an image of an eye and a set of boundaries of eye components within the image region. Some embodiments may then determine pupil size based on the set of drawn boundaries. As described elsewhere in this disclosure, some embodiments may then determine whether the pupil size satisfies a threshold and, in response to determining that the pupil size satisfies the threshold, transmit a message to the attachment device using a transmitter of the HMD.
[0069]
[0074] Some embodiments may determine whether a set of photoactivation criteria is satisfied based on pupil size or additional eye-related information, as indicated by block 532. Some embodiments may wait until a set of photoactivation criteria is satisfied before sending a set of messages to the attachment device that cause the attachment device to emit a bleaching light. Alternatively or additionally, the set of photoactivation criteria may be divided into subsets of criteria, such that satisfaction of different subsets may trigger transmission of different sets of messages. For example, some embodiments may send a first set of messages to the attachment device based on determining that a first subset of criteria is satisfied, and send a second set of messages to the attachment device based on determining that a second subset of criteria is satisfied.
[0070]
[0075] In some embodiments, the set of photoactivation criteria may include a criterion that the pupil size is greater than a minimum threshold, and the minimum threshold may include a value of 10 mm or less, a value of 5 mm or less, a value of 3 mm or less, a value of 1 mm or less, etc. For example, the minimum threshold may be equal to 5 mm, and some embodiments may determine that "the set of photoactivation criteria is satisfied if the determined pupil size is greater than 5 mm." Alternatively, the minimum threshold may be equal to 4 mm, and some embodiments may determine that the set of photoactivation criteria is satisfied if the determined pupil size is greater than 4 mm.
[0071]
[0076] In some embodiments, the set of light activation criteria may include multiple criteria that each must be satisfied for a set of light activation messages to be transmitted by the HMD. For example, some embodiments may use a set of criteria that includes a first criterion that the pupil size is greater than 4 mm and a second criterion that the eye gaze location is focused on a specific display location of the HMD. Some embodiments may then transmit a set of light activation messages based on a determination that both the first criterion and the second criterion are satisfied. Although the above example discloses a set of light activation criteria having two criteria, other numbers of criteria are possible for inclusion in a set of light activation criteria.
[0072]
[0077] If a set of photoactivation criteria is satisfied by the pupil size or other eye-related information, operations of process 500 may proceed to operations described by block 540. Otherwise, operations of process 500 may return to operations described by block 504.
[0073]
[0078] Some embodiments may transmit a set of messages to the attachment as instructed by block 540. Some embodiments may transmit the set of messages wirelessly via a communication protocol such as Bluetooth, 2.4 GHz Wi-Fi, 5.0 GHz Wi-Fi, or some other wireless communication protocol. In some embodiments, the set of wireless messages may be the same as other sets of wireless messages transmitted from the HMD to the attachment device. For example, in response to determining that a threshold amount of eyes is open at a first time point, some embodiments may transmit a first set of messages that cause the attachment device to emit a bleaching light. Then, some embodiments may transmit the same set of messages to the attachment device in response to determining that the threshold amount is met at a second time point.
[0074]
[0079] Alternatively, some embodiments may send different sets of messages based on which subset of criteria is satisfied by the eye-related information. For example, some embodiments may determine a first pupil size based on a first set of eye-related readings and determine that the first pupil size is smaller than a size threshold. Based on determining that the first pupil size is smaller than the first threshold, some embodiments may generate or update the first set of messages to include a first value in a parameter field. Some embodiments may then send the first set of messages to the attachment device, where the first value in the parameter field may cause the attachment device to emit a first bleaching light at a first intensity for a first duration. Some embodiments may then determine a second pupil size based on a second set of eye-related readings and determine that the second pupil size is greater than the size threshold. Based on a determination that the pupil size is greater than the size threshold, some embodiments may generate or update the second set of messages to include a second value that causes the attachment device to emit a second bleaching light having an intensity less than the first bleaching light. Some embodiments may modify the duration instead of the intensity of the bleaching light based on the message sent by the HMD. Alternatively, some embodiments may modify both the duration and intensity of the light emitted by the attachment device based on a set of messages sent from the HMD.
[0075]
[0080] Some embodiments may determine parameter values used to control LED operation based on a set of user-provided values. For example, some embodiments may receive a user-provided value indicating that the bleaching time was too unfavorable, where the user-provided value may be provided via a user interacting with a physical button, interacting with a display on an HMD, providing verbal input, etc. In response to receiving the user-provided value, some embodiments may update a configuration parameter and then generate a new message based on this configuration parameter to include a parameter value controlling the duration or intensity of light emission by the set of LEDs. For example, a user may press a button that updates a configuration parameter used to determine light emission intensity. In response to receiving the user-provided value, some embodiments may decrease the value of the configuration parameter by 1 (e.g., by decreasing the value of the configuration parameter from “1.00” to “0.90”), where the value represents a normalized intensity. Some embodiments may then generate a new message including the configuration parameter “0.90,” where the value of the configuration parameter causes the attachment device to emit light by the set of LEDs with an intensity equal to 90% of the set of LEDs’ maximum intensity.
[0076]
[0081] Some embodiments may determine which parameter values to use for a set of messages used to activate a set of LEDs based on a selection of a test category, where the test category may represent various types of test configurations. For example, some embodiments may receive a first user-selected input indicating a selection of a first dark adaptation test operation. Then, some embodiments may send to the attachment a first set of messages including parameters that cause the attachment to activate a first LED subset of LEDs. Then, some embodiments may receive a second user-selected input indicating a selection of a second dark adaptation test operation. Then, some embodiments may send to the attachment a second set of messages including parameters that cause the attachment to activate a second LED subset of LEDs that is different from the first set of LEDs. In some embodiments, the first LED subset and the second LED subset may emit light at different wavelengths. For example, a first subset of LEDs may emit light at a wavelength centered at 480 nanometers (nm), and a second subset of LEDs may emit light at a frequency centered at 520 nm. By allowing select subsets of LEDs to be activated, some embodiments may achieve specific types of bleaching that do not require total bleaching of the eye's photoreceptors.
[0077]
[0082] Some embodiments may activate a set of LEDs on the attachment in response to receiving the set of messages (as indicated by block 544). As described elsewhere in this disclosure, the set of LEDs may be part of an accessory or attachment to the HMD, and circuitry on the accessory or other attachment to the HMD may control the set of LEDs. In some embodiments, the circuitry on the attachment may receive the set of messages transmitted by the HMD via a wireless receiver on the circuitry, and the circuitry stores program instructions for controlling the set of LEDs based on the received set of messages. When activated, the set of LEDs may emit light at various intensities, including a whiteout intensity, and this emitted light may pass through a clear lens of the HMD.
[0078]
[0083] Some embodiments may receive different parameter values upon receiving different sets of messages to activate one or more LEDs. For example, circuitry in the attachment may configure the intensity of light emitted by a set of LEDs based on parameter values communicated via received messages sent from the HMD. Alternatively or additionally, the circuitry may configure the duration of the emitted light. As described elsewhere, the parameter values may be determined by the HMD based on various types of values, such as eye-related readings, other relevant eye-related information, user-provided values, etc.
[0079]
[0084] As described elsewhere, the attachment may include first and second circuitry, where the first circuitry may control a set of LEDs based on a received message, and the second circuitry may deactivate the set of LEDs if a set of safety criteria is met. In some embodiments, the second circuitry deactivates the set of LEDs and sends a warning message to the HMD indicating that the second circuitry has deactivated the set of LEDs if the message configures the set of LEDs to emit light for a period longer than the second circuitry's duration threshold. In some embodiments, the warning message may indicate that the configured duration exceeds the duration threshold, and an application running on the HMD may search for a set of configuration parameters used to set or otherwise update the LED emission duration. The HMD may then select a subset of the set of configuration parameters used to control the LED emission duration, where the selected subset exceeds the second circuitry's duration threshold. Some embodiments may then visually indicate this subset of configuration parameters for the user to update or delete. Alternatively, some embodiments may automatically update the values of this subset of configuration parameters such that none of the updated configuration parameters cause the set of LEDs to exceed a safe duration threshold.
[0080]
[0085] As described elsewhere, some embodiments may collect eye-related readings while a set of LEDs is emitting light. For example, a set of inward-facing cameras in the HMD may collect eye-related readings with the cameras during a data collection period, and a set of LEDs may emit bleaching light simultaneously with the data collection period. The HMD may determine a set of eye-related information based on the readings collected during the first data collection period and determine whether the eye-related information satisfies a set of criteria.
[0081]
[0086] Some embodiments may use readings collected during and after the first data collection period to determine whether to activate a set of LEDs, collect eye-related readings, or perform other actions during a second data collection period. For example, after collecting eye-related readings, some embodiments may collect images of the eye during the first data collection period and determine a related set of eye-related information indicative of the rate of eye pigment recovery after the eye is exposed to bleaching light. Some embodiments may then determine whether the rate of recovery satisfies a recovery rate threshold, where the recovery rate threshold may be a type of time-based criterion. The set of time-based criteria may include various types of criteria, such as a rate being greater than or equal to a minimum rate, a rate being less than or equal to a maximum rate, or a total change in the set of measurements or a total change in a derived value based on the set of measurements satisfying a change threshold. For example, satisfying the set of time-based criteria may include determining a rate of rhodopsin regeneration, a rate of cone pigment regeneration, or a rate of melanopsin regeneration based on sensor readings collected by the HMD and determining whether the rate is greater than a minimum rate. Alternatively or additionally, the rate may include a rate of change of pupil size or other accommodation mechanism of the eye. In response to determining that the set of time-based criteria is not satisfied, some embodiments may then initiate a second test operation to emit light from a set of LEDs on the attachment and collect a second set of eye-related readings during a second data collection period. In some embodiments, the HMD may determine whether the set of time-based criteria is satisfied based on the second set of eye-related readings. In response to determining that the second set of eye-related readings satisfy the set of time-based criteria, some embodiments may store the readings and information derived from the readings in persistent memory of the HMD or another computing device.
[0082]
[0087] It should be noted that features and limitations described in any one embodiment may be applied to any other embodiment herein, and that flowcharts or examples relating to one embodiment may be combined with any other embodiment in any suitable manner, performed in a different order, or performed in parallel. In addition, the systems and methods described herein may be performed in real time. It should also be noted that the above-described systems and / or methods may be applied to or used in accordance with other systems and / or methods.
[0083]
[0088] 6 is a block diagram of a computer system that may be used to implement features of some embodiments. Computer system 600 may include a set of central processing units ("set of processors") 605, memory 610, input / output devices 625 (e.g., keyboard, pointing device, touch device, display device), storage devices 620 (e.g., disk drives), and network adapters 630 (e.g., network interfaces), connected by interconnection wiring 615. Interconnection wiring 615 is shown as an abstraction representing any one or more separate physical buses, point-to-point connections, or both, connected by appropriate bridges, adapters, or controllers. Thus, the interconnect wiring 615 may include, for example, a system bus, a Peripheral Component Interconnect (PCI) bus or PCI Express bus, a HyperTransport or industry standard architecture (ISA) bus, a small computer system interface (SCSI) bus, a universal serial bus (USB), an IIC (12C) bus, or an Institute of Electrical and Electronics Engineers (IEEE) standard 1394 bus, also known as FireWire.
[0084]
[0089] Memory 610 and storage device 620 are computer-readable storage media that may store program instructions that implement at least a portion of various embodiments. Additionally, data structures and message structures may be stored or transmitted over data transmission media (e.g., signals over a communications link). Various communications links (e.g., the Internet, a local area network, a wide area network, a point-to-point dial-up connection) may be used. Thus, computer-readable media may include computer-readable storage media (e.g., non-transitory media) and computer-readable transmission media.
[0085]
[0090] In some embodiments, software or firmware may be initially provided to computer system 600 by downloading it from a remote system via computer system 600 (e.g., via network adapter 630). The provided software or firmware may be stored in memory 610. The program instructions stored in memory 610 may be implemented as software and / or firmware for programming set of processors 605 to perform the acts described above. For example, some embodiments may use set of processors 605 to determine a set of decision parameters by using a neural network model or another type of machine learning model.
[0086]
[0091] The various embodiments introduced herein may be implemented, for example, by programmable circuitry (e.g., one or more microprocessors) that are programmed by software and / or firmware, or by entirely dedicated hardwired (non-programmable) circuitry, or by a combination of such forms, which may be in the form of, for example, one or more ASICs, PLDs, FPGAs, etc.
[0087]
[0092] With respect to the components of the computing devices described in this disclosure, each of these devices may receive content and data via input / output (hereinafter "I / O") paths. Each of these devices may also include a processor and / or control circuitry for sending and receiving instructions, requests, and other suitable data using the I / O paths. The control circuitry may include any suitable processing, storage, and / or input / output circuitry. Additionally, some or all of the computing devices described in this disclosure may include a user input interface and / or a user output interface (e.g., a display) for use in receiving and displaying data. In some embodiments, a display, such as a touchscreen, may also serve as a user input interface. It should be noted that in some embodiments, one or more devices described in this disclosure may not have a user input interface or a display, but instead may receive and display content through the use of another device (e.g., a dedicated display device such as a computer screen, and / or a dedicated input device such as a remote control, mouse, voice input, etc.). Additionally, one or more of the devices described in this disclosure may execute an application (or another suitable program) that performs one or more operations described in this disclosure.
[0088]
[0093] While the present invention has been described in detail for purposes of illustration based on what are presently considered to be the most practical and preferred embodiments, it should be understood that such detail is for this purpose only, and that the present invention is not limited to the disclosed embodiments, but on the contrary, is intended to cover modifications and equivalent arrangements that are within the scope of the appended claims. For example, it should be understood that the present invention contemplates that, to the extent possible, one or more features of any embodiment can be combined with one or more features of any other embodiment.
[0089]
[0094] As used throughout this application, the word "may" is used in a permissive sense (i.e., meaning to have the possibility of) rather than a mandatory sense (i.e., meaning to have to). The word "comprise" and its conjugations, etc., mean including but not limited to. As used throughout this application, the singular indefinite and definite articles include plural references unless the context clearly dictates otherwise. Thus, for example, reference to "an element" or "an element" includes combinations of two or more elements notwithstanding the use of other terms and phrases of one or more elements ("one or more"). The term "or" is non-exclusive (i.e., includes both "and" and "or") unless the context clearly dictates otherwise. Terms describing conditional relationships (e.g., "in response to X, Y," "when X, Y," "if X, Y," "in the case of X, Y," etc.) encompass the following causal relations: the antecedent is a necessary causal condition, the antecedent is a sufficient causal condition, or the antecedent is a contributory causal condition of the outcome (e.g., "state X occurs when condition Y obtains" is a general expression of "X occurs only when Y occurs" and "X occurs when Y and Z occur"). Such conditional relationships are not limited to outcomes that immediately follow the obtaining of the antecedent, since some outcomes can be delayed; in conditional statements, the antecedent is linked to the outcome (e.g., the antecedent is related to the likelihood of a subsequent occurrence). A statement that "a plurality of attributes or functions are mapped to a plurality of objects (e.g., one or more processors performing steps / operations A, B, C, and D)" encompasses both all such attributes or functions mapped to all such objects, and a subset of attributes or functions mapped to a subset of objects (e.g., all processors each performing steps A and D, and both the case where processor 1 performs step / operation A, processor 2 performs step / operation B and part of step / operation C, and processor 3 performs step / operation C and part of step / operation D), unless otherwise indicated.Furthermore, unless otherwise indicated, a statement that one value or action is "based on" another condition or value encompasses both instances in which the condition or value is the only factor and instances in which the condition or value is one factor among multiple factors.
[0090]
[0095] Unless the context clearly dictates otherwise, a statement that "each" instance of a set has a certain property should not be read to exclude cases where some otherwise identical or similar members of the larger set do not have this property (i.e., "each" does not necessarily mean "every"). Restrictions on the order of listed steps should not be read into the scope of a claim unless expressly stated (e.g., by express language such as "do X, then do Y"), in contrast to statements that could be improperly argued to mean order restrictions (e.g., "do X on items, then do Y on items Xed") used for the purpose of making the claim easier to read rather than to prescribe an order. Statements referring to "at least Z of A, B, and C," and so on (e.g., "at least Z of A, B, or C") refer to at least Z of the listed categories (A, B, and C) and therefore do not require at least Z units within each category. It will be recognized from the discussion throughout this specification that, unless the context clearly dictates otherwise, the use of terms such as "processing," "computing," "calculating," "determining," and the like refers to the actions or processes of a particular apparatus, such as a special purpose computer or similar dedicated electronic processing / computing device. Furthermore, unless otherwise indicated, updating an item may include creating an item or modifying a time in existence. Thus, updating a record may include creating a record or modifying the value of a value already created.
[0091] Enumeration of Embodiments
[0096] The present technology will be better understood with reference to the following enumerated embodiments: A.1. A head-mounted display including a transparent lens and an outward-facing camera, the transparent lens and the outward-facing camera being on a front end of the head-mounted display, the outward-facing camera being adjacent to the transparent lens, and at least one pair of the outward-facing cameras being on either side of a vertical plane of the head-mounted display; and an accessory device positioned on the front end of the head-mounted display, the accessory device including a light-tight case, the light-tight case being a cavity that contains the transparent lens of the head-mounted display when the accessory device is attached to the head-mounted display, the light-tight case shielding the cavity from light from the head-mounted display's environment when the accessory device is attached to the head-mounted display. and an accessory device including a light-tight case including a cavity and a plurality of openings aligned with the outward-facing camera, and an attachment body secured to a front end of the light-tight case, the attachment body including a set of light-emitting diodes (LEDs) that emit light at a bleaching intensity, the set of LEDs mounted at a rear end of the attachment body and directed toward at least one of the transparent lenses, such that the light emitted by the set of LEDs is visible through the at least one of the transparent lenses, and circuitry at least partially enclosed within the attachment body and in electrical communication with the set of LEDs, the circuitry configured to control the light emission of the set of LEDs. A.2. The system of embodiment A.3, wherein the circuitry is controller circuitry and the attachment body further includes safety circuitry in electrical communication with the set of LEDs, the safety circuitry including a relay or microcontroller for deactivating the set of light-emitting diodes independently of the controller circuitry. A.3. A system described in any of embodiments A.1 to A.2, wherein the controller circuitry is configured to perform operations including: emitting a first light at a first intensity by a set of LEDs in response to receiving a first command via an interface of the circuitry, the first intensity being not a bleaching intensity; and emitting a second light at a second intensity by a set of LEDs in response to receiving a second command via the interface, the second intensity being a bleaching intensity. A.4. The system of any of embodiments A.1 to A.3, wherein the circuitry performs an operation including emitting a first light at a first intensity by a set of LEDs in response to receiving a first command via an interface of the circuitry, the first light being emitted simultaneously with the light emitted by the head-mounted display. A.5. The system of any of embodiments A.1 to A.4, further including a filter combiner and a neutral density filter fixed to the filter combiner, and the set of LEDs is directed toward the neutral density filter such that light emitted by the set of LEDs passes through the neutral density filter. A.6. The system of any of embodiments A.1 to A.5, wherein the plurality of apertures includes at least six apertures, and at least one aperture of the plurality of apertures is aligned with the microphone. A.7. A device comprising: a case including a cavity, such that when the device is attached to a head-mounted display, a lens of the head-mounted display is positioned inside the cavity and an opening in the case is aligned with an outward-facing camera of the head-mounted display; and an attachment body, a rear end of the attachment body secured to a front end of the case, the attachment body including: a set of light-emitting diodes (LEDs) attached to the rear end of the attachment body and directed toward the lens; and circuitry configured to control the light emission of the set of LEDs. A.8. The device of embodiment A.7, wherein the lens is a first lens; the attachment body includes an intermediate portion bisected by a sagittal plane of the attachment body; the intermediate portion is longer along the sagittal plane of the attachment body compared to the left section of the attachment body or the right section of the attachment body; the set of LEDs is a first set of LEDs; the second set of LEDs is mounted at the rear end of the attachment body and directed toward a second lens of the head-mounted display; the first set of LEDs and the second set of LEDs are approximately symmetrical about the sagittal plane; and the distance between the first set of LEDs and the second set of LEDs is 40 millimeters or more. A.9. A device described in any of embodiments A.7 to A.8, wherein the circuit configuration is a first circuit configuration and the second circuit configuration includes a microcontroller configured to perform operations including determining whether the power consumption of the set of LEDs satisfies a power threshold; determining whether the light emission duration of the set of LEDs satisfies a duration threshold in response to determining that the power consumption of the set of LEDs satisfies the power threshold; and deactivating the set of LEDs in response to determining that the light emission duration satisfies the duration threshold. A.10. The device of any of embodiments A.7 to A.9, wherein the set of LEDs is positioned below the cross section of the attachment body. A.11. The device of any of embodiments A.7 to A.10, wherein the attachment body is secured to the case at multiple attachment positions. A.12. The device of any of embodiments A.7 to A.11, wherein the attachment body is secured to the case by at least one of a threaded member, a snap fastener member, or an adhesive. A.13. A device of any of embodiments A.7 to A.13, wherein the opening is a first opening; the case includes multiple openings; the multiple openings are greater than three openings; and each respective opening of the multiple openings is aligned with at least one sensor of the multiple sensors of the head-mounted display. A.14. A device comprising: a case including a cavity, wherein when the device is attached to a head-mounted display, a lens of the head-mounted display is positioned inside the cavity; and an attachment body, wherein a rear end of the attachment body is secured to a front end of the case, the attachment body being attached to the rear end of the attachment body and facing toward the front end of the case; a set of light-emitting diodes (LEDs); a first circuit configuration configured to control light emission of the set of LEDs; and a second circuit configuration in electrical communication with the set of LEDs, the second circuit configuration configured to deactivate the set of LEDs independently of the first circuit configuration. A.15. The device of embodiment A.14, wherein the second circuitry is configured to deactivate the set of LEDs in response to the set of LEDs being activated for the duration threshold. A.16. The device of any of embodiments A.14-A.15, wherein the attachment body includes an antenna; the first circuitry is in communication with the antenna; and the second circuitry is not in communication with the antenna. A.17. The device of embodiment A.16, wherein the first circuit configuration includes a memory and a set of processors, and the memory stores program instructions that, when executed by the set of processors, cause the set of processors to perform operations including detecting that the second circuit configuration has deactivated the set of LEDs; and transmitting a wireless message to the computing device indicating that the second circuit configuration has deactivated the set of LEDs. A.18. The device of any of embodiments A.14 to A.17, wherein the set of LEDs is configured to project the bleaching light onto the retinal surface area such that the arc of at least one of the areas illuminated by the bleaching light is greater than 2 degrees. A.19. A device of any of embodiments A.14 to A.18, wherein the set of LEDs is a first set of LEDs; the second set of LEDs is directed toward a second lens of the head-mounted display; and the attachment body includes a third circuit configuration in electrical communication with the second set of LEDs, the second circuit configuration being configured to deactivate the set of LEDs independently of the first circuit configuration and the second circuit configuration. A.20. The device of embodiment A.20, wherein the set of LEDs is movable along the horizontal direction of the attachment body or the vertical direction of the attachment body. B.1. A system comprising: an attachment body secured to a front end of a case by coupling, the attachment body including a set of light emitting diodes (LEDs), the set of light emitting diodes being attached to a rear end of the attachment body and facing toward the front end of the case; circuitry including a first sub-circuitry and a second sub-circuitry, the first sub-circuitry configured to control light emission of the set of LEDs and the second sub-circuitry configured to deactivate the set of LEDs independently of the first sub-circuitry; a set of processors; and a memory storing program instructions that, when executed by the set of processors, cause the set of processors to perform operations including emitting light at a target intensity using the set of light emitting diodes (LEDs); and receiving a measurement of an eye response from a head-mounted display after emission of light at the target intensity. B.2. The system of embodiment B.1, wherein the operations further include detecting that the set of LEDs have stopped emitting light at the target intensity; and receiving a signal from the circuitry indicating that light at the target intensity is not being emitted within 5 milliseconds after detecting that the set of LEDs have stopped emitting light at the target intensity. B.3. The system of any of embodiments B.1 to B.2, wherein the operations further include obtaining a retinal position based on eye measurements and selecting a set of LEDs by determining an illumination position that focuses light within a first degree range of the eye, and emitting light at a target intensity includes illuminating the retinal surface area such that at least one arc of the retinal surface area is greater than 2 degrees. B.4. The system of any of embodiments B.1 to B.3, wherein the operations further include determining a pupil radius based on the measured eye response; determining a target luminance based on the pupil radius, wherein the target luminance is negatively correlated with the pupil radius; and updating the luminance of the stimulus displayed on the lens of the head-mounted display with the target luminance. B.5. The system of any of embodiments B.1 to B.4, wherein the set of LEDs is a first set of LEDs; the second set of LEDs is directed toward a second lens of the head-mounted display; and emitting light at a target intensity includes emitting light using the first set of LEDs without emitting light using the second set of LEDs. C.1. A system including an HMD including a transparent lens and a memory storing program instructions that, when executed by a set of processors in the HMD, perform operations including: determining, based on a set of images collected by an inward-facing camera of the HMD, whether a set of photoactivation criteria are satisfied by detecting image regions indicative of a person's eyes based on the set of images; and wirelessly transmitting a set of activation messages in response to determining that the set of photoactivation criteria are satisfied; and an accessory configured to attach to the HMD and including a set of light-emitting diodes (LEDs) that emit bleaching light having a bleaching intensity that is visible through the transparent lens of the HMD, wherein circuitry in the accessory, when executed by the circuitry, receives the set of activation messages via a wireless receiver of the accessory; and the accessory storing program instructions that, when executed by the circuitry, perform operations including activating the set of LEDs to emit light at the bleaching intensity through the transparent lens of the HMD. C.2. A system of any of embodiments C.1 to C.2, including an accessory body, the accessory body having a rear end fixed to the front end of the case and a set of LEDs attached to the rear end of the accessory body and directed toward the transparent lens; the circuitry at least partially enclosed within the accessory body; and the accessory body having a cavity that contains a transparent lens of the HMD when the case is attached to the HMD, the plurality of openings being aligned with the outward-facing camera of the HMD when the case is attached to the HMD; and an accessory body, the rear end of the accessory body fixed to the front end of the case and a set of LEDs attached to the rear end of the accessory body and directed toward the transparent lens; the circuitry at least partially enclosed within the accessory body; and the circuitry including a wireless receiver. C.3. A system comprising: a head-mounted display (HMD) including a memory storing program instructions that, when executed by a set of processors in the HMD, perform operations including determining whether a set of criteria are satisfied based on eye-related readings collected by a camera in the HMD; and wirelessly transmitting a set of messages in response to determining that the set of criteria are satisfied; and an attachment including a set of light-emitting diodes (LEDs) that emit light of a bleaching intensity through lenses of the HMD, the attachment storing program instructions that, when executed by the attachment, perform operations including activating the set of LEDs to emit light of a bleaching intensity in response to receiving the set of messages. C.4. The system of embodiment C.3, wherein the eye-related readings include a set of images; determining whether a set of criteria are satisfied includes detecting eyes in the set of images; determining a gaze location of the eye based on the set of images; determining that the gaze location of the eye is focused within the target area, and determining that the set of criteria are satisfied includes determining that the gaze location is focused within the target area. C.5. The system of any of embodiments C.3 to C.4, wherein the eye-related readings are first eye-related readings; the set of messages are a first set of messages, and the operations further include determining a first pupil size based on the first eye-related readings; generating or updating the first set of messages to include a first set of parameters that cause the set of LEDs to emit light at a first brightness based on a determination that the first pupil size is less than a size threshold; obtaining a second eye-related reading via the camera; determining a second pupil size based on the second eye-related readings; generating or updating a second set of messages to include a second set of parameters that cause the set of LEDs to emit light at a second brightness based on a determination that the second pupil size is greater than the size threshold, wherein the second brightness is less than the first brightness; and sending the second set of messages to the attachment. C.6. The system of embodiment C.5, wherein the size threshold is 5 millimeters or less. C.7. The system of any of embodiments C.3 to C.6, wherein the set of messages is a first set of messages, and the operations further include determining pupil size based on eye-related readings; generating or updating the first set of messages to include information that causes a set of LEDs to emit light at a first brightness based on a determination that the pupil size is less than a size threshold; receiving, by the HMD, a user-provided value indicating that the brightness has been too long; adjusting the configuration parameters; and generating or updating a second set of messages based on the configuration parameters, the second set of messages causing the set of LEDs to emit light at a second brightness that is less than the first brightness. C.8. The system of any of embodiments C.3 through C.7, wherein the set of messages causes the attachment to determine light intensity; and the attachment stores program instructions for determining current based on light intensity. C.9. The system of any of embodiments C.3 to C.8, wherein the operation further includes receiving a voice-activated stimulus, and determining whether a set of criteria is satisfied includes initiating a test operation that causes the attachment to determine whether the set of criteria is satisfied in response to receiving the voice-activated stimulus. C.10. The system of any of embodiments C.3 to C.9, wherein the operations further include receiving a set of images based on a set of outward-facing cameras of the HMD; detecting target motion or target shape based on the set of images; and determining whether a set of visual stimulus criteria are satisfied based on the target motion or target shape, wherein determining whether the set of criteria are satisfied includes initiating a test operation that causes the attachment to determine whether the set of criteria are satisfied in response to determining that the set of visual stimulus criteria are satisfied. C.11. The system of any of embodiments C.3 to C.10, wherein the eye-related readings include a set of images; determining whether a set of criteria are satisfied includes detecting image regions indicative of an eye by providing the set of images to a set of classifiers; determining a pupil size of the eye based on the image regions; and determining whether the pupil size satisfies a minimum threshold, wherein determining that the set of criteria are satisfied includes determining that the pupil size satisfies the minimum threshold. C.12. A method comprising: determining by a head-mounted display (HMD) whether a set of criteria are satisfied based on eye-related readings collected by a sensor in the HMD; wirelessly transmitting by the HMD a set of messages in response to determining that the set of criteria are satisfied; and activating by the attachment a set of LEDs in the attachment to emit bleaching light through a lens of the HMD in response to receiving the set of messages. C.13. The method of embodiment C.12, wherein activating the set of LEDs includes activating the set of LEDs using first circuitry of the attachment, and deactivating the set of LEDs with second circuitry of the attachment in response to the set of LEDs being activated for the duration threshold, the first circuitry being different from the second circuitry; and further including sending a warning message to the HMD indicating that the second circuitry has deactivated the set of LEDs. C.14. A method according to any of embodiments C.12 to C.13, further comprising retrieving configuration parameters that set or update LED emission durations from the memory of the HMD; determining a subset of configuration parameters associated with LED emission durations that exceed a duration threshold; and visually indicating the subset of configuration parameters on the display device. C.15. A method as described in any of embodiments C.12 to C.14, further comprising: displaying a visual stimulus on the lens; determining a gaze location based on eye-related readings; and determining whether the gaze location is within a threshold range of visual stimuli, wherein transmitting a set of messages includes transmitting a set of messages in response to determining that the gaze location is within the threshold range of visual stimuli. C.16. The method of embodiment C.15, further comprising: displaying a series of visual stimuli on the lens, the series of visual stimuli including the first visual stimulus, the visual stimulus being a first visual stimulus and the gaze location being a first gaze location; acquiring, for each respective stimulus of the series of visual stimuli, an image of a respective set of eyes with a sensor; determining a respective gaze location based on the respective set of images; determining whether the respective gaze location is within a respective threshold range of the respective stimulus; and activating a set of LEDs in response to determining that the respective gaze location is within a respective threshold range of the respective stimulus. C.17. A method as described in any of embodiments C.12 to C.16, further comprising: activating the set of LEDs includes activating the set of LEDs for a first duration, and collecting a set of eye-related readings by the sensor during a data collection period after the set of LEDs is activated; determining a set of eye-related information based on the set of eye-related readings, the set of eye-related information indicating a value over the data collection period; determining by the HMD whether a set of time-based criteria is satisfied based on the set of eye-related information; and sending a second set of messages to a recipient of the attachment that causes the set of LEDs to emit light for a second duration based on a determination that the set of time-based criteria is not satisfied. C.18. The method of embodiment C.17, further comprising: collecting second eye-related readings by a sensor during a second data collection period after a second duration, the eye-related readings being a first set of eye-related readings; determining a second set of eye-related information based on the second eye-related readings, the second set of eye-related information indicating a change over the second data collection period; determining by the HMD whether a set of time-based criteria is satisfied based on the second set of eye-related information; and presenting a visual stimulus on the lens in response to determining that the set of time-based criteria is satisfied. C.19. A method according to any of embodiments C.12 to C.18, further comprising obtaining a test category by the HMD that indicates a test configuration, and wherein transmitting a set of messages includes transmitting parameters that indicate an LED subset of the set of LEDs to activate based on the test category. C.20. The method of embodiment C.19, wherein a subset of LEDs in the set of LEDs emit light at a first wavelength that is different from a second wavelength emitted by LEDs in the set of LEDs that are not included in the LED subset.
Claims
1. 1. A system of a head-mounted display and an accessory, wherein the accessory projects a bleaching light through the head-mounted display to bleach photoreceptors for dark adaptation testing, comprising: a head mounted display including a transparent lens and an outward-facing camera, the transparent lens and the outward-facing camera being on a front end of the head mounted display, the outward-facing camera being adjacent to the transparent lens, and at least one pair of the outward-facing cameras being on either side of a vertical plane of the head mounted display; an accessory device positioned on a front end of the head mounted display, the accessory device comprising: A light-blocking case, a cavity that contains the transparent lens of the head-mounted display when the accessory device is attached to the head-mounted display, the light-shielding case shielding the cavity from light from the environment of the head-mounted display when the accessory device is attached to the head-mounted display; a plurality of apertures aligned with the outward-facing cameras; a light-blocking case including: An attachment body fixed to a front end of the light-shielding case, the attachment body comprising: a set of light emitting diodes (LEDs) that emit light at a bleaching intensity, the set of LEDs being mounted at a rear end of the attachment body and directed toward at least one of the transparent lenses, such that the light emitted by the set of LEDs is visible through the at least one of the transparent lenses; circuitry at least partially enclosed within the attachment body and in electrical communication with the set of LEDs, the circuitry configured to control the light emission of the set of LEDs; and Attachment body including and accessory devices including Including, the system.
2. 2. The system of claim 1, wherein the circuitry is controller circuitry, and the attachment body further includes safety circuitry in electrical communication with the set of LEDs, the safety circuitry including a relay or microcontroller for deactivating the set of light-emitting diodes independently of the controller circuitry.
3. The circuit configuration is emitting a first light at a first intensity by the set of LEDs in response to receiving a first command via the circuitry interface, the first intensity not being a bleaching intensity; and emitting a second light at a second intensity by the set of LEDs in response to receiving a second command via the interface, the second intensity being a bleaching intensity. The system of claim 1 configured to perform operations including:
4. 2. The system of claim 1, wherein the circuitry performs operations including emitting a first light at a first intensity by the set of LEDs in response to receiving a first command via an interface of the circuitry, the first light being emitted simultaneously with light emitted by the head-mounted display.
5. a filter combiner; a neutral density filter fixed to the filter combiner; Further comprising: The system of claim 1 , wherein the set of LEDs is directed toward the neutral density filter such that the light emitted by the set of LEDs passes through the neutral density filter.
6. The system of claim 1 , wherein the plurality of apertures includes at least six apertures, and at least one aperture of the plurality of apertures is aligned with a microphone.
7. A device, a case including a cavity, wherein when the device is attached to a head mounted display, a lens of the head mounted display is positioned inside the cavity and an opening of the case is aligned with an outward-facing camera of the head mounted display; An attachment body, the rear end of which is fixed to the front end of the case, and the attachment body comprises: a set of light emitting diodes (LEDs) mounted at the rear end of the attachment body and directed toward the lens; and circuitry configured to control the light emission of the set of LEDs; The attachment body and Including, the device.
8. the lens is a first lens; the attachment body including a middle portion bisected by a sagittal plane of the attachment body; the intermediate portion is longer along the sagittal plane of the attachment body compared to the left section of the attachment body or the right section of the attachment body; the set of LEDs is a first set of LEDs; a second set of LEDs mounted on the rear end of the attachment body and directed toward a second lens of the head mounted display; the first set of LEDs and the second set of LEDs are substantially symmetrical about a sagittal plane; the distance between the first set of LEDs and the second set of LEDs is 40 millimeters or greater; The device of claim 7.
9. The circuit configuration is a first circuit configuration, and the second circuit configuration is determining whether the power consumption of the set of LEDs meets a power threshold; in response to determining that the power consumption of the set of LEDs satisfies the power threshold; determining whether the duration of the light emission of the set of LEDs satisfies a duration threshold; and deactivating the set of LEDs in response to determining that the duration of the light emission satisfies the duration threshold.
10. The device of claim 7, comprising a microcontroller configured to perform operations including:
10. The device of claim 7 , wherein the set of LEDs is positioned below a cross section of the attachment body.
11. The device of claim 7 , wherein the attachment body is secured to the case at a plurality of attachment positions.
12. The device of claim 7 , wherein the attachment body is secured to the case by at least one of a threaded member, a snap fastener member, or an adhesive.
13. the opening is a first opening; the case including a plurality of openings; the plurality of apertures is greater than three apertures; each respective aperture of the plurality of apertures is aligned with at least one sensor of a plurality of sensors of the head mounted display; The device of claim 7.
14. A device, a case including a cavity, wherein when the device is attached to a head mounted display, a lens of the head mounted display is positioned inside the cavity; An attachment body, the rear end of which is fixed to the front end of the case, the attachment body comprising: a set of light emitting diodes (LEDs) attached to the rear end of the attachment body and directed toward the front end of the case; a first circuitry configured to control the light emission of the set of LEDs; and a second circuit configuration in electrical communication with the set of LEDs; an attachment body including: Including, the device.
15. 15. The device of claim 14, wherein the second circuitry is configured to deactivate the set of LEDs in response to the set of LEDs being activated for a duration threshold.
16. the attachment body includes an antenna; the first circuitry is in communication with the antenna; the second circuitry is not in communication with the antenna; 15. The device of claim 14.
17. The first circuit configuration includes: Memory and A set of processors the memory, when executed by the set of processors, causes the set of processors to detecting that the second circuitry has deactivated the set of LEDs; and transmitting a wireless message to a computing device indicating that the second circuitry has deactivated the set of LEDs; Stores program instructions that cause operations including 17. The device of claim 16.
18. 15. The device of claim 14, wherein the set of LEDs is configured to project the bleaching light onto a retinal surface area such that the arc of at least one of the regions illuminated by the bleaching light is greater than 2 degrees.
19. the set of LEDs is a first set of LEDs; a second set of LEDs directed toward a second lens of the head mounted display; the attachment body includes third circuitry in electrical communication with the second set of LEDs, the second circuitry configured to deactivate the set of LEDs independently of the first circuitry and the second circuitry; 15. The device of claim 14.
20. 20. The device of claim 19, wherein the set of LEDs is movable along a horizontal direction of the attachment body or a vertical direction of the attachment body.
21. 1. A system for using a bleaching light associated with a head mounted display (HMD) to project a bleaching light through the HMD to bleach photoreceptors of a dark adaptation testing device, the system comprising: a transparent lens; and a memory, which when executed by a set of processors in the HMD: determining whether a set of photoactivation criteria is satisfied based on a set of images collected by an inward-facing camera of the HMD by detecting image regions indicative of a person's eyes based on the set of images; and wirelessly transmitting a set of activation messages in response to determining that the set of photoactivation criteria are satisfied. and a memory for storing program instructions for performing operations including an accessory configured to attach to the HMD and including a set of light emitting diodes (LEDs) that emit white light having a white intensity that is visible through the transparent lens of the HMD, wherein circuitry of the accessory, when executed by the circuitry, receiving the set of activation messages via a wireless receiver of the accessory; and activating the set of LEDs to emit the whitening light at the whitening intensity through the transparent lens of the HMD in response to receiving the set of activation messages. Stores program instructions that perform operations including accessory Including, the system.
22. the HMD includes an outward-facing camera on a front end of the HMD; The accessory is a case including a cavity that contains the transparent lens of the HMD when the case is attached to the HMD, and a plurality of openings aligned with the outward-facing cameras of the HMD when the case is attached to the HMD; and an accessory body, the rear end of which is fixed to the front end of the case; the set of LEDs are mounted on a rear end of the accessory body and directed toward the transparent lens; the circuitry is at least partially enclosed within the accessory body; the circuitry includes the radio receiver; Accessory body 22. The system of claim 21, comprising:
23. 1. A head mounted display (HMD) including a memory storing program instructions that, when executed by a set of processors in the HMD, determining whether a set of criteria is satisfied based on eye-related readings collected by a camera of the HMD; and wirelessly transmitting a set of messages in response to determining that the set of criteria is satisfied. a head mounted display (HMD) including a memory storing program instructions for performing operations including an attachment including a set of light emitting diodes (LEDs) that emit light at a whitening intensity through a lens of the HMD, the attachment storing program instructions that, when executed by the attachment, perform operations including activating the set of LEDs to emit the light at the whitening intensity in response to receiving the set of messages; Including, the system.
24. The eye-related readings include a set of images; Determining whether the set of criteria is satisfied comprises: detecting eyes within the set of images; determining an eye gaze location based on the set of images; determining that the gaze location of the eye is focused within a target area, wherein determining that the set of criteria is satisfied includes determining that the gaze location is focused within the target area.
24. The system of claim 23, comprising:
25. the eye-related reading is a first eye-related reading; the set of messages is a first set of messages; The above operation further includes: determining a first pupil size based on the first eye-related reading; generating or updating the first set of messages to include a first set of parameters that cause the set of LEDs to emit light at a first intensity based on determining that the first pupil size is less than a size threshold; obtaining a second eye-related reading via said camera; determining a second pupil size based on the second eye-related reading; generating or updating a second set of messages to include a second set of parameters that cause the set of LEDs to emit light at a second intensity based on determining that the second pupil size is greater than the size threshold, the second intensity being less than the first intensity; and sending the second set of messages to the attachment; 24. The system of claim 23, comprising:
26. 26. The system of claim 25, wherein the size threshold is 5 millimeters or less.
27. The set of messages is a first set of messages, and the operation further comprises: determining pupil size based on said eye-related readings; generating or updating the first set of messages to include information causing the set of LEDs to emit light at a first intensity based on determining that the pupil size is less than a size threshold; receiving, by the HMD, a user-provided value indicating that the brightness has been too long; Adjusting the configuration parameters; and generating or updating a second set of messages based on the configuration parameters, the second set of messages causing the set of LEDs to emit light at a second intensity that is less than the first intensity; 24. The system of claim 23, comprising:
28. the set of messages causing the attachment to determine light intensity; the attachment storing program instructions for determining a current based on the light intensity.
24. The system of claim 23.
29. 24. The system of claim 23, wherein the operation further includes receiving a voice-activated stimulus, and determining whether the set of criteria is satisfied includes initiating a test operation that causes the attachment to determine whether the set of criteria is satisfied in response to receiving the voice-activated stimulus.
30. The operation further comprises: receiving a set of images based on a set of outward-facing cameras of the HMD; detecting target motion or target shape based on the set of images; and determining whether a set of visual cue criteria are satisfied based on the target motion or the target shape, wherein determining whether the set of criteria are satisfied includes initiating a test action that causes the attachment to determine whether the set of criteria are satisfied in response to determining that the set of visual cue criteria are satisfied.
24. The system of claim 23, comprising:
31. The eye-related readings include a set of images; Determining whether the set of criteria is satisfied comprises: detecting image regions indicative of eyes by providing the set of images to a set of classifiers; determining a pupil size of the eye based on the image region; determining whether the pupil size satisfies a minimum threshold, wherein determining that the set of criteria is satisfied includes determining that the pupil size satisfies the minimum threshold.
24. The system of claim 23, comprising:
32. determining, by a head mounted display (HMD), whether a set of criteria is satisfied based on eye-related readings collected by sensors in the HMD; wirelessly transmitting by the HMD a set of messages in response to determining that the set of criteria is satisfied; and activating, by the attachment, a set of LEDs on the attachment to emit a bleaching light through a lens of the HMD in response to receiving the set of messages. A method comprising:
33. activating the set of LEDs includes activating the set of LEDs by using first circuitry of the attachment. Including, deactivating the set of LEDs with second circuitry of the attachment in response to the set of LEDs being activated for a duration threshold, the first circuitry being different from the second circuitry; and sending a warning message to the HMD indicating that the second circuitry has deactivated the set of LEDs.
33. The method of claim 32, further comprising:
34. retrieving configuration parameters from a memory of the HMD that set or update LED firing durations; determining a subset of the configuration parameters associated with an LED emission duration that exceeds a duration threshold; and visually indicating said subset of said configuration parameters on a display device; 33. The method of claim 32, further comprising:
35. displaying a visual stimulus on said lens; determining a gaze location based on said eye-related readings; and determining whether the gaze location is within a threshold range of the visual stimuli, and transmitting the set of messages includes transmitting the set of messages in response to determining that the gaze location is within the threshold range of the visual stimuli.
33. The method of claim 32, further comprising:
36. the visual stimulus is a first visual stimulus, the gaze location is a first gaze location; displaying a series of visual stimuli on the lens, the series of visual stimuli including the first visual stimulus; For each stimulus in the series of visual stimuli: acquiring, with said sensors, an image of each pair of eyes; determining a respective gaze location based on the respective set of images; determining whether the respective gaze locations are within respective threshold ranges of the respective stimuli; and activating the set of LEDs in response to determining that the respective gaze locations are within the respective threshold ranges of the respective stimuli.
36. The method of claim 35, further comprising:
37. activating the set of LEDs includes activating the set of LEDs for a first duration; collecting a set of eye-related readings by the sensor during a data collection period after the set of LEDs is activated; determining a set of eye-related information based on the set of eye-related readings, the set of eye-related information indicating values over the data collection period; determining, by the HMD, whether a set of time-based criteria is satisfied based on the set of eye-related information; and transmitting a second set of messages to the recipient of the attachment that causes the set of LEDs to emit light for a second duration based on a determination that the set of time-based criteria is not satisfied; 33. The method of claim 32, further comprising:
38. the eye-related readings are a first set of eye-related readings; collecting second eye-related readings by the sensor during a second data collection period after the second duration; determining a second set of eye-related information based on the second eye-related readings, the second set of eye-related information indicating a change over the second data collection period; determining, by the HMD, whether the set of time-based criteria is satisfied based on the second set of eye-related information; and presenting a visual stimulus on the lens in response to determining that the set of time-based criteria is satisfied.
38. The method of claim 37, further comprising:
39. 33. The method of claim 32, further comprising acquiring, by the HMD, a test category indicating a test configuration, and wherein transmitting the set of messages includes transmitting parameters indicating an LED subset of the set of LEDs to activate based on the test category.
40. 40. The method of claim 39, wherein the LED subset of the set of LEDs emits light at a first wavelength that is different from a second wavelength emitted by LEDs in the set of LEDs that are not included in the LED subset.