Field of view map expansion

The wearable device system addresses hardware limitations by correlating the field of view with display locations using multiple displays and sensors, enabling comprehensive vision testing and ocular abnormality detection.

JP2024544624APending Publication Date: 2024-12-03HERU INC
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2024531730
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2021-11-30
Filing Date
2022-11-28
Publication Date
2024-12-03

AI Technical Summary

Technical Problem

Wearable devices face hardware limitations that reduce the user interface area for presenting visual stimuli, limiting the detection of the full visual field, particularly peripheral vision, and preventing comprehensive vision testing.

Method used

A wearable device system that includes a mapping subsystem to correlate the field of view with display locations, using multiple displays (both transparent and external) to present stimuli and collect feedback, employing sensors for eye tracking and environmental mapping to generate ocular abnormality information.

Benefits of technology

Enhances the detection of the visual field beyond hardware limitations, allowing comprehensive vision testing by correlating field of view with display locations and generating ocular abnormality information through continuous feedback and mapping.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024544624000001_ABST
    Figure 2024544624000001_ABST
Patent Text Reader

Abstract

The method includes obtaining spatial information indicating a position of the electronic display relative to the wearable device and selecting a first display location on an electronic display other than the wearable display of the wearable device based on the spatial information indicating that a first display location on the electronic display corresponds to a first viewing location in the field of view. The method further includes selecting a second display location on the wearable device based on the spatial information indicating that a second display location on the wearable display corresponds to a second viewing location in the field of view. The method further includes generating a presentation of (i) a first stimulus at the first display location on the electronic display and (ii) a second stimulus at the second display location on the wearable device and generating ocular anomaly information based on feedback information related to the presented stimuli.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This application claims the benefit of priority to U.S. Patent Application No. 17 / 538,862, filed November 30, 2021. The contents of the above-mentioned application are incorporated herein by reference in their entirety. [Background technology]

[0002] background

[0002] Wearable devices can be used to perform vision tests to determine vision disorders and eye-related conditions by testing the visual field of the eye for a set of characteristics. For example, the wearable device may present a visual stimulus on a portion of its display, where presenting includes varying the location of the visual stimulus on the wearable device display and measuring the eye's response to the stimulus. Summary of the Invention [Problem to be solved by the invention]

[0003] overview

[0003] In the context of vision testing using a wearable device, hardware limitations may reduce the user interface area of ​​the wearable device where visual stimuli can be presented. The reduced size area may be less than the full visual field of the user's eye. Such size limitations may reduce the total area of ​​visual fields that can be detected, particularly the visual field of the eye associated with peripheral vision. These hardware limitations may prevent vision testing of certain areas of the user's peripheral vision due to the loss of testable size of this observable area. [Means for solving the problem]

[0004]

[0004] In some embodiments, the wearable device may perform an operation to update ocular anomaly information of the eye by presenting a stimulus at a visual field location of the visual field of the eye. The wearable device may acquire spatial information informing a position, orientation, or other spatial information of a set of electronic displays relative to the wearable device. Some embodiments may include instructions for testing the visual field location and for determining whether the eye can observe the presented stimulus at the visual field location. After selecting the visual field location, the wearable device or a computer connected to the wearable device may use the acquired spatial information to select the electronic display to present the first stimulus at a display location mapped to the visual field location. At the same time or at a different time, the wearable device may present a second stimulus on the display of the wearable device, where the display may include a waveguide or another type of display to present the second stimulus to the eye. During or after the presentation of the stimulus, the wearable device may collect eye-related characteristics or other feedback information by an eye tracking sensor or other type of sensor. Some embodiments may then generate ocular anomaly information indicating one or more ocular anomalies based on the collected feedback information indicating whether the eye responded to the presentation of the stimuli.

[0005]

[0005] Various other aspects, features, or advantages of the present invention will be apparent through the detailed description of the present invention and the drawings attached hereto. It should also be understood that both the general description above and the detailed description below are examples and do not limit the scope of the present invention. As used herein and in the claims, the singular forms "a", "an", and "the" include plural references unless the context clearly indicates otherwise. In addition, as used herein and in the claims, the term "or" means "and / or" unless the context clearly indicates otherwise. In addition, as used herein, "a portion" means a portion or the entirety (i.e., the entire portion) of a given item (e.g., data) unless the context clearly indicates otherwise. Furthermore, "set" can mean singular or plural, such as "set of items" can mean one item or multiple items. [Brief description of the drawings]

[0006] BRIEF DESCRIPTION OF THE DRAWINGS [Figure 1A] SUMMARY OF THE DISCLOSURE

[0006] A system for facilitating vision testing and collecting feedback information according to one or more embodiments is shown. [Figure 1B]

[0007] 1 illustrates a user vision testing environment in accordance with one or more embodiments. [Figure 2A]

[0008] 1 illustrates a visual acuity test that involves monitoring eye movements in response to a set of presented stimuli according to one or more embodiments. [Figure 2B] 1 illustrates a visual acuity test that involves monitoring eye movements in response to a set of presented stimuli according to one or more embodiments. [Diagram 3]

[0009] 1 illustrates a flowchart of a process for performing a vision test using multiple displays in accordance with one or more embodiments. [Figure 4]

[0010] 1 illustrates a system having a test framework implemented on a computing device, a wearable device, and a display device in accordance with one or more embodiments. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0007] Detailed Description

[0011] In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the present invention. However, those skilled in the art will understand that the embodiments of the present invention may be practiced without these specific details or with equivalent configurations. In other cases, well-known structures and devices are shown in block diagram form in order to avoid unnecessarily obscuring the embodiments of the present invention.

[0008]

[0012] 1A illustrates a system for facilitating a vision test and for collecting feedback information according to one or more embodiments. In some embodiments, the system 100 may include a server 102 (or other computer system 102), where such system 102 may include one or more non-transitory storage media storing program instructions for performing one or more operations of the mapping subsystem 122, the stimulus presentation subsystem 123, or the feedback collection subsystem 124. In some embodiments, the system 100 includes a wearable device 104, where the wearable device 104 may include one or more non-transitory storage media storing program instructions for performing one or more operations of the mapping subsystem 122, the stimulus presentation subsystem 123, or the feedback collection subsystem 124. System 100 may also include a set of external displays 105 (e.g., accessories to wearable device 104, a desktop monitor, a television screen, or other external displays) that may be provided with instructions for displaying visual stimuli based on measurements or instructions provided by wearable device 104 or server 102. In some embodiments, wearable device 104 may communicate with various other electronic devices via network 150, where network 150 may include the Internet, a local area network, a peer-to-peer network, etc.

[0009]

[0013] The wearable device 104 may send and receive messages over the network 150 to communicate with the server 102, where the server 102 may include one or more non-transitory storage media that store program instructions for performing one or more operations of the predictive model subsystem 125. It is further noted that while one or more operations are described herein as being performed by a particular component of the system 100, these operations may in some embodiments be performed by other components of the system 100. For example, an operation described in this disclosure as being performed by the server 102 may instead be performed by the wearable device 104, in which case program code or data stored on the server 102 may instead be stored on the wearable device 104 or another client computing device. Similarly, in some embodiments, the server 102 may store program code or perform operations described as being performed by the wearable device 104. For example, the server may perform the operations described as being performed by the mapping subsystem 122, the stimulus presentation subsystem 123, or the feedback collection subsystem 124. Additionally, although some embodiments are described herein in relation to machine learning models, other predictive models (e.g., statistical models) may be used instead of or in addition to machine learning models. For example, in one or more embodiments, a statistical model may be used to replace a neural network model to determine ocular anomalies.

[0010]

[0014] In some embodiments, the system 100 can present a set of stimuli (e.g., shapes, text, or images) on a display of the wearable device 104. The wearable device 104 can include a housing 143, a left transparent display 141, and a right transparent display 142, where light can be projected from an emitter of the wearable device through a waveguide in the transparent displays 141-142 to present stimuli that are observable by one or more eyes of a user wearing the wearable device 104. The wearable device 104 also includes a set of outwardly facing sensors 147, where the set of outwardly facing sensors 147 can provide sensor data indicative of the physical space around the wearable device 104. In some embodiments, the set of outwardly facing sensors 147 can include a camera, an infrared sensor, a lidar sensor, a radar sensor, or the like.

[0011]

[0015] Additionally, the system 100 can present stimuli on a set of external displays 105 during the visual testing operation. Although the set of external displays 105 is shown as having two external displays, the set of external displays can include a greater or lesser number of external displays, such as only one external display or more than two external displays. For example, the set of external displays can include four external displays, eight external displays, nine external displays, or any other number of external displays. The external displays can include one or more types of electronic displays, such as computer monitors, smartphones, television screens, laptop devices, tablet devices, LED devices, LCD devices, other types of electronic displays, and the like. In some embodiments, the external displays can include projectors, in which case the location of the external displays can include a wall or screen onto which one or more stimuli are projected. In some embodiments, the external displays can themselves be transparent or partially transparent.

[0012]

[0016] During or after the vision testing operation, the system 100 may obtain feedback information related to the set of stimuli, where the feedback information may indicate whether or how the eye responds to one or more stimuli of the set of stimuli. For example, some embodiments may use the wearable device 104 to collect feedback information including various eye-related characteristics. In some embodiments, the feedback information may include an indication of an eye's response to the presentation of the dynamic stimuli at the first display location 146 on the wearable device 104. Alternatively, or in addition, the feedback information may include an indication of a lack of response to such stimuli. The response or lack of response may be determined based on one or more eye-related characteristics, such as eye movement, gaze direction, a distance the eye's gaze has moved in the gaze direction, a change in pupil size, user-specific input, and the like. In some embodiments, the feedback information may include image data or results based on the image data. For example, some embodiments may obtain an image or a sequence of images (e.g., in the form of a video) of the eye captured during the testing operation as the eye responds to the stimuli. The image of the eye may be an image of the retina of the eye, such as an image of all or a portion of the retina, an image of the cornea of ​​the eye, such as an image of all or a portion of the cornea, or another image of the eye. A wearable display location, as used in this disclosure, may include a display location of a wearable device.

[0013]

[0017] In some embodiments, the system 100 can detect one or more ocular anomalies of the eye and can update the relevant ocular anomaly information based on feedback information informing the eye's response to the stimuli. In some embodiments, the ocular anomaly can include visual field defects, eye misalignment, pupil movement or size anomalies, etc. For example, some embodiments can use predictive models to detect non-responsive regions of the visual field or other ocular anomalies in portions of the visual field associated with the ocular anomaly. In some embodiments, the region associated with the ocular anomaly can be determined by selection of a location or region of the visual field of the eye that fails to satisfy one or more visual acuity criteria. In some embodiments, satisfying a set of visual acuity criteria for a visual field location can include determining whether the eye responds to a visual field presented at a display location mapped to the visual field location, where various presented stimuli may vary in luminance, color, shape, size, etc.

[0014]

[0018] In some embodiments, data used or updated by one or more operations described in this disclosure can be stored in the set of databases 130. In some embodiments, the server 102, the wearable device 104, the set of external displays 105, or other computing devices can access the set of databases to perform one or more operations described in this disclosure. For example, a predictive model used to determine ocular anomaly information may be obtained from the first database 131, in which case the first database 131 can be used to store the predictive model or parameters of the predictive model. Alternatively or in addition, the set of databases 130 can store feedback information collected by the wearable device 104 or results determined from the feedback information. For example, the second database 132 can be used to store a set of user profiles that include or link to eye measurements and corresponding feedback information for users identified by the set of user profiles. Alternatively or in addition, the set of databases 130 can store instructions indicative of different types of testing procedures. For example, the third database 133 may store a set of test instructions that cause a first stimulus to be presented on the wearable device 104, then a second stimulus to be presented on the first external display 105a, and then a third stimulus to be presented on the second external display 150b.

[0015]

[0019] Subsystems 122-125

[0020] In some embodiments, the mapping subsystem 122 can generate a "view-to-display" map that maps a location or region of the field of view to a location or region of the AR interface displayed on the set of external displays 105 or on the left transparent display 141 or the right transparent display 142. The "view-to-display" map can be stored in various forms, such as in the form of a set of multi-dimensional arrays, functions, subroutines, and the like. For example, the "view-to-display" map can include a first multi-dimensional array, where the first two dimensions of the first array can inform coordinates in a combined display space that are mapped 1:1 with the field of view. In some embodiments, the third dimension of the first array can identify an external display or wearable display to be used in presenting the stimuli. Furthermore, the fourth and fifth dimensions of the array can be used as coordinates relative to the origin of each respective external display. In some embodiments, the arrays or other sets of values ​​described in this disclosure can instead be divided into multiple arrays or other subsets of values. In some embodiments, the field-to-display map can be used inversely, such that display locations can be mapped to visual field locations ("field locations") using the field-to-display map. Some embodiments pre-generate the display-to-field map by inverting one or more of the arrays described above. Additionally, some embodiments can use or update the map by using an array of maps or other data structures. Various other embodiments of the field-to-display map are possible, as described elsewhere in this disclosure.

[0016]

[0021] In some embodiments, the mapping subsystem 122 may obtain sensor information from the outwardly facing set of sensors 147, where the sensor information may include position measurements of the set of external displays 105. For example, a user wearing the wearable device 104 may rotate or translate his or her head, which may generate a corresponding rotation or translation of the wearable device 104. Some embodiments may detect these changes in physical orientation or position of the wearable device 104 relative to the set of external displays 105. Some embodiments may then perform a mapping operation to determine the position and orientation of the set of external displays based on the sensor information collected by the outwardly facing set of sensors 147.

[0017]

[0022] In some embodiments, the mapping subsystem 122 can update a "view→display" map that stores or otherwise signals an association between a view location in the field of view and a display location of the left transparent display 141, the right transparent display 142, or the set of external displays 105. For example, the outwardly facing set of sensors 147 may include one or more cameras to collect visual information from an area surrounding the wearable device 104, where the visual information can be used to determine a position or orientation of one or more of the set of external displays 105. As the wearable device 104 moves, some embodiments can continuously obtain sensor information that signals changes to the external environment, including changes in the position or orientation of the set of external displays 105 relative to the position or orientation of the wearable device 104. For example, some embodiments can generate a point cloud that represents the surfaces of objects around the wearable device 104 and can determine the position and orientation of the set of external displays 105 relative to the wearable device 104 based on the point cloud. Additionally, some embodiments may continuously update the view-to-display map as new sensor information is collected by the outward facing sensor set 147.

[0018]

[0023] In some embodiments, the stimulus presentation subsystem 123 can present the set of stimuli on the wearable device 104 or the set of external displays 105. In some embodiments, the left transparent display 141 and the right transparent display 142 can be positioned relative to the housing 143 to fit into an orbital region on the user such that each of the transparent displays 141-142 can collect data and present stimuli or other information to the user. The left transparent display 141 and the right transparent display 142 can house or be associated with an electronic display configured to present a reproduced image to the eye observing the respective transparent display. In various embodiments, the electronic display can include a projector, a display screen, and / or hardware for presenting an image that is viewable by the eye. In some embodiments, the projector of the electronic monitor can be positioned to project an image onto the subject's eye or onto or through a screen, glass, wave guide, or other material. For example, the stimulus presentation subsystem 123 may cause a gaze point or another visual stimulus to be projected onto the first display location 146, in which case the gaze point at the first display location 146 can then be observed by the eye of a user wearing the wearable device 104.

[0019]

[0024] In some embodiments, the stimulus presentation subsystem 123 can cause the set of stimuli to be displayed on an electronic display other than the display of another external display, such as an external display of the set of external displays 105. For example, after presenting the stimuli on the display of the wearable device 104, the stimulus presentation subsystem 123 can cause the stimuli to be presented on the second external display 105b at the second display location 151. An external display location, as used in this disclosure, may include a display location on an external display. The stimulus presentation subsystem 123 can then proceed to display additional stimuli on additional locations on the first external display 105a, the wearable device 104, or the second external display 105b.

[0020]

[0025] Some embodiments may determine a display location for the stimuli by first determining a location or region of the visual field. After determining the location or region of the visual field, some embodiments may use the "view->display" map to determine which display location of the left transparent display 141, the right transparent display 142, or the set of external displays 105 to use in displaying the stimuli. For example, some embodiments may determine that a previous sequence of sensor measurements indicated that a first region of the visual field has not yet been tested, and may select this first region for testing. Some embodiments may then use the "view->display" map to determine a third display location 152 on the first external display 105a, and in response to selecting the third display location 152, may display the stimuli at the third display location 152. As described elsewhere in this disclosure, some embodiments may measure eye movements or otherwise measure the eye's response to stimuli presented on the set of external displays 105 to measure the visual field of the eye. Additionally, as described in this disclosure, a visual location of a stimulus may include a visual location that is mapped to or otherwise associated with a display location of the stimulus, where the mapping or association between the display and the visual location is determined by a "visual location -> display" map. Similarly, a gaze location that is located at a visual location as used in this disclosure may also be described as being located at a display location that is mapped to the visual location.

[0021]

[0026] In some embodiments, the feedback collection subsystem 124 can record feedback information informing of eye responses to a set of stimuli presented on the wearable device 104 or the set of external displays 105. In some embodiments, the transparent displays 141-142 can include a left inwardly directed sensor 144 and a right inwardly directed sensor 145, where the inwardly directed sensors 144-145 can include eye tracking sensors. The inwardly directed sensors 144-145 can include cameras, infrared cameras, photodiodes, infrared sensors, etc. For example, the inwardly directed sensors 144-145 can include cameras configured to track pupil movement and track the subject's visual axis. In some embodiments, the inwardly directed sensors 144-145 can include infrared cameras and can be positioned within a relatively low portion relative to the transparent displays 141-142. The inwardly directed sensors 144-145 can be aligned in a direction to point towards an estimated pupil area for line of sight or pupil tracking.

[0022]

[0027] In some embodiments, the feedback collection subsystem 124 can use the inwardly directed sensors 144-145 to collect feedback information indicative of eye motion as the eye responds to different stimuli. For example, the feedback collection subsystem 124 can obtain eye feedback information collected by the inwardly directed sensors 144-145 as the eye responds to presentation of stimuli at the first display location 146 and the second display location 151. By collecting feedback information with stimuli presented on both the wearable device 104 and one or more of the external display set 105, some embodiments can increase the boundary of the visual field within which ocular abnormalities may be detected.

[0023]

[0028] In some embodiments, the predictive model subsystem 125 may obtain stimulus information, such as a stimulus location and characteristics of the stimulus location, where the stimulus location may include a location on the set of external displays 105. The predictive model subsystem 125 may also obtain training outputs informing the presence or absence of an ocular anomaly, such as vision defect information, defect category, or other output of the predictive model. The predictive model subsystem 125 may then provide the set of stimulus information and the training outputs to the machine learning model to update parameters of the machine learning model to predict the ocular anomaly based on the new input. Alternatively or additionally, the predictive model subsystem 125 may use statistical models or rules to determine the ocular anomaly and to generate a visual field map representative of the visual field of the eye, where one or more regions of the visual field map may be associated with a set of ocular anomalies or may otherwise include ocular anomaly information.

[0024]

[0029] FIG. 1B illustrates a user's vision testing environment according to one or more embodiments. The vision testing environment includes an external display 190. The external display 190 can present images, text, videos, etc. to a user wearing the wearable device 160. In some embodiments, the wearable device 160 can include a left transparent lens 161 and a right transparent lens 162. Some embodiments may allow a user wearing the wearable device 160 to look through the lenses 161-162 to observe a first visual stimulus at a first display location 181 and a second stimulus at a second display location 182, where the presentation of the stimuli can occur simultaneously or sequentially. Alternatively, in some embodiments, the wearable device can leave the areas covered by the lenses 161-162 empty so that the eye can look through empty space and observe the image presented on the external display 190.

[0025]

[0030] The wearable device 160 may include a left medial facing sensor 164 or a right medial facing sensor 165. Some embodiments may use the inwardly facing sensors 164-165 to collect sensor information related to the eye with stimuli presented on the external display 190. For example, the inwardly facing sensors 164-165 may track the gaze location and pupil dilation of the user's eye as the eye shifts its focus from a stimulus positioned at a first display location 181 to a stimulus presented at a second display location 182. In some embodiments, the outwardly facing sensor 166 may include a visual spectrum camera or an infrared camera to collect information about the environment in front of the wearable device 160. The outwardly facing sensor 166 may collect environmental information including images or videos of an area 185, where rotational or translational movement of the wearable device 160 may generate a corresponding change in the shift in what is displayed within the area 185. In some embodiments, the outwardly facing sensor 166 or some other component of the wearable device 160 may include additional sensors, such as an accelerometer or gyroscope, in which case the sensor information can be used to determine the position and orientation of the external display 190 relative to the wearable device 160.

[0026]

[0031] As described elsewhere, some embodiments can use sensor information collected by sensors 164-166 to update the "field-to-display" map. For example, wearable device 160 can transmit sensor information collected by sensors 164-166 to another computer system, such as server 102. Server 102 can then perform a mapping operation, including updating the "field-to-display" map to determine a field of view location of the field of view map to associate with a display location of external display 190. Server 102 can then use the mapping operation to update the field of view map based on the eye-related sensor information collected by sensors 164-165 and the updated "field-to-display" map.

[0027]

[0032] In some embodiments, the left transparent lens 161 or the right transparent lens 162 may include an LED panel, an OLED panel, or a waveguide to display shapes, text, images, or other stimuli to a user wearing the wearable device 160. Additionally, the inwardly facing sensors 164-165 may capture sensor information related to the eye as the user's eye responds to the presentation of the stimuli on the wearable device 160 or the display 190. For example, some embodiments may activate the display of the wearable device 160 to present a stimuli at the display locations 171-172 on the lenses 161-162 and then display a second stimulus at the second display location 182. Upon presentation of the stimuli on the left and right transparent lenses 161-162, the sensors 164-165 may collect sensor information related to the eye as the eye responds to the presentation of the stimuli.

[0028]

[0033] 2A-2B illustrate a visual acuity test that involves monitoring eye movement in response to a set of presented stimuli according to one or more embodiments. In some embodiments, various stimuli may be presented simultaneously or sequentially on the wearable display 202 or an AR interface displayed on the set of external displays 231-238, where the eye observing the wearable display 202 may be able to observe the stimuli displayed on the set of external displays 231-238. Some embodiments may use sensors to collect or otherwise track characteristics of the eye as the stimuli are presented to the eye. The eye characteristics may include limbus position, gaze direction, gaze location, rate at which gaze changes, distance traveled from a previous gaze location, pupil size, physical response to the appearance of the stimulus in the visual field, or other characteristics. For example, some embodiments may update a visual field map 203 representing the visual field of the eye by reporting a first visual field location to which the eye has moved in the gaze direction of a stimulus appearing at the visual field location.

[0029]

[0034] In some embodiments, the sensors of the wearable device may include a set of sensors capable of collecting sensor information that can be used to form a representation of the space around the wearable device. For example, the set of sensors may include a camera for collecting image data, an infrared sensor or LIDAR sensor for collecting distance data, an accelerometer for collecting force data, a gyroscope sensor for collecting rotation data, etc. The collected sensor data can be used to generate a spatial mapping using a spatial mapping algorithm. For example, some embodiments may use an infrared sensor of the wearable device to collect infrared light emitted by the wearable device and to determine a distance from an object using a time-of-flight algorithm. Alternatively or additionally, the set of sensors may include other types of depth sensors, such as structured light sensors or red-green-blue (RGB) depth sensors. Furthermore, some embodiments may track the position or location of the wearable device relative to a set of electronic displays using a positioning algorithm, such as a simultaneous positioning and mapping (SLAM) algorithm. Additionally, some embodiments may receive sensor information from external sensors to increase the accuracy of the spatial mapping to inform the position or orientation of objects around the wearable device or the wearable device itself. For example, the system may use a set of outside-in sensors that project infrared light into space and determine the position of the wearable device based on the reflection of the infrared light.

[0030]

[0035] Some embodiments may use the collected sensor information to generate a map of the external device around the wearable device that conveys spatial information of the external device in relation to the device itself, where the map may associate visual field locations of the eye's field of view ("field locations") with display locations of the wearable device or electronic display. In some embodiments, the field locations may represent locations within the field of view of one or more eyes of a user wearing the wearable device, and the map associating the field locations with display locations may take into account the orientation of the wearable device or the gaze direction of the eye. For example, some embodiments may continuously update the "field-to-display" map by determining a map showing associations between sets of locations representing the field of view of a user wearing the wearable device in relation to the set of external displays 231-238. In some embodiments, each external display of the set of external displays 231-238 may be an electronic display that is physically separate from the wearable device attached to the wearable display 202.

[0031]

[0036] In some embodiments, the user's field of view may be independent of eye movement, where the field of view has been determined by default or by a set of calibration measurements. For example, the user may physically rotate or translate the wearable device (e.g., by rotating or translating their head) and the "field of view to display" map may be updated based on the measured changes in the spatial mapping that inform updates to the position or orientation of objects around the wearable device. Furthermore, some embodiments may also update the field of view based on changes in gaze location. For example, some embodiments may include inwardly facing sensors to measure eye gaze location in real time and to determine changes in the eye's field of view based on gaze location.

[0032]

[0037] Some embodiments may associate different regions of the visual field map with display regions of the external display or the wearable device display. For example, some embodiments may update the visual field map 203 to indicate a set of visual fields 261-268 that are mapped to display regions of the set of external displays 231-238, respectively. For example, a visual location within visual field region 261 may be mapped to a display location within the display region of external display 231, a visual location within visual field region 262 may be mapped to a display location within the display region of external display 232, and so on. Furthermore, the "visual field -> display" map may associate visual field region 248 at the center of the visual field map 203 with the wearable display 202. Some embodiments may set the boundaries of each region as stimulus boundaries. For example, the dashed lines forming visual field region 248 may represent the stimulus boundaries of visual field region 248.

[0033]

[0038] In some embodiments, with reference to FIG. 2A , the first stimulus at the first display location 221 may be presented on the wearable display 202, where the wearable display 202 is attached to a wearable device. In some embodiments, the wearable display 202 may include a transparent display on which one or more stimuli may be presented. Alternatively, or in addition, the wearable display 202 may include an opaque display on which one or more stimuli may be presented. Alternatively, or in addition, the wearable display 202 may include a variable transparency material. For example, the wearable display 202 may include switchable glass, where a portion or all of the wearable display 202 may be made opaque or transparent based on a voltage. The user's eyes may respond to the presentation of the first stimulus at the first display location 221 by moving to a point where gaze is fixed at the first display location 221. During or after presentation of the first stimulus at the first display location 221, a sensor set of the wearable device can measure eye-related characteristics indicative of an eye response. For example, the sensor set can acquire an image of the eye to determine that the eye is focused on the first stimulus at the first display location 221.

[0034]

[0039] Some embodiments can follow the visual field to map the test motion and to select the visual field location to test. Some embodiments can select the second visual field location 252 for testing. After selecting the second visual field location 252, some embodiments can use the "visual field -> display" map to determine that the second stimulus should be displayed at the second display location 222 on the wearable display 202. Then, in some embodiments, the second stimulus can be presented at the second display location 222 of the wearable display 202. After the second stimulus is presented at the second display location 222, the eye, which was previously fixated on the first stimulus at the first display location 221, can then move to and focus on the second stimulus at the second display location 222. In some embodiments, the gaze direction of the eye can be tracked from the first visual field location 251 to the second visual field location 252. For example, following the appearance of a second stimulus at the second display location 222, the peripheral vision of the eye may detect the presence of the second stimulus at the second display location 222 even though the eye is fixated at the first display location 221. Based on the eye response and the association between the second display location 222 and the second viewing location 252, some embodiments may determine that the eye is responding to the stimulus presented at the second viewing location 252 (and may, for example, therefore observe the stimulus presented at such location). Alternatively, some embodiments may determine that the eye has moved from the first display location 221 in the direction of the second display location 222. The motion of the eye towards the second viewing location 252 may signal that the peripheral vision of the eye corresponding to the second viewing location 252 is responsive even when the eye is not fixing its gaze at the second display location 222. Alternatively, if the eye does not respond at all to the presentation of the second stimulus at the second display location 222 or the user performs a motion that does not indicate that they have observed the second stimulus, some embodiments can update the field of view map 203 to indicate that a visual defect exists at the second field of view location 252.

[0035]

[0040] As shown in field of view map 203, an eye may be associated with an eyepiece range 249 that represents the eye's predicted maximum peripheral vision. As shown by field of view region 261, field of view region 263, field of view region 265, and field of view region 267, each individual field of view region may be divided into a first portion that represents the field of view predicted to be observable within eyepiece range 249 and a second portion that represents the field of view that is not observable within eyepiece range 249. For example, field of view region 261 may be divided into observable field of view sub-region 261a and non-observable field of view sub-region 261b. Similarly, some embodiments may divide field of view region 263 into observable field of view sub-region 263a and non-observable field of view sub-region 263b. Similarly, some embodiments may divide field of view region 265 into observable field of view sub-region 265a and non-observable field of view sub-region 265b. Similarly, some embodiments may divide the visual field region 267 into observable visual field sub-region 267a and unobservable visual field sub-region 267b. As described elsewhere in this disclosure, some embodiments may determine whether to select a visual field location for stimulus presentation based on whether the visual field location is within the observable region. For example, some embodiments may first select both a first visual field location within the observable visual field sub-region 267a and a second visual field location within the unobservable visual field sub-region 267b as candidate visual field locations for visual testing. Some embodiments may then filter out the selected visual field location within the unobservable sub-region from the candidate visual field locations, thereby removing the second visual field location from a list of possible future visual field locations for visual testing.

[0036]

[0041] As shown in FIG. 2B, after the gaze location is focused on the second display location 222, another stimulus may be presented at another display location of the external display during or after the second stimulus is presented. Some embodiments may then perform a test operation that causes the system to test the third viewing location 253. Some embodiments may then use the "view→display" map to determine that the third viewing location 253 corresponds to the third display location 223, which in this case is a display location of the external display 231. As shown in FIG. 2B, after a detected change in eye gaze, some embodiments may update the "view→display" map to reflect a shift in the set of viewing regions 261-268 to signal a change in the mapping. Additionally, some embodiments may update the shape or size of the eyepiece area 249 to signal a change in the observable area.

[0037]

[0042] Some embodiments may then display a third stimulus at the third display location 223. The angular distance traveled by the eye by rotating from fixation on the second stimulus displayed at the second display location 222 and the third stimulus displayed at the third display location 223 may be equal to 140 degrees, which may be a distance greater than the angular distance traveled by the eye by focusing between two points at the corners of the AR interface shown on the wearable display 202. Feedback information measured from the user's eye as the eye moves its gaze from the second display location 222 to the third display location 223 may be used to update the field of view map 203 to indicate that the third viewing location 253 is observable by the user. As described elsewhere in this disclosure, some embodiments may update the field of view map 203 to indicate that the field of view of the eye may detect a visual change corresponding to the third viewing location 253 even if the eye's gaze moves its gaze direction toward the third viewing location 253 without actually reaching the third viewing location 253.

[0038]

[0043] Some embodiments may present multiple stimuli simultaneously. For example, some embodiments may present a first stimulus at a second display location 222 on a user interface of the wearable display and display multiple other stimuli on multiple external displays surrounding the field of view of the wearable display. Similarly, some embodiments may then remove or otherwise suppress one or more of the multiple other stimuli while the first stimulus remains displayed. As visual changes occur on the other display locations, these changes may cause the eye to move its gaze in the direction of the visual change. Alternatively, if the eye does not move in the gaze direction of the visual change, some embodiments may determine that the visual change is occurring within a defective area of ​​the field of view of the eye. Also, in some embodiments, the first stimulus may temporarily disappear, flash, or otherwise visually change in a continuous or sequential manner. Alternatively or additionally, the first stimulus may disappear after a new stimulus is presented, but reappear at the same display location after each new stimulus is presented. For example, a stimulus can be presented at the first display location 221 to re-center the eye at the calibrated central position after each presentation of the stimulus at display locations 222-223. By creating these changes to the first stimulus, the first stimulus may act as a calibration stimulus, where the eye can instinctively return to gaze at the first stimulus as a calibration measurement for other measurements.

[0039]

[0044] Further, some embodiments may display multiple stimuli such that at least one stimulus is presented on each of the set of external displays 231-238. As described elsewhere in this disclosure, some embodiments may collect feedback information during or after the presentation of each of the stimuli presented on the set of external displays 231-238 and the wearable display 202. Some embodiments may then generate or otherwise update the visual field map 203 based on the feedback information by determining which stimulus caused the eye to respond to its corresponding presentation and updating the visual field map 203 based on the visual field location associated with the stimulus.

[0040]

[0045] 3 illustrates a flow chart of a process for performing a visual test using multiple displays according to one or more embodiments. Some embodiments may obtain first sensor information informing a relative position or orientation of a wearable device worn by a user in relation to a set of external displays, as indicated by block 302 of process 300. As described elsewhere in this disclosure, the first sensor information may include LIDAR measurements, radar measurements, image measurements, infrared measurements, accelerometer measurements, gyroscope measurements, magnetic measurements, etc. Alternatively, or in addition, some embodiments may receive information from an external sensor to provide location information informing a position of the wearable device in relation to a set of sensors or other objects.

[0041]

[0046] Some embodiments may determine the distance or orientation of the external display by causing a set of calibration stimuli to be presented on the external display. Some embodiments may then use one or more sensors attached to the wearable device or sensors in communication with the wearable device to detect the set of calibration stimuli. Some embodiments may then determine the distance from each of the set of calibration stimuli based on the size or shape of the calibration stimuli. Some embodiments may then determine the position or orientation of the external display based on the set of distance measurements. For example, by determining the distance between each of the four corners of the wearable device and the external display, some embodiments may use a set of geometric operations to determine the distance and orientation of the external display in relation to the wearable device.

[0042]

[0047] Some embodiments may generate a first map representing the positions of the set of external devices based on the positions of the wearable device, as indicated by block 304 of process 300. In some embodiments, the first map may be a "view-to-display" map that is used directly to determine a display location or field of view location for displaying the stimuli based on known display locations. Alternatively, the first map may be an intermediate map used to determine the "view-to-display" map, as described elsewhere in this disclosure.

[0043]

[0048] Various operations may be performed to generate the first map. In some embodiments, a user may provide a position or orientation of the external display relative to the wearable device. For example, some embodiments may receive a first input from the user indicating that the wearable device is set at a first physical location (0,0,1), a second input from the user indicating that the top left corner of an electronic display other than the wearable display is at location (10,0.5,2), and a third input indicating that the bottom right corner of the electronic display is at location (10,-0.5,1). In some embodiments, the coordinates may represent the position of the electronic display in meters in the x, y, and z directions. Alternatively, or in addition, some embodiments may store or use coordinates in other coordinate systems, such as spherical or cylindrical coordinates. Some embodiments may then generate or otherwise update a map based on these inputs indicating the display position and orientation of the electronic display relative to the object position of the wearable device. Additionally, some embodiments may use a "view-to-display" map to determine the view location from the display location.

[0044]

[0049] Alternatively or additionally, some embodiments may use spatial positioning algorithms, such as time-of-flight or SLAM algorithms, to determine the position or orientation of the wearable device relative to the set of external displays. For example, some embodiments may perform real-time spatial mapping to obtain an array of positions that inform objects around the wearable device using images provided by a set of cameras, accelerometer data, and infrared sensor data. The array of positions may be filtered to determine the location of the displays. For example, some embodiments may determine the set of external displays using an object recognition model to recognize a known shape of the display, such as a rectangle bounded by a black border. Alternatively or additionally, some embodiments may determine the location of the external displays based on a set of known visual indicators displayed at the edges or background of the external displays. Some embodiments may then use the filtered set of positions or regions based on the filtered set of positions to determine a first map that informs the display location of the external displays relative to the wearable device. Some embodiments may combine the first map with the set of known positions that represent the display locations of the displays of the wearable device to determine a map that associates the display locations with respect to a target position of the wearable device. In some embodiments, the target position may include a calibrated position associated with a gaze location that represents the user's center of vision.

[0045]

[0050] Some embodiments can determine the field of view of the user's eye relative to the position of the wearable device, as indicated by block 306 of process 300. The field of view of the eye may be centered around the gaze location of the eye, where the visual area surrounding the gaze location may include the peripheral vision of the eye. Some embodiments can use an eye tracking sensor to measure eye movement vectors or other representations of eye-related characteristics. As described elsewhere in this disclosure, some embodiments can continuously measure a set of eye-related characteristics and perform one or more actions based on a determination that an eye-related characteristic has satisfied a set of criteria based on the gaze location, gaze direction, distance moved in the gaze direction, a determination that another characteristic has satisfied a threshold, etc.

[0046]

[0051] Some embodiments may determine a second map that associates the field of view with the display location based on the position of the wearable device relative to the set of external displays and the field of view of the eye relative to the wearable device, as indicated by block 310 of process 300. Some embodiments may perform a matrix transformation operation by transforming the matrix of the first map to generate the second map. Alternatively, some embodiments may modify the result of the first function by using a rotation function based on the rotation of the wearable device or the translational movement of the wearable device. In some embodiments, the first map may store an association between the display location and the field of view location of a fixed field of view representing the front of the wearable device, and the second map may represent a rotation operator or a translation operator that informs the rotation or translation of the eye relative to a calibrated center of the fixed field of view.

[0047]

[0052] In some embodiments, the second map may be a "field-to-display" map. Some embodiments may dynamically update the "field-to-display" map based on changes to the eye configuration. For example, some embodiments may present a first stimulus at a first display location to fixate the eye's gaze at the first stimulus. Some embodiments may then simultaneously remove the first stimulus and add a second stimulus at a second display location. Some embodiments may then determine whether the eye has fixed its gaze at the second display location based on updated feedback information provided by the eye tracking sensor, and in response to determining that the eye has fixed its gaze at the second display location, update the "field-to-display" map by transforming the original "field-to-display" map based on the eye's new gaze location relative to the reference gaze location.

[0048]

[0053] Although the above describes determining a map based on the field of view of the eye relative to a wearable device, some embodiments may determine the map without determining an updated field of view of the eye gaze, for example, some embodiments may determine the map based on the position of the wearable device relative to a set of external displays.

[0049]

[0054] Some embodiments may determine a set of visual field locations for the test operation, as indicated by block 320 of process 300. In some embodiments, the set of visual field locations may be preselected. For example, some embodiments may have a preselected set of visual field locations to test, where each preselected visual field location is associated with a different region of the visual field. Some embodiments may then generate or otherwise obtain a candidate set of visual field locations to be used as a set of stimulus locations.

[0050]

[0055] Some embodiments may rank the set of candidate visual locations to determine a sorted visual location sequence by one or more ranking operations, where the highest ranked visual locations may be prioritized as locations at which stimuli are presented. For example, some embodiments may rank the set of candidate visual locations based on the visual locations furthest from the set of tested visual locations. Alternatively, some embodiments may rank the set of candidate visual locations based on the visual locations closest to a recognized ocular anomaly. For example, some embodiments may select a visual location for testing based on a determination that the selected visual location is closest to a visual defect to which the user's eye was not previously responsive. Additionally, as described elsewhere in this disclosure, some embodiments may determine the ranking in real time using data obtained from a pupil or an eye tracking device, such as an eye tracker or other eye tracking device.

[0051]

[0056] Some embodiments may select the test locations using a random or pseudorandom value, where the random value may be determined based on a physical sensor, and the pseudorandom value may be determined based on a pseudorandom algorithm. For example, some embodiments may determine a viewing distance from pre-tested viewing locations, where the viewing distance may exceed or otherwise meet a distance threshold. Some embodiments may determine a first set of test locations and then select the next viewing location from the first set of test locations based on a random or pseudorandom value. By using a random or pseudorandom selection process, some embodiments may prevent a user's pattern learning behavior from affecting the accuracy of the viewing map.

[0052]

[0057] Some embodiments may dynamically determine future visual field locations to test based on the results of previous tests. For example, based on a determination that a first visual field location is associated with a detected missing area or another type of ocular anomaly, some embodiments may determine whether the first visual field location is near a stimulus boundary of a display area in which the first visual field is presented. Based on a determination that the first visual field location is within a distance threshold of the stimulus boundary, some embodiments may select a second visual field location or area associated with the visual field location for future presentation. As described elsewhere in this disclosure, some embodiments may then present a second stimulus on an external display at an external display location that is mapped to the second visual field location by the "visual field-to-display" map, and may collect further feedback information. Based on the collected further feedback information, some embodiments may modify the size or shape of the detected missing area or other ocular anomaly.

[0053]

[0058] Some embodiments may select a set of display locations associated with the determined set of viewing locations for the test operation based on a second map, where the second map associates a set of display locations with the set of viewing locations, as indicated by block 330 of process 300. For example, some embodiments may obtain a first viewing location represented by polar coordinates [0.5,0.5] representing the polar coordinates of the viewing field to test. Some embodiments may then select the display location by using a "view-to-display" map by determining a display location associated with the polar coordinates [0.5,0.5]. In some embodiments, the polar coordinates [0.5,0.5] may be transformed to a modified set of polar coordinates based on eye rotation. For example, some embodiments may determine that the eye is focused at the polar coordinates [0.1,0.1] relative to a fixed front vector of the wearable device. Some embodiments may then modify the polar coordinates based on the eye gaze location and update the polar coordinates to be [0.6,0.6]. Some embodiments may then determine a viewing location that is mapped to polar coordinates [0.6,0.6]. As described elsewhere in this disclosure, some embodiments may determine a viewing location sequence.

[0054]

[0059] Some embodiments may present a set of stimuli at a set of display locations, as indicated by block 335 of process 300. In some embodiments, the stimuli presented at the display locations may include a static fixation point, such as a black or red dot. Alternatively or additionally, the stimuli presented at the display locations may include animations, pictures, letters, symbols, etc. In some embodiments, the stimuli presented on the multiple displays may be scaled to account for differences between the displays. For example, some embodiments may obtain a sequence in which a presentation of a first red circle appears on the external display and a second red circle appears on the wearable device display. Some embodiments may then determine a length of the stimulus to scale one red circle based on the other. For example, some embodiments may determine the distance between the wearable device and the external display and increase the size of the stimulus presented on the external display in a proportional manner, such that the stimulus on the external display appears at the same size as the stimulus on the wearable device display.

[0055]

[0060] Some embodiments may collect feedback information using a set of eye tracking sensors, as indicated by block 340 of process 300. In some embodiments, the feedback information may signal gaze direction, angular distance the eye has moved, or another eye-related characteristic. For example, an eye tracking sensor in a wearable device may signal that the eye's gaze location has moved toward the stimulus from its initial gaze location by a distance of 0.3, where distance may represent an angular distance, a Euclidean distance, or a distance in an eye-related coordinate system. Additionally, some embodiments may collect additional feedback information such as head movement, acoustics, etc.

[0056]

[0061] Some embodiments may update the visual indication map or the associated ocular anomaly information of the eye based on the feedback information and the set of response criteria, as indicated by block 350 of process 300. Some embodiments may update the visual indication map to indicate whether the eye is responsive or unresponsive to the stimulus based on the set of criteria. For example, after a stimulus is presented at a visual field location, some embodiments may indicate that the visual field location is not observed and may associate the visual field location with an ocular anomaly based on a determination that feedback information collected at a later time does not satisfy the set of response criteria. The indication of the ocular anomaly may be stored as part of a visual field map, which may be used to store ocular anomaly information indicating locations or regions of the visual field of the eye that are healthy and regions of the visual field of the eye that are associated with one or more ocular anomalies.

[0057]

[0062] Some embodiments may determine that the eye's gaze has entered a viewing region mapped to a display region of an external display, thereby determining that feedback information collected by the set of eye tracking sensors satisfies a set of response criteria. For example, some embodiments may present a first stimulus at the wearable display location that causes the eye's gaze to be fixed at the first wearable display location. Some embodiments may then present a second stimulus at the external display location of the first external display. The feedback information may then indicate that the eye's gaze is focused on a region of the first external display. In response, some embodiments may determine that feedback information collected by the set of eye tracking sensors satisfies a criterion that indicates that the eye has observed the second stimulus. As described elsewhere in this disclosure, some embodiments may then update the eye's viewing map to indicate that the eye can observe the presented stimulus at the location mapped to the viewing location.

[0058]

[0063] Some embodiments may determine that the eye has responded to the presentation of a stimulus at a display location based on a determination that the movement of the user's eye indicates that the eye's gaze is within a boundary region of the eye's visual field. In some embodiments, the boundary region of the visual field may define an area of ​​the visual field within which the eye's gaze direction must remain while moving toward the displayed stimulus. For example, the boundary region may include an area between lines that are no more than a certain number of radians (e.g., 0.6 radians, 0.4 radians, 0.20 radians, or some other number of radians) away from a straight path from the eye's initial gaze location to the presented stimulus. For example, some embodiments may determine that the eye's gaze remains within the boundary region after the stimulus is presented until the eye's gaze reaches a viewing location that is mapped to the display location of the external screen. As described elsewhere in this disclosure, some embodiments may then update the eye's ocular anomaly information or associated visual field map to indicate that the eye is responding to the presented stimulus at the viewing location.

[0059]

[0064] Some embodiments may determine that the eye gaze has moved outside the bounding area of ​​the presented stimulus. In response, some embodiments may update the ocular anomaly information, such as by updating a visual field map that preserves the anomaly boundaries of one or more ocular anomalies, to indicate that a visual defect or another type of ocular anomaly is preventing the eye from observing the presented stimulus. For example, a peripheral stimulus may be presented at an external display location while the user's eye is fixed on a first stimulus at a wearable display location. Even if the eye does not detect the peripheral stimulus, the eye may start to move around as part of the user's conscious or subconscious behavior. If this movement causes the eye gaze to exceed the bounding box, some embodiments may indicate that the visual field location mapped to the external display location may be part of the ocular anomaly, even if the eye gaze is later focused on the stimulus.

[0060]

[0065] Some embodiments may determine that feedback information collected by the set of eye tracking sensors meets a set of response criteria by determining that the eye has moved at least a threshold distance toward the stimulus or toward a display presenting the stimuli. For example, after the eye gaze fixates on a stimulus positioned at the second display location 222, some embodiments may present a second stimulus at the third display location 223. Some embodiments may use the set of eye tracking sensors to determine whether the eye gaze moves a threshold distance toward the third display location 223. For example, some embodiments may determine whether the gaze has moved at least 60% of the distance between the second display location 222 and the third display location 223, where 60% may be the distance threshold. Although the above uses a distance threshold of 60%, some embodiments may use other distance thresholds, such as 40%, 50%, 80%, 90%, or other values.

[0061]

[0066] Some embodiments may require different criteria to be satisfied by the eye feedback information before determining that the feedback information satisfies criteria that indicate the presence or absence of an ocular anomaly. For example, some embodiments may present a first stimulus at an external display location of an external display and determine that the eye gaze must move within a boundary region until the gaze is within a display area corresponding to the screen of the external display. Alternatively or additionally, some embodiments may allow for the satisfaction of different combinations of criteria to update the ocular anomaly information for the eye or the associated visual field map. For example, some embodiments may determine that the visual field location of the eye is capable of detecting a stimulus presented on the display if the eye gaze remains within a boundary region and reaches a display area mapped to the display or the eye gaze moves a threshold distance in the direction of the stimulus.

[0062]

[0067] In some embodiments, the set of response criteria can represent notification of an eye-related condition based on color or luminance. For example, the sequence of stimuli displayed on the external display can be presented over time with a varying luminance that becomes darker or brighter each time a stimulus of the stimulus sequence is presented on the external display. Alternatively or additionally, presenting the sequence of stimuli can include presenting a stimulus that is presented with a first color and then with a second color. Some embodiments can determine a luminance value or color that induces eye motion and store these values ​​in association with a visual field location mapped to the display location or a visual field region associated with the mapped visual field location. For example, some embodiments can present a stimulus on the external display that changes from a first luminance to a second luminance and collect eye-related characteristics during the luminance change to determine whether the eye is responsive to the luminance change. Based on a determination that the eye is responsive to the luminance change, some embodiments can update ocular anomaly information or an associated visual field map based on feedback information collected during or after the luminance change. For example, some embodiments may determine that the eye's gaze has moved from an initial gaze location to a display location of the stimulus that has been altered in luminance, and in response, may update the eye's visual field map to indicate that the eye is responding to the change in luminance at the visual field location mapped to the display location. Some embodiments may perform similar operations described above to change the color of the stimuli, and may update the visual field map to indicate that the eye is or is not responding to the color change for the tested set of colors at the visual field location.

[0063]

[0068] Some embodiments may use machine learning models to detect the presence of an ocular anomaly. For example, some embodiments may provide eye tracking data of the eye, other feedback information, or a visual field map of the eye to a convolutional neural network trained to detect one or more ocular anomalies associated with the eye. The convolutional neural network may perform operations to determine an anomaly boundary of the ocular anomaly, such as the shape of a defective area (e.g., a blind spot or other visual defect) in a peripheral region of the eye. Some embodiments may then use the predicted anomaly boundary to determine future visual field locations to test. For example, some embodiments may determine whether the anomaly boundary overlaps with a stimulus boundary of a first display region and may present a second stimulus on an adjacent region of the first display region. Some embodiments may then perform further measurements to update the anomaly boundary of the ocular anomaly based on further feedback information collected after the presentation of the second stimulus.

[0064]

[0069] Some embodiments may repeat one or more of the above-described operations based on a sequence of viewing locations. For example, some embodiments may perform the above-described operations to generate a corresponding sequence of display locations, where the sequence of display locations may be updated in real-time based on updates to the "view→display" map to display the stimuli on a device display of the wearable device or an external display. For example, some embodiments may obtain a viewing sequence that prioritizes a first viewing location over a second viewing location, where the first and second viewing locations are consecutive. Some embodiments may then determine a first display location based on the first viewing location and the updated "view→display" map at a first time point, and may determine a second display location based on the second viewing location and the "view→display" map after the map is updated at a second time point. In some embodiments, the first display location may be an external display location, and the second display location may be a wearable device location. Some embodiments may then display a first stimulus at the first display location at a first time point, and then display a second stimulus at a second display location on the wearable device display at a second time point.

[0065]

[0070] For each generated stimulus, some embodiments may perform operations to determine whether feedback information informing a set of characteristics related to the eye satisfies a set of response criteria and may update ocular anomaly information for the eye, such as by updating a visual field map. For example, some embodiments may generate a visual field map for the eye based on feedback information collected after presentation of the first and second stimuli on a first external display and a wearable device display that extend horizontally across 150 degrees relative to the eye. Some embodiments may then present a third stimulus at a third display location associated with a visual field location that is 160 degrees horizontally from the eye's current gaze location and may expand a dimension of the visual field map based on a determination that the eye has responded to the presence of the third stimulus.

[0066]

[0071] 4, in some embodiments, the system 100 may include a visual acuity system 400, which includes a visual acuity testing framework 402. The visual acuity testing framework 402 may be implemented on an image processing device 404 and on a wearable device 406 for placement on a subject. The image processing device 404 may be entirely contained within an external image processing device or other computer, although in other examples, all or a portion of the image processing device 404 may be implemented within the wearable device 406.

[0067]

[0072] The image processing device 404 may include a memory 408 storing instructions 410 that, when executed by the processor 412, perform the testing and / or visioning modes described herein and instructions to collect feedback information from the wearable device 406. In some embodiments, the wearable device 406 may capture real-time visual field image data as raw data, processed data, or pre-processed data. In some embodiments, the wearable device display of the wearable device 406 may be positioned in front of the eye and may present stimuli such as text, images, or other objects, where the response of the eye may be used to generate or update a visual field map of the eye.

[0068]

[0073] The wearable device 406 can be communicatively connected to the image processing device 404 through a wired or wireless link. The link can be through Universal Serial Bus (USB), IEEE 1394 (Firewire), Ethernet, or other wired communication protocol devices. The wireless connection can be through any suitable wireless communication protocol such as WiFi, NFC, iBeacon, Bluetooth, Bluetooth low energy, etc.

[0069]

[0074] In various embodiments, the image processing device 404 can have a controller operatively connected to a database 420 via a link connected to an input / output (I / O) circuit 424. Additional databases can be linked to the controller in known manner. The controller can include a program memory, a processor 412 (which may be referred to as a microcontroller or microprocessor), a random access memory (RAM), and an I / O circuit 424, all of which can be interconnected via an address / data bus. Although only one microprocessor is described, it should be understood that the controller can include multiple microprocessors. Similarly, the memory of the controller can include multiple RAMs and multiple program memories. The RAM and program memory can be implemented as semiconductor memory, magnetically readable memory, and / or optically readable memory. A link can operatively connect the controller to the capture device through the I / O circuit 424.

[0070]

[0075] The program memory and / or RAM can store various applications (i.e., machine-readable instructions) for execution by the microprocessor. For example, an operating system can generally control the operation of the vision system 400, such as the operation of the wearable device 406 and / or the image processor 404, and in some embodiments can provide a user interface to the device for implementing the processes described herein. The program memory and / or RAM can also store various subroutines for accessing specific functions of the image processor 404 described herein. By way of example and not limitation, the subroutines can include, among others, obtaining a high resolution image of the visual field from the spectacle device, enhancing and / or correcting the image, and providing the enhanced and / or corrected image for presentation to the subject by the wearable device 406.

[0071]

[0076] In addition to those mentioned above, the image processing unit 404 may include other hardware resources. The device may also include or be connected to various types of I / O hardware, such as an electronic display 450 and an input device 451, where the input device 451 may include devices such as a keypad, keyboard, and the like. In some embodiments, the electronic display 450 may be touch-sensitive and may cooperate with a software keyboard routine as one of the software routines to receive user input. It may be advantageous for the image processing unit 404 to communicate with a wider network (not shown) through any of a number of known networking devices and techniques (e.g., through a computer network such as an intranet, the Internet, and the like). For example, the device may be connected to a database of ocular anomaly data.

[0072]

[0077] Each method operation presented in this disclosure is for illustrative purposes, not limiting. It is contemplated that the operations or descriptions of FIG. 3 may be used with any other embodiment of the present disclosure. In addition, the operations and descriptions described in connection with FIG. 3 may be performed in alternate orders or in parallel to further the objectives of the present disclosure. For example, each of these operations may be performed in any order, in parallel or simultaneously to reduce lag or increase the speed of a computer system or method. In some embodiments, the method may be implemented with one or more additional operations not described and / or without one or more of the operations described. In addition, the order in which the process operations of the method are shown (and described below) is not intended to be limiting.

[0073]

[0078] In some embodiments, the operations described in this disclosure can be implemented in one or more processing devices (e.g., digital processors, analog processors, digital circuits designed to process information, analog circuits designed to process information, state machines, and / or other mechanisms for electronically processing information). A processing device can include one or more devices that perform some or all of the operations of the method in response to instructions stored electronically on a non-transitory machine-readable medium, such as an electronic storage medium. A processing device can include one or more devices configured through hardware, firmware, and / or software specifically designed for the execution of one or more of the operations of the method. For example, it should be noted that any of the devices or apparatus described in connection with FIG. 1A or FIG. 4 can be used to perform one or more of the operations of FIG. 3.

[0074]

[0079] It should be noted that features and limitations described in any one embodiment may be applied to any other embodiment herein, and that flow charts or examples relating to one embodiment may be combined with any other embodiment in an appropriate manner, performed in a different order, or performed in parallel. In addition, the systems and methods described herein may be performed in real time. It should also be noted that the above-described systems and / or methods may be applied to or used in accordance with other systems and / or methods.

[0075]

[0080] In some embodiments, the various computer systems and subsystems illustrated in FIG. 1A or FIG. 4 may include one or more computing devices programmed to perform the functions described herein. The computing devices may include one or more electronic storage (e.g., set of databases 130), one or more physical processors programmed with one or more computer program instructions, and / or other components. The computing devices may include communication lines or ports to enable the exchange of information between a set of networks (e.g., network 150) or other computing platforms via wired or wireless techniques. The networks may include the Internet, a cellular network, a mobile voice or data network (e.g., 5G or LTE networks), a cable network, a public switched telephone network, or other types of communication networks, or combinations of communication networks. The network 150 may include Ethernet, satellite paths, fiber optic paths, cable paths, paths supporting Internet communications (e.g., IPTV), free space connections (e.g., for broadcast or other wireless signals), WiFi, Bluetooth, near field communications, or any other suitable wired or wireless communication paths, or combinations of such paths. A computing device may include additional communication paths linking multiple cooperating hardware, software, and / or firmware components. For example, a computing device may be implemented by a cloud of computing platforms that cooperate as a computing device.

[0076]

[0081] Each of these devices described in this disclosure may also include electronic storage. Electronic storage may include non-transitory storage media that electronically store information. The storage media of electronic storage may include one or both of: (i) system storage provided integrally with the server or client device (e.g., substantially non-removable); or (ii) removable storage that is removably connectable to the server or client device, for example, via a port (e.g., USB port, Firewire port, etc.) or drive (e.g., disk drive, etc.). Electronic storage may include one or more of an optically readable storage medium (e.g., optical disk, etc.), a magnetically readable storage medium (e.g., magnetic tape, magnetic hard drive, floppy drive, etc.), a charge-based storage medium (e.g., EEPROM, RAM, etc.), a solid-state storage medium (e.g., flash drive, etc.), and / or an electronically readable storage medium. The electronic storage may include one or more virtual storage resources (e.g., cloud storage, virtual private networks, and / or other virtual storage resources). The electronic storage may store information determined by a software algorithm, a processor, obtained from a server, obtained from a client device, or other information that enables the functionality described herein.

[0077]

[0082] A processor can be programmed to provide information processing capabilities within a computing device. Thus, a processor can include one or more of a digital processor, an analog processor, a digital circuit designed to process information, an analog circuit designed to process information, a state machine, and / or other mechanisms for electronically processing information. In some embodiments, a processor can include multiple processing units. These processing units may be physically located within the same device, or a processor may represent the processing functions of multiple devices working together. A processor can be programmed to execute computer program instructions to perform the functions described herein of subsystems 122-125 or other subsystems. A processor can be programmed to execute computer program instructions by software, hardware, firmware, any combination of software, hardware, or firmware, and / or other mechanisms for configuring processing capabilities on a processor.

[0078]

[0083] It should be understood that the description of the functionality provided by the different subsystems 122-125 described herein is for illustrative purposes and is not intended to be limiting, as any of the subsystems 122-125 may provide more or less functionality than that described. For example, one or more of the subsystems 122-125 may be eliminated and some or all of its functionality may be provided by other ones of the subsystems 122-125. As another example, additional subsystems may be programmed to perform some or all of the functionality attributed herein to one of the subsystems 122-125.

[0079]

[0084] In relation to the components of the computing devices described in this disclosure, each of these devices can receive content and data via an input / output (hereinafter "I / O") path. Each of these devices can also include a processor and / or control circuitry for sending and receiving commands, requests, and other suitable data using the I / O path. The control circuitry can have any suitable processing, storage, and / or input / output circuitry. Additionally, some or all of the computing devices described in this disclosure can include a user input interface and / or a user output interface (e.g., a display) used in receiving and displaying data. In some embodiments, a display such as a touch screen can also function as a user input interface. It should be noted that in some embodiments, one or more of the devices described in this disclosure may not have a user input interface or a display, and may instead receive and display content using another device (e.g., a dedicated display device such as a computer screen and / or a dedicated input device such as a remote control, a mouse, voice input, etc.). In addition, one or more of the devices described in this disclosure can execute an application (or another suitable program) that performs one or more of the operations described in this disclosure.

[0080]

[0085] While the present invention has been described in detail for purposes of illustration based on what are presently considered to be the most practical and preferred embodiments, it should be understood that such details are for this purpose only, and that the present invention is not limited to the disclosed embodiments, but rather is intended to cover modifications and equivalent arrangements within the scope of the appended claims. For example, it should be understood that the present invention contemplates that, to the extent possible, one or more features of any embodiment can be combined with one or more features of any other embodiment.

[0081]

[0086] As used throughout this application, the term "may" is used in a non-mandatory sense (i.e., does not mean must) but permissive sense (i.e., means having the potential). The terms "include," "including," "includes," and the like, mean inclusion rather than limitation. As used throughout this application, the singular forms "a," "an," and "the" include plural references unless the context dictates otherwise. Thus, for example, a reference to "an element" or "a element" includes a combination of two or more elements, notwithstanding the use of other terms or phrases for one or more elements, such as "one or more." The term "or" is non-exclusive (i.e., includes both "and" and "or") unless the context clearly dictates otherwise. Terms describing conditional relationships (e.g., "in response to X, Y," "upon X, Y," "if X, Y," "when X, Y," and the like) encompass causal relationships in which the antecedent is a necessary causal condition, a sufficient causal condition, or a leading causal condition of the subsequent (e.g., "state X occurs when condition Y obtains" applies to both "X occurs only if Y" and "X occurs when Y and Z"). Such conditional relationships are not limited to outcomes that directly follow the obtaining of the antecedent, since some outcomes may be delayed, and in a conditional description, the antecedent is connected to its subsequent (e.g., the antecedent is related to the likelihood of the occurrence of the subsequent).A statement that multiple attributes or functions are mapped to multiple entities (e.g., one or more processors perform steps / actions A, B, C, and D) encompasses both all such attributes or functions being mapped to all such entities and a subset of attributes or functions being mapped to a subset of attributes or functions (e.g., both all processors perform steps / actions A-D, respectively, and processor 1 performing step / action A, processor 2 performing step / action B and a portion of step / action C, and processor 3 performing a portion of step / action C and step / action D), unless otherwise indicated. Furthermore, a statement that one value or action is "based on" another state or value encompasses both instances in which the state or value is the only factor and instances in which the state or value is one factor of multiple factors, unless otherwise indicated.

[0082]

[0087] Unless the context clearly indicates otherwise, a statement that "each" instance of some aggregate has some property should not be construed to exclude cases where some other identical or similar members of the larger aggregate do not have the property (i.e., each does not necessarily mean each and every). Restrictions on the sequence of recited steps should not be read into the claims unless expressly specified (e.g., by express language such as "after performing X, perform Y"), as opposed to statements that could be improperly argued to imply sequence limitations used for the purpose of making the claims relatively readable rather than to prescribe a sequence (e.g., "perform X on the items, and perform Y on the items that have been X'd"). Statements referring to "at least Z of A, B, and C" and the like (e.g., "at least Z of A, B, or C") refer to at least Z of the enumerated categories (A, B, and C) and do not require at least Z units in each category. Unless the context clearly indicates otherwise, statements utilizing terms such as "processing," "computing," "calculating," "determining," or the like throughout this specification should be understood to refer to the actions or processes of a particular device, such as a special purpose computer or similar special purpose electronic processing / computing device. Furthermore, unless indicated otherwise, updating an item may include creating an item or modifying an existing time. Thus, updating a record may include creating a record or modifying the value of a value that has already been created.

[0083] Enumeration of embodiments

[0088] The present teachings may be more fully understood with reference to the following enumerated embodiments.

[0084] 1. A method comprising: obtaining spatial information indicative of one or more positions of one or more electronic displays relative to a wearable device; determining a first display location on an electronic display other than a wearable display of the wearable device based on the spatial information; determining a second display location based on the spatial information; generating a presentation of (i) a first stimulus at the first display location and (ii) a second stimulus at the second display location on the electronic display; and generating ocular anomaly information based on feedback information related to the presented stimuli.

[0085] 2. The method of embodiment 1, wherein determining the first display location includes selecting the first display location based on spatial information indicating that the first display location on the electronic display corresponds to the first viewing location in the field of view.

[0086] 3. The method of any one of embodiments 1-2, wherein the second display location is on a wearable device.

[0087] 4. The method of any one of embodiments 1 to 3, wherein determining the second display location includes selecting the second display location based on spatial information indicating that the second display location on the wearable display corresponds to a second viewing location in the field of view.

[0088] 5. A method comprising: acquiring, via one or more sensors, spatial information indicative of one or more positions of one or more electronic displays relative to a wearable device; updating a map indicative of an association between a first viewing location of a visual field and a display location of an external display based on the spatial information; selecting, for a visual test, a first display location on an electronic display other than the wearable display of the wearable device based on the map indicative of an association between the first viewing location of a visual field to be tested during the visual test and the first display location of the electronic display; selecting, for the visual test, a second display location on the wearable device based on the map indicative of an association between a second viewing location of a visual field to be tested during the visual test and the second display location of the wearable device; generating, during the visual test, a presentation of (i) a first stimulus at the first display location on the electronic display and (ii) a second stimulus at the second display location on the wearable device; and generating ocular anomaly information based on feedback information related to the presented stimuli.

[0089] 6. A method comprising: collecting sensor information using one or more sensors having relative spatial information indicative of an orientation and position of one or more external displays relative to a wearable device; continuously updating a "view-to-display" map based on the relative spatial information, the "view-to-display" map indicative of (i) an association between a viewing location of a viewing field and an external display location of one or more external displays and (ii) an association between a viewing location of the viewing field and a wearable display location of a wearable display of the wearable device; and, in response to the "view-to-display" map indicative of (i) a viewing location sequence indicative of a first viewing location to be tested at a first time point and (ii) an association between the first viewing location and the external display location. The method includes selecting an external display location of an external display as a corresponding display location for the first visual field location, selecting a wearable display location of a wearable device as a corresponding display location for the second visual field location of the visual field in response to (i) a visual field location sequence indicating the second visual field location to be tested at a second time point and (ii) a ``visual field → display'' map indicating an association between the second visual field location and the wearable display location, generating a presentation of (i) a stimulus at the external display location associated with the first visual field location at the first time point and (ii) a stimulus at the wearable display location associated with the second visual field location at the second time point, and generating ocular anomaly information based on feedback information related to the presented stimuli.

[0090] 7. The method of any one of embodiments 1 to 6, further comprising: determining that the stimulus boundary surrounds a region of the visual field associated with the external display and that the first visual field location is associated with an ocular anomaly identified by the ocular anomaly information prior to presentation of the stimulus at the external display location; and determining whether the first visual field location is within a distance threshold of the stimulus boundary, wherein presenting the stimulus at the external display location includes presenting the stimulus at the external display location in response to determining that the first visual field location is within the distance threshold of the stimulus boundary.

[0091] 8. A method of any one of embodiments 1 to 7, further comprising detecting rotational or translational movement of the wearable device between the presentation of a first stimulus at the external display location and the presentation of the stimulus at the wearable display location, and updating a "field of view → display" map based on the rotational or translational movement of the wearable device, wherein presenting the stimulus at the external display location includes using the updated "field of view → display" map.

[0092] 9. A method of any one of embodiments 1 to 8, further comprising providing first feedback information to a predictive model to detect ocular abnormalities identified by ocular abnormality information and an abnormality boundary associated with the ocular abnormality, the first feedback information being collected during or after the presentation of the first stimulus and prior to the presentation of the second stimulus, and determining whether the abnormality boundary overlaps with a stimulus boundary of the electronic display, wherein generating the presentation of the second stimulus includes generating the presentation of the second stimulus based on a determination that the abnormality boundary overlaps with the stimulus boundary.

[0093] 10. A method of any one of embodiments 1 to 9, wherein generating the ocular abnormality information includes determining whether a gaze location has moved from a first viewing area associated with the electronic display to a second viewing area associated with the wearable display, and based on a determination that the gaze location has moved from the first viewing area to the second viewing area, updating the visual field map to indicate that a stimulus presented at the second viewing location is detectable.

[0094] 11. The method of any one of embodiments 1 to 10, wherein presenting the second stimulus includes presenting a second stimulus having a shape having a second stimulus length associated with the second stimulus, and the method further includes determining a distance between the wearable device and the electronic display, and determining a first stimulus length by scaling the second stimulus length by the distance, wherein the first stimulus is presented based on the first stimulus length.

[0095] 12. The method of any one of embodiments 1 to 11, wherein the electronic display is a first electronic display, and further comprising presenting a third stimulus on a second electronic display of a second display device, collecting further feedback information during or after the presentation of the third stimulus, and expanding a dimension of the visual field map of the visual field based on the further feedback information.

[0096] 13. The method of any one of embodiments 1 to 12, wherein the feedback information includes a gaze direction and a distance traveled in the gaze direction, and wherein generating the ocular anomaly information includes determining whether the distance satisfies a distance threshold, and in response to determining that the distance satisfies the distance threshold, updating a visual field map of the visual field to indicate that the eye is responding to a stimulus associated with the second visual field location.

[0097] 14. A method of any one of embodiments 1 to 13, wherein presenting the first stimulus includes presenting the first stimulus having a first luminance, presenting the first stimulus having a second luminance, and collecting a portion of feedback information upon a change in luminance.

[0098] 15. The method of any one of embodiments 1 to 14, wherein presenting the first stimulus includes presenting a first stimulus having a first color, presenting a first stimulus having a second color, and collecting a portion of feedback information upon a color change.

[0099] 16. A method of any one of embodiments 1 to 15, wherein generating ocular abnormality information includes determining a boundary region of the visual field, the boundary region being between lines equal to a certain number of radians away from a straight path from the first visual field location to the second visual field location; determining whether the gaze location remains within the boundary region as the gaze location moves toward the second visual field location; and detecting the ocular abnormality based on a determination that the gaze location does not remain within the boundary region as the gaze location moves toward the second visual field location.

[0100] 17. A method of any one of embodiments 1 to 16, further comprising presenting an initial stimulus prior to presentation of a first stimulus, wherein the eye tracking sensor acquires a set of eye-related characteristics after presentation of the initial stimulus, and updating the map based on the set of eye-related characteristics, wherein selecting the first display location comprises selecting the first display location based on the updated map.

[0101] 18. The method of any one of embodiments 1 to 17, wherein the electronic display is a first electronic display, presenting a set of stimuli on a plurality of electronic displays, each individual stimulus of the set of stimuli being presented on an individual electronic display of the plurality of electronic displays, the plurality of electronic displays having the first electronic display, and further comprising updating feedback information based on sensor information obtained by an eye tracking sensor during or after the presentation of each stimulus of the set of stimuli, and updating a visual field map of the visual field based on the updated feedback information.

[0102] 19. A method according to any one of embodiments 1 to 18, wherein generating ocular abnormality information includes providing feedback information to a machine learning model and detecting ocular abnormalities based on an output of the machine learning model.

[0103] 20. The method of any one of embodiments 1 to 19, wherein the electronic display is a first electronic display and further comprises presenting a calibration stimulus at a second display location prior to presenting the first stimulus.

[0104] 21. The method of any one of embodiments 1 to 20, wherein the electronic display is a first electronic display, and further comprising presenting a third stimulus on the first electronic display by determining a set of candidate viewing locations separated from the second viewing location by at least a distance threshold, where at least one location of the set of candidate viewing locations is mapped to a third display location on a second electronic display other than the wearable display; selecting a third viewing location from the set of candidate viewing locations based on a random or pseudo-random value; and displaying the third stimulus on the second electronic display at the third display location mapped to the third viewing location.

[0105] 22. The method of any one of embodiments 1 to 21, further comprising presenting a set of calibration stimuli on the electronic display, determining a set of distance measurements based on the set of calibration stimuli, and determining a position and orientation of the electronic display based on the set of distance measurements.

[0106] 23. A method according to any one of embodiments 1 to 22, wherein selecting the first display location includes determining a set of candidate field of view locations, obtaining a boundary of an observable area based on a field of view map of the field of view, updating the set of candidate field of view locations based on the boundary and the set of candidate field of view locations by removing a candidate field of view location from the set of candidate field of view locations based on a determination that the candidate field of view location is not within the observable area, wherein the updated set of candidate field of view locations includes the first display location, and selecting the first display location from the updated set of candidate field of view locations.

[0107] 24. One or more tangible, non-transitory, machine-readable media storing instructions that, when executed by one or more processors, perform operations having the structure of any one of embodiments 1 to 23.

[0108] 25. A system comprising one or more processors and a memory storing computer program instructions that, when executed by the one or more processors, cause the one or more processors to perform operations having any one of embodiments 1 to 23.

[0109] A wearable device comprising one or more sensors that collect sensor information having relative spatial information indicating an orientation and position of one or more external displays in relation to a wearable display of the wearable device, and one or more processors that execute computer program instructions that, when executed, cause the one or more processors to realize operations having any one of those of embodiments 1 to 23.

Claims

1. A wearable device for ocular anomaly detection via mapping visual field locations to display locations on both a wearable device display and an external display, comprising: one or more sensors that collect sensor information having relative spatial information indicative of an orientation and position of one or more external displays in relation to the wearable device; one or more processors for executing computer program instructions; which instructions, when executed, based on the relative spatial information, continuously updating a "view→display" map that indicates (i) an association between a viewing location of the view and an external display location of one or more external displays, and (ii) an association between a viewing location of the view and a wearable display location of a wearable display of the wearable device; selecting an external display location of an external display as a corresponding display location for the first viewing location of the field of view in response to (i) a field location sequence indicating a first viewing location to be tested at a first time point and (ii) the "field-to-display" map indicating an association between the first viewing location and the external display location; selecting a wearable display location of the wearable device as a corresponding display location for the second visual field location of the visual field in response to (i) the visual field location sequence indicating a second visual field location to be tested at a second time point and (ii) the "visual field to display" map indicating an association between the second visual field location and the wearable display location; generating a presentation of (i) a stimulus at the external display location associated with the first viewing location at the first time point and (ii) a stimulus at the wearable display location associated with the second viewing location at the second time point; generating ocular anomaly information based on feedback information related to the presented stimulus; and A wearable device that generates a motion having the following characteristics:

2. a stimulus boundary encircling an area of ​​the visual field associated with the external display, and the action comprises: determining, prior to the presentation of the stimulus at the external display location, that the first viewing location is associated with an ocular anomaly identified by the ocular anomaly information; determining whether the first viewing location is within a distance threshold of the stimulus boundary, wherein presenting the stimulus at the external display location comprises presenting the stimulus at the external display location in response to determining that the first viewing location is within the distance threshold of the stimulus boundary; The wearable device of claim 1 , further comprising:

3. The operation includes: Detecting rotational or translational movement of the wearable device between the presentation of the stimuli at the external display location and the presentation of the stimuli at the wearable display location; updating the field-to-display map based on the rotational or translational motion of the wearable device, and presenting the stimuli at the external display location comprises using the updated field-to-display map; The wearable device of claim 1 , further comprising:

4. 1. A method comprising: Obtaining spatial information, via one or more sensors, informing one or more positions of one or more electronic displays relative to the wearable device; updating a map indicating an association between a first viewing location of the field of view and a display location of the external display based on the spatial information; selecting for a visual test a first display location on an electronic display other than a wearable display of the wearable device based on the map indicating an association between a first viewing location of the visual field and a first display location of the electronic display to be tested during the visual test; selecting, for the visual test, a second display location on the wearable device based on the map indicating an association between a second visual field location of the visual field to be tested and a second display location on the wearable device; generating, during the visual testing, a presentation of (i) a first stimulus at the first display location on the electronic display and (ii) a second stimulus at the second display location on the wearable device; generating ocular anomaly information based on feedback information related to the presented stimulus; and The method according to claim 1,

5. providing first feedback information to a predictive model to detect ocular anomalies identified by the ocular anomaly information and an anomaly boundary associated with the ocular anomaly, the first feedback information being collected during or after the presentation of the first stimulus and prior to the presentation of the second stimulus; determining whether the abnormality boundary overlaps a stimulus boundary of the electronic display, and generating the presentation of the second stimulus comprises generating the presentation of the second stimulus based on a determination that the abnormality boundary overlaps the stimulus boundary; The method of claim 4 further comprising:

6. Generating the ocular abnormality information includes: determining whether a gaze location has moved from a first viewing area associated with the electronic display to a second viewing area associated with the wearable display; updating a visual field map to indicate that the stimulus presented at the second visual field location is detectable based on a determination that the gaze location has moved from the first visual field area to the second visual field area; 5. The method of claim 4, comprising:

7. Presenting the second stimulus includes presenting a second stimulus having a shape with a second stimulus length associated with the second stimulus, the method further comprising: determining a distance between the wearable device and the electronic display; determining a first stimulus length by scaling the second stimulus length by the distance, the first stimulus being presented based on the first stimulus length; The method of claim 4 further comprising:

8. the electronic display is a first electronic display, and the method comprises: presenting a third stimulus on a second electronic display of a second display device; and collecting further feedback information during or after presentation of the third stimulus; and expanding a dimensionality of a field of view map of the field of view based on the further feedback information; The method of claim 4 further comprising:

9. The feedback information includes a gaze direction and a distance moved in the gaze direction, and generating the ocular abnormality information includes: determining whether the distance satisfies a distance threshold; in response to determining that the distance satisfies the distance threshold, updating a visual field map of the visual field to indicate that the eye is responsive to a stimulus associated with the second visual field location; 5. The method of claim 4, comprising:

10. Presenting the first stimulus includes: presenting the first stimulus having a first luminance; presenting the first stimulus having a second luminance; collecting a portion of said feedback information upon a change in luminance; 5. The method of claim 4, comprising:

11. Presenting the first stimulus includes: presenting the first stimulus having a first color; presenting the first stimulus having a second color; and collecting a portion of said feedback information upon a color change; 5. The method of claim 4, comprising:

12. Generating the ocular abnormality information includes: determining a boundary region of the field of view, the boundary region being between a line equal to a particular number of radians away from a straight path from the first field of view location to the second field of view location; determining whether the gaze location remains within the boundary region as the gaze location moves toward the second viewing location; detecting an ocular anomaly based on a determination that the gaze location does not remain within the boundary region as the gaze location moves toward the second viewing location; 5. The method of claim 4, comprising:

13. presenting an initial stimulus prior to the presentation of the first stimulus, an eye tracking sensor acquiring a set of eye-related characteristics after the presentation of the initial stimulus; updating the map based on the set of eye-related characteristics, and selecting the first display location comprises selecting the first display location based on the updated map; The method of claim 4 further comprising:

14. A non-transitory computer-readable medium storing instructions that, when executed by one or more processors, Obtaining spatial information indicative of one or more positions of one or more electronic displays relative to the wearable device; selecting a first display location on an electronic display other than a wearable display of the wearable device based on the spatial information indicating that the first display location on the electronic display corresponds to a first viewing location in a field of view; selecting a second display location on the wearable device based on the spatial information indicating that the second display location on the wearable display corresponds to a second viewing location of the field of view; Generating a presentation of (i) a first stimulus at the first display location on the electronic display and (ii) a second stimulus at the second display location on the wearable device; generating ocular anomaly information based on feedback information related to the presented stimulus; and A medium that generates an operation having the following properties:

15. the electronic display is a first electronic display, and the operation includes: presenting a set of stimuli on a plurality of electronic displays, each individual stimulus of the set of stimuli being presented on a respective electronic display of the plurality of electronic displays, the plurality of electronic displays including the first electronic display; updating the feedback information based on sensor information obtained by an eye tracking sensor during or after the presentation of each stimulus of the set of stimuli; updating a field of view map of the field of view based on the updated feedback information; and The medium of claim 14 further comprising:

16. Generating the ocular abnormality information includes: providing the feedback information to a machine learning model; and Detecting ocular anomalies based on an output of the machine learning model; and The medium of claim 14 , comprising:

17. 15. The medium of claim 14, wherein the electronic display is a first electronic display, and the action further comprises presenting a calibration stimulus at the second display location prior to presenting the first stimulus.

18. the electronic display is a first electronic display, and the operation includes: determining a set of candidate viewing locations separated from the second viewing location by at least a distance threshold, where at least one location in the set of candidate viewing locations is mapped to a third display location on a second electronic display other than the wearable display; selecting a third field of view location from the set of candidate field of view locations based on a random or pseudo-random value; displaying a third stimulus on the second electronic display at a third display location mapped to the third viewing location; and 15. The medium of claim 14, further comprising presenting the third stimulus on the first electronic display by:

19. The operation includes: presenting a set of calibration stimuli on the electronic display; determining a set of distance measurements based on the set of calibration stimuli; determining the position and orientation of the electronic display based on the set of distance measurements; The medium of claim 14 further comprising:

20. Selecting the first display location includes: Determining a set of candidate field of view locations; obtaining a boundary of a viewable region based on a field of view map of the field of view; updating the set of candidate viewing locations based on the boundary and the set of candidate viewing locations by removing the candidate viewing location from the set of candidate viewing locations based on a determination that the candidate viewing location is not within the observable region, wherein the updated set of candidate viewing locations includes the first display location; selecting the first display location from the updated set of candidate viewing locations; The medium of claim 14 , comprising:

Citation Information

Patent Citations

  • Methods and apparatus for evaluating the function of the visual system

    JP2015513430A

  • Use of the second screen as a private tracking head-up display

    JP2017511943A

  • Method and System for Visual Field Perimetry Testing Using a Head-Mounted Display Assembly

    US20190231184A1

  • Method and system for measuring or assessing human visual field

    US20210007597A1

  • Vision defect determination via a dynamic eye-characteristic-based fixation point

    US20210112226A1