Pass-through augmented reality apparatus for dynamically correcting strabismus

Abstract

A method, apparatus, and program product for dynamically correcting vision of a user utilizing pass-through augmented reality goggles comprising orientation sensors associated with eyes of a user, a camera configured to capture surroundings of the user, and at least one display aligned with each respective eye, the at least one display is configured to render a computer-generated image of the surroundings of the user. A processor is configured to perform the steps of: detecting gaze vectors associated with the eyes, obtaining respective magnitudes of ocular misalignment of the eyes, capturing at least one image of the surroundings of the user, generating a computer-generated image of the surroundings of the user based on: the at least one image of the surroundings of the user; the gaze vectors of the eyes, and the magnitude of ocular misalignment of the eyes. The processor is further configured to perform the steps of rendering for each display an adjusted first computer-generated image of the surroundings of the user.

Description

PASS-THROUGH AUGMENTED REALITY APPARATUS FOR DYNAMICALLY CORRECTING STRABISMUS

[0001] This application claims the benefit of U.S. Provisional Application No. 63 / 621,414, filed January 16, 2024, the contents of which is hereby incorporated by reference.FIELD

[0002] The present invention generally relates to apparatuses, methods, and program products for dynamically correcting strabismus in users, and in particular to pass-through augmented reality goggles worn by the user that dynamically correct for strabismus.BACKGROUND

[0003] Strabismus is a condition in which one eye is oriented in a direction different from the other eye. Strabismus may be treated surgically by relaxing or tightening the muscles of one or both eyes to achieve proper eye alignment. Strabismus may also be treated by providing prism-correction glasses in which lenses for one or both eyes comprise a three-dimensional triangular prism to redirect light before it enters the retina at the correct focal point. However, determining the degree of prism-correction by practitioners is inherently imprecise, which requires the patient to attend multiple visits to the practitioner. In addition, the peripheral view of patients suffering from strabismus is limited by the shape of the prism relative to the object that the patient is focusing on, which may require the patient to move their head in addition to orienting their eyes on the object to avoid double-vision. There is therefore a need in the art to provide an apparatus for correcting strabismus in patients.SUMMARY

[0004] In view of the above, it is an object of the present disclosure to provide a technological solution to address the long felt need and technological challenges faced in patients suffering from strabismus. Embodiments of the present disclosure implement video pass-through augmented reality (AR) to dynamically correct for strabismus in which AR goggles dynamically adjust at least one digital display for each eye based on at least the orientation of the respective eye and the gaze position.

[0005] In exemplary embodiments, an apparatus for dynamically correcting vision of a user is disclosed. The apparatus comprises: (a) at least one eye orientation sensor associated with a first eye and at least one eye orientation sensor associated with a second eye; (b) at least onecamera configured to capture surroundings of the user; (c) at least one display aligned with each respective first eye and second eye, wherein the at least one display is configured to render a computer-generated image of the surroundings of the user; (d) one or more processors; and (e) a non-transitory computer-readable memory operatively connected to the one or more processors, the non-transitor ' computer-readable memory' having stored thereon machine- readable instructions that, when executed by the one or more processors cause the one or more processors to perform steps of: (i)detecting, by’ each respective at least one eye orientation sensor, a first gaze vector associated with the first eye and a second gaze vector associated with the second eye; (ii) obtaining a respective magnitude of ocular misalignment of each of the first eye and second eye; (iii) capturing, by the at least one camera, at least one image of the surroundings of the user; (iv) generating, for each respective at least one display associated with the first eye and the second eye, a computer-generated image of the surroundings of the user based on: (a) the at least one image of the surroundings of the user; (b) the first gaze vector and the second gaze vector of each of the first eye and second eye; and (c) the respective magnitude of ocular misalignment of each respective eye associated with the each respective at least one display; (v) rendering, on the at least one display associated with the first eye. an adjusted first computer-generated image of the surroundings of the user; and (vi) rendering, on the at least one display associated wi th the second eye, an adjusted second computer-generated image of the surroundings of the user.

[0006] In embodiments, the first computer-generated image and the second computergenerated image correspond to a perspective field of view of the first eye and a perspective field of view7of the second eye respectively.

[0007] In embodiments, the one or more processors are further configured to determine the magnitude of the ocular misalignment of each eye.

[0008] In embodiments, the magnitude of the ocular misalignment of each eye is inputted by a practitioner.

[0009] In embodiments, the one or more processors are configured to perform after the generating step (iv) the further steps of: (v) detecting, by each respective at least one eye orientation sensor, a first gaze vector associated with the first eye and a second gaze vector associated with the second eye at a second time; (vi) obtaining a respective magnitude of ocular misalignment of each of the first eye and second eye at the second time; (vii) capturing, by the at least one camera, at least one image of the surroundings of the user at the second time; (viii) generating, for each respective at least one display associated with the first eye and the secondeye, a computer-generated image of the surroundings of the user at a second time based on: (a) the at least one image of the surroundings of the user at the second time; (b) the first gaze vector and the second gaze vector of each of the first eye and second eye at the second time; and (c) the respective magnitude of ocular misalignment of each respective eye associated with the each respective at least one display at the second time; (ix) rendering, on the at least one display associated with the first eye, an adjusted first computer-generated image of the surroundings of the user at the second time; and (x) rendering, on the at least one display associated with the second eye, an adjusted second computer-generated image of the surroundings of the user at the second time.

[0010] In embodiments, the adj usted computer-generated image of the surroundings of the user is rendered on at least a portion of each respective at least one display.

[0011] In embodiments, the portion of each respective at least one display which the adjusted computer-generated image of the surroundings of the user is rendered on is based on at least the magnitude of ocular misalignment of each respective eye.

[0012] In embodiments, the apparatus further comprises a communication interface configured to transmit and receive instructions to and from the apparatus.

[0013] In embodiments, the eye orientation sensor comprises a camera facing each respective first eye and second eye to capture images of each respective eye.

[0014] In embodiments, the one or more processors are further configured to generate a diagnosis of at least one of presence, type, and magnitude of the ocular misalignment by the steps of: (a) ceasing the rendering of a computer-generated image on the at least one display associated with the first eye for a period of time such that the first eye is occluded; (b) rendering a computer-generated image on the at least one display associated with the second eye for the period of time; (c) detecting movement and orientation of the second eye during the period of time; and (d) generating a report of the presence of tropia.

[0015] In embodiments, the one or more processors are further configured to execute the steps of: (e) detecting movement and orientation of the first eye during the period of time; (f) rendering a computer-generated image on the at least one display associated with the first eye after the period of time; (g) detecting movement and orientation of the first eye; (h) generating a report of the presence of phoria or latent deviation.

[0016] In embodiments, the at least one display associated with each respective eye is configured to render a compound computer-generated image of the surroundings of the user.

[0017] In further exemplary embodiments, an apparatus for dynamically correcting visionof a user is disclosed. The apparatus comprises at least one camera configured to capture surroundings of the user; at least one display aligned with each respective first eye and second eye, wherein the at least one display is configured to render a computer-generated image of the surroundings of the user; one or more processors; and a non-transitory computer-readable memory operatively connected to the one or more processors, the non-transitor ' computer- readable memory having stored thereon machine-readable instructions that, when executed by the one or more processors cause the one or more processors to perform steps of: (i) obtaining a respective magnitude of ocular misalignment of each of the first eye and second eye; (ii) capturing, by the at least one camera, at least one image of the surroundings of the user; (iii) generating, for each respective at least one display associated with the first eye and the second eye, a computer-generated image of the surroundings of the user based on: (a) the at least one image of the surroundings of the user; and (b) the respective magnitude of ocular misalignment of each respective eye associated with the each respective at least one display; (iv) rendering, on the at least one display associated with the first eye, an adjusted first computer-generated image of the surroundings of the user; and (v) rendering, on the at least one display associated with the second eye, an adjusted second computer-generated image of the surroundings of the user.

[0018] In other exemplary embodiments, a method for dynamically correcting vision of a user v\ i th pass-through augmented reality’ goggles is disclosed. The method comprises the steps of: (i) detecting, by at least one eye onentation sensor of the pass-through augmented reality goggles associated with a first eye and at least one eye orientation sensor of the pass-through augmented reality’ goggles associated with a second eye, a first gaze vector associated with the first eye and a second gaze vector associated with the second eye; (ii) obtaining a respective magnitude of ocular misalignment of each of the first eye and second eye; (iii) capturing, by at least one camera of the pass-through augmented reality goggles configured to capture surroundings of the user, at least one image of the surroundings of the user; (iv) generating, by one or more processors of the pass-through augmented reality' goggles, a computer-generated image of the surroundings of the user for at least one display of the pass-through augmented reality goggles aligned with each respective first eye and second eye, wherein each at least one display’ is configured to render a computer-generated image of the surroundings of the user, based on: (a) the at least one image of the surroundings of the user; (b) the first gaze vector and the second gaze vector of each of the first eye and second eye; and (c) the respective magnitude of ocular misalignment of each respective eye associated with the each respective at least one display; (v) rendering, by one or more processors of the pass-through augmented realitygoggles, an adjusted first computer-generated image of the surroundings of the user on the at least one display associated with the first eye; and (vi) rendering, by one or more processors of the pass-through augmented reality goggles, an adjusted second computer-generated image of the surroundings of the user on the at least one display associated with the second eye.

[0019] In embodiments of the method, the pass-through augmented reality goggles include one or more or all of the following: (a) at least one eye orientation sensor associated with a first eye and at least one eye orientation sensor associated with a second eye; (b) at least one camera configured to capture surroundings of the user; (c) at least one display aligned with each respective first eye and second eye, wherein the at least one display is configured to render a computer-generated image of the surroundings of the user; (d) one or more processors; and (e) a non-transitory computer-readable memory operatively connected to the one or more processors, the non-transitory computer-readable memory having stored thereon machine- readable instructions that, when executed by the one or more processors cause the one or more processors to perform the steps of the method.

[0020] In embodiments of the method, the first computer-generated image and the second computer-generated image correspond to a perspective field of view of the first eye and a perspective field of view7of the second eye respectively.

[0021] In embodiments of the method, the magnitude of the ocular misalignment of each eye is determined by one or more processors of the pass-through augmented reality goggles.

[0022] In embodiments of the method, the magnitude of the ocular misalignment of each eye is determined by one or more processors of the pass-through augmented reality goggles by: (a) ceasing the rendering of a computer-generated image on the at least one display associated with the first eye for a period of time such that the first eye is occluded; (b) rendering a computer-generated image on the at least one display associated with the second eye for the period of time; (c) detecting movement and orientation of the second eye during the period of time.

[0023] In embodiments of the method, the magnitude of the ocular misalignment of each eye is determined by further: (d) detecting movement and orientation of the first eye during the period of time; (e) rendering a computer-generated image on the at least one display associated with the first eye after the period of time: and (f) detecting movement and orientation of the first eye.

[0024] In embodiments of the method, the magnitude of the ocular misalignment of each eye is obtained from a practitioner.

[0025] In embodiments of the method, after generating step (iv), the method comprises the steps of: (v) detecting, by each respective at least one eye orientation sensor of the pass-through augmented reality goggles, a first gaze vector associated with the first eye and a second gaze vector associated with the second eye at a second time; (vi) obtaining a respective magnitude of ocular misalignment of each of the first eye and second eye at the second time; (vii) capturing, by the at least one camera, at least one image of the surroundings of the user at the second time; (viii) generating, by one or more processors of the pass-through augmented reality goggles a computer-generated image of the surroundings of the user at a second time for each respective at least one display associated with the first eye and the second eye, based on: (a) the at least one image of the surroundings of the user at the second time; (b) the first gaze vector and the second gaze vector of each of the first eye and second eye at the second time; and (c) the respective magnitude of ocular misalignment of each respective eye associated with the each respective at least one display at the second time; (ix) rendering, by one or more processors of the pass-through augmented reality goggles, an adjusted first computer-generated image of the surroundings of the user at the second time on the at least one display associated with the first eye; and (x) rendering, by one or more processors of the pass-through augmented reality goggles, an adjusted second computer-generated image of the surroundings of the user at the second time on the at least one display associated with the second eye.

[0026] In embodiments of the method, the adjusted computer-generated image of the surroundings of the user is rendered on at least a portion of each respective at least one display.

[0027] In embodiments of the method, the portion of each respective at least one display which the adjusted computer-generated image of the surroundings of the user is rendered on is based on at least the magnitude of ocular misalignment of each respective eye.

[0028] In embodiments of the method, the eye orientation sensor of the pass-through augmented reality goggles includes a camera facing each respective first eye and second eye to capture images of each respective eye.

[0029] In embodiments, the method comprises generating a diagnosis of at least one of presence, type, and magnitude of the ocular misalignment by the steps of: (d) ceasing the rendering of a computer-generated image on the at least one display associated with the first eye for a period of time such that the first eye is occluded; (e) rendering a computer-generated image on the at least one display associated with the second eye for the period of time; (f) detecting movement and orientation of the second eye during the period of time; and (g) generating a report of the presence of tropia.

[0030] In embodiments, the method further comprises: (e) detecting movement and orientation of the first eye during the period of time; (I) rendering a computer-generated image on the at least one display associated with the first eye after the period of time; (g) detecting movement and orientation of the first eye; and (h) generating a report of the presence of phoria or latent deviation.

[0031] In embodiments of the method, the at least one display associated with each respective eye is configured to render a compound computer-generated image of the surroundings of the user.

[0032] This invention also provides a method for dynamically correcting vision of a user with pass-through augmented reality goggles, comprising the steps of: (i) obtaining a respective magnitude of ocular misalignment of each of the first eye and second eye; (ii) capturing, by at least one camera of the pass-through augmented reality goggles configured to capture surroundings of the user, at least one image of the surroundings of the user; (iii) generating, by one or more processors of the pass-through augmented reality goggles, a computer-generated image of the surroundings of the user for at least one display aligned with each respective first eye and second eye, wherein the at least one display is configured to render a computergenerated image of the surroundings of the user, based on: (a) the at least one image of the surroundings of the user; and (b) the respective magnitude of ocular misalignment of each respective eye associated with the each respective at least one display; (iv) rendering, by one or more processors of the pass-through augmented reality goggles, an adjusted first computergenerated image of the surroundings of the user on the at least one display associated with the first eye; and (v) rendering, by one or more processors of the pass-through augmented reality goggles, an adjusted second computer-generated image of the surroundings of the user on the at least one display associated with the second eye.

[0033] Other features and advantages of the present disclosure will become readily apparent from the following detailed description and the accompanying drawings.BRIEF DESCRIPTION OF THE DRAWINGS

[0034] The above and related objects, features and advantages of the present disclosure will be more fully understood by reference to the following, detailed description of the preferred, albeit illustrative, embodiment of the present disclosure when taken in conjunctionwith the accompanying figures, wherein:

[0035] FIG. 1 illustrates a perspective view of an apparatus for dynamically correcting vision of a user, in accordance with embodiments of the present disclosure;

[0036] FIG. 2 illustrates a top view of the apparatus of FIG. 1 ;

[0037] FIG. 3 illustrates a schematic view of displays associated with each eye of the user, in accordance with embodiments of the present disclosure;

[0038] FIG. 4 illustrates a flowchart of machine-readable instructions executed by one or more processors for dynamically correcting vision of a user, in accordance with embodiments of the present disclosure, and

[0039] FIG. 5 illustrates a flowchart of machine-readable instructions executed by one or more processors for dynamically correcting vision of a user, in accordance with embodiments of the present disclosure.

[0040] In the drawings, exemplary embodiments of the invention are illustrated by way of example, it being expressly understood that the description and drawings are only for the purpose of illustration of exemplary embodiments and are not intended as a definition of the limits of the invention.DETAILED DESCRIPTION

[0041] The following description is presented to enable a person of ordinary skill in the art to make and use the invention, and is provided in the context of particular applications and their requirements. Various modifications to the embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments and applications without departing from the spirit and scope of the invention. In the following description, numerous details are set forth for the purpose of explanation. However, one of ordinary skill in the art will realize that the invention may be practiced without the use of these specific details. In other instances, well-known structures and devices are shown in block diagram form in order not to obscure the description of the invention with unnecessary- detail. Thus, the present disclosure is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features disclosed herein.

[0042] The present invention generally relates to apparatuses, methods, and program products for dynamically correcting strabismus in users, and in particular to pass-through augmented reality goggles worn by the user that dynamically correct for strabismus. Thepresent invention solves the technical problem associated non-surgical remedies for strabismus by providing an apparatus for dynamically correcting vision of a user. The apparatus comprises at least one eye orientation sensor associated with a first eye and at least one eye orientation sensor associated with a second eye; at least one camera configured to capture surroundings of the user. The apparatus further comprises at least one display aligned with each respective eye, wherein the at least one display is configured to render a computer-generated image of the surroundings of the user. The apparatus further comprises one or more processors and a non- transitory computer-readable memory operatively connected to the one or more processors, the non-transitory computer-readable memory' having stored thereon machine-readable instructions that, when executed by the one or more processors cause the one or more processors to perform steps of: (a) detecting, by each respective sensor, an orientation of the retina of each eye; (b) capturing, by the at least one camera, at least one image of the surroundings of the user; (c) adjusting the computer-generated image of the surroundings of the user rendered on each respective at least one display based on at least a magnitude of ocular misalignment of each respective eye; and (d) rendering, by the display, an adjusted computergenerated image of the surroundings of the user on each respective at least one display.

[0043] FIG. 1 illustrates an apparatus 100 for dynamically correcting vision of a user, in accordance with embodiments of the present disclosure. FIG. 2 illustrates a top view of the apparatus 100 of FIG. 1. In embodiments, the apparatus 100 comprises virtual reality goggles. In embodiments, the apparatus 100 comprises video pass-through augmented reality (AR) to dynamically correct for strabismus in which AR goggles dynamically adjust at least one digital display for each eye based on at least the orientation of respective gaze vectors associated with the first and second eyes.

[0044] With reference to FIGS. 1 and 2, the apparatus 100 comprises a first at least one eye orientation sensor 112 associated with a first eye 12 and a second at least one eye orientation sensor 114 associated with a second eye 14 of a user. The respective first and second eye orientation sensors (112, 114) are positioned on an inner portion 102 of the apparatus 100 and are oriented such that each of the first and second at least one eye orientation sensors (112, 114) capture the orientation of the respective first and second eyes (12, 14).

[0045] The apparatus 100 further comprises at least one camera 120 positioned on an outer portion 104 of the apparatus 100 and configured to capture surroundings of the user. In embodiments, a first at least one display 132 is positioned on the inner portion 102 of the apparatus and is aligned with the first eye 12. Likewise, a second at least one display 134 ispositioned on the inner portion 102 of the apparatus and is aligned with the second eye 14. As explained in further detail below with reference to FIG. 3, each respective at least one display (132, 134) is configured to render a computer-generated image of the surroundings of the user viewable by the respective first and second eyes (12, 14). In embodiments, the first at least one display 132 is configured to render a computer-generated image representative of the field of view of the first eye 12, and the second at least one display 132 is configured to render a computer-generated image representative of the field of view of the second eye 14 such that the user effectively views a desired point of view.

[0046] In embodiments, the apparatus 100 further comprises one or more processors 140 and non-transitory computer-readable memory 142 operatively connected to the one or more processors 140. The one or more processors 140 are operatively connected to the first and second at least one eye orientation sensors (1 12, 1 14), to the least one camera 120 and to the first and second at least one displays (132, 134). The non-transitory computer-readable memory' has stored thereon machine-readable instructions that, when executed by the one or more processors 140 cause the one or more processors 140 to perform steps as explained in detail below. In embodiments, the apparatus 100 further comprises a communication interface 144 configured to transmit and receive instructions to and from the apparatus. In embodiments, a practitioner may input parameters such as the magnitude of ocular misalignment for each of the first and second eyes (12, 14) where applicable.

[0047] FIG. 3 illustrates a schematic view of the first and second at least one display (132, 134) associated with each of the first and second eyes (12, 14) of the user, in accordance with embodiments of the present disclosure. An orientation of a retina 13 of the first eye 12 is defined by a gaze vector Ai in an X-Y plane and a field of view Fi. Likewise, an orientation of a retina 15 of the second eye 14 is defined by a gaze vector A2 in an X-Y plane and a field of view F2. The second eye 14 of the user is illustratively misaligned relative to the first eye 12 of the user, representing an exemplary' condition of strabismus. The first eye 12 is observing surroundings directly ahead of the user as represented by the gaze vector Ai and the field of view Fi being orthogonal to the respective first at least one display 132. Due to the misalignment of the second eye 14 resulting from the condition of strabismus, the gaze vector A2 and the field of view F2 is offset. It is understood that the illustrative representation of strabismus is merely exemplary and is not intended to be limiting. By way of example, both eyes may be offset and non-orthogonal relative to the respective first and second at least one display (132. 134).

[0048] To compensate for the ocular misalignment of the second eye 14 relative to the first eye 12. each of the first and second at least one displays (132. 134) are configured to render an adjusted computer-generated image (152, 1 4) of the surroundings of the user viewable by the respective first and second eyes (12, 14). In embodiments, the one or more processors are configured to adjust the computer-generated image of the surroundings of the user such that one or both of the first eye 12 and the second eye 14 may properly view the surroundings of the user, thereby correcting the condition of strabismus of the user. In embodiments, the first computer-generated image and the second computer-generated image correspond to a perspective field of view of the first eye and a perspective field of view of the second eye respectively. As explained in further detail below, the rendering of the respective adjusted computer-generated images (152, 154) are based on at least a magnitude of ocular misalignment of each respective eye (12, 14).

[0049] In embodiments, each adjusted computer-generated image (152, 154) is rendered on at least a portion of each respective at least one display (132, 134), and not the entire respective display (132. 134) to compensate for the misalignment. By way of example, as shown in FIGS. 2 and 3, the adjusted computer-generated image (152, 154) is rendered only on a portion of the respective displays (132, 134). In embodiments, the portion of each respective at least one display (132, 134) which the adjusted computer-generated image (152, 154) is rendered on is based on at least the magnitude of ocular misalignment of each respective eye (12, 14).

[0050] In embodiments, the at least one display (132, 134) associated with each respective eye (12, 14) is configured to generate a compound computer-generated image (152, 154) of the surroundings of the user. In embodiments, the at least one displays (132, 134) are stereoscopic displays.

[0051] FIG. 4 illustrates a flowchart 200 of machine-readable instructions that, when executed by the one or more processors cause the one or more processors to perform steps of: in step S210 detecting, by each respective at least one eye orientation sensor, a first gaze vector associated with the first eye and a second gaze vector associated with the second eye; in step S220 obtaining a respective magnitude of ocular misalignment of each of the first eye and second eye; in step S230 capturing, by the at least one camera, at least one image of the surroundings of the user; and in step S240 generating, for each respective at least one display associated with the first eye and the second eye, a computer-generated image of the surroundings of the user. The generating step S240 is based at least in part on the at least oneimage of the surroundings of the user; the first gaze vector and the second gaze vector of each of the first eye and second eye; and the respective magnitude of ocular misalignment of each respective eye associated with the each respective at least one display. The one or more processors are further configured to perform the steps of, in step S250 rendering, on the at least one display associated with the first eye, an adjusted first computer-generated image of the surroundings of the user, and in step S260 rendering, on the at least one display associated with the second eye. an adjusted second computer-generated image of the surroundings of the user.

[0052] In embodiments, the generating step S240 may be executed based on the exemplary pseudo code provided below:_ _

[0053] The one or more processors are configured to continuously and dynamically correct for ocular misalignment of the eyes (12, 14). In embodiments, the one or more processors are configured to perform after the generating step (iv) the further steps of: detecting, by each respective at least one eye orientation sensor, a first gaze vector associated with the first eye and a second gaze vector associated with the second eye at a second time; obtaining a respective magnitude of ocular misalignment of each of the first eye and second eye at the second time; capturing, by the at least one camera, at least one image of the surroundings of the user at the second time; and generating, for each respective at least one display associated with the first eye and the second eye, a computer-generated image of the surroundings of the user at a second time. The generating step is based at least on: the at least one image of the surroundings of the user at the second time; the first gaze vector and the second gaze vector of each of the first eye and second eye at the second time; and the respective magnitude of ocular misalignment of each respective eye associated with the each respective at least one display at the second time.The method further comprises rendering, on the at least one display associated with the first eye, an adjusted first computer-generated image of the surroundings of the user at the second time; and rendering, on the at least one display associated with the second eye, an adjusted second computer-generated image of the surroundings of the user at the second time.

[0054] In embodiments, the one or more processors 140 are further configured to determine the magnitude of the ocular misalignment of each eye. In embodiments, the magnitude of the ocular misalignment of each eye is inputted by a practitioner. In embodiments, the one or more processors 140 are further configured to generate a diagnosis of at least one of presence, type, and magnitude of the ocular misalignment by the steps of: ceasing the rendering of a computergenerated image on one or both of the at least one display (132, 134) associated with the first eye 12 for a period of time such that the first eye 12 is occluded; rendering a computergenerated image (152, 154) on the at least one display (132, 1 4) associated with the second eye 14 for the period of time; and detecting movement and orientation of the second eye 14 during the period of time. Movement of the second eye 14 is indicative of the presence of tropia. In embodiments, a report of the presence of tropia is generated and sent to a remote server.

[0055] In embodiments, the one or more processors 140 are further configured to execute the steps of detecting movement and orientation of the first eye 12 during the period of time; rendering a computer-generated image (152, 154) on the at least one display (132, 134) associated with the first eye 12 after the period of time; and detecting movement and orientation of the first eye 12. Movement of the first eye 12 is indicative of the presence of phoria or latent deviation. In embodiments, a report of the presence of phoria or latent deviation is generated and sent to a remote server.

[0056] In embodiments, the one or more processors 140 are further configured to execute the steps of detecting the orientation of each of the first eye 12 and second eye 14; determining a field of view of the user based on at least the orientation of each of the first eye 12 and second eye 14 and the position of a head of the user; and rendering the adjusted computer-generated image (152, 154) of the surroundings of the user based on the field of view of the user.

[0057] FIG. 5 illustrates a flowchart of machine-readable instructions executed by one or more processors for dynamically correcting vision of a user, that when executed by the one or more processors cause the one or more processors to perform steps of: in step S210 obtaining a respective magnitude of ocular misalignment of each of the first eye and second eye; in step S220 capturing, by the at least one camera, at least one image of the surroundings of the user;and in step S230 generating, for each respective at least one display associated with the first eye and the second eye, a computer-generated image of the surroundings of the user. The generating step S230 is based at least in part on the at least one image of the surroundings of the user; and the respective magnitude of ocular misalignment of each respective eye associated with the each respective at least one display. The one or more processors are further configured to perform the steps of, in step S240 rendering, on the at least one display associated with the first eye. an adjusted first computer-generated image of the surroundings of the user, and in step S250 rendering, on the at least one display associated with the second eye, an adjusted second computer-generated image of the surroundings of the user.

[0058] In view of the above, the apparatus 100 is configured to continuously detect the orientation of each of the first eye 12 and second eye 14 and dynamically adjust the computergenerated image (152, 154) based on at least the magnitude of misalignment for each of the first eye 12 and second eye 14.

[0059] While this invention has been described in conjunction with the exemplary embodiments outlined above, it is evident that many alternatives, modifications and variations will be apparent to those skilled in the art. Accordingly, the exemplary embodiments of the invention, as set forth above, are intended to be illustrative, not limiting. Various changes may be made without departing from the spirit and scope of the invention.

[0060] Now that embodiments of the present disclosure have been shown and described in detail, various modifications and improvements thereon can become readily apparent to those skilled in the art. Accordingly, the exemplar}' embodiments of the present disclosure, as set forth above, are intended to be illustrative, not limiting. The spirit and scope of the present disclosure is to be construed broadly.

Claims

CLAIMSWhat is claimed is:

1. An apparatus for dynamically correcting vision of a user comprising:(a) at least one eye orientation sensor associated with a first eye and at least one eye orientation sensor associated with a second eye;(b) at least one camera configured to capture surroundings of the user;(c) at least one display aligned with each respective first eye and second eye, wherein the at least one display is configured to render a computer-generated image of the surroundings of the user;(d) one or more processors; and(e) a non-transitory computer-readable memory operatively connected to the one or more processors, the non-transitory' computer-readable memory having stored thereon machine-readable instructions that, when executed by the one or more processors cause the one or more processors to perform steps of:(i) detecting, by each respective at least one eye orientation sensor, a first gaze vector associated with the first eye and a second gaze vector associated with the second eye;(ii) obtaining a respective magnitude of ocular misalignment of each of the first eye and second eye;(iii) capturing, by the at least one camera, at least one image of the surroundings of the user;(iv) generating, for each respective at least one display associated with the first eye and the second eye, a computer-generated image of the surroundings of the user based on:(a) the at least one image of the surroundings of the user;(b) the first gaze vector and the second gaze vector of each of the first eye and second eye; and(c) the respective magnitude of ocular misalignment of each respective eye associated with the each respective at least one display;(v) rendering, on the at least one display associated with the first eye, an adjusted first computer-generated image of the surroundings of the user; and(vi) rendering, on the at least one display associated with the second eye, an adjusted second computer-generated image of the surroundings of the user.

2. The apparatus of claim 1, wherein the first computer-generated image and the second computer-generated image correspond to a perspective field of view of the first eye and a perspective field of view of the second eye respectively.

3. The apparatus of claim 1, wherein the one or more processors are further configured to determine the magnitude of the ocular misalignment of each eye.

4. The apparatus of claim 1, wherein the magnitude of the ocular misalignment of each eye is inputted by a practitioner.

5. The apparatus of claim 1, wherein the one or more processors are configured to perform after the generating step (iv) the further steps of:(vi) detecting, by each respective at least one eye orientation sensor, a first gaze vector associated with the first eye and a second gaze vector associated with the second eye at a second time;(vii) obtaining a respective magnitude of ocular misalignment of each of the first eye and second eye at the second time;(viii) capturing, by the at least one camera, at least one image of the surroundings of the user at the second time;(ix) generating, for each respective at least one display associated with the first eye and the second eye, a computer-generated image of the surroundings of the user at a second time based on:(a) the at least one image of the surroundings of the user at the second time;(b) the first gaze vector and the second gaze vector of each of the first eye and second eye at the second time; and(c) the respective magnitude of ocular misalignment of each respective eye associated with the each respective at least one display at the second time;(x) rendering, on the at least one display associated with the first eye, an adjusted first computer-generated image of the surroundings of the user at the second time; and(xi) rendering, on the at least one display associated with the second eye, an adjusted second computer-generated image of the surroundings of the user at the second time.

6. The apparatus of claim 1, wherein the adjusted computer-generated image of the surroundings of the user is rendered on at least a portion of each respective at least one display.

7. The apparatus of claim 6, wherein the portion of each respective at least one display which the adjusted computer-generated image of the surroundings of the user is rendered on is based on at least the magnitude of ocular misalignment of each respective eye.

8. The apparatus of claim 1, further comprising a communication interface configured to transmit and receive instructions to and from the apparatus.

9. The apparatus of claim 1 , wherein the eye orientation sensor comprises a camera facing each respective first eye and second eye to capture images of each respective eye.

10. The apparatus of claim 1, wherein the one or more processors are further configured to generate a diagnosis of at least one of presence, type, and magnitude of the ocular misalignment by the steps of:(a) ceasing the rendering of a computer-generated image on the at least one display associated with the first eye for a period of time such that the first eye is occluded;(b) rendering a computer-generated image on the at least one display associated with the second eye for the period of time;(c) detecting movement and orientation of the second eye during the period of time; and(d) generating a report of the presence of tropia.

11. The apparatus of claim 10, wherein the one or more processors are further configured to execute the steps of:(e) detecting movement and orientation of the first eye during the period of time;(1) rendering a computer-generated image on the at least one display associated with the first eye after the period of time;(g) detecting movement and orientation of the first eye;(h) generating a report of the presence of phoria or latent deviation.

12. The apparatus of claim 1, wherein the at least one display associated with each respective eye is configured to render a compound computer-generated image of the surroundings of the user.

13. An apparatus for dynamically correcting vision of a user comprising:(a) at least one camera configured to capture surroundings of the user;(b) at least one display aligned with each respective first eye and second eye, wherein the at least one display is configured to render a computer-generated image of the surroundings of the user;(c) one or more processors; and(d) a non-transitory computer-readable memory' operatively connected to the one or more processors, the non-transitory computer-readable memory' having stored thereon machine-readable instructions that, when executed by the one or more processors cause the one or more processors to perform steps of:(i) obtaining a respective magnitude of ocular misalignment of each of the first eye and second eye;(ii) capturing, by the at least one camera, at least one image of the surroundings of the user;(iii) generating, for each respective at least one display associated with the first eye and the second eye, a computer-generated image of the surroundings of the user based on:(a) the at least one image of the surroundings of the user; and(b) the respective magnitude of ocular misalignment of each respective eye associated with the each respective at least one display;(iv) rendering, on the at least one display associated with the first eye. an adjusted first computer-generated image of the surroundings of the user; and(v) rendering, on the at least one display associated with the second eye, an adjusted second computer-generated image of the surroundings of the user.

14. A method for dynamically correcting vision of a user with pass-through augmented reality goggles, comprising the steps of:(i) detecting, by at least one eye orientation sensor of the pass-through augmented reality goggles associated with a first eye and at least one eye orientation sensor of the pass-through augmented reality goggles associated with a second eye, a first gaze vector associated with the first eye and a second gaze vector associated with the second eye;(ii) obtaining a respective magnitude of ocular misalignment of each of the first eye and second eye;(iii) capturing, by at least one camera of the pass-through augmented reality goggles configured to capture surroundings of the user, at least one image of the surroundings of the user;(iv) generating, by one or more processors of the pass-through augmented reality' goggles, a computer-generated image of the surroundings of the user for at least one display of the pass-through augmented reality goggles aligned with each respective first eye and second eye, wherein each at least one display is configured to render a computer-generated image of the surroundings of the user, based on:(a) the at least one image of the surroundings of the user;(b) the first gaze vector and the second gaze vector of each of the first eye and second eye; and(c) the respective magnitude of ocular misalignment of each respective eye associated with the each respective at least one display;(v) rendering, by one or more processors of the pass-through augmented reality goggles, an adjusted first computer-generated image of the surroundings of the user on the at least one display associated with the first eye; and(vi) rendering, by one or more processors of the pass-through augmented reality goggles, an adjusted second computer-generated image of thesurroundings of the user on the at least one display associated with the second eye.

15. The method of claim 14, wherein the pass-through augmented reality goggles comprise one or more or all of the following:(a) at least one eye orientation sensor associated with a first eye and at least one eye orientation sensor associated with a second eye;(b) at least one camera configured to capture surroundings of the user;(c) at least one display aligned with each respective first eye and second eye, wherein the at least one display is configured to render a computer-generated image of the surroundings of the user;(d) one or more processors; and(e) a non-transitory computer-readable memory' operatively connected to the one or more processors, the non-transitory computer-readable memory' having stored thereon machine-readable instructions that, when executed by the one or more processors cause the one or more processors to perform the steps of the method.

16. The method of claim 14, wherein the first computer-generated image and the second computer-generated image correspond to a perspective field of view of the first eye and a perspective field of view of the second eye respectively.

17. The method of claim 14, wherein the magnitude of the ocular misalignment of each eye is determined by one or more processors of the pass-through augmented reality goggles.

18. The method of claim 16, wherein the magnitude of the ocular misalignment of each eye is determined by one or more processors of the pass-through augmented reality goggles by:(a) ceasing the rendering of a computer-generated image on the at least one display associated with the first eye for a period of time such that the first eye is occluded;(b) rendering a computer-generated image on the at least one display associated with the second eye for the period of time;(c) detecting movement and orientation of the second eye during the period of time.

19. The method of claim 17, further comprising:(d) detecting movement and orientation of the first eye during the period of time;(e) rendering a computer-generated image on the at least one display associated with the first eye after the period of time; and(f) detecting movement and orientation of the first eye.

20. The method of claim 14, wherein the magnitude of the ocular misalignment of each eye is obtained from a practitioner.

21. The method of claim 14, further comprising after generating step (iv), the steps of:(v) detecting, by each respective at least one eye orientation sensor of the pass-through augmented reality goggles, a first gaze vector associated with the first eye and a second gaze vector associated with the second eye at a second time;(vi) obtaining a respective magnitude of ocular misalignment of each of the first eye and second eye at the second time;(vii) capturing, by the at least one camera, at least one image of the surroundings of the user at the second time;(viii) generating, by one or more processors of the pass-through augmented reality goggles a computer-generated image of the surroundings of the user at a second time for each respective at least one display associated with the first eye and the second eye, based on:(a) the at least one image of the surroundings of the user at the second time;(b) the first gaze vector and the second gaze vector of each of the first eye and second eye at the second time; and(c) the respective magnitude of ocular misalignment of each respective eye associated with the each respective at least one display at the second time;(ix) rendering, by one or more processors of the pass-through augmented reality goggles, an adjusted first computer-generated image of the surroundings of the user at the second time on the at least one display associated with the first eye; and(x) rendering, by one or more processors of the pass-through augmented reality’ goggles, an adjusted second computer-generated image of thesurroundings of the user at the second time on the at least one display- associated with the second eye.

22. The method of claim 14, wherein the adjusted computer-generated image of the surroundings of the user is rendered on at least a portion of each respective at least one display.

23. The method of claim 22, wherein the portion of each respective at least one display which the adjusted computer-generated image of the surroundings of the user is rendered on is based on at least the magnitude of ocular misalignment of each respective eye.

24. The method of claim 14, wherein the eye orientation sensor of the pass-through augmented reality goggles comprises a camera facing each respective first eye and second eye to capture images of each respective eye.

25. The method of claim 14, comprising generating a diagnosis of at least one of presence, type, and magnitude of the ocular misalignment by the steps of:(a) ceasing the rendering of a computer-generated image on the at least one display associated with the first eye for a period of time such that the first eye is occluded;(b) rendering a computer-generated image on the at least one display associated with the second eye for the period of time;(c) detecting movement and orientation of the second eye during the period of time; and(d) generating a report of the presence of tropia.

26. The method of claim 25, further comprising:(e) detecting movement and orientation of the first eye during the period of time;(!) rendering a computer-generated image on the at least one display associated with the first eye after the period of time;(g) detecting movement and orientation of the first eye; and(h) generating a report of the presence of phoria or latent deviation.

27. The method of claim 14, wherein the at least one display associated with each respective eye is configured to render a compound computer-generated image of the surroundings of the user.

28. A method for dynamically correcting vision of a user with pass-through augmented reality’ goggles, comprising the steps of:(i) obtaining a respective magnitude of ocular misalignment of each of the first eye and second eye;(ii) capturing, by at least one camera of the pass-through augmented reality’ goggles configured to capture surroundings of the user, at least one image of the surroundings of the user;(iii) generating, by one or more processors of the pass-through augmented reality goggles, a computer-generated image of the surroundings of the user for at least one display aligned with each respective first eye and second eye, wherein the at least one display is configured to render a computer-generated image of the surroundings of the user, based on:(a) the at least one image of the surroundings of the user; and(b) the respective magnitude of ocular misalignment of each respective eye associated with the each respective at least one display;(iv) rendering, by one or more processors of the pass-through augmented reality goggles, an adjusted first computer-generated image of the surroundings of the user on the at least one display associated with the first eye; and(v) rendering, by one or more processors of the pass-through augmented reality goggles, an adjusted second computer-generated image of the surroundings of the user on the at least one display associated with the second eye.

Images