An amblyopia rehabilitation system based on AR eye movement

Abstract

This application discloses an AR-based eye-tracking amblyopia rehabilitation system, relating to the field of amblyopia rehabilitation. The AR-based eye-tracking amblyopia rehabilitation system includes: AR eye-tracking glasses; an AR projector projecting a target image into the AR eye; an AR waveguide transmitting the AR projected image to the user's eye; an infrared eye-tracking camera capturing the user's eye movements to obtain an infrared image of the user's eye; an image processing unit processing the infrared image of the user's eye; an eye-tracking calculation unit performing eye-tracking calculations on the processed infrared image of the user's eye to obtain the current gaze position of the user's eye; and a main control unit, based on the current gaze position of the user's eye, controlling the AR projector corresponding to the amblyopic eye to stop working, enabling the amblyopic eye to 100% gaze at the physical environment image, and controlling the corresponding position on the AR waveguide of the non-amblyopic eye to be blurred through the AR projector, enabling the non-amblyopic eye to assist in gaze imaging. This application can improve the effectiveness of amblyopia rehabilitation training.

Description

Technical Field

[0001] This application relates to the field of amblyopia rehabilitation, and in particular to an amblyopia rehabilitation system based on AR eye tracking. Background Technology

[0002] Amblyopia, a visual impairment caused by visual impairment, is related to developmental disorders of the brain's visual pathways. It is a clinical syndrome resulting from functional and morphological abnormalities in the visual conduction system, from the retinal ganglion cells to the visual cortex, and across the entire central nervous system. Occlusion therapy has been used for over a century, and currently, more than 90% of ophthalmologists still consider it the first-line treatment.

[0003] Occlusion therapy forces the patient to use the amblyopic eye to see by covering the non-amblyopic eye, thereby eliminating the inhibition of the amblyopic eye by the non-amblyopic eye and improving the vision of the amblyopic eye. Occlusion therapy is a simple, economical, and effective method for treating amblyopia in children. However, patient compliance is poor, and it cannot improve binocular vision, including simultaneous vision, fusion vision, and stereopsis. Therefore, the treatment effect is difficult to maintain, relapse is common, and the non-amblyopic eye is prone to developing myopia.

[0004] With the deepening research on strabismus and amblyopia in children, treatment methods, represented by digital therapy, have emerged, greatly improving treatment adherence. Through binocular visual information stimulation training, neurons in the visual pathway can be activated, forming new neuronal connections and improving binocular vision and functional vision. Currently, products using digital therapy for amblyopia rehabilitation training typically have time limitations; daily training time cannot be too long, resulting in unsatisfactory rehabilitation effects. Summary of the Invention

[0005] The purpose of this application is to provide an AR-based eye-tracking amblyopia rehabilitation system that can improve the effectiveness of amblyopia rehabilitation training.

[0006] To achieve the above objectives, this application provides the following solution: This application provides an AR eye-tracking-based amblyopia rehabilitation system, including: AR eye-tracking glasses; the AR eye-tracking glasses include: an infrared light emitting unit, an infrared eye-tracking camera, an image processing unit, an eye-tracking calculation unit, an AR projector, an AR optical waveguide, and a main control unit; The AR projector is used to project the target image to obtain an AR projected image; the AR waveguide is used to transmit the AR projected image to the human eye; The infrared light emitting unit is used to emit infrared light; the infrared light is used to illuminate the human eye; the infrared eye-tracking camera is used to capture the eye movements of the human eye to obtain an infrared image of the human eye; The image processing unit is used to process the human eye infrared image to obtain a human eye processed infrared image; The eye-tracking calculation unit is used to perform eye-tracking calculations on the infrared processed image of the human eye to obtain the current gaze position of the human eye. The main control unit is used to control the AR projector corresponding to the amblyopic eye to stop working according to the current gaze position of the human eye, so that the amblyopic eye can gaze at the physical environment image 100%, and to control the corresponding position on the AR waveguide of the non-amblyopic eye to be blurred by the AR projector so that the non-amblyopic eye can assist in gazing at the image; the eye with weaker vision in the human eye is the amblyopic eye, and the eye with stronger vision is the non-amblyopic eye.

[0007] In one embodiment, the corresponding position on the AR waveguide controlling the non-amblyopic eye is blurred and displayed by the AR projector, enabling the non-amblyopic eye to assist in fixation imaging. Specifically, the main control unit is used for: Based on the current gaze position of the human eye, the blurring transparency is determined according to the visual acuity difference between the non-amblyopic eye and the amblyopic eye. Based on the blurring transparency, the corresponding position on the AR waveguide of the non-amblyopic eye is controlled to be blurred and displayed by the AR projector. The non-amblyopic eye is then imaged after blurring.

[0008] In one embodiment, the eye-tracking calculation unit is specifically used for: An eye-tracking algorithm is used to perform eye-tracking calculations on the infrared image of the human eye to obtain the current gaze position of the human eye.

[0009] In one embodiment, the eye-tracking algorithm includes: interpupillary distance corneal reflection method.

[0010] In one embodiment, the image processing unit is specifically used for: The infrared image of the human eye is subjected to automatic exposure, color space conversion, noise reduction and scaling to obtain a processed infrared image of the human eye.

[0011] In one embodiment, there are two AR waveguides, with one AR waveguide corresponding to one eye.

[0012] In one embodiment, there are multiple infrared light emitting units, and the multiple infrared light emitting units are arranged at predetermined positions.

[0013] In one embodiment, the infrared light is infrared floodlight.

[0014] According to the specific embodiments provided in this application, this application has the following technical effects: This application provides an AR eye-tracking-based amblyopia rehabilitation system, comprising: AR eye-tracking glasses; the AR eye-tracking glasses include: an infrared light emitting unit, an infrared eye-tracking camera, an image processing unit, an eye-tracking calculation unit, an AR projector, an AR waveguide, and a main control unit; the eye-tracking calculation unit performs eye-tracking calculations on the infrared processed image of the human eye to obtain the current gaze position of the human eye; the main control unit, based on the current gaze position of the human eye, controls the AR projector corresponding to the amblyopic eye to stop working, so that the amblyopic eye is 100% focused on the physical environment image, and controls the corresponding position on the AR waveguide of the non-amblyopic eye to be blurred through the AR projector, so that the non-amblyopic eye assists in gaze image formation, thereby reducing the image formation of the non-amblyopic eye, forcing the patient to use the amblyopic eye for image formation, thereby eliminating the inhibition of the amblyopic eye by the non-amblyopic eye, achieving the purpose of enhancing the vision of the amblyopic eye, and without limiting the training time, improving the amblyopia rehabilitation training effect. Attached Figure Description

[0015] To more clearly illustrate the technical solutions in the embodiments of this application or related technologies, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0016] Figure 1 A schematic diagram of the structure of an amblyopia rehabilitation system based on AR eye tracking provided in an embodiment of this application; Figure 2 This is a schematic diagram of normal and amblyopia imaging provided in an embodiment of this application. Detailed Implementation

[0017] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0018] From a physiological perspective, humans primarily acquire visual data through the fovea, which provides only about 1–2 degrees of visual field. Although this area occupies only a tiny portion of the visual field, it records 50% of the effective visual information transmitted to the brain via the optic nerve. Therefore, the human visual and attentional systems operate around a primary goal: focusing the optical image of the object of interest onto the fovea. This is the fundamental and primary reason for eye movements, and eye-tracking technology enables the quantitative identification of the object being gazed upon and the gaze pattern.

[0019] Currently, VR or AR products that integrate eye tracking can be used for amblyopia rehabilitation training by running amblyopia rehabilitation training software or games. However, these products have certain time limitations, and the daily training time cannot be too long, resulting in poor amblyopia rehabilitation training effects.

[0020] The purpose of this application is to provide an AR-based eye-tracking amblyopia rehabilitation system that uses AR eye-tracking glasses worn daily for continuous amblyopia rehabilitation training, thereby improving the effectiveness of amblyopia rehabilitation training.

[0021] To make the above-mentioned objectives, features and advantages of this application more apparent and understandable, the application will be further described in detail below with reference to the accompanying drawings and specific embodiments.

[0022] In one exemplary embodiment, such as Figure 1 As shown, an AR-based eye-tracking amblyopia rehabilitation system is provided, including AR eye-tracking glasses. The AR eye-tracking glasses include: an infrared light emitting unit, an infrared eye-tracking camera, an image processing unit, an eye-tracking calculation unit, an AR projector, an AR waveguide, and a main control unit. The infrared light emitting unit, infrared eye-tracking camera, image processing unit, eye-tracking calculation unit, AR projector, and AR waveguide are all connected to the main control unit, which controls each functional unit to perform its corresponding function.

[0023] The AR projector projects a target image to obtain an AR projected image; the AR waveguide transmits the AR projected image to the human eye; the infrared light emitting unit emits infrared light to illuminate the human eye; the infrared eye-tracking camera captures the human eye's eye movements to obtain an infrared image of the human eye; the image processing unit processes the infrared image of the human eye to obtain a processed infrared image of the human eye; the eye-tracking calculation unit performs eye-tracking calculations on the processed infrared image of the human eye to obtain the current gaze position of the human eye; the main control unit controls the AR projector corresponding to the amblyopic eye to stop working based on the current gaze position of the human eye, so that the amblyopic eye can focus 100% on the physical environment image, and controls the corresponding position on the AR waveguide of the non-amblyopic eye to be blurred by the AR projector, so that the non-amblyopic eye can assist in gazing and imaging; the eye with weaker vision is the amblyopic eye, and the eye with stronger vision is the non-amblyopic eye.

[0024] In another exemplary embodiment of this application, the corresponding position on the AR waveguide of the non-amblyopic eye is blurred and displayed by the AR projector to assist the non-amblyopic eye in gazing and imaging. Specifically, the main control unit is used to: determine the blurring transparency based on the current gaze position of the human eye and the visual acuity difference between the non-amblyopic eye and the amblyopic eye (or the degree of amblyopia of the amblyopic eye), and control the corresponding position on the AR waveguide of the non-amblyopic eye to be blurred and displayed by the AR projector according to the blurring transparency, so that the non-amblyopic eye can form an image after blurring.

[0025] In another exemplary embodiment of this application, the eye-tracking calculation unit is specifically used to: perform eye-tracking calculation on the infrared image of the human eye using an eye-tracking algorithm to obtain the current gaze position of the human eye.

[0026] In another exemplary embodiment of this application, the eye-tracking algorithm includes: interpupillary distance corneal reflection method. The basic principle of the interpupillary distance corneal reflection method is: (1) illuminating the eye with infrared light; (2) using a camera to collect the infrared light spot reflected from the cornea. Under the premise that the relative position of the light source and the head remains unchanged, the light spot formed by the corneal reflection will not move; (3) calculating the direction of eye movement based on the angle between the corneal reflected light spot and the pupil, thereby determining the current gaze position of the human eye.

[0027] In another exemplary embodiment of this application, the image processing unit is specifically used to: perform automatic exposure, color space conversion, noise reduction and scaling processing on the human eye infrared image to obtain a human eye processed infrared image.

[0028] In another exemplary embodiment of this application, there are two AR waveguides, with one AR waveguide corresponding to one eye.

[0029] In another exemplary embodiment of this application, there are multiple infrared light emitting units, and the multiple infrared light emitting units are arranged according to a set position.

[0030] In another exemplary embodiment of this application, the infrared light emitting unit is an infrared floodlight emitting unit, and the infrared light is infrared floodlight.

[0031] The implementation process of the AR-based eye-tracking amblyopia rehabilitation system in this embodiment is as follows in practical application.

[0032] Step 1: The infrared light emitting unit is placed in the set position to emit infrared light to illuminate the human eye.

[0033] Step 2: The infrared eye-tracking camera captures images of the eyes.

[0034] Step 3: The image processing unit performs image processing on the infrared image of the human eye captured by the infrared camera.

[0035] Step 4: The eye-tracking calculation unit uses the human eye infrared image (i.e., the human eye infrared processed image) processed by the image processing unit to perform eye-tracking calculations and obtain the current position of the human eye's gaze.

[0036] Step 5: Based on the current position of the human eye's gaze, the AR projector corresponding to the amblyopic eye is stopped or canceled. The amblyopic eye can then focus 100% on the physical environment image, and the corresponding position on the AR waveguide of the non-amblyopic eye is controlled to be blurred by the AR projector, allowing the non-amblyopic eye to assist in focusing on the image. This reduces the image from the non-amblyopic eye, forcing the patient to use the amblyopic eye to view, thereby eliminating the inhibition of the amblyopic eye by the non-amblyopic eye and achieving the goal of enhancing the vision of the amblyopic eye. Figure 2 The results of normal and amblyopia imaging are shown.

[0037] The AR eye-tracking-based amblyopia rehabilitation system of this embodiment can perform continuous amblyopia rehabilitation training through AR eye-tracking glasses worn daily, thereby improving the effectiveness of amblyopia rehabilitation training.

[0038] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0039] This document uses specific examples to illustrate the principles and implementation methods of this application. The descriptions of the above embodiments are only for the purpose of helping to understand the methods and core ideas of this application. Furthermore, those skilled in the art will recognize that, based on the ideas of this application, there will be changes in the specific implementation methods and application scope. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. An amblyopia rehabilitation system based on AR eye-tracking, characterized in that, include: AR eye-tracking glasses; The AR eye-tracking glasses include: an infrared light emitting unit, an infrared eye-tracking camera, an image processing unit, an eye-tracking calculation unit, an AR projector, an AR optical waveguide, and a main control unit; The AR projector is used to project the target image to obtain an AR projected image; the AR waveguide is used to transmit the AR projected image to the human eye; The infrared light emitting unit is used to emit infrared light; the infrared light is used to illuminate the human eye; the infrared eye-tracking camera is used to capture the eye movements of the human eye to obtain an infrared image of the human eye; The image processing unit is used to process the human eye infrared image to obtain a human eye processed infrared image; The eye-tracking calculation unit is used to perform eye-tracking calculations on the infrared processed image of the human eye to obtain the current gaze position of the human eye. The main control unit is used to control the AR projector corresponding to the amblyopic eye to stop working according to the current gaze position of the human eye, so that the amblyopic eye can gaze at the physical environment image 100%, and to control the corresponding position on the AR waveguide of the non-amblyopic eye to be blurred by the AR projector so that the non-amblyopic eye can assist in gazing at the image; the eye with weaker vision in the human eye is the amblyopic eye, and the eye with stronger vision is the non-amblyopic eye.

2. The AR eye movement-based amblyopia rehabilitation system according to claim 1, wherein, The main control unit specifically handles the following: A corresponding position on the AR waveguide controlling the non-amblyopic eye is blurred and displayed via the AR projector, enabling the non-amblyopic eye to assist in fixation imaging. Based on the current gaze position of the human eye, the blurring transparency is determined according to the visual acuity difference between the non-amblyopic eye and the amblyopic eye. Based on the blurring transparency, the corresponding position on the AR waveguide of the non-amblyopic eye is controlled to be blurred and displayed by the AR projector. The non-amblyopic eye is then imaged after blurring. 3.The AR eye movement based amblyopia rehabilitation system of claim 1, wherein, The eye-tracking calculation unit is specifically used for: An eye-tracking algorithm is used to perform eye-tracking calculations on the infrared image of the human eye to obtain the current gaze position of the human eye.

4. The AR eye movement-based amblyopia rehabilitation system according to claim 3, wherein, The eye-tracking algorithm includes: interpupillary distance corneal reflection method.

5. The AR eye movement based amblyopia rehabilitation system of claim 1, wherein, The image processing unit is specifically used for: The infrared image of the human eye is subjected to automatic exposure, color space conversion, noise reduction and scaling to obtain a processed infrared image of the human eye.

6. The AR eye movement based amblyopia rehabilitation system of claim 1, wherein, There are two AR waveguides, and one AR waveguide corresponds to one eye.

7. The amblyopia rehabilitation system based on AR eye-tracking according to claim 1, characterized in that, There are multiple infrared light emitting units, and the multiple infrared light emitting units are set at predetermined positions.

8. The amblyopia rehabilitation system based on AR eye-tracking according to claim 1, characterized in that, The infrared light is infrared floodlight.

Images