Amblyopia training method, device, equipment and storage medium

Abstract

The embodiment of the present application discloses an amblyopia training method, device, equipment and storage medium, which belongs to the field of image processing technology. The method includes: determining the dominant eye and the amblyopia eye of the user's eyes; determining the amblyopia type of the amblyopia eye, the amblyopia type includes strabismic amblyopia or anisometropic amblyopia; when the amblyopia type of the amblyopia eye is determined to be strabismic amblyopia, the amblyopia training image is subjected to homography transformation processing to perform amblyopia training, and when the amblyopia type of the amblyopia eye is determined to be anisometropic amblyopia, the amblyopia training image is subjected to image resizing processing to perform amblyopia training. The embodiment of the present application determines the amblyopia type of the amblyopia eye, processes the amblyopia training image according to the amblyopia type of the amblyopia eye, and then performs amblyopia training. In other words, by distinguishing the amblyopia type, targeted training is performed according to different symptoms, which can improve the effect of amblyopia training.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of image processing technology, and in particular to an amblyopia training method, device, equipment and storage medium. Background Art

[0002] Amblyopia refers to an eye disease in which the best corrected visual acuity is lower than normal vision without organic lesions in the eyeball. It is usually caused by monocular strabismus, anisometropia, high refractive error, visual deprivation, etc. If not treated in time, amblyopia may worsen and even lead to blindness. Therefore, an amblyopia training method is urgently needed to correct the vision of the amblyopic eye.

[0003] The related art proposes an amblyopia training device, which can display binocular visual field content, and the binocular visual field content includes a moving target. The amblyopia training device can track the gaze trajectories of the user's left eye and right eye on the moving target, and determine the dominant eye and the amblyopic eye according to the degree of proximity between the left eye gaze trajectory and the right eye gaze trajectory and the actual motion trajectory of the moving target. Then, for the amblyopic eye, the visual field content including the moving target is repeatedly displayed, and the degree of proximity between the gaze trajectory of the amblyopic eye and the actual motion trajectory of the moving target is recorded.

[0004] However, for patients with amblyopia of different causes or different degrees, the training effect is not very ideal after training with the above-mentioned amblyopia training device. Summary of the invention

[0005] The embodiments of the present application provide a method, device, equipment and storage medium for amblyopia training, which can solve the problem of unsatisfactory training effect in related technologies. The technical solution is as follows:

[0006] In a first aspect, an amblyopia training method is provided, which is applied to an amblyopia training device, the method comprising: determining a user's dominant eye and amblyopia eye, determining the amblyopia type of the amblyopia eye, the amblyopia types including strabismic amblyopia and anisometropic amblyopia, when the amblyopia type of the amblyopia eye is determined to be strabismic amblyopia, performing homography transformation processing on an amblyopia training image to perform amblyopia training, and when the amblyopia type of the amblyopia eye is determined to be anisometropic amblyopia, performing image size adjustment processing on the amblyopia training image to perform amblyopia training.

[0007] In the embodiment of the present application, the amblyopia type of the amblyopia eye is determined, and the amblyopia training image is processed according to the amblyopia type of the amblyopia eye, and then amblyopia training is performed. In other words, by distinguishing the amblyopia type, targeted training is performed according to different symptoms, which can improve the amblyopia training effect.

[0008] The implementation process of determining the amblyopia type of the amblyopic eye includes: displaying a first test image in a display area corresponding to the dominant eye, displaying a second test image in a display area corresponding to the amblyopic eye, and determining the coordinates of the gaze position of the dominant eye in the displayed first test image and the coordinates of the gaze position of the amblyopic eye in the displayed second test image by eye tracking, and obtaining the first gaze position coordinates and the second gaze position coordinates. The amblyopia type of the amblyopic eye is determined according to the first gaze position coordinates and the second gaze position coordinates.

[0009] As an example, the implementation process of determining the coordinates of the gaze position of the dominant eye in the displayed first test image by eye tracking is: determining the position transformation matrix, determining the eyeball position coordinates of the dominant eye by eye tracking, and then multiplying the eyeball position coordinates of the dominant eye by the position transformation matrix to obtain the coordinates of the gaze position of the dominant eye in the first test image, that is, the first gaze position coordinates. Similarly, the implementation process of determining the coordinates of the gaze position of the amblyopic eye in the displayed second test image by eye tracking is: determining the position transformation matrix, determining the eyeball position coordinates of the amblyopic eye by eye tracking, and then multiplying the eyeball position coordinates of the amblyopic eye by the position transformation matrix to obtain the coordinates of the gaze position of the amblyopic eye in the second test image, that is, the second gaze position coordinates.

[0010] The position transformation matrix refers to the transformation matrix between the eyeball position and the position of the target point in the image.

[0011] As an example, the implementation process of determining the amblyopia type of the amblyopic eye according to the first gaze position coordinate and the second gaze position coordinate is as follows: according to the first gaze position coordinate and the second gaze position coordinate, binocular deviation information is determined, and the binocular deviation information refers to the deviation information between the line of sight of the amblyopic eye and the line of sight of the dominant eye. If the binocular deviation information is greater than or equal to the first threshold, the amblyopia type of the amblyopic eye is determined to be strabismic amblyopia. If the binocular deviation information is less than the first threshold, the amblyopia type of the amblyopic eye is determined to be anisometropic amblyopia.

[0012] It should be noted that, under normal circumstances, the binocular deviation information should be as close to 0 as possible. That is to say, the larger the binocular deviation information, the more severe the degree of strabismus, and the smaller the binocular deviation information, the milder the degree of strabismus. Therefore, when it is determined that there is an amblyopic eye in the user's eyes, it can be determined whether the binocular deviation information is greater than or equal to the first threshold. If the binocular deviation information is greater than or equal to the first threshold, the amblyopia type of the user's amblyopic eye is strabismic amblyopia. If the binocular deviation information is less than the first threshold, the amblyopia type of the user's amblyopic eye is anisometropic amblyopia.

[0013] That is to say, when it is determined that there is an amblyopic eye in the user's eyes, the amblyopia type of the amblyopic eye can be determined by the first threshold value, whether it is strabismic amblyopia or anisometropic amblyopia.

[0014] The first threshold refers to any value within a reference distance range, and the reference distance range refers to a distance range used to distinguish strabismic amblyopia from anisometropic amblyopia. Moreover, the first threshold is related to the angular resolution of the amblyopia training device. For example, when the average angular resolution of the display screen of the amblyopia training device is 20, the first threshold is 100 pixels. When the average angular resolution of the display screen of the amblyopia training device is 30, the first threshold is 150 pixels.

[0015] It is worth noting that, based on the above description, amblyopia is usually caused by monocular strabismus, anisometropia, high refractive error, visual deprivation, etc. However, for the two types of high refractive error and visual deprivation, since the eye has been physiologically damaged, the vision of the amblyopic eye cannot be corrected through amblyopia training. Therefore, the embodiment of the present application distinguishes between strabismic amblyopia and anisometropia amblyopia to perform amblyopia training, and does not involve the two types of amblyopia, high refractive error and visual deprivation.

[0016] Among them, the implementation process of determining the dominant eye and the amblyopic eye of the user's eyes is: detecting the refractive power of the user's eyes, determining the eye with lower refractive power as the dominant eye, and determining the eye with higher refractive power as the amblyopic eye.

[0017] Refractive power generally refers to the degree of myopia, hyperopia or astigmatism. Generally speaking, refractive power is also called visual acuity. Visual acuity mainly refers to the ability of the fundus retina to form an image. As an example, a vision chart is displayed in two display areas of the amblyopia training device. In the process of the user's eyes looking at the vision chart respectively, the refractive power of the user's eyes is detected by adjusting the virtual image distance. Among them, the vision chart can be projected from the terminal device to the amblyopia training device. Of course, the vision chart can also be stored in the amblyopia training device itself, and the embodiments of the present application do not limit this.

[0018] In some embodiments, the implementation process of performing homography transformation processing on the amblyopia training image is as follows: displaying the amblyopia training image in the display area corresponding to the dominant eye, performing homography transformation processing on the amblyopia training image and displaying it in the display area corresponding to the amblyopia eye, so that the images seen by both eyes of the user can be combined to perform amblyopia training. Similarly, the implementation process of performing image resizing on the amblyopia training image to perform amblyopia training is as follows: displaying the amblyopia training image in the display area corresponding to the dominant eye, performing image resizing on the amblyopia training image and displaying it in the display area corresponding to the amblyopia eye, so that the images seen by both eyes of the user can be combined to perform amblyopia training.

[0019] In other embodiments, in order to improve the imaging ability of the amblyopic eye, the image contrast corresponding to the dominant eye and the image contrast corresponding to the amblyopic eye may also be determined so that the user's binocular perception ability is the same. In this way, the amblyopia training image can be displayed in the display area corresponding to the dominant eye according to the image contrast corresponding to the dominant eye, and the amblyopia training image can be homographically transformed according to the image contrast corresponding to the amblyopic eye and displayed in the display area corresponding to the amblyopic eye according to the amblyopia type of the amblyopic eye, so that the images seen by both eyes of the user can be combined to perform amblyopia training. Alternatively, the amblyopia training image can be displayed in the display area corresponding to the dominant eye according to the image contrast corresponding to the dominant eye, and the amblyopia training image can be resized according to the image contrast corresponding to the amblyopic eye and displayed in the display area corresponding to the amblyopic eye, so that the images seen by both eyes of the user can be combined to perform amblyopia training.

[0020] For the above two embodiments, the operation of processing the amblyopia training image according to the amblyopia type of the amblyopic eye and the operation of performing amblyopia training are the same, the only difference is whether it is necessary to determine the image contrast corresponding to each of the two eyes, and then display the amblyopia training image according to the image contrast corresponding to each of the two eyes during the amblyopia training process. Next, taking the second embodiment as an example, the amblyopia training process provided by the embodiment of the present application is introduced.

[0021] In some embodiments, the implementation process of determining the image contrast corresponding to the dominant eye and the image contrast corresponding to the amblyopic eye includes: displaying a third test image in a display area corresponding to the dominant eye, and displaying a fourth test image in a display area corresponding to the amblyopic eye. Afterwards, the contrast of the displayed third test image is reduced, and the contrast of the displayed fourth test image is increased. When a contrast determination instruction is detected, the contrast of the third test image after the reduction is determined as the image contrast corresponding to the dominant eye, and the contrast of the fourth test image after the increase is determined as the image contrast corresponding to the amblyopic eye. The contrast determination instruction is triggered when the user feedbacks that the contrast that can be perceived by both eyes is the same based on the displayed third test image and fourth test image.

[0022] That is, by displaying a test image on two display areas of the amblyopia training device, respectively, and adjusting the contrast of the two test images through the user's subjective feedback, the user's two eyes can perceive the same contrast. Moreover, in the embodiment of the present application, by reducing the contrast of the third test image and increasing the contrast of the fourth test image, it is ensured that the user's two eyes can perceive the same contrast. In other words, by reducing the contrast of the dominant eye and increasing the contrast of the amblyopic eye, in the subsequent amblyopia training process, different contrast images are displayed to the dominant eye and the amblyopic eye, respectively, to strengthen the amblyopic eye and suppress the imaging ability of the dominant eye, thereby achieving the purpose of amblyopia training.

[0023] The above implementation process is to determine the image contrast corresponding to the dominant eye and the image contrast corresponding to the amblyopic eye based on the subjective feedback of the user, but the contrast of the user's subjective feedback may often be biased. Therefore, in other embodiments, multiple third test images are displayed in the display area corresponding to the dominant eye, and multiple fourth test images are displayed in the display area corresponding to the amblyopic eye. The multiple third test images include the first moving target, and the multiple fourth test images include the second moving target. In this way, before the contrast of the third test image after the reduction is determined as the image contrast corresponding to the dominant eye, and the contrast of the fourth test image after the increase is determined as the image contrast corresponding to the amblyopic eye, it also includes: determining the gaze trajectory of the dominant eye on the first moving target in the multiple third test images, and the gaze trajectory of the amblyopic eye on the second moving target in the multiple fourth test images by eye tracking, and obtaining the first gaze trajectory and the second gaze trajectory. Obtain the actual motion trajectory of the first moving target and the actual motion trajectory of the second moving target, and obtain the first actual motion trajectory and the second actual motion trajectory. If the first gaze trajectory matches the first actual motion trajectory, and the second gaze trajectory matches the second actual motion trajectory, the contrast of the third test image after being reduced is determined as the image contrast corresponding to the dominant eye, and the contrast of the fourth test image after being increased is determined as the image contrast corresponding to the amblyopic eye.

[0024] That is, by means of eye tracking, it is possible to further accurately determine whether the image contrast corresponding to the two eyes determined by the user's subjective feedback is accurate, thereby avoiding errors caused by subjective feedback.

[0025] Based on the above description, amblyopia types include strabismic amblyopia and anisometropic amblyopia. For different amblyopia types, the operations for processing amblyopia training images are different, which will be introduced separately below.

[0026] The amblyopia type of the amblyopic eye is strabismic amblyopia

[0027] In this case, the amblyopia training image includes a target object, and the target object is used for amblyopia training. At this time, the amblyopia training image is homographically transformed according to the binocular deviation information. The amblyopia training image before the homography transformation is used as the first training image, and the amblyopia training image after the homography transformation is used as the second training image. According to the image contrast corresponding to the dominant eye, the first training image is displayed in the display area corresponding to the dominant eye, and according to the image contrast corresponding to the amblyopic eye, the second training image is displayed in the display area corresponding to the amblyopic eye. By means of eye tracking, the gaze position of the dominant eye in the first training image and the gaze position of the amblyopic eye in the second training image are determined to obtain the first gaze position and the second gaze position. If the first gaze position coincides with the actual position of the target object in the first training image, and the second gaze position coincides with the actual position of the target object in the second training image, the homography transformation amount of the amblyopia training image is reduced, and the step of using the amblyopia training image before the homography transformation as the first training image and the amblyopia training image after the homography transformation as the second training image is returned to, until the amblyopia training is completed, or the second gaze position coincides with the actual position of the target object in the second training image without performing the homography transformation on the amblyopia training image.

[0028] Homography refers to the mapping relationship from one image to another, usually including translation and / or rotation. Since the eyes are usually not sensitive enough to rotation, in the embodiment of the present application, homography mainly refers to translation. In addition, based on the above-mentioned binocular deviation calculation process, binocular deviation information can be divided into deviation information in the horizontal direction and deviation information in the vertical direction. In this way, the implementation process of homography for amblyopia training images according to binocular deviation information is as follows: the deviation information in the horizontal direction in the binocular deviation information is determined as the translation amount in the horizontal direction, and the deviation information in the vertical direction in the binocular deviation information is determined as the translation amount in the vertical direction. Afterwards, the amblyopia training image is translated according to the translation amount in the horizontal direction and the translation amount in the vertical direction, thereby realizing the homography for amblyopia training images.

[0029] For strabismic amblyopia, since there is a deviation between the sight direction of the amblyopic eye and the sight direction of the dominant eye, it is necessary to perform a homography transformation on the amblyopic training image to adjust the position of the target object in the amblyopic training image. Then, the unadjusted amblyopic training image is displayed in the display area corresponding to the dominant eye, and the adjusted amblyopic training image is displayed in the display area corresponding to the amblyopic eye, so that during the training of the amblyopic eye, the images seen by the user's two eyes can be combined, that is, the two eyes can see the same picture. Moreover, the two eyes simultaneously watch the amblyopic training image in the corresponding display area, which can ensure the stereoscopic vision of the two eyes.

[0030] In addition, based on the above description, the image contrast corresponding to the dominant eye and the image contrast corresponding to the amblyopic eye may be different. In this way, the first training image is displayed according to the image contrast corresponding to the dominant eye, and the second training image is displayed according to the image contrast corresponding to the amblyopic eye. While improving the imaging ability of the amblyopic eye, it can also ensure the user's comfort, make it easier for the user to accept the training method and training process, improve the training effect, and increase user stickiness.

[0031] Amblyopia in the amblyopic eye is anisometropic amblyopia

[0032] In this case, the amblyopia training image includes a target object, and the target object is used for amblyopia training. At this time, the position and / or size of the target object in the amblyopia training image is adjusted multiple times to obtain multiple training images, and the image scaling ratio of the amblyopic eye relative to the dominant eye is determined. According to the image scaling ratio, the sizes of the multiple training images are scaled. The multiple training images before scaling are used as multiple third training images, and the multiple training images after scaling are used as multiple fourth training images. According to the image contrast corresponding to the dominant eye, the multiple third training images are sequentially displayed in the display area corresponding to the dominant eye, and according to the image contrast corresponding to the amblyopic eye, the multiple fourth training images are sequentially displayed in the display area corresponding to the amblyopic eye, and the display order and switching frequency of the multiple third training images and the multiple fourth training images are the same.

[0033] For anisometropic amblyopia, since the refractive power of the amblyopic eye is higher than that of the dominant eye, the size of the image seen by the amblyopic eye may be different from the size of the image seen by the dominant eye. Therefore, after the position and / or size of the target object in the amblyopia training image is adjusted multiple times to obtain multiple training images, it is necessary to determine the image scaling ratio of the amblyopic eye relative to the dominant eye, and then scale the sizes of the multiple training images according to the image scaling ratio so that the images seen by the dominant eye and the amblyopic eye can be combined, that is, both eyes can see the same picture.

[0034] The implementation process of determining the image scaling ratio of the amblyopic eye relative to the dominant eye is as follows: displaying a fifth test image in a display area corresponding to the dominant eye, and displaying a sixth test image in a display area corresponding to the amblyopic eye, wherein the fifth test image includes a first test target, and the sixth test image includes a second test target, and the first test target and the second test target have the same ratio. Scale the ratio of the sixth test image. When a ratio determination instruction is detected, determine the ratio between the first test target and the scaled second test target to obtain the image scaling ratio, and the ratio determination instruction is triggered when the user feedbacks that his or her eyes can see the first test target and the second test target of the same ratio.

[0035] That is, for the same eye, the first test target in the fifth test image and the second test target in the sixth test image have the same initial ratio. Then, in the process of the dominant eye looking at the fifth test image and the amblyopic eye looking at the sixth test image, by scaling the ratio of the sixth test image, when the user feedbacks that both eyes can see the first test target and the second test target of the same ratio, the image scaling ratio is determined by the size of the first test target and the size of the scaled second test target.

[0036] After the amblyopia training is performed according to different amblyopia types, the embodiment of the present application can also provide feedback on the amblyopia training effect, so as to facilitate the user to adjust the training plan in a targeted manner. Next, two methods of providing feedback on the amblyopia training effect are introduced.

[0037] The first method is to determine the gaze position of the amblyopic eye in the image displayed in the display area corresponding to the amblyopic eye by eye tracking, and obtain the gaze position of the amblyopic eye. If the gaze position of the amblyopic eye coincides with the actual position of the target object in the image displayed in the display area corresponding to the amblyopic eye, the display mode of the target object in the image displayed in the display area corresponding to the amblyopic eye is modified to the reference display mode to indicate the amblyopia training effect.

[0038] Among them, the reference display mode may refer to highlighting, color changing, etc., and the embodiments of the present application do not limit this.

[0039] The second method is to determine the gaze position of the amblyopic eye in the image displayed in the display area corresponding to the amblyopic eye by eye tracking, and obtain the gaze position of the amblyopic eye. According to the gaze position of the amblyopic eye and the actual position of the target object, an amblyopia training curve is drawn to indicate the amblyopia training effect.

[0040] As an example, the total number of training sessions in this amblyopia training cycle and the percentage of the number of times the amblyopia eye gaze position overlaps with the actual position of the target object in this amblyopia training cycle to the total number of training sessions are counted. Then, the amblyopia training curve is drawn by combining the data of multiple amblyopia training cycles in history. That is, the amblyopia training curve is drawn by taking multiple amblyopia training cycles as the horizontal axis and the percentage determined in each amblyopia training cycle as the vertical axis.

[0041] It should be noted that the above two methods can be used alone or in combination, and the embodiments of the present application do not limit this. Of course, in practical applications, the effect of amblyopia training can also be fed back in other ways. For example, after amblyopia training is performed in each amblyopia training cycle, the diopter of the amblyopic eye can be detected, and then, the amblyopia training curve is drawn with multiple amblyopia training cycles as the horizontal axis and the diopter of the amblyopic eye as the vertical axis.

[0042] In a second aspect, an amblyopia training device is provided, which has the function of implementing the amblyopia training method in the first aspect. The amblyopia training device includes at least one module, which is used to implement the amblyopia training method provided in the first aspect.

[0043] In a third aspect, an amblyopia training device is provided, the amblyopia training device comprising a processor and a memory, the memory being used to store a program for executing the amblyopia training method provided in the first aspect, and storing data involved in implementing the amblyopia training method provided in the first aspect. The processor is configured to execute the program stored in the memory. The operating device of the storage device may further include a communication bus, the communication bus being used to establish a connection between the processor and the memory.

[0044] In a fourth aspect, a computer-readable storage medium is provided, in which instructions are stored, and when the computer-readable storage medium is run on a computer, the computer executes the amblyopia training method described in the first aspect.

[0045] In a fifth aspect, a computer program product comprising instructions is provided, which, when executed on a computer, enables the computer to execute the amblyopia training method of the first aspect.

[0046] The technical effects obtained by the above-mentioned second, third, fourth and fifth aspects are similar to the technical effects obtained by the corresponding technical means in the first aspect, and will not be repeated here.

[0047] The technical solution provided by the embodiments of the present application can at least bring the following beneficial effects:

[0048] In the embodiment of the present application, the amblyopia type of the amblyopic eye is determined, and the amblyopia training image is processed in different ways according to the amblyopia type of the amblyopic eye, and then amblyopia training is performed. In other words, by distinguishing the amblyopia type, targeted training is performed according to different symptoms, which can improve the amblyopia training effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0049] Figure 1 is an architecture diagram of an amblyopia training system provided in an embodiment of the present application;

[0050] Figure 2 is a flow chart of an amblyopia training method provided in an embodiment of the present application;

[0051] Figure 3 is a schematic diagram of multiple binocular deviation information determined according to an embodiment of the present application;

[0052] Figure 4 is a schematic diagram of a method for training strabismic amblyopia provided in an embodiment of the present application;

[0053] Figure 5 It is a schematic diagram of restoring strabismic amblyopia to emmetropia provided by an embodiment of the present application;

[0054] Figure 6 is a schematic diagram of adjusting an amblyopia training image according to a first method provided in an embodiment of the present application;

[0055] Figure 7 is a schematic diagram of a change of an amblyopia training image displayed in a first manner provided in an embodiment of the present application;

[0056] Figure 8 is a schematic diagram of adjusting an amblyopia training image according to a second method provided in an embodiment of the present application;

[0057] Fig. 9 is a schematic diagram of a change of an amblyopia training image displayed in a second manner provided in an embodiment of the present application;

[0058] Fig.10 is a schematic diagram of adjusting an amblyopia training image according to a third method provided in an embodiment of the present application;

[0059] Fig.11 is a schematic diagram of a change in an amblyopia training image displayed in a third manner provided in an embodiment of the present application;

[0060] Fig.12 is a schematic diagram of adjusting an amblyopia training image according to a fourth method provided in an embodiment of the present application;

[0061] Fig.13 is a schematic diagram of a change of an amblyopia training image displayed in a fourth manner provided in an embodiment of the present application;

[0062] Fig.14 It is a schematic diagram of determining an image scaling ratio when displaying a test image to both eyes provided by an embodiment of the present application;

[0063] Fig.15 is a schematic diagram of binocular imaging provided by an embodiment of the present application;

[0064] Fig.16 is a first schematic diagram indicating the effect of amblyopia training provided by an embodiment of the present application;

[0065] Fig.17 is a second schematic diagram indicating the effect of amblyopia training provided in an embodiment of the present application;

[0066] Fig.18 is a third schematic diagram indicating the effect of amblyopia training provided in an embodiment of the present application;

[0067] Fig.19 is a structural schematic diagram of an amblyopia training device provided in an embodiment of the present application;

[0068] Fig. 20 is a structural schematic diagram of an amblyopia training device provided in an embodiment of the present application;

[0069] Fig.21 is a schematic diagram of the structure of a terminal provided in an embodiment of the present application;

[0070] Fig. 22 It is a structural diagram of another terminal provided in an embodiment of the present application. DETAILED DESCRIPTION

[0071] In order to make the objectives, technical solutions and advantages of the embodiments of the present application clearer, the implementation methods of the present application will be further described in detail below in conjunction with the accompanying drawings.

[0072] Before explaining in detail the amblyopia training method provided in the embodiment of the present application, the terms and implementation environment involved in the embodiment of the present application are first introduced.

[0073] First, the terms involved in the embodiments of the present application are introduced.

[0074] Amblyopia: refers to an eye disease in which the best corrected visual acuity is lower than normal vision without organic lesions in the eyeball. It is usually caused by monocular strabismus, anisometropia, high refractive error, visual deprivation, etc.

[0075] Monocular strabismus: refers to the disorder of central control, imbalance of extraocular muscle strength, inability of both eyes to focus on the target at the same time, separation of the visual axis, one eye focusing on the target and the other eye deviating from the target. It can also be understood as the phenomenon that due to abnormal binocular interaction caused by eye deviation, the different images received by the fovea of ​​the strabismus eye (confusion vision) are suppressed, resulting in the best corrected visual acuity of the strabismus eye being lower than normal vision.

[0076] Anisometropia: refers to the difference in the refractive power of the two eyes. The eye with the higher refractive power will develop amblyopia. Usually, anisometropia amblyopia is monocular amblyopia.

[0077] High refractive error: refers to the situation that when the eyes are not adjusted, parallel light rays cannot form a clear image on the retina after passing through the refractive effect of the eyes, but form an image in front of or behind the retina. It mainly refers to hyperopic refractive error or high astigmatism, which will cause visual deprivation due to blurred images of both eyes. Usually, high refractive error will cause binocular amblyopia.

[0078] Visual deprivation: refers to a phenomenon in which visual information is prevented from being transmitted without damaging the structure of the eye. It can also be understood as a phenomenon in which the vision of the eye is reduced due to refractive media confusion (corneal leukoplakia, cataract, vitreous inflammation or hemorrhage) and complete ptosis during the critical period of vision.

[0079] Dominant eye: refers to the eye with lower diopter, which is the opposite of amblyopic eye. That is, the eye with lower diopter is the dominant eye.

[0080] Amblyopic eye: refers to the eye with higher diopter, which is a relative concept to the dominant eye. That is, the eye with higher diopter is the amblyopic eye.

[0081] Eye tracking: refers to the tracking of eye movements by measuring the gaze position of the eyes or the movement of the eyes relative to the head. The most common method is to obtain the position of the eyes through video recording equipment.

[0082] Secondly, the implementation environment involved in the embodiments of the present application is introduced.

[0083] Please refer to Figure 1 , Figure 1 1 is an architecture diagram of an amblyopia training system provided in an embodiment of the present application. The system includes a terminal device 101 and an amblyopia training device 102, and the terminal device 101 and the amblyopia training device 102 communicate with each other in a wireless or wired manner.

[0084] The terminal device 101 is used to display an amblyopia training image, and project the displayed amblyopia training image onto the amblyopia training device 102. The amblyopia training device 102 includes two display areas, which correspond to the user's eyes, namely, a display area corresponding to the dominant eye and a display area corresponding to the amblyopia eye. The two display areas of the amblyopia training device 102 are used to display the amblyopia training image projected by the terminal device 101. The amblyopia training device 102 is also used to determine the amblyopia type of the user's amblyopia eye, and process the amblyopia training image according to the amblyopia type, so as to perform amblyopia training through the amblyopia training images displayed on the two display areas to correct the vision of the amblyopia eye.

[0085] In some embodiments, the amblyopia training device 102 includes a display module, an eye tracking module and an image processing module. The display module is used to display the amblyopia training image projected by the terminal device 101. The eye tracking module is used to determine the amblyopia type of the user's amblyopia eye. The image processing module is used to process the amblyopia training image according to the amblyopia type.

[0086] Optionally, the eye tracking module is also used to determine the gaze position of the user's eyes, thereby determining the amblyopia training effect.

[0087] It should be noted that the terminal device 101 is any electronic product that can interact with the user through one or more methods such as a keyboard, a touchpad, a touch screen, a remote control, voice interaction or a handwriting device. For example, a personal computer (PC), a mobile phone, a smart phone, a personal digital assistant (PDA), a wearable device, a handheld computer PPC (Pocket PC), a tablet computer, a smart car machine, a smart TV, a smart speaker, etc. The amblyopia training device 102 is any head-mounted device with two display areas. For example, virtual reality (VR) glasses, VR helmets, viewing glasses, augmented reality (AR) glasses, AR helmets, mixed reality (MR) glasses, MR helmets and other devices. Among them, the two display areas of the amblyopia training device 102 are two display screens of the amblyopia training device 102, or different display areas in the same display screen of the amblyopia training device 102.

[0088] It is worth noting that in the above system architecture, the terminal device 101 is used to project the amblyopia training image to the amblyopia training device 102, and then the amblyopia training device 102 performs amblyopia training on the amblyopia eye of the user. In some other embodiments, the above system architecture does not include the terminal device 101, that is, the amblyopia training device 102 can store the amblyopia training image and directly display the stored amblyopia training image during the amblyopia training process.

[0089] Next, the amblyopia training method provided in the embodiment of the present application is explained in detail.

[0090] Please refer to Figure 2 , Figure 2 The flowchart of an amblyopia training method provided in an embodiment of the present application is applied to an amblyopia training device, the amblyopia training device includes two display areas, and the two display areas correspond to the user's eyes. The method includes the following steps.

[0091] Step 201: Determine the dominant eye and amblyopic eye of the user.

[0092] In some embodiments, the process of determining the dominant eye and amblyopic eye of a user is as follows: respectively detect the refractive power of the user's eyes, determine the eye with lower refractive power as the dominant eye, and determine the eye with higher refractive power as the amblyopic eye.

[0093] Refractive power generally refers to the degree of myopia, hyperopia or astigmatism. Generally speaking, refractive power is also called visual acuity. Visual acuity mainly refers to the ability of the fundus retina to form an image. As an example, a vision chart is displayed in two display areas of the amblyopia training device. In the process of the user's eyes looking at the vision chart respectively, the refractive power of the user's eyes is detected by adjusting the virtual image distance. Among them, the vision chart can be projected from the terminal device to the amblyopia training device. Of course, the vision chart can also be stored in the amblyopia training device itself, and the embodiments of the present application do not limit this.

[0094] Step 202: Determine the amblyopia type of the amblyopic eye, where the amblyopia type includes strabismic amblyopia or anisometropic amblyopia.

[0095] In some embodiments, the process of determining the amblyopia type of the amblyopic eye is as follows: displaying a first test image in a display area corresponding to the dominant eye, and displaying a second test image in a display area corresponding to the amblyopic eye. Determine the coordinates of the gaze position of the dominant eye in the displayed first test image and the coordinates of the gaze position of the amblyopic eye in the displayed second test image by eye tracking, and obtain the first gaze position coordinates and the second gaze position coordinates. Determine the amblyopia type of the amblyopic eye based on the first gaze position coordinates and the second gaze position coordinates.

[0096] The first test image and the second test image may be the same or different. The first test image and the second test image may be projected from the terminal device to the amblyopia training device. Of course, the first test image and the second test image may also be stored in the amblyopia training device itself, which is not limited in the embodiments of the present application.

[0097] As an example, the implementation process of determining the coordinates of the gaze position of the dominant eye in the displayed first test image by eye tracking is: determining the position transformation matrix, determining the eyeball position coordinates of the dominant eye by eye tracking, and then multiplying the eyeball position coordinates of the dominant eye by the position transformation matrix to obtain the coordinates of the gaze position of the dominant eye in the first test image, that is, the first gaze position coordinates. Similarly, the implementation process of determining the coordinates of the gaze position of the amblyopic eye in the displayed second test image by eye tracking is: determining the position transformation matrix, determining the eyeball position coordinates of the amblyopic eye by eye tracking, and then multiplying the eyeball position coordinates of the amblyopic eye by the position transformation matrix to obtain the coordinates of the gaze position of the amblyopic eye in the second test image, that is, the second gaze position coordinates.

[0098] The position transformation matrix refers to the transformation matrix between the eyeball position and the position of the target point in the image. The position transformation matrix can be determined by: the amblyopia training device displays multiple target points in sequence, and then when the user's eyes are looking at the multiple target points, the user's eyeball position coordinates are determined by eye tracking to obtain the corresponding multiple eyeball position coordinates. Next, the position transformation matrix is ​​determined by the following formula.

[0099] P 1 =T*P 2

[0100] In the above formula, P 1 refers to the matrix composed of the coordinates of multiple target points, T refers to the position transformation matrix, P 2 It refers to multiple eye position coordinates determined by eye tracking when the user's eyes are looking at the multiple target points.

[0101] As an example, the implementation process of determining the amblyopia type of the amblyopic eye according to the first gaze position coordinate and the second gaze position coordinate is as follows: according to the first gaze position coordinate and the second gaze position coordinate, binocular deviation information is determined, and the binocular deviation information refers to the deviation information between the line of sight of the amblyopic eye and the line of sight of the dominant eye. If the binocular deviation information is greater than or equal to the first threshold, the amblyopia type of the amblyopic eye is determined to be strabismic amblyopia. If the binocular deviation information is less than the first threshold, the amblyopia type of the amblyopic eye is determined to be anisometropic amblyopia.

[0102] The binocular deviation information is also referred to as the distance between binocular gaze positions. Therefore, in some embodiments, the amblyopia training device determines the binocular deviation information by the following formula according to the first gaze position coordinates and the second gaze position coordinates.

[0103]

[0104] Among them, in the above formula, ED is the binocular deviation information, (L x , L y ) is the first gaze position coordinate, (R x , R y ) is the second gaze position coordinate.

[0105] It should be noted that, under normal circumstances, the binocular deviation information should be as close to 0 as possible. That is to say, the larger the binocular deviation information, the more severe the degree of strabismus, and the smaller the binocular deviation information, the milder the degree of strabismus. Therefore, when it is determined that there is an amblyopic eye in the user's eyes, it can be determined whether the binocular deviation information is greater than or equal to the first threshold. If the binocular deviation information is greater than or equal to the first threshold, the amblyopia type of the user's amblyopic eye is strabismic amblyopia. If the binocular deviation information is less than the first threshold, the amblyopia type of the user's amblyopic eye is anisometropic amblyopia.

[0106] That is to say, when it is determined that there is an amblyopic eye in the user's eyes, the amblyopia type of the amblyopic eye can be determined by the first threshold value, whether it is strabismic amblyopia or anisometropic amblyopia.

[0107] The first threshold refers to any value within a reference distance range, and the reference distance range refers to a distance range used to distinguish strabismic amblyopia from anisometropic amblyopia. Moreover, the first threshold is related to the angular resolution of the amblyopia training device. For example, when the average angular resolution of the display screen of the amblyopia training device is 20, the first threshold is 100 pixels. When the average angular resolution of the display screen of the amblyopia training device is 30, the first threshold is 150 pixels.

[0108] It is worth noting that, based on the above description, amblyopia is usually caused by monocular strabismus, anisometropia, high refractive error, visual deprivation, etc. However, for the two types of high refractive error and visual deprivation, since the eye has been physiologically damaged, the vision of the amblyopic eye cannot be corrected through amblyopia training. Therefore, the embodiment of the present application distinguishes between strabismic amblyopia and anisometropia amblyopia to perform amblyopia training, and does not involve the two types of amblyopia, high refractive error and visual deprivation.

[0109] The above implementation process is to perform a test to determine binocular deviation information by eye tracking, thereby determining the amblyopia type of the amblyopic eye. In other embodiments, multiple tests can be performed by eye tracking to determine binocular deviation information, thereby determining the amblyopia type of the amblyopic eye. That is, in other embodiments, the implementation process of determining the amblyopia type of the amblyopic eye is: displaying a first test image in the display area corresponding to the dominant eye, and displaying a second test image in the display area corresponding to the amblyopic eye. By eye tracking, the coordinates of multiple gaze positions of the dominant eye in the displayed first test image and the coordinates of multiple gaze positions of the amblyopic eye in the displayed second test image are determined to obtain multiple first gaze position coordinates and multiple second gaze position coordinates. According to the multiple first gaze position coordinates and the multiple second gaze position coordinates, the amblyopia type of the amblyopic eye is determined.

[0110] The implementation process of determining the amblyopia type of the amblyopic eye according to multiple first gaze position coordinates and multiple second gaze position coordinates is as follows: determining a binocular deviation information according to the first gaze position coordinates and the second gaze position coordinates determined at the same time, thereby obtaining multiple binocular deviation information, wherein the binocular deviation information refers to the deviation information between the line of sight of the amblyopic eye and the line of sight of the dominant eye. Determine the statistical value of the multiple binocular deviation information, and if the statistical value of the multiple binocular deviation information is greater than or equal to the first threshold, determine the amblyopia type of the amblyopic eye as strabismic amblyopia. If the statistical value of the multiple binocular deviation information is less than the first threshold, determine the amblyopia type of the amblyopic eye as anisometropic amblyopia.

[0111] For example, assuming that the amblyopia training device displays a first test image in the display area corresponding to the dominant eye and a second test image in the display area corresponding to the amblyopic eye, the coordinates of the 7 gaze positions of the dominant eye in the first test image and the coordinates of the 7 gaze positions of the amblyopic eye in the second test image are determined by eye tracking, and 7 first gaze position coordinates and 7 second gaze position coordinates are obtained. According to the 7 first gaze position coordinates and the 7 second gaze position coordinates, the 7 binocular deviation information is determined as follows: Figure 3 By determining the statistical values ​​of the 7 binocular deviation information, the amblyopia type of the amblyopic eye can be determined.

[0112] It should be noted that the statistical values ​​of the multiple binocular deviation information refer to the average value, median value, etc. of the multiple binocular deviation information, which is not limited in the embodiment of the present application.

[0113] Step 203: When the amblyopia type of the amblyopic eye is determined to be strabismic amblyopia, amblyopia training is performed by performing homography transformation on the amblyopia training image; when the amblyopia type of the amblyopic eye is determined to be anisometropic amblyopia, amblyopia training is performed by performing image size adjustment on the amblyopia training image.

[0114] In some embodiments, the implementation process of performing homography transformation processing on the amblyopia training image is as follows: displaying the amblyopia training image in the display area corresponding to the dominant eye, performing homography transformation processing on the amblyopia training image and displaying it in the display area corresponding to the amblyopia eye, so that the images seen by both eyes of the user can be combined to perform amblyopia training. Similarly, the implementation process of performing image resizing on the amblyopia training image to perform amblyopia training is as follows: displaying the amblyopia training image in the display area corresponding to the dominant eye, performing image resizing on the amblyopia training image and displaying it in the display area corresponding to the amblyopia eye, so that the images seen by both eyes of the user can be combined to perform amblyopia training.

[0115] In other embodiments, in order to improve the imaging ability of the amblyopic eye, the image contrast corresponding to the dominant eye and the image contrast corresponding to the amblyopic eye may also be determined so that the user's binocular perception ability is the same. In this way, the amblyopia training image can be displayed in the display area corresponding to the dominant eye according to the image contrast corresponding to the dominant eye, and the amblyopia training image can be homographically transformed according to the image contrast corresponding to the amblyopic eye and then displayed in the display area corresponding to the amblyopic eye, so that the images seen by both eyes of the user can be combined to perform amblyopia training. Alternatively, the amblyopia training image can be displayed in the display area corresponding to the dominant eye according to the image contrast corresponding to the dominant eye, and the amblyopia training image can be resized according to the image contrast corresponding to the amblyopic eye and then displayed in the display area corresponding to the amblyopic eye, so that the images seen by both eyes of the user can be combined to perform amblyopia training.

[0116] For the above two embodiments, the operation of processing the amblyopia training image according to the amblyopia type of the amblyopic eye and the operation of performing amblyopia training are the same, the only difference is whether it is necessary to determine the image contrast corresponding to each of the two eyes, and then display the amblyopia training image according to the image contrast corresponding to each of the two eyes during the amblyopia training process. Next, taking the second embodiment as an example, the amblyopia training process provided by the embodiment of the present application is introduced through the following steps (1)-(2).

[0117] (1) Determine the image contrast corresponding to the dominant eye and the image contrast corresponding to the amblyopic eye so that the user's binocular perception abilities are the same.

[0118] In some embodiments, the amblyopia training device displays a third test image in a display area corresponding to the dominant eye, and displays a fourth test image in a display area corresponding to the amblyopic eye. Afterwards, the contrast of the displayed third test image is reduced, and the contrast of the displayed fourth test image is increased. When a contrast determination instruction is detected, the contrast of the third test image after the reduction is determined as the image contrast corresponding to the dominant eye, and the contrast of the fourth test image after the increase is determined as the image contrast corresponding to the amblyopic eye. The contrast determination instruction is triggered when the user feedbacks that the contrast that can be perceived by both eyes of the user is the same based on the displayed third test image and fourth test image.

[0119] That is, by displaying a test image on two display areas of the amblyopia training device, respectively, and adjusting the contrast of the two test images through the user's subjective feedback, the user's two eyes can perceive the same contrast. Moreover, in the embodiment of the present application, by reducing the contrast of the third test image and increasing the contrast of the fourth test image, it is ensured that the user's two eyes can perceive the same contrast. In other words, by reducing the contrast of the dominant eye and increasing the contrast of the amblyopic eye, in the subsequent amblyopia training process, different contrast images are displayed to the dominant eye and the amblyopic eye, respectively, to strengthen the amblyopic eye and suppress the imaging ability of the dominant eye, thereby achieving the purpose of amblyopia training.

[0120] The implementation process of reducing the contrast of the displayed third test image and increasing the contrast of the displayed fourth test image is as follows: reducing the contrast of the third test image according to the adjustment step length, and increasing the contrast of the fourth test image according to the adjustment step length. Displaying the adjusted third test image and fourth test image. When the contrast adjustment instruction is detected, continue to reduce the contrast of the third test image according to the adjustment step length, and increase the contrast of the fourth test image according to the adjustment step length, and display the third test image and fourth test image after the contrast adjustment until the contrast determination instruction is detected. The contrast adjustment instruction is triggered by the user's feedback that the contrast of both eyes is different based on the displayed third test image and fourth test image.

[0121] It should be noted that, in the process of adjusting the contrast of the third test image by adjusting the step length, the display area corresponding to the dominant eye can be blocked, and then displayed after the adjustment, and the user determines whether the contrast of the two eyes is the same. Of course, in the process of adjusting the contrast of the third test image by adjusting the step length, the display area corresponding to the dominant eye can also be not blocked. Similarly, in the process of adjusting the contrast of the fourth test image by adjusting the step length, the display area corresponding to the amblyopic eye can be blocked, and then displayed after the adjustment, and the user determines whether the contrast of the two eyes is the same. Of course, in the process of adjusting the contrast of the fourth test image by adjusting the step length, the display area corresponding to the amblyopic eye can also be not blocked, and the embodiments of the present application are not limited to this.

[0122] In addition, the contrast of the third test image and the contrast of the fourth test image can be adjusted in sequence. For example, the contrast of the third test image is first reduced according to the adjustment step, and then the adjusted third test image and fourth test image are displayed. If the user feedback is that the contrast of the two eyes is different based on the displayed third test image and fourth test image, then the contrast of the fourth test image is increased according to the adjustment step, and the adjusted third test image and fourth test image are displayed. If the user feedback is that the contrast of the two eyes is different based on the displayed third test image and fourth test image, then the contrast of the third test image is further reduced according to the adjustment step until the user feedback is that the contrast of the two eyes is the same based on the displayed third test image and fourth test image.

[0123] Of course, first reducing the contrast of the third test image and then increasing the contrast of the fourth test image is only an example. Of course, the contrast of the fourth test image may be increased first and then the contrast of the third test image may be reduced. The embodiment of the present application does not limit the adjustment order of the third test image and the fourth test image.

[0124] The third test image and the fourth test image may be the same or different. The third test image and the fourth test image may be projected by the terminal device onto the amblyopia training device. Of course, the third test image and the fourth test image may also be stored by the amblyopia training device itself, which is not limited in the embodiments of the present application.

[0125] In the case where the third test image and the fourth test image are stored by the amblyopia training device itself, the amblyopia training device can be manually adjusted according to the adjustment step length to adjust the contrast of the test image. However, in the case where the third test image and the fourth test image are projected onto the amblyopia training device by the terminal device, not only can the amblyopia training device be manually adjusted according to the adjustment step length to adjust the contrast of the test image, but the terminal device can also be manually adjusted according to the adjustment step length to adjust the contrast of the test image.

[0126] The adjustment step length for each contrast adjustment may be the same or different. The adjustment step length may be a pre-set step length or may be calculated based on the contrast between the third test image and the fourth test image.

[0127] As an example, the contrast difference between the third test image and the fourth test image is determined, and the contrast difference is divided by a preset number of times to obtain an adjustment step. That is, in this way, after adjusting the third test image and the fourth test image by a preset number of times, the contrast seen by both eyes of the user will be the same.

[0128] As another example, the contrast difference between the third test image and the fourth test image is determined, and the corresponding adjustment step is obtained from the stored correspondence between the contrast difference and the adjustment step according to the contrast difference. The correspondence between the contrast difference and the adjustment step can be determined in advance based on experience.

[0129] The above implementation process is to determine the image contrast corresponding to the dominant eye and the image contrast corresponding to the amblyopic eye based on the subjective feedback of the user, but the contrast of the user's subjective feedback may often be biased. Therefore, in other embodiments, multiple third test images are displayed in the display area corresponding to the dominant eye, and multiple fourth test images are displayed in the display area corresponding to the amblyopic eye. The multiple third test images include the first moving target, and the multiple fourth test images include the second moving target. In this way, before the contrast of the third test image after the reduction is determined as the image contrast corresponding to the dominant eye, and the contrast of the fourth test image after the increase is determined as the image contrast corresponding to the amblyopic eye, it also includes: determining the gaze trajectory of the dominant eye on the first moving target in the multiple third test images, and the gaze trajectory of the amblyopic eye on the second moving target in the multiple fourth test images by eye tracking, and obtaining the first gaze trajectory and the second gaze trajectory. Obtain the actual motion trajectory of the first moving target and the actual motion trajectory of the second moving target, and obtain the first actual motion trajectory and the second actual motion trajectory. If the first gaze trajectory matches the first actual motion trajectory, and the second gaze trajectory matches the second actual motion trajectory, the contrast of the third test image after being reduced is determined as the image contrast corresponding to the dominant eye, and the contrast of the fourth test image after being increased is determined as the image contrast corresponding to the amblyopic eye.

[0130] That is, by means of eye tracking, it is possible to further accurately determine whether the image contrast corresponding to the two eyes determined by the user's subjective feedback is accurate, thereby avoiding errors caused by subjective feedback.

[0131] As an example, the first gaze trajectory matches the first actual motion trajectory means that the overlap between the first gaze trajectory and the first actual motion trajectory is greater than a certain threshold. Similarly, the second gaze trajectory matches the second actual motion trajectory means that the overlap between the second gaze trajectory and the second actual motion trajectory is greater than a certain threshold.

[0132] The first moving target and the second moving target may be the same or different. In addition, the first gaze trajectory and the second gaze trajectory are determined in a similar manner to the above-mentioned method of determining the two gaze position coordinates when determining the binocular deviation, and the present embodiment will not be described in detail.

[0133] Furthermore, if the first gaze trajectory does not match the first actual motion trajectory, the contrast of the third test image needs to be readjusted, and during the adjustment process, the first gaze trajectory is redetermined by eye tracking. If the redetermined first gaze trajectory does not match the first actual motion trajectory, the adjustment is continued until the redetermined first gaze trajectory matches the first actual motion trajectory, thereby obtaining the image contrast corresponding to the dominant eye. Similarly, if the second gaze trajectory does not match the second actual motion trajectory, the contrast of the fourth test image needs to be readjusted, and during the adjustment process, the second gaze trajectory is redetermined by eye tracking. If the redetermined second gaze trajectory does not match the second actual motion trajectory, the adjustment is continued until the redetermined second gaze trajectory matches the second actual motion trajectory, thereby obtaining the image contrast corresponding to the amblyopic eye.

[0134] (2) According to the image contrast corresponding to the dominant eye, the amblyopia training image is displayed in the display area corresponding to the dominant eye. According to the image contrast corresponding to the amblyopia eye, the amblyopia training image is subjected to homography transformation or image resizing according to the amblyopia type of the amblyopia eye and then displayed in the display area corresponding to the amblyopia eye, so that the images seen by the user's two eyes can be combined to perform amblyopia training.

[0135] Based on the above description, amblyopia types include strabismic amblyopia and anisometropic amblyopia. For different amblyopia types, the operations for processing amblyopia training images are different, which will be introduced separately below.

[0136] The amblyopia type of the amblyopic eye is strabismic amblyopia

[0137] In this case, the amblyopia training image includes a target object, and the target object is used for amblyopia training. At this time, the amblyopia training image is homographically transformed according to the binocular deviation information. The amblyopia training image before the homography transformation is used as the first training image, and the amblyopia training image after the homography transformation is used as the second training image. According to the image contrast corresponding to the dominant eye, the first training image is displayed in the display area corresponding to the dominant eye, and according to the image contrast corresponding to the amblyopic eye, the second training image is displayed in the display area corresponding to the amblyopic eye. By means of eye tracking, the gaze position of the dominant eye in the first training image and the gaze position of the amblyopic eye in the second training image are determined to obtain the first gaze position and the second gaze position. If the first gaze position coincides with the actual position of the target object in the first training image, and the second gaze position coincides with the actual position of the target object in the second training image, the homography transformation amount of the amblyopia training image is reduced, and the step of using the amblyopia training image before the homography transformation as the first training image and the amblyopia training image after the homography transformation as the second training image is returned to, until the amblyopia training is completed, or the second gaze position coincides with the actual position of the target object in the second training image without performing the homography transformation on the amblyopia training image.

[0138] Homography refers to the mapping relationship from one image to another, usually including translation and / or rotation. Since the eyes are usually not sensitive enough to rotation, in the embodiment of the present application, homography mainly refers to translation. In addition, based on the above-mentioned binocular deviation calculation process, binocular deviation information can be divided into deviation information in the horizontal direction and deviation information in the vertical direction. In this way, the implementation process of homography for amblyopia training images according to binocular deviation information is as follows: the deviation information in the horizontal direction in the binocular deviation information is determined as the translation amount in the horizontal direction, and the deviation information in the vertical direction in the binocular deviation information is determined as the translation amount in the vertical direction. Afterwards, the amblyopia training image is translated according to the translation amount in the horizontal direction and the translation amount in the vertical direction, thereby realizing the homography for amblyopia training images.

[0139] In addition, the subsequent reduction of the homography transformation amount of the amblyopia training image may refer to reducing the horizontal translation amount and / or vertical translation amount of the amblyopia training image, and the reduction amount in the horizontal direction and the vertical direction may be the same or different, and the reduction amount may be set as required.

[0140] For example, Figure 4As shown, it is assumed that the user's left eye is strabismic amblyopia, that is, the user's left eye is strabismic and the right eye is straight. At this time, there is a deviation between the line of sight of the left eye and the line of sight of the right eye. In order to perform amblyopia training on the user's left eye, the position of the target object in the amblyopia training image needs to be translated to the left. Afterwards, the amblyopia training image before translation is used as the first training image, and the amblyopia training image after translation is used as the second training image. According to the image contrast corresponding to the right eye, the first training image is displayed in the display area corresponding to the right eye, and according to the image contrast corresponding to the left eye, the second training image is displayed in the display area corresponding to the left eye.

[0141] By means of eye tracking, the gaze position of the right eye in the first training image and the gaze position of the left eye in the second training image are determined to obtain a first gaze position and a second gaze position. If the first gaze position coincides with the actual position of the target object in the first training image, and the second gaze position coincides with the actual position of the target object in the second training image, then the leftward translation of the target object in the amblyopia training image is reduced, and the corresponding amblyopia training image continues to be displayed in the display area of ​​both eyes. If the second gaze position coincides with the actual position of the target object in the second training image without the target object in the amblyopia training image being translated, then it can be determined that the user's left eye has returned to emmetropia, that is, if Figure 5 shown.

[0142] The method for determining the first gaze position and the second gaze position is similar to the method for determining the two gaze position coordinates when determining the binocular deviation, and will not be described in detail in the embodiment of the present application.

[0143] For strabismic amblyopia, since there is a deviation between the sight direction of the amblyopic eye and the sight direction of the dominant eye, it is necessary to perform a homography transformation on the amblyopic training image to adjust the position of the target object in the amblyopic training image. Then, the unadjusted amblyopic training image is displayed in the display area corresponding to the dominant eye, and the adjusted amblyopic training image is displayed in the display area corresponding to the amblyopic eye, so that during the training of the amblyopic eye, the images seen by the user's two eyes can be combined, that is, the two eyes can see the same picture. Moreover, the two eyes simultaneously watch the amblyopic training image in the corresponding display area, which can ensure the stereoscopic vision of the two eyes.

[0144] In addition, based on the above description, the image contrast corresponding to the dominant eye and the image contrast corresponding to the amblyopic eye may be different. In this way, the first training image is displayed according to the image contrast corresponding to the dominant eye, and the second training image is displayed according to the image contrast corresponding to the amblyopic eye. While improving the imaging ability of the amblyopic eye, it can also ensure the user's comfort, make it easier for the user to accept the training method and training process, improve the training effect, and increase user stickiness.

[0145] It should be noted that the entire process of amblyopia training can be divided into multiple cycles, but after each cycle of amblyopia training, the image contrast corresponding to both eyes may change. Therefore, under normal circumstances, before each cycle of amblyopia training, it is necessary to determine the image contrast corresponding to the user's two eyes. The specific implementation process is described above and will not be repeated here.

[0146] Amblyopia in the amblyopic eye is anisometropic amblyopia

[0147] In this case, the amblyopia training image includes a target object, and the target object is used for amblyopia training. At this time, the position and / or size of the target object in the amblyopia training image is adjusted multiple times to obtain multiple training images, and the image scaling ratio of the amblyopic eye relative to the dominant eye is determined. According to the image scaling ratio, the sizes of the multiple training images are scaled. The multiple training images before scaling are used as multiple third training images, and the multiple training images after scaling are used as multiple fourth training images. According to the image contrast corresponding to the dominant eye, the multiple third training images are sequentially displayed in the display area corresponding to the dominant eye, and according to the image contrast corresponding to the amblyopic eye, the multiple fourth training images are sequentially displayed in the display area corresponding to the amblyopic eye, and the display order and switching frequency of the multiple third training images and the multiple fourth training images are the same.

[0148] For anisometropic amblyopia, since the refractive power of the amblyopic eye is higher than that of the dominant eye, the size of the image seen by the amblyopic eye may be different from the size of the image seen by the dominant eye. Therefore, after the position and / or size of the target object in the amblyopia training image is adjusted multiple times to obtain multiple training images, it is necessary to determine the image scaling ratio of the amblyopic eye relative to the dominant eye, and then scale the sizes of the multiple training images according to the image scaling ratio so that the images seen by the dominant eye and the amblyopic eye can be combined, that is, both eyes can see the same picture.

[0149] There are many ways to adjust the position and / or size of the target object in the amblyopia training image multiple times, and four of them are introduced below.

[0150] In the first method, the position of the target object in the amblyopia training image is adjusted in the order of top, bottom, left, and right to obtain four training images. That is, for the four training images, the position of the target object is located at the top, bottom, left, and right positions in the image in sequence.

[0151] For example, Figure 6As shown in FIG. 1 , the position of the target object in the amblyopia training image is adjusted in the order of up, down, left, and right, and the four training images obtained are training image 1 to training image 4. In this way, after the four training images are displayed in the display area in sequence, the user will see the following: Figure 7 The image shown, that is, the target object is Figure 7 Change the positions of 1, 2, 3, and 4.

[0152] In the second method, the position of the target object in the amblyopia training image is adjusted in a rotational manner to obtain a plurality of training images.

[0153] For example, Figure 8 As shown in FIG. 1 , after adjusting the position of the target object in the amblyopia training image in a rotational manner, eight training images are obtained, namely, training image 1 to training image 8. Thus, after displaying the eight training images in sequence in the display area, the user will see the following: Fig. 9 The image shown, that is, the target object is Fig. 9 Change the positions of 1, 2, 3, 4, 5, 6, 7, and 8.

[0154] In a third method, the position of the target object in the amblyopia training image is randomly adjusted to obtain multiple training images.

[0155] For example, Fig.10 As shown in FIG. 1 , after randomly adjusting the position of the target object in the amblyopia training image, nine training images are obtained, namely, training image 1 to training image 9. Thus, after displaying these nine training images in sequence in the display area, the user will see the following: Fig.11 The image shown, that is, the target object is Fig.11 Change the positions of 1, 2, 3, 4, 5, 6, 7, 8, and 9.

[0156] A fourth method is to adjust the size of the target object in the amblyopia training image multiple times to obtain multiple training images.

[0157] For example, Fig.12 As shown in FIG. 1 , the size of the target object in the amblyopia training image is adjusted four times to obtain four training images, namely, training image 1 to training image 4. Thus, after the four training images are sequentially displayed in the display area, the user will see the following: Fig.13 The image shown, that is, the target object presents a shape from far to near.

[0158] It should be noted that the first three methods are to adjust the position of the target object, and the last method is to adjust the size of the target object. In practical applications, the first three methods can also adjust the size of the target object on the basis of adjusting the position, that is, the position and size are superimposed for adjustment. Similarly, for the last method, the position of the target object can also be adjusted on the basis of adjusting the size of the target object, and the embodiments of the present application will not be repeated here.

[0159] The embodiments of the present application train the extraocular muscles through up and down, left and right, rotational, random, near and far movements, etc., to improve the imaging ability of the amblyopic eye, thereby achieving the purpose of training the amblyopic eye.

[0160] The implementation process of determining the image scaling ratio of the amblyopic eye relative to the dominant eye is as follows: displaying a fifth test image in a display area corresponding to the dominant eye, and displaying a sixth test image in a display area corresponding to the amblyopic eye, wherein the fifth test image includes a first test target, and the sixth test image includes a second test target, and the first test target and the second test target have the same ratio. The ratio of the sixth test image displayed is scaled. When a ratio determination instruction is detected, the ratio between the first test target and the scaled second test target is determined to obtain the image scaling ratio, and the ratio determination instruction is triggered when the user feedbacks that his or her own eyes can see the first test target and the second test target of the same ratio based on the displayed fifth test image and sixth test image.

[0161] That is, for the same eye, the first test target in the fifth test image and the second test target in the sixth test image are initially the same in proportion. Then, in the process of the dominant eye gazing at the fifth test image and the amblyopic eye gazing at the sixth test image, the proportion of the sixth test image is adjusted, and when the user feedbacks that his or her eyes can see the first test target and the second test target of the same proportion based on the displayed fifth test image and sixth test image, the image scaling ratio is determined by the size of the first test target and the size of the scaled second test target.

[0162] As an example, the ratio between the height of the scaled second test target and the height of the unscaled first test target is determined as the scaling ratio in the vertical direction, and the ratio between the width of the scaled second test target and the width of the unscaled first test target is determined as the scaling ratio in the horizontal direction. Then, the scaling ratio in the vertical direction and the scaling ratio in the horizontal direction are determined as the image scaling ratio of the amblyopic eye relative to the dominant eye.

[0163] In this example, according to the image scaling ratio, the implementation process of scaling the sizes of the multiple training images is: multiplying the heights of the multiple training images by the scaling ratio in the vertical direction, and multiplying the widths of the multiple training images by the scaling ratio in the horizontal direction, thereby obtaining the scaled multiple training images.

[0164] As another example, the ratio between the height of the unscaled first test target and the height of the scaled second test target is determined as the scaling ratio in the vertical direction, and the ratio between the width of the unscaled first test target and the width of the scaled second test target is determined as the scaling ratio in the horizontal direction. Then, the scaling ratio in the vertical direction and the scaling ratio in the horizontal direction are determined as the image scaling ratio of the amblyopic eye relative to the dominant eye.

[0165] In this example, according to the image scaling ratio, the implementation process of scaling the sizes of the multiple training images is: dividing the heights of the multiple training images by the scaling ratio in the vertical direction, and dividing the widths of the multiple training images by the scaling ratio in the horizontal direction, thereby obtaining the scaled multiple training images.

[0166] It should be noted that the above is to determine the image scaling ratio by scaling the sixth test image. Of course, the image scaling ratio can also be determined by scaling the fifth test image. In addition, in order to facilitate binocular image combination, the backgrounds of the fifth test image and the sixth test image can be the same.

[0167] For example, Fig.14 As shown, assuming that the left eye is the dominant eye and the right eye is the amblyopic eye, the fifth test image is displayed in the display area of ​​the left eye, the fifth test image includes the first test target, and the height and width of the first test target are both 2 cm, and the sixth test image is displayed in the display area of ​​the right eye, the sixth test image includes the second test target, and the height and width of the second test target are also both 2 cm. Then, the scale of the sixth test image is scaled. When the image seen by the user is Fig.15 When the image shown is shown, that is, when the outer contour of the second test target is inscribed in the outer contour of the first test target, it is determined that the user's eyes can see the first test target and the second test target of the same proportion. At this time, it is determined that the height and width of the scaled second test target are both 3 cm, so the image scaling ratio is determined to be 3:2. In this way, for amblyopia, the sizes of multiple training images need to be multiplied by the image scaling ratio to perform amblyopia training later.

[0168] It should be noted that the embodiment of the present application can not only determine the image scaling ratio of the amblyopic eye relative to the dominant eye, but also determine the rotation angle of the amblyopic eye relative to the dominant eye. However, since the eye is usually not sensitive enough to rotation, the embodiment of the present application mainly determines the image scaling ratio, and then scales the image for amblyopia training of the amblyopic eye.

[0169] In addition, when conducting amblyopia training according to different amblyopia types, the refractive power of the amblyopic eye can also be corrected, and then amblyopia training can be conducted in the above manner.

[0170] After the amblyopia training is performed according to different amblyopia types, the embodiment of the present application can also provide feedback on the amblyopia training effect, so as to facilitate the user to adjust the training plan in a targeted manner. Next, two methods of providing feedback on the amblyopia training effect are introduced.

[0171] The first method is to determine the gaze position of the amblyopic eye in the image displayed in the display area corresponding to the amblyopic eye by eye tracking, and obtain the gaze position of the amblyopic eye. If the gaze position of the amblyopic eye coincides with the actual position of the target object in the image displayed in the display area corresponding to the amblyopic eye, the display mode of the target object in the image displayed in the display area corresponding to the amblyopic eye is modified to the reference display mode to indicate the amblyopia training effect.

[0172] Among them, the reference display mode may refer to highlighting, color changing, etc., and the embodiments of the present application do not limit this.

[0173] For example, Fig.16 As shown, if the gaze position of the amblyopic eye coincides with the actual position of the target object, the target object is changed in color. In this way, after multiple trainings, the user can know the number of times the gaze position coincides with the actual position, and then determine the effect of the amblyopia training, so as to adjust the training plan at any time.

[0174] The second method is to determine the gaze position of the amblyopic eye in the image displayed in the display area corresponding to the amblyopic eye by eye tracking, and obtain the gaze position of the amblyopic eye. According to the gaze position of the amblyopic eye and the actual position of the target object, an amblyopia training curve is drawn to indicate the amblyopia training effect.

[0175] As an example, the total number of training sessions in this amblyopia training cycle and the percentage of the number of times the amblyopia eye gaze position overlaps with the actual position of the target object in this amblyopia training cycle to the total number of training sessions are counted. Then, the amblyopia training curve is drawn by combining the data of multiple amblyopia training cycles in history. That is, the amblyopia training curve is drawn by taking multiple amblyopia training cycles as the horizontal axis and the percentage determined in each amblyopia training cycle as the vertical axis.

[0176] For example, Fig.17As shown in FIG. 1 , the amblyopia training device performs amblyopia training in 7 amblyopia training cycles. During these 7 amblyopia training cycles, the percentage of the number of times the amblyopia eye's gaze position coincides with the actual position of the target object to the total number of training times is 50%, 60%, 70%, 80%, 90%, 95%, and 100%, respectively. At this time, the amblyopia training curve drawn is as follows: Fig.17 shown.

[0177] It should be noted that the above two methods can be used alone or in combination, and the embodiments of the present application do not limit this. Of course, in practical applications, other methods can also be used to feedback the effect of amblyopia training. For example, after each amblyopia training cycle, the refractive power of the amblyopic eye can be detected, and then the amblyopia training curve can be drawn with multiple amblyopia training cycles as the horizontal axis and the refractive power of the amblyopic eye as the vertical axis. Fig.18 As shown in FIG. 1 , the amblyopia training device performs amblyopia training in 11 amblyopia training cycles. During these 11 amblyopia training cycles, the refractive power of the amblyopic eye is 700, 650, 600, 500, 450, 400, 350, 300, 275, 275, and 275, respectively. At this time, the amblyopia training curve drawn is as follows: Fig.18 shown.

[0178] In addition, the embodiment of the present application can feedback the amblyopia training effect through the amblyopia training device, and can also feedback the amblyopia training effect through the terminal device. That is, after the amblyopia training device determines the amblyopia training effect, it can directly feedback to the user. Of course, the amblyopia training device can also send the amblyopia training effect to the terminal device, and the terminal device can directly feedback to the user.

[0179] The above implementation process is used to determine the gaze position of the amblyopic eye, so as to provide feedback on the amblyopia training effect. Of course, in other embodiments, the gaze position of the dominant eye can also be determined, so as to provide feedback on the amblyopia training effect. Among them, the method of determining the gaze position of the dominant eye and providing feedback on the amblyopia training effect is the same as the method of the amblyopic eye described above, and the embodiments of the present application will not be repeated here.

[0180] In an embodiment of the present application, amblyopia training is performed by determining the amblyopia type of the amblyopic eye, and processing the amblyopia training image according to the amblyopia type of the amblyopic eye and displaying it. That is to say, by distinguishing the amblyopia type, targeted training is performed according to different symptoms, which can improve the amblyopia training effect. Moreover, in the embodiment of the present application, during the amblyopia training process, amblyopia training images are displayed in the display areas corresponding to both eyes, so that the images seen by both eyes can be combined to improve the stereoscopic vision of both eyes. Furthermore, after the amblyopia training is performed, the embodiment of the present application can also feedback the amblyopia training effect, so that the user can adjust the amblyopia training plan in a targeted manner and improve user stickiness. Finally, the disadvantaged training device provided by the embodiment of the present application integrates amblyopia detection, training, and effect feedback, so that users can perform targeted training more flexibly, and prompt training efficiency and training effect.

[0181] Fig.19 is a structural diagram of an amblyopia training device provided in an embodiment of the present application. The amblyopia training device can be implemented by software, hardware or a combination of both to become part or all of the amblyopia training device. The amblyopia training device can be Figure 1 Amblyopia training equipment shown. Fig.19 The device includes: a first determining module 1901, a second determining module 1902, a first amblyopia training module 1903 and a second amblyopia training module 1904.

[0182] The first determination module 1901 is used to determine the dominant eye and the amblyopic eye of the user;

[0183] The second determination module 1902 is used to determine the amblyopia type of the amblyopic eye, where the amblyopia type includes strabismic amblyopia or anisometropic amblyopia;

[0184] A first amblyopia training module 1903 is used for performing homography transformation processing on the amblyopia training image to perform amblyopia training when the amblyopia type of the amblyopic eye is determined to be strabismic amblyopia;

[0185] The second amblyopia training module 1904 is used to perform image size adjustment processing on the amblyopia training image to perform amblyopia training when the amblyopia type of the amblyopic eye is determined to be anisometropic amblyopia.

[0186] Optionally, the second determining module 1902 includes:

[0187] A display submodule, configured to display a first test image in a display area corresponding to the dominant eye, and display a second test image in a display area corresponding to the amblyopic eye;

[0188] A first determination submodule is used to determine the coordinates of the gaze position of the dominant eye in the displayed first test image and the coordinates of the gaze position of the amblyopic eye in the displayed second test image by eye tracking, to obtain first gaze position coordinates and second gaze position coordinates;

[0189] The second determination submodule is used to determine the amblyopia type of the amblyopic eye according to the first gaze position coordinates and the second gaze position coordinates.

[0190] Optionally, the second determining submodule is specifically used for:

[0191] Determining binocular deviation information according to the first gaze position coordinate and the second gaze position coordinate, wherein the binocular deviation information refers to deviation information between the sight direction of the amblyopic eye and the sight direction of the dominant eye;

[0192] If the binocular deviation information is greater than or equal to the first threshold, determining that the amblyopia type of the amblyopic eye is strabismic amblyopia;

[0193] If the binocular deviation information is less than the first threshold, it is determined that the amblyopia type of the amblyopic eye is anisometropic amblyopia.

[0194] Optionally, the first determining module is specifically configured to:

[0195] Detecting the diopter of the user's eyes;

[0196] The eye with lower refractive power of the user is determined as the dominant eye, and the eye with higher refractive power of the user is determined as the amblyopic eye.

[0197] Optionally, the first amblyopia training module 1903 includes:

[0198] The first amblyopia training submodule is used to display an amblyopia training image in the display area corresponding to the dominant eye, and display the amblyopia training image in the display area corresponding to the amblyopia eye after homography transformation, so that the images seen by the user's two eyes can be combined to perform amblyopia training.

[0199] Optionally, the second amblyopia training module 1904 includes:

[0200] The second amblyopia training submodule is used to display an amblyopia training image in the display area corresponding to the dominant eye, and to adjust the image size of the amblyopia training image and then display it in the display area corresponding to the amblyopia eye, so that the images seen by the user's two eyes can be combined to perform amblyopia training.

[0201] Optionally, the device further comprises:

[0202] The third determination module is used to determine the image contrast corresponding to the dominant eye and the image contrast corresponding to the amblyopic eye so that the user's binocular perception ability is the same.

[0203] Optionally, the third determining module is specifically configured to:

[0204] Displaying a third test image in the display area corresponding to the dominant eye, and displaying a fourth test image in the display area corresponding to the amblyopic eye;

[0205] reducing the contrast of the displayed third test image and increasing the contrast of the displayed fourth test image;

[0206] The third determination submodule is used to, when a contrast determination instruction is detected, determine the contrast of the third test image after being reduced as the image contrast corresponding to the dominant eye, and determine the contrast of the fourth test image after being increased as the image contrast corresponding to the amblyopic eye. The contrast determination instruction is triggered when the user feedbacks that the contrast that can be perceived by both eyes of the user is the same based on the displayed third test image and fourth test image.

[0207] Optionally, the amblyopia training image includes a target object, and the target object is used for amblyopia training;

[0208] The first amblyopia training submodule is specifically used for:

[0209] Performing homography transformation on the amblyopia training image according to binocular deviation information, wherein the binocular deviation information refers to the deviation information between the sight direction of the amblyopic eye and the sight direction of the dominant eye;

[0210] Using the amblyopia training image before homography transformation as the first training image, using the amblyopia training image after homography transformation as the second training image, displaying the first training image in the display area corresponding to the dominant eye according to the image contrast corresponding to the dominant eye, and displaying the second training image in the display area corresponding to the amblyopia according to the image contrast corresponding to the amblyopia;

[0211] Determine the gaze position of the dominant eye in the first training image and the gaze position of the amblyopic eye in the second training image by eye tracking to obtain a first gaze position and a second gaze position;

[0212] If the first gaze position coincides with the actual position of the target object in the first training image, and the second gaze position coincides with the actual position of the target object in the second training image, the homography transformation amount of the amblyopia training image is reduced, and the step of using the amblyopia training image before the homography transformation as the first training image and the amblyopia training image after the homography transformation as the second training image is returned to, until the amblyopia training is completed, or the second gaze position coincides with the actual position of the target object in the second training image without performing the homography transformation on the amblyopia training image.

[0213] Optionally, the amblyopia training image includes a target object, and the target object is used for amblyopia training;

[0214] The second amblyopia training submodule is specifically used for:

[0215] If the amblyopia type of the amblyopic eye is anisometropic amblyopia, the position and / or size of the target object in the amblyopia training image is adjusted multiple times to obtain multiple training images;

[0216] Determine the image scaling ratio for the amblyopic eye relative to the dominant eye;

[0217] Scale the sizes of multiple training images according to the image scaling ratio;

[0218] The multiple training images before scaling are used as multiple third training images, and the multiple training images after scaling are used as multiple fourth training images. According to the image contrast corresponding to the dominant eye, the multiple third training images are sequentially displayed in the display area corresponding to the dominant eye, and according to the image contrast corresponding to the amblyopic eye, the multiple fourth training images are sequentially displayed in the display area corresponding to the amblyopic eye, and the display order and switching frequency of the multiple third training images and the multiple fourth training images are the same.

[0219] Optionally, the second amblyopia training submodule is further used for:

[0220] Display a fifth test image in a display area corresponding to the dominant eye, and display a sixth test image in a display area corresponding to the amblyopic eye, wherein the fifth test image includes a first test target, and the sixth test image includes a second test target, and the first test target and the second test target have the same proportions;

[0221] scaling the displayed sixth test image;

[0222] When a ratio determination instruction is detected, the ratio between the first test target and the scaled second test target is determined to obtain the image scaling ratio. The ratio determination instruction is triggered when the user feedbacks that his or her own eyes can see the first test target and the second test target of the same ratio based on the displayed fifth test image and sixth test image.

[0223] Optionally, the device further comprises:

[0224] A fourth determination module is used to determine the gaze position of the amblyopic eye in the image displayed in the display area corresponding to the amblyopic eye by eye tracking to obtain the gaze position of the amblyopic eye;

[0225] A training effect indication module is used to modify the display mode of the target object in the image displayed in the display area corresponding to the amblyopic eye to a reference display mode if the gaze position of the amblyopic eye coincides with the actual position of the target object in the image displayed in the display area corresponding to the amblyopic eye, so as to indicate the amblyopia training effect, and / or, according to the gaze position of the amblyopic eye and the actual position of the target object, draw an amblyopia training curve to indicate the amblyopia training effect.

[0226] In the embodiment of the present application, the amblyopia type of the amblyopia eye is determined, and the amblyopia training image is processed and displayed according to the amblyopia type of the amblyopia eye to perform amblyopia training. In other words, by distinguishing the amblyopia type, targeted training can be performed according to different symptoms, which can improve the amblyopia training effect. Moreover, in the embodiment of the present application, during the amblyopia training process, the amblyopia training image is displayed in the display area corresponding to both eyes, so that the images seen by both eyes can be combined to improve the stereoscopic vision of both eyes.

[0227] It should be noted that: the amblyopia training device provided in the above embodiment is only illustrated by the division of the above functional modules when performing amblyopia training. In actual application, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the amblyopia training device provided in the above embodiment and the amblyopia training method embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0228] Please refer to Fig. 20 , Fig. 20 2 is a schematic diagram of a structure of an amblyopia training device according to an embodiment of the present application. The amblyopia training device includes at least one processor 2001 , a communication bus 2002 , a memory 2003 and at least one communication interface 2004 .

[0229] The processor 2001 may be a general-purpose central processing unit (CPU), a network processor (NP), a microprocessor, or may be one or more integrated circuits for implementing the solution of the present application, such as an application-specific integrated circuit (ASIC), a programmable logic device (PLD) or a combination thereof. The above-mentioned PLD may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL) or any combination thereof.

[0230] The communication bus 2002 is used to transmit information between the above components. The communication bus 2002 can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, only one thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.

[0231] The memory 2003 may be a read-only memory (ROM), a random access memory (RAM), an electrically erasable programmable read-only memory (EEPROM), an optical disc (including a compact disc read-only memory (CD-ROM), a compressed optical disc, a laser disc, a digital versatile disc, a Blu-ray disc, etc.), a magnetic disk storage medium or other magnetic storage device, or any other medium that can be used to carry or store the desired program code in the form of instructions or data structures and can be accessed by a computer, but is not limited thereto. The memory 2003 may exist independently and be connected to the processor 2001 via the communication bus 2002. The memory 2003 may also be integrated with the processor 2001.

[0232] The communication interface 2004 uses any transceiver-like device for communicating with other devices or communication networks. The communication interface 2004 includes a wired communication interface and may also include a wireless communication interface. Among them, the wired communication interface may be, for example, an Ethernet interface. The Ethernet interface may be an optical interface, an electrical interface, or a combination thereof. The wireless communication interface may be a wireless local area network (WLAN) interface, a cellular network communication interface, or a combination thereof, etc.

[0233] In a specific implementation, as an embodiment, the processor 2001 may include one or more CPUs, such as Fig. 20 CPU0 and CPU1 are shown in the figure.

[0234] In a specific implementation, as an embodiment, the amblyopia training device may include multiple processors, such as Fig. 20 2001 and processor 2005 shown in FIG. Each of these processors may be a single-core processor or a multi-core processor. A processor herein may refer to one or more devices, circuits, and / or processing cores for processing data (such as computer program instructions).

[0235] In a specific implementation, as an embodiment, the amblyopia training device may further include an output device 2006 and an input device 2007. The output device 2006 communicates with the processor 2001 and may display information in a variety of ways. For example, the output device 2006 may be a liquid crystal display (LCD), a light emitting diode (LED) display device, a cathode ray tube (CRT) display device, or a projector. The input device 2007 communicates with the processor 2001 and may receive user input in a variety of ways. For example, the input device 2007 may be a mouse, a keyboard, a touch screen device, or a sensor device.

[0236] In some embodiments, the memory 2003 is used to store the program code 2010 for executing the solution of the present application, and the processor 2001 can execute the program code 2010 stored in the memory 2003. The program code 2010 may include one or more software modules, and the amblyopia training device can implement the method provided in the above embodiment through the processor 2001 and the program code 2010 in the memory 2003.

[0237] Please refer to Fig.21 , Fig.21 1 is a schematic diagram of a terminal device provided in an embodiment of the present application. The terminal device includes a sensor unit 1110 , a computing unit 1120 , a storage unit 1140 and an interaction unit 1130 .

[0238] The sensor unit 1110 generally includes a visual sensor (such as a camera), a depth sensor, an IMU, a laser sensor, etc.;

[0239] The computing unit 1120 usually includes a CPU, a GPU, a cache, a register, etc., and is mainly used to run an operating system;

[0240] The storage unit 1140 mainly includes memory and external storage, and is mainly used for reading and writing user local and temporary data;

[0241] The interaction unit 1130 mainly includes a display screen, a touch panel, a speaker, a microphone, etc., and is mainly used to interact with the user, obtain input, and implement the algorithm effect, etc. For example, the amblyopia training image can be displayed and projected onto the amblyopia training device.

[0242] For ease of understanding, the structure of a terminal device 100 provided in an embodiment of the present application is described below by way of example. Fig. 22 , Fig. 22 It is a structural diagram of a terminal device provided in an embodiment of the present application.

[0243] like Fig. 22 As shown, the terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, and the like.

[0244] It is understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0245] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and / or a neural-network processing unit (neural-network processing unit, NPU), etc. Among them, different processing units can be independent devices or integrated in one or more processors. The processor 110 can execute a computer program to implement any amblyopia training method in the embodiments of the present application.

[0246] The controller may be the nerve center and command center of the terminal device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0247] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory, thereby avoiding repeated access, reducing the waiting time of the processor 110, and thus improving the efficiency of the system.

[0248] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (IC) interface, an inter-integrated circuit sound (IS) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0249] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0250] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from the wired charger through the USB interface 130 .

[0251] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160.

[0252] The wireless communication function of the terminal device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0253] In some feasible implementations, the terminal device 100 can use a wireless communication function to communicate with other devices. For example, the terminal device 100 can communicate with a second electronic device, the terminal device 100 establishes a screen projection connection with the second electronic device, and the terminal device 100 outputs the projection data to the second electronic device. The projection data output by the terminal device 100 may be audio and video data.

[0254] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in terminal device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0255] The mobile communication module 150 can provide solutions for wireless communications including 1G / 3G / 4G / 5G applied to the terminal device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 2. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0256] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0257] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the terminal device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 1, modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency, amplify it, and convert it into electromagnetic waves for radiation through antenna 2.

[0258] In some embodiments, the antenna 1 of the terminal device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the terminal device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0259] The terminal device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.

[0260] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the terminal device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0261] In some feasible implementations, the display screen 194 may be used to display various interfaces of the system output of the terminal device 100 .

[0262] The terminal device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0263] ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 193.

[0264] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the terminal device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0265] Digital signal processors are used to process digital signals. In addition to processing digital image signals, they can also process other digital signals.

[0266] Video codecs are used to compress or decompress digital videos. The terminal device 100 may support one or more video codecs. Thus, the terminal device 100 may play or record videos in various coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG1, MPEG3, MPEG4, etc.

[0267] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of the terminal device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0268] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0269] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the terminal device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as the indoor positioning method in the embodiment of the present application, etc.), etc. The data storage area may store data created during the use of the terminal device 100 (such as audio data, phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.

[0270] The terminal device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor, etc. For example, music playing, recording, etc. In some feasible implementations, the audio module 170 can be used to play the sound corresponding to the video. For example, when the display screen 194 displays the video playing screen, the audio module 170 outputs the sound of the video playing.

[0271] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals.

[0272] The speaker 170A, also called a "horn", is used to convert audio electrical signals into sound signals.

[0273] The receiver 170B, also called a "handset", is used to convert audio electrical signals into sound signals.

[0274] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals.

[0275] The earphone interface 170D is used to connect a wired earphone and can be a USB interface 130 or a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0276] The pressure sensor 180A is used to sense pressure signals and can convert pressure signals into electrical signals. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194. The gyroscope sensor 180B can be used to determine the motion posture of the terminal device 100. The air pressure sensor 180C is used to measure air pressure.

[0277] The acceleration sensor 180E can detect the magnitude of the acceleration of the terminal device 100 in all directions (including three axes or six axes). When the terminal device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the terminal device and applied to applications such as horizontal and vertical screen switching and pedometers.

[0278] The distance sensor 180F is used to measure the distance.

[0279] The ambient light sensor 180L is used to sense the brightness of ambient light.

[0280] The fingerprint sensor 180H is used to collect fingerprints.

[0281] The temperature sensor 180J is used to detect the temperature.

[0282] The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the terminal device 100, which is different from the position of the display screen 194.

[0283] The key 190 includes a power key, a volume key, etc. The key 190 may be a mechanical key or a touch key. The terminal device 100 may receive key input and generate key signal input related to user settings and function control of the terminal device 100.

[0284] Motor 191 can generate vibration prompts.

[0285] Indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, messages, missed calls, notifications, etc.

[0286] The SIM card interface 195 is used to connect a SIM card.

[0287] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access, or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a magnetic tape), an optical medium (e.g., a digital versatile disc (DVD)), or a semiconductor medium (e.g., a solid state disk (SSD)). It is worth noting that the computer-readable storage medium mentioned in the embodiment of the present application may be a non-volatile storage medium, in other words, a non-transient storage medium.

[0288] It should be understood that the "multiple" mentioned herein refers to two or more. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of the associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in order to facilitate the clear description of the technical solution of the embodiments of the present application, in the embodiments of the present application, the words "first", "second" and the like are used to distinguish between the same items or similar items with basically the same functions and effects. Those skilled in the art can understand that the words "first", "second" and the like do not limit the quantity and execution order, and the words "first", "second" and the like do not limit them to be necessarily different.

[0289] The above-mentioned embodiments are provided for the present application and are not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application shall be included in the protection scope of the present application.

Claims

1. A method for amblyopia training, characterized in that: Applied to amblyopia training equipment, the method comprises: Determine the user's dominant eye and amblyopic eye; Determining the amblyopia type of the amblyopic eye, wherein the amblyopia type includes strabismic amblyopia or anisometropic amblyopia; When the amblyopia type of the amblyopia eye is determined to be strabismic amblyopia, an amblyopia training image is displayed in the display area corresponding to the dominant eye, and the amblyopia training image is subjected to homography transformation and then displayed in the display area corresponding to the amblyopia eye, so that the images seen by the user's two eyes can be combined to perform amblyopia training; When the amblyopia type of the amblyopic eye is determined to be anisometropic amblyopia, the amblyopia training image is displayed in the display area corresponding to the dominant eye, and the amblyopia training image is displayed in the display area corresponding to the amblyopic eye after image size adjustment, so that the images seen by the user's two eyes can be combined to perform amblyopia training.

2. The method according to claim 1, characterized in that Determining the amblyopia type of the amblyopic eye includes: Displaying a first test image in the display area corresponding to the dominant eye, and displaying a second test image in the display area corresponding to the amblyopic eye; Determine the coordinates of the gaze position of the dominant eye in the displayed first test image and the coordinates of the gaze position of the amblyopic eye in the displayed second test image by eye tracking, and obtain first gaze position coordinates and second gaze position coordinates; The amblyopia type of the amblyopic eye is determined according to the first gaze position coordinates and the second gaze position coordinates.

3. The method according to claim 2, characterized in that The determining the amblyopia type of the amblyopic eye according to the first gaze position coordinates and the second gaze position coordinates includes: Determining binocular deviation information according to the first gaze position coordinates and the second gaze position coordinates, wherein the binocular deviation information refers to deviation information between the sight line direction of the amblyopic eye and the sight line direction of the dominant eye; If the binocular deviation information is greater than or equal to a first threshold, determining that the amblyopia type of the amblyopic eye is strabismic amblyopia; If the binocular deviation information is less than the first threshold, it is determined that the amblyopia type of the amblyopic eye is anisometropic amblyopia.

4. The method according to any one of claims 1 to 3, characterized in that: The determining the dominant eye and the amblyopic eye of the user includes: detecting the diopter of both eyes of the user; The eye with lower refractive power among the two eyes of the user is determined as the dominant eye, and the eye with higher refractive power among the two eyes of the user is determined as the amblyopic eye.

5. The method according to claim 1, characterized in that Before displaying the amblyopia training image in the display area corresponding to the dominant eye, the method further includes: The image contrast corresponding to the dominant eye and the image contrast corresponding to the amblyopic eye are determined so that the binocular perception ability of the user is the same.

6. The method according to claim 5, characterized in that The determining of the image contrast corresponding to the dominant eye and the image contrast corresponding to the amblyopic eye comprises: Displaying a third test image in the display area corresponding to the dominant eye, and displaying a fourth test image in the display area corresponding to the amblyopic eye; reducing the contrast of the displayed third test image and increasing the contrast of the displayed fourth test image; When a contrast determination instruction is detected, the contrast of the third test image after being reduced is determined as the image contrast corresponding to the dominant eye, and the contrast of the fourth test image after being increased is determined as the image contrast corresponding to the amblyopic eye. The contrast determination instruction is triggered when the user feedbacks that the contrast that his or her two eyes can perceive is the same based on the displayed third test image and the fourth test image.

7. The method according to claim 5, characterized in that The amblyopia training image includes a target object, and the target object is used for amblyopia training; The step of displaying the amblyopia training image in the display area corresponding to the dominant eye, and performing homography transformation on the amblyopia training image and then displaying it in the display area corresponding to the amblyopia eye comprises: Performing homography transformation on the amblyopia training image according to binocular deviation information, wherein the binocular deviation information refers to deviation information between the sight direction of the amblyopic eye and the sight direction of the dominant eye; Using the amblyopia training image before homography transformation as the first training image, using the amblyopia training image after homography transformation as the second training image, displaying the first training image in the display area corresponding to the dominant eye according to the image contrast corresponding to the dominant eye, and displaying the second training image in the display area corresponding to the amblyopia according to the image contrast corresponding to the amblyopia; Determine the gaze position of the dominant eye in the first training image and the gaze position of the amblyopic eye in the second training image by eye tracking to obtain a first gaze position and a second gaze position; If the first gaze position coincides with the actual position of the target object in the first training image, and the second gaze position coincides with the actual position of the target object in the second training image, the homography transformation amount of the amblyopia training image is reduced, and the step of using the amblyopia training image before the homography transformation as the first training image and the amblyopia training image after the homography transformation as the second training image is returned to, until the amblyopia training is completed, or the second gaze position coincides with the actual position of the target object in the second training image without performing the homography transformation on the amblyopia training image.

8. The method according to claim 5, characterized in that The amblyopia training image includes a target object, and the target object is used for amblyopia training; The step of displaying the amblyopia training image in the display area corresponding to the dominant eye, and performing image size adjustment processing on the amblyopia training image and then displaying it in the display area corresponding to the amblyopia eye comprises: Adjusting the position and / or size of the target object in the amblyopia training image multiple times to obtain multiple training images; Determining the image scaling ratio of the amblyopic eye relative to the dominant eye; Scaling the sizes of the plurality of training images according to the image scaling ratio; The multiple training images before scaling are used as multiple third training images, and the multiple training images after scaling are used as multiple fourth training images. According to the image contrast corresponding to the dominant eye, the multiple third training images are sequentially displayed in the display area corresponding to the dominant eye, and according to the image contrast corresponding to the amblyopic eye, the multiple fourth training images are sequentially displayed in the display area corresponding to the amblyopic eye, and the display order and switching frequency of the multiple third training images and the multiple fourth training images are the same.

9. The method according to claim 8, characterized in that Determining the image scaling ratio of the amblyopic eye relative to the dominant eye includes: Displaying a fifth test image in the display area corresponding to the dominant eye, and displaying a sixth test image in the display area corresponding to the amblyopic eye, wherein the fifth test image includes a first test target, and the sixth test image includes a second test target, and the first test target and the second test target have the same proportions; Scaling the displayed sixth test image; When a ratio determination instruction is detected, the ratio between the first test target and the scaled second test target is determined to obtain the image scaling ratio. The ratio determination instruction is triggered when the user feedbacks that his or her own eyes can see the first test target and the second test target of the same ratio based on the displayed fifth test image and the sixth test image.

10. The method according to any one of claims 7 to 9, characterized in that: The method further comprises: Determine the gaze position of the amblyopic eye in the image displayed in the display area corresponding to the amblyopic eye by eye tracking to obtain the gaze position of the amblyopic eye; If the gaze position of the amblyopic eye coincides with the actual position of the target object in the image displayed in the display area corresponding to the amblyopic eye, the display mode of the target object in the image displayed in the display area corresponding to the amblyopic eye is modified to a reference display mode to indicate the amblyopia training effect, and / or, based on the gaze position of the amblyopic eye and the actual position of the target object, an amblyopia training curve is drawn to indicate the amblyopia training effect.

11. A device for training amblyopia, characterized in that: Applied to amblyopia training equipment, the device comprises: A first determination module is used to determine the dominant eye and amblyopic eye of the user; A second determination module is used to determine the amblyopia type of the amblyopic eye, wherein the amblyopia type includes strabismic amblyopia or anisometropic amblyopia; A first amblyopia training module is used for displaying an amblyopia training image in the display area corresponding to the dominant eye when the amblyopia type of the amblyopia eye is determined to be strabismic amblyopia, and performing homography transformation on the amblyopia training image and then displaying it in the display area corresponding to the amblyopia eye, so that the images seen by the user's two eyes can be combined to perform amblyopia training; The second amblyopia training module is used to display the amblyopia training image in the display area corresponding to the dominant eye when the amblyopia type of the amblyopic eye is determined to be anisometropic amblyopia, and to display the amblyopia training image in the display area corresponding to the amblyopic eye after image size adjustment, so that the images seen by the user's two eyes can be combined to perform amblyopia training.

12. The device according to claim 11, characterized in that The second determining module comprises: A display submodule, configured to display a first test image in a display area corresponding to the dominant eye, and to display a second test image in a display area corresponding to the amblyopic eye; A first determination submodule is used to determine the coordinates of the gaze position of the dominant eye in the displayed first test image and the coordinates of the gaze position of the amblyopic eye in the displayed second test image by eye tracking to obtain first gaze position coordinates and second gaze position coordinates; The second determining submodule is used to determine the amblyopia type of the amblyopic eye according to the first gaze position coordinates and the second gaze position coordinates.

13. The device according to claim 12, characterized in that The second determining submodule is specifically used for: Determining binocular deviation information according to the first gaze position coordinates and the second gaze position coordinates, wherein the binocular deviation information refers to deviation information between the sight line direction of the amblyopic eye and the sight line direction of the dominant eye; If the binocular deviation information is greater than or equal to a first threshold, determining that the amblyopia type of the amblyopic eye is strabismic amblyopia; If the binocular deviation information is less than the first threshold, it is determined that the amblyopia type of the amblyopic eye is anisometropic amblyopia.

14. The device according to any one of claims 11 to 13, characterized in that: The first determining module is specifically used for: detecting the diopter of both eyes of the user; The eye with lower refractive power among the two eyes of the user is determined as the dominant eye, and the eye with higher refractive power among the two eyes of the user is determined as the amblyopic eye.

15. The device according to claim 11, characterized in that The device also includes: The third determination module is used to determine the image contrast corresponding to the dominant eye and the image contrast corresponding to the amblyopic eye so that the binocular perception ability of the user is the same.

16. The device according to claim 15, characterized in that The third determination module is specifically used for: Displaying a third test image in the display area corresponding to the dominant eye, and displaying a fourth test image in the display area corresponding to the amblyopic eye; reducing the contrast of the displayed third test image and increasing the contrast of the displayed fourth test image; When a contrast determination instruction is detected, the contrast of the third test image after being reduced is determined as the image contrast corresponding to the dominant eye, and the contrast of the fourth test image after being increased is determined as the image contrast corresponding to the amblyopic eye. The contrast determination instruction is triggered when the user feedbacks that the contrast that his or her two eyes can perceive is the same based on the displayed third test image and the fourth test image.

17. The device according to claim 15, characterized in that The amblyopia training image includes a target object, and the target object is used for amblyopia training; The first amblyopia training module is specifically used for: Performing homography transformation on the amblyopia training image according to binocular deviation information, wherein the binocular deviation information refers to deviation information between the sight direction of the amblyopic eye and the sight direction of the dominant eye; Using the amblyopia training image before homography transformation as the first training image, using the amblyopia training image after homography transformation as the second training image, displaying the first training image in the display area corresponding to the dominant eye according to the image contrast corresponding to the dominant eye, and displaying the second training image in the display area corresponding to the amblyopia according to the image contrast corresponding to the amblyopia; Determine the gaze position of the dominant eye in the first training image and the gaze position of the amblyopic eye in the second training image by eye tracking to obtain a first gaze position and a second gaze position; If the first gaze position coincides with the actual position of the target object in the first training image, and the second gaze position coincides with the actual position of the target object in the second training image, the homography transformation amount of the amblyopia training image is reduced, and the step of using the amblyopia training image before the homography transformation as the first training image and the amblyopia training image after the homography transformation as the second training image is returned to, until the amblyopia training is completed, or the second gaze position coincides with the actual position of the target object in the second training image without performing the homography transformation on the amblyopia training image.

18. The device according to claim 15, characterized in that The amblyopia training image includes a target object, and the target object is used for amblyopia training; The second amblyopia training module is specifically used for: Adjusting the position and / or size of the target object in the amblyopia training image multiple times to obtain multiple training images; Determining the image scaling ratio of the amblyopic eye relative to the dominant eye; Scaling the sizes of the plurality of training images according to the image scaling ratio; The multiple training images before scaling are used as multiple third training images, and the multiple training images after scaling are used as multiple fourth training images. According to the image contrast corresponding to the dominant eye, the multiple third training images are sequentially displayed in the display area corresponding to the dominant eye, and according to the image contrast corresponding to the amblyopic eye, the multiple fourth training images are sequentially displayed in the display area corresponding to the amblyopic eye, and the display order and switching frequency of the multiple third training images and the multiple fourth training images are the same.

19. The device according to claim 18, characterized in that The second amblyopia training module is also used for: Displaying a fifth test image in the display area corresponding to the dominant eye, and displaying a sixth test image in the display area corresponding to the amblyopic eye, wherein the fifth test image includes a first test target, and the sixth test image includes a second test target, and the first test target and the second test target have the same proportions; Scaling the displayed sixth test image; When a ratio determination instruction is detected, the ratio between the first test target and the scaled second test target is determined to obtain the image scaling ratio. The ratio determination instruction is triggered when the user feedbacks that his or her own eyes can see the first test target and the second test target of the same ratio based on the displayed fifth test image and the sixth test image.

20. The device according to any one of claims 17 to 19, characterized in that: The device also includes: A fourth determination module is used to determine the gaze position of the amblyopic eye in the image displayed in the display area corresponding to the amblyopic eye by eye tracking to obtain the gaze position of the amblyopic eye; A training effect indication module is used to modify the display mode of the target object in the image displayed in the display area corresponding to the amblyopic eye to a reference display mode if the gaze position of the amblyopic eye coincides with the actual position of the target object in the image displayed in the display area corresponding to the amblyopic eye to indicate the amblyopia training effect, and / or, according to the gaze position of the amblyopic eye and the actual position of the target object, draw an amblyopia training curve to indicate the amblyopia training effect.

21. A device for training amblyopia, characterized in that: The amblyopia training device comprises a memory and a processor, wherein the memory is used to store a computer program, and the processor is used to execute the computer program to implement the steps of any one of the methods of claims 1-10.

22. A computer-readable storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the method described in any one of claims 1 to 10 are implemented.

Images