Strabismus angle determination device and strabismus angle determination system based on ar glasses

Abstract

The application discloses a strabismus angle determination device and system based on AR glasses, and the strabismus angle determination device comprises a left eyeball capturing camera, a right eyeball capturing camera and a processor; the processor is electrically connected with the left eyeball capturing camera, the right eyeball capturing camera, a left eye display module and a right eye display module; the processor is used for sending a strabismus examination picture to the left eye display module and the right eye display module; the left eye display module and the right eye display module are used for displaying the same strabismus examination picture in front of the left eye and the right eye; the left eyeball capturing camera is used for acquiring a left eyeball image; the right eyeball capturing camera is used for acquiring a right eyeball image; the processor is further used for receiving the left eyeball image and the right eyeball image transmitted by the left eyeball capturing camera and the right eyeball capturing camera respectively, and calculating a direction angle of the left eyeball and the right eyeball according to the left eyeball image and the right eyeball image, so as to determine the strabismus angle, thereby improving the convenience and accuracy of the strabismus angle determination.

Description

TECHNICAL FIELD

[0001] The present application relates to the AR glasses image processing technical field, especially to a strabismus angle determination device and system based on AR glasses. BACKGROUND

[0002] Squint refers to the two eyes cannot simultaneously fixate on the target, which belongs to the eye muscle disease, the patient with strabismus because of eye position is not correct, when the patient pays attention to an object, the image of the object on the normal eye falls on the fovea of the retina, the strabismus eye falls on the position outside the fovea, so the object will appear the phenomenon of diplopia; One eye image is suppressed, losing the single vision function and stereoscopic sense of both eyes, and some people will lead to poor vision development and cause amblyopia. At present, the strabismus population is increasing, some people are caused by nature, and some people are caused by improper viewing habits.

[0003] At present, the existing visual function inspection device has the following defects: first, the operation method of the traditional strabismus inspection instrument is complex, professional personnel are needed to operate and evaluate the inspection results, and the patient usually cannot use the instrument to measure by himself; second, the instrument is large in size and inconvenient to carry. SUMMARY

[0004] The technical problem to be solved by the present application is to overcome the defects of the traditional strabismus inspection instrument in the prior art, such as complex operation method and inconvenient carrying, and to provide a strabismus angle determination device and system based on AR glasses.

[0005] The present application solves the above technical problems by the following technical scheme:

[0006] The present application provides a strabismus angle determination device based on AR glasses, the AR glasses comprising a left eye display module and a right eye display module, the strabismus angle determination device comprising a left eyeball capture camera, a right eyeball capture camera and a processor.

[0007] The processor is electrically connected with the left eyeball capture camera, the right eyeball capture camera, the left eye display module and the right eye display module respectively.

[0008] The processor is configured to send a strabismus inspection picture to the left eye display module and the right eye display module.

[0009] The left eye display module and the right eye display module are configured to display the same strabismus inspection picture in front of the left eye and the right eye.

[0010] The left eyeball capture camera is configured to acquire a left eyeball image, which is an eyeball image when the left eyeball views the strabismus inspection picture.

[0011] The right eyeball capturing camera is used for acquiring a right eyeball image; the right eyeball image is an eyeball image when a right eyeball watches a picture of the strabismus examination;

[0012] The processor is further used for receiving a left eyeball image and a right eyeball image transmitted by the left eyeball capturing camera and the right eyeball capturing camera respectively, and calculating a direction angle of the left eyeball and the right eyeball according to the left eyeball image and the right eyeball image to determine a strabismus angle.

[0013] Preferably, a distance between the picture of the strabismus examination and the eyeball is within a preset range.

[0014] Preferably, the picture of the strabismus examination is provided with a plurality of numbers and arranged in an equidistant array.

[0015] Preferably, a number in the array center of the picture of the strabismus examination is arranged opposite to a pupil of a normal eyeball.

[0016] Preferably, the picture of the strabismus examination comprises a target object; a position of the target object in the picture of the strabismus examination dynamically changes.

[0017] Preferably, the processor comprises a power supply unit.

[0018] The power supply unit is used for starting the left eyeball capturing camera, the right eyeball capturing camera, the left eye display module and the right eye display module to work.

[0019] Preferably, the strabismus angle determination device further comprises a display terminal.

[0020] The display terminal is in communication connection with the processor.

[0021] The processor is used for sending the strabismus angle to the display terminal.

[0022] The display terminal is used for receiving and displaying the strabismus angle.

[0023] The application further provides a strabismus angle determination system, which comprises an AR glasses and the AR glasses-based strabismus angle determination device as described above.

[0024] The positive progress effect of the application is that:

[0025] The present invention discloses a strabismus angle determination device and a strabismus angle determination system based on AR glasses. The strabismus angle determination device based on AR glasses is provided with: a left eyeball capture camera, a right eyeball capture camera, and a processor. The left / right eyeball images when the left / right eye views a strabismus inspection picture are obtained by the left / right eyeball capture camera and the right eyeball capture camera, and the left / right eyeball images are transmitted to the processor. The processor calculates the viewing direction angle of the eyeball to determine the strabismus angle, thereby improving the convenience and accuracy of strabismus angle determination. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] Figure 1 Schematic diagram of the modules of the device for determining the squint angle based on AR glasses according to embodiment 1 of the present invention.

[0027] Figure 2 Schematic diagram of the structure of the device for determining the squint angle of AR glasses according to Example 1 of the present invention.

[0028] Figure 3 This is a diagram showing the first position relationship between the virtual screen and the human eye according to Example 1 of the present invention.

[0029] Figure 4 This is a diagram showing the second position relationship between the virtual screen and the human eye according to embodiment 1 of the present invention.

[0030] Figure 5 This is a schematic diagram of the strabismus inspection screen according to Example 1 of the present invention.

[0031] Figure 6 2 is a diagram showing the positional relationship between the line of sight and the virtual screen in Example 1 of the present invention.

[0032] Figure 7 Schematic diagram of the modules of the system for determining the squint angle according to embodiment 2 of the present invention. DETAILED DESCRIPTION

[0033] The present invention is further described below by way of examples, but the present invention is not limited to the scope of the examples.

[0034] Example 1

[0035] like Figure 1 , Figure 2 As shown, this embodiment discloses a device for determining a squint angle based on AR glasses. The AR glasses 1 include a left-eye display module 11 and a right-eye display module 12. The device for determining a squint angle includes: a left-eye capture camera 21, a right-eye capture camera 22, and a processor 23.

[0036] The processor 23 is electrically connected to the left eye capture camera 21, the right eye capture camera 22, the left eye display module 11 and the right eye display module 12 respectively;

[0037] The processor 23 is used to send the strabismus examination picture to the left-eye display module 11 and the right-eye display module 12;

[0038] like Figure 3 As shown, the left-eye display module 11 and the right-eye display module 12 are used to display the same strabismus examination picture in front of the left eye and the right eye; specifically, the distance between the strabismus examination picture and the eyeball is within a preset range so that the strabismus examination picture can be displayed at the near eye through the near-eye optical system. For example, a 110-inch virtual screen can be displayed 3 meters in front of the human eye through the left-eye display module 11 and the right-eye display module 12, and the virtual screen is used to display the strabismus examination picture.

[0039] The left eyeball capture camera 21 is used to obtain a left eyeball image; the left eyeball image is an image of the left eyeball when viewing the strabismus examination picture;

[0040] The right eye capture camera 22 is used to capture an image of the right eyeball; the right eyeball image is an image of the right eyeball viewing the strabismus test image. Specifically, the left eye capture camera 21 and the right eye capture camera 22 are used to capture eyeball movement and changes in pupil size in real time. The left eye capture camera 21 and the right eye capture camera 22 can be located on the upper inner side of the AR glasses.

[0041] The processor 23 is further configured to receive the left eyeball image and the right eyeball image transmitted by the left eyeball capture camera 21 and the right eyeball capture camera 22, respectively, and calculate the viewing direction angles of the left eyeball and the right eyeball based on the left eyeball image and the right eyeball image to determine the strabismus angle. Specifically, the relative position of the pupil and the eyeball can be obtained based on the eyeball image. The relative position of the pupil and the eyeball can be represented by a coordinate system (X, Y). For example, when the pupil is at the exact center of the eyeball, the coordinates are (X0, Y0), and the viewing direction angle of the eyeball is 0°. Similarly, when the relative position of the pupil and the eyeball is (X5, Y0), the viewing direction angle of the eyeball is 5°.

[0042] In one practicable manner, the strabismus examination screen is provided with a plurality of numbers, which are arranged in an equidistant array.

[0043] In this solution, the strabismus inspection screen is provided with several numbers, which are arranged in an equidistant array, so that when determining the user's strabismus angle, the line of sight can be focused on the target object more accurately and conveniently, thereby making the determination of the user's strabismus angle faster and the result of the strabismus angle determination more accurate.

[0044] In an implementable manner, the number of the array center in the picture of the strabismus examination is arranged opposite to the pupil of the normal eyeball.

[0045] Specifically, it is assumed that the left eye of the user is a normal eye and the right eye is a strabismus eye. As shown in Figure 4 , Figure 5 the number 5 of the array center in the picture of the strabismus examination is arranged opposite to the pupil of the left eyeball of the user, at this time, the left eyeball capture camera 21 obtains the eyeball image of the user, and according to the eyeball image, it can be obtained that the visual line of the left eye of the user is 90° to the virtual screen where the picture of the strabismus examination is located. At the same time, when the right eye watches the number 5 of the array center in the picture of the strabismus examination, the right eyeball capture camera 22 obtains the eyeball image of the user, and according to the eyeball image, it can be obtained that the angle between the visual line of the right eye of the user and the virtual screen where the picture of the strabismus examination is located, that is, the strabismus angle of the right eye can be determined, thereby further improving the convenience and accuracy of the determination of the strabismus angle.

[0046] In an implementable manner, the picture of the strabismus examination includes a target object; the position of the target object in the picture of the strabismus examination dynamically changes.

[0047] As shown in Figure 6 , in this scheme, the strabismus eye is assisted to train and improve the strabismus condition through the dynamic change of the position of the target object in the picture of the strabismus examination. Specifically, a 110-inch virtual screen is formed at a distance of 3 meters from the eyeball of the user through the action of the left eye display module 11 and the right eye display module 12, and a green ball is arranged in the picture of the strabismus examination on the virtual screen and moves left and right on the screen. If the user is a single-eye strabismus user, the strabismus eye of the user cannot clearly see the green ball. Because when the object is in the same direction as the strabismus angle, the strabismus eye does not rotate and watches the most clearly, so as the green ball moves up, down, left and right, the relative amplitude of the change of the gaze direction of the strabismus eye of the user compared to the normal eye is smaller than that of the green ball. As shown in Figure 6 , the visual directions of the two eyes of the strabismus population are not parallel, and the intersection angle of the visual lines can be reduced through the above-mentioned assisted training method, thereby gradually improving the strabismus condition.

[0048] In an implementable manner, the processor 23 includes a power supply unit (not shown in the figure); the power supply unit is used to start the left eyeball capture camera 21, the right eyeball capture camera 22, the left eye display module 11 and the right eye display module 12 to work.

[0049] In this scheme, the power supply unit can be a lithium battery, and the power supply unit can be arranged in the right temple of the AR glasses, and a power supply jack can also be arranged on the right temple of the AR glasses to charge the power supply unit, thereby making the strabismus angle determination device more convenient, and further meeting the use requirements of multiple application scenarios.

[0050] In an implementable manner, the strabismus angle determination device further comprises a display terminal 24; the display terminal 24 is in communication connection with the processor 23; the processor 23 is configured to send the strabismus angle to the display terminal 24; and the display terminal 24 is configured to receive and display the strabismus angle.

[0051] Specifically, the display terminal 24 can be a mobile terminal, which is in communication connection with the processor 23, and the processor 23 sends the obtained strabismus angle to the mobile terminal, and the mobile terminal receives and displays the strabismus angle, so that the user can know the strabismus angle in time.

[0052] The embodiment discloses a strabismus angle determination device based on AR glasses, which is provided with a left eyeball capturing camera 21, a right eyeball capturing camera 22, and a processor 23. The left / right eyeball images when the left / right eyes watch the picture of the strabismus examination are acquired by the left / right eyeball capturing camera 22 and the right eyeball capturing camera 22, and are transmitted to the processor 23. The processor 23 calculates the direction angle of the eyeball watching to determine the strabismus angle, thereby improving the convenience and accuracy of the strabismus angle determination. In addition, the power supply unit, the display terminal 24, and the setting that the number of the array center in the picture of the strabismus examination is directly opposite to the pupil of the normal eyeball are further provided, so as to further improve the convenience of the strabismus angle determination. Meanwhile, a target object is provided in the picture of the strabismus examination, and the position of the target object in the picture of the strabismus examination dynamically changes, so as to assist the training of the strabismus eye and improve the strabismus condition, thereby further meeting the diverse needs of the user.

[0053] Embodiment 2

[0054] As shown in Figure 7 The embodiment discloses a strabismus angle determination system, which comprises AR glasses 1 and a strabismus angle determination device 2 based on the AR glasses 1 as in the embodiment 1.

[0055] The embodiment discloses a strabismus angle determination system based on AR glasses 1, the strabismus angle determination system comprises the AR glasses 1 and the strabismus angle determination device 2 based on the AR glasses 1 as in the embodiment 1, the strabismus angle determination device is through being equipped with: left eyeball capture camera 21, right eyeball capture camera 22, processor 23, through left / right eyeball capture camera 22 and right eyeball capture camera 22 obtains the left / right eyeball image when left / right eye watches the picture of strabismus examination, and the left / right eyeball image is transmitted to processor 23, and processor 23 calculates the direction angle of eyeball watching, to determine the strabismus angle, to improve the convenience and accuracy of strabismus angle determination.In addition, it is further improved the convenience of strabismus angle determination by being equipped with power supply unit, display terminal 24 and the number of array center in the picture of strabismus examination is directly opposite to the pupil of normal eyeball arrangement, further improve the convenience of strabismus angle determination.At the same time, by being equipped with a target object in the picture of strabismus examination, the position of the target object in the picture of strabismus examination dynamically changes, to assist training for strabismus eye and improve the strabismus condition, further meet the demand of user diversity.

[0056] Although the specific embodiments of the present application are described above, those skilled in the art should understand that this is only an example, the protection scope of the present application is defined by the appended claims. Those skilled in the art can make various changes or modifications to these embodiments without departing from the principles and essence of the present application, and these changes and modifications all fall within the protection scope of the present application.

Claims

1. A device for determining a squint angle based on AR glasses, wherein the AR glasses include a left-eye display module and a right-eye display module, characterized in that: The strabismus angle determination device includes: a left eyeball capture camera, a right eyeball capture camera, and a processor; The processor is electrically connected to the left eye capture camera, the right eye capture camera, the left eye display module and the right eye display module respectively; The processor is used to send the strabismus examination picture to the left-eye display module and the right-eye display module; The left-eye display module and the right-eye display module are used to display the same strabismus examination picture in front of the left eye and the right eye; The left eyeball capture camera is used to obtain an image of the left eyeball; the left eyeball image is an image of the left eyeball when viewing the strabismus examination picture; The right eyeball capture camera is used to obtain a right eyeball image; the right eyeball image is an image of the right eyeball when viewing the strabismus examination picture; The processor is further configured to receive a left eyeball image and a right eyeball image transmitted by the left eyeball capture camera and the right eyeball capture camera, respectively, and calculate viewing direction angles of the left eyeball and the right eyeball based on the left eyeball image and the right eyeball image to determine a strabismus angle; The left eyeball capture camera and the right eyeball capture camera are also used to capture the movement of the eyeballs and the changes in pupil size in real time; The processor is further configured to obtain the relative position of the pupil and the eyeball according to the eyeball image, and obtain the direction angle according to the relative position.

2. The device for determining a squint angle based on AR glasses according to claim 1, wherein: The distance between the strabismus examination screen and the eyeball is within a preset range.

3. The device for determining a squint angle based on AR glasses according to claim 1, wherein: The strabismus examination screen is provided with a plurality of numbers, which are arranged in an equidistant array.

4. The device for determining a squint angle based on AR glasses according to claim 3, wherein: The number in the center of the array in the strabismus examination screen is arranged to be aligned with the pupil of a normal eye.

5. The device for determining a squint angle based on AR glasses according to claim 1, wherein: The strabismus examination picture includes a target object; the position of the target object in the strabismus examination picture changes dynamically.

6. The device for determining a squint angle based on AR glasses according to claim 1, wherein: The processor includes a power supply unit; The power supply unit is used to start the left eye capture camera, the right eye capture camera, the left eye display module and the right eye display module.

7. The device for determining a squint angle based on AR glasses according to claim 1, wherein: The squint angle determination device further includes a display terminal; The display terminal is communicatively connected to the processor; The processor is used to send the squint angle to the display terminal; The display terminal is used to receive and display the squint angle, and display the squint angle.

8. A system for determining a squint angle, characterized in that: The squint angle determination system includes AR glasses and the squint angle determination device based on AR glasses according to any one of claims 1 to 7.

Images