A method and system for quantitatively checking strabismus

Abstract

The present application provides a method and system for quantitatively checking strabismus, and relates to the technical field of strabismus checking. The method includes: in response to the first cover switching event in the current round of strabismus checking, controlling the display device to switch from displaying the first element to displaying the second element; using the detection model to detect the current face image to determine the current second pupil center position and the current second eye movement state; determining the current second offset according to the current second pupil center position and the second pupil center position of the previous round; comparing the current second offset with the second offset of the previous round to determine the next round of display position according to the comparison result and the current second eye movement state; and performing the next round of strabismus checking using the first element and the second element whose next round of display position has been determined. By adopting the above-mentioned method and system for quantitatively checking strabismus, the problem that ordinary individual users cannot complete strabismus checking alone and the low adaptability of strabismus checking is solved.

Description

Technical Field

[0001] The present application relates to the technical field of strabismus detection, and in particular to a method and system for quantitatively detecting strabismus. Background Art

[0002] Strabismus refers to the inability of both eyes to focus on the target at the same time, which manifests as a deviation of the eye position and is a disease of the extraocular muscles. Strabismus is a common eye disease. Existing methods for examining strabismus include: corneal light reflection method, prism method, and corneal reflection point method. Among them, the prism cover method is a relatively accurate quantitative examination method for strabismus. During the examination, the prism needs to be placed in front of the strabismic eye, with the tip of the prism pointing in the direction of the strabismus. The degree of the prism is gradually increased until the strabismus angle is neutralized and the eyeball no longer moves. At this time, the required prism degree is the strabismus degree of the distance and gaze direction being examined.

[0003] However, although the prism cover method has high detection accuracy, the entire strabismus inspection process requires professional training for staff, the inspection process is relatively complicated, and can only be completed in professional scenarios, resulting in ordinary individual users being unable to complete the strabismus inspection on their own, and the strabismus inspection has low adaptability. Summary of the invention

[0004] In view of this, the purpose of the present application is to provide a method and system for quantitatively checking strabismus, so as to solve the problem that ordinary individual users cannot complete strabismus checking by themselves and the adaptability of strabismus checking is low.

[0005] In a first aspect, an embodiment of the present application provides a strabismus quantitative inspection method, which is applied to a strabismus quantitative inspection system. The strabismus quantitative inspection system includes a display device and an image acquisition device. The image acquisition device is used to acquire a face image of a user under test in real time. The display device is used to provide a first element with a fixed display position and a second element with a moving display position. The method includes:

[0006] In response to a first covering switching event in which covering the second eye under examination is switched to covering the first eye under examination in this round of strabismus examination, controlling the display device to switch from displaying the first element to displaying the second element at the display position of this round;

[0007] The detection model is used to detect the current face image to determine the current second pupil center position and the current second eye movement state when the second element is observed through the second tested eye in this round of strabismus inspection;

[0008] Determine a current second offset according to the current second pupil center position and the previous second pupil center position in the previous strabismus examination;

[0009] Compare the current second offset with the previous second offset to determine the next display position of the second element according to the comparison result and the current second eye movement state, the previous second offset being the offset between the previous second pupil center position and the previous second pupil center position;

[0010] The next round of strabismus inspection is performed using the first element and the second element whose display position has been determined for the next round, so that when the strabismus inspection meets the inspection stop requirement, the current strabismus degree of the user being tested is determined according to the corresponding relationship between the offset and the strabismus degree.

[0011] Optionally, the next display position of the second element is determined according to the comparison result and the current second eye movement state in the following manner: if the current second offset is greater than the previous second offset, the current display position is used as the starting position, and the position after moving the first set distance from the starting position in the opposite direction of the direction indicated by the current second eye movement state is selected as the next display position; if the current second offset is less than or equal to the previous second offset, the current display position is used as the starting position, and the position after moving the second set distance from the starting position in the direction indicated by the current second eye movement state is selected as the next display position.

[0012] Optionally, the next round of strabismus examination is performed using the first element and the second element whose display position for the next round has been determined, including: in response to the second cover switching event, starting a first strabismus examination for the first eye to be tested in the next round of strabismus examination, the second cover switching event being an event of switching from covering the first eye to be tested in the current round of strabismus examination to covering the second eye to be tested; in response to the first cover switching event in the next round of strabismus examination, starting a second strabismus examination for the second eye to be tested in the next round of strabismus examination.

[0013] Optionally, after determining the current second offset, it also includes: comparing the current first offset and the current second offset with the offset threshold respectively, the current first offset is determined based on the current first pupil center position in this round of strabismus inspection and the first pupil center position in the previous round; if both offsets are less than or equal to the offset threshold, it is determined that the current round of strabismus inspection meets the inspection stop requirement, and the current strabismus degree of the user being tested is determined based on the current second offset in this round of strabismus inspection and the correspondence between the offset and the strabismus degree; if at least one offset is greater than the offset threshold, it is determined that the current round of strabismus inspection does not meet the inspection stop requirement, and the latest display position of the second element is determined based on the comparison result of the current second offset and the second offset in the previous round, so as to perform the next round of strabismus inspection.

[0014] Optionally, the current second offset includes a current second horizontal offset and a current second vertical offset, and the previous round second offset includes a previous round second horizontal offset and a previous round second vertical offset, and controlling the display device to switch from displaying the first element to displaying the second element at the current round display position includes: controlling the display device to display the second element in the horizontal direction and the vertical direction respectively, so as to determine the current second horizontal offset and the current second vertical offset according to the current second pupil center position and the previous round second pupil center position respectively; comparing the current second offset with the previous round second offset, including: comparing the current second horizontal offset with the previous round second horizontal offset; comparing the current second vertical offset with the previous round second vertical offset.

[0015] Optionally, a first strabismus examination is performed on the first eye under test in the following manner: a next round of strabismus examination is taken as the latest strabismus examination in this round, and the display device is controlled to switch from displaying the second element of the previous round to displaying the first element of this round; the current face image is detected using a detection model to determine the current first pupil center position and the current first eye movement state when the first eye under test observes the first element in this round of strabismus examination; the current first offset is determined based on the current first pupil center position and the previous round of first pupil center position in the previous round of strabismus examination to end the first strabismus examination in this round.

[0016] Optionally, the current face image is detected using a detection model, including: detecting the current face image using a face detection model to obtain a current face detection result; analyzing the current face detection result using a pupil detection model to obtain the current second pupil center position and the current second eye movement state under this round of strabismus examination.

[0017] Optionally, the method also includes: using a distance detection model and an angle detection model to determine whether the distance and facing direction of the user being tested meet preset inspection conditions; if the preset inspection conditions are met, starting this round of strabismus inspection to use the detection model to detect the current face image and determine the pupil center position and eye movement status.

[0018] Optionally, the current second offset is determined based on the current second pupil center position and the previous round of second pupil center position in the previous round of strabismus examination, including: taking the difference between the current second pupil center position and the previous round of second pupil center position as the current second offset.

[0019] In a second aspect, an embodiment of the present application further provides a strabismus quantitative inspection system, the system comprising a display device, an image acquisition device, and a processor;

[0020] A display device, used for providing a first element with a fixed display position and a second element with a movable display position, and switching display between the first element and the second element in response to a cover switching event;

[0021] The image acquisition device is used to acquire the face image of the user under test in real time, and transmit the acquired face image to the processor for processing;

[0022] The processor is used to execute the above strabismus quantitative inspection method.

[0023] The embodiments of the present application bring the following beneficial effects:

[0024] The embodiments of the present application provide a method and system for quantitatively checking strabismus, which can automatically switch the display of the first element and the second element required for each round of strabismus checking through a display device, and automatically use a detection model to determine the pupil center position and the eye movement state, so as to adjust the display position of the second element of the next round of strabismus checking according to the pupil center position of this round, until the strabismus checking meets the checking stop requirement, the current strabismus degree of the user being checked can be automatically calculated. By using the strabismus quantitative checking system, an ordinary individual user can independently complete the strabismus checking without the guidance and operation of a professional, thereby improving the efficiency of the strabismus checking. Compared with the strabismus quantitative checking method in the prior art, the problem that an ordinary individual user cannot complete the strabismus checking independently and the adaptability of the strabismus checking is low is solved.

[0025] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0027] Figure 1 A flow chart of a method for quantitatively inspecting strabismus provided in an embodiment of the present application is shown;

[0028] Figure 2 A flowchart of the first strabismus inspection method for the next round provided by an embodiment of the present application is shown;

[0029] Figure 3 A schematic diagram of the structure of a strabismus quantitative inspection system provided in an embodiment of the present application is shown. DETAILED DESCRIPTION

[0030] To make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the technical scheme in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all of the embodiments. The components of the embodiments of the present application usually described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the application claimed for protection, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, each other embodiment obtained by those skilled in the art without making creative work belongs to the scope of protection of the present application.

[0031] It is worth noting that before the present application was filed, strabismus refers to the inability of both eyes to look at the target at the same time, which manifests as a deviation of the eye position and is an extraocular muscle disease. Strabismus is a common eye disease, and existing strabismus examination methods include: corneal reflection method, prism method, and corneal reflection point method. Among them, the prism cover method is a relatively accurate quantitative inspection method for strabismus. During the inspection, the prism needs to be placed in front of the strabismus eye, with the tip of the prism pointing in the direction of the strabismus, and the degree of the prism is gradually increased until the strabismus angle is neutralized and the eyeball no longer moves. At this time, the required prism degree is the strabismus degree of the distance and gaze direction being inspected. However, although the prism cover method has a high detection accuracy, the entire strabismus inspection process requires professional training for staff, the inspection process is relatively complicated, and can only be completed in professional scenarios, resulting in ordinary individual users being unable to complete strabismus inspections alone, and the scope of applicable scenarios for strabismus inspections is low.

[0032] Based on this, an embodiment of the present application provides a method for quantitatively inspecting strabismus to improve the adaptability and efficiency of strabismus inspection.

[0033] See also Figure 1 , Figure 1 This is a flow chart of a method for quantitatively checking strabismus provided in an embodiment of the present application. Figure 1 As shown, the strabismus quantitative inspection method provided in the embodiment of the present application is applied to a processor of a strabismus quantitative inspection system, the strabismus quantitative inspection system also includes a display device and an image acquisition device, the image acquisition device is used to acquire a face image of a user under test in real time, the display device is used to provide a first element with a fixed display position and a second element with a moving display position, the method includes:

[0034] Step S101, in response to a first covering switching event of switching from covering the second eye to covering the first eye in this round of strabismus examination, controlling the display device to switch from displaying the first element to displaying the second element at the current display position.

[0035] In this step, the first measured eye may refer to the left eye or the right eye of the measured user. If the first measured eye is the left eye, the second measured eye is the right eye of the measured user; if the first measured eye is the right eye, the second measured eye is the left eye of the measured user.

[0036] The display device may refer to a device for displaying the first element and the second element. The display device is connected to the processor so that the processor controls the display device to switch the element display.

[0037] The first element may refer to an image element whose display position remains fixed. For example, the first element may be a graphic, such as a dot, or may be text or a symbol.

[0038] The second element may refer to an image element whose display position is variable. For example, the second element may be a graphic, such as a dot, or may be text or a symbol.

[0039] The first element and the second element are elements of the same shape and size, but the display state of the first element and the display state of the second element may be different. Here, the display state may refer to the color of the element.

[0040] The first cover switching event is an event of switching from covering the second eye to covering the first eye, for example, from covering the right eye to covering the left eye. Correspondingly, the second cover event is an event of switching from covering the first eye to covering the second eye, for example, from covering the left eye to covering the right eye.

[0041] In an embodiment of the present application, the user under test is an ordinary individual user, and the strabismus quantitative inspection system can be deployed on a personal terminal device, for example: the strabismus quantitative inspection system is deployed on a laptop computer or a smart phone. Taking the deployment of the strabismus quantitative inspection system on a smart phone as an example, the mobile phone screen is the display device, and the mobile phone camera is the image acquisition device, so that the user under test can complete the strabismus inspection alone through the smart phone. Usually, the user under test has only one strabismus eye and the other eye is a normal eye. For this reason, the normal eye of the user under test is called the first eye under test, and the strabismus eye of the user under test is called the second eye under test, or the eye of the user under test with a relatively low degree of strabismus is called the first eye under test, and the eye of the user under test with a relatively high degree of strabismus is called the second eye under test.

[0042] Before performing a strabismus quantitative test, a strabismus qualitative test can be used to determine which eye of the user being tested is the first eye being tested and which eye is the second eye being tested. The strabismus qualitative test can also be completed by a strabismus quantitative test system. In this case, it is only necessary to obtain a facial image of the user being tested when observing the dots on the mobile phone screen, and then determine the first eye being tested and the second eye being tested through an image detection model, which will not be described in detail here. Alternatively, the user being tested can manually select which eye is the first eye being tested and which eye is the second eye being tested.

[0043] When performing a strabismus quantitative inspection, multiple rounds of strabismus quantitative inspection processes are required, and each round of strabismus quantitative inspection processes includes a first strabismus inspection process and a second strabismus inspection process, wherein the first strabismus inspection process is a strabismus inspection process when observing a first element through a first tested eye, and the second strabismus inspection process is a strabismus inspection process when observing a second element through a second tested eye.

[0044] At the same time, in each round of the second strabismus inspection process, it is necessary to control the display device to first display the second element in the horizontal direction and then display the second element in the vertical direction, or to control the display device to first display the second element in the vertical direction and then display the second element in the horizontal direction, so as to calculate the strabismus degree in different strabismus directions. And whether it is the horizontal direction or the vertical direction, it is necessary to determine the corresponding current second offset, so as to determine whether the current round of strabismus inspection meets the inspection stop requirements according to the current horizontal second offset and the current second vertical offset, and determine the next round of display position of the second element.

[0045] It should be noted that before the first strabismus inspection process is carried out, the distance detection model and the angle detection model can be used in real time to determine whether the distance and the facing direction of the user being tested meet the preset inspection conditions; if the preset inspection conditions are met, the current round of strabismus inspection is started to detect the current face image using the detection model to determine the pupil center position and the eye movement state. Among them, the distance detection model can use a binocular matching algorithm, a monocular camera ranging method, or an infrared ranging method, and the angle detection model can be provided by the face detection model. The preset inspection conditions include distance conditions and observation angle conditions. For example: the strabismus quantitative inspection system determines whether the distance between the user being tested and the display device meets the distance condition and whether the angle at which the user being tested observes the display device meets the observation angle condition. If the distance condition is not met or the observation angle condition is not met, a prompt message is sent to the user being tested to adjust the position or observation angle of the user being tested until the preset inspection conditions are met. If the distance condition is met and the observation angle condition is met, the first strabismus inspection process is started. Exemplarily, the distance condition may be that the measured user is 33 cm away from the display device, and the observation angle condition is that the measured user is looking directly at the display device, that is, the angle between the facing direction and the plane of the display device is in the range of [89°, 91°]. Technical personnel in this field may select specific values ​​of the distance condition and the observation angle condition based on actual conditions, and this application is not limited thereto.

[0046] In addition, during all rounds of strabismus inspection, the strabismus quantitative inspection system will determine whether the user being tested meets the preset inspection conditions. As long as the user being tested does not meet the preset inspection conditions, the user will be immediately reminded to adjust the position and / or observation angle. Only when the user being tested meets the preset inspection conditions will the subsequent strabismus inspection process continue.

[0047] A round of strabismus inspection process is selected as an example for detailed introduction below, and the selected round of strabismus inspection process is referred to as the current round of strabismus inspection process.

[0048] At the end of the second strabismus inspection of the previous round of strabismus inspection process, the target detection model is used to determine whether the second eye under test of the user under test is covered and whether the first eye under test is not covered. If the second eye under test is covered and the first eye under test is not covered, the second cover switching event is triggered. Among them, the target detection model is deployed in the processor, and the target detection model can use the Faster R-CNN model or the YOLO model. Then, in response to the second cover switching event, the first strabismus inspection process for the first eye under the current round of strabismus inspection is started. Since the second element is displayed in the display device at the end of the previous round of strabismus inspection, since a new round of strabismus inspection has been started, the display device changes from displaying the second element under a solid color background to displaying the first element under a solid color background, wherein the position of the first element is fixed and unchanged, and is always facing the user under test. The use of a solid color background is to facilitate the user under test to observe the elements displayed on the display device.

[0049] When the user under test observes the first element, the current face image of the user under test is continuously acquired through the image acquisition device, so as to detect the current face image using the detection model, so as to determine the current first pupil center position and the current first eye movement state when the first eye under test observes the first element in this round of strabismus inspection. According to the current first pupil center position and the previous round of first pupil center position in the previous round of strabismus inspection, the current first offset is determined. It can be seen that the current first offset is determined based on the current first pupil center position in this round of strabismus inspection and the previous round of first pupil center position. Then, the first cover switching event is triggered, and in response to the first cover switching event, the display device is controlled to switch from displaying the first element to displaying the second element at the current round display position, and step S102 is continued.

[0050] Among them, the cover switching event can be that after the covering device of the strabismus quantitative inspection system automatically covers the eye under test, the image acquisition device sends the facial image of the covered eye to the target detection model, and then the target detection model is triggered according to the detection result; it can also be that after the user under test manually covers the eye under test, the image acquisition device sends the facial image of the covered eye to the target detection model, and then the target detection model is triggered according to the detection result.

[0051] Step S102, using the detection model to detect the current face image, so as to determine the current second pupil center position and the current second eye movement state when observing the second element through the second tested eye in this round of strabismus inspection.

[0052] In this step, the second pupil center position may refer to the pupil center position coordinates of the second measured eye, which is used to characterize the distance that the pupil center position of the second measured eye is offset from the eyeball center position of the second measured eye. Exemplarily, if the eyeball center position coordinates of the second measured eye are (0,0), then when the second pupil center position is (2mm.0), it means that the second pupil center position is offset 2mm to the right relative to the eyeball center position of the second measured eye.

[0053] The second eye movement state may refer to the movement state of the eyeball of the second measured eye relative to the center point of the second measured eye. The second eye movement state includes but is not limited to: movement to the left, movement to the right, movement upward, and movement downward.

[0054] In the embodiment of the present application, the face detection model is used to detect the current face image to obtain the current face detection result; the pupil detection model is used to analyze the current face detection result to obtain the current second pupil center position and the current second eye movement state under the current strabismus examination. Here, since the first eye under test is covered, the face detection result is input into the pupil detection model to obtain the current second pupil center position and the current second eye movement state corresponding to the second eye under test.

[0055] The face detection model may be a FaceNet detection model or a SVM detection model. The pupil detection model may be a Hough detection model. The current face detection result includes but is not limited to: coordinates of multiple key points of the face and coordinates of the face frame.

[0056] Step S103, determining the current second offset according to the current second pupil center position and the previous round of second pupil center position in the previous round of strabismus examination.

[0057] In this step, the second pupil center position in the previous round may refer to the pupil center position coordinates of the second measured eye in the previous round of strabismus examination.

[0058] Here, the difference between the current second pupil center position and the second pupil center position of the previous round can be calculated, and the difference between the current second pupil center position and the second pupil center position of the previous round can be used as the current second offset. For example: the current second pupil center position of this round is , the center position of the second pupil in the previous round is , then the current second offset is .

[0059] In the embodiment of the present application, the current second offset includes the current second horizontal offset and the current second vertical offset. The processor controls the display device to display the second element in the horizontal direction and the vertical direction respectively, and determines the current second horizontal offset and the current second vertical offset respectively according to the current second pupil center position and the second pupil center position of the previous round. Taking the second element moving in the horizontal direction as an example, for the sake of distinction, the current second pupil center position of this round is recorded as: , the second pupil center position in the previous round is recorded as: , then the current second horizontal offset is Taking the second element moving in the vertical direction as an example, the current second pupil center position of this round is recorded as: , the second pupil center position in the previous round is recorded as: , then the current second horizontal offset is .

[0060] After determining the current second offset, the current first offset and the current second offset can be compared with the offset threshold respectively; if both offsets are less than or equal to the offset threshold, it means that the pupil center positions of the two eyes have hardly changed between the two rounds of strabismus inspection, and the entire strabismus detection process has converged, then it is determined that the current round of strabismus inspection meets the inspection stop requirement, and then the current strabismus degree of the user being tested is determined according to the current second offset under the current round of strabismus inspection and the corresponding relationship between the offset and the strabismus degree. For example: for every 3 microns of offset, the strabismus degree increases by 2°, then when the current second offset is 30 microns, the strabismus degree of the second eye being tested is determined to be 20°.

[0061] It should be noted that the offset threshold includes a first offset threshold and a second offset threshold. Only when the current second horizontal offset, the current second vertical offset, and the current first offset are all less than or equal to the offset threshold can it be determined that the current round of strabismus inspection meets the inspection stop requirement. Here, since the position of the first element observed by the first tested eye is fixed, the current first offset must be less than or equal to the first offset threshold under normal circumstances. Therefore, it is only necessary to ensure that the current second horizontal offset and the current second vertical offset are both less than or equal to the second offset threshold. Among them, the first offset threshold and the second offset threshold may be equal or unequal.

[0062] During the second squint inspection process of this round, the display position of the second element is first moved horizontally along the X-axis. If the current second horizontal offset and the current first offset are both less than or equal to the offset threshold, the display position of the second element needs to be controlled to move vertically along the Y-axis. If the current second vertical offset and the current first offset are both less than or equal to the offset threshold, it is determined that this round of squint inspection meets the inspection stop requirement. Of course, the display position of the second element can also be moved vertically along the Y-axis first, and then moved horizontally along the X-axis. However, no matter which movement method is used, it is necessary to ensure that the current second horizontal offset and the current second vertical offset are both less than or equal to the offset threshold to determine that this round of squint inspection meets the inspection stop requirement.

[0063] In addition, the correspondence between the offset and the degree of strabismus is determined in advance, and the correspondence is related to the distance between the user being tested and the display device. Before conducting a quantitative strabismus test, the distance between the user being tested and the display device has been set, for example: 33cm, and then the correspondence between the offset and the degree of strabismus at a distance of 33cm is determined.

[0064] If at least one offset is greater than the offset threshold, it means that the pupil center position of at least one eye still changes significantly between the two rounds of strabismus inspection, and the entire strabismus detection process does not converge. It is determined that the current round of strabismus inspection does not meet the inspection stop requirements, and it is necessary to continue the subsequent round of strabismus inspection. Therefore, step S104 is executed to determine the latest display position of the second element according to the comparison result of the current second offset and the previous round of second offset, so as to perform the next round of strabismus inspection. Among them, the offset threshold is a set value.

[0065] Step S104, comparing the current second offset with the previous second offset, to determine the next display position of the second element according to the comparison result and the current second eye movement state.

[0066] In this step, the second offset of the previous round is the offset between the second pupil center position of the previous round and the second pupil center position of the previous round. The second offset of the previous round is the difference between the second pupil center position of the previous round and the second pupil center position of the previous round.

[0067] In the embodiment of the present application, if the current second offset is greater than the second offset of the previous round, it means that compared with the previous round, the distance between the pupil centers of the front and rear rounds in this round of strabismus examination has become farther, and the second element needs to be moved in the opposite direction. Therefore, the display position of this round is used as the starting position, and the position after moving the first set distance from the starting position in the opposite direction of the current second eye movement state indication direction is selected as the display position of the next round. Among them, the second offset of the previous round includes the second horizontal offset of the previous round and the second vertical offset of the previous round.

[0068] Taking the second element moving horizontally along the X-axis as an example, the current second horizontal offset is compared with the second horizontal offset of the previous round. If the current second horizontal offset is greater than the second horizontal offset of the previous round, the horizontal display position of this round is taken as the starting position, and the position after moving the first set distance from the starting position in the opposite direction of the horizontal indication direction of the current second eye movement state is selected as the horizontal display position of the next round. Similarly, taking the second element moving vertically along the Y-axis as an example, the current second vertical offset is compared with the second vertical offset of the previous round. If the current second vertical offset is greater than the second vertical offset of the previous round, the vertical display position of this round is taken as the starting position, and the position after moving the first set distance from the starting position in the opposite direction of the vertical indication direction of the current second eye movement state is selected as the vertical display position of the next round.

[0069] If the current second offset is less than or equal to the second offset of the previous round, it means that the distance between the pupil centers of the front and rear rounds has become closer in this round of strabismus examination than in the previous round, and the second element needs to be moved forward. Therefore, the display position of this round is used as the starting position, and the position after moving the second set distance from the starting position in the direction indicated by the current second eye movement state is selected as the display position of the next round.

[0070] Taking the second element moving horizontally along the X-axis as an example, the current second horizontal offset is compared with the second horizontal offset of the previous round. If the current second horizontal offset is less than or equal to the second horizontal offset of the previous round, the horizontal display position of this round is taken as the starting position, and the position after moving the second set distance from the starting position to the horizontal indication direction of the current second eye movement state is selected as the horizontal display position of the next round. Similarly, taking the second element moving vertically along the Y-axis as an example, the current second vertical offset is compared with the second vertical offset of the previous round. If the current second vertical offset is less than or equal to the second vertical offset of the previous round, the vertical display position of this round is taken as the starting position, and the position after moving the second set distance from the starting position to the vertical indication direction of the current second eye movement state is selected as the vertical display position of the next round.

[0071] Step S105, performing the next round of strabismus inspection using the first element and the second element whose display position has been determined for the next round, so as to determine the current strabismus degree of the user under test according to the corresponding relationship between the offset and the strabismus degree when the strabismus inspection meets the inspection stop requirement.

[0072] In this step, the correspondence between the offset and the strabismus degree is used to characterize the strabismus degree corresponding to the offset, and the correspondence may be in an enumeration form or in a curve form.

[0073] Exemplarily, the corresponding relationship in enumerated form is: when the offset is 3, the corresponding strabismus degree is 2, and when the offset is 5, the corresponding strabismus degree is 4; the corresponding relationship in curve form is: for every increase of 2 in the offset, the strabismus degree increases by 3.

[0074] In an embodiment of the present application, when the next round of strabismus inspection is performed, the target detection model detects the current face image to determine whether the first eye under test is not covered and the second eye under test is covered. If the first eye under test is not covered and the second eye under test is covered, a second cover switching event is triggered. In response to the second cover switching event, the first strabismus inspection for the first eye under test in the next round of strabismus inspection is started. After the first strabismus inspection in the next round of strabismus inspection is completed, in response to the first cover switching event in the next round of strabismus inspection, the second strabismus inspection for the second eye under test in the next round of strabismus inspection is started. Among them, the second cover switching event is an event of switching from covering the first eye under test to covering the second eye under test in the current round of strabismus inspection. For example, if this round is the third round, the second cover switching event is an event of switching from covering the first eye under test in the third round of strabismus inspection to covering the second eye under test in the fourth round of strabismus inspection.

[0075] Refer to the following Figure 2 Let's introduce the specific process of the first strabismus examination.

[0076] Figure 2 FIG. 4 shows a flowchart of the first strabismus inspection method for the next round provided by the embodiment of the present application, such as Figure 2 As shown, the first strabismus inspection method of the next round includes:

[0077] Step S1051: taking the next round of strabismus inspection as the latest strabismus inspection of this round, and controlling the display device to switch from displaying the second element of the previous round to displaying the first element of this round.

[0078] Taking the above example, the fourth round of strabismus examination is the latest round of strabismus examination, and the third round of strabismus examination is the previous round of strabismus examination. At this time, since a new round of strabismus examination has started, the processor controls the display device to display the first element used in the fourth round of strabismus examination according to the set position.

[0079] Step S1052, using the detection model to detect the current face image to determine the current first pupil center position and the current first eye movement state when observing the first element through the first tested eye in this round of strabismus inspection.

[0080] Here, the face detection model is also used to detect the current face image during the fourth round of strabismus inspection to obtain the current face detection result during the fourth round of strabismus inspection. The current face detection result is input into the pupil detection model to obtain the current first pupil center position and the current first eye movement state during the fourth round of strabismus inspection.

[0081] Step S1053, determining the current first offset according to the current first pupil center position and the previous round of first pupil center position in the previous round of strabismus examination, so as to end the first strabismus examination of this round.

[0082] Here, the current first pupil center position may refer to the pupil center position coordinates of the first eye under the current strabismus examination, and is used to characterize the distance by which the pupil center position of the first eye under test is offset from the eyeball center position of the first eye under test. For example, if the eyeball center position coordinates of the first eye under test are (0,0), then when the first pupil center position is (1mm.0), it means that the first pupil center position is offset 1mm to the right relative to the eyeball center position of the first eye under test.

[0083] The first pupil center position in the previous round may refer to the coordinates of the pupil center position of the first measured eye in the previous round of strabismus examination.

[0084] After obtaining the current first pupil center position and the previous round first pupil center position, the difference between the current first pupil center position and the previous round first pupil center position can be used as the current first offset to end the first strabismus inspection of this round.

[0085] The second strabismus inspection process under the fourth round of strabismus inspection is the same as the second strabismus inspection process under the third round of strabismus inspection, and will not be repeated here.

[0086] When a round of strabismus inspection meets the inspection stop requirement, for example, the ninth round of strabismus inspection meets the inspection stop requirement, the target strabismus degree corresponding to the current second offset can be determined based on the correspondence between the offset and the strabismus degree. Then, the target strabismus degree is used as the current strabismus degree of the user being tested.

[0087] For example: when the offset is 7, the target strabismus degree is determined to be 20° according to the corresponding relationship; when the offset is 5, the target strabismus degree is determined to be 15° according to the corresponding relationship. Since the current second offset includes the current second horizontal offset and the current second vertical offset, in the above example, the current second horizontal offset in the ninth round of strabismus inspection is 7, and the current horizontal strabismus degree of the user being tested can be determined to be 20°; the current second vertical offset in the ninth round of strabismus inspection is 5, and the current vertical strabismus degree of the user being tested can be determined to be 15°. In addition, the strabismus type can also be determined according to the current second horizontal offset and the current second vertical offset. For example: when the current second horizontal offset and the current second vertical offset are both positive numbers, the strabismus type is upper right strabismus, and the upper right strabismus degree is determined according to the angle between the current second offset and the horizontal direction.

[0088] Compared with the strabismus quantitative inspection method in the prior art, the present application can automatically switch the display of the first element and the second element required for each round of strabismus inspection through the display device, and automatically use the detection model to determine the pupil center position and the eye movement state, so as to adjust the display position of the second element of the next round of strabismus inspection according to the pupil center position of this round, until the strabismus inspection meets the inspection stop requirements, the current strabismus degree of the user being tested can be automatically calculated. Using the strabismus quantitative inspection system, ordinary individual users can independently complete the strabismus inspection without the guidance and operation of professionals, thereby improving the efficiency of the strabismus inspection. Compared with the strabismus quantitative inspection method in the prior art, the present application solves the problem that ordinary individual users cannot complete the strabismus inspection alone and the adaptability of the strabismus inspection is low.

[0089] Based on the same inventive concept, a strabismus quantitative inspection system corresponding to the strabismus quantitative inspection method is also provided in the embodiment of the present application. Since the principle of solving the problem by the system in the embodiment of the present application is similar to the above-mentioned strabismus quantitative inspection method in the embodiment of the present application, the implementation of the system can refer to the implementation of the method, and the repeated parts will not be repeated.

[0090] See also Figure 3 , Figure 3 This is a schematic diagram of the structure of a strabismus quantitative inspection system provided in an embodiment of the present application. Figure 3 As shown in , the strabismus quantitative inspection system 200 includes a display device 210, an image acquisition device 220, and a processor 230;

[0091] The display device 210 is used to provide a first element with a fixed display position and a second element with a movable display position, and to switch the display between the first element and the second element in response to a cover switching event;

[0092] The image acquisition device 220 is used to acquire the face image of the user under test in real time and transmit the acquired face image to the processor for processing;

[0093] The processor 230 is used to execute the above-mentioned strabismus quantitative inspection method.

[0094] The image acquisition device 220 may be integrated into the display device 210 or may be independent of the display device 210. When the image acquisition device 220 is independent of the display device 210, the image acquisition device 220 should be disposed above and / or below the display device 210 to ensure that the user can observe the center of the display device 210 when looking straight ahead.

[0095] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0096] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of devices or units can be electrical, mechanical or other forms.

[0097] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0098] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0099] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk, and other media that can store program codes.

[0100] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present application, which are used to illustrate the technical solutions of the present application, rather than to limit them. The protection scope of the present application is not limited thereto. Although the present application is described in detail with reference to the above-mentioned embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-mentioned embodiments within the technical scope disclosed in the present application, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. A method for quantitatively inspecting strabismus, characterized in that: The invention is applied to a strabismus quantitative inspection system, the strabismus quantitative inspection system comprises a display device and an image acquisition device, the image acquisition device is used to acquire a face image of a user under test in real time, the display device is used to provide a first element with a fixed display position and a second element with a moving display position, and the method comprises: In response to a first covering switching event in which covering the second eye to be tested is switched to covering the first eye to be tested in this round of strabismus examination, controlling the display device to switch from displaying the first element to displaying the second element at the display position of this round; Detecting the current face image using the detection model to determine the current second pupil center position and the current second eye movement state when observing the second element through the second tested eye in this round of strabismus inspection; Determining a current second offset according to the current second pupil center position and the second pupil center position of a previous round of strabismus examination; Compare the current second offset with the previous second offset, and determine the next display position of the second element according to the comparison result and the indication direction of the current second eye movement state, wherein the previous second offset is the offset between the second pupil center position of the previous round and the second pupil center position of the previous round; Performing the next round of strabismus inspection using the first element and the second element whose display position has been determined for the next round, so as to determine the current strabismus degree of the user being tested according to the corresponding relationship between the offset and the strabismus degree when the strabismus inspection meets the inspection stop requirement; Determine the next display position of the second element according to the comparison result and the indication direction of the current second eye movement state in the following manner: If the current second offset is greater than the previous second offset, the current display position is used as the starting position, and the position after moving a first set distance from the starting position in the opposite direction of the current second eye movement state indication direction is selected as the next display position; If the current second offset is less than or equal to the previous round second offset, the current round display position is used as the starting position, and the position after moving a second set distance from the starting position in the indicated direction of the current second eye movement state is selected as the next round display position.

2. The method according to claim 1, characterized in that The step of performing the next round of strabismus inspection by using the first element and the second element whose display position has been determined for the next round includes: In response to a second cover switching event, starting a first strabismus examination for the first eye under test in a next round of strabismus examination, wherein the second cover switching event is an event of switching from covering the first eye under test to covering the second eye under test in the current round of strabismus examination; In response to the first cover switching event in the next round of strabismus examination, a second strabismus examination for the second tested eye in the next round of strabismus examination is started.

3. The method according to claim 1, characterized in that After determining the current second offset, the method further includes: Comparing the current first offset and the current second offset with offset thresholds respectively, wherein the current first offset is determined according to the current first pupil center position in the current round of strabismus examination and the first pupil center position in the previous round; If both offsets are less than or equal to the offset threshold, it is determined that the current round of strabismus inspection meets the inspection stop requirement, and the current strabismus degree of the measured user is determined according to the current second offset in the current round of strabismus inspection and the corresponding relationship between the offset and the strabismus degree; If at least one offset is greater than the offset threshold, it is determined that the current round of squint inspection does not meet the inspection stop requirement, and the latest display position of the second element is determined based on the comparison result of the current second offset and the previous round of second offset to perform the next round of squint inspection.

4. The method according to claim 2, characterized in that: The first strabismus test for the first tested eye is performed in the following manner: Using the next round of strabismus inspection as the latest strabismus inspection of the current round, and controlling the display device to switch from displaying the second element of the previous round to displaying the first element of the current round; Detecting the current face image using the detection model to determine the current first pupil center position and the current first eye movement state when observing the first element through the first tested eye in this round of strabismus inspection; The current first offset is determined according to the current first pupil center position and the previous round of first pupil center position in the previous round of strabismus examination to end the first strabismus examination of this round.

5. The method according to claim 1, characterized in that The current second offset includes a current second horizontal offset and a current second vertical offset, and the upper wheel second offset includes an upper wheel second horizontal offset and an upper wheel second vertical offset; The controlling the display device to switch from displaying the first element to displaying the second element at the current display position includes: Controlling the display device to display the second element in the horizontal direction and the vertical direction respectively, so as to determine the current second horizontal offset and the current second vertical offset respectively according to the current second pupil center position and the previous round second pupil center position; The comparing the current second offset with the previous second offset includes: Comparing the current second horizontal offset with the second horizontal offset of the previous wheel; The current second vertical offset is compared with the second vertical offset of the upper wheel.

6. The method according to claim 1, characterized in that The detecting model is used to detect the current face image, including: Use the face detection model to detect the current face image to obtain the current face detection result; The current face detection result is analyzed using a pupil detection model to obtain the current second pupil center position and the current second eye movement state in this round of strabismus examination.

7. The method according to claim 1, characterized in that The method further comprises: Using the distance detection model and the angle detection model, determine whether the distance and the facing direction of the user being measured meet the preset inspection conditions; If the preset inspection conditions are met, the current round of strabismus inspection will begin, using the detection model to detect the current face image and determine the pupil center position and eye movement status.

8. The method according to claim 1, characterized in that Determining the current second offset according to the current second pupil center position and the second pupil center position of the previous round of strabismus examination includes: The difference between the current second pupil center position and the second pupil center position of the previous round is used as the current second offset.

9. A strabismus quantitative inspection system, characterized in that: The system includes a display device, an image acquisition device, and a processor; The display device is used to provide a first element with a fixed display position and a second element with a movable display position, and switch the display between the first element and the second element in response to a cover switching event; The image acquisition device is used to acquire the face image of the user under test in real time, and transmit the acquired face image to the processor for processing; The processor is used to execute the strabismus quantitative inspection method according to any one of claims 1 to 8.

Images