Eye fundus image processing method and device, myopia detection method, electronic equipment and storage medium

Abstract

The embodiment of the invention provides an eye fundus image processing method and device, a myopia detection method, electronic equipment and a storage medium. The method comprises the steps of obtaining a to-be-processed eye fundus image; in response to an image conversion instruction, generating a diagnosis auxiliary line corresponding to the fundus image to be processed according to the fundus image and the image conversion instruction; according to the diagnosis auxiliary line, the strabismus condition of the to-be-processed eye fundus image is determined, the user clicks the button for auxiliary strabismus diagnosis in the preset processing software, the auxiliary line for auxiliary strabismus diagnosis appears on the eye fundus image, in this way, the eye fundus image can be rapidly analyzed to assist in oblique amblyopia judgment through a man-machine interaction mode, and the user experience is improved. And the detection accuracy and efficiency are improved.

Description

Technical Field

[0001] The present application relates to the field of image processing technology, and in particular, to a method and device for processing fundus images, a myopia detection method, an electronic device and a storage medium. Background Art

[0002] As people's living standards improve, they pay more and more attention to their eyes, especially for the diagnosis of adolescent eyes, such as myopia, strabismus or amblyopia. Currently, it usually requires a combination of multiple methods, including vision examination, eye movement examination, refractive examination, stereoscopic vision examination, pupil reaction examination, psychological visual test and medical history collection. These methods require multiple tests and take a long time. The patients are usually minors, which increases their burden due to low efficiency. In addition, they rely on the doctor's experience and judgment and are prone to deviations. Therefore, how to improve the accuracy and efficiency of the test is an urgent issue. Summary of the invention

[0003] Some embodiments of the present application aim to provide a method, device, myopia detection method, electronic device and storage medium for processing fundus images. Through the technical solutions of the embodiments of the present application, a fundus image to be processed is acquired; in response to an image conversion instruction, a diagnostic auxiliary line corresponding to the fundus image to be processed is generated according to the fundus image and the image conversion instruction; based on the diagnostic auxiliary line, the strabismus condition of the fundus image to be processed is determined. In the present application, a user clicks a button for auxiliary diagnosis of strabismus in a preset processing software, and an auxiliary line for auxiliary diagnosis of strabismus appears on the fundus image. In this way, through human-computer interaction, the diagnostic image of the fundus image can be quickly and accurately judged, thereby improving the accuracy and efficiency of detection.

[0004] In a first aspect, some embodiments of the present application provide a method for processing a fundus image, comprising:

[0005] Acquiring a fundus image to be processed;

[0006] In response to an image conversion instruction, generating a diagnosis auxiliary line corresponding to the fundus image to be processed according to the fundus image and the image conversion instruction;

[0007] The strabismus condition of the fundus image to be processed is determined according to the diagnostic auxiliary line.

[0008] In some embodiments of the present application, when the user clicks a button for auxiliary diagnosis of strabismus in a preset processing software, auxiliary lines for auxiliary diagnosis of strabismus appear on the fundus image. In this way, through human-computer interaction, the diagnostic image of the fundus image can be quickly and accurately determined, thereby improving the accuracy and efficiency of detection.

[0009] Optionally, the image conversion instruction is implemented through a conversion button on a preset processing software.

[0010] In some embodiments of the present application, a conversion button is set on the preset processing software. When the user clicks the conversion button, the terminal device obtains the conversion instruction input by the user, thereby realizing human-computer interaction.

[0011] Optionally, in response to the image conversion instruction, generating a diagnostic auxiliary line corresponding to the fundus image to be processed according to the fundus image and the image conversion instruction includes:

[0012] According to the fundus image to be processed, acquiring the optic disc center point and the macula center point in the fundus image to be processed;

[0013] According to the optic disc center point and the macula center point, a first diagnostic auxiliary line, a second diagnostic auxiliary line and a third diagnostic auxiliary line are determined respectively.

[0014] Optionally, determining a first diagnostic auxiliary line, a second diagnostic auxiliary line, and a third diagnostic auxiliary line respectively according to the optic disc center point and the macula center point includes:

[0015] Determine a horizontal line passing through the center point of the optic disc as the first diagnostic auxiliary line;

[0016] determining a horizontal line passing through the lower edge of the optic disc as the second diagnostic auxiliary line;

[0017] The line connecting the optic disc center point and the macula center point is determined as the third diagnostic auxiliary line.

[0018] In some embodiments of the present application, the optic disc center point and the macula center point in the fundus image are obtained by processing the fundus image to be processed, and a diagnostic auxiliary line is generated on the fundus image based on the optic disc center point and the macula midline, which is used to judge the diagnostic condition of the fundus image and improve the accuracy and efficiency of the diagnosis.

[0019] Optionally, determining the strabismus condition of the fundus image to be processed according to the diagnostic auxiliary line includes:

[0020] If the third diagnosis auxiliary line is located between the first diagnosis auxiliary line and the second diagnosis auxiliary line, determining that the fundus image to be processed is a front view image;

[0021] If the third diagnosis auxiliary line is located above the first diagnosis auxiliary line and the second diagnosis auxiliary line, determining that the fundus image to be processed is introversion;

[0022] If the third diagnosis auxiliary line is located below the first diagnosis auxiliary line and the second diagnosis auxiliary line, it is determined that the fundus image to be processed is external rotation.

[0023] Some embodiments of the present application determine whether the fundus image to be processed is a normal image or amblyopia by determining the relative positions of the first diagnostic auxiliary line, the second diagnostic auxiliary line, and the third diagnostic auxiliary line.

[0024] In a second aspect, some embodiments of the present application provide a fundus image processing device, including:

[0025] An acquisition module, used for acquiring a fundus image to be processed;

[0026] A generating module, configured to generate, in response to an image conversion instruction, a diagnostic auxiliary line corresponding to the fundus image to be processed according to the fundus image and the image conversion instruction;

[0027] The diagnosis module is used to determine the strabismus condition of the fundus image to be processed according to the diagnosis auxiliary line.

[0028] In some embodiments of the present application, when the user clicks a button for auxiliary diagnosis of strabismus in a preset processing software, auxiliary lines for auxiliary diagnosis of strabismus appear on the fundus image. In this way, through human-computer interaction, the diagnostic image of the fundus image can be quickly and accurately determined, thereby improving the accuracy and efficiency of detection.

[0029] Optionally, the image conversion instruction is implemented through a conversion button on a preset processing software.

[0030] In some embodiments of the present application, a conversion button is set on the preset processing software. When the user clicks the conversion button, the terminal device obtains the conversion instruction input by the user, thereby realizing human-computer interaction.

[0031] Optionally, the generating module is used to:

[0032] According to the fundus image to be processed, acquiring the optic disc center point and the macula center point in the fundus image to be processed;

[0033] According to the optic disc center point and the macula center point, a first diagnostic auxiliary line, a second diagnostic auxiliary line and a third diagnostic auxiliary line are determined respectively.

[0034] Optionally, the generating module is used to:

[0035] Determine a horizontal line passing through the center point of the optic disc as the first diagnostic auxiliary line;

[0036] determining a horizontal line passing through the lower edge of the optic disc as the second diagnostic auxiliary line;

[0037] The line connecting the optic disc center point and the macula center point is determined as the third diagnostic auxiliary line.

[0038] In some embodiments of the present application, the optic disc center point and the macula center point in the fundus image are obtained by processing the fundus image to be processed, and a diagnostic auxiliary line is generated on the fundus image based on the optic disc center point and the macula midline, which is used to judge the diagnostic condition of the fundus image and improve the accuracy and efficiency of the diagnosis.

[0039] Optionally, the diagnostic module is used to:

[0040] If the third diagnosis auxiliary line is located between the first diagnosis auxiliary line and the second diagnosis auxiliary line, determining that the fundus image to be processed is a front view image;

[0041] If the third diagnosis auxiliary line is located above the first diagnosis auxiliary line and the second diagnosis auxiliary line, determining that the fundus image to be processed is introversion;

[0042] If the third diagnosis auxiliary line is located below the first diagnosis auxiliary line and the second diagnosis auxiliary line, it is determined that the fundus image to be processed is external rotation.

[0043] Some embodiments of the present application determine whether the fundus image to be processed is a normal image or amblyopia by determining the relative positions of the first diagnostic auxiliary line, the second diagnostic auxiliary line, and the third diagnostic auxiliary line.

[0044] In a third aspect, some embodiments of the present application provide a myopia detection method, comprising:

[0045] acquiring a first fundus image;

[0046] Preprocessing the first fundus image to obtain a processed first fundus image;

[0047] If it is determined that the processed first fundus image is myopic, determining the age information of the user corresponding to the processed first fundus image;

[0048] If the user's age information is less than a preset age, determining whether the processed first fundus image is strabismus according to a preset strabismus detection method;

[0049] If the processed first fundus image is strabismus, the fundus image processing method described in any one of the first aspects is used to determine a first strabismus detection result corresponding to the processed first fundus image, wherein the first strabismus detection result at least includes a strabismus rotation angle and a diagnostic auxiliary line;

[0050] According to the position of the macula center and the position of the standard macula fixation area in the processed first fundus image, performing amblyopia detection on the processed first fundus image to determine a first amblyopia detection result corresponding to the first fundus image; the first amblyopia detection result at least includes a paracentral fixation category;

[0051] A myopia prevention and control plan corresponding to the first fundus image is determined according to the myopia fundus characteristics, the first strabismus detection result and the first amblyopia detection result.

[0052] In a fourth aspect, some embodiments of the present application provide a myopia detection method, the method comprising:

[0053] acquiring a second fundus image;

[0054] Preprocessing the second fundus image to obtain a processed second fundus image;

[0055] performing strabismus detection on the processed second fundus image;

[0056] If the processed second fundus image is strabismus, the fundus image processing method described in any one of the first aspects is used to determine a second strabismus detection result corresponding to the processed second fundus image, wherein the second strabismus detection result at least includes a strabismus rotation angle and a diagnostic auxiliary line;

[0057] performing amblyopia detection on the processed second fundus image according to the position of the macula center and the position of the standard macula fixation area in the processed second fundus image, and determining a second amblyopia detection result corresponding to the second fundus image;

[0058] Determining strabismus and amblyopia risk data corresponding to the second fundus image according to the second strabismus detection result and the second amblyopia detection result;

[0059] Determining user age data corresponding to the second fundus image according to the strabismus and amblyopia risk data;

[0060] According to the user age data, a strabismus and amblyopia detection and prevention scheme corresponding to the user age data is determined.

[0061] In a fifth aspect, some embodiments of the present application provide an electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein when the processor executes the program, the method for processing fundus images as described in any embodiment of the first aspect can be implemented.

[0062] In a sixth aspect, some embodiments of the present application provide a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, can implement the method for processing fundus images as described in any embodiment of the first aspect.

[0063] In the seventh aspect, some embodiments of the present application provide a computer program product, comprising a computer program, wherein the computer program, when executed by a processor, can implement the method for processing fundus images as described in any embodiment of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0064] In order to more clearly illustrate the technical solutions of some embodiments of the present application, the drawings required for use in some embodiments of the present application will be briefly introduced below. It should be understood that the following drawings only show some embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0065] Figure 1 A schematic diagram of a process flow of a method for processing fundus images provided in an embodiment of the present application;

[0066] Figure 2 A schematic diagram of the structure of a fundus image processing device provided in an embodiment of the present application;

[0067] Figure 3 A schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0068] The technical solutions in some embodiments of the present application will be described below in conjunction with the drawings in some embodiments of the present application.

[0069] It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings. At the same time, in the description of this application, the terms "first", "second", etc. are only used to distinguish the description and cannot be understood as indicating or implying relative importance.

[0070] As people's living standards improve, the importance of eyes is increasing, especially for the diagnosis of adolescent eyes, such as myopia, strabismus or amblyopia. At present, it is usually necessary to combine multiple methods, including vision test, eye movement test, refraction test, stereoscopic vision test, pupil reaction test, psychological visual test and medical history collection. These methods require multiple tests, the test time is long, the patient is usually a minor, the inefficiency increases their burden, and it depends on the doctor's experience and judgment, which is prone to deviation. Therefore, how to improve the accuracy and efficiency of the test is an urgent problem. In view of this, some embodiments of the present application provide a method for processing fundus images, the method includes obtaining a fundus image to be processed; in response to an image conversion instruction, generating a diagnostic auxiliary line corresponding to the fundus image to be processed according to the fundus image and the image conversion instruction; according to the diagnostic auxiliary line, determining the strabismus of the fundus image to be processed, in the present application, the user clicks the button of the auxiliary diagnosis strabismus in the preset processing software, and the auxiliary line of the auxiliary diagnosis strabismus appears on the fundus image, so that the diagnostic image of the fundus image can be quickly and accurately judged through human-computer interaction, and the accuracy and efficiency of the detection are improved.

[0071] Glossary:

[0072] Strabismus: Strabismus is a common eye condition in which both eyes cannot focus on the same target at the same time, causing one eye's line of sight to deviate from its normal position. This deviation can be inward, outward, upward or downward.

[0073] Amblyopia: Also known as "lazy eye", it is a common visual disorder in children, characterized by lower than normal vision in one eye, which cannot be corrected to normal vision even with glasses. The main cause of amblyopia is that the brain suppresses visual signals from one eye, resulting in poor vision development in that eye.

[0074] Paracentral fixation: refers to the patient's fixation on the area around the macula instead of the fovea. Paracentral fixation is a common phenomenon in patients with amblyopia, which seriously affects vision recovery and quality of life.

[0075] like Figure 1 As shown, an embodiment of the present application provides a method for processing a fundus image, the method comprising:

[0076] S101, obtaining a fundus image to be processed;

[0077] Specifically, a visual camera is used to collect fundus images of the user's left and right eyes respectively, and the visual camera sends the collected fundus images to the terminal device. In this way, the terminal device obtains the fundus images to be processed, that is, the collected fundus images of the left and right eyes, and pre-processes the fundus images.

[0078] Specifically, preset processing software is stored on the terminal device, and the acquired fundus image to be processed is input into the preset processing software. A conversion button is set on the interface of the preset processing software, and the user clicks the conversion button, so that the terminal device receives the conversion instruction input by the user.

[0079] S102, in response to the image conversion instruction, generating a diagnostic auxiliary line corresponding to the fundus image to be processed according to the fundus image and the image conversion instruction;

[0080] Specifically, after receiving the conversion instruction input by the user, the terminal device processes the fundus image to be processed, obtains the optic disc center point and the macula center point in the fundus image, and generates corresponding diagnostic auxiliary lines based on the optic disc center point and the macula center point.

[0081] S103: Determine the strabismus condition of the fundus image to be processed according to the auxiliary diagnosis line.

[0082] Specifically, after acquiring the diagnostic auxiliary lines, the terminal device can determine the diagnostic condition of the fundus image to be processed according to the relative positions between the diagnostic auxiliary lines. For example, the diagnostic condition can be a normal fundus image or amblyopia.

[0083] In some embodiments of the present application, when the user clicks a button for auxiliary diagnosis of strabismus in a preset processing software, auxiliary lines for auxiliary diagnosis of strabismus appear on the fundus image. In this way, through human-computer interaction, the diagnostic image of the fundus image can be quickly and accurately determined, thereby improving the accuracy and efficiency of detection.

[0084] Another embodiment of the present application further supplements the method for processing fundus images provided in the above embodiment.

[0085] Optionally, the image conversion instruction is implemented through a conversion button on a preset processing software.

[0086] In the embodiment of the present application, a conversion button is provided on the interface of the preset processing software. For example, the input fundus image to be processed is on the left side of the preset processing software interface, and a conversion button, namely, a "fundus rotation angle" button, is provided on the right side. When the user clicks the "fundus rotation angle" button on the right side, the terminal device obtains the image conversion instruction input by the user.

[0087] In some embodiments of the present application, a conversion button is set on the preset processing software. When the user clicks the conversion button, the terminal device obtains the conversion instruction input by the user, thereby realizing human-computer interaction.

[0088] Optionally, generating a diagnostic auxiliary line corresponding to the fundus image to be processed according to the conversion instruction and the fundus image to be processed includes:

[0089] According to the fundus image to be processed, obtaining the optic disc center point and the macula center point in the fundus image to be processed;

[0090] According to the center point of the optic disc and the center point of the macula, a first diagnostic auxiliary line, a second diagnostic auxiliary line and a third diagnostic auxiliary line are determined respectively.

[0091] Among them, the optic disc (OD) is the full name of the optic disc, also called the optic nerve papilla. About 3mm from the macula to the nasal side of the retina, there is a light red disc-shaped structure with a diameter of about 1.5mm and clear boundaries. It is called the optic disc, or optic disc for short, and is like a plate.

[0092] Optionally, according to the optic disc center point and the macula center point, respectively determining a first diagnostic auxiliary line, a second diagnostic auxiliary line and a third diagnostic auxiliary line comprises:

[0093] A horizontal line passing through the center point of the optic disc is determined as the first diagnostic auxiliary line;

[0094] A horizontal line passing through the lower edge of the optic disc is determined as the second diagnostic auxiliary line;

[0095] The line connecting the center of the optic disc and the center of the macula is determined as the third diagnostic auxiliary line.

[0096] After the terminal device receives the conversion instruction input by the user, diagnostic auxiliary lines will appear on the left image of the preset processing software, for example, the first diagnostic auxiliary line, the second diagnostic auxiliary line and the third diagnostic auxiliary line. After clicking the "fundus rotation angle" button, the first diagnostic auxiliary line, the second diagnostic auxiliary line and the third diagnostic auxiliary line will appear on the fundus image to be processed on the left. The three appear at the same time, among which the first diagnostic auxiliary line is a horizontal line passing through the center point of the optic disc and is used to assist in the diagnosis of strabismus. The second diagnostic auxiliary line is a horizontal line passing through the lower edge of the optic disc. The third diagnostic auxiliary line is a line connecting the center point of the optic disc and the center point of the macula.

[0097] In some embodiments of the present application, the optic disc center point and the macula center point in the fundus image are obtained by processing the fundus image to be processed, and a diagnostic auxiliary line is generated on the fundus image based on the optic disc center point and the macula midline, which is used to judge the diagnostic condition of the fundus image and improve the accuracy and efficiency of the diagnosis.

[0098] Optionally, determining the strabismus of the fundus image to be processed according to the diagnostic auxiliary line includes:

[0099] If the third diagnosis auxiliary line is located between the first diagnosis auxiliary line and the second diagnosis auxiliary line, determining that the fundus image to be processed is a front view image;

[0100] If the third diagnosis auxiliary line is located above the first diagnosis auxiliary line and the second diagnosis auxiliary line, it is determined that the fundus image to be processed is introversion;

[0101] If the third diagnosis auxiliary line is located below the first diagnosis auxiliary line and the second diagnosis auxiliary line, it is determined that the fundus image to be processed is exotropy.

[0102] Exemplarily, if the third diagnostic auxiliary line is between the first diagnostic auxiliary line and the second diagnostic auxiliary line, the fundus image is a frontal image rather than an oblique image; if the third diagnostic auxiliary line is above the two horizontal lines of the first diagnostic auxiliary line and the second diagnostic auxiliary line, it is inward rotation; if the third diagnostic auxiliary line is below the two horizontal lines of the first diagnostic auxiliary line and the second diagnostic auxiliary line, it is outward rotation.

[0103] In the embodiment of the present application, the user inputs a conversion instruction, that is, clicks a button for assisting in diagnosing strabismus, and auxiliary lines for assisting in diagnosing strabismus appear on the fundus image.

[0104] Some embodiments of the present application determine whether the fundus image to be processed is a normal image or amblyopia by determining the relative positions of the first diagnostic auxiliary line, the second diagnostic auxiliary line, and the third diagnostic auxiliary line.

[0105] Furthermore, in order to more accurately determine the fundus image, the embodiment of the present application may be detected in the following manner:

[0106] A101. Obtain a fundus image of the person to be tested; specifically, obtain the fundus image of the person to be tested through a fundus camera, and the fundus camera transmits the acquired fundus image to a terminal device, wherein the acquired fundus image may be a 45° fundus image, or a 60°, 80°, 120° fundus image, or a wide-angle fundus image or a fundus image with other field of view angles, or even a fundus image of other modalities, and the fundus image may be shot with the optic disc as the center, or may be shot with the macula center as the center, or an image of other eye positions;

[0107] A102, determining the macular center position information corresponding to the fundus image according to the fundus image of the person to be tested;

[0108] A103. Determine the paracentral fixation type corresponding to the fundus image according to the macular center position information and the preset macular fixation area. Specifically, the terminal device pre-stores a preset macular fixation area, which is obtained by identifying the fundus image of the emmetropia person. The terminal device collects the fundus image of any person in real time, identifies the fundus image, obtains the macular center position information of the fundus image, compares the macular center position information with the preset macular fixation area, determines the relative position of the macular center position and the preset macular fixation area, and then obtains the paracentral fixation type of the fundus image.

[0109] Among them, the preset macular fixation area is obtained in the following manner: obtaining a sample fundus image of an emmetropic person; specifically, a plurality of initial sample fundus images of a plurality of emmetropic persons may be obtained; and the plurality of initial sample fundus images are averaged to obtain the sample fundus images of the emmetropic person.

[0110] According to a preset positioning algorithm, a preset macular fixation area in the sample fundus image is determined, wherein the preset positioning algorithm at least includes a pre-trained positioning model, or a positioning algorithm based on machine learning or computer vision algorithm. The measured distance and / or field of view angle from the center of the macula to the center of the preset macular fixation area is calculated; according to the measured distance and / or field of view angle and the size of the preset value, the paracentral fixation type corresponding to the fundus image is determined. The paracentral fixation type includes at least one of macular center fixation, paracentral fixation, paramacular fixation, peripheral fixation and wandering fixation.

[0111] Specifically, as an optional implementation, the terminal device can calculate the measured distance from the center position of the macula to the center of a preset macular fixation area based on the center position of the macula in the fundus image of the person to be tested, and judge the measured distance. If the para-central fixation type corresponding to the fundus image is judged based on the size of the measured distance, for example, if the measured distance is less than the first preset distance, the para-central fixation type of the fundus image is determined to be para-central fixation; if the measured distance is greater than the first preset distance and less than the second preset distance, the para-central fixation type of the fundus image is determined to be para-macular fixation; if the measured distance is greater than the second preset distance and less than the third preset distance, the para-central fixation type of the fundus image is determined to be peripheral fixation; if the measured distance is greater than the third preset distance, the para-central fixation type of the fundus image is determined to be wandering fixation, wherein the first preset distance, the second preset distance, and the third preset distance can be set according to the situation and are not limited in the embodiments of the present application.

[0112] As another optional implementation, the terminal device obtains the field of view angle corresponding to the fundus image of the person to be tested, compares the field of view angle with the preset field of view angle, and calculates the difference between the field of view angle and the preset field of view angle. If the difference is less than the first preset angle difference, the para-central fixation type of the fundus image is determined to be para-central fixation; if the difference is greater than the first preset angle difference and less than the second preset angle difference, the para-central fixation type of the fundus image is determined to be para-macular fixation; if the difference is greater than the second preset angle difference and less than the third preset angle difference, the para-central fixation type of the fundus image is determined to be peripheral fixation; if the difference is greater than the third preset angle difference, the para-central fixation type of the fundus image is determined to be wandering fixation; wherein, the first preset angle difference, the second preset angle difference, and the third preset angle difference can be set according to actual needs and are not specifically limited in the present application.

[0113] In summary, the embodiments of the present application calculate the measured distance and / or the field of view angle from the center of the macula to the center of the preset macular fixation area, and determine the paracentral fixation type corresponding to the fundus image according to the measured distance and / or the field of view angle and the size of the preset value. In the specific implementation process, you can choose to calculate only the test distance, or only the field of view angle, or both at the same time, which can be set as needed.

[0114] Specifically, the gaze properties of the amblyopic eye can be divided into the following three categories:

[0115] Central fixation: fixation is at the center of the fovea;

[0116] Paracentral fixation: the fixation point is offset from the fovea;

[0117] Wandering gaze: There is no fixed gaze point, that is, the gaze wanders.

[0118] Further subdivision, paracentral fixation can be divided into the following three types:

[0119] Parafoveal fixation: fixation point is near the fovea;

[0120] Paramacular fixation: fixation is in the macular area outside the fovea;

[0121] Peripheral fixation: fixation on retinal locations outside the macula.

[0122] The terminal device obtains fundus camera parameters, which include field of view angle. The distance corresponding to a 1° field of view angle on the fundus image is calculated based on the field of view angle of the fundus camera and recorded as the unit distance. A standard preset macular fixation area is generated based on the unit distance.

[0123] The standard preset macular areas include: a first area, i.e., a macular central fixation area with the macula as the center and a unit distance as a radius; a second area, i.e., a para-central fixation area with the first area as the center and twice the unit distance as a radius; a third area, i.e., a para-macular fixation area with the second area as the center and three times the unit distance as a radius. The shapes of the above-mentioned first, second and third areas are preferably regular shapes, such as circles, and those skilled in the art may also set them to other shapes.

[0124] When the terminal device detects the fundus image, if the gaze point falls on the center of the macula, it is central macular gaze, indicating that the patient's gaze point is stable and there is no amblyopia; if the gaze point falls outside the center of the macula and is within the first area, it is paracentral gaze, indicating that the patient has paracentral gaze, which is a manifestation of amblyopia; if the gaze point is within the second area, it is paramacular gaze, indicating that the patient has paramacular gaze, which is a manifestation of amblyopia and the severity of amblyopia is greater than that of paracentral gaze; if the gaze point is within the third area, it is peripheral gaze, indicating that the patient has peripheral gaze, which is a manifestation of amblyopia and the severity of amblyopia is greater than that of paramacular gaze, and the treatment is difficult; if the gaze point is outside the third area, it is wandering gaze, indicating that the patient has wandering gaze, which is a manifestation of amblyopia and the severity of amblyopia is greater than that of peripheral gaze, and the treatment is difficult.

[0125] That is to say, normal people use the center of the macula (fovea) of the fundus retina to focus on the target. Therefore, normal gaze is called central gaze. For various reasons, the eyes do not use the center of the macula to focus on the target, but use one or more parts outside the center of the macula to focus on the target, which is abnormal gaze.

[0126] In some embodiments of the present application, by calculating the measured distance and / or the field of view angle from the center of the macula to the center of a preset macular fixation area, the paracentral fixation type of the fundus image is determined according to the size of the distance and / or the size of the field of view angle, thereby enabling the fundus image to be quickly identified.

[0127] In the embodiment of the present application, the paracentral gaze can also be detected in reverse, and the fundus camera can be changed, that is, the eyes need to look at a point or a projection of an image when taking the fundus image.

[0128] The embodiments of the present application improve diagnostic accuracy. Through automated image analysis technology, it can more accurately determine whether the patient has paracentral fixation and reduce errors caused by subjective judgment. The automated method can quickly complete the analysis and diagnosis of fundus images, shorten the examination time, and improve diagnostic efficiency. It can reduce the number of examinations required by patients, reduce the burden on patients, and improve patients' medical experience. It can generate detailed diagnostic reports to provide doctors with a scientific basis, assist clinical decision-making, and improve treatment effects.

[0129] In addition to this solution, the existing paracentral fixation method can be achieved by changing the camera, that is, the eyes need to look at a point or a projection of an image when taking a picture. The camera will directly project the macular fixation area onto the fundus of the patient. The photographer can directly observe the fundus of the patient to determine whether the patient has paracentral fixation.

[0130] The present application also provides a myopia detection method, which includes:

[0131] acquiring a first fundus image;

[0132] Preprocessing the first fundus image to obtain a processed first fundus image;

[0133] If it is determined that the processed first fundus image is myopic, determining the age information of the user corresponding to the processed first fundus image;

[0134] If the user's age information is less than the preset age, judging whether the processed first fundus image is strabismus according to a preset strabismus detection method;

[0135] If the processed first fundus image is strabismus, the above-mentioned fundus image processing method is used to determine a first strabismus detection result corresponding to the processed first fundus image, wherein the first strabismus detection result at least includes a strabismus rotation angle and a diagnostic auxiliary line;

[0136] According to the position of the macula center and the position of the standard macula fixation area in the processed first fundus image, performing amblyopia detection on the processed first fundus image to determine a first amblyopia detection result corresponding to the first fundus image; the first amblyopia detection result at least includes a paracentral fixation category;

[0137] According to the myopia fundus characteristics, the first strabismus detection result and the first amblyopia detection result, a myopia prevention and control plan corresponding to the first fundus image is determined.

[0138] The step of performing amblyopia detection on the processed first fundus image specifically includes:

[0139] After the terminal device obtains the processed first fundus image of the person to be tested, the basic structure of the fundus image includes: blood vessels (arteries and veins), optic disc, optic cup, and macula. A preset recognition algorithm is used to identify the macula in the fundus image to obtain the position of the macula in the fundus, and then determine the macula center position information based on the macula position.

[0140] The terminal device pre-stores a preset macular fixation area, which is obtained by identifying the fundus image of the emmetropia person. The terminal device compares the macular center position information in the first fundus image with the preset macular fixation area, determines the relative position of the macular center position in the first fundus image and the preset macular fixation area, and then obtains the paracentral fixation type of the processed first fundus image.

[0141] Exemplarily, a detection method A combining amblyopia and strabismus provided in an embodiment of the present application is as follows:

[0142] A100, obtains the patient's fundus image and performs preprocessing, i.e., standardization processing such as denoising and enhancement, in order to improve the image quality;

[0143] A200, detects whether the patient is myopic, and if so, obtains the patient's age information;

[0144] A300, if the age is underage, the above method is used to detect strabismus;

[0145] A400, if it is strabismus, it will output the rotation angle and auxiliary lines, such as the first diagnostic auxiliary line, the second diagnostic auxiliary line and the third diagnostic auxiliary line, to help doctors diagnose strabismus and facilitate the comparison of the effects before and after strabismus surgery, so as to intuitively see the strabismus correction effect;

[0146] A500 further detects whether it is amblyopia, determines the category according to the position of the macula center in the standard macula fixation area, and outputs the fundus image with the macula fixation area using the above method;

[0147] A600 outputs a comprehensive myopia prevention and control plan and provides targeted treatment based on the myopic fundus-related characteristics, strabismus rotation angle and paracentral fixation category.

[0148] The detection of strabismus and amblyopia is not only applicable to myopia detection in adults, but also to myopia detection in minors. If myopia occurs and is not discovered in time, it will cause greater damage to the eyes.

[0149] The present application also provides a myopia detection method, which includes:

[0150] acquiring a second fundus image;

[0151] Preprocessing the second fundus image to obtain a processed second fundus image;

[0152] performing strabismus detection on the processed second fundus image;

[0153] If the processed second fundus image is strabismus, the above-mentioned fundus image processing method is used to determine a second strabismus detection result corresponding to the processed second fundus image, wherein the second strabismus detection result at least includes a strabismus rotation angle and a diagnostic auxiliary line;

[0154] performing amblyopia detection on the processed second fundus image according to the position of the macula center and the position of the standard macula fixation area in the processed second fundus image, and determining a second amblyopia detection result corresponding to the second fundus image;

[0155] Determine strabismus and amblyopia risk data corresponding to the second fundus image according to the second strabismus detection result and the second amblyopia detection result;

[0156] Determining user age data corresponding to the second fundus image according to the strabismus and amblyopia risk data;

[0157] According to the user's age data, determine the strabismus and amblyopia detection and prevention plan corresponding to the user's age data.

[0158] The amblyopia detection is performed on the processed second fundus image, specifically including:

[0159] After acquiring the processed second fundus image of the person to be tested, the terminal device uses a preset recognition algorithm to identify the macula in the fundus image, obtains the position of the macula in the fundus, and then determines the macula center position information based on the macula position.

[0160] The terminal device pre-stores a preset macular fixation area, which is obtained by identifying the fundus image of the emmetropia person. The terminal device compares the macular center position information in the second fundus image with the preset macular fixation area, determines the relative position of the macular center position and the preset macular fixation area, and then obtains the paracentral fixation type of the processed second fundus image.

[0161] Exemplarily, the technical solution B for combining strabismus and amblyopia provided by the present application is as follows:

[0162] B100, obtain the patient's fundus image and perform preprocessing, i.e., standardization processing such as denoising and enhancement, in order to improve the image quality;

[0163] B200, detects strabismus;

[0164] B300, if it is strabismus, it will output the rotation angle and auxiliary lines, such as the first diagnostic auxiliary line, the second diagnostic auxiliary line and the third diagnostic auxiliary line, to help doctors diagnose strabismus and facilitate the comparison of the effects before and after strabismus surgery, so as to intuitively see the strabismus correction effect;

[0165] B400, further detecting whether it is amblyopia, judging the category according to the position of the macula center in the standard macula fixation area, and outputting the fundus image with the macula fixation area using the above method;

[0166] B500, based on the strabismus and amblyopia test results, if there is a risk of strabismus and amblyopia, the patient's age is further obtained;

[0167] B600, if the age is a minor, a myopia prevention and control plan is generated based on the strabismus rotation angle and paracentral fixation category;

[0168] B700, if the age is an adult, the strabismus and amblyopia detection results are directly output.

[0169] If the user detects strabismus and amblyopia, timely prevention and control is required, especially for children and adolescents. If they are in a state of strabismus and amblyopia for a long time, it will affect their refractive development and lead to myopia. Therefore, the embodiments of the present application can be used to detect strabismus and amblyopia in time to avoid the occurrence of myopia.

[0170] There are many causes of myopia, the most common one is refractive myopia, but a small part of myopia is caused by other reasons. If it is not discovered and treated in time, it is likely to lead to blindness. The method of the present application can detect the real cause of adolescent myopia early, target treatment, and improve diagnostic accuracy. Provide adolescents with accurate myopia prevention and control plans and eye treatment plans. At the same time, the present application checks myopia, strabismus, and amblyopia in one step, reducing the number of examinations required for patients, reducing the burden on patients, and improving patients' medical experience. The method of the present application assists clinical decision-making, and the generated auxiliary lines and macular fixation areas provide a scientific basis for doctors, assist clinical decision-making, and improve treatment effects.

[0171] It should be noted that each implementable method in this embodiment may be implemented separately, or may be implemented in combination in any combination without conflict, and this application is not limited thereto.

[0172] Another embodiment of the present application provides a fundus image processing device, which is used to execute the fundus image processing method provided in the above embodiment.

[0173] like Figure 2 , which is a schematic diagram of the structure of a fundus image processing device provided in an embodiment of the present application. The fundus image processing device includes an acquisition module 601, a generation module 602 and a diagnosis module 603, wherein:

[0174] The acquisition module 601 is used to acquire the fundus image to be processed;

[0175] The generating module 602 is used to generate a diagnostic auxiliary line corresponding to the fundus image to be processed according to the fundus image and the image conversion instruction in response to the image conversion instruction;

[0176] The diagnosis module 603 is used to determine the strabismus condition of the fundus image to be processed according to the diagnosis auxiliary lines.

[0177] Regarding the device in this embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0178] In some embodiments of the present application, when the user clicks a button for auxiliary diagnosis of strabismus in a preset processing software, auxiliary lines for auxiliary diagnosis of strabismus appear on the fundus image. In this way, through human-computer interaction, the diagnostic image of the fundus image can be quickly and accurately determined, thereby improving the accuracy and efficiency of detection.

[0179] Another embodiment of the present application further supplements the fundus image processing device provided in the above embodiment.

[0180] Optionally, the image conversion instruction is implemented through a conversion button on a preset processing software.

[0181] In some embodiments of the present application, a conversion button is set on the preset processing software. When the user clicks the conversion button, the terminal device obtains the conversion instruction input by the user, thereby realizing human-computer interaction.

[0182] Optionally, generate a module for:

[0183] According to the fundus image to be processed, obtaining the optic disc center point and the macula center point in the fundus image to be processed;

[0184] According to the center point of the optic disc and the center point of the macula, a first diagnostic auxiliary line, a second diagnostic auxiliary line and a third diagnostic auxiliary line are determined respectively.

[0185] Optionally, generate a module for:

[0186] A horizontal line passing through the center point of the optic disc is determined as the first diagnostic auxiliary line;

[0187] A horizontal line passing through the lower edge of the optic disc is determined as the second diagnostic auxiliary line;

[0188] The line connecting the center of the optic disc and the center of the macula is determined as the third diagnostic auxiliary line.

[0189] In some embodiments of the present application, the optic disc center point and the macula center point in the fundus image are obtained by processing the fundus image to be processed, and a diagnostic auxiliary line is generated on the fundus image based on the optic disc center point and the macula midline, which is used to judge the diagnostic condition of the fundus image and improve the accuracy and efficiency of the diagnosis.

[0190] Optionally, a diagnostic module for:

[0191] If the third diagnosis auxiliary line is located between the first diagnosis auxiliary line and the second diagnosis auxiliary line, determining that the fundus image to be processed is a front view image;

[0192] If the third diagnosis auxiliary line is located above the first diagnosis auxiliary line and the second diagnosis auxiliary line, it is determined that the fundus image to be processed is introversion;

[0193] If the third diagnosis auxiliary line is located below the first diagnosis auxiliary line and the second diagnosis auxiliary line, it is determined that the fundus image to be processed is exotropy.

[0194] Some embodiments of the present application determine whether the fundus image to be processed is a normal image or amblyopia by determining the relative positions of the first diagnostic auxiliary line, the second diagnostic auxiliary line, and the third diagnostic auxiliary line.

[0195] Regarding the device in this embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0196] It should be noted that each implementable method in this embodiment may be implemented separately, or may be implemented in combination in any combination without conflict, and this application is not limited thereto.

[0197] An embodiment of the present application also provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the operation of the method corresponding to any embodiment of the fundus image processing method provided in the above embodiments can be implemented.

[0198] An embodiment of the present application also provides a computer program product, which includes a computer program, wherein when the computer program is executed by a processor, it can implement the operations of the method corresponding to any embodiment of the fundus image processing method provided in the above embodiments.

[0199] like Figure 3 As shown, some embodiments of the present application provide an electronic device 700, which includes: a memory 710, a processor 720, and a computer program stored in the memory 710 and executable on the processor 720, wherein the processor 720 can implement any of the methods of the fundus image processing method described above when reading the program from the memory 710 through a bus 730 and executing the program.

[0200] Processor 720 can process digital signals and can include various computing structures, such as complex instruction set computer structure, reduced instruction set computer structure, or a structure that implements a combination of multiple instruction sets. In some examples, processor 720 can be a microprocessor.

[0201] The memory 710 may be used to store instructions executed by the processor 720 or data related to the execution of instructions. These instructions and / or data may include codes for implementing some or all functions of one or more modules described in the embodiments of the present application. The processor 720 of the disclosed embodiment may be used to execute instructions in the memory 710 to implement the method shown above. The memory 710 includes a dynamic random access memory, a static random access memory, a flash memory, an optical memory, or other memory known to those skilled in the art.

[0202] The above are only embodiments of the present application and are not intended to limit the scope of protection of the present application. For those skilled in the art, the present application may have various changes and variations. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the scope of protection of the present application. It should be noted that similar reference numerals and letters represent similar items in the following drawings, so once an item is defined in one drawing, it does not need to be further defined and explained in the subsequent drawings.

[0203] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

[0204] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

Claims

1. A method for processing fundus images, characterized in that: The method comprises: Acquiring a fundus image to be processed; In response to an image conversion instruction, generating a diagnosis auxiliary line corresponding to the fundus image to be processed according to the fundus image and the image conversion instruction; The strabismus condition of the fundus image to be processed is determined according to the diagnostic auxiliary line.

2. The method for processing fundus images according to claim 1, characterized in that: The image conversion instruction is implemented by a conversion button on the preset processing software.

3. The method for processing fundus images according to claim 1, characterized in that: The step of generating, in response to the image conversion instruction, a diagnostic auxiliary line corresponding to the fundus image to be processed according to the fundus image and the image conversion instruction comprises: According to the fundus image to be processed, acquiring the optic disc center point and the macula center point in the fundus image to be processed; According to the optic disc center point and the macula center point, a first diagnostic auxiliary line, a second diagnostic auxiliary line and a third diagnostic auxiliary line are determined respectively.

4. The method for processing fundus images according to claim 3, characterized in that: The step of determining a first diagnostic auxiliary line, a second diagnostic auxiliary line, and a third diagnostic auxiliary line respectively according to the optic disc center point and the macula center point comprises: Determine a horizontal line passing through the center point of the optic disc as the first diagnostic auxiliary line; Determine a horizontal line passing through the lower edge of the optic disc as the second diagnostic auxiliary line; The line connecting the optic disc center point and the macula center point is determined as the third diagnostic auxiliary line.

5. The method for processing fundus images according to claim 4, characterized in that: Determining the strabismus of the fundus image to be processed according to the diagnostic auxiliary line includes: If the third diagnosis auxiliary line is located between the first diagnosis auxiliary line and the second diagnosis auxiliary line, determining that the fundus image to be processed is a front view image; If the third diagnosis auxiliary line is located above the first diagnosis auxiliary line and the second diagnosis auxiliary line, determining that the fundus image to be processed is introversion; If the third diagnosis auxiliary line is located below the first diagnosis auxiliary line and the second diagnosis auxiliary line, it is determined that the fundus image to be processed is external rotation.

6. A fundus image processing device, characterized in that: The device comprises: An acquisition module, used for acquiring a fundus image to be processed; A generating module, configured to generate, in response to an image conversion instruction, a diagnostic auxiliary line corresponding to the fundus image to be processed according to the fundus image and the image conversion instruction; The diagnosis module is used to determine the strabismus condition of the fundus image to be processed according to the diagnosis auxiliary line.

7. A myopia detection method, characterized in that: The method comprises: acquiring a first fundus image; Preprocessing the first fundus image to obtain a processed first fundus image; If it is determined that the processed first fundus image is myopia, determining the age information of the user corresponding to the processed first fundus image; If the user's age information is less than a preset age, determining whether the processed first fundus image is strabismus according to a preset strabismus detection method; If the processed first fundus image is strabismus, the fundus image processing method according to any one of claims 1 to 5 is used to determine a first strabismus detection result corresponding to the processed first fundus image, wherein the first strabismus detection result at least includes a strabismus rotation angle and a diagnostic auxiliary line; According to the position of the macula center and the position of the standard macula fixation area in the processed first fundus image, performing amblyopia detection on the processed first fundus image to determine a first amblyopia detection result corresponding to the first fundus image; the first amblyopia detection result at least includes a paracentral fixation category; A myopia prevention and control plan corresponding to the first fundus image is determined according to the myopia fundus characteristics, the first strabismus detection result and the first amblyopia detection result.

8. A myopia detection method, characterized in that: The method comprises: acquiring a second fundus image; Preprocessing the second fundus image to obtain a processed second fundus image; performing strabismus detection on the processed second fundus image; If the processed second fundus image is strabismus, the fundus image processing method according to any one of claims 1 to 5 is used to determine a second strabismus detection result corresponding to the processed second fundus image, wherein the second strabismus detection result at least includes a strabismus rotation angle and a diagnostic auxiliary line; performing amblyopia detection on the processed second fundus image according to the position of the macula center and the position of the standard macula fixation area in the processed second fundus image, and determining a second amblyopia detection result corresponding to the second fundus image; Determining strabismus and amblyopia risk data corresponding to the second fundus image according to the second strabismus detection result and the second amblyopia detection result; Determining user age data corresponding to the second fundus image according to the strabismus and amblyopia risk data; According to the user age data, a strabismus and amblyopia detection and prevention scheme corresponding to the user age data is determined.

9. An electronic device, characterized in that: It comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, it can implement the method for processing fundus images described in any one of claims 1 to 5, or it can implement the myopia detection method described in any one of claims 7 or 8.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, characterized in that when the program is executed by a processor, it can implement the method for processing fundus images described in any one of claims 1 to 5, or can implement the myopia detection method described in any one of claims 7 or 8.

Images