Myopia prediction method and system based on eye fundus image and electronic equipment

Through the myopia prediction method based on fundus images, using structured pruning and self-distillation training technology, a myopia prediction auxiliary model is generated, which solves the problem of low accuracy in traditional pathological myopia diagnosis, and achieves more efficient and accurate myopia prediction and diagnosis .

CN119494833AActive Publication Date: 2025-02-21NORTH CHINA UNIVERSITY OF SCIENCE AND TECHNOLOGY
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202411787204.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-06
Publication Date
2025-02-21
Estimated Expiration
2044-12-06

AI Technical Summary

Technical Problem

Traditional pathological myopia diagnosis relies on complex instrument examinations and doctors’ subjective judgments, with low accuracy and difficult to achieve timely and accurate diagnosis in areas with resource-constrained.

Method used

Using myopia prediction method based on fundus images, the ResNet-50 model was selected for structured pruning by acquiring and standardizing pathological myopia medical data sets, and a myopia prediction auxiliary model was generated using self-distillation training technology to improve fundus image classification recognition and the accuracy of myopia prediction.

Benefits of technology

It significantly improves the accuracy of myopia prediction, reduces artificial errors, provides more consistent diagnostic results, and is suitable for resource-constrained medical environments, improving the automatic diagnosis efficiency of pathological myopia.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119494833A_ABST
    Figure CN119494833A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of myopia prediction, in particular to a myopia prediction method and system based on an eye fundus image and electronic equipment. Comprising the following steps: acquiring a pathological myopia medical data set, performing data enhancement and standardization processing on the pathological myopia medical data set to generate a fundus image data set, and dividing the fundus image data set into a training set and a verification set; selecting a baseline model, and performing structured pruning on the baseline model to obtain a pruning model; performing self-distillation training on the pruning model by using the fundus image data set to generate a myopia prediction auxiliary model; obtaining a to-be-detected eye fundus image; and inputting a to-be-detected fundus image into the myopia prediction auxiliary model to generate a myopia prediction result of the to-be-detected fundus image. The myopia prediction is carried out through the method, which pathologic myopia the fundus image to be detected belongs to can be quickly and accurately identified and classified, personal errors are reduced, and a more consistent diagnosis result is provided.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of myopia prediction, and in particular to a myopia prediction method, system and electronic equipment based on fundus images. Background Art

[0002] Pathological myopia is a serious eye disease. Unlike myopia caused by ordinary refractive errors, it is usually caused by abnormal morphology or structural changes of the eyeball, rather than just a problem of refractive power. It is characterized by excessive axial length, pathological changes in the retina and choroid, leading to vision loss and other eye health problems. In recent years, the incidence of pathological myopia has shown a clear growth trend, becoming an important challenge in the field of global eye health. Therefore, understanding and predicting the risk of pathological myopia is crucial to developing effective prevention strategies and treatment plans.

[0003] Traditional diagnosis of pathological myopia relies on complex instrument examinations and the doctor's clinical experience. The diagnosis process is not only time-consuming and labor-intensive, but also the results are limited by the doctor's professional level and experience, and there is a certain degree of subjectivity. In addition, for resource-constrained areas, there is a lack of advanced medical equipment and a shortage of professional doctors. These factors have seriously hindered the timely and accurate diagnosis of pathological myopia. Summary of the invention

[0004] The technical problem to be solved by the present invention is that the traditional diagnosis of pathological myopia mainly relies on instruments and doctors' subjective judgment, and has a low accuracy rate.

[0005] In order to solve the above problems, the present invention provides a myopia prediction method and system which can improve the accuracy of fundus image classification and recognition, and thus improve the accuracy of myopia prediction;

[0006] The first technical solution of the present invention is:

[0007] A myopia prediction method based on fundus images, comprising:

[0008] Obtain a pathological myopia medical dataset, perform data enhancement and standardization on the pathological myopia medical dataset, generate a fundus image dataset, and divide the fundus image dataset into a training set and a validation set;

[0009] Select a baseline model, perform structured pruning on the baseline model, and obtain a pruned model;

[0010] The pruned model was trained by self-distillation using the fundus image dataset to generate a myopia prediction auxiliary model.

[0011] Acquire a fundus image to be detected;

[0012] The fundus image to be detected is input into the myopia prediction auxiliary model to generate a myopia prediction result of the fundus image to be detected.

[0013] Preferably, a further technical solution of the present invention is:

[0014] The selected baseline model is subjected to structured pruning to obtain a pruned model, specifically:

[0015] The baseline model uses the ResNet-50 model, takes the prediction results of the ResNet-50 model as the original prediction results, performs He reinitialization on the convolution kernels in each convolution layer of the ResNet-50 model, and outputs the weights and reinitialized model after He reinitialization;

[0016] The ResNet-50 model is forward propagated through the weights reinitialized by He, the accuracy of the reinitialized model is recorded, and the difference between the output of the reinitialized model and the output of the ResNet-50 model is calculated to obtain the performance loss;

[0017] Set a performance loss threshold. When the performance loss is less than the performance loss threshold, prune the ResNet-50 model to obtain an initial pruned model.

[0018] The Osprey optimization algorithm is used to optimize the pruning ratio and performance loss threshold of the initial pruning model to obtain the pruning model.

[0019] The convolution kernels in each convolution layer of the ResNet-50 model are reinitialized by He, and the formula is:

[0020] ;

[0021] in, is the ResNet-50 model weight, is the number of neurons in the previous layer, and the model weights are from a mean of 0 and a variance of are drawn from a normal distribution.

[0022] The Osprey optimization algorithm is used to optimize the parameters of the pruning ratio and performance loss threshold of the initial pruning model to obtain a pruning model, which is specifically:

[0023] In the multi-objective optimization task, according to the characteristics of different regions of the objective function, a hierarchical strategy is used to gradually converge to the optimal solution, generate the Pareto frontier, find multiple optimal solutions that do not dominate each other, and obtain the optimal pruning ratio and the optimal performance loss threshold;

[0024] The ResNet-50 model is pruned by the optimal pruning ratio and the optimal performance loss threshold to obtain the pruned model.

[0025] The method uses the fundus image dataset to perform self-distillation training on the pruning model to generate a myopia prediction auxiliary model, specifically:

[0026] The pruning model performs forward propagation on the training data of the training set, outputs the predicted probability of each category, performs temperature adjustment on the predicted probability, and generates the first soft label corresponding to the training set;

[0027] The pruning model forward propagates the training data of the training set again to generate the second soft label corresponding to the training set;

[0028] Calculate the distillation loss based on the difference between the second soft label and the first soft label; calculate the classification loss between the prediction result and the true label using the cross entropy loss function; combine the distillation loss and the classification loss through a weighting factor to generate a total loss function;

[0029] When the improvement of the accuracy of the validation set of the pruning model is less than or equal to the preset accuracy value in a continuous training cycle, the training is stopped, and the Osprey optimization algorithm is used to optimize the parameters of the temperature, training cycle and preset accuracy value to generate a myopia prediction auxiliary model.

[0030] The temperature adjustment of the predicted probability to generate the first soft label corresponding to the training set is specifically:

[0031] Temperature adjustment is performed on the predicted probability of each category, and the predicted probability is divided by the temperature parameter , input the Softmax function to obtain the first soft label; the Softmax function formula is:

[0032] ;

[0033] in, For the The first soft label corresponding to the category, The model is The original output of the categories , is the temperature parameter that controls the smoothness of the probability distribution.

[0034] The data enhancement and standardization processing of the pathological myopia medical data set is specifically as follows:

[0035] The AutoAugment algorithm is used to select the optimal combination among multiple enhancement strategies, and the optimal enhancement strategy corresponding to the pathological myopia medical data set is obtained;

[0036] Use the optimal enhancement strategy to enhance the data of pathological myopia medical dataset and obtain an enhanced dataset;

[0037] The fundus image in the enhanced data set is size-normalized and pixel-value-normalized to obtain the fundus image data set.

[0038] The AutoAugment algorithm is used to select the optimal combination among multiple enhancement strategies, and the optimal enhancement strategy corresponding to the pathological myopia medical data set is obtained, which is:

[0039] Using the reinforcement learning framework, the operation probability is enhanced in the following and amplitude Search for the optimal combination in parameter space:

[0040] ;

[0041] in, Indicates the selected enhancement operation, and are the probability and magnitude of the operation, respectively. Indicates the number of enhancement operations included in each combination;

[0042] Optimization objective function of the enhancement strategy It is expressed as:

[0043] ;

[0044] in, is the number of samples in the validation set, is the total number of categories, For the input image The result after applying the combination of enhancement strategies, For Model In the enhanced sample Upper pair The predicted probability of the class, is an indicator variable. The true category is Class time, ,otherwise ;

[0045] The step of searching for the optimal combination is iterated until the optimal enhancement strategy is obtained.

[0046] The second technical solution of the present invention is:

[0047] A myopia prediction system based on fundus images, applying the prediction method described in the above claims, comprising:

[0048] The model training module is used to obtain a medical dataset of pathological myopia, perform data enhancement and standardization on the medical dataset of pathological myopia, generate a fundus image dataset, and divide the fundus image dataset into a training set and a validation set; select a baseline model, perform structured pruning on the baseline model to obtain a pruned model; use the fundus image dataset to perform self-distillation training on the pruned model to generate a myopia prediction auxiliary model;

[0049] An acquisition module is used to acquire the fundus image to be detected and input the fundus image to be detected into the prediction module;

[0050] The prediction module is used to generate a myopia prediction result of the fundus image to be detected according to the myopia prediction auxiliary module.

[0051] The third technical solution of the present invention is:

[0052] An electronic device, comprising:

[0053] processor;

[0054] a memory for storing instructions executable by the processor;

[0055] The processor is configured to read the executable instructions from the memory and execute the instructions to implement the method described in the above claim.

[0056] Compared with the prior art, the present invention using the above technical solution has the following beneficial effects:

[0057] The present invention selects ResNet-50 with the best performance on the fundus image dataset as the baseline model, and uses structured pruning technology to prune the baseline model. The structured pruning technology involves randomly reinitializing the parameters of each layer, and evaluating the importance of each convolutional layer filter based on the performance degradation of the baseline model after reinitializing the parameters. After setting the performance loss threshold, the filters with less performance impact are pruned, thereby reducing the complexity and computing requirements of the model without significantly affecting the model performance, and significantly improving the processing speed; after pruning, the pruned model is further optimized using self-distillation training technology. In this process, the pruned model uses its own predicted output on the training data as new training labels. These outputs are used as soft labels, and the pruned model is retrained through the cross entropy loss function, which helps the pruned model to deeply understand the complex characteristics of pathological myopia; in order to prevent overfitting and ensure the optimal performance of the pruned model on unseen data, an early stopping strategy is introduced, that is, if the accuracy of the pruned model does not drop significantly in several consecutive verification cycles, the training is stopped. The myopia prediction auxiliary model trained by the above method can quickly and accurately identify and classify which type of pathological myopia the fundus image to be tested belongs to, reduce human errors, and provide more consistent diagnostic results. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] Figure 1 is a flow chart of a prediction method according to Embodiment 1 of the present invention;

[0059] Figure 2 is a schematic diagram of a fundus image according to the first embodiment of the present invention;

[0060] Figure 3 is a schematic diagram of the process of self-distillation training according to the first embodiment of the present invention;

[0061] Figure 4 is a generation roadmap of the myopia prediction auxiliary model of the first embodiment of the present invention; DETAILED DESCRIPTION

[0062] The present invention will be further described below in conjunction with embodiments, the purpose of which is only to provide a better understanding of the content of the present invention. Therefore, the examples given do not limit the protection scope of the present invention.

[0063] See attached Figure 1-4 Embodiment 1 of the present invention discloses a myopia prediction method based on fundus images, comprising:

[0064] Step 101: obtaining a pathological myopia medical dataset, performing data enhancement and standardization processing on the pathological myopia medical dataset, generating a fundus image dataset, and dividing the fundus image dataset into a training set and a validation set;

[0065] Step 102: Select the ResNet-50 model as the baseline model, perform structured pruning on the baseline model, and obtain a pruned model;

[0066] Step 103: Use the fundus image dataset to perform self-distillation training on the pruned model to generate a myopia prediction auxiliary model;

[0067] Step 104, obtaining a fundus image to be detected;

[0068] Step 105: input the fundus image to be detected into the myopia prediction auxiliary model to generate a myopia prediction result of the fundus image to be detected.

[0069] In this embodiment, the pathological myopia medical dataset in step 101 adopts the iChallenge-PM dataset; illustratively, the fundus images in the iChallenge-PM dataset ( Figure 2 PM in the fundus image) can be compared with the normal fundus image ( Figure 2 The Normal in the dataset provides richer details. After data enhancement and normalization of the iChallenge-PM dataset, a fundus image dataset can be obtained. The iChallenge-PM dataset contains 400 training set images and 400 validation set images.

[0070] Preferably, the data enhancement process of the pathological myopia medical dataset in step 101 is specifically as follows:

[0071] The AutoAugment algorithm is used to select the optimal combination from multiple enhancement strategies to obtain the optimal enhancement strategy corresponding to the pathological myopia medical data set; the pathological myopia medical data set is enhanced using the optimal enhancement strategy to obtain an enhanced data set; the fundus image in the enhanced data set is size-standardized and pixel-value-standardized to obtain the fundus image data set.

[0072] The AutoAugment algorithm is used to select the optimal combination among multiple enhancement strategies, and the optimal enhancement strategy corresponding to the pathological myopia medical data set is obtained.

[0073] Using the reinforcement learning framework, the operation probability is enhanced in the following and amplitude Search for the optimal combination in parameter space:

[0074] ;

[0075] The above formula represents the input A set of augmentation operations applied, where Represents the selected enhancement operation, which is part of each tuple. and are the probability and magnitude of the operation, respectively. Indicates the number of enhancement operations included in each combination;

[0076] Optimization objective function of the enhancement strategy It is expressed as:

[0077] ;

[0078] in, is the number of samples in the validation set, is the total number of categories, For the input image The result after applying the combination of enhancement strategies, For Model In the enhanced sample Upper pair The predicted probability of the class, is an indicator variable. The true category is Class time, ,otherwise ;

[0079] Iterating the step of searching for the optimal combination until the optimal enhancement strategy is obtained;

[0080] In step 101, the standardization process of the pathological myopia medical dataset is specifically as follows: the size and pixel value of the fundus images in the enhanced pathological myopia medical dataset are standardized. For example, the same size is applied to the images for standardization, and all are adjusted to 224*224. Then the scale value, mean, variance, and order of all images are normalized to obtain the fundus image dataset.

[0081] In this embodiment, the ResNet-50 model in step 102 is a deep residual network, mainly composed of multiple residual blocks, including an input part consisting of a convolutional layer and a maximum pooling layer, a middle part consisting of multiple residual blocks, and an output part consisting of a fully connected layer, wherein each residual block contains multiple convolutional layers.

[0082] In this embodiment, the specific steps of structured pruning in step 102 are:

[0083] The prediction results of the ResNet-50 model are used as the original prediction results, and the convolution kernels in each convolution layer of the ResNet-50 model are reinitialized by He:

[0084] ;

[0085] in, is the ResNet-50 model weight, is the number of neurons in the previous layer, and the model weights are from a mean of 0 and a variance of Extract from the normal distribution of; Output He reinitialized weights and reinitialized model;

[0086] The ResNet-50 model is forward propagated through the weights after He reinitialization, the accuracy of the reinitialized model is recorded, and the difference between the output of the reinitialized model and the output of the ResNet-50 model is calculated to obtain the performance loss ;

[0087] The specific performance loss formula is:

[0088] ;

[0089] In the formula, It indicates the accuracy of the model on the validation set after a certain layer of reinitialization, and is the accuracy of the original model; this difference measures the impact of reinitialization of each layer’s weights on model performance; sets the performance loss threshold ,Right now Figure 4 The accuracy threshold in , when the performance loss Less than the performance loss threshold When , it is considered that pruning this layer will not significantly affect the overall performance of the model, and the ResNet-50 model is pruned to obtain the initial pruned model;

[0090] Pruning ratio and performance loss threshold of the initial pruning model using the Osprey optimization algorithm Optimize the parameters and get the pruning model, specifically:

[0091] In the multi-objective optimization task, according to the different regional characteristics of the objective function, a hierarchical strategy is used to gradually converge to the optimal solution, generate the Pareto frontier, find multiple optimal solutions that do not dominate each other, and obtain the optimal pruning ratio and the optimal performance loss threshold; the ResNet-50 model is pruned by the optimal pruning ratio and the optimal performance loss threshold to obtain the pruned model.

[0092] Preferably, the fitness function of the Osprey optimization algorithm can be the root mean square error (RMSE) of the baseline model under different parameter combinations, and dynamically adjusted control parameters are used to determine the probability of using different hunting behaviors.

[0093] During the pruning process, cross entropy loss is used to measure the classification performance of the pruned model on the training data to ensure that the classification accuracy of the pruned model is maintained at a high level as much as possible while gradually reducing the model parameters. By monitoring the accuracy of the pruned model on the validation set, we can evaluate the impact of pruning on model performance and dynamically adjust the pruning strategy to reduce the negative impact of pruning on accuracy. The specific settings are as follows:

[0094] ;

[0095] in, is the indicator variable of the true label, is the predicted probability output by the pruned model, is the number of categories.

[0096] In this embodiment, the self-distillation training step in step 103 includes:

[0097] 1. Generate soft labels: The pruning model performs forward propagation on the training data of the training set, outputs the predicted probability of each category, performs temperature adjustment on the predicted probability, and generates the first soft label corresponding to the training set;

[0098] ;

[0099] In the formula, For the pruning model The original output of the categories , For the pruning model The original output of the categories , For all categories The index and is the temperature parameter that controls the smoothness of the probability distribution.

[0100] 2. Loss function configuration:

[0101] (1) Distillation loss: The pruning model performs forward propagation on the training data of the training set again, and uses the same batch of training data to generate new outputs. These outputs are used as the second soft labels corresponding to the training set. The distillation loss is calculated based on the difference between the second soft label and the first soft label. The distillation loss calculation formula is:

[0102] ;

[0103] In the formula, For a given temperature The current output probability of the pruned model is , is the result obtained after softmax conversion. Here is the first soft label obtained by calculation.

[0104] (2) Classification loss: The cross entropy loss function is used to calculate the classification loss between the prediction result of the pruned model and the true label (original hard label); the cross entropy loss function formula is:

[0105] ;

[0106] in, is the actual class label.

[0107] (3) Total loss function: The distillation loss and classification loss are combined through weighting factors to generate the total loss function;

[0108] ;

[0109] in, is the distillation loss weight, set to 0.5, is the temperature parameter, set to 2. The factor is used to appropriately scale the distillation loss, ensuring that the gradient contributed by the distillation loss remains balanced relative to the gradient of the classification loss.

[0110] 3. Set the self-distillation parameters:

[0111] (1) Temperature parameters Set to 2 to adjust the smoothness of soft labels, helping the pruning model learn more subtle information from these probabilities;

[0112] (2) Distillation loss weight Set to 0.5, this weight determines the proportion of distillation loss in the total loss function to ensure that the pruned model can balance the distillation loss and the original classification loss when learning its own output.

[0113] 4. Pruning model training configuration:

[0114] The learning rate is set to 0.001, which is a relatively mild learning rate suitable for making subtle adjustments during the self-distillation process to ensure that the pruned model can effectively learn from its own output.

[0115] The Adam optimizer is selected as the optimizer. The Adam optimizer is widely used because of its adaptive learning rate adjustment mechanism, which is particularly suitable for dealing with unstable gradient problems that may occur in the self-distillation process.

[0116] 5. Training monitoring and early stopping strategy: During the self-distillation training process, the performance of the pruned model on the validation set is continuously monitored, and an early stopping strategy is implemented to prevent overfitting. When the accuracy of the pruned model validation set improves to less than or equal to the preset accuracy value within 5 consecutive training cycles, training is stopped. Specifically, the preset accuracy value is set to 1%.

[0117] The Osprey Optimization Algorithm is used to optimize the parameters of temperature, training cycle and accuracy preset values ​​to obtain a trained myopia prediction auxiliary model. In the field of deep learning, the Osprey Optimization Algorithm (OOA) can be used to optimize the weights and biases of neural networks. By considering the training process of neural networks as an optimization problem, the Osprey Optimization Algorithm can help find the optimal parameter settings and improve the performance of neural networks.

[0118] Embodiment 2 of the present invention discloses a myopia prediction system based on fundus images, applying the prediction method described in the above claims, including:

[0119] The model training module is used to obtain a medical dataset of pathological myopia, perform data enhancement and standardization on the medical dataset of pathological myopia, generate a fundus image dataset, and divide the fundus image dataset into a training set and a validation set; select a baseline model, perform structured pruning on the baseline model to obtain a pruned model; use the fundus image dataset to perform self-distillation training on the pruned model to generate a myopia prediction auxiliary model;

[0120] An acquisition module is used to acquire the fundus image to be detected and input the fundus image to be detected into the prediction module;

[0121] The prediction module is used to generate a myopia prediction result of the fundus image to be detected according to the myopia prediction auxiliary module.

[0122] Embodiment 3 of the present invention discloses an electronic device, including:

[0123] processor;

[0124] a memory for storing instructions executable by the processor;

[0125] The processor is configured to read the executable instructions from the memory and execute the instructions to implement the method described in the above claim.

[0126] The present invention compares the performance of three deep learning models, VGGNet, GoogLeNet and ResNet-50, on the iChallenge-PM fundus image dataset, selects the ResNet-50 model with the best performance as the baseline model according to key indicators such as accuracy and loss, and prunes the baseline model using the SR-init structured pruning (layer pruning) technology. The structured pruning technology involves randomly reinitializing the parameters of each layer, and evaluates the importance of each convolutional layer filter based on the performance degradation of the baseline model after reinitialization by comparing the output differences of the model before and after reinitialization, and decides whether to retain these filters based on the set performance loss threshold, so as to avoid Under the premise of significantly affecting the performance of the pruned model, the complexity and computational requirements of the model are reduced, and the processing speed is significantly improved; after pruning, the pruned model is further optimized using self-distillation training technology. In this process, the pruned model uses its own predicted output on the training data as a new training label. These outputs are used as soft labels to retrain the pruned model through the cross entropy loss function, which helps the pruned model to deeply understand the complex characteristics of pathological myopia; to prevent overfitting and ensure the optimal performance of the pruned model on unseen data, an early stopping strategy is introduced, that is, if the accuracy of the pruned model does not drop significantly in several consecutive verification cycles, the training is stopped; the model trained by self-distillation is evaluated on an independent test set to verify its improved diagnostic accuracy and generalization ability. The implementation of this model will significantly improve the efficiency of automatic diagnosis of pathological myopia and reduce the misdiagnosis rate. It is suitable for resource-constrained medical environments and is of great significance to promoting the intelligence and automation of the medical industry. The myopia prediction auxiliary model trained by the above method can quickly and accurately identify and classify which pathological myopia the fundus image to be tested belongs to, reduce human errors, and provide more consistent diagnostic results.

[0127] The above description is only a preferred feasible embodiment of the present invention, and does not limit the scope of rights of the present invention. All equivalent changes made using the contents of the present specification and its drawings are included in the scope of rights of the present invention.

Claims

1. A myopia prediction method based on fundus images, characterized in that: include: Obtain a pathological myopia medical dataset, perform data enhancement and standardization on the pathological myopia medical dataset, generate a fundus image dataset, and divide the fundus image dataset into a training set and a validation set; Select a baseline model, perform structured pruning on the baseline model, and obtain a pruned model; The pruned model was trained by self-distillation using the fundus image dataset to generate a myopia prediction auxiliary model. Acquire a fundus image to be detected; The fundus image to be detected is input into the myopia prediction auxiliary model to generate a myopia prediction result of the fundus image to be detected.

2. The myopia prediction method based on fundus images according to claim 1, characterized in that: The selected baseline model is subjected to structured pruning to obtain a pruned model, specifically: The baseline model uses the ResNet-50 model, takes the prediction results of the ResNet-50 model as the original prediction results, performs He reinitialization on the convolution kernels in each convolution layer of the ResNet-50 model, and outputs the weights and reinitialized model after He reinitialization; The ResNet-50 model is forward propagated through the weights reinitialized by He, the accuracy of the reinitialized model is recorded, and the difference between the output of the reinitialized model and the output of the ResNet-50 model is calculated to obtain the performance loss; Set a performance loss threshold. When the performance loss is less than the performance loss threshold, prune the ResNet-50 model to obtain an initial pruned model. The Osprey optimization algorithm is used to optimize the pruning ratio and performance loss threshold of the initial pruning model to obtain the pruning model.

3. The myopia prediction method based on fundus images according to claim 2, characterized in that: The convolution kernels in each convolution layer of the ResNet-50 model are reinitialized by He, and the formula is: ; in, is the ResNet-50 model weight, is the number of neurons in the previous layer, and the model weights are from a mean of 0 and a variance of are drawn from a normal distribution.

4. The myopia prediction method based on fundus images according to claim 2, characterized in that: The Osprey optimization algorithm is used to optimize the parameters of the pruning ratio and performance loss threshold of the initial pruning model to obtain a pruning model, which is specifically: In multi-objective optimization tasks, according to the characteristics of different regions of the objective function, a hierarchical strategy is used to gradually converge to the optimal solution, generate the Pareto frontier, find multiple optimal solutions that do not dominate each other, and obtain the optimal pruning ratio and the optimal performance loss threshold; The ResNet-50 model is pruned by the optimal pruning ratio and the optimal performance loss threshold to obtain the pruned model.

5. The myopia prediction method based on fundus images according to claim 1, characterized in that: The method uses the fundus image dataset to perform self-distillation training on the pruning model to generate a myopia prediction auxiliary model, specifically: The pruning model performs forward propagation on the training data of the training set, outputs the predicted probability of each category, performs temperature adjustment on the predicted probability, and generates the first soft label corresponding to the training set; The pruning model forward propagates the training data of the training set again to generate the second soft label corresponding to the training set; Calculate the distillation loss based on the difference between the second soft label and the first soft label; calculate the classification loss between the prediction result and the true label using the cross entropy loss function; combine the distillation loss and the classification loss through a weighting factor to generate a total loss function; When the improvement of the accuracy of the validation set of the pruning model is less than or equal to the preset accuracy value in a continuous training cycle, the training is stopped, and the Osprey optimization algorithm is used to optimize the parameters of the temperature, training cycle and preset accuracy value to generate a myopia prediction auxiliary model.

6. The myopia prediction method based on fundus images according to claim 1, characterized in that: The temperature adjustment of the predicted probability to generate the first soft label corresponding to the training set is specifically: Temperature adjustment is performed on the predicted probability of each category, and the predicted probability is divided by the temperature parameter , input the Softmax function to obtain the first soft label; The Softmax function formula is: ; in, For the The first soft label corresponding to the category, The model is The original output of the categories , is the temperature parameter that controls the smoothness of the probability distribution.

7. The myopia prediction method based on fundus images according to claim 1, characterized in that: The data enhancement and standardization processing of the pathological myopia medical data set is specifically as follows: The AutoAugment algorithm is used to select the optimal combination among multiple enhancement strategies, and the optimal enhancement strategy corresponding to the pathological myopia medical data set is obtained; Use the optimal enhancement strategy to enhance the data of pathological myopia medical dataset and obtain an enhanced dataset; The fundus image in the enhanced data set is size-normalized and pixel-value-normalized to obtain the fundus image data set.

8. The myopia prediction method based on fundus images according to claim 1, characterized in that: The AutoAugment algorithm is used to select the optimal combination among multiple enhancement strategies, and the optimal enhancement strategy corresponding to the pathological myopia medical data set is obtained, which is: Using the reinforcement learning framework, the operation probability is enhanced in the following and amplitude Search for the optimal combination in parameter space: ; in, Indicates the selected enhancement operation, and are the probability and magnitude of the operation, respectively. Indicates the number of enhancement operations included in each combination; Optimization objective function of the enhancement strategy It is expressed as: ; in, is the number of samples in the validation set, is the total number of categories, For the input image The result after applying the combination of enhancement strategies, For Model In the enhanced sample Upper pair The predicted probability of the class, is an indicator variable. The true category is Class time, ,otherwise ; The step of searching for the optimal combination is iterated until the optimal enhancement strategy is obtained.

9. A myopia prediction system based on fundus images, using the prediction method according to any one of claims 1 to 8, characterized in that: include: The model training module is used to obtain a medical dataset of pathological myopia, perform data enhancement and standardization on the medical dataset of pathological myopia, generate a fundus image dataset, and divide the fundus image dataset into a training set and a validation set; select a baseline model, perform structured pruning on the baseline model to obtain a pruned model; use the fundus image dataset to perform self-distillation training on the pruned model to generate a myopia prediction auxiliary model; An acquisition module is used to acquire the fundus image to be detected and input the fundus image to be detected into the prediction module; The prediction module is used to generate a myopia prediction result of the fundus image to be detected according to the myopia prediction auxiliary module.

10. An electronic device comprising: processor; a memory for storing instructions executable by the processor; The processor is used to read the executable instructions from the memory and execute the instructions to implement the method described in any one of claims 1 to 8.

Citation Information

Patent Citations

  • Pathological myopia recognition method based on data enhancement and model fusion

    CN112580580A

  • Model compression method and device, data processing method and device, storage medium and chip

    CN116644781A

  • SAR (Synthetic Aperture Radar) image multi-type target detection lightweight method and SAR image multi-type target detection lightweight device based on combination of channel pruning and knowledge distillation

    CN116992940A

  • Wind power cluster control method and system based on improved eagle search algorithm

    CN118100321A

  • Performance perception-based decayed tooth detection method combining global channel pruning and YOLOv5

    CN118351114A