Eye fundus image classification method and device based on multi-task curriculum type learning, equipment and medium

A fundus image and classification method technology, applied in neural learning methods, image analysis, image enhancement, etc., can solve problems such as unbalanced distribution, lack of interpretability, difficulty in overcoming training samples, etc., to increase the range of receptive fields and enhance features Encoding ability, effect of improving accuracy

Pending Publication Date: 2021-11-05
CENT SOUTH UNIV
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The present invention provides a glaucoma diagnosis method, device, equipment and method based on multi-task course-style learning, which can solve the problem that the existing glaucoma screening methods are difficult to overcome the unbalanced distribution of training samples, the inability to accurately identify difficult samples, and the lack of unbiased screening. question of certain interpretability

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Eye fundus image classification method and device based on multi-task curriculum type learning, equipment and medium
  • Eye fundus image classification method and device based on multi-task curriculum type learning, equipment and medium
  • Eye fundus image classification method and device based on multi-task curriculum type learning, equipment and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0066] Embodiment 1 provides a fundus image classification method based on multi-task curriculum learning, such as figure 1 shown, proceed as follows:

[0067] Step A, design a teacher network based on the self-attention mechanism; take the fundus image sample as input and the glaucoma classification label as output, and supervise the training of the teacher network;

[0068] 1) Design a teacher network based on the self-attention mechanism

[0069] The structure of the teacher network is as follows figure 2As shown, it includes in turn: the ResNet-34 backbone structure with the fully connected layer removed, the convolutional layer, the GC self-attention mechanism module, the global average pooling layer, and the fully connected layer. In the ResNet-34 backbone structure with the fully connected layer removed, a set of feature maps after each pooling layer is named as the 1st to 5th set of feature maps in sequence, and the 2nd to 5th set of feature maps are reduced to Sam...

Embodiment 2

[0120] This embodiment provides a fundus image classification device based on multi-task curriculum learning, including: a teacher network module and a multi-task student network module; wherein,

[0121] The structure of the teacher network module is designed based on a self-attention mechanism, and the fundus image sample is used as an input, and the glaucoma classification label is used as an output to perform supervised training, and after the training is completed, it is used to generate a label evidence map corresponding to each fundus image sample;

[0122] The structure of the multi-task student network module includes an evidence map prediction branch and a glaucoma prediction branch; and the loss function for training the multi-task student network is designed according to the sample prior weighting coefficient θ and the sample feedback loss coefficient α of the fundus image sample Obtained; among them, the sample prior weighting coefficient θ is designed according to...

Embodiment 3

[0127] This embodiment provides an electronic device, including a memory and a processor, where a computer program is stored in the memory, and when the computer program is executed by the processor, the processor implements the method described in Embodiment 1.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an eye fundus image classification method and device based on multi-task curriculum type learning, equipment and a medium. The method comprises the following steps: training a teacher network through employing an eye fundus image sample, and then generating an evidence graph of the eye fundus image sample; designing a multi-task student network comprising two branches of evidence graph prediction and glaucoma prediction; designing a sample prior weighting coefficient and a sample feedback loss coefficient according to glaucoma classification labels and prediction results of the teacher network and the student network, and designing a loss function of the student network based on the two coefficients; taking the eye fundus image sample as input of the two prediction branches of the student network, taking the classification label as output of the glaucoma prediction branch, taking a label evidence graph as the output of the evidence graph prediction branch, and training the student network based on the loss function; and using the trained student network to generate the glaucoma classification label and the evidence graph of a to-be-classified eye fundus image. According to the invention, the classification accuracy is improved and the evidence graph of a classification decision is generated.

Description

technical field [0001] The invention belongs to the field of image information processing, and in particular relates to a glaucoma diagnosis method, device, equipment and method based on multi-task course learning. Background technique [0002] Glaucoma has become the second leading cause of blindness in the world, threatening the visual health of more than 65 million people. Glaucoma develops slowly and its symptoms are mild in the early stages, making it easy for patients to ignore the condition, which can cause irreversible damage to their vision. Therefore, early screening and treatment are crucial for the prevention and treatment of glaucoma. The common clinical diagnosis method of glaucoma is the optic nerve head (ONH) examination, which refers to the comprehensive analysis of the pathological phenomenon and physiological structure of glaucoma in fundus images by ophthalmologists. The main pathological changes are neural retinal edge erosion, optic cup dilation, reti...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06N3/08G06T7/00
CPCG06N3/08G06T7/0012G06T2207/30041G06T2207/20081G06F18/214G06F18/241
Inventor 郭璠李伟清申子奇杨佳男刘卓群王志远
Owner CENT SOUTH UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap