Eye fundus image segmentation method based on uncertainty and shallow feature enhanced attention network
By using uncertainty and superficial features to enhance attention networks in fundus image segmentation, the problems of vascular details, crossover, low contrast and imbalance are solved, segmentation accuracy and robustness are improved, and more accurate retinal vascular segmentation is achieved. .
Patent Information
- Application Number
- CN202411260161.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-10
- Publication Date
- 2024-12-31
- Estimated Expiration
- 2044-09-10
AI Technical Summary
The prior art problems such as difficulty in segmenting vascular details, cross-and overlap of blood vessels, low contrast, and imbalance of foreground and background in fundus images lead to unstable segmentation performance, especially in pathological conditions, which is difficult to achieve accurate segmentation.
Using the method of enhancing attention network based on uncertainty and shallow features, pay attention to segmentation details through the attention module, enhance shallow features by combining deep feature information, use uncertainty modeling module to reduce adverse effects, and build a neural network model for eye bottom Image segmentation.
It improves the accuracy of retinal vascular segmentation, enhances the expression of vascular detail characteristics, reduces the impact of uncertainty, and achieves a more robust segmentation result.
Smart Images

Figure CN119228812A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of image processing technology, and in particular to a fundus image segmentation method based on uncertainty and shallow feature enhanced attention network. Background Art
[0002] The number of patients suffering from blinding eye diseases such as glaucoma, diabetic retinopathy (DR) and age-related macular degeneration (AMD) is large, affecting more than 418 million people worldwide. The early development of these eye diseases is usually unnoticeable to patients, and clinical early screening is achieved by detecting retinal structures in the fundus of patients, as they are highly correlated with changes in retinal morphology. Previously, this work was done manually by experienced experts, but annotating large datasets is time-consuming and expensive. In addition, there are few experts who can complete this work independently, making it a challenging task. Therefore, it is still necessary to develop an efficient and automatic retinal vessel segmentation method.
[0003] In recent years, deep learning has revolutionized the field of medical image analysis, and has performed well in various tasks such as image segmentation, classification, and detection. Convolutional neural networks (CNNs) are particularly good at learning hierarchical features directly from raw image data, automatically extracting complex patterns and structures without hand-crafted features. A variety of deep learning-based methods have been proposed for vessel segmentation in fundus images, which use different network architectures and training strategies to improve segmentation accuracy. These methods usually involve fully convolutional networks (FCNs), U-Net architectures, and more recently, attention mechanisms and multi-scale feature integration to capture global context and detail information. Despite significant progress, challenges such as variability in vessel thickness, low contrast between vessels and background, and the presence of pathological areas still pose obstacles to achieving robust segmentation performance.
[0004] In the study of fundus vessel segmentation, many research problems still exist. For example, (1) Vascular details: The vascular structure in fundus images is complex, including the main trunk and numerous small branches. The segmentation of small branches is particularly difficult because they may be almost invisible in low-resolution images. (2) Vascular crossing and overlap: The blood vessels may cross or overlap in the image, which makes it difficult for the segmentation algorithm to distinguish the boundaries of different blood vessels. (3) Low contrast: The contrast between blood vessels and the background in fundus images is usually low, especially under pathological conditions, which increases the difficulty of segmentation. (4) Foreground-background imbalance: The area occupied by blood vessels in the image is usually very small, and the number of pixels in the foreground (blood vessels) is seriously insufficient compared to the background. This class imbalance will affect the training effect of the segmentation algorithm. In addition, certain diseases (such as diabetic retinopathy) can cause abnormal spots or hemorrhages in fundus images. These lesions may interfere with the normal operation of the vascular segmentation algorithm. Summary of the invention
[0005] In view of the defects existing in the prior art, the present invention provides a fundus image segmentation method based on uncertainty and shallow feature enhanced attention network, which reduces the adverse effects of uncertainty by modeling uncertainty and combining it with deep learning methods; it also uses an attention module to focus on segmentation details, and at the same time uses deep feature information to enhance shallow feature information to improve the final segmentation effect.
[0006] In order to achieve the above technical objectives, the technical solution adopted by the present invention is:
[0007] A fundus image segmentation method based on uncertainty and shallow feature enhanced attention network includes the following steps:
[0008] Step 1): Select fundus retinal image data as a training set and a test set, each fundus retinal image sample includes an original color fundus retinal image and a corresponding blood vessel segmentation label;
[0009] Step 2): preprocessing the fundus retinal images in the training set;
[0010] Step 3): Build a neural network model on Pytorch;
[0011] Step 4): Use the trained neural network model to segment the test set and obtain the final segmentation result.
[0012] As a possible implementation, further, step 2) specifically includes the following steps:
[0013] Each fundus retinal image was grayscaled and normalized, and then the overall contrast was adjusted using contrast-limited adaptive histogram equalization (CLAHE) and gamma correction with a gamma value set to 1.5;
[0014] Each fundus retinal image and the corresponding retinal vessel segmentation labels are divided into smaller blocks or sub-images.
[0015] As a possible implementation, each fundus retinal image and the corresponding retinal blood vessel segmentation label are further divided into smaller blocks or sub-images, specifically:
[0016] The training set image data is randomly cropped into 100,000 images with a width and height of 48*48.
[0017] As a possible implementation, further, step 3) specifically includes the following steps:
[0018] Step 3.1): Input the original image into the network and obtain the features through a convolution, BN, and ReLU operation. Figure 1 , and then undergo three consecutive downsampling and convolution, BN, and ReLU operations to obtain feature maps 2, 3, and 4, a total of four feature maps;
[0019] Step 3.2): The features Figure 1 ~3 Input the attention module to obtain the attention feature maps a1, a2, a3;
[0020] Step 3.3): Input the attention feature map a3 and feature map 4 into the shallow feature enhancement module, and output feature map A3; input feature map A3 and attention feature map a2 into the shallow feature enhancement module, and output feature map A2; input feature map A2 and attention feature map a1 into the shallow feature enhancement module, and output feature map A1;
[0021] Step 3.4): After upsampling feature map 4, it is spliced with feature map A3 on the channel, and then subjected to convolution, BN, and ReLU operations to obtain feature map U3; after upsampling feature map U3, it is spliced with feature map A2 on the channel, and then subjected to convolution, BN, and ReLU operations to obtain feature map U2; after upsampling feature map U2, it is spliced with feature map A1 on the channel, and then subjected to convolution, BN, and ReLU operations to obtain feature map U1;
[0022] Step 3.5): Perform upsampling and convolution operations on feature maps U2 and U3 by 2 and 4 times respectively to make their shapes the same as feature map U1, then concatenate feature maps U1, U2, and U3 on the channel to obtain feature map C, input feature map C into the attention module to obtain feature map C1, and finally perform residual addition operation on feature map C and feature map C1 to obtain the coarse segmentation map Seg;
[0023] Step 3.6): Perform uncertainty modeling on the coarse segmentation map Seg to obtain the evidence feature map E and the uncertainty feature map F. Generate a reliable mask M through the coarse segmentation image Seg, the evidence feature map E and the uncertainty feature map F. Finally, concatenate M and the coarse segmentation map Seg on the channel and perform a 1×1 convolution to output the final refined segmentation result.
[0024] As a possible implementation, further, the attention module is composed of a channel attention module and a spatial attention module;
[0025] The channel attention module is used to pass the input feature map through two parallel MaxPool layers and AvgPool layers, change the feature map from C×H×W to C×1×1, and then process it through the Share MLP module; wherein the Share MLP module is used to compress the number of channels to 1 / r (Reduction, reduction rate) times the original number of channels, and then expand it to the original number of channels, and obtain two activated results through the ReLU activation function;
[0026] Next, add these two output results element by element, and then use a sigmoid activation function to get the output of Channel Attention, and then multiply this output result by the original image to return to the size of C×H×W;
[0027] The spatial attention module is used to obtain two 1×H×W feature maps by performing maximum pooling and average pooling operations on the output results of the channel attention module, and then splicing the two feature maps through a Concat operation, and then obtaining four feature maps through four dilated convolutions with different dilation rates, and then splicing the four feature maps through a Concat operation, and then obtaining a feature map of spatial attention through a sigmoid operation, and finally multiplying the output result by the original image to return to the size of C×H×W.
[0028] As a possible implementation mode, further, the shallow feature enhancement module is used to perform a Concat operation on the shallow features and the deep features after convolution and BN, and then input the concatenated feature maps into the MaxPool and AvgPool branches respectively to obtain two feature maps, which are then concat-concatenated and then subjected to convolution and sigmoid to obtain the weights after the fusion of the deep and shallow features, and then perform pixel-by-pixel multiplication with the shallow features to obtain the feature map, and perform pixel-by-pixel addition on the shallow feature image to finally obtain the enhanced feature map.
[0029] As a possible implementation, further, the uncertainty modeling in step 3.6) includes the following steps:
[0030] S1: Obtain evidence feature E = [e1, ..., e K ], by applying the Softplus activation function to ensure that the eigenvalue is greater than 0, the formula is:
[0031] E=SOftplus(Seg)
[0032] S2: Parameterize E as a Dirichlet distribution, the formula is:
[0033]
[0034] Among them, α k and e k are the k-th Dirichlet distribution parameter and evidence, (h,w)∈(H,W) and H and W are the width and height of the coarse segmentation graph Seg, respectively;
[0035] S3: Calculate the confidence quality and the corresponding uncertainty score, the formula is:
[0036]
[0037] in u (h,w) Respectively represent the probability and overall uncertainty of the corresponding class at each pixel coordinate; represents the Dirichlet intensity, K represents the total number of pixel classes;
[0038] F={u (h,w) ,(h,w)∈(H,W)} is expressed as the uncertainty of each pixel in the segmentation feature map.
[0039] As a possible implementation, further, in step 3.6), a reliable mask M is generated by using the coarse segmentation image Seg, the evidence feature map E, and the uncertainty feature map F, as follows:
[0040] After adding the coarse segmentation map Seg and the evidence feature map E, they are mapped to e with the uncertainty feature map F -F Feature map F on the function w Multiplying together yields a reliable mask M.
[0041] As a possible implementation, further, step 4) specifically includes the following steps:
[0042] The preprocessed and amplified image is sent to the neural network constructed in step 3) for network training, and the loss between the network segmentation result and the manually annotated segmentation result is used to guide the network training. When the loss is reduced to meet the requirements or reaches a preset number of iterations, the network training is stopped to obtain the fundus vascular segmentation network model;
[0043] The fundus image to be segmented is directly sent into the trained fundus vascular segmentation network model to obtain the final fundus vascular segmentation result.
[0044] The present invention constructs an attention network based on uncertainty and shallow feature enhancement. On the basis of the fundus vascular segmentation network, it reduces the downsampling step by one and performs a total of three downsampling steps to reduce the depth of the model and improve the segmentation efficiency of the model.
[0045] Secondly, an attention module and a shallow feature enhancement module are added to the network to enhance the expression of shallow features, and an uncertainty modeling module is used before the final output of the network to reduce the adverse effects of uncertainty.
[0046] In the encoding part, the attention module and the shallow feature enhancement module are added to the feature maps of the first three layers before they are spliced with the upsampled feature maps; in the decoding part, the second and third layer feature maps obtained after upsampling are upsampled and convolved by 2 times and 4 times respectively, and then spliced with the first layer feature map and input into the attention module and uncertainty modeling module; the attention module enables the network to focus on the vascular area of the fundus image and improve the segmentation accuracy of the network. The shallow feature enhancement module can use the deep feature map to enable the shallow feature map to obtain deep features without losing the details of the shallow features; the uncertainty modeling method can model the uncertainty of the image and combine the deep learning method to reduce the high uncertainty to obtain a more refined segmented image.
[0047] By adopting the above technical solution, the present invention has the following beneficial effects compared with the prior art:
[0048] The present invention provides a novel retinal fundus image segmentation method for automatically segmenting retinal blood vessels from fundus images, and reduces the uncertainty of the final output of the model by enhancing shallow feature expression through attention mechanism and deep feature enhancement, as well as uncertainty modeling combined with deep learning, thereby improving the accuracy of retinal blood vessel segmentation. BRIEF DESCRIPTION OF THE DRAWINGS
[0049] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0050] Figure 1 The figure is a simplified flow chart of the method of the present invention. DETAILED DESCRIPTION
[0051] The present invention will be further described in detail below in conjunction with the accompanying drawings and examples. It is particularly noted that the following examples are only used to illustrate the present invention, but are not intended to limit the scope of the present invention. Similarly, the following examples are only partial embodiments of the present invention rather than all embodiments, and all other embodiments obtained by those of ordinary skill in the art without creative work are within the scope of protection of the present invention.
[0052] Refer to the attached Figure 1 As shown, this embodiment provides a fundus image segmentation method based on uncertainty and shallow feature enhanced attention network, which specifically includes the following steps:
[0053] Step 1): Select fundus retinal image data as training set and test set, each fundus retinal image sample includes the original color fundus retinal image and the corresponding vascular segmentation label. In this embodiment, three public data sets DRIVE, CHASEDB1, and STARE are used. DRIVE uses 20 pictures as training set and 20 pictures as test set; CHASEDB1 uses 21 pictures as training set and 7 pictures as test set; STARE uses 15 pictures as training set and 5 pictures as test set.
[0054] Step 2): Preprocess the fundus retinal images in the training set for input into the neural network model. In this embodiment, the preprocessing step includes: graying and normalizing each fundus retinal image, and then using contrast limited adaptive histogram equalization (CLAHE) and gamma correction with a gamma value set to 1.5 to adjust the overall contrast; each fundus retinal image and the corresponding retinal vascular segmentation label are divided into smaller blocks or sub-images, specifically: randomly crop the training set image data into 100,000 images with a width and height of 48*48.
[0055] Step 3): Build a neural network model on Pytorch, which includes the following steps:
[0056] Step 3.1): Input the original image into the network and obtain the features through a convolution + BN + ReLU operation Figure 1 , and then undergo three consecutive downsampling and convolution + BN + ReLU operations to obtain feature maps 2, 3, and 4, a total of four feature maps;
[0057] Step 3.2): The features Figure 1 ~3 Input the attention module to obtain the attention feature maps a1, a2, a3;
[0058] Step 3.3): Input the attention feature map a3 and feature map 4 into the shallow feature enhancement module, and output feature map A3; input feature map A3 and attention feature map a2 into the shallow feature enhancement module, and output feature map A2; input feature map A2 and attention feature map a1 into the shallow feature enhancement module, and output feature map A1;
[0059] Step 3.4): After upsampling feature map 4, it is concatenated with feature map A3 on the channel, and then subjected to convolution + BN + ReLU operations to obtain feature map U3; after upsampling feature map U3, it is concatenated with feature map A2 on the channel, and then subjected to convolution + BN (Batch Normalization) + ReLU operations to obtain feature map U2; after upsampling feature map U2, it is concatenated with feature map A1 on the channel, and then subjected to convolution, BN, and ReLU operations to obtain feature map U1;
[0060] Step 3.5): Perform upsampling and convolution operations on feature maps U2 and U3 by 2 and 4 times respectively to make their shapes the same as feature map U1, then concatenate feature maps U1, U2, and U3 on the channel to obtain feature map C, input feature map C into the attention module to obtain feature map C1, and finally perform residual addition operation on feature map C and feature map C1 to obtain the coarse segmentation map Seg;
[0061] Step 3.6): Perform uncertainty modeling on the coarse segmentation map Seg to obtain the evidence feature map E and the uncertainty feature map F. Generate a reliable mask M through the coarse segmentation image Seg, the evidence feature map E and the uncertainty feature map F. Finally, concatenate M and the coarse segmentation map Seg on the channel and perform a 1×1 convolution to output the final refined segmentation result.
[0062] In this embodiment, the attention module consists of a channel attention module and a spatial attention module;
[0063] Among them, the channel attention module enables the network to encode the importance of the channel, obtain the weight values of different channels, and then focus the network's learning on important channels to improve the performance of network learning; it is used to pass the input feature map through two parallel MaxPool layers and AvgPool layers, and change the feature map from C×H×W to C×1×1; then pass through the Share MLP module, in which it first compresses the number of channels to 1 / r (Reduction, reduction rate) times the original number of channels, and then expands to the original number of channels; then passes through the ReLU activation function to obtain two activated results. The two output results are added element by element, and then a sigmoid activation function is used to obtain the output result of Channel Attention, and then this output result is multiplied by the original image to return to the size of C×H×W.
[0064] The spatial attention module enables the network to encode the importance of spatial areas on the feature map, obtain weight values of different areas, and then focus the network's learning on important spatial areas to improve the performance of network learning; it is used to obtain two 1×H×W feature maps through maximum pooling and average pooling of the output results of the channel attention module, and then concatenate the two feature maps through the Concat operation, and then obtain four feature maps through four dilated convolutions with different dilation rates, and then concatenate the four feature maps through the Concat operation, and then obtain the feature map of spatial attention through a sigmoid, and finally multiply the output result by the original image to change it back to C×H×W size.
[0065] The shallow feature enhancement module can promote the fusion of deep features and guide the enhanced representation of shallow features. It is used to concatenate shallow features and deep features after convolution and BN, and then input the concatenated feature maps into the MaxPool and AvgPool branches to obtain two feature maps for concat operation. After convolution and sigmoid, the weights of deep and shallow feature fusion are obtained. The feature map obtained after pixel-by-pixel multiplication with the shallow features is added pixel-by-pixel to the shallow feature image to finally obtain the enhanced feature map.
[0066] In this embodiment, the uncertainty modeling in step 3.6) includes the following steps:
[0067] S1: Obtain evidence feature E = [e1, ..., e K ], by applying the Softplus activation function to ensure that the eigenvalue is greater than 0, the formula is:
[0068] E=Softplus(Seg)
[0069] S2: Parameterize E as a Dirichlet distribution, the formula is:
[0070]
[0071] Among them, α k and e k are the k-th Dirichlet distribution parameter and evidence, (h,w)∈(H,W) and H and W are the width and height of the coarse segmentation graph Seg, respectively;
[0072] S3: Calculate the confidence quality and the corresponding uncertainty score, the formula is:
[0073]
[0074] in u (h,w)Respectively represent the probability and overall uncertainty of the corresponding class at each pixel coordinate; represents the Dirichlet intensity, K represents the total number of pixel classes;
[0075] F={u (h,w) ,(h,w)∈(H,W)} is expressed as the uncertainty of each pixel in the segmentation feature map.
[0076] In this embodiment, in step 3.6), a reliable mask M is generated by using the coarse segmentation image Seg, the evidence feature map E, and the uncertainty feature map F, as follows:
[0077] After adding the coarse segmentation map Seg and the evidence feature map E, they are mapped to e with the uncertainty feature map F -F Feature map F on the function w Multiplying together yields a reliable mask M.
[0078] Step 4): Use the trained neural network model to segment the test set to obtain the final segmentation result; specifically, the following steps are included:
[0079] The preprocessed and amplified image is sent to the neural network constructed in step 3) for network training, and the loss between the network segmentation result and the manually labeled segmentation result (vessel segmentation truth map) is used to guide the network training. When the loss is reduced to meet the requirements or reaches the preset number of iterations, the network training is stopped to obtain the fundus vascular segmentation network model;
[0080] The fundus image to be segmented is directly sent into the trained fundus vascular segmentation network model to obtain the final fundus vascular segmentation result.
[0081] The above descriptions are only some embodiments of the present invention, and are not intended to limit the protection scope of the present invention. Any equivalent device or equivalent process transformation made using the contents of the present invention specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present invention.
Claims
1. A fundus image segmentation method based on uncertainty and shallow feature enhanced attention network, characterized in that: The steps include: Step 1): Select fundus retinal image data as a training set and a test set, each fundus retinal image sample includes an original color fundus retinal image and a corresponding blood vessel segmentation label; Step 2): preprocessing the fundus retinal images in the training set; Step 3): Build a neural network model on Pytorch; Step 4): Use the trained neural network model to segment the test set and obtain the final segmentation result.
2. The method for fundus image segmentation based on uncertainty and shallow feature enhanced attention network according to claim 1, characterized in that: Step 2) specifically includes the following steps: Each fundus retinal image was grayscaled and normalized, and then gamma correction was used with CLAHE and a gamma value set to 1.5 to adjust the overall contrast; Each fundus retinal image and the corresponding retinal vessel segmentation labels are divided into smaller blocks or sub-images.
3. The method for fundus image segmentation based on uncertainty and shallow feature enhanced attention network according to claim 2, characterized in that: Each fundus retinal image and the corresponding retinal vascular segmentation label are divided into smaller blocks or sub-images, specifically: The training set image data is randomly cropped into 100,000 images with a width and height of 48*48.
4. The method for fundus image segmentation based on uncertainty and shallow feature enhanced attention network according to claim 1, characterized in that: Step 3) specifically includes the following steps: Step 3.1): Input the original image into the network and perform one convolution, BN, and ReLU operation to obtain feature map 1. Then perform three consecutive downsampling and convolution, BN, and ReLU operations to obtain feature maps 2, 3, and 4, a total of four feature maps; Step 3.2): Input feature maps 1 to 3 into the attention module to obtain attention feature maps a1, a2, and a3; Step 3.3): Input the attention feature map a3 and feature map 4 into the shallow feature enhancement module, and output feature map A3; input feature map A3 and attention feature map a2 into the shallow feature enhancement module, and output feature map A2; input feature map A2 and attention feature map a1 into the shallow feature enhancement module, and output feature map A1; Step 3.4): After upsampling feature map 4, it is spliced with feature map A3 on the channel, and then subjected to convolution, BN, and ReLU operations to obtain feature map U3; after upsampling feature map U3, it is spliced with feature map A2 on the channel, and then subjected to convolution, BN, and ReLU operations to obtain feature map U2; after upsampling feature map U2, it is spliced with feature map A1 on the channel, and then subjected to convolution, BN, and ReLU operations to obtain feature map U1; Step 3.5): Perform upsampling and convolution operations on feature maps U2 and U3 by 2 and 4 times respectively to make their shapes the same as feature map U1, then concatenate feature maps U1, U2, and U3 on the channel to obtain feature map C, input feature map C into the attention module to obtain feature map C1, and finally perform residual addition operation on feature map C and feature map C1 to obtain the coarse segmentation map Seg; Step 3.6): Perform uncertainty modeling on the coarse segmentation map Seg to obtain the evidence feature map E and the uncertainty feature map F. Generate a reliable mask M through the coarse segmentation image Seg, the evidence feature map E and the uncertainty feature map F. Finally, concatenate M and the coarse segmentation map Seg on the channel and perform a 1×1 convolution to output the final refined segmentation result.
5. The method for fundus image segmentation based on uncertainty and shallow feature enhanced attention network according to claim 4, characterized in that: The attention module consists of a channel attention module and a spatial attention module; The channel attention module is used to pass the input feature map through two parallel MaxPool layers and AvgPool layers, change the feature map from C×H×W to C×1×1, and then process it through the Share MLP module; wherein the Share MLP module is used to compress the number of channels to 1 / r (Reduction, reduction rate) times the original number of channels, and then expand it to the original number of channels, and obtain two activated results through the ReLU activation function; Next, add these two output results element by element, and then use a sigmoid activation function to get the output of ChannelAttention, and then multiply this output result by the original image to return to the size of C×H×W; The spatial attention module is used to obtain two 1×H×W feature maps by performing maximum pooling and average pooling operations on the output results of the channel attention module, and then splicing the two feature maps through a Concat operation, and then obtaining four feature maps through four dilated convolutions with different dilation rates, and then splicing the four feature maps through a Concat operation, and then obtaining a feature map of spatial attention through a sigmoid operation, and finally multiplying the output result by the original image to return to the size of C×H×W.
6. The method for fundus image segmentation based on uncertainty and shallow feature enhanced attention network according to claim 4, characterized in that: The shallow feature enhancement module is used to perform a Concat operation on the shallow features and deep features after convolution and BN, and then input the spliced feature maps into the MaxPool and AvgPool branches to obtain two feature maps, which are then concat-joined and then subjected to convolution and sigmoid to obtain the weights after the fusion of the deep and shallow features, and then perform pixel-by-pixel multiplication with the shallow features to obtain the feature map and perform pixel-by-pixel addition with the shallow feature image to finally obtain the enhanced feature map.
7. The method for fundus image segmentation based on uncertainty and shallow feature enhanced attention network according to claim 4, characterized in that: Uncertainty modeling in step 3.6) includes the following steps: S1: Obtain evidence feature E = [e1, ..., e K ], by applying the Softplus activation function to ensure that the eigenvalue is greater than O, the formula is: E=Softplus(Seg) S2: Parameterize E as a Dirichlet distribution, the formula is: Among them, α k and e k are the k-th Dirichlet distribution parameter and evidence, (h, w)∈(H, W), and H and W are the width and height of the coarse segmentation graph Seg, respectively; S3: Calculate the confidence quality and the corresponding uncertainty score, the formula is: in u(h, w) represents the probability and overall uncertainty of the corresponding class at each pixel coordinate; represents the Dirichlet intensity, K represents the total number of pixel classes; F={u (h,w) , (h, w)∈(H, W)} is expressed as the uncertainty of each pixel in the segmentation feature map.
8. The method for fundus image segmentation based on uncertainty and shallow feature enhanced attention network according to claim 4, characterized in that: In step 3.6), a reliable mask M is generated by the coarse segmentation image Seg, the evidence feature map E and the uncertainty feature map F, as follows: After adding the coarse segmentation map Seg and the evidence feature map E, they are mapped to e with the uncertainty feature map F -F Feature map F on the function w Multiplying together yields a reliable mask M.
9. The method for fundus image segmentation based on uncertainty and shallow feature enhanced attention network according to claim 4, characterized in that: Step 4) specifically includes the following steps: The preprocessed and amplified image is sent to the neural network constructed in step 3) for network training, and the loss between the network segmentation result and the manually annotated segmentation result is used to guide the network training. When the loss is reduced to meet the requirements or reaches a preset number of iterations, the network training is stopped to obtain the fundus vascular segmentation network model; The fundus image to be segmented is directly sent into the trained fundus vascular segmentation network model to obtain the final fundus vascular segmentation result.
Citation Information
Patent Citations
Liver ablation curative effect evaluation method based on two-stage similar radiography generative adversarial network
CN116777885A
Image invisible area completion method based on non-modal instance segmentation
CN117115445A
Rough set-based neural network method for segmenting fundus retinal vascular image
WO2021253939A1
A computer-implemented method of determining if a fundus image requires referral for investigation for a disease
WO2024018177A1
Cited By
Eye fundus image reflection repairing and complementing method and related device
CN120765512A
