Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

An automatic medical image segmentation method based on multi-path attention fusion

An automatic segmentation and medical image technology, applied in image analysis, neural learning methods, image enhancement, etc., can solve problems such as difficulty in saving spatial information, encoder loses spatial information, and affects segmentation results, so as to improve feature quality and increase image quality. Quantity, good accuracy effect

Active Publication Date: 2022-05-03
CHONGQING UNIV OF POSTS & TELECOMM
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in the hierarchical transformation in the U-Net network, the learning process of different pooling levels often shares the same data path, so the generated multi-scale feature map may not be fully distinguished as expected. Due to the existence of the pooling layer, the encoder Losing part of the spatial information, the single U-Net network uses simple two consecutive 3×3 convolutional layers. This standard convolutional layer is difficult to preserve rich spatial information. Another disadvantage is that the U-Net network uses It is a simple skip connection, which only splices the features of the encoder and the features of the decoder, and the features output from the decoder will be redundant, which will affect the final segmentation result

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • An automatic medical image segmentation method based on multi-path attention fusion
  • An automatic medical image segmentation method based on multi-path attention fusion
  • An automatic medical image segmentation method based on multi-path attention fusion

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0059] The pictures in the medical image data set are divided into a training set and a verification set. The training set is used to train the model, and the verification set is used to optimize the various indicators of the model. For medical image segmentation, it is not easy to obtain enough training samples. Therefore, the present invention Augment the pictures in the training set. The augmented operations include:

[0060] Rotate the pictures in the training set, the rotation angles include 10°, 20°, -10° and -20°, and save the rotated pictures;

[0061] Flip the pictures in the training set up and down and left and right, and save the flipped pictures;

[0062] Perform elastic transformation on the pictures in the training set, and save the pictures after elastic transformation;

[0063] Perform (20%, 80%) range scaling on the pictures in the training set, and save the scaled pictures;

[0064] Use the pictures in the training set and the pictures in the training set ...

Embodiment 2

[0083] Using the separation method in Example 1, in this implementation, Keras and Tensorflow open source deep learning libraries are used, NIVIDIA Geforce RTX-2080Ti GPU is used for training, Adam optimization algorithm model is used, and the learning rate is set to 0.0001; 2018ISIC skin is used Cancer lesion segmentation, LUNA lung CT dataset.

[0084] A data set in this example is provided by the 2018 Skin Cancer Lesion Segmentation Challenge, which contains a total of 2954 skin cancer lesion pictures, each with a size of 700×900 and a corresponding segmentation label map; using 1815 1 picture is used as a training set, 59 pictures are used as a verification set, and the remaining 520 pictures are used as a test set. In order to facilitate network training, the size of all pictures is adjusted to 256×256. The data in the test set is as follows: Figure 4 shown, where Figure 4 In the first row, the original image data, the second row is the label of the original image, the...

Embodiment 3

[0090] Using the separation method in Embodiment 1, different from Embodiment 2, this embodiment uses the LUNA dataset, which is provided by the 2017 Kaggle Lung Node Competition. Contains a total of 730 pictures and 730 corresponding segmentation label maps. The pixel size of each picture is 512×512. Use 70% of the pictures as the training set, 10% of the pictures as the verification set, and the remaining 20% ​​of the data as a test set.

[0091] Due to the small amount of data, techniques such as rotation, flipping and elastic transformation are used to augment the training data set, so that the network can have good robustness and segmentation accuracy.

[0092] Four evaluation indicators are used, F1-score, Accuracy, Sensitivity and Specificity. The larger these four indexes are, the more accurate the segmentation effect is. As can be seen from Table 2, the experimental results in the LUNA data set show that compared with U-Net, R2-Unet, BCD-Net and U-Net++, the method of...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the technical field of medical image processing and computer vision, and in particular relates to a medical image automatic segmentation method based on multi-path attention fusion. The images in the training set are augmented, and the images in the validation set and the augmented training set are normalized; the images in the training set are input into the multi-path attention fusion network model, and the segmentation results are obtained under the guidance of the cross entropy loss function. Figure; select the model with the highest accuracy in the verification set, input the test set into the multi-path attention fusion network loaded with this model, and output the segmentation result map of the image; the present invention solves the problem that the existing network in the medical image segmentation process cannot be used in the encoder. It can effectively improve the quality of features at different scales, and it is difficult to control the inter-layer dependencies between low-level structural features and high-level semantic features of the network, resulting in poor segmentation results.

Description

technical field [0001] The invention belongs to the technical field of medical image processing and computer vision, in particular to an automatic medical image segmentation method based on multi-path attention fusion. Background technique [0002] Medical images play a key role in medical treatment and diagnosis. The goal of computer-aided diagnosis (CAD) systems is to provide physicians with accurate interpretations of medical images to enable better treatment of large numbers of patients. Also, automated processing of medical images results in reduced time, cost and errors of human-based processing. One of the main areas of research in this field is medical image segmentation, which is a key step in numerous medical imaging studies. [0003] Like other areas of search in computer vision, deep learning networks achieve excellent results and outperform non-deep techniques in medical imaging. Deep neural networks are mainly used for classification tasks, where the output ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06T7/11G06N3/04G06N3/08
CPCG06T7/11G06T2207/10081G06T2207/20081G06T2207/20084G06T2207/30088G06T2207/30061G06N3/08G06N3/048G06N3/045
Inventor 舒禹程张晶肖斌李伟生
Owner CHONGQING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products