Kidney fascia CT image segmentation method and system based on improved UNet network

By improving the UNet network, dynamic serpentine convolution and CBAM attention module were introduced, combined with the EE module and the residual module, the problem of renal fascia blurring boundaries and susceptibility to surrounding tissues on CT images is solved, and efficient and accurate renal fascia segmentation is achieved.

CN119648680AActive Publication Date: 2025-03-18SUN YAT SEN UNIV

Patent Information

Application Number
CN202411812285.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-10
Publication Date
2025-03-18
Estimated Expiration
2044-12-10

AI Technical Summary

Technical Problem

The prior art is difficult to effectively segment the fuzzy boundary of the renal fascia on the abdominal CT image, and is susceptible to surrounding tissues, making it difficult to extract features.

Method used

Using the improved UNet network, a GA module composed of a cascaded bilayer dynamic serpentine convolution and a layer of CBAM attention module is introduced into the encoder, instead of the original convolution layer, and an improved EE module is introduced into the decoder, combined with the residual module, a network can be built that can more effectively extract and segment renal fascial features.

Benefits of technology

It significantly improves the accuracy and robustness of renal fascial segmentation, can more effectively suppress irrelevant or redundant information, and provides an efficient method of renal fascial automatic segmentation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119648680A_ABST
    Figure CN119648680A_ABST
Patent Text Reader

Abstract

The invention relates to the field of computer-aided medical diagnosis, and discloses a renal fascia CT image segmentation method and system based on an improved UNet network, and the method comprises the following specific steps: constructing and preprocessing an original renal fascia CT image, and obtaining a training set; in an encoder of the UNet network, an improved GA module composed of cascaded double-layer dynamic snakelike convolution and a layer of CBAM attention module is adopted to replace all convolution layers of the encoder of the Unet network, and an improved UNet network is constructed; inputting the training set into the improved UNet network for training to obtain an optimal model; and inputting a to-be-predicted image into the optimal model to obtain a predicted renal fascia segmentation result. The method solves the problem that the features of the renal fascia are difficult to extract due to the fact that the boundary of the renal fascia is fuzzy and is easily influenced by surrounding tissues, and has the characteristic of being capable of realizing accurate and efficient image segmentation.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of computer-aided medical diagnosis, and more specifically, to a renal fascia CT image segmentation method and system based on an improved UNet network. Background Art

[0002] The renal fascia is an important structure that wraps around the kidneys, and its health status is closely related to the kidneys and surrounding tissues. In the early stages of renal tumors, the renal fascia can prevent the spread of tumor cells, but as the disease progresses, the tumor may break through the renal fascia and cause more extensive invasion. Doctors can observe the positional relationship between the renal fascia and the renal tumor through abdominal CT images, thereby assessing the severity of kidney disease and deciding whether surgery is needed. However, the renal fascia appears as a thin soft tissue density line shadow on abdominal CT images and is easily affected by surrounding tissues. Even experienced radiologists find it difficult to accurately segment its area. If deep learning technology can be used to effectively segment the renal fascia in abdominal CT images, it will be helpful for clinical diagnosis and treatment, and provide new perspectives and tools for kidney disease research.

[0003] With the advancement of science and technology, deep learning technology has developed rapidly in the field of medical image segmentation. Various models such as CNN, UNet, FCN, etc. have been widely used in the detection and segmentation of diseases such as tumors and organs. However, as far as the currently available methods are concerned, the research on renal fascia segmentation using deep learning technology is relatively scarce. In order to fill this research gap, the necessity of using deep learning technology for renal fascia segmentation has gradually become prominent.

[0004] The prior art has a method for segmenting liver and tumor images. The image segmentation network based on the multi-scale feature attention mechanism simultaneously pays attention to the global spatial information, local spatial information and inter-channel information, which can effectively utilize the limited information of the feature image and solve the problem that the Unet network cannot effectively utilize the information of a small medical image data set to complete accurate segmentation.

[0005] However, the existing technology cannot solve the problem that the renal fascia is easily affected by its surrounding tissues due to its fuzzy boundaries, making its features difficult to extract. Therefore, how to invent a renal fascia CT image segmentation method based on an improved UNet network is a technical problem that urgently needs to be solved in this technical field. Summary of the invention

[0006] In order to solve the problem that the renal fascia is easily affected by its surrounding tissues due to its fuzzy boundaries, making it difficult to extract its features, the present invention provides a renal fascia CT image segmentation method and system based on an improved UNet network, which has the characteristics of being able to achieve accurate and efficient image segmentation.

[0007] In order to achieve the above-mentioned purpose of the present invention, the technical scheme adopted is as follows: A renal fascia CT image segmentation method based on an improved UNet network includes the following specific steps: Construct and preprocess the original renal fascia CT images to obtain the training set; In the encoder of the UNet network, an improved GA module consisting of a cascaded double-layer dynamic snake convolution and a layer of CBAM attention module is used to replace all convolutional layers of the encoder of the UNet network to construct an improved UNet network; Input the training set into the improved UNet network for training to obtain the best model; The image to be predicted is input into the optimal model to obtain the predicted renal fascia segmentation result.

[0008] Preferably, the original renal fascia CT image is constructed and preprocessed, and the specific steps are: Obtain original renal fascia CT images; Adjust the window width and window level of the original renal fascia CT image; The renal fascia CT images with adjusted window width and window position are cropped; The cropped renal fascia CT images are annotated to obtain a renal fascia dataset; The renal fascia dataset was augmented by random rotation, random horizontal flipping, random cropping, and translation operations; The data-enhanced renal fascia image dataset is divided into training set and test set according to the set ratio.

[0009] Furthermore, the CBAM attention module consists of a cascaded channel attention module and a spatial attention module.

[0010] Furthermore, the specific process of the GA module processing the input image is as follows: In each GA module of the encoder, the first layer of the two-layer dynamic snake convolution is adaptively convolved according to the input image. The local features dynamically adjust their sliding direction and step size to capture local features and output feature maps : =DSC( ,k) Where DSC is the dynamic snake convolution operation, k is the convolution kernel size; Will The second layer of dynamic snake convolution is input into the double-layer dynamic snake convolution for further refinement of feature extraction and output feature map : =DSC( ,k) Will Input to a layer of CBAM attention module, Perform channel attention mechanism processing and obtain channel descriptors through global average pooling and maximum pooling : ) Among them, GlobalAvgPool is the global average pooling, and GlobalMaxPool is the global maximum pooling; Descriptor Generate channel attention weights through the fully connected layer :

[0011] in, and is the learned weight matrix, ReLU is the activation function, σ is the sigmoid activation function; Weight Application In the above example, we generate an enhanced feature map ; = ⊙

[0012] Where ⊙ represents element-by-element multiplication; right Perform spatial attention mechanism processing and calculate spatial features S through channel-dimensional pooling operation: S=Concat(MaxPool( ),AvgPool( )) Among them, Concat is a concatenation operation; Convolution is performed on the spatial feature S to generate spatial attention weights : =σ(Conv(S, )) in It is the convolution kernel in the spatial attention mechanism; Weight Apply to In the example above, we generate the output feature map of the GA module. : = ⊙ .

[0013] Furthermore, when constructing the improved UNet network, an improved EE module is used to replace all decoding convolutional layers in the decoder of the UNet network; the improved EE module consists of a cascaded double-layer convolution, a SE attention module and an EMA attention module.

[0014] Furthermore, the specific process of the EE module processing the input image is as follows: In each EE module of the decoder, the input image After the double-layer convolution operation, the output feature map : =DoubleConv( , k3); Among them, DoubleConv is a double-layer convolution operation, and k3 is a 3×3 convolution kernel; Will Input into the SE attention module, and generate channel descriptors through global average pooling :

[0015] Will Input fully connected layer to generate channel attention weights :

[0016] in and is the learned weight matrix; Weight Application In the above example, we generate an enhanced feature map : = ⊙

[0017] Will Input EMA attention module; in the EMA attention module, the channel mean and variance of the feature map are calculated to generate a moving average channel descriptor μ and σ, perform normalization operations to generate updated channel weights : =normalize( ) Where normalize is the normalization operation; right Weighted to generate feature map : = ⊙

[0018] Will and Perform feature fusion to generate the output feature map of the EE module .

[0019] Furthermore, when constructing the improved UNet network, a residual module is introduced at the connection between the UNet network encoder and decoder; the residual module consists of two cascaded 3×3 convolutional layers and one 5×5 convolutional layer.

[0020] Furthermore, the training set is input into the improved UNet network for training, specifically: setting the initial learning rate, training epoch, and sample batch; the training set is input into the improved UNet network, and the model is trained using the RMSprop optimizer. During training, Dice Loss is selected as the loss function, and the learning rate of each model parameter is adaptively adjusted according to the size of the gradient.

[0021] Furthermore, after obtaining the best model, the model is evaluated through indicators such as the Dice coefficient. The specific steps are as follows: The test set is input into the best model for training, the renal fascia image feature information is extracted, the renal fascia in the abdominal CT image is predicted, and the test segmentation result image is obtained; The Dice coefficient, recall rate, precision rate, and accuracy rate are used as evaluation indicators of the model to evaluate the training results. If the evaluation result does not meet the set threshold, the training set is re-input into the improved UNet network for training.

[0022] A renal fascia CT image segmentation system based on an improved UNet network, comprising an image processing module, a UNet network construction module, a model training module, and an image segmentation module; The image processing module is used to construct and preprocess the original renal fascia CT image to obtain a training set; The UNet network construction module is used to replace all convolutional layers of the encoder of the UNet network with an improved GA module consisting of a cascaded double-layer dynamic snake convolution and a layer of CBAM attention module in the encoder of the UNet network to construct an improved UNet network; The model training module is used to input the training set into the improved UNet network for training to obtain the best model; The image segmentation module is used to input the image to be predicted into the optimal model to obtain the predicted renal fascia segmentation result.

[0023] The beneficial effects of the present invention are as follows: The present invention is based on the U-shaped network of the original UNet, and replaces the encoding convolution layer with an improved GA module including a double-layer dynamic snake convolution and a layer of CBAM attention module, thereby improving the UNet network. The improved UNet network can fully understand the characteristics of the renal fascia in the abdominal CT image, while effectively suppressing irrelevant or redundant information, and significantly improving the accuracy of renal fascia segmentation. The present invention provides an efficient new method for the automatic segmentation of the renal fascia, filling the gap in the field of using deep learning technology to segment the renal fascia. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] Figure 1 This is a schematic diagram of the specific process of the renal fascia CT image segmentation method based on the improved UNet network.

[0025] Figure 2 Schematic diagram of samples and their labels used for training and testing of the renal fascia dataset in Example 2.

[0026] Figure 3 This is the overall structure diagram of the improved UNet network model in the present invention.

[0027] Figure 4 It is a structural diagram of the improved GA module in the present invention.

[0028] Figure 5 It is a structural diagram of the improved EE module in the present invention.

[0029] Figure 6 Schematic diagram of the residual module in the present invention. DETAILED DESCRIPTION

[0030] The present invention is described in detail below with reference to the accompanying drawings and specific embodiments.

[0031] Example 1 like Figure 1 As shown, a renal fascia CT image segmentation method based on an improved UNet network includes the following specific steps: Construct and preprocess the original renal fascia CT images to obtain the training set; In the encoder of the UNet network, an improved GA module consisting of a cascaded double-layer dynamic snake convolution and a layer of CBAM attention module is used to replace all convolutional layers of the encoder of the UNet network to construct an improved UNet network; Input the training set into the improved UNet network for training to obtain the best model; The image to be predicted is input into the optimal model to obtain the predicted renal fascia segmentation result.

[0032] Example 2 More specifically, in a specific embodiment, a renal fascia image dataset is constructed by the following specific steps: Obtain original renal fascia CT images; The window width of the original renal fascia CT image was adjusted to 300, and the window level was adjusted to -50 to observe the renal fascia more clearly; The renal fascia CT image with adjusted window width and window position is cropped with a cropping resolution of [700,550]; The renal fascia was labeled using labelme software to obtain the renal fascia dataset.

[0033] In this embodiment, the samples and labels used for training in the renal fascia dataset are as follows: Figure 2 As shown in the two left pictures in the figure, the samples and labels used for testing in the renal fascia dataset are as follows Figure 2 As shown in the two pictures on the right.

[0034] In a specific embodiment, the original renal fascia CT images are preprocessed to obtain a training set and a test set, and the specific steps are as follows: The renal fascia dataset was augmented by random rotation, random horizontal flipping, random cropping, and translation operations; The data-enhanced renal fascia image dataset is divided into training set and test set in a ratio of 4:1.

[0035] In a specific embodiment, the CBAM attention module consists of a cascaded channel attention module and a spatial attention module.

[0036] The specific process of GA module processing input image is as follows: In each GA module of the encoder, the first layer of the two-layer dynamic snake convolution is adaptively convolved according to the input image. The local features dynamically adjust their sliding direction and step size to capture local features and output feature maps : =DSC( ,k) Where DSC is the dynamic snake convolution operation, k is the convolution kernel size; Will The second layer of dynamic snake convolution is input into the double-layer dynamic snake convolution for further refinement of feature extraction and output feature map : =DSC( ,k) Will Input to a layer of CBAM attention module, Perform channel attention mechanism processing and obtain channel descriptors through global average pooling and maximum pooling : ) Among them, GlobalAvgPool is the global average pooling, and GlobalMaxPool is the global maximum pooling; Descriptor Generate channel attention weights through the fully connected layer :

[0037] in, and is the learned weight matrix, ReLU is the activation function, σ is the sigmoid activation function; Weight Application In the above example, we generate an enhanced feature map ; = ⊙

[0038] Where ⊙ represents element-by-element multiplication; right Perform spatial attention mechanism processing and calculate spatial features S through channel-dimensional pooling operation: S=Concat(MaxPool( ),AvgPool( )) Among them, Concat is a concatenation operation; Convolution is performed on the spatial feature S to generate spatial attention weights : =σ(Conv(S, )) in It is the convolution kernel in the spatial attention mechanism; Weight Apply to In the example above, we generate the output feature map of the GA module. : = ⊙ .

[0039] In a specific embodiment, when constructing an improved UNet network, an improved EE module is used to replace all decoding convolutional layers in the decoder of the UNet network; wherein the improved EE module is composed of a cascaded double-layer convolution, a SE attention module and an EMA attention module.

[0040] In a specific embodiment, the specific process of the EE module processing the input image is as follows: In each EE module of the decoder, the input image After the double-layer convolution operation, the output feature map : =DoubleConv( , k3); Among them, DoubleConv is a double-layer convolution operation, and k3 is a 3×3 convolution kernel; Will Input into the SE attention module, and generate channel descriptors through global average pooling :

[0041] Will Input fully connected layer to generate channel attention weights :

[0042] in and is the learned weight matrix; Weight Application In the above example, we generate an enhanced feature map : = ⊙

[0043] Will Input EMA attention module; in the EMA attention module, the channel mean and variance of the feature map are calculated to generate a moving average channel descriptor μ and σ, perform normalization operations to generate updated channel weights : =normalize( ) Where normalize is the normalization operation; right Weighted to generate feature map : = ⊙

[0044] Will and Perform feature fusion to generate the output feature map of the EE module .

[0045] In a specific embodiment, when constructing the improved UNet network, a residual module is also introduced at the connection between the UNet network encoder and the decoder; the residual module consists of two cascaded 3×3 convolutional layers and one 5×5 convolutional layer.

[0046] In this embodiment, the structure of the improved UNet network is as follows: Figure 3 and Figure 4 As shown in the figure, by replacing all the convolution layers of the encoder of the Unet network with an improved GA module consisting of a cascaded double-layer dynamic snake convolution and a layer of CBAM attention module, the characteristics of the renal fascia are emphasized while suppressing irrelevant or redundant information; the input image is first subjected to a double-layer dynamic snake convolution for feature extraction, and then the features are input into the CBAM attention module; compared with the standard convolution, the dynamic snake convolution better captures the local correlation and spatial structure of the renal fascia by introducing a more flexible convolution structure; the CBAM attention module consists of two key modules, channel attention and spatial attention. The channel attention module can evaluate the importance of each channel of the renal fascia feature map and adjust the weight of each channel accordingly; the spatial attention module focuses on the spatial position information of the renal fascia feature map, and emphasizes or suppresses the features of different positions by generating an enhanced feature map; In the decoder of the UNet network, an improved EE module is used such as Figure 5 As shown in the figure, the decoding convolution layer is replaced, which improves the model's attention to the features of the renal fascia, enhances detail retention, and improves the quality of renal fascia segmentation; the input of the EE module is feature fused with the output after double-layer convolution, SE attention module and EMA attention module; the SE attention module can help the model better retain the edges and details of the renal fascia, and enhance the attention to the features of the renal fascia by dynamically adjusting the importance of each channel; the EMA attention module helps the model reduce its sensitivity to instantaneous noise in CT images and improve the segmentation robustness of the renal fascia in complex backgrounds.

[0047] like Figure 6 As shown in the figure, the residual module is introduced at the connection between the UNet network encoder and decoder, which effectively improves the accuracy and robustness of renal fascia segmentation; the input of the residual module is fused with the output after two layers of 3×3 convolutional layers and one layer of 5×5 convolutional layers. The 3x3 convolution can capture the detailed information of the renal fascia, while the 5x5 convolution can capture a wider range of contextual information, thereby enhancing the expressiveness of the features.

[0048] In this embodiment, the specific process of the residual module processing the input image is as follows: In the residual module, the input image After two layers of 3×3 convolutional layers, the output feature map : =DoubleConv( ,k3) Among them, DoubleConv is a double-layer convolution operation, and k3 is a 3×3 convolution kernel; Will Input a 5×5 convolutional layer =Conv( , k5) Among them, Conv is the convolution operation, k5 is the 5×5 convolution kernel; Will and Perform feature fusion to generate the output feature map of the residual module .

[0049] In a specific embodiment, the training set is input into the improved UNet network for training, specifically: the initial learning rate is set to 0.001, the training epoch is set to 40, that is, the model learns all training samples 40 times, the sample batch is 4, that is, 4 pictures are input into the model at a time; the training set is input into the improved UNet network, and the RMSprop optimizer is used for model training. During the training, Dice Loss is selected as the loss function to process unbalanced data, and the learning rate of each model parameter is adaptively adjusted according to the size of the gradient.

[0050] In a specific embodiment, the image to be predicted is input into the optimal model to obtain the predicted renal fascia segmentation result, and the specific steps are as follows: The image to be predicted is input into the encoder of the best model; the feature maps generated by the GA modules of the 1st to 3rd layers are input into the GA modules of the next layer as input images, and the feature maps generated by the GA modules of the 4th layer are input into the residual module; The fourth layer GA module inputs the feature map it generates into the residual module, which first passes through two layers of 3×3 convolutional layers; After another 5×5 convolution layer, the obtained image is fused with the input image to obtain and output the fused feature map. Input the fused feature map into the decoder of the best model; The fused feature map is input into the EE module of the fourth layer; the feature map generated by the EE module of the 4th to 2nd layer is input into the EE module of the previous layer; each EE module of each layer is jump-connected with its corresponding GA module; the feature map output by the EE module of the first layer is output as the predicted renal fascia segmentation result map.

[0051] In a specific embodiment, after obtaining the best model, the model is evaluated by using indicators such as the Dice coefficient, and the specific steps are as follows: The test set is input into the best model for training, the renal fascia image feature information is extracted, the renal fascia in the abdominal CT image is predicted, and the test segmentation result image is obtained; The Dice coefficient, recall rate, precision rate, and accuracy rate are used as evaluation indicators of the model to evaluate the training results. If the evaluation result does not meet the set threshold, the training set is re-input into the improved UNet network for training.

[0052] In this embodiment, the Dice coefficient is specifically a set similarity measurement function, which is used to measure the similarity between the segmentation result and the real renal fascia label. The expression of the Dice coefficient is:

[0053] The recall rate is specifically the ratio of correctly predicted positive samples to actual positive samples, that is, the ratio of the number of pixels correctly predicted to be renal fascia to the number of pixels actually being renal fascia. The expression of the recall rate is:

[0054] The precision rate is specifically the ratio of correctly predicted positive samples to all predicted positive samples, that is, the ratio of the number of pixels correctly predicted as renal fascia to the number of pixels predicted as renal fascia. The expression of the precision rate is:

[0055] The accuracy is specifically the ratio of correctly predicted samples to the total number of samples, that is, the ratio of the number of pixels correctly predicted as renal fascia to the number of pixels correctly predicted as non-renal fascia to the total number of pixels. The expression of the accuracy is as follows:

[0056] Among them, TP represents the number of pixels correctly predicted as renal fascia, FP represents the number of pixels incorrectly predicted as renal fascia, TN represents the number of pixels correctly predicted as non-renal fascia, and FN represents the number of pixels incorrectly predicted as non-renal fascia.

[0057] Example 3 A renal fascia CT image segmentation system based on an improved UNet network, comprising an image processing module, a UNet network construction module, a model training module, and an image segmentation module; The image acquisition module is used to construct a renal fascia image data set; The image processing module is used to construct and preprocess the original renal fascia CT image to obtain a training set; The UNet network construction module is used to replace all convolutional layers of the encoder of the UNet network with an improved GA module consisting of a cascaded double-layer dynamic snake convolution and a layer of CBAM attention module in the encoder of the UNet network to construct an improved UNet network; The model training module is used to input the training set into the improved UNet network for training to obtain the best model; The image segmentation module is used to input the image to be predicted into the optimal model to obtain the predicted renal fascia segmentation result.

[0058] Obviously, the above embodiments of the present invention are only examples for clearly explaining the present invention, and are not intended to limit the implementation methods of the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention shall be included in the protection scope of the claims of the present invention.

Claims

1. A renal fascia CT image segmentation method based on an improved UNet network, characterized in that: The specific steps include: Construct and preprocess the original renal fascia CT images to obtain the training set; In the encoder of the UNet network, an improved GA module consisting of a cascaded double-layer dynamic snake convolution and a layer of CBAM attention module is used to replace all convolutional layers of the encoder of the UNet network to construct an improved UNet network; Input the training set into the improved UNet network for training to obtain the best model; The image to be predicted is input into the optimal model to obtain the predicted renal fascia segmentation result.

2. The renal fascia CT image segmentation method based on the improved UNet network according to claim 1, characterized in that: Construct and preprocess the original renal fascia CT image. The specific steps are as follows: Obtain original renal fascia CT images; Adjust the window width and window level of the original renal fascia CT image; The renal fascia CT images with adjusted window width and window position are cropped; The cropped renal fascia CT images are annotated to obtain a renal fascia dataset; The renal fascia dataset was augmented by random rotation, random horizontal flipping, random cropping, and translation operations; The data-enhanced renal fascia image dataset is divided into training set and test set according to the set ratio.

3. The renal fascia CT image segmentation method based on the improved UNet network according to claim 1, characterized in that: The CBAM attention module consists of a cascaded channel attention module and a spatial attention module.

4. The renal fascia CT image segmentation method based on the improved UNet network according to claim 3 is characterized in that: The specific process of GA module processing input image is as follows: In each GA module of the encoder, the first layer of the two-layer dynamic snake convolution is adaptively convolved according to the input image. The local features dynamically adjust their sliding direction and step size to capture local features and output feature maps : =DSC( ,k) Where DSC is the dynamic snake convolution operation, k is the convolution kernel size; Will The second layer of dynamic snake convolution is input into the double-layer dynamic snake convolution for further refinement of feature extraction and output feature map : =DSC( ,k) Will Input to a layer of CBAM attention module, Perform channel attention mechanism processing and obtain channel descriptors through global average pooling and maximum pooling : ) Among them, GlobalAvgPool is the global average pooling, and GlobalMaxPool is the global maximum pooling; Descriptor Generate channel attention weights through the fully connected layer : in, and is the learned weight matrix, ReLU is the activation function, σ is the sigmoid activation function; Weight Application In the above example, we generate an enhanced feature map ; = ⊙ Where ⊙ represents element-by-element multiplication; right Perform spatial attention mechanism processing and calculate spatial features S through channel-dimensional pooling operation: S=Concat(MaxPool( ),AvgPool( )) Among them, Concat is a concatenation operation; Convolution is performed on the spatial feature S to generate spatial attention weights : =σ(Conv(S, )) in It is the convolution kernel in the spatial attention mechanism; Weight Apply to In the example above, we generate the output feature map of the GA module. : = ⊙ 。 5. The renal fascia CT image segmentation method based on the improved UNet network according to claim 4 is characterized in that: When constructing the improved UNet network, an improved EE module is used to replace all decoding convolutional layers in the decoder of the UNet network; the improved EE module consists of a cascaded double-layer convolution, a SE attention module and an EMA attention module.

6. The renal fascia CT image segmentation method based on the improved UNet network according to claim 5 is characterized in that: The specific process of EE module processing input image is as follows: In each EE module of the decoder, the input image After the double-layer convolution operation, the output feature map : =DoubleConv( ,k3); Among them, DoubleConv is a double-layer convolution operation, and k3 is a 3×3 convolution kernel; Will Input into the SE attention module, and generate channel descriptors through global average pooling : Will Input fully connected layer to generate channel attention weights : in and is the learned weight matrix; Weight Application In the above example, we generate an enhanced feature map : = ⊙ Will Input EMA attention module; in the EMA attention module, the channel mean and variance of the feature map are calculated to generate a moving average channel descriptor μ and σ, perform normalization operations to generate updated channel weights : =normalize( ) Where normalize is the normalization operation; right Weighted to generate feature map : = ⊙ Will and Perform feature fusion to generate the output feature map of the EE module .

7. The renal fascia CT image segmentation method based on the improved UNet network according to claim 1, characterized in that: When constructing the improved UNet network, a residual module is also introduced at the connection between the UNet network encoder and decoder; the residual module consists of two cascaded 3×3 convolutional layers and one 5×5 convolutional layer.

8. The renal fascia CT image segmentation method based on the improved UNet network according to claim 6, characterized in that: The training set is input into the improved UNet network for training. Specifically, the initial learning rate, training epoch, and sample batch are set. The training set is input into the improved UNet network, and the model is trained using the RMSprop optimizer. During training, DiceLoss is selected as the loss function, and the learning rate of each model parameter is adaptively adjusted according to the size of the gradient.

9. The renal fascia CT image segmentation method based on the improved UNet network according to claim 4, characterized in that: After obtaining the best model, the model is evaluated through indicators such as the Dice coefficient. The specific steps are as follows: The test set is input into the best model for training, the renal fascia image feature information is extracted, the renal fascia in the abdominal CT image is predicted, and the test segmentation result image is obtained; The Dice coefficient, recall rate, precision rate, and accuracy rate are used as evaluation indicators of the model to evaluate the training results. If the evaluation result does not meet the set threshold, the training set is re-input into the improved UNet network for training.

10. A renal fascia CT image segmentation system based on an improved UNet network, characterized in that: Including image processing module, UNet network construction module, model training module, image segmentation module; The image processing module is used to construct and preprocess the original renal fascia CT image to obtain a training set; The UNet network construction module is used to replace all convolutional layers of the encoder of the UNet network with an improved GA module consisting of a cascaded double-layer dynamic snake convolution and a layer of CBAM attention module in the encoder of the UNet network to construct an improved UNet network; The model training module is used to input the training set into the improved UNet network for training to obtain the best model; The image segmentation module is used to input the image to be predicted into the optimal model to obtain the predicted renal fascia segmentation result.

Citation Information

Patent Citations

  • Face super-resolution method based on multi-scale attention residual error and equivariant mapping

    CN113052016A

  • Road scene image real-time semantic segmentation method based on improved U-Net

    CN116363358A

  • Insect pest fine granularity identification method based on OfficienNetV2S

    CN117876773A

  • Pancreatic tumor image segmentation method and system based on reinforcement learning and attention

    WO2023221954A1

Cited By

  • Method and device for measuring diameter of RC structural steel bar based on deep learning

    CN120451250A

  • Lithium ore microscopic image segmentation method and system based on improved Unet model

    CN121304707A

  • Lithium ore microscopic image segmentation method and system based on improved Unet model

    CN121304707B