Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Context pyramid fusion network and image segmentation method

A fusion network and image segmentation technology, applied in the field of image processing, can solve the problems of insufficient contextual information extraction ability of a single encoder-decoder, ignoring global feature information, segmentation errors, etc., to improve segmentation performance and overcome gradual weakening , enhance the effect of response

Active Publication Date: 2020-01-14
SUZHOU UNIV
View PDF9 Cites 35 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although the CNN network with U-shaped structure has achieved good performance in medical image segmentation, the context information extraction ability of its single encoder-decoder is still not sufficient.
This will lead to the gradual weakening of the global context information obtained by the deep encoder when it is passed to the shallow decoder step by step
In addition, the simple skip connection between the encoder-decoder at each level ignores the global feature information and non-selectively fuses the local information, which will introduce irrelevant interference information, which will lead to segmentation errors

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Context pyramid fusion network and image segmentation method
  • Context pyramid fusion network and image segmentation method
  • Context pyramid fusion network and image segmentation method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] The purpose of the present invention is to overcome problems such as the low ability to extract multi-scale context information of a single encoder-decoder layer in the existing U-shaped structure network, the introduction of noise and the insufficient ability of global information extraction caused by simple skip connections, and the first design of the global pyramid guide ( Global Pyramid Guidance (GPG) module and scale-aware pyramid fusion (Scale-Aware Pyramid Fusion, SAPF) module apply two kinds of pyramid modules to the U-shaped structure network, aiming to realize a CNN based on convolutional neural network, suitable for medical The deep learning network for image segmentation is called Context Pyramid Fusion Network (CPFNet). The global pyramid guidance module (GPG module for short) proposed by the present invention can fuse multi-scale global context information and guide and transfer the global context information to the feature decoding module in the form of s...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a context pyramid fusion network and an image segmentation method, and the context pyramid fusion network comprises a feature coding module which comprises a plurality of feature extraction layers which are connected step by step, and is used for obtaining a feature map of an original image; a plurality of global pyramid guiding modules, connected with the different featureextraction layers respectively and used for fusing the feature maps extracted by the feature extraction layers connected with the global pyramid guiding modules with the feature maps extracted by allthe higher feature extraction layers to obtain global context information and guiding and transmitting the global context information to the feature decoding module through jump connection; a scale sensing pyramid fusion module, connected with the highest feature extraction layer of the feature coding module and used for dynamically selecting a correct receptive field according to the feature maps of different scales and fusing multi-scale context information; and a feature decoding module, used for reconstructing a feature map according to the global context information and the multi-scale context information. The method is good in image segmentation performance, and is better in effectiveness and universality.

Description

technical field [0001] The invention relates to a context pyramid fusion network and an image segmentation method, belonging to the technical field of image processing. Background technique [0002] Semantic segmentation of medical images is an important step in medical image analysis. Realize lesion region segmentation in different medical images, such as segmentation of skin lesions in dermoscopic images, segmentation of linear lesions in indocyanine green fundus angiography images, segmentation of dangerous organs in chest CT images, and segmentation of retinal optical coherence tomography (OCT). ) image segmentation of macular edema damage, etc., is the basis for quantitative analysis of lesions. However, in the case of generally low imaging resolution of medical images, medical images generally have the characteristics of low contrast, blurred boundaries of lesion areas, etc., coupled with the characteristics of variety and shape diversity of lesions, the semantic segm...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/62G06K9/34
CPCG06V10/267G06V2201/03G06F18/253G06F18/214
Inventor 朱伟芳冯爽朗陈新建赵鹤鸣
Owner SUZHOU UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products