Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Image segmentation method and system based on edge auxiliary calculation and mask attention

An image segmentation and attention technology, applied in the field of computer vision, can solve problems such as single target loss function, inaccurate edge segmentation of model targets, and inability to make full use of multi-scale context information, so as to improve accuracy, effect, and edge Accurate and clear, improve the effect of spatial resolution

Active Publication Date: 2022-05-31
CENT SOUTH UNIV +1
View PDF10 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the existing methods still have the following problems. The model does not accurately segment the edge of the target in the image, cannot make full use of multi-scale context information, there is too much information loss in the prediction process, and the target loss function optimized by the model is too large. Single, unable to effectively model, the above problems will eventually affect the segmentation effect of the model

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image segmentation method and system based on edge auxiliary calculation and mask attention
  • Image segmentation method and system based on edge auxiliary calculation and mask attention
  • Image segmentation method and system based on edge auxiliary calculation and mask attention

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0042] An image segmentation method based on edge-assisted computation and mask attention, the frame diagram of this method is attached figure 1 shown, including the following steps:

[0043] S1. Establish a feature encoder constructed by multi-stage cascaded residual modules, perform dimensionality reduction and upsampling on the outputs of the first three-order residual modules, and fuse three shallow feature maps to obtain edge feature maps, which are obtained after feature dimensionality reduction The edge predicts the image and enhances the representation ability of the first three layers of feature encoders. The specific implementation method is as follows:

[0044] The feature encoder consists of five layers: conv1, conv2_x, conv3_x, conv4_x, and conv5_x. The conv1 layer includes a convolution layer with a convolution kernel of 7*7, a BatchNorm layer, a ReLu layer, and a MaxPool layer. All layers except the conv1 layer The level is a cascaded residual block. The residu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an image segmentation method and system based on edge auxiliary calculation and mask attention, and the method comprises the steps: building a feature encoder constructed by a multi-stage cascaded residual module, obtaining an edge feature map through fusing three superficial layer feature maps, obtaining an edge prediction image after feature dimension reduction, enhancing the representation capability of the first three layers of feature encoders, and obtaining an edge prediction image; the last-order residual error module sequentially passes through a plurality of feature decoders and a mask attention module, the mask attention module is used for improving the focus attention of the feature decoder of each level on a local area, and a segmentation result image predicted by a corresponding scale is output at each level. And fusing the output feature map of the feature decoder and the edge feature map of the first three-order residual error module, and predicting a final segmentation result image through feature dimension reduction. Compared with an existing image segmentation method, the method can provide more accurate segmentation edge prediction, is suitable for image segmentation in various complex scenes, and is higher in generalization performance and better in segmentation effect.

Description

technical field [0001] The invention belongs to the field of computer vision, and relates to an image segmentation method and system based on edge auxiliary calculation and mask attention. Background technique [0002] At present, the image segmentation technology based on deep learning is an important research direction in the field of computer vision, and has been widely used. The existing image segmentation method is to use the deep learning model to classify each pixel in the image, and finally get each pixel. Semantic categories of pixels. However, the existing methods still have the following problems. The model does not accurately segment the edge of the target in the image, cannot make full use of multi-scale context information, there is too much information loss in the prediction process, and the target loss function optimized by the model is too large. Single, unable to effectively model, the above problems will eventually affect the segmentation effect of the mo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06V10/26G06V10/80G06V10/82G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06N3/045G06F18/253
Inventor 王勇钟立科黄伟红胡建中
Owner CENT SOUTH UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products