Semantic segmentation method based on reverse attention model

An attention model and semantic segmentation technology, applied in the field of image processing, can solve complex problems, increase the number of model learning parameters, etc., to achieve the effect of speeding up

Pending Publication Date: 2020-09-18
HENAN UNIVERSITY OF TECHNOLOGY
View PDF0 Cites 20 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] However, this method increases the number of model learning parameters and is more complicated.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Semantic segmentation method based on reverse attention model
  • Semantic segmentation method based on reverse attention model
  • Semantic segmentation method based on reverse attention model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] In order to elaborate on the purpose, technical solutions and advantages of the present invention, the present invention will be further described in detail below in conjunction with specific implementation steps and accompanying drawings.

[0039] The present invention provides a semantic segmentation method based on the reverse attention model. In the commonly used full convolutional network (CNN) semantic segmentation model, the reverse attention model is introduced, and the attention view of the high-level output features of the model is Reverse the low-level features of the model and perform multi-feature fusion to maintain the boundary information in the segmentation results, while filtering part of the noise information to improve the accuracy of the semantic segmentation results.

[0040] Since the present invention adds a loss function based on Gumbe softmax to the output features of the last layer of the basic semantic segmentation model after attention self-en...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a semantic segmentation method based on a reverse attention model. The method mainly comprises the following steps: acquiring an image data set, and constructing a training set and a test set; constructing a deep semantic segmentation network model, wherein the deep semantic segmentation network model comprises a basic network model and a reverse attention model; and inputting the features output by the basic network into a reverse attention model to calculate attention views, gradually counteracting the attention views on the low-level output features of the basic semantic segmentation network, and fusing the attention views with the output features of the basic network and the up-sampling features thereof to obtain a final segmentation result. According to the model, only basic semantic segmentation network output features are used for calculating an attention view, and low-level features are guided to be fused into the basic semantic segmentation network output features, so that noise in the low-level features of the model is suppressed, and the robustness and segmentation precision of the semantic segmentation model are improved; meanwhile, a loss function based on Gumbel softmax is added to high-level output features of the basic semantic segmentation model, so that the model training speed is increased.

Description

technical field [0001] The invention belongs to the technical field of image processing, and in particular relates to a semantic segmentation method based on a reverse attention model. Background technique [0002] In recent years, deep learning has developed by leaps and bounds. The deep learning model represented by convolutional neural network (CNN) has once again ignited the silent neural network, setting off a wave of deep learning in academia and industry. [0003] The early DNN-based segmentation model was limited by the fixed size of the input image. To solve this problem, Long and Shelhamer of the University of Berkeley proposed a fully convolutional network (FCN) for image semantic segmentation, by using convolution instead of full Connect the layers, and use techniques such as deconvolution and upsampling to map the dense predictive image output by the network to the original image, thereby achieving end-to-end semantic segmentation, and the DNN model can handle i...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/34G06N3/04G06N3/08
CPCG06N3/08G06V10/267G06N3/045
Inventor 李磊董卓莉费选母亚双李卫东王贵财石帅锋李铮
Owner HENAN UNIVERSITY OF TECHNOLOGY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products