Image semantic segmentation method of guiding feature fusion based on attention mechanism

A technology of feature fusion and semantic segmentation, which is applied to computer components, instruments, biological neural network models, etc., can solve problems such as blurred boundaries and outlines, and achieve the effect of reducing ambiguity, high accuracy, and clear boundary outlines

Inactive Publication Date: 2019-09-06
CHANGSHU INSTITUTE OF TECHNOLOGY
View PDF4 Cites 43 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

While semantic segmentation solves the classification problem, it also needs to face the spatial details such as the boundary contour of the positioning object in the segmentation. The simple pixel classification task often has the phenomenon that the boundary contour of the object in the segmentation result is blurred.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image semantic segmentation method of guiding feature fusion based on attention mechanism
  • Image semantic segmentation method of guiding feature fusion based on attention mechanism
  • Image semantic segmentation method of guiding feature fusion based on attention mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0023] Such as figure 1 As shown, the present invention is based on the attention mechanism to guide the image semantic segmentation method of feature fusion, comprising the following steps:

[0024] (10) Encoder basic network construction: use the improved ResNet-101 to generate a series of features ranging from high resolution and low semantics to low resolution and high semantics;

[0025] Such as figure 2 As shown, the (10) encoder basic network construction steps include:

[0026] (11) Re-deployment of the number of layers of building blocks: redeploy the number of building blocks owned by each stage from res-2 to res-5, and res-2 to res-5 of the original ResNet-101 {3, 4, 23, 3 } The number of building blocks is adjusted to {8, 8, 9, 8};

[0027] The purpose of the convolutional network encoder is to generate a series of features ranging from high-resolution low-semantic to low-resolution high-semantic. The base network usually uses existing convolutional neural netw...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an image semantic segmentation method of guiding feature fusion based on attention mechanism. The image semantic segmentation method comprises the following steps: (10) constructing an encoder basic network: using an improved ResNet-101 to generate a series of features changing from high resolution low semantics to low resolution high semantics; (20) constructing a decoderfeature fusion module: extracting high-level semantics with strong consistency constraint by adopting a pyramid structure module based on three-layer convolution operation, and performing weighted fusion on low-level stage features layer by layer to obtain a preliminary segmentation heat map; and (30) constructing an auxiliary loss function: adding auxiliary supervision to each fusion output in the decoding stage, superposing the auxiliary supervision with main supervision loss after the up-sampling of the heat map, and strengthening the hierarchical training of the model to obtain a semanticsegmentation map. The image semantic segmentation method of guiding feature fusion based on attention mechanism is high in accuracy and clear in boundary contour.

Description

technical field [0001] The invention belongs to the technical field of static image recognition, in particular to an image semantic segmentation method based on an attention mechanism guiding feature fusion with high accuracy and clear boundaries. Background technique [0002] Semantic segmentation, that is, pixel-level image understanding, is one of the important cornerstones in the field of computer vision and has a very wide range of application scenarios. Through fine-grained segmentation, it gives the machine the ability to separate different areas of the visual image at the pixel level. Semantic segmentation divides the pixel regions belonging to the same object in the image together, thereby expanding its application field. [0003] Semantic segmentation combines the two problems of object classification and target positioning while performing pixel-level prediction. How to strike a balance between the two mutually constrained problems of high-level abstract object c...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/34G06K9/62G06N3/04
CPCG06V10/267G06N3/045G06F18/2193G06F18/253
Inventor 龚声蓉周鹏程
Owner CHANGSHU INSTITUTE OF TECHNOLOGY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap