Attention mechanism-based lightweight semantic segmentation model construction method

A semantic segmentation and construction method technology, applied in the field of image processing, can solve problems such as ignoring information, and achieve the effects of not being over-fitting, facilitating actual deployment, and improving performance

Active Publication Date: 2021-08-10
BEIHANG UNIV
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This ensures the integrity of the high-frequency information, but when unpooling the lower-resolution feature map, the information between the neighbors of the pixels is also ignored.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Attention mechanism-based lightweight semantic segmentation model construction method
  • Attention mechanism-based lightweight semantic segmentation model construction method
  • Attention mechanism-based lightweight semantic segmentation model construction method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0048] refer to figure 1 As shown, the present invention discloses a method for constructing a lightweight semantic segmentation model based on an attention mechanism, comprising the following steps:

[0049] Given an image I, the corresponding true label map GT constitutes the training set:

[0050] Step 1. Model establishment, using AHSP module, Channel Attention Sum (channel attention sum), Criss-Cross Attention Sum (cross attention sum), Channel Split (ch...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an attention mechanism-based lightweight semantic segmentation model construction method, which is applied to the technical field of image processing, and a training set is formed by giving an image I and a corresponding real label graph GT. The method comprises the steps of step 1, establishing a model; step 2, model training; and step 3, model testing: inputting a test set image into the trained network model to obtain a test result. According to the invention, the image segmentation accuracy and segmentation speed are improved; the segmentation process is not easy to over-fit; efficiency is high, and actual deployment is facilitated; and under the condition that the annotation data is insufficient, the annotation data is quickly trained, so that the performance is further improved.

Description

technical field [0001] The invention relates to the technical field of image processing, in particular to a method for constructing a lightweight semantic segmentation model based on an attention mechanism. Background technique [0002] Image segmentation refers to the computer vision task of marking the specified area according to the content of the image. Specifically, the purpose of image semantic segmentation is to mark each pixel in the image and associate the pixel with its corresponding category. It has important practical application value in scene understanding, medical image, unmanned driving, etc. [0003] Classic semantic segmentation models include: [0004] Fully convolutional neural network (FCN), as a classic production of semantic segmentation network in deep learning, draws on the traditional classification network structure, but is different from the traditional classification network, and converts the fully connected layer of the traditional classificati...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/10G06N3/04G06N3/08
CPCG06T7/10G06N3/08G06T2207/20081G06T2207/20084G06T2207/30061G06N3/045Y02T10/40
Inventor 张霖杨源
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products