Lightweight network real-time semantic segmentation method based on attention mechanism

A semantic segmentation and lightweight technology, which is applied in the field of real-time semantic segmentation of lightweight network based on attention mechanism, can solve the problem that image semantic segmentation is difficult to achieve the balance between segmentation accuracy and segmentation efficiency, so as to enhance useful features and improve The effect of precision

Pending Publication Date: 2021-02-05
BEIJING UNIV OF TECH
View PDF0 Cites 27 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to provide a light-weight network real-time semantic segmentation method based on the attention mechanism, which can better solve the problem that the image semantic segmentation in the prior art is difficult to achieve a balance between segmentation accuracy and segmentation efficiency, so as to meet the needs of robots. The need for real-time segmentation in real-world environments

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Lightweight network real-time semantic segmentation method based on attention mechanism
  • Lightweight network real-time semantic segmentation method based on attention mechanism
  • Lightweight network real-time semantic segmentation method based on attention mechanism

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] The present invention will be described in detail below in conjunction with specific embodiments and accompanying drawings.

[0034] like figure 1 As shown, a lightweight network real-time semantic segmentation method based on the attention mechanism includes the following steps:

[0035] Step 1: Prepare image datasets for training and testing;

[0036] In this embodiment, the categories in the Cityscapes data set are used as benchmarks. This data set contains 5000 finely labeled images of street scenes from 50 different cities. The training set has 2975 images, the verification set has 500 images, and the test set has 500 images. 1525 images, and 19998 images with coarse annotations. In this embodiment, only finely labeled images are used for training, and the image resolution is 1024×2048. All pixels in the dataset can be labeled into 30 categories, of which 19 categories are selected for training and testing.

[0037] Step 2: Build a lightweight real-time semanti...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a lightweight network real-time semantic segmentation method based on an attention mechanism, which is used for solving the problems that the segmentation precision and the segmentation efficiency are difficult to balance and the practical application cannot be met. The method comprises: preparing image data; and constructing a lightweight real-time semantic segmentation network based on an attention mechanism, providing a new asymmetric encoding and decoding network structure. In an encoder, a lightweight module-separable asymmetric module is used, and the module combines the advantages of depth separable asymmetric convolution and hole convolution. The calculation amount is greatly reduced while the precision is kept; an attention feature fusion module is designed in a decoder, features in the encoder and features in the decoder are fused, the fused features are selected and combined through an attention mechanism, the features useful for recovering image information are enhanced, and the network segmentation precision is effectively improved. Finally, semantic segmentation is achieved by using the trained segmentation network.

Description

Technical field: [0001] The invention belongs to the technical field of image semantic segmentation, and relates to a lightweight network real-time semantic segmentation method based on an attention mechanism. Background technique: [0002] In recent years, with the rapid development of computer technology and sensor technology, robot research has made great progress, and more and more service robots are widely used in social production and life. When a robot serves humans, it first needs to establish cognition and understanding of the surrounding environment, and then complete a series of other tasks, such as robot positioning, navigation, path planning, etc. Therefore, the cognition and understanding of the environment directly affects the performance of the robot. inferior. Semantic segmentation is a cornerstone technology of scene understanding. It groups each pixel in an image according to its semantic meaning, that is, it classifies each pixel in an image. After the ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/10
CPCG06T2207/20081G06T2207/20084G06T7/10
Inventor 杨金福王康李明爱袁帅
Owner BEIJING UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products