Image semantic segmentation based on global and local features of deep learning

A technology of global features and local features, applied in the field of computer vision image semantic segmentation, can solve the problem of difficult to widely represent image features, achieve the effect of reasonable design, reduce classification errors, and clear boundaries

Active Publication Date: 2019-01-11
ACADEMY OF BROADCASTING SCI STATE ADMINISTATION OF PRESS PUBLICATION RADIO FILM & TELEVISION +1
View PDF7 Cites 45 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

These methods rely too much on manually annotated feature libraries, and it is difficult to widely represent image features, which has great limitations in practical applications.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image semantic segmentation based on global and local features of deep learning
  • Image semantic segmentation based on global and local features of deep learning
  • Image semantic segmentation based on global and local features of deep learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] Embodiments of the present invention will be described in further detail below in conjunction with the accompanying drawings.

[0035] An image semantic segmentation method based on global features and local features of deep learning, such as Figure 1 to Figure 3 As shown, at the encoding end, the deep convolutional neural network model is used to extract the global and local features of the image; at the decoding end, the two features are fused to obtain complementary image discriminant features for image semantic segmentation. At the same time, in order to restore the original resolution of the image more accurately at the decoding end, a stacked pooling layer is proposed. The image features are stacked through the maximum pooling layer, the convolutional layer, and finally the anti-pooling layer. The feature is fused with the previous convolution feature to reduce the noise in the feature map, make the boundary of the segmentation map clearer, and also reduce the cl...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to an image semantic segmentation method based on global features and local features of deep learning. The method comprises the following steps: at an encoding end, the basic deep features of an image are extracted by using a convolution neural network model based on deep learning; meanwhile, the features are divided into low-level features and high-level features according to the deep of the convolution layer; the feature fusion module fuses the low-level feature and the high-level feature into the enhanced deep feature; the feature fusion module fuses the low-level feature and the high-level feature into the enhanced deep feature; after the deep feature is acquired, the deep feature is inputted to the decoding end; the cross-entropy loss function is used to train the network and mIoU is used to evaluate the performance of the network. The invention is reasonable in design, and uses the deep convolution neural network model to extract the global and local features of an image, fully utilizes the complementarity of the global features and the local features, further improves the performance by utilizing the stack pooling layer, and effectively improves the accuracy of image semantic segmentation.

Description

technical field [0001] The invention belongs to the technical field of computer vision image semantic segmentation, in particular to an image semantic segmentation method based on global features and local features of deep learning. Background technique [0002] Image semantic segmentation refers to dividing each pixel in the image into different semantic categories by a certain method, realizing the reasoning process from the bottom layer to the high-level semantics, and finally obtaining a pixel-by-pixel semantically labeled segmentation map showing different segmentation regions. Image semantic segmentation is widely used in many computer vision tasks such as street scene recognition and target detection in automotive autonomous driving, drone landing point detection, scene understanding, robot vision, etc. From the machine learning method based on computer vision to the current method based on deep learning, the research of image semantic segmentation algorithm has made ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/04G06N3/08G06K9/46G06K9/62
CPCG06N3/084G06V10/462G06N3/045G06F18/24
Inventor 宋辉解伟郭晓强周芸姜竹青门爱东
Owner ACADEMY OF BROADCASTING SCI STATE ADMINISTATION OF PRESS PUBLICATION RADIO FILM & TELEVISION
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products