Instance segmentation method and device based on feature attention and sub-upsampling

An attention and feature map technology, applied in the field of image processing, can solve the problems of complex calculation, low effectiveness and low accuracy of image feature vectors, and achieve the effects of increasing memory usage, improving effectiveness, and improving accuracy

Active Publication Date: 2019-12-03
NINGBO INST OF MATERIALS TECH & ENG CHINESE ACADEMY OF SCI
View PDF5 Cites 39 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] An embodiment of the present invention provides an instance segmentation method and device based on feature attention and sub-upsampling, which is used to solv...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Instance segmentation method and device based on feature attention and sub-upsampling
  • Instance segmentation method and device based on feature attention and sub-upsampling
  • Instance segmentation method and device based on feature attention and sub-upsampling

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] In order to make the purpose, technical solution and advantages of the present application clearer, the technical solution of the present application will be clearly and completely described below in conjunction with specific embodiments of the present application and corresponding drawings. Apparently, the described embodiments are only some of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

[0051] ginseng figure 1 and figure 2 , introducing an implementation of the instance segmentation method based on feature attention and sub-upsampling in this application. In this embodiment, the method includes:

[0052] S11. Acquire the original image to be segmented.

[0053] The original image may be, for example, an RGB image.

[0054] S12....

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an instance segmentation method based on feature attention and sub-upsampling. The method comprises the steps of obtaining a to-be-segmented original image; extracting a feature map from the original image through a feature global network, and determining a region of interest in the feature map, the feature global network comprising an attention module; aligning and extracting a region of interest from the feature map; and classifying the extracted regions of interest, and generating segmentation masks for the extracted regions of interest by utilizing sub-pixel up-sampling so as to realize instance segmentation of the original image. The method has the advantages that the attention module is added when the feature map is extracted; according to the embodiment of the invention, redundant information and fusion information can be deleted by applying channel transformation after maximum pooling and average pooling operations, the effectiveness of an image featurevector is improved. Meanwhile, the accuracy of segmentation and detection in instance segmentation is improved under the condition of not reducing the speed in combination with a sub-pixel up-samplingmode, and the occupied memory is not increased.

Description

technical field [0001] The invention belongs to the technical field of image processing, and in particular relates to an instance segmentation method and device based on feature attention and sub-upsampling. Background technique [0002] Instance segmentation is a kind of pixel-by-pixel segmentation, which is a further development of semantic segmentation. Semantic segmentation does not distinguish between different instances belonging to the same category. For example, when there are multiple cats in an image, semantic segmentation predicts all pixels of two cats as "cat". And instance segmentation further needs to distinguish which pixels belong to the first cat and which pixels belong to the second cat. [0003] Faster-RCNN is an earlier target detection network. For an input picture, the network can get a list of bounding boxes, the category label of each bounding box, and the probability of each bounding box category label. It contains a convolutional layer for extra...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/32G06K9/34G06N3/04
CPCG06V40/10G06V10/267G06V10/25G06N3/045
Inventor 雷蕾田佳豪王敏杰徐颖周昊宇肖江剑
Owner NINGBO INST OF MATERIALS TECH & ENG CHINESE ACADEMY OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap