Gating feature attention equivariant segmentation method based on weak supervised learning

A technology of attention and weak supervision, applied in the field of image processing, can solve the problems that the weak supervision segmentation network cannot be realized, and achieve the effect of improving classification accuracy and segmentation accuracy

Pending Publication Date: 2022-04-19
NANJING UNIV OF INFORMATION SCI & TECH
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, this global attention mechanism is aimed at all pixels in the image, and also requires corresponding

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Gating feature attention equivariant segmentation method based on weak supervised learning
  • Gating feature attention equivariant segmentation method based on weak supervised learning
  • Gating feature attention equivariant segmentation method based on weak supervised learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] The drawings constituting a part of the present invention are used to provide a further understanding of the present invention, and the schematic embodiments and descriptions of the present invention are used to explain the present invention, and do not constitute an improper limitation of the present invention.

[0044] figure 1 It is a schematic flow chart of the gated feature attention segmentation method based on weakly supervised learning proposed by the present invention, which can be specifically divided into three types: a twin classification network with equivariant constraints, a gated partial fusion module, and a cross feature attention module. module. The specific process steps are as follows:

[0045] First, build a ResNet38 classification network, send the image and its corresponding classification label into the network, and perform classification training through the classification loss function to obtain the category information of the image. In class...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a gating feature attention isovariant segmentation method based on weak supervised learning, and the method specifically comprises the steps: 1, training a first classification network, and carrying out the weight sharing, and obtaining a second classification network; training a partial fusion module of the first gating, and carrying out weight sharing to obtain a partial fusion module of the second gating; 2, performing affine transformation on the original image to obtain an affine image; 3, respectively inputting the original image and the affine image into two classification networks; 4, taking the feature layer of the last layer of the two classification networks as class activation mapping and affine class activation mapping; 5, inputting the feature maps output by the two classification networks at the specific stage into a corresponding gated partial fusion module to obtain a gated feature map and an affine gated feature map; 6, inputting results obtained in the step 4 and the step 5 into a cross feature attention model to obtain improved class activation mapping; and 7, realizing image segmentation according to the improved class activation mapping. According to the invention, the segmentation precision of the weak supervision network is improved.

Description

technical field [0001] The invention belongs to the technical field of image processing. Background technique [0002] With the wide application of deep learning, computer vision technology has developed rapidly. Computer vision is a science that studies how to let machines replace human eyes to identify, track and detect real objects. It is a simulation of biological vision, where the computer replaces the human brain to analyze and process the image data, and ultimately hopes that the computer can observe and understand the world through "vision" like humans. [0003] Semantic segmentation is one of the main tasks of computer vision and a prerequisite for a large number of advanced vision tasks. The semantic segmentation network at this stage is divided into two categories: one is a strongly supervised segmentation network, which requires pixel-level annotation for objects in the segmented scene, and the production cost of the dataset is relatively high; the other is a w...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06V10/764G06V10/26G06V10/774G06V10/80G06V10/56G06V10/46G06V10/82G06V10/75G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06N3/045G06F18/2155G06F18/22G06F18/253G06F18/24
Inventor 陈苏婷成泽华张艳艳吴超群张闯许鑫马文妍
Owner NANJING UNIV OF INFORMATION SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products