Semi-supervised image semantic segmentation method based on double-discriminator adversarial learning

A semantic segmentation and discriminator technology, applied in the field of image semantic segmentation, can solve problems such as difficulties, inapplicability of engineering projects, labor and material costs, etc., and achieve the effect of improving stability and segmentation performance

Pending Publication Date: 2022-05-06
SUN YAT SEN UNIV
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the segmentation model based on the convolutional neural network relies heavily on a large amount of data with pixel-level annotations for supervised learning, and the work of pixel-level manual annotation is cumbersome and difficult, which often requires a lot of manpower and material costs, and is not suitable for actual engineering projects.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Semi-supervised image semantic segmentation method based on double-discriminator adversarial learning
  • Semi-supervised image semantic segmentation method based on double-discriminator adversarial learning
  • Semi-supervised image semantic segmentation method based on double-discriminator adversarial learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] The present invention will be further described below.

[0020] Concrete implementation process of the present invention is as follows:

[0021] (1) Prepare the data set. Collect corresponding training samples and test samples according to actual application requirements. In order to verify the general effect of the method proposed in the present invention, as a specific example, the Pascal VOC2012 data set, the most commonly used benchmark data set in the field of semantic segmentation, can be downloaded. The present invention randomly selects 1 / 8 of the data from the PASCAL VOC 2012 training set as the labeled data training set in the experiment, and the remaining training set as the unlabeled data training set in the experiment, and finally verifies the experimental results on the PASCAL VOC2012 verification set.

[0022] (2) Data preprocessing. Through a series of data enhancement processes such as random rotation, flipping, and cropping of the training set, the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention designs a semi-supervised image semantic segmentation method based on double-discriminator adversarial learning. And a strategy of alternately training by adopting double discriminators and a divider is adopted. And performing linear mixing on different class probability graphs and target values to serve as training data of the double discriminators, and outputting a space confidence graph. When data with labels are used for training, the segmentation network is jointly supervised by cross entropy loss and adversarial loss based on a standard. And after multiple rounds of alternate training, adding label-free data, and continuing training. And carrying out binarization processing on confidence maps output by the two discriminators through a set threshold value to obtain two different high-confidence regions, and taking the intersection of the two regions as a pseudo tag for calculating the cross entropy loss of label-free data. At the moment, the segmentation network adds one item of cross entropy loss based on pseudo labels. According to the method, double discriminator adversarial learning is introduced, so that the stability of model training is improved, the segmentation performance is also improved, and the effectiveness of the method is proved.

Description

technical field [0001] The invention relates to the field of image semantic segmentation, in particular to a semi-supervised image semantic segmentation method based on dual discriminator confrontation learning. Background technique [0002] In recent years, thanks to the birth of large-scale data, the use of high-computing GPUs, and the proposal of various advanced model methods, computer vision technology based on deep learning has rapidly emerged. Image semantic segmentation, as a basic problem in the field of computer vision applications, is to classify images at the pixel level, assign an appropriate category label and boundary location to each pixel in the image, and has a very broad practical application prospect. The traditional semantic segmentation method focuses on the manually extracted features, which has achieved good segmentation results to a certain extent, and has the advantage of low algorithm cost. However, the traditional method also has certain limitati...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06V10/26G06V10/774G06V10/764G06V10/82G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06N3/045G06F18/2155G06F18/24
Inventor 林风龙郑慧诚梁凡
Owner SUN YAT SEN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products