Gini exponent-based domain adaptive semantic segmentation method

A Gini index and semantic segmentation technology, applied in the field of pattern recognition and computer vision, can solve a lot of experimental noise and other problems, and achieve the effect of improving accuracy

Pending Publication Date: 2020-12-22
BEIJING UNIV OF TECH
View PDF0 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Pseudo-label thresholds are usually artificially set empirically, r

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Gini exponent-based domain adaptive semantic segmentation method
  • Gini exponent-based domain adaptive semantic segmentation method
  • Gini exponent-based domain adaptive semantic segmentation method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0122] 1. Experimental data set

[0123] The method proposed in the present invention is tested on the commonly used unsupervised adaptive dataset GTA5-Cityscapes, where the synthetic dataset GTA5 is used as the source domain and the real dataset Cityscapes is used as the target domain. Models are evaluated on the Cityscapes validation set.

[0124] GTA5: The synthetic dataset GTA5 contains 24966 synthetic images with a resolution of 1914×1052 and the corresponding ground-truth. These composite images were collected from a cityscape video game based on the city of Los Angeles. The automatically generated ground-truth contains 33 categories. The methods experimented on GTA5-Cityscapes generally only consider the 19 categories compatible with the Cityscapes dataset, and the present invention is no exception.

[0125] Cityscapes: As a dataset collected from the real world, Cityscapes provides 3975 images with fine segmentation annotations. The training set contains 2975 image...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a Gini exponent-based domain adaptive semantic segmentation method, which comprises the following steps of: measuring uncertainty of output prediction by utilizing a Gini exponent, performing uncertainty measurement and constraint on output prediction of a target domain on an output layer, reducing the difference between a source domain and the target domain in category distribution, and performing inter-domain adaptation; dividing a target domain sample set into two subsets according to an uncertainty measurement result of the Gini index for target domain prediction, training an intra-domain adaptive segmentation network for a sample corresponding to intra-domain high-confidence prediction by using a pseudo tag as weak supervision information, and calculating a Gini index graph for output prediction of the two subsets of the intra-domain adaptive segmentation network; a Gini exponent graph calculated by a low-confidence sample is constrained, a discriminator Dtis used for discriminating which subset the Gini index graph belongs to, the difference in a target domain is reduced based on an adversarial thought, and the semantic annotation precision is improved. Compared with the prior art, the semantic annotation accuracy of the target domain is remarkably improved.

Description

technical field [0001] The invention relates to an unsupervised field adaptive semantic tagging method, in particular to a field adaptive semantic segmentation method based on the Gini index, which belongs to the field of pattern recognition and computer vision and can be applied to automatic driving and robot visual navigation technologies. Background technique [0002] Unsupervised domain adaptive semantic segmentation uses labeled source domain data and unlabeled target domain data for training, and learns a model that has a better semantic annotation effect on target domain images. Accurate unsupervised domain-adaptive semantic segmentation is crucial for many applications, such as autonomous driving, robot navigation, etc. [0003] The main problem to be solved by unsupervised domain adaptation is how to reduce the difference between the source domain and the target domain. The usual strategies include: inter-domain adaptation of the input space, inter-domain adaptation...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/10G06N3/04G06N3/08
CPCG06T7/10G06N3/084G06T2207/20081G06T2207/20084G06T2207/30204G06N3/045
Inventor 王立春胡玉杰王少帆孔德慧李敬华尹宝才
Owner BEIJING UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products