Automatic image labeling method based on unsupervised domain adaptation

A technology for automatic image labeling and domain supervision, which is applied in the fields of machine learning and computer vision, and can solve problems such as time cost and labor cost

Pending Publication Date: 2020-12-29
NANJING UNIV
View PDF0 Cites 9 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Purpose of the invention: the technical problem to be solved by this invention is to provide a kind of image automatic tagging method based on unsupervised domain adaptation for the deficiencies in the prior art, and the image (vide...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Automatic image labeling method based on unsupervised domain adaptation
  • Automatic image labeling method based on unsupervised domain adaptation
  • Automatic image labeling method based on unsupervised domain adaptation

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0089] This embodiment includes the following parts:

[0090] Step 1, the collection of source domain and target domain datasets.

[0091] The source domain is generally an open source data set or a data set preserved by previous workers. Generally speaking, the acquisition rate is relatively high, and the scale is relatively complete, and the usability is high; the target domain data set is the focus of attention, and the target domain data The set has only images but no corresponding labeled data. After obtaining it, adjust and organize it into a general PASCAL VOC data set form (xml file: folder, filename, size, etc. tags), and put it in the source folder and the target folder respectively for backup.

[0092] Step 2, domain adaptation algorithm framework construction.

[0093] (1), Faster R-CNN framework. First, the input image is represented as a tensor (multidimensional array) of Height×Width×Depth, and after the pre-trained CNN model is processed, a convolution featu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an automatic image annotation method based on unsupervised domain adaptation. The method comprises the following steps: acquiring a source domain image and annotation, and acquiring a target domain image; building a detection framework, and constructing a domain classifier to extract global features and local features; training the existing data by using a PyTorch deep learning framework application algorithm to obtain a trained domain adaptation detection model; detecting the test data set (unlabeled pictures in the target domain) by using the existing latest model to obtain a preliminary detection result; and carrying out secondary processing and extraction by utilizing the preliminary detection result file to generate an xml annotation file in a PASCAL VOC format.On the basis of the domain adaptation method, under the condition that a large amount of target domain data are not labeled, only source domain pictures and labeling data similar to the target domaindata need to be owned, and training can be put into use for automatic labeling of the data. Compared with the prior art, the method is good in flexibility, high in classification precision, simple inmodel and high in practicability.

Description

technical field [0001] The invention relates to the fields of machine learning and computer vision, in particular to an image automatic labeling method based on unsupervised domain adaptation. Background technique [0002] Today's deep learning models need to be trained on large-scale supervised data sets-for each data, there will be a corresponding label. For a data set like ImageNet that contains up to one million pictures, it takes many people to spend several months to complete the manual labeling. Assuming that a data set with one million categories is to be created now, a total of 100 million frames must be given. Each frame in the video data set is labeled, which is basically impossible to achieve. The main goal of unsupervised learning research is to train a model that can be used for other tasks, the characteristics of this model should be as general as possible, and the characteristics of this model should be as good as possible, and the results of the supervised ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/62G06N3/04G06N3/08G06T7/11
CPCG06T7/11G06N3/08G06T2207/30204G06T2207/20081G06T2207/20084G06V2201/07G06N3/045G06F18/214G06F18/24
Inventor 杨育彬龙坤
Owner NANJING UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products