Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Domain adaptive target detection method and system considering category semantic matching

A domain-adaptive, target detection technology, applied in the domain-adaptive target detection field considering category semantic matching, can solve problems such as category semantic mismatch, unreasonable strategy, damage to cross-domain target detection model performance, etc., and achieve consistency , the effect of reducing the effect of pseudo-label noise

Pending Publication Date: 2021-12-17
HUNAN UNIV
View PDF3 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, these methods often only align the distribution of the source domain and the target domain from a macro perspective, ignoring the semantic information of the specific categories of the two domains, which can easily cause wrong matching of category semantics, thereby limiting the cross-domain detection performance of the target detection model. improve
Although some self-training methods using pseudo-labels overcome the difficulty of lacking labeled data in the target domain and improve the cross-domain robustness of the target detection model to a certain extent, the strategy of selecting pseudo-labels is not reasonable enough, resulting in errors. The accumulation of the damage to the performance of the cross-domain object detection model

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Domain adaptive target detection method and system considering category semantic matching
  • Domain adaptive target detection method and system considering category semantic matching
  • Domain adaptive target detection method and system considering category semantic matching

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0105] Step 1. Obtain labeled images in the source domain and unlabeled images in the target domain.

[0106] In step 2, a base object detector is trained using source-domain labeled images.

[0107] Step 3, add a domain adaptive component to the basic object detector, and use the source domain and target domain images to train the domain adaptive object detection model.

[0108] Step 4, remove the previously added domain adaptation component, and use the adapted basic target detector to detect the target domain scene.

[0109] Further, the source domain labeled image and the target domain unlabeled image obtained in step 1 are divided into the following steps, such as figure 2 As shown, its specific expression is:

[0110] Step 1.1, obtain unlabeled images of the target domain. According to the actual application requirements, collect images of the scene to be detected, and use the collected images to create a data set as the target domain. Since these images have not be...

Embodiment 2

[0179] The present invention also provides a domain adaptive target detection system considering category semantic matching, such as Figure 9 As shown, the system includes:

[0180] Module 1, image storage module. The image storage module saves a variety of public datasets for target detection research, which contain images and corresponding labels in specific scenes. In addition, the image storage module also stores the collected images of the scene to be detected. According to the actual application requirements, one of the public datasets can be selected as the source domain, and the collected images can be used as the target domain.

[0181] Module 2, pre-training module. The domain-adaptive object detection model is composed of a basic object detector, a global feature discrimination component, a pseudo-label dynamic selection component, and a category semantic matching component. When the input data only contains source domain images, the pre-training module uses so...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a domain adaptive target detection method and system considering category semantic matching. The method comprises the following steps: step 1, acquiring a source domain image with a label and a target domain image without a label; step 2, training by using the source domain image with the label to obtain a pre-trained basic target detector; step 3, adding a domain self-adaptive component on the pre-trained basic target detector, and performing training by using the source domain image with the label and the target domain image without the lable to obtain a trained domain self-adaptive target detection model; and step 4, removing the added domain adaptive component, and performing target detection on the target domain scene by using the trained domain adaptive target detection model. According to the domain adaptive target detection method and system, the problem of semantic matching of specific categories of two domains in cross-domain target detection is considered, and the problem of wrong alignment of the target categories of the source domain and the target domain in a shared category space is avoided, so that the detection performance of a target detection model on the target domain is further improved.

Description

technical field [0001] The invention belongs to the field of computer vision target detection, and in particular relates to a domain adaptive target detection method and system considering category semantic matching. Background technique [0002] Under the joint action of many factors such as the rapid increase in data scale, the advancement of computing power, and algorithm innovation, deep learning has risen rapidly and achieved considerable development, showing strong advantages in the field of computer vision. In recent years, object detection methods based on deep learning have used large-scale, labeled data to train object detection models, and have achieved outstanding results on various public data sets. In practical applications, there are usually differences in the distribution of the training data set (called the source domain) and the test data set (called the target domain). If the target detection model trained from the source domain is applied to the target do...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06N3/08
CPCG06N3/08G06F18/2415G06F18/214
Inventor 王晓伟蒋沛文王惠秦晓辉边有钢秦洪懋徐彪谢国涛秦兆博胡满江丁荣军
Owner HUNAN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products