Fine-Grained Object Recognition Using Domain Discriminators

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Deep learning models face challenges in fine-grained object recognition when generalizing to test cases with environments drastically different from the training data, as existing approaches like data-agnostic augmentation and domain adaptation techniques are not effective in handling unlabeled data from target domains.

Innovation Solution

The method involves dividing unlabeled training data from a target domain into subdomains using attribute annotations, ranking them based on similarity to the source domain, and applying multiple domain discriminators for multi-step adversarial training between the target and source domains, along with preceding target domains.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If data-driven domain adaptation techniques are used to generalize to test cases with drastically different environments, then the model's ability to handle domain differences is improved, but the requirement for large-scale labeled training data increases

Engineering Contradiction:
Improveability to handle domain differencesVSAvoidlabeled training data
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The patent segments the target domain into multiple subdomains based on attribute annotations (e.g., lighting conditions, weather conditions). This allows the model to handle domain differences by training on segmented subdomains that are more similar to the source domain, reducing the need for large-scale labeled data across the entire target domain.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces domain discriminators as intermediary components that facilitate domain adaptation. These discriminators help the model learn to distinguish between source and target domains, enabling effective generalization to drastically different environments without requiring extensive labeled target domain data.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If manual labeling of training data is performed, then the quality of training data is improved, but the development cycle time increases

Engineering Contradiction:
Improvetraining data qualityVSAvoiddevelopment cycle
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent implements a self-labeling mechanism where the model uses domain discriminators and attribute annotations to automatically identify and label training data from the target domain. This self-service approach eliminates the need for manual labeling while maintaining data quality, significantly reducing development cycle time.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent performs preliminary actions by pre-processing target domain data into subdomains based on attribute annotations before training. This preliminary organization of data enables the model to effectively utilize unlabeled data, reducing the need for manual labeling and accelerating the development cycle.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If domain adaptation techniques are applied to handle environmental differences, then the recognition accuracy in new environments is improved, but the model complexity increases

Engineering Contradiction:
Improverecognition accuracy in new environmentsVSAvoidmodel complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent segments the complex domain adaptation problem into manageable subdomains based on attributes. This segmentation simplifies the model by focusing on specific, identifiable characteristics (lighting, weather) rather than handling all possible domain variations simultaneously, reducing overall model complexity while maintaining accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes parameters by using attribute annotations to define subdomains and by adjusting the domain discriminator training parameters. This allows the model to adapt to new environments through parameter adjustments rather than complex architectural changes, maintaining recognition accuracy while controlling model complexity.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11087142B2Recognizing fine-grained objects in surveillance camera images
Publication Date: 2021.08.10 NEC CORP
  • US11087142B2 patent drawing
  • US11087142B2 patent drawing
  • US11087142B2 patent drawing

AI summary

Systems and methods for recognizing fine-grained objects are provided. The system divides unlabeled training data from a target domain into two or more target subdomains using an attribute annotation. The system ranks the target subdomains based on a similarity to the source domain. The system applies multiple domain discriminators between each of the target subdomains and a mixture of the source domain and preceding target domains. The system recognizes, using the multiple domain discriminators for the target domain, fine-grained objects.