Adversarial Domain Adaptation for Construction Zone Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Instance object detection and segmentation in road-scene images require labor-intensive annotation processes due to variations in architectural styles and environmental conditions across different domains, making it challenging to train fully supervised models effectively.

Innovation Solution

A method using adversarial learning to align image-level features between source and target domains, selecting unlabeled samples with lower prediction scores and higher diversity scores for annotation, and iteratively updating the label set to improve model performance in construction zone segmentation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If fully supervised model training is performed in every domain with labor-intensive annotation, then model accuracy and reliability are improved, but annotation time and computational resources are significantly increased

Engineering Contradiction:
Improvemodel accuracyVSAvoidannotation time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent performs preliminary domain adaptation by aligning feature distributions between source and target domains using adversarial learning before actual annotation. The domain discriminator is trained to distinguish between source and target domain features, and the feature alignment module pre-processes the feature representations to reduce domain gap. This preliminary action enables the model to achieve better performance with fewer annotations in the target domain.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary feature alignment module that mediates between the source domain pre-trained model and the target domain annotation process. This intermediary component transforms and aligns feature representations from the source domain to the target domain, enabling knowledge transfer without requiring full retraining. The intermediary handles the domain adaptation task, reducing the need for extensive target domain annotations.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If domain adaptation is performed to handle variations in architectural styles and environmental conditions, then model adaptability is improved, but the complexity of the training process is increased

Engineering Contradiction:
Improvedomain adaptabilityVSAvoidtraining process complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the domain adaptation process into distinct modular components: a domain discriminator module that learns domain-specific feature distributions, a feature alignment module that transforms features between domains, and an active learning module that selects informative samples. This segmentation allows each component to be trained and optimized independently, reducing the overall complexity of the training process while maintaining high domain adaptability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements feedback mechanisms where the domain discriminator provides guidance on domain-specific feature characteristics, and the active learning module uses prediction scores to feedback-select the most informative samples for annotation. This feedback loop continuously refines the feature alignment and domain adaptation process, making the complex training process more manageable through iterative improvement guided by measurable metrics.

Inventive Principle:
Principle #23Feedback

3Productivity

If active learning with domain discriminator is used to select diverse and uncertain samples, then annotation efficiency is improved, but the computational cost for feature alignment and sample selection is increased

Engineering Contradiction:
Improveannotation efficiencyVSAvoidcomputational cost
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The patent applies partial action by selecting only the most informative samples for annotation rather than annotating all available data. The active learning module uses the domain discriminator's prediction scores to identify and annotate only the top-k most uncertain and diverse samples. This partial annotation approach significantly reduces the computational cost of annotation while maintaining high annotation efficiency, as the model learns from the most valuable samples rather than processing the entire dataset.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11580334B2Construction zone segmentation
Publication Date: 2023.02.14 NEC CORP
  • US11580334B2 patent drawing
  • US11580334B2 patent drawing
  • US11580334B2 patent drawing

AI summary

Systems and methods for construction zone segmentation are provided. The system aligns image level features between a source domain and a target domain based on an adversarial learning process while training a domain discriminator. The target domain includes construction zones scenes having various objects. The system selects, using the domain discriminator, unlabeled samples from the target domain that are far away from existing annotated samples from the target domain. The system selects, based on a prediction score of each of the unlabeled samples, samples with lower prediction scores. The system annotates the samples with the lower prediction scores.