Active Learning Object Detection Uncertainty Metric

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional object detection methods require extensive and costly annotation for both localization and classification, making them inefficient in terms of data annotation budgets and quality control.

Innovation Solution

The implementation of an active learning system that utilizes uncertainty measures for object detection, combining classification and localization uncertainties through metrics like Localization Tightness (LT) and Localization Stability (LS), allowing for reduced annotated data requirements while achieving comparable performance to conventional passive learning methods.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional vision detection methods use large amounts of annotated data to achieve super-human performance, then detection accuracy is improved, but annotation cost and time increase significantly

Engineering Contradiction:
Improvedetection accuracyVSAvoidannotation time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system uses the object detector itself to identify which samples need annotation by evaluating uncertainty metrics, eliminating the need for external judgment about which samples are most valuable. The detector self-identifies its knowledge gaps and prioritizes annotation of those specific cases.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system implements a feedback loop where the object detector processes unlabeled data, computes uncertainty metrics (classification and localization), and uses this feedback to select samples for annotation. Annotated samples are then added to the training set, improving the detector's performance iteratively.

Inventive Principle:
Principle #23Feedback

2Reliability

If conventional methods annotate all samples uniformly, then comprehensive training data is obtained, but annotation budget is exhausted quickly

Engineering Contradiction:
Improvetraining data qualityVSAvoidannotation budget
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

Instead of uniform annotation across all samples, the system applies different annotation priorities to different regions of the data space. Samples with high uncertainty metrics (both classification and localization) are prioritized for annotation, while samples with low uncertainty are skipped, creating a non-uniform but optimized annotation distribution.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system changes the parameter of sample selection from random or uniform sampling to uncertainty-based sampling. By computing uncertainty parameters (classification uncertainty and localization uncertainty) for each sample and selecting based on these parameters, the system optimizes which samples receive annotation resources.

Inventive Principle:
Principle #35Parameter changes

3Loss of time

If active learning uses only classification uncertainty for sample selection, then annotation cost is reduced, but localization performance suffers

Engineering Contradiction:
Improveannotation timeVSAvoidlocalization accuracy
Core Design Contradiction:
Loss of timeVSManufacturing precision

Solution Approach 1:

The system merges two separate uncertainty metrics - classification uncertainty and localization uncertainty - into a combined selection criterion. Both metrics are computed for each sample, and samples are selected for annotation based on the combination of these uncertainties, ensuring that both classification and localization performance are improved simultaneously.

Inventive Principle:
Principle #5Merging (Combining)

4Ease of manufacture

If random sampling is used to select samples for annotation, then implementation is simple, but annotation efficiency is low

Engineering Contradiction:
Improveimplementation simplicityVSAvoidannotation efficiency
Core Design Contradiction:
Ease of manufactureVSProductivity

Solution Approach 1:

The system replaces the mechanical/random process of sample selection with an information-driven process based on uncertainty metrics. Instead of randomly selecting samples, the system computes uncertainty values (classification and localization) and selects samples based on these computed metrics, substituting random mechanical selection with intelligent information-based selection.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentEP3475881B1System and method for active learning
Publication Date: 2020.04.22 MITSUBISHI ELECTRIC CORP
  • EP3475881B1 patent drawingFigure 1A
  • EP3475881B1 patent drawingFigure 1B
  • EP3475881B1 patent drawingFigure 1C

AI summary

System and method for an active learning system including a sensor obtains data from a scene including a set of images having objects. A memory to store active learning data including an object detector trained for detecting objects in images. A processor in communication with the memory, is configured to detect a semantic class and a location of at least one object in an image selected from the set of images using the object detector to produce a detection metric as a combination of an uncertainty of the object detector about the semantic class of the object in the image (classification) and an uncertainty of the object detector about the location of the object in the image (localization). Using an output interface or a display type device, in communication with the processor, to display the image for human labeling when the detection metric is above a threshold.