Multiple Category Boosting for Adaptive Label Refinement

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Multi-view object detection, such as face detection, faces challenges in accuracy due to misclassification caused by inadequate labeling and the labor-intensive process of manual labeling, especially in tasks like pedestrian or car detection, where the boundary between subcategories can be subtle and prone to errors.

Innovation Solution

The use of multiple category boosting algorithms, specifically probabilistic and winner-take-all multiple category boosting, where classifiers are jointly trained with adaptive labeling, allowing labels to change over iterations, and combining likelihood values to improve classification accuracy by iteratively refining labels.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual labeling is used to train classifiers for different subcategories, then classification accuracy for each subcategory can be improved, but the labeling process becomes very labor-intensive and error-prone

Engineering Contradiction:
Improveclassification accuracyVSAvoidlabeling efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system uses automatic clustering algorithms to generate subcategory labels without manual intervention. The clustering process automatically groups training examples into subcategories based on feature similarity, eliminating the need for labor-intensive manual labeling while maintaining classification accuracy through data-driven category formation.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary clustering of training examples into subcategories before classifier training begins. This preliminary organization of data into meaningful groups allows subsequent classifiers to be trained on well-structured subsets, improving both automation and accuracy without requiring manual labeling of each example.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If conventional clustering is used to automatically label training examples, then labeling productivity is improved, but classification accuracy deteriorates due to misclassification errors and suboptimal clustering results

Engineering Contradiction:
Improvelabeling efficiencyVSAvoidclassification accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system implements dynamic re-clustering where training examples are re-clustered into subcategories at multiple stages during the boosting training process. As classifiers improve and provide better predictions, the clustering is updated to reflect more accurate category assignments, allowing the system to adapt and correct initial misclassifications dynamically throughout training.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses feedback from classifier predictions to improve clustering quality. Misclassified examples are identified and re-clustered in subsequent iterations, with the clustering process incorporating feedback from classifier performance to refine category assignments and reduce misclassification errors in later training stages.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If the general class of objects is divided into multiple subcategories for detection, then detection accuracy for specific viewpoints is improved, but device complexity increases due to multiple classifiers and pose estimators

Engineering Contradiction:
Improvedetection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system merges the clustering and classifier training processes into a unified boosting framework. Instead of separately managing multiple independent classifiers for each subcategory, the system integrates them into a single boosting algorithm that dynamically adjusts subcategory assignments and trains classifiers jointly, reducing system complexity while maintaining detection accuracy across multiple viewpoints.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS8401979B2Multiple category learning for training classifiers
Publication Date: 2013.03.19 MICROSOFT TECHNOLOGY LICENSING LLC
  • US8401979B2 patent drawing
  • US8401979B2 patent drawing
  • US8401979B2 patent drawing

AI summary

Described is multiple category learning to jointly train a plurality of classifiers in an iterative manner. Each training iteration associates an adaptive label with each training example, in which during the iterations, the adaptive label of any example is able to be changed by the subsequent reclassification. In this manner, any mislabeled training example is corrected by the classifiers during training. The training may use a probabilistic multiple category boosting algorithm that maintains probability data provided by the classifiers, or a winner-take-all multiple category boosting algorithm selects the adaptive label based upon the highest probability classification. The multiple category boosting training system may be coupled to a multiple instance learning mechanism to obtain the training examples. The trained classifiers may be used as weak classifiers that provide a label used to select a deep classifier for further classification, e.g., to provide a multi-view object detector.