Dynamic Training Sample Grouping for Classifier Hierarchy

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing object detection systems face challenges in effectively recognizing objects under varying poses, lighting conditions, and environments due to the need for extensive manual labeling and potential errors in training classifier networks, which complicates the training process and increases time and effort.

Innovation Solution

The approach involves dynamic grouping of training samples in the feature space to train classification nodes, using a clustering process and iterative splitting based on similarity, with different weights assigned to samples from 'yes' and 'no' paths to address errors and outliers, resulting in an automatic training method that minimizes errors and effort.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual labeling and training of classifier networks is performed, then object detection accuracy can be improved, but the time and effort required for training increases significantly

Engineering Contradiction:
Improveobject detection accuracyVSAvoidtraining time and effort
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs automatic training by having the classifier network self-evaluate its own performance through confidence score assessment. The network automatically identifies samples that need retraining based on low confidence predictions, eliminating the need for manual labeling and intervention. This self-service mechanism resolves the contradiction by maintaining high accuracy through automated iterative improvement while minimizing human time and effort investment.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system implements a feedback loop where the classifier network's confidence scores are continuously monitored and fed back into the training process. Samples with low confidence predictions are automatically identified and added to the retraining pool, creating a closed-loop system that continuously improves accuracy. This feedback mechanism enables the system to maintain high detection accuracy while reducing manual intervention time, as the automated feedback-driven retraining replaces manual labeling efforts.

Inventive Principle:
Principle #23Feedback

2Reliability

If extensive manual labeling is performed to train classifier networks, then classification reliability can be improved, but the complexity of the training process increases

Engineering Contradiction:
Improveclassification reliabilityVSAvoidtraining process complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The classifier network automatically manages its own training requirements by self-evaluating confidence scores and identifying samples that need retraining. This self-service approach simplifies the training process complexity while maintaining reliability, as the system autonomously determines when and what to retrain without complex manual intervention protocols or extensive human labeling workflows.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system extracts only the critical subset of samples that actually need retraining based on confidence score thresholds, rather than requiring extensive manual labeling of all possible samples. By taking out only the necessary samples for retraining, the system maintains high classification reliability while significantly reducing training process complexity compared to comprehensive manual labeling approaches.

Inventive Principle:
Principle #2Taking out (Extraction)

3Device complexity

If a single classifier is used for object detection, then the system is simpler to implement, but it cannot effectively detect objects whose appearance changes dramatically

Engineering Contradiction:
Improveclassifier system simplicityVSAvoiddetection capability under varying conditions
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The system dynamically adapts by automatically creating multiple specialized classifier networks through iterative retraining on diverse sample subsets. Instead of using a static single classifier, the system evolves multiple classifiers that specialize in different object appearance variations. This dynamic approach maintains relative simplicity while dramatically improving adaptability to varying lighting, pose, and environmental conditions through automated ensemble generation.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The training process segments the overall training task into multiple specialized classifier networks, each trained on specific subsets of samples with particular characteristics. This segmentation allows the system to maintain simplicity at the individual classifier level while achieving high adaptability through the collective ensemble of specialized classifiers, resolving the contradiction between system simplicity and detection versatility.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS8948500B2Method of automatically training a classifier hierarchy by dynamic grouping the training samples
Publication Date: 2015.02.03 SEIKO EPSON CORP
  • US8948500B2 patent drawing
  • US8948500B2 patent drawing
  • US8948500B2 patent drawing

AI summary

The present invention uses dynamic grouping to divide up training samples to train different classification nodes. At the beginning of the training, all samples are in the same group. A clustering process is applied in the feature space of the selected feature vectors with cluster indexes accumulated. The average of all the accumulated cluster indexes is used as the threshold for splitting the samples into two groups. When the splitting criterion is met, samples are split into two groups based on their similarity in the feature space.