Dual AI Model Crowd Counting with Annotation Error Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for crowd counting using artificial intelligence models face significant errors due to partial occlusions in crowd images and the high fatigue and error rate of manual annotation processes for training these models.

Innovation Solution

A method involving two AI models, where the first model is trained on a dataset with potential annotation errors and the second model corrects a portion of these errors during each training epoch, allowing for more accurate crowd counting predictions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If traditional object recognition with bounding boxes is used for crowd counting, then the method is simple to implement, but significant errors occur due to frequent occlusions of body parts

Engineering Contradiction:
Improveease of implementationVSAvoidcrowd counting accuracy
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent segments the crowd counting task from traditional full-body object recognition. Instead of detecting entire human bodies with bounding boxes, the method divides the task into detecting specific key body parts (head, torso, limbs) separately. This segmentation allows the system to count individuals even when full bodies are occluded, as long as key parts are visible, thereby improving accuracy while maintaining implementation simplicity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from two-dimensional bounding box detection to a more sophisticated multi-dimensional approach by tracking multiple body parts across different spatial dimensions and temporal frames. This dimensional expansion allows the system to reconstruct complete person identities from partial observations, resolving the contradiction between simple implementation and accurate counting under occlusion.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If manual annotation is used to build training datasets with precise location markers, then annotation accuracy can be improved, but annotator fatigue and error rates increase significantly

Engineering Contradiction:
Improveannotation accuracyVSAvoidannotator consistency
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent implements self-service annotation where the AI model automatically generates initial annotations for training data. The system uses semi-supervised learning where manually annotated data is used to train the model, which then generates annotations for additional data. This self-annotation capability reduces annotator fatigue and improves consistency, as the model applies the same annotation criteria uniformly across all data without human variability.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent performs preliminary automated annotation before final manual review. The AI model pre-processes and generates draft annotations that are then refined by annotators. This preliminary action reduces the time and effort required for manual annotation while maintaining high accuracy, as annotators only need to correct rather than create annotations from scratch.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If annotation errors are present in the training dataset, then the model training process becomes simpler, but the model cannot accurately predict crowd counting

Engineering Contradiction:
Improvetraining efficiencyVSAvoidprediction accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent implements feedback mechanisms in the training process where the model's predictions are continuously evaluated against ground truth data. Annotation errors are detected through this feedback loop, and the training process incorporates error correction by adjusting weights and parameters based on prediction performance. This allows the system to maintain training efficiency while progressively improving prediction accuracy by learning from and correcting annotation errors.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent employs dynamic training where the importance of different training samples is adjusted based on their annotation quality and the model's current performance. Samples with suspected annotation errors are down-weighted or re-examined during training. This dynamic approach allows the system to efficiently train on large datasets containing some errors while maintaining high prediction accuracy by adaptively focusing on reliable training data.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS20250139974A1Method for estimating a crowd counting, a method for training a model for estimation of the crowd counting, and an electronic device for performing the same
Publication Date: 2025.05.01 NOTA INC
  • US20250139974A1 patent drawing
  • US20250139974A1 patent drawing
  • US20250139974A1 patent drawing

AI summary

The method of estimating a crowd counting according to an embodiment of the present invention includes receiving a first model for a crowd counting estimation that is trained based on a data set, wherein the data set includes an image and a reference annotation corresponding to a human object in the image and includes a sample that is the reference annotation having an error, receiving a second model for a crowd counting estimation that is trained by correcting a portion of the reference annotation included in the data set during each training epoch, receiving a target image, and generating a first crowd counting predicting the number of crowds present in the target image from the target image through the first model and a second crowd counting predicting the number of crowds present in the target image from the target image through the second model.