Iterative Constrained Partitioning for Video Track Annotation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for annotating individuals in sequences of images fail to effectively incorporate external constraints and multi-camera acquisitions, leading to inaccuracies in automatic annotations.

Innovation Solution

A computer-implemented method using an iterative constrained partitioning algorithm that extracts tracks from images, computes individual signatures, and applies constraints from sensors and user interactions to improve annotation accuracy, allowing for multiple iterations of validation and refinement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If classification or partitioning techniques are used for annotating individuals, then the annotation process can be automated, but the accuracy of annotations deteriorates due to inability to incorporate external constraints

Engineering Contradiction:
Improveautomation of annotation processVSAvoidaccuracy of annotations
Core Design Contradiction:
Extent of automationVSMeasurement precision

Solution Approach 1:

The patent implements an iterative annotation process where the system generates automatic annotations, receives feedback in the form of constraints from sensors and user interactions, and refines the annotations in subsequent iterations. This feedback loop enables the system to progressively improve annotation accuracy while maintaining automation, directly resolving the contradiction between automation extent and annotation precision.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent transforms the static, single-iteration classification approach into a dynamic, multi-iteration process. The annotation system adapts over time by incorporating new constraints and refining groupings across multiple iterations, allowing it to maintain high automation while progressively improving accuracy through dynamic adjustment of annotation parameters.

Inventive Principle:
Principle #15Dynamics

2Productivity

If single-iteration partitioning is used, then the processing speed is maintained, but the annotation accuracy deteriorates due to lack of iterative refinement

Engineering Contradiction:
Improveprocessing speedVSAvoidannotation accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent performs preliminary grouping in the first iteration to establish initial annotations quickly, then uses subsequent iterations to refine these groupings based on additional constraints. This preliminary action approach allows the system to maintain high initial processing speed while achieving improved accuracy through targeted refinements in later iterations, rather than performing exhaustive analysis from the start.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent applies partial refinement in each iteration, focusing computational resources on refining specific groupings that benefit most from additional constraints rather than reprocessing all data equally. This selective iterative refinement maintains productivity by avoiding redundant computations while still achieving significant accuracy improvements through cumulative refinement across iterations.

Inventive Principle:
Principle #16Partial or excessive action

3Device complexity

If multi-camera acquisitions are not properly handled, then the system complexity is reduced, but the annotation reliability deteriorates due to inability to incorporate spatial and temporal constraints

Engineering Contradiction:
Improvesystem complexityVSAvoidannotation reliability
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent segments the multi-camera annotation problem into manageable components by processing each camera's data independently to extract tracks and compute signatures, then integrating these segments through the partitioning algorithm that incorporates inter-camera spatial and temporal constraints. This segmentation approach reduces system complexity by breaking down the complex multi-camera problem while maintaining reliability through constraint-based integration of segmented results.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces the constrained partitioning algorithm as an intermediary that mediates between multiple camera data sources. This intermediary component receives tracks from various cameras, applies spatial and temporal constraints as mediation rules, and produces integrated annotations that maintain reliability across multi-camera acquisitions without requiring direct complex interactions between all camera systems.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Reliability

If user constraints and sensor constraints are incorporated, then the annotation reliability is improved, but the ease of operation deteriorates due to additional validation steps

Engineering Contradiction:
Improveannotation reliabilityVSAvoidease of validation
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent implements self-service mechanisms where the system automatically processes user constraints and sensor constraints through the iterative partitioning algorithm without requiring manual intervention at each step. The system serves itself by automatically refining annotations based on provided constraints, reducing the operational burden on users while maintaining high reliability through systematic constraint incorporation across multiple iterations.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS20240212373A1Method for annotating tracks of individuals in a sequence of images
Publication Date: 2024.06.27 COMMISSARIAT A LENERGIE ATOMIQUE ET AUX ENERGIES ALTERNATIVES
  • US20240212373A1 patent drawing
  • US20240212373A1 patent drawing
  • US20240212373A1 patent drawing

AI summary

A method for annotating tracks acquired from a camera, includes the following steps: receiving at least one sequence of images acquired using at least one camera, extracting, from the at least one sequence of images, at least one track of an unknown individual, computing, for each track of individuals, a signature of the individual, executing multiple iterations of a constrained partitioning algorithm on the tracks based on their signature, the algorithm being configured to partition the tracks into at least one group of recommended individuals or into a group of individuals without a recommendation, in each new iteration, providing the partitioning algorithm with at least one new constraint and executing a step of validating the identity of the individuals classified in the group of recommended individuals. If the identity of the individual is validated, annotating the individual with this identity and transferring them to a group of annotated individuals.