Multiple-Camera User Disambiguation via Trajectory Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current materials handling facilities face challenges in accurately identifying users and associating them with events, particularly in environments with multiple users and complex inventory management, where disambiguation and efficient data processing are necessary to optimize operations.

Innovation Solution

A multiple-camera system and process that utilizes image capture devices to determine user patterns, arm trajectories, and touch points, combined with inventory management systems, to accurately identify and associate users with events by processing image data and reducing occlusions, thereby enhancing the accuracy and efficiency of user and item tracking.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple camera systems are deployed to track multiple users in a materials handling facility, then user identification accuracy improves, but system complexity and data processing requirements increase

Engineering Contradiction:
Improveuser identification accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system divides the facility into multiple zones with cameras positioned at strategic locations, processing user trajectories in segments rather than attempting to track all users across the entire facility simultaneously. This reduces the computational burden on each camera system while maintaining overall tracking accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A central processing system acts as an intermediary that receives data from multiple camera systems, correlates user patterns across different camera views, and resolves ambiguities. This intermediary coordinates the multiple camera systems to work together as a unified tracking network.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If multiple camera systems are deployed to track multiple users, then event association accuracy improves, but data processing time and computational load increase

Engineering Contradiction:
Improveevent association accuracyVSAvoiddata processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system pre-processes camera data to extract and store key user characteristics, movement patterns, and trajectory segments as users pass through different zones. This preliminary processing organizes data in advance, reducing the computational burden during event association and enabling faster real-time analysis.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system continuously compares observed user trajectories against expected patterns and adjusts processing priorities based on detected anomalies or high-value events. This feedback mechanism optimizes data processing by focusing computational resources on critical associations rather than uniformly processing all data streams.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If detailed image data is processed from multiple cameras to disambiguate users, then user identification precision improves, but computational resources and processing complexity increase

Engineering Contradiction:
Improveuser identification precisionVSAvoidcomputational resources
Core Design Contradiction:
Measurement precisionVSPower

Solution Approach 1:

The system extracts only the essential features from camera images needed for user identification, such as trajectory patterns, movement speed, and directional vectors, rather than processing complete high-resolution images. This extraction approach maintains identification precision while dramatically reducing computational requirements.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Different levels of image processing are applied to different regions of interest within camera fields of view. Areas where user disambiguation is critical receive more detailed processing, while less critical areas use simplified processing, optimizing the balance between identification precision and computational resource usage.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10552750B1Disambiguating between multiple users
Publication Date: 2020.02.04 AMAZON TECH INC
  • US10552750B1 patent drawing
  • US10552750B1 patent drawing
  • US10552750B1 patent drawing

AI summary

Described is a multiple-camera system and process for disambiguating between multiple users and identifying which of the multiple users performed an event. For example, when an event is detected, user patterns near the location of the event are determined, along with touch points at the location of the event. User pattern orientation and/or arm trajectories between the event location and the user patterns may be determined and processed to disambiguate between multiple users and determine which user pattern is involved in the event.