Agent Re-Verification Using Multiple-Camera Feature Vectors

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In materials handling facilities, tracking agents becomes challenging due to drops (loss of tracking when agents move out of view or become obscured) and flips (misidentification of agents when they are close to each other, leading to incorrect tracking and item list updates).

Innovation Solution

A multiple-camera system generates feature vectors from multiple angles to create agent models, which are used to re-verify agent identity through probe agent models, comparing similarity scores to correct tracking errors and update item lists accurately.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If agents move quickly through the facility, then productivity increases, but tracking reliability decreases due to drops and flips

Engineering Contradiction:
Improveagent throughputVSAvoidtracking reliability
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system performs preliminary actions by capturing images at multiple locations (entrance, interior, exit) before tracking issues occur. Probe agent models are generated in advance and stored for later comparison when drops or flips are detected, enabling corrective actions to be taken after the fact rather than preventing the issues in real-time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements feedback mechanisms by continuously comparing current agent models against stored probe agent models and historical data. When similarity scores indicate potential drops or flips, the system triggers re-verification processes and updates tracking information, creating a closed-loop feedback system that maintains accuracy despite rapid movement.

Inventive Principle:
Principle #23Feedback

2Reliability

If multiple cameras are deployed throughout the facility, then tracking reliability improves, but device complexity increases

Engineering Contradiction:
Improvetracking reliabilityVSAvoidcamera system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The camera system is segmented into functional zones (entrance cameras, interior cameras, exit cameras) each responsible for specific tracking tasks. This segmentation allows the complex system to be managed modularly, with each camera group handling specific aspects of agent tracking and providing targeted coverage for common drop/flip scenarios.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Multiple cameras serve multiple functions: they capture images for initial agent identification, generate probe agent models for re-verification, detect drops and flips, and provide historical data for tracking corrections. This multi-functionality reduces the need for separate specialized systems, managing complexity through versatile components.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If re-verification processes are implemented, then tracking accuracy improves, but processing time increases

Engineering Contradiction:
Improveagent identification accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs re-verification periodically at key locations (entrance, interior, exit) rather than continuously. This periodic approach maintains tracking accuracy at critical transition points where drops and flips are most likely to occur, while avoiding the time cost of continuous re-verification throughout the entire facility.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

Probe agent models are generated and stored in advance at multiple locations before tracking issues occur. When an agent is detected, the system compares current images against pre-generated probe models rather than creating new models in real-time, significantly reducing processing time while maintaining high identification accuracy.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11961303B1Agent re-verification and resolution using imaging
Publication Date: 2024.04.16 AMAZON TECH INC
  • US11961303B1 patent drawing
  • US11961303B1 patent drawing
  • US11961303B1 patent drawing

AI summary

Described is a multiple-camera system and process for detecting, tracking, and re-verifying agents within a materials handling facility. In one implementation, a plurality of feature vectors may be generated for an agent and maintained as an agent model representative of the agent. When the object being tracked as the agent is to be re-verified, feature vectors representative of the object are generated and stored as a probe agent model. Feature vectors of the probe agent model are compared with corresponding feature vectors of candidate agent models for agents located in the materials handling facility. Based on the similarity scores, the agent may be re-verified, it may be determined that identifiers used for objects tracked as representative of the agents have been flipped, and/or to determine that tracking of the object representing the agent has been dropped.