Aerial Bin Imaging for Faster Inventory Content Verification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In materials handling facilities, determining the content of inventory items in bins is resource-intensive and prone to errors, especially as facilities grow in size, requiring significant time and manual effort, which increases the likelihood of inaccuracies.

Innovation Solution

An automated aerial vehicle (AAV) equipped with image capture devices and illumination elements flies along rows of bins, capturing images and processing them using computer imaging programs, including machine learning, to determine bin content and identity, reducing the need for manual review by focusing on bins with low confidence scores.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual methods are used to determine bin content, then accuracy can be maintained through human verification, but time consumption and resource requirements increase significantly

Engineering Contradiction:
Improvebin content determination accuracyVSAvoidtime required for bin content determination
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces manual visual inspection with an automated imaging system using cameras and computer vision algorithms. The system captures images of bin contents and uses image processing to automatically identify and classify items, substituting human mechanical inspection with automated optical detection and computational analysis.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables self-service bin content determination where the imaging and image processing system automatically identifies items without requiring human intervention for each bin. The automated analysis provides item identification, quantity counting, and classification independently, with human review only needed for low-confidence results.

Inventive Principle:
Principle #25Self-service

2Reliability

If comprehensive manual inspection of all bins is performed, then complete inventory accuracy is achieved, but resource consumption and operational complexity increase

Engineering Contradiction:
Improveinventory accuracyVSAvoidoperational complexity of bin content determination
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system applies partial action by performing automated image processing on all bins but requiring manual verification only for a subset of bins with low confidence scores. This approach achieves comprehensive inventory monitoring while reducing operational complexity by limiting human intervention to cases where automated analysis is uncertain.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system implements feedback through confidence score evaluation, where the automated image processing system assigns confidence levels to its identifications. Low-confidence results trigger feedback loops for manual review, while high-confidence results proceed automatically, creating an adaptive process that maintains reliability while managing complexity.

Inventive Principle:
Principle #23Feedback

3Productivity

If automated imaging systems are deployed, then processing speed and coverage increase, but initial resource investment and system complexity increase

Engineering Contradiction:
Improvebin content determination throughputVSAvoidcomplexity of automated imaging system
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The imaging system achieves multi-functionality by using the same camera infrastructure and image processing platform for multiple purposes: bin content identification, item classification, quantity counting, and inventory tracking. This universal system replaces multiple specialized tools, increasing productivity while managing complexity through consolidation.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses optical copying through imaging to create digital representations of bin contents without physical handling. Cameras capture visual copies of items, and image processing creates digital inventories, enabling rapid assessment of multiple bins without the complexity of physical inspection protocols.

Inventive Principle:
Principle #26Copying

4Measurement precision

If manual verification is required for all bins, then high accuracy is maintained, but the process becomes resource-intensive and error-prone

Engineering Contradiction:
Improvebin content determination accuracyVSAvoidconsistency of bin content determination
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system performs preliminary automated image processing and analysis for all bins before any human review. This preliminary action pre-screens bins and identifies only those requiring manual verification, reducing human error by limiting exposure to fatigue-prone repetitive tasks while maintaining accuracy through layered verification.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The confidence score mechanism creates feedback that directs manual verification only where needed. High-confidence automated identifications proceed without human review, while low-confidence cases trigger feedback loops for verification, improving consistency by applying uniform automated standards while allowing human judgment for ambiguous cases.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10929810B1Bin content imaging and correlation using automated aerial vehicles
Publication Date: 2021.02.23 AMAZON TECH INC
  • US10929810B1 patent drawing
  • US10929810B1 patent drawing
  • US10929810B1 patent drawing

AI summary

This disclosure describes a system and method for utilizing an automated aerial vehicle for determining the content of items included in bins within a materials handling facility. In some implementations, the automated aerial vehicle may fly along a flight path past one or more bins (e.g., for imaging the bins to determine the content of the bins and for which the images may be correlated with the bins). The flight path for the automated aerial vehicle may be determined based on various parameters e.g., for most efficiently imaging the bins, etc.).