Sensor Data Fusion for Inventory Interaction Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current inventory management systems in material handling facilities face challenges in accurately and efficiently tracking interactions such as picking and placing of items across multiple sensors, often resulting in low confidence levels in interaction data due to inconsistent sensor data.

Innovation Solution

The system employs data fusion techniques to combine hypotheses from multiple sensors, using Bayes' rule to aggregate data from different types of sensors and processing methods, and discards inconsistent hypotheses to generate high-confidence interaction data, ensuring accurate tracking of inventory levels and user interactions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple sensors are used to track interactions, then measurement coverage is improved, but data consistency and reliability deteriorate due to inconsistent sensor data

Engineering Contradiction:
Improveinteraction detection accuracyVSAvoiddata consistency
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent combines data from multiple sensors (weight sensors, optical sensors, RFID readers) through data fusion techniques. The system aggregates hypotheses from different sensor types and uses consistency checking to merge reliable data while filtering out inconsistent information, thereby maintaining high measurement precision across multiple sensors without sacrificing data reliability

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system implements feedback mechanisms where sensor data is continuously validated against expected interaction patterns. Inconsistent sensor readings trigger re-evaluation and cross-validation with other sensors, allowing the system to correct anomalies and maintain reliable interaction detection despite the complexity of multiple data sources

Inventive Principle:
Principle #23Feedback

2Measurement precision

If data fusion from multiple sensors is implemented, then interaction detection accuracy is improved, but system complexity increases

Engineering Contradiction:
Improveinteraction detection accuracyVSAvoiddata processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the data fusion process into distinct modules: individual sensor data acquisition, hypothesis generation for each sensor type, consistency checking, and final interaction determination. This modular segmentation reduces processing complexity by handling each sensor type independently before integration, while still achieving high interaction detection accuracy through systematic combination of results

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces an intermediary processing layer that translates diverse sensor data formats into a common hypothesis structure. This intermediary layer standardizes data from different sensor types before fusion, simplifying the integration process and reducing overall system complexity while maintaining the ability to detect interactions with high precision

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11042836B1Fusion of sensor data for detecting interactions at an inventory location
Publication Date: 2021.06.22 AMAZON TECH INC
  • US11042836B1 patent drawing
  • US11042836B1 patent drawing
  • US11042836B1 patent drawing

AI summary

Items may be stowed in an inventory location, such as a shelf. An interaction may take place where one of the items is picked from or placed on the inventory location. Sensor data can be acquired from two or more sensors, such as cameras or weight sensors, configured to collect such sensor data for the inventory location. Hypotheses to describe interactions at the inventory location may be determined using sensor data from each different sensor. However, the confidence value for such hypotheses may not be reliable. Fusion of sensor data may be performed where sets of hypotheses from the different sensors are combined and the resulting hypotheses are more accurate.