Inventory Return Image Scoring for Misplaced Shelf Items

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Inventory management systems face challenges in accurately determining the tidiness of inventory locations, leading to errors in inventory tracking and billing due to incorrectly placed items, which can result in incorrect quantity calculations and unreliable data.

Innovation Solution

The system uses image data from cameras to generate an untidy score by comparing cropped images of inventory locations with stored item data, employing correct item verification and invalid item recognition scores to determine the likelihood of incorrectly placed items, thereby triggering corrective actions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual inventory checking is performed, then inventory accuracy can be maintained, but labor time and operational complexity increase significantly

Engineering Contradiction:
Improveinventory accuracyVSAvoidlabor time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent replaces manual visual inspection and physical inventory checking with an automated computer vision system using cameras and machine learning algorithms. The system automatically captures images of inventory locations, processes them through trained models to identify misplaced items, and generates alerts without requiring human labor for routine checking, thereby maintaining accuracy while eliminating time loss.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The inventory system performs self-monitoring through automated image capture and analysis. The machine learning model continuously evaluates inventory images and autonomously identifies untidy conditions, enabling the system to check itself without external intervention and freeing up human workers from manual counting and verification tasks.

Inventive Principle:
Principle #25Self-service

2Reliability

If comprehensive inventory monitoring is implemented, then inventory tracking reliability improves, but system complexity and computational resources increase

Engineering Contradiction:
Improveinventory tracking reliabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent divides the inventory monitoring task into distinct segments: image capture by cameras, pre-processing of images, feature extraction, classification by machine learning models, and alert generation. Each component handles a specific portion of the workflow independently, reducing overall system complexity while maintaining comprehensive monitoring capability through modular architecture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system introduces an intermediary machine learning model that acts as a bridge between raw image data and inventory status determination. The model processes images and translates them into structured information about item placement accuracy, simplifying the connection between physical inventory and digital tracking systems without requiring direct complex integration.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If automated image processing is used to identify misplaced items, then detection speed increases, but measurement precision may decrease due to algorithm errors

Engineering Contradiction:
Improvedetection speedVSAvoiditem identification accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system performs preliminary training of machine learning models using labeled datasets of correctly and incorrectly placed items before deployment. This pre-training establishes accurate classification boundaries and reduces algorithm errors during actual operation, ensuring both high detection speed and precise item identification without requiring post-processing corrections.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements feedback mechanisms where detection results are validated against ground truth data when available, and model performance is continuously evaluated. Error patterns are fed back into the training process to refine the algorithm, improving both speed and precision over time through iterative optimization based on real-world performance data.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11117744B1Determination of untidy item return to an inventory location
Publication Date: 2021.09.14 AMAZON TECH INC
  • US11117744B1 patent drawing
  • US11117744B1 patent drawing
  • US11117744B1 patent drawing

AI summary

A user may place an item at an inventory location in an incorrect location, such as the wrong lane on the shelf. An untidy score is generated that is indicative of whether an item is where it is supposed to be. A correct item verification (CIV) score is determined that is indicative of how similar the returned item is to the type of item that is supposed to be stored at that location. An invalid item recognition (IIR) score is determined that is indicative of similarity of the returned item to a set of items associated with the user, that set excluding the item that is supposed to be stored at that location. The CIV and the IIR are combined to generate an untidy score. Based on the untidy score, someone may be dispatched to clean up the inventory location.