Augmented Reality Bin Guidance for Hardware-Light Inventory Picking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current inventory management systems in large-scale fulfillment centers rely on expensive and bulky camera and projector systems, as well as RFID technology, which can be imprecise and require complex installation, leading to system downtime and inefficiencies in item picking and placement tasks.
Innovation Solution
An augmented, mixed, or virtual reality system is used to localize mobile storage units and bins, providing intuitive graphical guidance through an augmented, mixed, or virtual reality interface that highlights the appropriate bins and detects user interactions, reducing the need for extensive hardware by using computer vision and machine learning techniques to generate and refine virtual objects based on fiducials or object detection models.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If camera and projector systems are used for inventory management, then item picking and placement guidance can be provided, but the system becomes expensive and bulky with complex installation requirements
Solution Approach 1:
The patent extracts the essential function of visual guidance from the complex camera-projector system and implements it through a wearable computing device with display. This removes the bulky external hardware while retaining the core capability of providing directional guidance to workers for item picking and placement.
Solution Approach 2:
The wearable computing device serves multiple functions: it provides guidance information, tracks worker location, identifies bins and items, and communicates with the inventory management system. This multi-functional approach replaces the specialized camera and projector systems with a single integrated device.
2Loss of information
If RFID technology is used for item tracking, then inventory information can be obtained, but precision is reduced and complex installation is required
Solution Approach 1:
The patent uses visual copying through image capture and processing to identify items and bins. Instead of relying on RFID signals that may be imprecise, the system captures images, processes them to extract visual features, and uses these features for accurate identification and tracking of inventory items.
Solution Approach 2:
The patent replaces the electromagnetic RFID detection system with a visual-based system using cameras and image processing. This substitution allows for more precise identification by using visual features such as barcodes, labels, and physical characteristics of items and bins.
3Reliability
If extensive hardware is deployed for inventory management, then coverage is improved, but system downtime increases and operational efficiency decreases
Solution Approach 1:
The wearable computing device operates autonomously, capturing images, processing them locally, and providing real-time guidance without requiring constant system intervention. This self-service capability reduces system downtime and maintains operational efficiency while providing comprehensive inventory management coverage.
Solution Approach 2:
The system performs preliminary image capture and processing before the worker needs the information. By pre-processing visual data and preparing guidance information in advance, the system ensures continuous operation without downtime while maintaining comprehensive coverage of inventory management tasks.
Data Source
AI summary
In various examples, an augmented, mixed, or virtual reality device comprising a camera and a display may determine first storage buffer with a first bin in a physical environment. The augmented, mixed, or virtual reality device may generate a first virtual object including a first virtual bin, the first virtual object corresponding to the first storage buffer and the first virtual bin corresponding to the first bin. The augmented, mixed, or virtual reality device may receive first data indicating a first object located in the first bin. First graphical data highlighting the first virtual bin may be generated. The first graphical data highlighting at least the portion of the first virtual bin on a first portion of the display may be generated. The first portion of the display may overlay at least a portion of the first bin in a field of view of the camera.