Inventory System Using Expression Detection for Item Location Assistance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users often face difficulties in locating items within materials handling facilities, such as warehouses and retail stores, leading to frustration and inefficiencies in inventory management.

Innovation Solution

An inventory management system that utilizes image capture devices, gesture, and expression detection to provide assistance to users through audible, visual, or haptic cues, and dispatching associates to help locate items, based on user interactions and preferences.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If users search for items manually in materials handling facilities, then users can locate items independently, but users experience frustration and inefficiency due to difficulty in locating items

Engineering Contradiction:
Improveitem location efficiencyVSAvoiduser frustration
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The system enables self-service through automated expression detection and gesture recognition, where the inventory management system autonomously detects user frustration through facial expressions and macroexpressions, then automatically provides assistance without requiring users to manually request help, thereby improving efficiency while maintaining ease of operation

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system implements feedback loops by continuously monitoring user expressions and behaviors, detecting frustration levels, and adjusting assistance provision accordingly. The system receives feedback from gesture recognition and expression analysis, then responds with appropriate assistance levels, creating a dynamic system that adapts to user needs in real-time

Inventive Principle:
Principle #23Feedback

2Ease of operation

If the inventory management system provides assistance to all users, then user satisfaction improves, but system complexity and resource consumption increase

Engineering Contradiction:
Improveuser satisfactionVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system applies partial action by providing assistance selectively rather than universally. It detects user expressions and frustration levels to determine which users need assistance, applying the assistance function only to those who exhibit signs of difficulty, thereby reducing overall system complexity while maintaining high user satisfaction for those who need help

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The system implements local quality by tailoring assistance provision to individual users based on their specific expressions and behaviors. Different users receive different levels of assistance based on their detected needs, with the system concentrating resources on users showing frustration rather than uniformly assisting all users, thus reducing overall system complexity

Inventive Principle:
Principle #3Local quality

3Adaptability or versatility

If the system detects user expressions and gestures, then personalized assistance is provided, but measurement and detection difficulty increases

Engineering Contradiction:
Improvepersonalized assistanceVSAvoidexpression detection complexity
Core Design Contradiction:
Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The system achieves versatility through multi-functional detection capabilities that identify various types of expressions (facial expressions, macroexpressions, gestures) using integrated image capture devices and processing algorithms. This universal detection approach enables personalized assistance while managing detection complexity through consolidated multi-purpose detection systems rather than separate specialized systems for each expression type

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11232509B1Expression and gesture based assistance
Publication Date: 2022.01.25 AMAZON TECH INC
  • US11232509B1 patent drawing
  • US11232509B1 patent drawing
  • US11232509B1 patent drawing

AI summary

This disclosure describes a system for assisting users in locating items from inventory locations and/or obtaining additional information about items. In some instances, a user may experience difficulty in locating an inventory item in a materials handling facility. By detecting one or more expressions presented by the user, an inventory management system may determine that assistance is to be provided to the user, determine and provide the appropriate assistance to the user.