User-Adaptive Order Terminal Using Voice and Gesture Inputs
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing retail management systems face challenges in order entry and processing due to environmental contaminants that can damage electronic devices, and they often require physical contact, which can be cumbersome and inefficient.
Innovation Solution
A user-adaptive order processing terminal that employs a combination of 3D gestures, voice commands, and facial recognition to accelerate order placement and completion, using a display, microphone, and motion sensor to detect and interpret user inputs, allowing for hands-free operation and reducing device contamination.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If touchscreen-based ordering systems are used, then order entry and processing can be automated, but electronic devices are prone to damage from environmental contaminants and require physical contact that reduces efficiency
Solution Approach 1:
The patent replaces the mechanical touchscreen interface with voice recognition and gesture-based controls. The voice recognition system captures audio commands through a microphone, processes them to identify menu items, and executes orders without requiring physical contact with the device. This substitution eliminates the reliability issues associated with touchscreen contamination while maintaining automation benefits.
Solution Approach 2:
The patent introduces voice commands and gesture recognition as intermediary interfaces between the user and the ordering system. Instead of direct touchscreen contact, users speak commands or perform gestures that are captured by sensors and processed by the system. This intermediary layer protects the electronic device from contaminants while enabling automated order entry.
2Productivity
If touchscreen interaction is required, then order processing can be performed, but physical contact becomes cumbersome and reduces operational efficiency
Solution Approach 1:
The patent replaces manual touchscreen operations with voice-based and gesture-based control mechanisms. Users can place orders, modify selections, and complete transactions by speaking commands or performing simple gestures, eliminating the need for cumbersome touchscreen interactions. This substitution significantly improves both processing speed and operational convenience.
Solution Approach 2:
The voice recognition system enables users to independently place and manage their own orders without requiring staff assistance or complex manual navigation. The system interprets spoken commands and automatically processes the order, allowing users to serve themselves efficiently without the inconvenience of traditional touchscreen interfaces.
3Adaptability or versatility
If traditional touchscreen systems are used, then order entry can be performed, but the interface does not adapt to different user needs or environmental conditions
Solution Approach 1:
The patent implements a dynamic interface that automatically adapts to different user preferences and environmental conditions. The system can switch between voice recognition, gesture control, and other input modes based on user selection or environmental factors such as background noise levels. This dynamic adaptability allows the same device to serve multiple functions and user types without requiring separate specialized systems.
Solution Approach 2:
The patent creates a universal ordering system that can accommodate multiple input methods (voice, gestures, and potentially other modes) within a single device. This multi-functional approach allows the system to adapt to different user needs, environmental conditions, and accessibility requirements without increasing overall system complexity, as all functions are integrated into one platform.
Data Source
AI summary
A user-adaptive order processing terminal includes a display, a microphone, a configuration manager, and a motion sensor. The display displays electronic menu items in a first area for selection by a user, where the electronic menu items are accessed via selection of one or more sub-menu items. The microphone detects audio spoken by the user. The configuration manager captures the audio from the microphone, transmits the audio via first messages to a backend server, receives second messages from the backend server providing text that corresponds to the audio, accesses suggested menu items that correspond to the text, and modifies a second area of the display to present the suggested menu items for selection, where the suggested menu items would otherwise be presented in the first area through selection of the one or more sub-menu items. The motion sensor subsequently detects distance to and motions performed by the user, where the configuration manager captures movements of the user from the motion sensor, transmit the motions via third messages to the backend server, receives fourth messages from the backend server providing 3-dimensional (3D) gestures that correspond to the movements, and adds one or more of the suggested menu items to an electronic order in accordance with the 3D gestures.