Gesture Recognition System for Contactless Symbol Entry
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current human-machine interfaces, such as computers and devices, are inefficient for data entry as they rely on keyboards and mice, which are slow compared to natural human communication methods like gestures, and have not been effectively configured to recognize and process hand motions for symbol entry.
Innovation Solution
A gesture recognition system that uses an imaging system to track hand motions and recognize symbols on a display screen, allowing users to select and enter symbols without physical contact, with optional manual controller integration for flexibility.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If keyboards and mice are used for data entry, then device compatibility and reliability are maintained, but data entry speed and naturalness deteriorate
Solution Approach 1:
The patent replaces mechanical input devices (keyboards and mice) with an optical imaging system that captures and processes hand gestures. The imaging system uses cameras to detect hand positions and movements, converting physical gestures into digital signals without mechanical contact, thereby increasing data entry speed and naturalness.
Solution Approach 2:
The patent introduces hand gestures as an intermediary between the user and the computer system. Instead of direct mechanical interaction with keyboards or mice, users perform natural hand movements that are captured by the imaging system and translated into commands, creating a more natural interaction bridge.
2Productivity
If gesture recognition system is implemented, then data entry speed and naturalness are improved, but system complexity increases
Solution Approach 1:
The imaging system serves multiple functions: it captures images for gesture recognition, provides visual feedback by displaying hand icons on the screen, and can switch between gesture recognition mode and manual controller mode. This multi-functionality reduces the need for separate components, managing system complexity while maintaining enhanced productivity.
Solution Approach 2:
The system provides visual feedback by displaying hand icons on the screen at locations corresponding to the user's actual hand positions. This feedback mechanism helps users understand system recognition and adjust their gestures, improving usability without requiring complex additional hardware.
3Area of stationary object
If symbols are displayed in small size on screen, then screen space utilization is maximized, but selection precision deteriorates
Solution Approach 1:
The patent adds a temporal dimension to symbol selection by using sequential gestures. Users first perform a gross movement to select a symbol pod (coarse selection), then perform a second gesture to select the specific symbol within the pod (fine selection). This two-stage gesture process resolves the precision issue without requiring larger symbol display.
Solution Approach 2:
The patent segments the symbol selection process into two distinct stages: first selecting a symbol pod containing multiple symbols, then selecting the specific symbol within that pod. This segmentation allows symbols to remain small on screen while maintaining selection precision through the hierarchical selection process.
4Ease of operation
If gesture recognition mode is used, then naturalness and speed are improved, but reliability and control precision may deteriorate
Solution Approach 1:
The patent makes the system dynamically switchable between gesture recognition mode and manual controller mode. Users can choose the most appropriate interaction mode based on the task requirements, ensuring both naturalness (gesture mode) and control precision (manual mode) are available when needed.
Data Source
AI summary
An embodiment of the invention provides a gesture recognition system (GRS) that displays a graphical user interface in which symbols are grouped into “pods” on a display screen, and a user enters a desired symbol into a computer by selecting a pod containing the desired symbol, and then selecting the symbol from a display of the symbols in the selected pod using hand motions without having to contact the display screen or use a manual controller.