3D Gesture Virtual Keyboard Activation for Display Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users need to perform additional operations to display a virtual keyboard for character input on multimedia devices, which can be inconvenient.
Innovation Solution
A display device with a camera and controller that captures hand gestures in 3D space to selectively display a virtual keyboard for character input, determining the gesture based on hand position and motion, allowing input without manual keyboard activation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a virtual keyboard is displayed only after manual activation, then device operation complexity is reduced, but user input convenience deteriorates
Solution Approach 1:
The system automatically detects hand gestures and activates the virtual keyboard without requiring manual user commands. The camera captures hand movements, the controller analyzes gesture patterns, and the display automatically presents the keyboard when gesture criteria are met, enabling the system to serve itself rather than requiring explicit activation commands from the user.
Solution Approach 2:
The patent replaces traditional mechanical or manual keyboard activation mechanisms with an optical gesture recognition system. Instead of requiring users to press physical keys or navigate through menus to activate the keyboard, the system uses camera-based gesture detection to automatically trigger keyboard display, substituting mechanical interaction with optical field-based detection.
2Productivity
If gesture recognition is implemented to automatically display virtual keyboard, then user input efficiency is improved, but system complexity increases
Solution Approach 1:
The gesture recognition system is divided into distinct functional modules: a camera module for capturing hand gestures, a controller module for analyzing gesture patterns and determining intent, and a display module for presenting the virtual keyboard. This segmentation allows each component to specialize in its function, improving overall processing efficiency while making the complex system more manageable and maintainable.
Solution Approach 2:
The system continuously captures and pre-analyzes hand gestures in real-time before actual character input is needed. By maintaining readiness to detect activation gestures and pre-loading the virtual keyboard, the system eliminates delays between gesture recognition and keyboard display, thereby improving character input speed without requiring complex real-time processing during the actual typing phase.
3Loss of time
If additional operations are required to display virtual keyboard, then system resource consumption is reduced, but user operation time increases
Solution Approach 1:
The camera and gesture recognition system operate periodically rather than continuously, activating at regular intervals to capture hand gestures. This periodic operation reduces overall energy consumption compared to continuous monitoring, while still providing timely keyboard activation by maintaining a rhythm of detection that is frequent enough to capture user intent without excessive energy expenditure.
Solution Approach 2:
The system uses a simplified gesture recognition approach that detects only the essential characteristics needed for keyboard activation, rather than analyzing all possible hand movements in detail. By implementing partial gesture recognition that focuses only on the critical activation gesture patterns, the system achieves fast keyboard display while consuming less energy than a comprehensive gesture analysis system would require.
Data Source
AI summary
Disclosed are a display device and a control method thereof. The display device includes a display, a camera capturing a gesture in a three dimensional space; and a controller selectively displaying a virtual keyboard corresponding to a hand gesture for character input on the display when the captured gesture includes the hand gesture for the character input. Accordingly, the virtual keyboard corresponding to the hand gesture for the character input is displayed, so that the user may not perform an additional operation to display the virtual keyboard.