Gesture Control System for Touch-Based Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional mobile devices lack an alternative form of control for users to interact with touch-based applications displayed on external devices, such as televisions, beyond physical touch inputs, limiting user experience and functionality.
Innovation Solution
The system facilitates gesture-based user inputs by obtaining video and image data from a user at a distance, processing it to detect gestures, and converting these into appropriate touch-based commands for the mobile device, allowing non-contact control of touch-based applications.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If gesture-based control is implemented without physical contact, then user experience is enhanced and control flexibility is improved, but device complexity increases due to additional sensors and processing requirements
Solution Approach 1:
The patent introduces an intermediary processing layer that captures gestures from multiple sources (touchscreen, microphone, game controller, remote control) and translates them into unified commands. This mediator component handles the complexity of multiple input modalities without requiring the core application logic to change, thus improving ease of operation while containing device complexity through modular architecture.
Solution Approach 2:
The system implements a universal control interface that accepts multiple types of inputs (touch, voice, game controller, remote control) and processes them through a common gesture recognition engine. This multi-functional approach allows a single system to handle diverse control methods, enhancing operational flexibility without requiring separate processing paths for each input type.
2Adaptability or versatility
If video and image data processing is used to detect gestures at a distance, then non-contact control is enabled, but processing time and computational resources increase
Solution Approach 1:
The system implements partial processing by selectively analyzing only the necessary portions of video and image data for gesture detection. Rather than processing complete high-resolution frames, the system focuses on specific regions of interest where gestures are likely to occur, reducing computational load and processing time while maintaining accurate gesture recognition capability.
Solution Approach 2:
The patent employs preliminary action through pre-processing steps that prepare video and image data before full gesture analysis. This includes initial filtering, noise reduction, and feature extraction that simplify subsequent gesture detection operations, thereby reducing the time required for comprehensive gesture recognition while enabling versatile non-contact control.
3Adaptability or versatility
If multiple input sources are integrated (touchscreen, voice, game controller, remote control), then control options are expanded, but system integration complexity increases
Solution Approach 1:
The system segments the control architecture into distinct modular components: touchscreen input module, voice recognition module, game controller interface module, remote control interface module, and a central gesture translation module. Each module handles its specific input type independently, and the segmentation allows for easier integration, maintenance, and troubleshooting while providing expanded control options through the combined functionality of all modules.
Data Source
AI summary
A device includes one or more input devices; one or more processors communicatively coupled to the one or more input devices; and memory storing instructions that, when executed cause the one or more processors to receive command inputs from the one or more input devices, process the received command inputs to determine translated inputs, and perform operations based on the determined translated inputs. The translated inputs are between different modes.