Mobile Terminal Gesture Control for Display Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current remote-controller input methods for application software on display devices, such as televisions, are inefficient as they require multiple button operations, leading to high costs and inconvenient user experiences when implementing gesture recognition, which increases hardware costs and deviates from user habits.
Innovation Solution
A gesture control method and system where a mobile terminal establishes a wireless connection with a display device, detects user gestures, converts them into operation instructions, and transmits these instructions to the display device, eliminating the need for gesture detection capabilities on the display device and allowing users to input commands using the mobile terminal.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If gesture detection capability is integrated into the display device, then gesture input function is achieved, but hardware cost increases significantly
Solution Approach 1:
The patent introduces a mobile terminal as an intermediary device that performs gesture detection and processing. The mobile terminal captures images, detects gestures, converts them into operation instructions, and transmits these instructions to the display device. This mediator approach allows gesture functionality to be achieved without integrating complex gesture detection hardware into the display device itself, thereby reducing hardware costs while maintaining the desired adaptability.
2Adaptability or versatility
If gesture detection is implemented on the display device, then gesture control is enabled, but user operation convenience decreases
Solution Approach 1:
The patent leverages the mobile terminal's existing camera and processing capabilities to perform gesture detection. The mobile terminal uses its own image capture device to take pictures, its processor to detect gestures and convert them into instructions, and its transmission module to send these instructions to the display device. This self-service approach utilizes the mobile terminal's inherent functionalities rather than requiring the display device to perform gesture detection, thereby improving user convenience while enabling gesture control.
3Measurement precision
If multiple button operations are required for application control, then precise input is achieved, but input efficiency decreases
Solution Approach 1:
The patent replaces the mechanical button-pressing system with an image-based gesture recognition system. Instead of requiring users to physically press multiple buttons on a remote controller, the system captures images of user gestures, automatically detects and recognizes these gestures, and converts them into operation instructions. This substitution eliminates the need for multiple sequential button operations, thereby improving input efficiency while maintaining input precision through accurate gesture recognition and conversion.
Data Source
AI summary
Provided are a gesture control method, a gesture control device and a gesture control system. The gesture control method includes: establishing, by a mobile terminal, a wireless communication connection with a display device; displaying, by the mobile terminal, a gesture input interface corresponding to a current application of the display device; detecting, by the mobile terminal, a user gesture; converting, by the mobile terminal, the user gesture into an operation instruction corresponding to the user gesture; and transmitting, by the mobile terminal, the operation instruction to the display device.