Camera Gesture Control for Smart TV Navigation and Commands
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Smart TVs are inefficiently controlled using remote controls with limited directional keys, leading to time-consuming interactions.
Innovation Solution
A control method and device that utilize a camera to capture images of a user's wrist and hand gestures to determine the movement trajectory of a navigation indicator and control commands independently, enhancing interaction efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If a remote control with four directional keys is used to control a smart TV, then the device structure remains simple, but the interaction efficiency becomes low and the control process becomes time-consuming
Solution Approach 1:
The patent replaces the mechanical remote control system with optical recognition technology. A camera captures images of the user's hand gestures, and image processing algorithms determine the intended control commands and navigation indicator positions, substituting mechanical button pressing with optical field-based gesture recognition to dramatically improve interaction efficiency
Solution Approach 2:
The patent introduces a camera as an intermediary device between the user and the smart TV. The camera captures hand gesture images, which are then processed to extract control information, serving as a mediator that translates physical gestures into digital control commands without requiring direct contact with the TV interface
2Speed
If hand gesture recognition is used to control the navigation indicator position, then the control speed improves, but the recognition accuracy may be affected by gesture complexity
Solution Approach 1:
The patent segments the hand gesture recognition into two independent parts: the first part of the hand determines the navigation indicator position, while the second part determines the control command. This segmentation allows each part to be recognized with simpler features, improving both speed and accuracy by avoiding the complexity of recognizing entire hand gestures
3Manufacturing precision
If the navigation indicator position and control command are determined from the same hand gesture, then the system complexity remains low, but the control accuracy decreases when the user's hand moves quickly
Solution Approach 1:
The patent divides the control information extraction into two separate functions: one for determining navigation indicator position and another for determining control commands. This segmentation allows the system to process position and command information independently, maintaining high control accuracy even during rapid hand movements while managing system complexity through modular processing
Solution Approach 2:
The patent transitions from analyzing hand gestures in a single temporal dimension to utilizing spatial segmentation of different hand parts. By treating the first and second parts of the hand as separate information sources, the system adds a spatial dimension to gesture interpretation, enabling simultaneous extraction of position and command information with higher accuracy
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The disclosure relates to the technical field of computers, in particular to a control method and device, terminal and storage medium. The control method provided by an embodiment of the disclosure includes: receiving an image, obtaining position information of a first part and gesture information of a second part of a user based on the image, determining a movement trajectory of a navigation indicator based on the position information of the first part, and determining a control command based on the gesture information of the second part, the control command being used for controlling a visual element to which the navigation indicator is directed.