Trajectory-Based Hand Gesture Control for Cursor and System Functions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current human-computer interface technologies lack an effective method for simultaneously controlling a cursor and operating system functions using hand motions without additional sensing devices or training, limiting the functionality of touch-based interfaces.
Innovation Solution
A trajectory-based control method and apparatus that analyze hand motions by expressing smoothed coordinates to distinguish between cursor control and system function control, allowing users to manage cursor movements and system actions using single or dual hand trajectories without physical contact with the monitor.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If hand motion recognition is used for cursor control, then ease of operation is improved, but the ability to simultaneously perform system functions is lost
Solution Approach 1:
The patent segments hand motion trajectories into distinct types: circular trajectories are identified for cursor control operations, while linear or non-circular trajectories are identified for system function operations. This segmentation allows the system to differentiate between cursor movement intentions and function execution intentions based on trajectory characteristics, enabling both cursor control and system function control through hand motions simultaneously.
2Adaptability or versatility
If additional sensing devices are used to enhance control functionality, then adaptability is improved, but device complexity increases
Solution Approach 1:
The patent makes the existing sensing device (camera) perform multiple functions: it captures images for both cursor control and system function control, analyzes various trajectory types for different operations, and supports multiple input methods (hand gestures, body movements) using the same hardware. This multi-functionality enhances adaptability without increasing device complexity, as the single camera system is utilized more comprehensively.
3Measurement precision
If training processes are required for gesture recognition, then measurement precision is improved, but ease of operation deteriorates
Solution Approach 1:
The system employs self-service by automatically adapting to user gestures without requiring external training data or calibration processes. The trajectory analysis unit automatically identifies and adapts to the user's natural hand motion patterns, gesture types, and movement characteristics through real-time analysis, enabling accurate gesture recognition while maintaining ease of operation. The system serves itself by learning from observed trajectories rather than requiring pre-trained models.
Data Source
AI summary
A method for constructing a gesture mouse utilizes an object e.g., a user's palm) in the background of the photographed region of a video camera as a determination basis. In a computer system, (1) for the image of an object, the point with maximum Y-axis value is set to be a cursor; (2) the point with maximum X-axis value is set to be a push button; (3) the cursor and the push button are used as centers to set small tracking areas respectively; (4) if the distance between the cursor and the push button becomes greater than a designated threshold within a time period, an action of the push button is determined to occur. Images obtained by the video camera are input into a computer through the digital image interface of the video camera or an analog/digital converting card for further processing.