Gesture Recognition Trajectory Stabilization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Gesture recognition systems often fail to accurately associate the desired action with the exact position on the screen due to hand movements during gestures, leading to incorrect selections and slow reaction times, as they rely on hand position rather than intended target position.
Innovation Solution
A method that records the trajectory of a user's body part before a specific gesture, allowing for the calculation of a precise selection position based on this trajectory, ensuring the position remains stable during the gesture, and automatically updates the cursor position on the screen for precise command execution.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the system determines mouse position solely based on hand position during gestures, then the system can identify gesture states, but the mouse position becomes disrupted and actions occur at incorrect locations
Solution Approach 1:
The system records the hand trajectory before the gesture occurs and calculates the intended target position in advance. This preliminary calculation of the target position (based on trajectory analysis) allows the system to determine where the user intends to act, rather than where the hand is during the gesture, thus resolving the contradiction between reliable action location and natural gesture performance
2Measurement precision
If the user must hold their hand over the element for a certain time to select it, then the system can identify the target element, but the response time increases and user constraint increases
Solution Approach 1:
The system performs preliminary analysis of the hand trajectory to predict the intended target position before the gesture is completed. By calculating the target position based on the recorded trajectory path (rather than waiting for the hand to hover stationary), the system identifies the target element faster without requiring the user to maintain a static position, thus reducing both time loss and user constraint while maintaining identification precision
Solution Approach 2:
The system replaces the mechanical requirement of holding the hand stationary over the element with an optical/computational analysis of the hand's movement trajectory. Instead of requiring physical stability (mechanical approach), the system uses trajectory recording and position calculation (computational approach) to identify the target, thereby eliminating the time-consuming hover requirement while maintaining precise target identification
3Productivity
If the system calculates position based on hand position during gesture, then the system can process gestures quickly, but the selected position does not match the user's intended position
Solution Approach 1:
The system records the hand trajectory in advance and calculates the intended target position based on this recorded path before executing the gesture recognition. This preliminary trajectory analysis allows the system to determine the correct target position (matching user intent) while maintaining fast processing speed, as the calculation is performed efficiently based on the pre-recorded trajectory data rather than requiring continuous hand position monitoring during the gesture
Data Source
Figure 1~2
AI summary
The invention relates to a gesture recognition control method and device (1) for a computer system (3), the device being characterized in that it comprises: - display means (7) configured to display selectable commands, - observation means (4) configured to provide images of a user (2), - computing means (6) capable of receiving the user's images and configured to determine the trajectory of at least one part of the user's body (2) and display on the display means (7) a visual feedback of the current position of the body part, the computing means (6) being further configured to recognize at least one specific gesture of the body part, the detection of the specific gesture enabling the selection of the command (3), and - trajectory storage means (5) connected to the computing means (6), the device (1) being configured so that, in the event of recognition of the specific gesture,calculate a specific command selection position on the display means (7) based on the recorded trajectory.