Gesture Interface Device Using Palm Coordinates to Correct Fingertip Noise
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current Graphical User Interface (GUI) systems with sensors that detect hand gestures often introduce noise when body parts are far from the sensor or not fully detected, leading to erroneous interpretations of user interactions due to unreliable coordinate data.
Innovation Solution
A device and method that utilize a processing device with sensors to obtain and analyze sensor data, determine user interface gestures, and estimate gestures by learning parameters from reliable data points, such as the palm, to correct and extrapolate coordinates of less reliable body parts like fingertips, ensuring accurate interaction with virtual objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If sensor data is used directly for gesture detection, then the system responds quickly to user input, but the accuracy deteriorates when body parts are far from the sensor or not fully detected
Solution Approach 1:
The patent introduces an intermediary estimation process that uses reliably detected body part coordinates (such as the palm) to estimate the coordinates of less reliable body parts (such as fingertips). This intermediary step mediates between the raw sensor data and the final gesture interpretation, improving accuracy without sacrificing response speed.
Solution Approach 2:
The system performs preliminary actions by learning and storing parameters for different gesture types in advance. When a gesture is detected, the system retrieves these pre-learned parameters to assist in estimating coordinates, rather than calculating everything from scratch during the interaction moment.
2Device complexity
If the system uses basic sensor data without correction, then the device complexity remains low, but the reliability of gesture interaction deteriorates due to noise and erroneous coordinates
Solution Approach 1:
The patent changes parameters by learning and storing characteristic parameters for different gesture types (such as typical distances between palm and fingertips, angular relationships). These parameter changes allow the system to correct noisy sensor data by comparing against learned norms, significantly improving reliability while maintaining relatively simple device architecture.
3Ease of operation
If the system accepts all sensor data as is, then the ease of operation is high, but the manufacturing precision of gesture coordinates deteriorates due to noise introduction
Solution Approach 1:
The system extracts only the reliable information from sensor data (such as palm position when fingertips are noisy) and uses this extracted reliable data combined with learned parameters to reconstruct the complete gesture coordinates. This selective extraction approach maintains ease of operation while improving coordinate precision.
Data Source
AI summary
A user interface device including memory configured to store instructions and at least one hardware processor configured to execute the instructions to obtain, from at least one sensor, sensor data corresponding to a user gesture, determine a user interface gesture that matches the sensor data, obtain parameters for the determined interface gesture, and upon obtaining the parameters for the determined interface gesture, use the sensor data and the parameters for the determined interface gesture to estimate the user gesture in a user interface. Also provided is a method.