Fist-Based Gesture Interaction Ray Intersection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing gesture interactions in virtual reality systems, such as 'clicking' with a single-hand index finger, 'pinching' with a thumb and index finger, and 'determining' by making a fist, require high accuracy of gesture recognition, leading to significant human and financial investment, while interaction accuracy and experience are relatively poor.
Innovation Solution
A gesture interaction method where a ray is formed from a predetermined hand position to a finger joint when four fingers form a fist, with the operation icon's position determined by the intersection of this ray with the display surface, and interaction is completed by the thumb touching the index finger, reducing precision requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional single-finger clicking or pinching gestures are used for interaction, then gesture recognition accuracy can be maintained, but human and financial investment increases significantly
Solution Approach 1:
The patent changes the parameters of gesture recognition by transitioning from precise single-finger or two-finger gesture detection to fist-based interaction. This parameter change allows the system to recognize gross motor movements (fist formation and movement) rather than fine motor skills, thereby reducing the complexity and cost of gesture recognition systems while maintaining effective interaction capability
2Measurement precision
If high accuracy gesture recognition is implemented for interactive gestures, then gesture recognition accuracy improves, but interaction accuracy and user experience deteriorate
Solution Approach 1:
The patent segments the interaction process into two distinct phases: navigation phase using fist-based gross motor movements for directional control, and selection phase using thumb-index finger pinching for precise confirmation. This segmentation allows each phase to use the most appropriate interaction method, improving overall user experience while reducing the need for continuous high-precision gesture recognition
Solution Approach 2:
The patent introduces an intermediary mechanism (the fist-based navigation system) that bridges the user and the virtual environment. Instead of requiring direct high-precision gesture recognition for all interactions, the fist serves as an intermediary control that provides intuitive directional control, making the interaction more natural and accurate
Data Source
Figure 1~2
Figure 3~4
Figure 5
AI summary
Provided are a gesture interaction method and a gesture interaction system based on artificial reality. The method includes: determining a ray formed from a predetermined position of a hand to a finger joint of the hand in a state in which four fingers of the hand form a fist as an operation indication line, an end point of the ray being the predetermined position of the hand; determining a point of intersection between the operation indication line and a display surface in the artificial reality as a position of an operation icon in the artificial reality; controlling the operation icon to move correspondingly in response to detecting that the four fingers of the hand form the fist and move, to move the operation icon in the display surface to a target key; and determining, in response to detecting an action of a thumb of the hand touching an index finger of the hand, that the operation icon clicks on the target key to complete an interaction.