Virtual Hand Gesture Mapping for Accurate VR Object Gripping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current immersive reality technologies face inefficiencies in user interaction with virtual objects due to the absence of tangible contact, leading to errors and degraded immersive experiences, particularly when gripping and releasing virtual objects.
Innovation Solution
A method for interacting with virtual objects in immersive reality devices that involves detecting continuous gestures of the real hand to trigger gripping and releasing actions by the virtual hand, using a non-linear mapping between real and virtual hand movements to facilitate intuitive interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If current interaction techniques are used where the real hand closes to surround or pass through the virtual object, then the interaction can be detected, but the interaction accuracy deteriorates because the natural gripping position does not correspond to the validation position
Solution Approach 1:
The patent creates a virtual hand that copies the geometry and movements of the real user's hand. This virtual hand is then used to interact with virtual objects, allowing the system to detect gripping actions based on the virtual hand's geometry matching the object's geometry, rather than requiring the real hand to perform artificial gestures like closing completely or passing through the object.
Solution Approach 2:
The virtual hand serves as an intermediary between the real hand and the virtual object. Instead of directly detecting interactions between the real hand and virtual object, the system uses the virtual hand as a mediator that can be tracked and analyzed to determine when a gripping action has occurred, based on geometric matching between the virtual hand and virtual object.
2Measurement precision
If the virtual hand geometry is updated in real-time to match the real hand, then the interaction detection accuracy improves, but the computational complexity increases
Solution Approach 1:
The patent pre-computes and stores the geometry of the virtual hand in various gripping configurations. When interaction detection is needed, the system compares the captured real hand geometry against these pre-computed virtual hand models to determine if a gripping action has occurred, avoiding the need for complex real-time geometric transformations.
Solution Approach 2:
The patent replaces complex real-time geometric computation with pattern matching against pre-computed virtual hand models. Instead of calculating hand geometry transformations in real-time, the system uses captured images or video frames to directly compare with stored virtual hand geometries, significantly reducing computational requirements.
Data Source
AI summary
A method for interacting with a virtual object in an immersive reality, a program using same, and an immersive reality device in which a user is able to interact with a virtual object. The method includes, when a virtual hand associated with a real hand of a user of the immersive reality device is in the proximity of a virtual object, detecting a continuous gesture of the real hand, the detection of the continuous gesture triggering gripping of the virtual object by the virtual hand. A simple and continuous gesture is thus associated with triggering the gripping of the virtual object, without placing the real hand in a position incompatible with this gripping in terms of perception by the user.