Virtual Hand Grasp Mapping for Accurate Immersive Object Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current immersive reality technologies face challenges in effective interaction with virtual objects using bare hands due to inconsistencies in grasping and releasing, leading to errors and a degraded user experience.
Innovation Solution
A method of interaction where a continuous gesture of the real hand near a virtual object triggers grasping or releasing by a virtual hand, using a non-linear mapping between real and virtual hand movements to facilitate seamless interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the immersive reality system validates virtual grasping when the real hand closes while encircling or passing through the virtual object, then the interaction can be initiated, but the position of the real hand does not correspond to an actual grasp of the virtual object, leading to interaction errors and degraded user experience
Solution Approach 1:
The patent creates a virtual hand that replicates the geometry and movements of the user's real hand. This virtual hand is then used to interact with virtual objects, ensuring that the grasping position and orientation match the actual physical grasp. The virtual hand serves as an accurate copy that bridges the gap between real hand movements and virtual object manipulation, eliminating the mismatch problem.
Solution Approach 2:
The virtual hand acts as an intermediary between the real hand and the virtual object. Instead of directly mapping real hand positions to virtual object interactions, the system first transforms real hand movements into virtual hand movements, which then interact with virtual objects. This intermediate step ensures geometric accuracy and proper grasp validation.
2Ease of operation
If the user attempts to manipulate a virtual object by encircling it with their real hand without touching it (when the virtual object's diameter is smaller than that of the closed real hand), then the interaction can be performed, but this does not correspond to an actual grasp of the virtual object, leading to interaction errors
Solution Approach 1:
The virtual hand copy preserves the exact geometry of the user's real hand, including finger thickness and hand size. When validating a grasp, the system checks whether the virtual hand (with its accurate geometry) can physically enclose the virtual object, ensuring that the grasp is geometrically valid and corresponds to an actual physical grasp.
3Ease of operation
If the immersive reality device uses current interaction techniques that allow passing through the virtual object with the real hand, then the interaction can be initiated, but this leads to errors and degraded immersive experience
Solution Approach 1:
By creating a virtual hand that accurately copies the real hand's geometry, the system can properly detect when the hand passes through a virtual object versus when it actually grasps it. The virtual hand's accurate dimensions allow the system to validate whether the interaction is physically meaningful, preventing invalid interactions while maintaining ease of use.
Data Source
Figure 1
Figure 2~3
Figure 4a~5a
AI summary
The invention relates to a method for interacting with a virtual object in an immersive reality environment, a program using it, and an immersive reality device in which a user can interact with a virtual object. An object of the invention is a method for interacting with a virtual object reproduced by an immersive reality device comprising: - when a virtual hand associated with a real hand of a user of the immersive reality device is near a virtual object, detecting a continuous gesture of the real hand, the detection of this continuous gesture triggering the virtual hand to grasp the virtual object. Thus, a simple and continuous gesture is associated with triggering the grasping of the virtual object without placing the real hand in a position incompatible with such a grasp in terms of user perception.