Finger-Wearable Device for Occlusion-Resistant Virtual Object Manipulation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current input modalities for manipulating computer-generated objects, such as extremity tracking and eye tracking, face inaccuracies due to physical object occlusion and depth issues, particularly when dealing with objects of varying depths in the display environment.
Innovation Solution
An electronic device with a finger-wearable device communication interface moves computer-generated objects based on finger manipulation data, determining proximity thresholds and drop criteria to accurately position them within a drop region, independent of occlusions and depth complexities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If extremity tracking or eye tracking is used to manipulate computer-generated objects, then the user can interact with the objects, but tracking accuracy deteriorates when physical objects occlude the user's extremities or when objects are at varying depths
Solution Approach 1:
The patent introduces a finger-wearable device as an intermediary between the user and the computer-generated objects. This device wears on the finger and provides direct finger manipulation data, serving as a mediator that bypasses the occlusion problems of extremity and eye tracking. The wearable device captures finger movements directly, ensuring accurate tracking regardless of physical object occlusions or depth variations in the environment.
2Adaptability or versatility
If computer-generated objects are placed at greater depths in the display environment, then more objects can be displayed, but manipulation accuracy deteriorates
Solution Approach 1:
The finger-wearable device acts as an intermediary that decouples manipulation accuracy from display depth. By capturing finger movements directly at the user's finger rather than tracking eyes or entire extremities, the system maintains precise manipulation control regardless of how far into the depth environment objects are placed.
Solution Approach 2:
The patent replaces the mechanical tracking systems (eye tracking cameras, extremity tracking sensors) with a wearable sensor system directly on the finger. This substitution provides more reliable manipulation data that is independent of the three-dimensional depth position of displayed objects, allowing accurate interaction with objects at any depth.
3Adaptability or versatility
If physical objects are present in the environment, then the user can interact with real-world objects, but occlusion of the user's extremities reduces tracking reliability
Solution Approach 1:
The finger-wearable device serves as a protected intermediary that is worn directly on the user's finger. This positioning makes it much less susceptible to occlusion by environmental objects compared to tracking the entire hand or arm. The device maintains direct contact with the finger, ensuring continuous and reliable data capture even when the user's extremities are partially obscured by physical objects in the environment.
Data Source
AI summary
A method includes, while displaying a computer-generated object at a first position within an environment, obtaining extremity tracking data from an extremity tracker. The first position is outside of a drop region that is viewable using the display. The method includes moving the computer-generated object from the first position to a second position within the environment based on the extremity tracking data. The method includes, in response to determining that the second position satisfies a proximity threshold with respect to the drop region, detecting an input that is associated with a spatial region of the environment. The method includes moving the computer-generated object from the second position to a third position that is within the drop region, based on determining that the spatial region satisfies a focus criterion associated with the drop region.