Merging Virtual Objects via Extremity Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems for manipulating computer-generated objects using extremity tracking inputs face reliability issues due to occlusions and limited mobility, leading to tracking inaccuracies, especially when objects are at varying depths within a display environment.
Innovation Solution
An electronic device merges computer-generated objects based on extremity tracking data from a finger-wearable device, determining proximity thresholds and compatibility criteria to generate and display new objects, allowing effective manipulation even when physical objects occlude the user's extremities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If extremity tracking input is used to manipulate computer-generated objects, then user interaction capability is improved, but tracking reliability deteriorates when physical objects occlude the extremity
Solution Approach 1:
The system introduces a camera as an intermediary device to capture images of the user's extremity. Instead of relying directly on extremity tracker data that may be occluded, the system uses image data from the camera to detect and track the extremity position, providing a reliable alternative when direct tracking fails due to occlusion.
Solution Approach 2:
The system replaces the mechanical/extremity tracking system with an optical detection system using a camera. When extremity tracking becomes unreliable due to occlusion, the system substitutes the tracking method by capturing images and detecting extremity positions visually, thereby maintaining tracking reliability under varying physical conditions.
2Adaptability or versatility
If computer-generated objects are placed at high depth in the scene background, then scene composition flexibility is improved, but manipulation difficulty increases leading to tracking inaccuracies
Solution Approach 1:
The camera acts as an intermediary that captures the entire scene including background objects at various depths. By using image processing to detect extremity positions relative to these background objects, the system maintains accurate tracking even when objects are placed at high depths in the scene, thereby preserving both scene composition flexibility and tracking precision.
Data Source
AI summary
A method includes displaying a plurality of computer-generated objects, including a first computer-generated object at a first position within an environment and a second computer-generated object at a second position within the environment. The first computer-generated object corresponds to a first user interface element that includes a first set of controls for modifying a content item. The method includes, while displaying the plurality of computer-generated objects, obtaining extremity tracking data. The method includes moving the first computer-generated object from the first position to a third position within the environment based on the extremity tracking data. The method includes, in accordance with a determination that the third position satisfies a proximity threshold with respect to the second position, merging the first computer-generated object with the second computer-generated object in order to generate a third computer-generated object for modifying the content item. The method includes displaying the third computer-generated object.