XR Hand Tracking Suppression Near Restricted Virtual Objects
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing wearable devices for extended reality struggle to accurately distinguish and manage the representation of hand objects in virtual environments, leading to potential interference and inefficiencies in hand tracking.
Innovation Solution
A wearable device equipped with a camera and display system that identifies objects in a virtual screen, determines the type of object, and adjusts hand tracking based on proximity, selectively hiding hand object movements when necessary.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If hand tracking is performed in virtual environment, then user interaction capability is improved, but object recognition accuracy deteriorates due to interference from hand objects
Solution Approach 1:
The system segments the virtual environment into different zones: a first area where hand objects are allowed and a second area where hand objects are restricted. This spatial segmentation allows hand tracking to function in permitted zones while preventing interference in restricted zones, thereby maintaining both interaction capability and object recognition accuracy.
Solution Approach 2:
Different quality rules are applied to different regions of the virtual screen. In the first area, hand objects are rendered with normal visibility to enable interaction. In the second area, hand objects are hidden or restricted to prevent interference with object recognition. This local differentiation resolves the contradiction by applying appropriate visibility rules locally.
2Measurement precision
If hand object representation is restricted in certain areas, then object recognition accuracy is improved, but ease of operation deteriorates due to limited hand tracking
Solution Approach 1:
The system dynamically adjusts the representation of hand objects based on their location and the current operational context. Hand objects are hidden when they would interfere with object recognition in the second area, but restored when needed for interaction in the first area. This dynamic adjustment maintains both accuracy and operability.
Solution Approach 2:
The system continuously monitors the virtual environment to detect when hand objects are present and assess whether they would interfere with object recognition. Based on this feedback, the system automatically adjusts hand object visibility and tracking behavior, ensuring optimal balance between recognition accuracy and operational ease.
Data Source
AI summary
A wearable device is provided. The wearable device includes at least one processor, a display, and at least one camera. The at least one processor is configured to identify an object included in a virtual screen displayed through the display using the at least one camera, determine whether the identified object corresponds to a type for restricting a representation of a hand object of a user, display, through the display, a virtual screen including the hand object based on a hand tracking in accordance with a determination that the identified object does not correspond to the type, and display, through the display, a virtual screen without displaying a movement of the hand object in accordance with the hand tracking based on identifying that the hand object is located within a threshold distance from the identified object in accordance with a determination that the identified object corresponds to the type.