Wearable Relative Position Sensing for VR Hand Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing VR and AR systems face challenges in hand tracking when hands are not in the field of view of the head-mounted display or when users hold objects, leading to unsatisfactory performance.
Innovation Solution
A method and system using wearable devices with motion detection elements and light emitting elements to determine user posture by detecting relative positions between these devices, allowing hand tracking even when hands are out of view or holding objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If hand tracking is performed using the front camera of the HMD, then hand tracking can be achieved when hands are in the field of view, but hand tracking cannot be performed when hands are out of the field of view or when users hold objects
Solution Approach 1:
The patent applies multi-functionality by using wearable devices that can serve multiple purposes: they detect relative positions for posture determination, emit light for visibility, and provide motion detection capabilities. This allows the system to track hands both when they are in the camera's field of view and when they are not, thereby improving tracking coverage while maintaining reliable hand tracking performance through alternative sensing methods
2Reliability
If wearable devices with motion detection elements are used to detect relative positions, then hand tracking performance is enhanced when hands are out of view, but device complexity increases
Solution Approach 1:
The wearable devices perform self-service by autonomously detecting relative positions between devices and determining posture information without requiring complex external processing systems. The devices themselves contain the necessary sensors and processing capabilities to generate posture data, which reduces the overall system complexity while maintaining enhanced hand tracking performance for hands-out-of-view scenarios
Data Source
Figure 1
Figure 2
Figure 3A
AI summary
The disclosure provides a method for determining a posture of a user, a host, and a computer readable medium. The method includes: detecting a relative position between a first wearable device and a second wearable device; and in response to determining that the relative position between the first wearable device and the second wearable device satisfies a predetermined relative position, determining the posture of the user at least based on the relative position between the first wearable device and the second wearable device.