Fiducial-Marked Tracking Device for Low-Complexity XR Hand Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing XR controllers are complex and expensive, limiting their widespread use due to high costs, and there is a need for a more cost-effective solution that can accurately track user hand movements for enhanced immersion in XR environments.
Innovation Solution
A tracking device that leverages existing camera devices to anchor its space to hand tracking space using fiducial marks and inertial sensors, allowing for cost-effective manufacturing and precise hand-tracking without the need for complex sensors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional XR controllers with complex sensors are used, then tracking precision is improved, but device cost and complexity increase
Solution Approach 1:
The patent introduces fiducial marks as an intermediary element that mediates between the simple tracking device and the camera system. These marks serve as a bridge that allows the camera to accurately track the device's position and orientation without requiring complex sensors within the device itself, thus resolving the contradiction between tracking precision and device complexity
Solution Approach 2:
The patent replaces complex mechanical sensing systems (inertial sensors, motors, etc.) with an optical system consisting of fiducial marks and camera-based tracking. This substitution eliminates the need for expensive mechanical components while maintaining tracking accuracy, directly addressing the contradiction between measurement precision and device complexity
2Measurement precision
If traditional XR controllers with complex sensors are used, then tracking precision is improved, but manufacturing cost increases
Solution Approach 1:
The patent employs inexpensive fiducial marks that can be easily manufactured and replaced if needed, replacing expensive sensor assemblies. These marks are simple graphical patterns that can be printed or attached to the device, dramatically reducing manufacturing costs while maintaining tracking precision through the camera-based observation system
Solution Approach 2:
The patent extracts the complex sensing functionality from the device itself and places it in the external camera system. By removing expensive sensors from the controller and relying on external observation of fiducial marks, the device becomes much cheaper to manufacture while the tracking precision is maintained through the extracted sensing capability in the camera system
3Ease of manufacture
If simple tracking devices without complex sensors are used, then manufacturing cost is reduced, but tracking precision deteriorates
Solution Approach 1:
The patent transitions the tracking problem from the device's local coordinate system to the camera's global coordinate system. By observing fiducial marks from the camera's perspective and performing coordinate transformations, the system achieves accurate 3D tracking without requiring complex sensors in the device, thus maintaining precision while reducing cost
Data Source
AI summary
A computing device receives a notification from a tracking device that the tracking device has entered a gripped state in which a user has securely gripped the tracking device with a hand of the user. The computing device responsively receives orientation data from the tracking device indicative of an orientation of the tracking device in a tracking device space. The computing device determines an orientation of the hand of the user in a hand tracking space from captured image data of the hand of the user and the tracking device. The computing device generates a transformation matrix to anchor the tracking device space to the hand tracking space. The tracking device resultantly enters an anchored state.