VR Controller Tracking with Headset and Fixed Cameras
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Virtual reality systems face challenges in accurately tracking controller movement due to occlusion and limited perspective, leading to reduced confidence in determining the controller's position and orientation.
Innovation Solution
A virtual reality system employs at least two cameras, one mounted on a headset and another positioned away from the user, to capture the controller from multiple perspectives, using detectors like LEDs on the controller surface to enhance detection and orientation accuracy, and a console to generate a virtual world based on these views, providing backup imaging when the controller is occluded.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single camera is used to track the controller, then the device complexity is reduced, but the measurement precision and reliability of controller position and orientation tracking deteriorate due to occlusion and limited perspective
Solution Approach 1:
The tracking system is segmented into multiple independent camera units (first camera, second camera, third camera) positioned at different locations. Each camera captures images from its own perspective, and the results are combined to achieve comprehensive tracking. This segmentation allows the system to overcome the limitations of a single camera by distributing the tracking function across multiple independent observers.
Solution Approach 2:
The patent merges the tracking data from multiple cameras (first camera, second camera, third camera) to achieve more accurate and reliable controller tracking. By combining the perspectives and information from all cameras, the system achieves better occlusion handling and more precise position/orientation determination than any single camera could provide alone.
2Reliability
If multiple cameras are used to track the controller from different perspectives, then the reliability and measurement precision improve, but the device complexity increases
Solution Approach 1:
The tracking system is segmented into multiple independent camera units (first camera, second camera, third camera) positioned at different locations. Each camera captures images from its own perspective, and the results are combined to achieve comprehensive tracking. This segmentation allows the system to overcome the limitations of a single camera by distributing the tracking function across multiple independent observers.
Solution Approach 2:
Multiple cameras serve multiple functions: they provide redundant tracking data for reliability, capture different perspectives for better geometry estimation, and act as backup systems when some cameras are occluded. The first camera provides primary tracking, the second camera provides alternative tracking when needed, and the third camera provides additional perspective, making the system universally capable of handling various tracking scenarios.
3Measurement precision
If detectors like LEDs are added to the controller surface, then the detection accuracy and orientation determination improve, but the device complexity and manufacturing cost increase
Solution Approach 1:
The patent uses detectors (such as LEDs or other visible markers) on the controller surface that can be detected by the cameras. These detectors provide distinctive visual features that change or vary in appearance based on the controller's orientation and position, enabling accurate determination of the controller's state from image data.
Solution Approach 2:
The detectors act as intermediaries between the controller and the cameras. Instead of directly analyzing the controller's physical state, the system uses these detectable markers as intermediaries that encode information about the controller's position and orientation, making the tracking process more accurate and reliable.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach improves the accuracy of controller tracking by providing distinct views from different angles, reducing errors and maintaining tracking even when the controller is occluded, resulting in a more immersive and realistic virtual experience.
Implementation Method 1
The image tracking system includes a set of fixed cameras to image the headset worn by a user and the controller operated by the user. The headset includes an imaging device (camera) configured to capture images including the controller.
Implementation Method 2
the detectors include lights, such as light-emitting diodes (LEDs), located on the surface of the controller
Data Source
AI summary
A virtual reality (VR) system tracks the position of a controller. The VR system includes an image tracking system comprising of a number of fixed cameras, and a headset worn by the user that includes an imaging device to capture images of a controller operated by the user. The controller includes a set of features disposed on the surface of the controller. The image tracking system provides a first view of the controller. The imaging device mounted on the headset provides a second view of the controller. Each view of the controller (i.e., from the headset and from the image tracking system) provides a distinct set of features observed on the controller. The first and second sets of features are identified from the captured images and a pose of the controller is determined using the first set of features and the second set of features.