HMD Controller Tracking Using Dual Camera Perspective
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems for determining the movement of a hand-held controller relative to a head-mounted display (HMD) face challenges in accurately tracking the controller's position and orientation, especially when the controller is outside the view of the camera on the HMD.
Innovation Solution
The system includes a hand-held controller, an HMD with a camera positioned to capture images of the controller, and a processing device that determines the position and movement of both the HMD and the controller within the real-world environment, allowing for accurate tracking and modification of the application state.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a camera on the HMD is used to track the controller, then the tracking system is compact and portable, but the controller may be outside the camera's view
Solution Approach 1:
The patent introduces a second camera mounted on the controller itself, creating a dual-perspective tracking system. This dimensional addition allows the system to track the controller's position and orientation from both the HMD's viewpoint and the controller's own viewpoint, ensuring continuous tracking regardless of the controller's spatial orientation relative to the HMD.
2Device complexity
If the camera on the HMD is positioned to capture the controller, then the system structure is simplified, but the controller may still be out of view during certain movements
Solution Approach 1:
The patent uses the controller-mounted camera as an intermediary tracking element. This secondary camera acts as a mediator that continuously captures the controller's own position and orientation, providing backup tracking data when the HMD camera cannot observe the controller, thereby enhancing tracking reliability without significantly complicating the overall system architecture.
3Productivity
If only images from the HMD camera are used, then the processing device workload is reduced, but accurate tracking of controller movement is compromised
Solution Approach 1:
The patent segments the tracking function into two independent components: the HMD camera captures the real-world environment and the controller's position relative to the user, while the controller-mounted camera captures the controller's own orientation and position. This segmentation allows each camera to specialize in specific tracking aspects, improving overall measurement precision while distributing the processing workload efficiently.
Data Source
AI summary
Systems and methods for determining movement of a hand-held controller (HHC) with respect to a head-mounted display (HMD) are described. A camera is located at a lower region of the HMD for capturing images of the HHC. The images of the HHC are used to determine a position and an orientation of the HHC with reference to the HMD. Also, the camera or another camera can be used to determine a position and orientation of the HMD with respect to a real-world environment. The position and orientation of the HMD and the position and orientation of the HHC are used to change to state of an application executed on a game cloud.