Head-Mounted Camera Motion Tracking for Latency and Coverage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing motion tracking technologies for head-mounted displays and personal viewing devices face limitations such as latency, restricted tracking areas, and inability to track objects in outdoor environments with bright sunlight, as well as failure to account for the user's head and eye perspective, leading to suboptimal interaction with virtual or augmented reality environments.
Innovation Solution
A personal viewing device equipped with outward-facing cameras and sensors that allow for motion tracking from the user's perspective, enabling 360-degree tracking and limitless motion capture, while integrating image analysis and sensor data to provide accurate orientation and position information of objects relative to the user's head and eyes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If external cameras are placed in the surrounding environment for optical tracking, then motion tracking can be achieved, but latency is introduced due to lead time associated with the start of actual tracking
Solution Approach 1:
Instead of placing cameras in the environment to track the user (external perspective), the patent inverts the approach by placing cameras on the user's head to capture the environment (user's perspective). This inversion eliminates the latency associated with external cameras needing to track moving users, as the cameras move with the user and continuously capture the environment from the user's viewpoint.
2Measurement precision
If external cameras are used for tracking, then motion capture is possible, but the tracking area is restricted and cannot provide 360 degree coverage
Solution Approach 1:
The patent transitions from a 2D planar tracking approach (external cameras viewing from fixed positions) to a 360-degree spherical tracking approach by mounting cameras on the user's head. This dimensional change allows tracking in all directions around the user, providing complete coverage regardless of the user's movement or orientation in the environment.
3Reliability
If traditional optical tracking with external cameras is used, then tracking can occur in controlled environments, but it does not work in outdoor environments with bright sunlight
Solution Approach 1:
The patent introduces an intermediary approach by using the user's head-mounted cameras as a mobile reference frame that travels with the user. This intermediary system (user-worn cameras) is not affected by environmental lighting conditions in the same way fixed external cameras are, as the cameras move with the user and can capture targets from the user's perspective regardless of outdoor lighting conditions.
4Measurement precision
If active tracking with inertial sensors is used, then motion sensing can be achieved, but the sensors add weight and complexity to the device
Solution Approach 1:
The patent replaces the mechanical inertial sensor system with an optical imaging system. Instead of using accelerometers, gyroscopes, and other inertial sensors that require complex processing and add significant weight, the system uses outward-facing cameras to capture visual information about the environment and targets, which is then processed to determine user motion and orientation.
Data Source
AI summary
An apparatus, methods and systems to provide a personal viewing device configured to display an image. The personal viewing device configured to be worn by a user. At least one sensor coupled to the personal viewing device. At least one camera coupled to the personal viewing device and facing outwardly with respect to the personal viewing device. A processor configured for interaction analysis. The processor in communication with the personal viewing device, the at least one sensor and the at least one camera.