Hybrid Motion Tracking System Reducing Latency via Peripheral-Camera Fusion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing motion tracking systems for VR and AR applications face high latency due to camera-based systems, which is exacerbated by increased display frame rates, and peripheral-based systems provide limited information about the user's body.
Innovation Solution
A hybrid system combining camera-based skeletal tracking with peripheral motion data, where peripherals provide high-frequency updates to reduce latency and enhance tracking accuracy by using a skeletal model with constraints to predict and refine body position information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If camera-based systems are used to capture body motion, then comprehensive body position information can be obtained, but high latency is introduced due to processing delays
Solution Approach 1:
The patent combines camera-based skeletal tracking with peripheral motion data into a hybrid system. The camera provides comprehensive body position information while peripherals provide high-frequency updates to reduce latency. The system merges these data sources to achieve both complete tracking information and low latency performance.
Solution Approach 2:
The system performs preliminary action by using peripheral data to predict and refine body position between camera frames. This allows the system to prepare tracking information in advance, reducing the effective latency experienced in the final rendered output.
2Productivity
If display frame rate is increased to 60 or 120 Hz, then smoother visual experience is provided, but processing overhead increases substantially
Solution Approach 1:
The system applies partial action by selectively processing peripheral data at full frequency while using camera data at lower frequency. Not all tracking parameters are updated at every frame, reducing overall processing overhead while maintaining smooth display performance.
Solution Approach 2:
The system performs preliminary processing of peripheral motion data to predict body position, reducing the computational burden during final rendering. This pre-computation allows high frame rates to be achieved with reduced real-time processing overhead.
3Loss of time
If peripheral-based tracking is used, then lower latency is achieved, but limited information about the user's body is provided
Solution Approach 1:
The patent merges peripheral motion data with camera-based skeletal tracking to combine the advantages of both systems. Peripherals provide low-latency position detection while the camera provides comprehensive body information, creating a hybrid system that achieves both low latency and complete tracking.
Solution Approach 2:
The system uses a skeletal model as an intermediary to fuse peripheral and camera data. The skeletal model integrates the high-frequency peripheral position data with the comprehensive camera-based body structure information, reconciling the limitations of each individual system.
Data Source
AI summary
A motion tracking system for tracking a user is provided. The system includes a motion detecting unit, a camera, a body tracking unit and a data merging unit. The motion detecting unit is operable to generate motion information for a user from input signals. The camera is operable to capture images of the user. The body tracking unit is operable to generate tracking information for a user by using the images of the user captured by the camera. And the data merging unit is operable to merge the generated tracking information and the generated motion information. The motion information is used to modify the tracking information.