Dynamic Vision Sensors for Low Latency HMD Motion Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional motion detection systems for head-mounted displays (HMDs) face high power and latency limitations due to the need for substantial processing of 2D images frame-by-frame to track edges and motion, which hampers real-time and accurate head tracking in virtual and augmented reality applications.
Innovation Solution
The implementation of dynamic vision sensors (DVS) that detect movement by monitoring changes in pixel light levels, reducing data transmission and processing bandwidth, and enabling efficient gesture control and motion tracking with lower latency and improved processing efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional motion detection systems process 2D images frame-by-frame to track edges and motion, then motion tracking is achieved, but power consumption and latency increase significantly
Solution Approach 1:
The patent segments the image processing task by using event cameras that only detect and transmit pixel changes rather than processing entire frames. This selective segmentation of data transmission reduces the processing load while maintaining motion detection accuracy, directly addressing the latency issue without sacrificing measurement precision.
Solution Approach 2:
The invention extracts only the essential motion information from the visual scene by using event-based sensors that output discrete pixel change events. This extraction approach eliminates redundant data transmission and processing of static scene elements, reducing latency while preserving motion tracking accuracy.
2Measurement precision
If traditional motion detection systems process 2D images frame-by-frame, then motion tracking is achieved, but processing bandwidth requirements increase
Solution Approach 1:
The system segments the visual data stream into discrete pixel change events rather than processing continuous frame sequences. This segmentation reduces the volume of data requiring processing and transmission, improving processing efficiency while maintaining the ability to accurately track motion through the extracted event data.
Solution Approach 2:
The event camera approach performs partial processing by only capturing and transmitting pixels that have changed state, rather than processing the entire frame. This partial action approach significantly reduces processing bandwidth requirements while maintaining sufficient data for accurate motion tracking.
3Measurement precision
If traditional motion detection systems are used in HMDs, then head tracking is achieved, but power consumption increases
Solution Approach 1:
The patent extracts only the necessary motion information from the visual scene using event-based sensors, eliminating the need to process and transmit complete frame data. This extraction strategy significantly reduces computational load and power consumption while maintaining head tracking accuracy essential for HMD applications.
Solution Approach 2:
The system performs partial processing by activating sensor output only when pixel changes occur, rather than continuously processing all frames. This reduces the overall computational workload and power consumption while maintaining sufficient data throughput for accurate head tracking in virtual and augmented reality applications.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach significantly reduces latency and processing bandwidth requirements, enabling more accurate and efficient motion tracking and gesture control in HMDs, enhancing the overall performance of virtual and augmented reality experiences.
Implementation Method 1
dynamic vision sensors (DVS) that detect movement by monitoring changes in pixel light levels
Data Source
AI summary
Systems and methods may provide for using one or more stereoscopic devices for gesture control and tracking in a head mounted display (HMD). Each of the one or more stereoscopic devices may include a pair of dynamic vision sensors (DVS) arranged to have complementary fields of view (FOV) to detect one or more of a leading and a trailing edge of an object moving in a range or area to be detected. The DVS sensors determine how the object is moving based on a change in light intensity of pixels without having to detect, transfer, or process all of the pixels. The system and method may thereby provide motion tracking and gesture control functions at very low latency and processing bandwidth.