Depth Map Post-Processing for VR Headsets
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies for virtual reality (VR) and augmented reality (AR) head-mounted displays (HMDs) face challenges in generating high-resolution depth maps within a certain time frame without causing display delays or increasing heat generation and power consumption.
Innovation Solution
An information processing device and method that determine a processing time for post-processing depth maps based on the device's position, posture, and importance level information, allowing for efficient allocation of processing time to ensure high-resolution depth map generation without delay.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If the depth map resolution is increased by upsampling or filling processing, then the manufacturing precision (depth map resolution) is improved, but the processing time increases causing display delay
Solution Approach 1:
The patent applies local quality by differentiating processing time allocation across different regions of the depth map. Important regions (such as areas with high detail requirements or regions where virtual objects will be displayed) receive more processing time for upsampling and filling, while less important regions receive reduced processing time. This allows the system to maintain high resolution where needed without uniformly increasing processing time across the entire depth map, thus resolving the contradiction between resolution and processing time.
2Manufacturing precision
If the processing time for post-processing depth map is increased, then the manufacturing precision (depth map resolution) is improved, but the productivity (processing speed) deteriorates
Solution Approach 1:
The patent implements dynamics by making the processing time allocation adaptive rather than fixed. The system dynamically adjusts the processing time for different regions of the depth map based on their importance levels. Regions with higher importance receive proportionally more processing time, while less important regions receive less processing time. This dynamic allocation allows the system to maintain high productivity overall while ensuring sufficient processing time for critical regions, resolving the contradiction between precision and productivity.
3Manufacturing precision
If the processing time is extended for depth map generation, then the manufacturing precision is improved, but the temperature (heat generation) increases
Solution Approach 1:
The patent reduces heat generation by applying local quality in processing time allocation. Instead of uniformly extending processing time across the entire depth map, the system extends processing time only for important regions that require high resolution. Less important regions are processed with reduced time, which directly reduces the overall computational load and consequently reduces heat generation while maintaining the required precision in critical areas.
4Manufacturing precision
If the processing time is extended for depth map generation, then the manufacturing precision is improved, but the power consumption increases
Solution Approach 1:
The patent reduces power consumption by implementing dynamic processing time allocation based on region importance. The system dynamically adjusts processing time for each region according to its importance level, ensuring that high-power operations are performed only where necessary for maintaining precision in important regions. This dynamic approach prevents uniform high-power consumption across the entire processing area, thereby reducing overall power consumption while preserving manufacturing precision where it matters most.
Data Source
AI summary
An information processing device includes a processing time determination unit that determines a processing time for performing post-processing on a depth map on the basis of a position and a posture of a device and importance level information based on a display included in the device, and a post-processing unit that performs the post-processing on the depth map for the processing time determined by the processing time determination unit.