CGH Depth-Layer Reprojection for Motion-to-Photon Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality devices using computer-generated holography face challenges in correcting spatial coordinates for holographic images due to mixed fringes at different depths, leading to user immersion issues from motion-to-photon latency.
Innovation Solution
An electronic device with a first processor generating depth layers from image data and a second processor reprojecting these layers based on user pose information, using pixel-shifting and overwriting techniques to compensate for user movement, thereby generating computer-generated holography.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional reprojection method is applied to holographic images, then spatial coordinate correction can be performed, but the mixed fringes at different depths make it difficult to apply the method effectively
Solution Approach 1:
The patent divides the holographic image into multiple depth layers, where each layer contains fringes from a specific depth range. This segmentation allows the reprojection method to be applied independently to each layer, avoiding the complexity of dealing with mixed fringes across all depths simultaneously. The first processor generates multiple depth layers from image data, and the second processor reprojects each layer separately based on user pose information.
2Reliability
If real-time image correction is performed to minimize motion-to-photon latency, then user immersion is enhanced, but computational processing time and complexity increase
Solution Approach 1:
The system performs preliminary actions by pre-dividing the image into multiple depth layers and pre-calculating reprojection parameters for each layer. When user movement is detected, the second processor can quickly reproject each pre-prepared layer without performing complex computations from scratch, thereby reducing real-time processing time while maintaining accurate spatial coordinate correction.
Solution Approach 2:
By segmenting the image into multiple depth layers, the patent reduces the computational complexity of real-time reprojection. Instead of processing the entire holographic image as a single complex structure, the system processes each depth layer independently, which significantly decreases the processing time required for real-time corrections while maintaining user immersion stability.
3Speed
If depth layers are processed in parallel for real-time reprojection, then processing speed increases, but memory bandwidth requirements and data management complexity increase
Solution Approach 1:
The patent segments the holographic image into multiple depth layers that can be processed in parallel. Each depth layer is stored as a separate data structure, allowing the second processor to simultaneously reproject multiple layers using different pixel shift amounts. This segmentation enables parallel processing while maintaining organized data management through structured storage of depth layer information.
Data Source
AI summary
Provided are an electronic device for processing computer-generated holography (CGH) and a method thereof. The electronic device generates a plurality of depth layers (computer-generated holography) having different depth information from image data at a first view point, and reprojects each of the plurality of depth layers based on the user's pose information at the second view point different from the first view point to generates CGH.