CGH Depth-Layer Reprojection for Low-Latency AR Holograms
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality devices using computer-generated holography face challenges in correcting spatial coordinates for holographic images due to user movement, leading to motion-to-photon latency and reduced user immersion.
Innovation Solution
An electronic device with a first processor generating depth layers from image data and a second processor reprojecting these layers based on user pose information, using pixel-shifting and overwriting techniques to compensate for latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional image correction methods are applied to holographic images, then spatial coordinate correction can be achieved, but the interference pattern fringes at different depths become mixed and reprojection fails
Solution Approach 1:
The patent divides the holographic image into multiple depth layers, each containing fringes at a specific depth. By segmenting the image data into these separate depth layers, the system can process and correct each layer's spatial coordinates independently, preventing fringe mixing while maintaining correction accuracy.
Solution Approach 2:
The patent introduces a depth dimension to the image processing by creating multiple depth layers. This dimensional approach allows the system to separate and process fringes at different depths independently, transforming a 2D image correction problem into a multi-layer 3D processing solution that resolves the fringe mixing issue.
2Loss of time
If real-time image correction is performed to minimize motion-to-photon latency, then user immersion is improved, but processing time and computational complexity increase
Solution Approach 1:
The patent performs preliminary actions by pre-dividing the image into depth layers and pre-calculating correction parameters for each layer. This allows the system to quickly apply corrections in real-time without performing complex calculations during the critical rendering moment, thus reducing latency while managing computational complexity.
Solution Approach 2:
By segmenting the image processing into independent depth layers, the system can parallelize computations and reduce the overall processing time. Each depth layer can be corrected simultaneously using separate reprojection operations, decreasing the total processing complexity compared to a monolithic correction approach.
3Productivity
If depth layers are processed simultaneously for reprojection, then processing speed increases, but memory bandwidth requirements and data management complexity increase
Solution Approach 1:
The patent segments the reprojection process into separate operations for each depth layer, allowing simultaneous processing of multiple layers. Each depth layer is handled as an independent unit with its own pixel data and correction parameters, enabling parallel processing that increases productivity while maintaining manageable data structure through the layered segmentation.
Data Source
AI summary
Provided are an electronic device for processing computer-generated holography (CGH) and a method thereof. The electronic device generates a plurality of depth layers (computer-generated holography) having different depth information from image data at a first view point, and reprojects each of the plurality of depth layers based on the user's pose information at the second view point different from the first view point to generates CGH.