Light Field Parallax Enhancement via Depth Layer Shifting
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The limited spatial resolution of integral displays in light field technology results in shallow depth perception due to under-sampling of light fields, leading to unsatisfactory 3D visualization, especially when neighboring pixels belong to different depth planes, and existing interpolation methods provide limited enhancement at high computational costs.
Innovation Solution
The technique involves slicing light field data into layers based on depth, laterally shifting each layer by an offset distance related to its depth and viewing angle, and recombining them to enhance parallax and 3D perception, using disparity maps and a system comprising preprocessing, slicing, parallax boosting, data filling, and resampling circuits.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If light field data is under-sampled to fit the display resolution, then the integral display can be populated with light field content, but depth perception becomes shallow and 3D visualization quality deteriorates
Solution Approach 1:
The patent segments the light field data into multiple depth layers based on disparity maps. Each layer corresponds to a specific depth range, allowing independent processing and enhancement of parallax effects for different depth planes while maintaining overall display resolution constraints
Solution Approach 2:
The patent introduces an additional processing dimension by applying lateral shifts to depth-layered light field data based on viewing angle and depth position. This dimensional transformation enhances parallax effects without requiring increased display resolution, effectively adding depth information in the angular dimension
2Device complexity
If traditional 2D interpolation is used to down-sample light field views, then computational complexity is reduced, but depth perception and parallax effects are significantly degraded
Solution Approach 1:
The patent segments light field processing into distinct depth layers, allowing selective application of interpolation techniques only where necessary while preserving original data in other regions, thus reducing overall computational complexity while maintaining depth perception quality
Solution Approach 2:
The patent applies different processing strategies to different regions of the light field data based on depth characteristics. Areas with significant depth variation receive enhanced processing while uniform regions use simpler methods, optimizing the balance between quality and computational cost
3Manufacturing precision
If 4D interpolation based on spatio-angular local averaging is used, then depth perception is enhanced, but computational cost increases greatly and rendering possibilities are restricted
Solution Approach 1:
The patent divides the computationally intensive 4D interpolation process into separate depth-layer operations. By processing each depth layer independently and using disparity maps to guide the interpolation, the overall computational burden is reduced while maintaining the depth enhancement benefits
Solution Approach 2:
The patent performs preliminary depth estimation using disparity maps before the main interpolation process. This preliminary action identifies regions requiring enhanced processing and prepares depth-layered data structures, reducing the computational scope of subsequent 4D interpolation operations
Data Source
AI summary
Techniques are provided for perception enhancement of light fields (LFs) for use in integral display applications. A methodology implementing the techniques according to an embodiment includes receiving one or more LF views and a disparity map associated with each LF view. The method also includes quantizing the disparity map into planes, where each plane is associated with a selected range of depth values. The method further includes slicing the LF view into layers, where each layer comprises pixels of the LF view associated with one of the planes. The method further includes shifting each of the layers in a lateral direction by an offset distance. The offset distance is based on a viewing angle associated with the LF view and further based on the depth values of the associated plane. The method also includes merging the shifted layers to generate a synthesized LF view with increased parallax.