Extended-Dimension Light Field Rendering With Angular View Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image processing technologies struggle to effectively display 4D light field images, which require rendering images from different viewpoints in both horizontal and vertical directions, due to limitations in view mapping and color volume adjustment based on angular views.
Innovation Solution
The method involves using a view function that determines angular views based on pixel locations and viewer position, incorporating angular range metadata and color volume mapping metadata to enhance image processing and display, with interpolation techniques to create additional views from reference views.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a view function is used to determine angular views based on pixel locations and viewer position, then the accuracy of 4D light field image rendering is improved, but the complexity of image processing increases
Solution Approach 1:
The view function is segmented into separate horizontal and vertical angular view functions, each handling one dimension independently. This allows the complex 4D light field rendering to be broken down into manageable components that can be processed separately and then combined, reducing the overall computational complexity while maintaining accuracy.
Solution Approach 2:
The view function acts as an intermediary between the raw light field data and the final rendered image. It mediates the transformation by calculating angular views based on pixel locations and viewer position, serving as a computational bridge that simplifies the overall processing pipeline while maintaining rendering accuracy.
2Manufacturing precision
If color volume mapping metadata is adjusted based on angular views, then the color accuracy and viewing experience are improved, but the processing time and computational load increase
Solution Approach 1:
Color volume mapping metadata is pre-adjusted for different angular views before the actual rendering process. By performing this preparation in advance, the system avoids redundant calculations during real-time rendering, reducing processing time while maintaining color accuracy across different viewing angles.
Solution Approach 2:
The system changes color volume mapping parameters dynamically based on the determined angular views. By adjusting these parameters according to the viewer's position and the corresponding angular view, the system optimizes color accuracy for each viewing condition without requiring complete reprocessing of the entire image.
3Adaptability or versatility
If interpolation techniques are used to create additional views from reference views, then the versatility of the light field display is improved, but the quality and fidelity of the rendered image may deteriorate
Solution Approach 1:
Different regions of the light field image are processed with different interpolation qualities based on their local characteristics. Areas with higher detail requirements receive more precise processing while less critical areas use simpler interpolation methods, maintaining overall image fidelity while enabling versatile viewpoint rendering.
Solution Approach 2:
The interpolation process is made dynamic, adapting the level and type of interpolation based on the specific viewing conditions and angular view being rendered. This allows the system to optimize between versatility and fidelity by adjusting interpolation strength and method in real-time based on the desired viewpoint.
4Stability of the object's composition
If the view function is defined relative to a reference plane, then the consistency of angular view determination is improved, but the adaptability to viewer positions outside the reference plane decreases
Solution Approach 1:
The view function is extended from a 2D reference plane to a 3D viewing space by adding the depth dimension. This allows the function to handle viewer positions at different distances and angles relative to the reference plane, maintaining consistency while improving adaptability to three-dimensional viewing conditions.
Solution Approach 2:
The view function is designed to serve multiple purposes: it consistently determines angular views for reference plane positions while also adapting to extended viewing zones. By making the function universal, it can handle both the stable reference plane cases and the more challenging extended viewing conditions through a unified approach.
Data Source
AI summary
In one embodiment, methods, media, and systems process and display light field images using a view function that is based on pixel locations in the image and on the viewer's distance (observer's Z position) from the display. The view function can be an angular view function that specifies different angular views for different pixels in the light field image based on the inputs that can include: the x or y pixel location in the image, the viewer's distance from the display, and the viewer's angle relative to the display. In one embodiment, light field metadata, such as angular range metadata and/or angular offset metadata can be used to process and display the image. In one embodiment, color volume mapping metadata can be used to adjust color volume mapping based on the determined angular views; and the color volume mapping metadata can also be adjusted based on angular offset metadata.