Layered Mesh Representation for Immersive Light Field Video Compression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The proliferation of virtual reality and three-dimensional content poses challenges due to the resource-intensiveness of rendering large files, making it cumbersome to store and render on user devices, necessitating more efficient methods for compressing and rendering immersive light field videos.
Innovation Solution
The method involves generating a multi-depth image (MDI) from a multi-plane image (MPI) by splitting it into sub-volumes, converting depthmaps to meshes, calculating color and transmittance images for each layer, and transmitting these to user devices for rendering, using techniques such as neural networks to optimize cuts and minimize rendering errors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If three-dimensional content is stored as large files with multiple layers, then visual quality and immersive experience are maintained, but storage complexity and rendering resource requirements increase
Solution Approach 1:
The patent segments the three-dimensional content into multiple depth layers, where each layer represents a specific depth range. This segmentation allows the complex 3D scene to be divided into manageable layers that can be processed and rendered independently, reducing overall rendering complexity while maintaining visual quality.
Solution Approach 2:
The patent extracts depth information from the 3D content to create depth maps, which are then used to generate depth layers. By extracting and separating depth data from color information, the system can optimize storage and rendering processes, reducing the computational burden on user devices.
2Manufacturing precision
If multi-plane images with many fronto-parallel planes are used, then rendering accuracy and depth precision are improved, but file size and processing complexity increase
Solution Approach 1:
The patent applies local quality by creating depth layers with varying levels of detail based on their depth range and importance. Critical depth regions with high visual impact are represented with higher precision using more planes, while less critical regions use fewer planes. This selective approach maintains necessary depth precision while reducing overall file size.
Solution Approach 2:
The patent uses partial action by selectively applying high-resolution depth representation only to specific depth layers that require it for visual quality. Not all depth layers are represented with the same level of detail, allowing the system to achieve adequate depth precision where needed while minimizing file size through reduced representation in other areas.
Data Source
AI summary
Mechanisms for generating compressed images are provided. More particularly, methods, systems, and media for capturing, reconstructing, compressing, and rendering view-dependent immersive light field video with a layered mesh representation are provided.