Light Field Rendering With View Sub-Sampling for Bandwidth Limits
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Handling of light field data becomes a bottleneck for networks due to the vast amounts of data required for adjustable viewpoint viewing of video content.
Innovation Solution
A method for multiplexed rendering of light fields involves receiving a media manifest file identifying multiple representations with varying view sub-samplings, selecting a representation based on user tracking, and rendering the selected representation, including view synthesis and interpolation techniques to optimize data handling.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If full light field data is transmitted to enable adjustable viewpoint viewing, then viewing quality and viewpoint flexibility are improved, but network bandwidth consumption and data handling complexity increase significantly
Solution Approach 1:
The light field data is segmented into multiple representations with different view sub-samplings (e.g., first representation with first sub-sampling, second representation with second sub-sampling). This allows the system to transmit only the necessary portion of light field data based on user needs, reducing overall data volume while maintaining viewpoint flexibility when required.
Solution Approach 2:
The system dynamically selects between different representations based on user direction tracking and bandwidth constraints. The viewpoint flexibility is adjusted dynamically - when user direction is tracked, the system provides high-quality rendered views; when bandwidth is constrained, it switches to lower-resolution sub-sampled representations, optimizing the balance between adaptability and data efficiency.
2Loss of energy
If multiple representations with different view sub-samplings are transmitted, then bandwidth efficiency is improved, but system complexity and rendering requirements increase
Solution Approach 1:
Multiple representations with different view sub-samplings are prepared in advance (first representation, second representation, etc.), allowing the system to efficiently select and transmit appropriate data based on current bandwidth conditions without performing complex processing in real-time, thus reducing runtime complexity.
Solution Approach 2:
The system changes parameters such as view density and sub-sampling rates between different representations. By pre-processing data at multiple parameter settings, the system avoids complex real-time parameter adjustments, reducing computational complexity during runtime while maintaining bandwidth efficiency.
3Productivity
If view synthesis and interpolation are performed to optimize data handling, then data transmission efficiency is improved, but processing time and computational requirements increase
Solution Approach 1:
View synthesis and interpolation operations are performed in advance during the preparation of multiple representations. This preliminary processing allows the system to store pre-synthesized views that can be quickly retrieved and transmitted, reducing real-time processing time while maintaining data transmission efficiency.
Data Source
AI summary
An example method in accordance with some embodiments may include: receiving a media manifest file identifying a plurality of representations of a multi-view video, at least a first representation of the plurality of representations comprising a first sub-sampling of views and at least a second representation of the plurality of representations comprising a second sub-sampling of views different from the first sub-sampling of views; selecting a selected representation from the plurality of representations; retrieving the selected representation; and rendering the selected representation.