Bandwidth-Adaptive Light Field Video via Sub-Aperture Selection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies struggle to efficiently capture and transmit light field content in varying network conditions, particularly in regions with low throughput and high latency, which demands significant network resources and compute resources.
Innovation Solution
Estimate upstream bandwidth, determine a reduced service tier based on available bandwidth, and allocate resources accordingly to adjust the image array for transmission and processing, selecting sub-aperture images that maximize feature saliency and adjacency to maintain quality while adapting to network conditions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If light field video content is transmitted with high detail and full image array, then viewing quality and 3D experience are improved, but network resource consumption and bandwidth requirements increase significantly
Solution Approach 1:
The system dynamically changes parameters of the light field content including resolution, number of sub-aperture images, and bitrate based on network conditions. When bandwidth is limited, it reduces the number of sub-aperture images transmitted or lowers their resolution, thereby reducing network resource consumption while maintaining acceptable viewing quality.
Solution Approach 2:
The light field content is segmented into multiple sub-aperture images that can be selectively transmitted. The system can transmit only a subset of sub-aperture images based on network conditions rather than the full set, reducing the quantity of data transmitted while preserving essential 3D viewing experience.
2Productivity
If full service tier resources are allocated for light field video processing, then processing capability and transmission quality are improved, but system resource requirements exceed available bandwidth in low-resource regions
Solution Approach 1:
The system dynamically adjusts the service tier and resource allocation based on real-time network conditions. It transitions between different processing capabilities and transmission quality levels, adapting to available bandwidth rather than requiring fixed high-resource allocation. This enables the system to function across diverse network environments from high-bandwidth to low-bandwidth regions.
Solution Approach 2:
The system changes operational parameters including service tier level, processing resolution, and transmission bitrate to match available network resources. When bandwidth is limited, it reduces processing capability requirements and transmission quality parameters, ensuring compatibility with low-resource regions while maintaining optimal performance in high-resource environments.
3Quantity of substance
If the image array is reduced to adapt to lower bandwidth, then network resource consumption is reduced, but viewing quality and cone of view are degraded
Solution Approach 1:
The system applies different quality levels to different parts of the light field content based on their importance. It prioritizes transmission of sub-aperture images that contribute most to the cone of view and viewing quality, while reducing or omitting less critical images. This selective transmission reduces network resource consumption while minimizing degradation of essential viewing quality.
Solution Approach 2:
The system transmits a partial set of sub-aperture images rather than the complete image array when bandwidth is limited. By selecting and transmitting only the most essential subset of images, it achieves acceptable viewing quality with reduced network resource consumption, accepting partial functionality rather than complete degradation.
Data Source
AI summary
Systems and methods for bandwidth-adaptive light field video transmission on mobile and portable devices is disclosed. An upstream bandwidth is estimated. A request for a service tier for capture and transmission of light field content is received, wherein the light field content comprises an image array of a plurality of sub-aperture images. When the requested service tier is greater than the estimated upstream bandwidth, a reduced service tier is determined based on the estimated upstream bandwidth. A number of sub-aperture images comprising a reduced image array is determined based on the reduced service tier. The image array is reduced to the reduced image array based on feature saliency and adjacency of sub-aperture images. Resources corresponding to the reduced service tier are provided for capture and transmission of the reduced image array.