Immersive Video Tile Selection for Bandwidth Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current solutions for streaming spherical videos over bandwidth-constrained networks compromise video quality, leading to issues like freeze screen and black areas due to limited throughput, as they either deliver the full 360° scene at reduced resolution or suffer from sudden quality degradation when the viewport moves.
Innovation Solution
The approach involves spatially tiling the immersive video into a set of tiles and temporally dividing it into segments, with the client terminal defining surfaces bounding tiles, obtaining intersection proportions of a volume of vision, and selecting tiles based on these proportions to ensure continuous high-quality video playback without sudden degradation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the full 360° scene is delivered to the end device, then the user can navigate freely within the scene, but the video resolution is decreased to meet bandwidth constraints
Solution Approach 1:
The 360° scene is divided into multiple tiles spatially, and the video is segmented into segments temporally. Only the tiles corresponding to the current viewport and its surrounding area are delivered to the end device, rather than delivering the entire scene. This segmentation allows maintaining high resolution for the delivered portions while enabling free navigation through progressive loading of additional tiles.
2Loss of energy
If the resolution of the portion of the 360° scene outside the current viewport is reduced, then bandwidth is saved, but the displayed video suffers from sudden degradation when the viewport moves
Solution Approach 1:
The system pre-delivers multiple tile segments corresponding to the current viewport and its surrounding area before the user actually navigates to those regions. This preliminary action ensures that when the user moves the viewport, the required tiles are already available at high resolution, preventing sudden quality degradation while still saving bandwidth by not delivering the entire scene.
3Productivity
If the video resolution is decreased to meet bandwidth constraints, then the throughput requirement is reduced, but the immersive experience quality deteriorates
Solution Approach 1:
The system delivers high-resolution video content only for the specific regions (tiles) that are currently visible or likely to become visible in the viewport, while not delivering or delivering lower-resolution content for the rest of the 360° scene. This local quality approach maintains high immersive experience quality for the delivered content while improving bandwidth efficiency by avoiding transmission of unnecessary full-scene data.
Data Source
AI summary
A terminal adapted to receive an immersive video spatially tiled with a set of tiles is configured to request tiles depending on their intersection with a volume of vision associated with a user.