Viewport-Dependent Tiled Streaming for Multiparty Immersive Video
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing immersive media communication technologies face challenges in efficiently delivering immersive media content, particularly in multi-party scenarios, due to high bandwidth requirements and processing demands, which are not suitable for real-time implementations.
Innovation Solution
Implementing viewport-dependent tiled transmission techniques, where the media content is encoded into multiple tiles, and only tiles corresponding to the viewer's viewport are transmitted, optimizing bandwidth usage and processing demands.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If all tiles of immersive media content are transmitted to each receiver, then complete content coverage is achieved, but bandwidth requirements and processing demands increase significantly
Solution Approach 1:
The immersive media content representation is divided into multiple tiles, allowing selective transmission of only those tiles that cover the receiver's viewport. This segmentation enables the system to transmit a subset of tiles rather than all tiles, reducing bandwidth consumption while maintaining complete viewport coverage.
Solution Approach 2:
The system extracts and transmits only the relevant portion of the immersive media content - specifically the tiles that correspond to the receiver's viewport - rather than transmitting the complete set of all tiles. This extraction principle reduces the quantity of transmitted data while ensuring that all visible content is delivered.
2Loss of information
If all tiles of immersive media content are transmitted to each receiver, then complete content coverage is achieved, but processing demands increase significantly
Solution Approach 1:
By segmenting the immersive media content into tiles and transmitting only the viewport-relevant tiles, the receiver's processing workload is reduced. The device only needs to process and render the subset of tiles that correspond to the viewport rather than processing all tiles, thereby reducing computational complexity.
Solution Approach 2:
The system extracts only the necessary tiles for viewport coverage from the complete tile set, reducing the amount of data that requires processing at the receiver端. This extraction of relevant information minimizes processing demands while maintaining complete viewport content coverage.
3Quantity of substance
If viewport-dependent selective tile transmission is implemented, then bandwidth efficiency is improved, but system complexity increases
Solution Approach 1:
The implementation of viewport-dependent selective tile transmission requires segmenting the immersive media content into tiles and establishing a mapping between tiles and viewport regions. This segmentation approach enables efficient bandwidth utilization by transmitting only necessary tiles, though it introduces additional system complexity for tile management and selection.
Solution Approach 2:
The system dynamically determines which tiles to transmit based on the receiver's viewport information, making the transmission adaptive rather than static. This dynamic selection process improves bandwidth efficiency by adjusting transmitted content to match actual viewing requirements, but adds complexity to the tile selection and transmission control mechanisms.
Data Source
AI summary
An apparatus for providing immersive media content to a plurality of receivers is described. The apparatus obtains for a representation of the immersive media content a plurality of tiles, the plurality of tiles covering some or all of the representation, and, for some or all of the plurality receivers, transmits to each receiver one or more of the tiles, the one or more tiles covering at least a viewport associated with the respective receiver.