Multiparty Immersive Video Tiling for Viewport-Based Bandwidth Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing immersive media communication technologies face challenges in efficiently delivering immersive media content, particularly in multi-party scenarios, due to high bandwidth requirements and processing power needs, which are not suitable for real-time implementations.
Innovation Solution
Implementing viewport-dependent tiled transmission techniques, where the immersive media content is encoded into multiple tiles, and only tiles corresponding to the viewer's viewport are transmitted, optimizing bandwidth usage and reducing processing requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If all immersive media content is transmitted to each receiver, then complete content coverage is achieved, but bandwidth requirements increase significantly
Solution Approach 1:
The immersive media content is divided into multiple tiles in the spatial domain. Each tile represents a portion of the overall content, allowing selective transmission to receivers based on their specific viewport requirements. This segmentation enables the system to transmit only relevant portions of the content rather than the entire dataset.
Solution Approach 2:
The system extracts and transmits only the specific tiles that correspond to each receiver's viewport region. By identifying which tiles are visible to each receiver and transmitting only those, the system eliminates unnecessary data transmission while maintaining complete content coverage for all receivers collectively.
2Loss of information
If all immersive media content is processed at each receiver, then complete content is available, but processing power requirements become prohibitive
Solution Approach 1:
By segmenting the content into tiles and assigning specific tiles to specific receivers based on viewport, the processing burden is distributed across multiple receivers rather than requiring each receiver to process the entire content set. Each receiver only needs to process and render the tiles relevant to its viewport.
Solution Approach 2:
Each receiver independently determines its own viewport and requests only the tiles it needs, eliminating the need for a centralized system to manage and distribute all content to all receivers. The receivers self-serve by requesting only their required content portions.
3Quantity of substance
If viewport-dependent tiled transmission is implemented, then bandwidth efficiency improves, but system complexity increases
Solution Approach 1:
The content is pre-segmented into tiles with clear spatial identifiers, and receivers are assigned specific tile sets based on their viewports. This structured approach simplifies the transmission logic compared to more complex adaptive streaming methods, as the tile boundaries and assignments are predetermined rather than dynamically calculated.
Data Source
AI summary
An apparatus for providing immersive media content to a plurality of receivers is described. The apparatus obtains for a representation of the immersive media content a plurality of tiles, the plurality of tiles covering some or all of the representation, and, for some or all of the plurality receivers, transmits to each receiver one or more of the tiles, the one or more tiles covering at least a viewport associated with the respective receiver.