Media Stream Spatial Tile Grouping for Bandwidth Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing media data streaming technologies, such as RTP, face challenges in efficiently transmitting high-resolution video content over networks, particularly in scenarios where not all devices can handle full resolution, leading to sub-optimal bandwidth consumption and compatibility issues with multicast delivery.
Innovation Solution
The solution introduces a new 'group' semantic and attribute in SDP to signal spatial relationships between media streams, allowing for independent decoding and delivery of spatial sub-parts or tiles, compatible with existing RTP mechanisms, without requiring additional header extensions, enabling user devices to selectively receive and render only necessary media streams.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If full high-resolution video is transmitted to all devices, then video quality is improved, but bandwidth consumption increases and compatibility with low-capability devices deteriorates
Solution Approach 1:
The video stream is segmented into multiple spatial tiles that can be independently decoded and transmitted. Each tile represents a spatial sub-part of the original video, allowing receivers to selectively receive only the tiles they need based on their capabilities and interests, thereby reducing bandwidth consumption while maintaining video quality for capable devices.
Solution Approach 2:
The system dynamically adapts the video delivery by allowing receivers to select different combinations of spatial tiles based on their real-time capabilities and network conditions. This dynamic selection enables the same video content to be optimized for different devices without requiring multiple pre-encoded versions.
2Measurement precision
If full high-resolution video is transmitted, then video quality is improved, but compatibility with devices having limited rendering capabilities deteriorates
Solution Approach 1:
By dividing the video into independent spatial tiles, the system enables devices with limited rendering capabilities to receive and display only a subset of tiles, while high-capability devices can receive all tiles for full-resolution display. This segmentation makes the system adaptable to various device capabilities.
Solution Approach 2:
Different spatial regions of the video can be delivered with different qualities or resolutions according to device capabilities. Devices can selectively receive high-quality tiles for important regions and lower-quality or fewer tiles for less important regions, optimizing the balance between video quality and device compatibility.
3Adaptability or versatility
If spatial sub-parts are transmitted as independent media streams, then selective reception is enabled, but signaling complexity increases
Solution Approach 1:
The patent reuses existing SDP (Session Description Protocol) mechanisms that are already widely supported in multimedia streaming. By extending these existing protocols rather than creating new proprietary signaling mechanisms, the solution enables selective reception while minimizing signaling complexity and ensuring broad compatibility.
Data Source
Figure 1a
Figure 1b
Figure 2a~2b
AI summary
The invention relates to streaming of at least two media streams, each of the at least two media streams carrying encoded media data, the encoded media data respectively carried by the at least two media streams being decodable independently from each other. After sending a description of media streams of a plurality of media streams including the at least two media streams and, in response to sending the description, receiving a request for obtaining the at least two media streams, the at least two media streams are transmitted according to the received request. The description comprises an indication relating to a spatial relationship between media data carried by the at least two media streams.