Partitioned Media Encapsulation for Tile Streaming Overhead
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for streaming user-selected regions of interest in compressed video streams over HTTP are inefficient due to the need for multiple non-continuous byte range access and potential duplication of base layer data when accessing spatial tiles, which is not effectively addressed by current file formats like ISO BMFF.
Innovation Solution
A method and device for encapsulating tiled timed media data that allows efficient streaming by creating a valid file format and elementary stream at parsing time, enabling the combination of different tiles and reducing transmission overhead, using a generic signaling for coding dependencies and reorganizing data into contiguous byte ranges for efficient access.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple non-continuous byte range access is used to stream selected tiles, then spatial access to specific tiles is enabled, but transmission overhead increases and streaming efficiency decreases
Solution Approach 1:
The video stream is segmented into tiles that can be independently decoded and streamed. Each tile is organized as a separate spatial unit within the encoded bit-stream, allowing clients to request and receive only the specific tiles they need without downloading the entire video stream. This segmentation enables efficient spatial access while reducing transmission overhead by eliminating the need to transmit unwanted tile data.
2Reliability
If base layer data is duplicated when accessing spatial tiles, then tile independence is improved, but data redundancy increases and bandwidth usage increases
Solution Approach 1:
The encoding structure is organized in a nested manner where tile-specific data is embedded within an overall encoded bit-stream structure. The bit-stream contains organizational information that allows selective extraction of individual tiles while sharing common base layer data efficiently. This nesting enables tile independence without requiring full duplication of base layer data for each tile, as the structure allows intelligent sharing and referencing of common data elements.
3Adaptability or versatility
If current file formats like ISO BMFF are used for encapsulation, then standard compatibility is maintained, but efficient streaming of selected tiles is not achieved
Solution Approach 1:
The solution provides a multi-functional encapsulation approach that works with existing file formats like ISO BMFF while adding tile-specific organizational capabilities. The method enables both standard video streaming and efficient tile-selective streaming through the same encoded bit-stream structure. By organizing tiles within the existing file format framework and adding appropriate metadata and access mechanisms, the solution achieves tile streaming efficiency without requiring a completely new file format, thus maintaining compatibility while enabling new functionality.
Data Source
Figure 1a~1b
Figure 2~8
Figure 3
AI summary
The invention relates to encapsulating partitioned timed media data in a server, the partitioned timed media data comprising timed samples, each timed sample comprising a plurality of subsamples. After having selected at least one subsample from amongst the plurality of subsamples of one of the timed samples, one partition track comprising the selected subsample and one corresponding subsample of each of the other timed samples is created for each selected subsample. Next, at least one dependency box is created, each dependency box being related to a partition track and comprising at least one reference to one or more of the other created partition tracks, the at least one reference representing a decoding order dependency in relation to the one or more of the other partition tracks. Each of the partition tracks is independently encapsulated in at least one media file.