Partitioned Timed Media Encapsulation for Tile Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for streaming user-selected regions of interest in compressed video streams over HTTP are inefficient, as they require accessing non-continuous byte ranges and result in bit-stream duplication, making it difficult to efficiently access and combine spatial tiles in HTTP streaming.
Innovation Solution
A method and device for encapsulating partitioned timed media data, allowing for the selection and independent encapsulation of subsamples into media segment files, enabling efficient streaming of arbitrary regions of interest by creating partition tracks and reference tracks, which reduces indexation overhead and supports efficient combination of different tiles.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If existing methods are used to stream user-selected regions of interest in compressed video streams, then HTTP streaming is supported, but non-continuous byte ranges must be accessed and bit-stream duplication occurs
Solution Approach 1:
The video bit-stream is segmented into independent tile-level segments, where each segment contains complete decoding information for a specific spatial tile. This segmentation allows clients to request only the segments corresponding to their region of interest without needing to access non-continuous byte ranges or handle bit-stream duplication, thereby simplifying the access operation while maintaining efficient indexing.
2Adaptability or versatility
If spatial tiles are accessed in HTTP streaming, then user-selected regions of interest can be streamed, but efficient combination of different tiles is difficult
Solution Approach 1:
The patent extracts and removes the complex tile combination processing from the client device by pre-assembling complete tile segments on the server side. Each segment is self-contained with all necessary decoding parameters and spatial information, allowing clients to simply request and play back segments without performing complex combination operations, thus maintaining adaptability while reducing device complexity.
3Productivity
If partitioned timed media data is encapsulated independently, then efficient streaming of arbitrary regions is enabled, but data duplication may occur
Solution Approach 1:
The patent applies local quality by creating independently encapsulated segments only for the specific spatial tiles and time intervals that are actually requested. Each segment contains precisely the data needed for that specific region and time period, avoiding unnecessary duplication of data across segments. The independent encapsulation is localized to only where needed, maintaining streaming efficiency while minimizing data duplication.
Data Source
AI summary
The invention relates to encapsulating tiled timed media data in a server and providing a timed media data bit-stream from encapsulated tiled timed media in a client device. The tiled timed media data comprises timed samples and each timed sample comprises a plurality of spatial subsamples. After having selected at least one spatial subsample from amongst the plurality of spatial subsamples of one of the timed samples, one tile track comprising the selected spatial subsample and one corresponding spatial subsample of each of the other timed samples is created for each selected spatial subsample. One composite track comprising at least one extractor identifying at least one of the created tile tracks is created. Each created track is independently encapsulated in at least one media segment file.