ISOBMFF Track Grouping for Dependency Signaling and Stream Switching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing ISOBMFF formats lack mechanisms to signal dependencies between groups of tracks, necessitating separate configurations for encoders, segmenters, and manifest generators, and do not support efficient grouping and switching between DASH AdaptationSets and CMAF switching sets.
Innovation Solution
A method and apparatus for generating an ISOBMFF file that groups tracks into track groups and groups of track groups, using track group type and grouping type specific boxes to indicate interrelations, allowing standalone operation of encoders, segmenters, and manifest generators.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If tracks are grouped using existing ISOBMFF mechanisms (TrackGroupTypeBox, Entity ToGroupBox, alternate_group field), then track grouping is achieved, but dependency signaling between groups of tracks is lost and separate configurations are required
Solution Approach 1:
The patent combines multiple existing grouping mechanisms (TrackGroupTypeBox, Entity ToGroupBox, alternate_group field) into a unified grouping structure that preserves dependency information. By merging these separate mechanisms into a single comprehensive grouping system, the patent eliminates the need for separate configurations while maintaining complete track dependency signaling within the ISOBMFF file.
Solution Approach 2:
The patent creates a universal grouping mechanism that can handle multiple types of track relationships (DASH AdaptationSets, CMAF switching sets, and other track groupings) through a single standardized structure. This multi-functional grouping system replaces the need for multiple separate configuration mechanisms, allowing one system to serve multiple grouping purposes while preserving all dependency information.
2Ease of manufacture
If encoders, segmenters, and manifest generators operate with separate configurations, then each component can be independently optimized, but deployment constraints increase and coordination becomes difficult
Solution Approach 1:
The patent embeds complete grouping and dependency information in the ISOBMFF file during the encoding stage, performing the grouping configuration action in advance. This preliminary action ensures that all subsequent components (segmenters, manifest generators) can operate independently using the pre-configured information stored in the file, eliminating the need for separate configurations and coordination while maintaining deployment flexibility.
3Adaptability or versatility
If multiple grouping mechanisms are used to support DASH and CMAF, then comprehensive track grouping is achieved, but the file format complexity increases and efficiency decreases
Solution Approach 1:
The patent segments the grouping information into hierarchical levels within the ISOBMFF file structure, organizing track dependencies in a segmented manner that allows efficient access and processing. By segmenting the grouping data into structured boxes and fields, the patent maintains format versatility for supporting multiple streaming standards while enabling efficient parsing and processing compared to using multiple separate grouping mechanisms.
Data Source
AI summary
Described herein is a method of processing media streams. The method includes: receiving one or more media streams and side information for the one or more media streams, the one or more media streams comprising media content comprising one or more tracks; generating an ISO Base Media File Format, ISOBMFF, file based on the one or more media streams and the side information; and outputting the generated ISOBMFF file for further processing. Further described are a respective method of processing an ISOBMFF file, respective apparatuses and a computer program product.