ISOBMFF Preselection Signaling for Unified Media Track Processing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing media file formats like ISOBMFF lack the ability to signal preselections and their processing information, which is necessary for providing tailored media experiences to users, especially in the context of ISOBMFF.
Innovation Solution
A method for processing media streams that involves identifying preselection-related boxes, analyzing metadata, and providing tracks for downstream processing, enabling unified signaling and processing of preselections across different formats.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If ISOBMFF format is used for media stream packaging, then compatibility with existing media players is improved, but the ability to signal preselections and their processing information is lost
Solution Approach 1:
The patent embeds preselection signaling information within the existing ISOBMFF box structure by nesting preselection-related boxes (such as 'pres' boxes) inside existing container boxes like 'moov' or 'trak' boxes. This allows preselection data to be integrated into the established ISOBMFF hierarchy without creating a separate parallel structure, thereby maintaining format compatibility while adding new functionality.
Solution Approach 2:
The patent designs the preselection signaling mechanism to serve multiple functions: it provides preselection information to media players, enables tailored media experiences, and maintains compatibility with existing ISOBMFF processing pipelines. The same box structure is used both for traditional media metadata and for preselection signaling, allowing a single system to handle both legacy and enhanced requirements.
2Adaptability or versatility
If preselection information is signaled in media streams, then tailored media experiences for users are enabled, but implementation effort and computational costs increase
Solution Approach 1:
The patent pre-computes and pre-packages preselection information into the media stream during the encoding or packaging phase. Media players receive ready-to-use preselection data in the form of structured boxes containing track groupings and processing information, eliminating the need for complex runtime analysis and reducing computational burden during playback.
Solution Approach 2:
The patent uses standardized box structures that are copied and reused throughout the ISOBMFF hierarchy. Once preselection information is defined in a parent box, it can be referenced and copied to child boxes, reducing the overall amount of data that needs to be processed and implemented across different media players.
3Adaptability or versatility
If preselection-related boxes are added to ISOBMFF structure, then unified signaling across formats is achieved, but the complexity of processing the media stream increases
Solution Approach 1:
The patent divides preselection information into separate, independently processable boxes within the ISOBMFF structure. Each preselection-related box contains specific aspects of preselection data (such as track groupings, language information, or processing flags), allowing media players to selectively parse and process only the relevant segments based on their capabilities and the user's needs.
Data Source
Figure 1A~1B
Figure 2~3A
Figure 3B~4B
AI summary
Described is a method of processing a media stream. The method comprises receiving the media stream packetized in accordance with a predefined transport format, wherein the packetized media stream comprises a plurality of hierarchical boxes each being associated with a respective box type identifier, and wherein the plurality of boxes comprise one or more 5track boxes referencing respective tracks indicative of media components of the media stream; determining whether the media stream comprises a preselection-related box of predefined type indicative of a preselection, wherein the preselection corresponds to a media presentation to a user; and if it is determined that the media stream comprises the preselection-related box: analyzing metadata information corresponding to the preselection-0related box, the metadata information being indicative of characteristics of the preselection;identifying one or more tracks in the packetized media stream contributing to the preselection based on the metadata information; and providing the one or more tracks for downstream processing in accordance with the given preselection