Descriptive Metadata for Media File Sample Dependency Repair
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current media data encapsulation and transmission methods, such as those using the ISO Base Media File Format (ISOBMFF), face challenges in efficiently selecting and describing data for clients to reconstruct valid media files, particularly in low-latency streaming scenarios where sample dependencies are complex and loss or corruption occur.
Innovation Solution
The method generates descriptive metadata within media files to detail dependencies between samples, including offset references and byte-range information, allowing for improved indexing, filtering, and repair of media data, enabling clients to determine which samples to repair or cancel in case of loss, and facilitating low-latency streaming independent of coding type.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If sample dependencies are explicitly described in metadata, then client ability to repair and reconstruct media files is improved, but data transmission volume and processing complexity increase
Solution Approach 1:
The patent segments the dependency description into hierarchical levels: track-level dependencies, sample-level dependencies, and byte-range dependencies. This segmentation allows the system to describe complex sample relationships without requiring complete dependency graphs for every sample, reducing metadata complexity while maintaining reconstruction capability.
Solution Approach 2:
The patent performs preliminary encoding of dependency information into the metadata during the media file creation process. By pre-calculating and storing dependency relationships (such as which samples depend on which byte ranges), the system eliminates the need for complex runtime dependency analysis, reducing processing complexity during playback and repair operations.
2Ease of operation
If complete sample dependency information is provided, then filtering and selection of necessary data is improved, but indexing and metadata size increase
Solution Approach 1:
The patent extracts only the essential dependency information needed for filtering and selection operations. Instead of storing complete dependency graphs, it extracts key relationships such as byte-range dependencies and sample reference relationships, allowing efficient data filtering without the overhead of complete dependency information.
Solution Approach 2:
The patent implements partial dependency description by providing dependency information at appropriate granularities. For example, it describes dependencies at the byte-range level rather than individual sample level where possible, providing sufficient information for filtering operations while avoiding the metadata overhead of complete sample-level dependency tracking.
3Reliability
If byte-range information is included in metadata, then repair capability of corrupted data is improved, but parsing and processing time increase
Solution Approach 1:
The patent performs preliminary organization of byte-range information during media file encoding, pre-calculating and storing the byte ranges that each sample depends on. This preliminary action allows the parsing system to quickly locate and verify dependency information without performing complex range calculations during playback or repair operations, significantly reducing parsing time.
Solution Approach 2:
The metadata structure is designed to be self-descriptive, with byte-range information directly embedded in the dependency descriptions. This allows parsing systems to automatically extract and process dependency information without requiring external dependency databases or complex lookup procedures, reducing parsing overhead while maintaining complete repair capability.
Data Source
AI summary
At least one embodiment of a method for encapsulating media data in a media file, the media data comprising a plurality of samples. After having generated a first track comprising a media data part storing a first sequence of samples of the plurality of samples, the first track further comprising a metadata part describing the first sequence of samples and having generated descriptive metadata describing a dependency between a given sample of the first track and another sample, the generated descriptive metadata being stored in the metadata part of the first track, the first track is encapsulated in the media file, the generated descriptive metadata comprising an offset reference for indicating a reference sample to be used for identifying the sample the given sample depends on.