Visual Track Composition Metadata Parsing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding methods fail to efficiently combine and render multiple visual tracks with alpha compositing, spatial compositing, and background compositing metadata in a unified manner, particularly in media file formats like ISO base media file format (ISOBMFF).
Innovation Solution
The proposed solution involves an apparatus and method that includes interface and processing circuitry to receive and parse metadata for visual track composition, extracting configuration information for alpha compositing, spatial compositing, and background compositing. This metadata is then used to combine samples from multiple visual tracks, generating composite samples based on the extracted information, and encapsulating it in a file format like ISOBMFF for rendering.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple visual tracks are stored and delivered separately in a media file format, then storage efficiency and delivery flexibility are improved, but the complexity of combining and rendering these tracks with different compositing operations increases
Solution Approach 1:
The patent applies preliminary action by pre-storing compositing metadata (alpha compositing parameters, spatial compositing matrices, background compositing information) alongside the visual tracks in the media file. This allows the compositing operations to be performed efficiently during rendering without requiring complex real-time processing, as all necessary configuration information is already prepared and available.
Solution Approach 2:
The patent introduces metadata as an intermediary element that mediates between the separate visual tracks and the final composite output. This metadata contains all the necessary compositing instructions and parameters, enabling the rendering system to combine tracks correctly without direct complex interactions between the tracks themselves.
2Productivity
If compositing metadata is stored within the media file structure, then integration and processing efficiency are improved, but the file structure complexity increases
Solution Approach 1:
The patent applies universality by designing a metadata structure that serves multiple functions: it stores alpha compositing parameters, spatial compositing transformations, background compositing information, and track composition instructions all within a unified metadata framework. This multi-functional approach improves processing efficiency by consolidating information while managing structure complexity through standardized organization.
Solution Approach 2:
The patent implements nesting by organizing the metadata in a hierarchical structure where compositing parameters are nested within the media file structure, which itself contains the visual tracks. This nested arrangement allows efficient access to compositing information during processing while maintaining a clear, manageable file structure through standardized nesting levels.
3Manufacturing precision
If alpha compositing and spatial compositing operations are performed during rendering, then visual quality and compositing flexibility are improved, but processing time and computational resources increase
Solution Approach 1:
The patent applies preliminary action by pre-computing and storing compositing metadata including transformation matrices, alpha blending parameters, and spatial composition instructions. This allows the rendering system to retrieve and apply pre-prepared compositing operations rather than performing complex calculations in real-time, thereby maintaining high visual quality while reducing processing time.
Solution Approach 2:
The patent utilizes parameter changes by storing compositing operations as predefined parameters and modes (e.g., specific alpha blending modes, transformation matrix types) that can be efficiently applied during rendering. This parameter-based approach enables high-quality compositing through lookup and application of pre-defined operations rather than complex real-time computation.
Data Source
AI summary
Aspects of the disclosure provide an apparatus that includes interface circuitry and processing circuitry. The interface circuitry is configured to receive signals carrying metadata for visual track composition from multiple visual tracks. The visual track composition includes alpha compositing, and can include spatial compositing and background compositing. The processing circuitry is configured to parse the metadata to extract configuration information for the visual track composition. Further, the processing circuitry receives a first sample from a first visual track and a second sample from a second visual track, and combines the first sample with the second sample to generate a composite sample based on the configuration information for the visual track composition.