Overlay Composition Metadata Encoding for 3D Video
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies inadequately support overlay compositions and metadata for high-resolution, 3D, and omnidirectional video content, particularly in efficiently encoding and delivering spherical content, which limits flexibility and scalability in rendering and composition processes.
Innovation Solution
The proposed solution involves a method for associating and storing overlay composition metadata using various data structures and mechanisms, such as track groups, derived tracks, and timed metadata tracks, to enable flexible overlay composition and rendering, particularly for hierarchical track structures, allowing for offset, layer, and source metadata specification to manage complex video content like 3D and omnidirectional media.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If overlay composition metadata is stored using traditional flat structures, then implementation is simple, but flexibility and scalability for complex compositions are limited
Solution Approach 1:
The patent segments overlay composition metadata into hierarchical track structures where different levels of composition information are separated into distinct track groups. This allows complex compositions to be broken down into manageable segments that can be independently processed and rendered, improving flexibility without overwhelming complexity at any single level.
Solution Approach 2:
The patent introduces a hierarchical dimension to metadata storage by organizing overlay composition information across multiple levels (track groups, tracks, samples). This dimensional transformation from flat to hierarchical structure enables better organization of complex compositions while maintaining manageable complexity through layered abstraction.
2Loss of information
If all overlay composition metadata is stored explicitly, then complete composition information is available, but metadata storage requirements increase
Solution Approach 1:
The patent establishes default composition behaviors and parameters in advance through track group level settings. This preliminary configuration allows common composition scenarios to be handled without storing explicit metadata for every detail, reducing storage requirements while maintaining complete composition information through a combination of defaults and specific overrides.
Solution Approach 2:
The patent creates universal track group structures that can serve multiple composition purposes. A single track group configuration can handle various overlay scenarios through parameter adjustments rather than requiring separate metadata for each case, reducing overall metadata storage while preserving complete composition information through flexible reusability.
Data Source
AI summary
The techniques described herein relate to methods, apparatus, and computer readable media configured to encode and decode multimedia data. A hierarchical track structure for the multimedia data is encoded with at least a first track and a second track, wherein the second track is above the first track. Overlay composition metadata is associated with the second track, wherein the overlay composition metadata comprises offset metadata, layer metadata, source metadata, or some combination thereof. The overlay composition metadata specifies at least part of an overlay composition for media data associated with the first track, wherein the overlay composition can be performed as part of a track derivation operation on media data associated with the first track to generate media data of the second track, such that the second track is a derived track of the first track.