Three-Level Multimedia Metadata Structure for HDR Compatibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing multimedia container formats lack support for high dynamic range (HDR) image quality and efficient management of multiple multimedia experiences, leading to compatibility issues and inefficient resource utilization.
Innovation Solution
A unified container format with a three-level metadata structure (low-level, mid-level, and upper-level metadata) that encapsulates multiple multimedia applications, enabling seamless playback, editing, and translation across different experiences based on computation resources, device capabilities, and user preferences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a unified container format is implemented to support multiple multimedia applications, then adaptability and versatility are improved, but device complexity increases
Solution Approach 1:
The metadata structure is divided into three distinct levels: low-level metadata (track and clip properties), mid-level metadata (scene and effect information), and upper-level metadata (application-specific parameters). This segmentation allows each level to handle specific functions independently, reducing overall system complexity while maintaining versatility across multiple multimedia applications.
Solution Approach 2:
The container format is designed as a universal structure that can accommodate multiple multimedia applications (photo, video, live photo) within a single file. The multi-level metadata architecture provides a common framework that serves different application types through standardized interfaces, enabling one container format to fulfill multiple functions without requiring separate specialized formats for each application type.
2Manufacturing precision
If HDR multimedia experiences are supported, then image quality is improved, but computation resources required increase
Solution Approach 1:
HDR-related metadata including tone mapping parameters, color volume information, and rendering instructions are pre-encoded and stored in the container during the content creation phase. This preliminary preparation allows playback devices to directly utilize the pre-computed HDR parameters without performing intensive real-time computations, thereby maintaining high image quality while reducing energy consumption during playback.
3Ease of operation
If backward compatibility is maintained with existing formats, then ease of operation is improved, but adaptability to new features decreases
Solution Approach 1:
The new multi-level metadata structure is nested within existing container format frameworks (such as HEIF or JPEG). The low-level metadata layer maintains compatibility with existing format specifications, while mid-level and upper-level metadata layers are added as extensions to provide new HDR and multi-application features. This nested approach allows the system to preserve backward compatibility with legacy formats while incorporating advanced capabilities.
Data Source
Figure 1
Figure 2
Figure 3A
AI summary
Embodiments described herein provide a unified container format for delivering different multimedia applications. One embodiment provides provided a data structure utilized for implementing a plurality of multimedia applications. The data structure includes a first metadata level including low-level metadata used to perform operations associated with media data in a bitstream. The data structure includes a second metadata level including mid-level metadata used to apply operation metadata to render the media data. The data structure includes a third metadata level including upper-level metadata used to utilize the low-level metadata and the mid-level metadata to deliver the plurality of multimedia applications. The first metadata level further includes synchronization metadata for converting the media data, the low-level metadata, the mid-level metadata, and the upper-level metadata from a first multimedia application of the plurality of multimedia applications to a second multimedia application of the plurality of multimedia applications.