Immersive Media Metadata Coherence and Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current networks lack an efficient mechanism to translate and distribute immersive media across heterogeneous client devices, as they struggle with defining generic translations between scene graph formats and annotating metadata for scene-based media, leading to coherence issues and suboptimal resource utilization.
Innovation Solution
A method and system for processing annotations in immersive media streams, involving determining metadata coherence, generating alignment indicators, and storing supporting information to facilitate access and interpretation by different processors, using standards like ISO/IEC 23090 Part 28 for metadata annotation and translation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If generic translation mechanisms are implemented for scene graph formats, then distribution capability across heterogeneous devices is improved, but system complexity increases due to metadata coherence management
Solution Approach 1:
The patent introduces an intermediary translation layer that mediates between different scene graph formats. This intermediary mechanism translates metadata between heterogeneous device formats while maintaining coherence, thereby enabling broad distribution capability without directly increasing the complexity of individual device systems.
Solution Approach 2:
The patent creates a universal translation framework that can handle multiple scene graph formats through a single coherent system. This multi-functional approach allows one system to serve multiple device types, improving adaptability while consolidating complexity into a manageable central translation mechanism.
2Reliability
If metadata annotation is performed for scene-based media, then interoperability between processors is improved, but processing time increases due to coherence verification
Solution Approach 1:
The patent performs metadata annotation and coherence verification as preliminary actions during the media processing pipeline, before the actual scene rendering. By completing these verification steps in advance, the system ensures interprocessor interoperability without adding time delays during critical rendering operations.
Solution Approach 2:
The patent implements continuous metadata coherence verification that operates parallel to the main processing workflow. This allows the system to maintain reliability through ongoing verification while keeping the primary processing timeline uninterrupted, thus minimizing time loss.
3Measurement precision
If comprehensive metadata is stored for scene media, then access accuracy is improved, but resource expenditure increases due to storage and transmission requirements
Solution Approach 1:
The patent implements local quality optimization by storing comprehensive metadata only where and when it is needed for accurate access. Rather than uniformly storing all metadata everywhere, the system selectively maintains metadata quality at specific locations in the processing pipeline, reducing overall storage and transmission resources while preserving access accuracy where critical.
Data Source
AI summary
Embodiments of the present disclosure are directed to a method, device, system, and a non-transitory computer readable medium to determine, whether a set of metadata used to annotate a particular media or media portion in the immersive media stream is coherent with the media or media portion that the set of metadata describes. The method may also include in response to determining a change has been made to the immersive media in the immersive media bitstream, generating an indicator specifying that the set of metadata and the immersive media in the immersive media bitstream are no longer aligned. The method may also include annotating the particular media or media portion using the set of metadata to facilitate subsequent access and interpretation of the set of metadata by a second processor that is different from the first processor.