Metadata Framework for Immersive Media Scene Graph Translation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies face challenges in efficiently distributing immersive media across heterogeneous client devices, as they require significant information about each client's capabilities and media formats, leading to suboptimal network performance and media interchange issues.
Innovation Solution
The implementation of a metadata framework with subsystems for geometric assets, animation, and logical data sequences helps preserve scene information during scene graph translation, enabling efficient conversion and rendering of immersive media streams across diverse client devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If scene graph translation is performed without a metadata framework, then conversion speed may be faster, but scene information integrity is lost
Solution Approach 1:
The patent introduces a metadata framework as an intermediary layer between different scene graph formats. This framework preserves scene information by capturing geometric assets, animation data, and logical sequences during translation, allowing accurate conversion between heterogeneous formats without direct format-to-format mapping that would lose information.
Solution Approach 2:
The metadata framework segments scene information into distinct subsystems including geometric assets, animation, and logical sequences. This segmentation allows each aspect of scene data to be preserved and translated independently, maintaining overall scene integrity while enabling targeted optimization for different client device requirements.
2Reliability
If client-specific media format information is collected and processed, then media distribution accuracy improves, but network performance deteriorates
Solution Approach 1:
The metadata framework serves multiple functions simultaneously: it preserves scene information integrity, enables format conversion, and provides a standardized interchange format that works across different client devices. This multi-functionality eliminates the need for separate processing paths for different clients, improving network performance while maintaining distribution accuracy.
Solution Approach 2:
The system changes the parameter representation of media by translating scene graphs into a standardized metadata framework format rather than processing each client-specific format separately. This parameter transformation simplifies network processing while maintaining the ability to accurately deliver appropriate formats to different clients.
3Adaptability or versatility
If comprehensive client capability information is required, then media format compatibility improves, but system complexity increases
Solution Approach 1:
The metadata framework acts as an intermediary that handles client capability adaptation. Instead of requiring the source system to know and process each client's specific capabilities, the framework translates scene graphs into a universal format that can then be adapted to any client, reducing system complexity while maintaining broad compatibility.
Solution Approach 2:
Rather than having the source system adapt to each client format directly, the patent inverts the approach by first translating to a standardized metadata framework that encapsulates all necessary scene information, which then serves as the source for client-specific adaptations. This reversal simplifies the source system while maintaining adaptability.
Data Source
AI summary
Embodiments of the present disclosure are directed to a method to process immersive media, including receiving scene graph information of a first scene in a first scene graph format to be converted into a second scene graph format. The method may also include obtaining a metadata framework to preserve scene information stored in a scene graph during a process of scene graph translation, the metadata framework comprising a plurality of subsystems; converting the first scene into the second scene graph format using the metadata framework; and rendering the first scene in the second scene graph format based on the converting. The plurality of subsystems may include a subsystem comprising information associated with geometric assets of the first scene; a subsystem comprising information associated with animation of one or more assets in the first scene; and a subsystem comprising information associated with a logical sequence of data in the first scene.