Scene Graph Translation for Low-Latency Immersive Media Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The distribution of immersive media over commercial networks is hindered by the diversity of client devices, which require significant information about each client's capabilities and media formats to facilitate media interchange, leading to inefficiencies and latency due to repeated transformation and streaming processes.
Innovation Solution
A method and device for streaming immersive media that utilize a metadata framework to translate scene graphs between formats, incorporating metadata systems to describe logical, physical, and processing aspects, enabling efficient media interchange across heterogeneous client devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If scene graphs are translated between different formats for each client device, then compatibility with heterogeneous client devices is improved, but processing time and latency increase due to repeated transformations
Solution Approach 1:
The system performs preliminary translation of scene graphs from source formats to an intermediate representation format before distribution. This advance preparation eliminates the need for repeated real-time transformations when content is delivered to different client devices, thereby reducing latency while maintaining format compatibility.
Solution Approach 2:
The patent introduces an intermediate representation format as a mediator between various source scene graph formats and target client device formats. This intermediate format serves as a universal bridge that enables efficient translation to multiple target formats without requiring direct pairwise transformations between all possible format combinations.
2Adaptability or versatility
If comprehensive information about client capabilities and media formats is collected, then media interchange compatibility is improved, but system complexity increases
Solution Approach 1:
The system manages client device information as structured parameters and characteristics that can be efficiently stored, compared, and matched. By parameterizing client capabilities and media format support, the system reduces complexity in determining compatibility and selecting appropriate translation paths while maintaining comprehensive adaptability.
3Adaptability or versatility
If scene graphs are translated in real-time for each client request, then format adaptability is improved, but processing efficiency decreases
Solution Approach 1:
The system performs scene graph translation to an intermediate representation format in advance, before actual client requests are processed. This preliminary action ensures that when clients request content, the translation work has already been completed, dramatically improving processing efficiency while maintaining full format adaptability.
Solution Approach 2:
The system creates copies of scene graphs in an intermediate representation format that can be efficiently distributed and further translated to various target formats. This copying approach avoids repeated transformation of the original source format and enables parallel processing for multiple clients.
Data Source
AI summary
There is provided a method of streaming immersive media, executable by a processor, the method including: ingesting content of a scene of the immersive media, the content including a scene graph in a first scene graph format; translating the scene graph from the first scene graph format to a second scene graph format according to a metadata framework including first systems of metadata representing information shared commonly across the first scene graph format and the second scene graph format; and streaming the content of the immersive media based on the second scene graph translated from the first scene graph according to the metadata framework.