Unifying Data Model for Heterogeneous Immersive Media Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies lack a standard representation for immersive media, hindering the streaming of heterogeneous media formats to heterogeneous end-point clients over commercial networks, thus limiting the distribution of immersive media applications.
Innovation Solution
A unifying data model and system for representing and streaming heterogeneous immersive media, enabling the streaming of both timed and untimed media across commercial networks to heterogeneous end-points, using a manifest and layered representation that allows clients to receive minimal information first and refine it progressively.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a unifying data model is implemented to represent heterogeneous immersive media, then adaptability to different end-point clients is improved, but device complexity increases
Solution Approach 1:
The data model is segmented into multiple hierarchical levels including scene graph nodes, media assets, and representation layers. Each level handles specific aspects of immersive media representation, allowing the system to manage complexity through modular organization while maintaining broad adaptability to different end-point clients through standardized interfaces at each level.
Solution Approach 2:
The scene graph data model serves multiple functions simultaneously: it represents spatial relationships, stores media asset metadata, enables progressive streaming, and adapts to different client capabilities. This multi-functionality reduces the need for separate specialized data structures for different media types and delivery scenarios.
2Loss of time
If progressive streaming with layered representation is used, then loss of time in content delivery is reduced, but device complexity increases
Solution Approach 1:
The scene graph and media assets are prepared in advance with hierarchical layering and metadata annotation during encoding. This preliminary organization enables the streaming system to efficiently deliver content in progressive layers without requiring complex real-time processing, reducing delivery time while keeping runtime complexity manageable.
Solution Approach 2:
The streaming system dynamically adapts the level of detail and quality of immersive media content based on network conditions and client capabilities. The layered representation allows flexible composition of base layers and enhancement layers, enabling time-efficient delivery by transmitting only necessary detail levels rather than complete high-fidelity content.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method, computer system, and computer readable medium are provided for displaying video content. An interface to a presentation engine to enable real-time rendering of a plurality of objects is created whereby the plurality of objects are logically organized together through a plurality of scene graphs, and whereby the plurality of scene graphs is organized a media interchange format. Geometry information of the plurality of scene graphs is updated through the interface to a representation engine. The plurality of objects is streamed based on multi-resolution or multi-tesselation of heterogenous visual geometric objects in each of the scene graphs from among the plurality of scene graphs using the media interchange format.