Immersive Scene Prioritization for Bandwidth-Limited Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face challenges in efficiently distributing immersive media, such as lightfield and holographic content, over networks due to the heterogeneous nature of client devices and the massive bandwidth requirements, often resulting in buffering and interruptions.
Innovation Solution
A method for media processing that involves assigning priority values to scenes and assets in immersive media, determining streaming orders based on these values, and utilizing network resources to optimize delivery, including split rendering and adaptation based on client device capabilities and network bandwidth.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If all scenes in immersive media are streamed with equal priority, then complete scene data is transmitted, but network bandwidth is wasted and streaming efficiency deteriorates under limited bandwidth conditions
Solution Approach 1:
The patent segments the immersive media content into multiple scenes and further divides each scene into assets with different priority levels (high, medium, low). This segmentation allows the streaming system to selectively transmit only the most important scene components first, optimizing bandwidth utilization while maintaining streaming efficiency under limited network conditions.
Solution Approach 2:
The patent applies local quality by assigning different priority values to different scenes and assets within scenes based on their importance to the user experience. High-priority scenes (e.g., main character scenes, critical plot points) receive preferential treatment in terms of bandwidth allocation and transmission timing, while lower-priority scenes are deferred or transmitted with lower quality, thereby optimizing overall streaming efficiency.
2Reliability
If high-priority scenes are transmitted first, then user experience is improved under limited bandwidth, but complete scene data may not be received
Solution Approach 1:
The patent performs preliminary actions by pre-analyzing the immersive media content to identify and tag high-priority scenes and assets before streaming begins. This pre-processing allows the streaming system to immediately transmit the most critical content first, ensuring that users receive the most important scene data without waiting for complete transmission, thereby improving perceived user experience while managing bandwidth constraints.
Solution Approach 2:
The patent implements a feedback mechanism where the streaming system continuously monitors network conditions, device capabilities, and user interaction patterns, then dynamically adjusts the priority assignment and transmission order of scenes. This feedback loop allows the system to adapt to changing conditions, ensuring that high-priority scenes are transmitted when bandwidth is available while maintaining the ability to transmit lower-priority scenes later to improve data completeness.
3Productivity
If scene prioritization is implemented, then streaming bandwidth is optimized, but system complexity increases due to priority assignment and reordering mechanisms
Solution Approach 1:
The patent simplifies the prioritization system by using a discrete parameter approach - assigning scenes and assets to one of a few predefined priority levels (high, medium, low) rather than using continuous or complex weighting schemes. This parameter simplification reduces the computational complexity of the prioritization algorithm while still achieving effective bandwidth optimization, making the system more practical for implementation.
4Speed
If scenes are reordered based on priority values, then critical scenes are delivered faster, but streaming protocol complexity increases
Solution Approach 1:
The patent segments the scene delivery process into priority-based batches, where high-priority scenes are packaged and transmitted separately from medium and low-priority scenes. This segmentation allows the use of simpler transmission protocols for each batch while achieving faster delivery of critical content, as the high-priority batch can be transmitted immediately without waiting for complete scene data preparation.
Data Source
AI summary
Aspects of the disclosure provide methods and apparatuses for immersive media processing. In some examples, a method of media processing includes receiving a scene based immersive media for playing at a light field based display. The scene based immersive media includes a plurality of scenes. The method includes assigning priority values respectively to the plurality of scenes in the scene based immersive media, and determining an order for streaming the plurality of scenes to an end device according to the priority values. In some examples, a method of media processing includes receiving a scene based immersive media for playing at a light field based display. A scene in the scene based immersive media includes a plurality of assets in a first order. The method includes determining a second order for streaming the plurality of assets to an end device, the second order is different from the first order.