Viewport-Adaptive Spatial Streaming for VR Quality Stability
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual reality streaming technologies face challenges in maintaining consistent video quality during viewport changes due to inadequate distribution of bandwidth and computational resources, leading to visible quality degradation and increased processing complexity.
Innovation Solution
A system that dynamically adjusts media segment selection and decoding based on predetermined relationships between different qualities of spatial scene portions, using server-provided information to optimize bandwidth and computational resources, ensuring higher quality is maintained in the viewport area.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the viewport is changed during VR streaming, then the user can explore different spatial regions, but the visible quality degrades due to the time required for the DASH client to react and download new content
Solution Approach 1:
The patent applies preliminary action by having the DASH client proactively request and buffer media segments for potential future viewports before they are actually needed. When viewport change information is received, the client checks whether media segments for the new viewport are already buffered, allowing immediate playback without quality degradation. This pre-fetching strategy eliminates the traditional delay between viewport change and content availability.
Solution Approach 2:
The patent implements dynamics by making the media segment buffering strategy adaptive to viewport change patterns. The system dynamically adjusts which viewports to pre-fetch based on received viewport change information, creating a responsive system that optimizes buffer usage according to actual user behavior rather than following a static pre-fetching schedule.
2Area of stationary object
If high resolution video is transmitted for the entire spherical field of view, then complete spatial coverage is achieved, but bandwidth requirements become tremendously high
Solution Approach 1:
The patent applies local quality by transmitting media segments at different resolutions for different spatial regions. Viewport-centered regions are encoded at high resolution to match the human fovea's resolving capacity, while peripheral and non-viewport regions use lower resolution. This creates a quality gradient that optimizes bandwidth usage by concentrating high-quality content only where the user is actually looking.
Solution Approach 2:
The patent implements segmentation by dividing the spherical video content into multiple media segments corresponding to different spatial regions or viewports. Each segment can be independently encoded at appropriate quality levels and selectively buffered based on predicted viewport changes, allowing fine-grained control over bandwidth allocation across different spatial areas.
3Quantity of substance
If only the viewport region is transmitted at high resolution, then bandwidth is reduced, but the DASH client requires time to adapt and download content for new viewports causing quality degradation
Solution Approach 1:
The patent resolves this contradiction by applying preliminary action through proactive buffering of media segments for potential future viewports. Before a viewport change occurs, the system uses received viewport change information to identify which segments will be needed and buffers them in advance. This eliminates the adaptation delay while maintaining bandwidth efficiency, as only necessary segments are pre-fetched rather than entire high-resolution spherical content.
Solution Approach 2:
The patent applies the skipping principle by rushing through the content acquisition process for new viewports using pre-buffered segments. Instead of waiting for sequential downloading after a viewport change, the system has already retrieved and stored the necessary media segments, allowing immediate playback resumption without quality degradation or visible loading artifacts.
Data Source
AI summary
Various concepts for media content streaming are described. Some allow for streaming spatial scene content in a spatially unequal manner so that the visible quality for the user is increased, or the processing complexity or used bandwidth at the streaming retrieval site is decreased. Others allow for streaming spatial scene content in a manner enlarging the applicability to further application scenarios.


