VR Video Projection Signaling for Adaptive HTTP Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face challenges in efficiently streaming virtual reality (VR) video data over HTTP using dynamic adaptive streaming, particularly in adapting to varying network bandwidth and ensuring seamless playback quality.
Innovation Solution
The technique involves encoding VR video data into multiple representations with different characteristics, such as bitrate, resolution, and codec profiles, and using a Media Presentation Description (MPD) to manage adaptive streaming, allowing clients to dynamically switch between these representations based on available bandwidth.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If video data is compressed using advanced video coding standards to improve transmission efficiency, then bandwidth utilization improves, but decoding complexity and processing requirements increase
Solution Approach 1:
The video stream is divided into multiple segments with different quality levels and bitrates. Each segment can be independently decoded, allowing the system to transmit highly compressed video efficiently while enabling selective decoding based on device capabilities and network conditions, thus resolving the contradiction between transmission efficiency and decoding complexity.
Solution Approach 2:
The system dynamically changes video encoding parameters such as bitrate, resolution, and compression level to optimize the balance between transmission efficiency and decoding complexity. By adjusting these parameters based on network conditions and device capabilities, the system achieves efficient transmission without overwhelming the decoder.
2Adaptability or versatility
If multiple video representations with different qualities are provided to adapt to varying network bandwidth, then streaming adaptability improves, but system complexity and bandwidth consumption increase
Solution Approach 1:
The system implements dynamic adaptive streaming where video representations are selected and switched in real-time based on current network bandwidth and device capabilities. This dynamic approach allows the system to provide multiple quality levels for adaptability while managing complexity through automated selection algorithms that adjust to changing conditions without requiring manual intervention.
Solution Approach 2:
The streaming system incorporates feedback mechanisms that continuously monitor network bandwidth, playback quality, and device performance. Based on this feedback, the system automatically adjusts which video representation to transmit next, enabling adaptability while managing system complexity through data-driven decision-making rather than complex predetermined rules.
3Productivity
If video data is segmented for adaptive streaming to improve bandwidth utilization, then streaming efficiency improves, but playback continuity and seamless switching become more difficult
Solution Approach 1:
The system performs preliminary actions by pre-buffering multiple video segments at different quality levels before playback begins or before switches are needed. This advance preparation ensures that when network conditions change or switching between representations is required, seamless transitions can occur without interruption, maintaining playback continuity while preserving streaming efficiency.
Solution Approach 2:
The system implements beforehand cushioning by maintaining buffer stocks of video data at multiple quality levels and preparing fallback segments in advance. This cushioning approach ensures that even if network conditions deteriorate or switching delays occur, playback continuity is maintained without visible interruptions, thus resolving the contradiction between streaming efficiency and reliability.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A device for processing media data is configured to receive media data including virtual reality (VR) video data; determine, based at least in part on data signaled at an adaptation set level of a media presentation description for a media presentation, a projection mapping used in the media presentation; process segments of a video representation of the media presentation based on the projection mapping used in the media presentation. A device for processing media data is configured to generate media data that includes VR video data; include in the media data, data signaled at an adaptation set level of a media presentation description that identifies a projection mapping used in media presentation included in the media data; and send segments of a video representation of the media presentation based on the projection mapping used in the media presentation.