Streaming Spherical Video Adaptive Quality Switching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Streaming spherical video consumes significant system resources due to high bandwidth and processing requirements, posing challenges in efficient transmission and playback.
Innovation Solution
The method involves encoding a video frame at a base quality and additional portions at a higher quality, with keyframes staggered across view perspectives to optimize streaming and playback on devices like head-mounted displays, using techniques such as equiangular cubemap sampling and adaptive stream switching based on user motion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If spherical video is encoded and streamed at high quality, then video quality is improved, but bandwidth consumption and system resources increase significantly
Solution Approach 1:
The spherical video stream is segmented into multiple quality versions (first video stream at base quality, second video streams at higher quality). The system transmits the base quality stream continuously and selectively transmits higher quality portions based on user perspective, thereby reducing overall bandwidth consumption while maintaining quality where needed.
Solution Approach 2:
Instead of uniformly encoding the entire spherical video at high quality, the system applies higher quality encoding only to specific portions corresponding to the user's current perspective (foveated regions), while maintaining base quality for other regions. This localized quality enhancement reduces total bandwidth consumption while preserving perceptual quality.
2Manufacturing precision
If spherical video is encoded and streamed at high quality, then video quality is improved, but processing and memory resources for encoders and decoders increase
Solution Approach 1:
The video processing task is segmented into base quality encoding (always transmitted) and enhanced quality encoding (selectively transmitted). The decoder only processes enhanced quality portions when needed, reducing overall processing and memory requirements compared to decoding the entire high-quality stream.
Solution Approach 2:
The system performs partial high-quality encoding only for portions of the video that are likely to be viewed, rather than encoding the entire spherical video at high quality. This reduces encoder processing resources while maintaining quality for the actual viewing experience.
3Adaptability or versatility
If multiple high-quality video streams are transmitted for different perspectives, then user experience is improved, but bandwidth consumption increases
Solution Approach 1:
The multiple perspective streams are segmented into a base stream (first video stream) and perspective-specific enhancement streams (second video streams). The base stream provides continuous coverage at acceptable quality, while enhancement streams provide selective quality improvements, reducing total bandwidth compared to transmitting all perspective streams at full quality.
Solution Approach 2:
Instead of transmitting complete high-quality streams for all possible perspectives, the system transmits only partial high-quality portions corresponding to predicted or detected user perspectives. This provides adaptability for improved user experience while consuming less bandwidth than full multi-perspective streaming.
Data Source
AI summary
A method includes receiving a first video stream at a playback device, the first video stream having a first quality, receiving at least two second video streams at the playback device, the at least two second video streams each corresponding to a portion of the first video stream, the at least two second video streams having a second quality, the second quality being a higher quality as compared to the first quality, playing back the first video stream at the playback device, selecting a third video stream from the at least two second video streams based on a view perspective of a user of the playback device, and playing back the third video stream together with the first video stream at the playback device.