Adaptive Immersive Video Streaming via Spatial Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current immersive video streaming technologies face high bandwidth consumption issues, requiring significant bandwidth to maintain video quality and reduce startup delay and buffering, especially when streaming 360° video content.
Innovation Solution
The system splits immersive video scenes into portions, allowing clients to request and stream only the streams within the user's current field of view, using a server that provides a manifest detailing each stream's properties, enabling dynamic selection and streaming of necessary streams based on the user's viewing direction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If immersive video content is streamed as a single high-quality stream containing all viewable areas, then video quality is maintained, but bandwidth consumption increases dramatically
Solution Approach 1:
The immersive video content is divided into multiple separate streams, where each stream contains a specific portion or region of the spherical video scene. Instead of transmitting the entire 360-degree video at high quality, the system segments the content spatially and transmits only the relevant segments based on user viewing direction, thereby maintaining video quality while dramatically reducing bandwidth consumption.
2Loss of energy
If adaptive bitrate streaming is used to reduce bandwidth consumption, then bandwidth efficiency improves, but video quality may deteriorate
Solution Approach 1:
The system applies different quality levels to different regions of the immersive video content based on user viewing behavior. The portion of the video within the user's current field of view is transmitted at high quality, while peripheral or less frequently viewed regions are transmitted at lower quality or not at all. This local quality differentiation maintains overall video quality perception while optimizing bandwidth usage.
3Manufacturing precision
If high resolution 360° video is streamed to maintain quality level, then video quality is preserved, but startup delay and buffering increase
Solution Approach 1:
The system performs preliminary actions by pre-processing the immersive video content into multiple segmented streams with different quality levels and regions. When a user requests video playback, the system can immediately begin transmitting the relevant high-quality segments without waiting to load the entire high-resolution 360-degree video, thereby reducing startup delay and buffering while maintaining video quality.
Data Source
AI summary
Client configured for retrieving a video data representation of an immersive video scene streamed by a server using a streaming protocol, wherein the server is configured for providing a plurality of streams to the client, wherein each of the streams comprises a portion of the immersive video scene, the client comprising: a sending interface; a reception interface; a viewing direction receiving unit; and a stream selecting unit; wherein the sending interface is configured for transmitting a streaming request for streaming the one or more selected streams as the video data representation of the immersive video scene, wherein the sending interface receives from the stream selecting unit a selected stream information identifying the one or more selected streams, wherein the selected stream information is created by the stream selecting unit based on the viewing direction of the user of the client and based on the manifest.