Video Streaming Viewpoint Switching Latency Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current multimedia streaming technologies, such as DASH, face challenges in achieving low-latency viewpoint switching while maintaining low bitrate and minimal computational and memory requirements, leading to potential deterioration in the quality of experience, especially in free-viewpoint streaming applications.
Innovation Solution
A method for initiating a viewpoint switch is introduced, which involves optimizing video coding and decoding processes to reduce latency and bitrate, utilizing techniques such as adaptive encoding and decoding of video layers, and leveraging the ISO Base Media File Format to manage metadata and media data efficiently.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If DASH clients receive entire self-contained movie fragments before processing, then buffering is ensured, but latency increases and quality of experience deteriorates during viewpoint switching
Solution Approach 1:
The patent segments the video content into two distinct types of segments: viewpoint segments (containing only base layer for quick viewpoint switching) and non-viewpoint segments (containing both base and enhancement layers for full quality playback). This segmentation allows the system to optimize for different operational requirements - rapid switching versus high quality display - thereby resolving the contradiction between buffering reliability and switching latency.
Solution Approach 2:
The patent dynamically adjusts the composition of buffer contents based on the current operational state. When a viewpoint switch is detected, the system prioritizes loading and processing viewpoint segments over non-viewpoint segments, creating a dynamic buffering strategy that adapts to real-time requirements and reduces switching latency while maintaining adequate buffering for normal playback.
2Adaptability or versatility
If viewpoint switching is implemented in DASH streaming, then free-viewpoint functionality is achieved, but bitrate and computational complexity increase
Solution Approach 1:
The patent applies local quality by differentiating the encoding quality and completeness between viewpoint segments and non-viewpoint segments. Viewpoint segments contain only the essential base layer information needed for rapid viewpoint transitions, while non-viewpoint segments contain full-quality enhancement layers. This localized quality differentiation reduces overall bitrate and computational complexity while preserving the essential viewpoint switching functionality.
3Stability of the object's composition
If entire movie fragments are buffered before processing, then decoding stability is maintained, but memory requirements and processing time increase
Solution Approach 1:
The patent segments the buffer into functionally distinct regions: a viewpoint segment buffer for rapid access during viewpoint switching, and a non-viewpoint segment buffer for standard playback. This segmentation allows the system to maintain decoding stability for each segment type independently while reducing the total buffer occupancy requirement compared to buffering entire uniform movie fragments.
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
A method comprising: requesting, by a client, an independently coded first representation of a video content component from a server; receiving and playing a first set of data units of the independently coded first representation; requesting a second set of data units of a second representation, said second set of data units being dependently coded on one or more requested or buffered data units of the first set; and requesting a third set of independently coded data units of a third representation.