Scalable Video Stream Adaptation via Pre-Signaled Layer Switching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current scalable video coding technologies face challenges in efficient low-to-high layer switching, leading to reduced coding efficiency and increased implementation complexity, particularly in streaming applications where frequent IDR access units are required for stream adaptation, affecting user experience.
Innovation Solution
The introduction of signaling mechanisms for low-to-high layer switching points in the file format and video bit stream, using specific box types and SEI messages, enables efficient scalable stream switching without extensive parsing and analysis of video bit streams, allowing for intelligent forwarding of scalability layers and computationally scalable decoding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If frequent IDR access units are used for stream adaptation in scalable video coding, then stream adaptability is improved, but coding efficiency deteriorates and implementation complexity increases
Solution Approach 1:
The video stream is segmented into multiple layers (base layer and enhancement layers) with different quality levels. Each layer can be independently decoded, allowing the system to adapt to different network conditions by selecting appropriate layers without requiring frequent full-IDR refreshes, thus improving coding efficiency while maintaining stream adaptability.
Solution Approach 2:
The patent pre-signals switching point information in the file format and bit stream during encoding. This preliminary action allows decoders to efficiently perform layer switching without extensive real-time parsing and analysis, reducing implementation complexity and improving coding efficiency while maintaining frequent adaptation capability.
2Measurement precision
If extensive parsing and analysis of video bit streams is performed for layer switching, then stream adaptation accuracy is improved, but computational burden increases
Solution Approach 1:
Switching point information is pre-calculated and embedded in the file format and bit stream during the encoding phase. This preliminary action transfers the computational burden from the decoding/adaptation phase to the encoding phase, allowing efficient layer switching with minimal real-time computational requirements while maintaining accurate stream adaptation.
Solution Approach 2:
The patent introduces signaling mechanisms (box types in file format, SEI messages in bit stream) as intermediaries that carry switching point information. These intermediaries enable accurate stream adaptation by providing pre-processed switching information without requiring extensive real-time parsing and analysis of the video bit stream.
3Adaptability or versatility
If low-to-high layer switching is implemented without pre-signaled switching points, then coding flexibility is improved, but implementation complexity increases
Solution Approach 1:
The patent pre-signals switching point information in the file format and bit stream during encoding. This preliminary action provides a framework that guides layer switching decisions, maintaining coding flexibility while significantly reducing implementation complexity by eliminating the need for extensive real-time parsing and analysis of video bit streams.
Data Source
AI summary
A system and method for signaling low-to-high layer switching points in a file format level to enable efficient scalable stream switching in streaming servers and local file playback. The present invention also provides for a system and method for signaling low-to-high layer switching points in video bit stream, e.g., to enable intelligent forwarding of scalability layers in media-aware network elements or computationally scalable decoding in stream recipients.