Scalable Video Coding Temporal Level Switching via Nesting Flags
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing scalable video coding systems face limitations in efficiently switching between temporal levels, particularly when transitioning from a lower to a higher temporal level, due to unaddressed dependencies within and between temporal levels, which restricts flexibility and adaptability in real-time communications.
Innovation Solution
Incorporating a 'temporal_level_nesting_flag' in the SVC's Sequence Parameter Set and Scalability Information SEI message to explicitly indicate temporal dependencies and enable nested operation, allowing for seamless addition or removal of temporal levels, thereby facilitating efficient switching between temporal levels.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If traditional switching or transcoding MCUs are used in scalable video coding systems, then video communication can be established, but system complexity is significantly increased and processing efficiency is reduced
Solution Approach 1:
The patent uses scalable video coding to create multiple copies of the video stream at different temporal levels (base layer and enhancement layers) instead of using traditional transcoding. Each layer is a simplified copy that can be independently decoded, eliminating the need for complex switching or transcoding MCUs while maintaining processing efficiency
Solution Approach 2:
The video stream is segmented into multiple temporal layers with different complexity levels. The base layer provides essential video content at lower temporal resolution, while enhancement layers add temporal detail. This segmentation allows receivers to select appropriate layers based on network conditions without requiring complex processing at the MCU
2Adaptability or versatility
If temporal level switching is implemented without explicit dependency signaling, then bitstream compatibility is maintained, but switching flexibility and adaptability are restricted
Solution Approach 1:
The patent introduces syntax elements in the bitstream that pre-signify temporal level dependencies and switching conditions. This preliminary signaling allows receivers to understand the hierarchical relationships between temporal layers before switching is needed, enabling flexible adaptation without complex real-time dependency analysis
Solution Approach 2:
The syntax elements act as intermediaries that carry dependency information between the encoder and receiver. These signaling mechanisms mediate the temporal level switching process by providing explicit instructions about which layers depend on others, simplifying the switching logic at the receiver
3Adaptability or versatility
If seamless temporal level transitions are enabled, then video communication adaptability is improved, but additional signaling overhead is introduced
Solution Approach 1:
The patent modifies existing SVC syntax parameters to include temporal level dependency information. By changing and extending the parameter structure rather than introducing entirely new signaling mechanisms, the patent enables seamless temporal transitions while minimizing additional overhead by reusing existing bitstream structures
Data Source
Figure 1
Figure 2a~2c
Figure 3
AI summary
Media communication systems and methods for media encoded using scalable coding with temporal scalability are provided. Transmitting endpoints include switching information in their transmitted media to indicate if temporal level switching at a decoder can occur at any frame of the transmitted encoded media.