Scalable Video Coding for Low-Delay Heterogeneous Conferencing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional videoconferencing systems face challenges with end-to-end signal delays and lack of customized video resolution, especially when multiple participants are involved, and they are not well-suited for heterogeneous network environments and endpoint equipment diversity, leading to suboptimal performance and high costs.
Innovation Solution
The development of scalable video coding (SVC) systems that provide a layered representation of video signals at multiple temporal, quality, and spatial resolutions, allowing for adaptive transmission and decoding without significant delays, and enabling features like continuous presence and error resilience in multipoint conferencing scenarios.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional MCUs mix video frames from multiple participants into a common composite video frame stream, then all participants can receive a unified video stream, but the system cannot provide customized video resolutions for different participants and introduces considerable end-to-end delay
Solution Approach 1:
The video stream is segmented into multiple layers with different resolutions (base layer and enhancement layers). Each participant receives the base layer and selectively receives enhancement layers to achieve their desired resolution, eliminating the need for repeated video mixing operations at the MCU.
Solution Approach 2:
The patent introduces a new dimension of scalability by encoding video at multiple resolution levels simultaneously. Instead of mixing videos at a single resolution, the system transmits a scalable video stream that includes base layer (e.g., QCIF) and enhancement layers (e.g., CIF, 2CIF), allowing participants to select their required resolution without additional processing delay.
2Adaptability or versatility
If MCUs decode, mix, and re-encode multiple video streams to provide customized resolutions, then participants can view other participants at different resolutions, but the MCU operations introduce considerable end-to-end delay
Solution Approach 1:
The video is pre-encoded at multiple resolution levels (scalable video coding) before transmission. This preliminary action at the source eliminates the need for real-time decoding, mixing, and re-encoding at the MCU, as the scalable stream can be directly distributed to participants who select their desired resolution level.
Solution Approach 2:
The patent extracts the resolution adaptation function from the MCU and moves it to the participant endpoints. Each participant's device selects and processes only the necessary layers from the scalable video stream, removing the complex video mixing operations from the MCU and thereby reducing end-to-end delay.
3Reliability
If dedicated hardware components are used to provide acceptable quality and performance levels, then video quality and performance are maintained, but infrastructure costs increase
Solution Approach 1:
The scalable video coding system provides a universal solution that works across diverse network conditions and endpoint capabilities. A single scalable video stream can serve participants with different bandwidth constraints and device capabilities, eliminating the need for dedicated hardware components at each endpoint while maintaining acceptable video quality.
4Reliability
If video is transmitted at high resolution to ensure quality, then video quality is maintained, but bandwidth consumption increases and performance degrades on heterogeneous networks
Solution Approach 1:
The patent implements dynamic adaptability through scalable video coding, where the effective video resolution is dynamically adjusted based on the participant's network conditions and device capabilities. Each participant receives a base layer and selectively receives enhancement layers, allowing the system to adapt video quality to heterogeneous network environments without requiring dedicated hardware or complex MCU operations.
Data Source
AI summary
Scalable video codecs are provided for use in videoconferencing systems and applications hosted on heterogeneous endpoints/receivers and network environments. The scalable video codecs provide a coded representation of a source video signal at multiple temporal, quality, and spatial resolutions.