MCU Video Capability Aggregation for Resolution Adaptation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Videoconferencing systems face challenges in coordinating and accommodating participants with varying video resolution capabilities, especially when the number of participants is large, which can degrade user experience and complicate the aggregation of video streams.
Innovation Solution
A Multipoint Control Unit (MCU) executes algorithms to dynamically manage and aggregate video receiving capabilities by maintaining a table of participant capabilities, allowing flexible resolution adjustments and multiple view sources, ensuring high resolution and efficient bandwidth management without degrading user experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the MCU coordinates and accommodates participants with varying video resolution capabilities, then the video conference can support multiple participants with different capabilities, but the complexity of managing and aggregating video streams increases significantly
Solution Approach 1:
The patent segments the video stream management by creating separate aggregation processes for different resolution capabilities. The MCU divides participants into groups based on their capabilities and processes video streams separately for each capability level, then combines them through selective distribution. This segmentation reduces the overall complexity by breaking down the monolithic stream management task into manageable segments.
Solution Approach 2:
The patent introduces an intermediary aggregation mechanism that acts as a mediator between participants with different capabilities. The MCU creates intermediate aggregated streams at different resolution levels, which then serve as intermediaries for distribution to various participants. This intermediary layer simplifies the direct many-to-many coordination problem by introducing structured intermediate representations.
2Productivity
If the MCU handles a large number of participant requests dynamically, then the system can accommodate more participants with varying capabilities, but the processing time and computational resources increase
Solution Approach 1:
The patent applies preliminary action by pre-aggregating video streams at multiple resolution levels before participants join or before capability changes occur. The MCU maintains pre-computed aggregated streams for different capability levels, so when participants join or capabilities change, the system can quickly select and distribute from pre-prepared streams rather than performing full aggregation in real-time. This reduces processing time while maintaining high participant throughput.
3Ease of operation
If the system provides multiple view sources to participants, then the user experience is enhanced with more viewing options, but the bandwidth consumption and system load increase
Solution Approach 1:
The patent applies local quality by providing different video quality levels to different participants based on their specific capabilities and needs. Instead of providing the same high-quality stream to all participants (which would waste bandwidth), the system delivers appropriately sized streams to each participant - high resolution to capable devices, lower resolution to constrained devices. This local optimization enhances user experience for each participant while significantly reducing total bandwidth consumption.
Data Source
AI summary
Video receiving capabilities of participants and source capabilities are compared and conference capabilities for providing different resolutions, frame rates, bit rate, and number of streams are determined by maintaining a conference receiving capability list updated as number and capability of participants' changes. Preferred receiving capabilities of participants are also taken into account in determining conference characteristics based on comparison with allowed capabilities.