SFU Media Server Simulcast Stream Adaptation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Video conferencing applications based on the selective forwarding unit (SFU) model experience video quality and performance degradation in environments with multiple participant devices, heterogeneous codec types, varying network quality, and different screen resolutions.
Innovation Solution
A media server with an SFU architecture dynamically adjusts video stream characteristics such as frame size, frame rate, and codec types based on participant device capabilities and changing conference, system, or network factors, by obtaining notifications of supported video characteristics and adapting settings in real-time.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the SFU model is used to route multiple video streams in real-time multi-party video conferences, then video communication functionality is enabled, but video quality and performance degrade in environments with large numbers of participants, heterogeneous codec types, varying network quality, and different device capabilities
Solution Approach 1:
The patent implements dynamic adaptation by continuously monitoring network conditions, device capabilities, and conference parameters, then adjusting video stream characteristics (resolution, bitrate, codec type) in real-time. The system transitions from static video streaming to dynamic video quality adjustment based on current system state, resolving the contradiction between adaptability and reliability.
Solution Approach 2:
The patent changes multiple video stream parameters (resolution, frame rate, bitrate, codec type) dynamically based on network conditions and device capabilities. By adjusting these parameters adaptively, the system maintains reliable video quality across diverse environments with varying network quality and device specifications.
2Adaptability or versatility
If multiple video streams with different resolutions and codec types are simultaneously transmitted to accommodate heterogeneous participant devices, then device compatibility is improved, but network bandwidth consumption and system complexity increase
Solution Approach 1:
The patent applies local quality by sending different video stream qualities to different participants based on their specific device capabilities and network conditions. Instead of broadcasting all video streams to all participants, the system selectively routes appropriate quality levels to each device, reducing overall network bandwidth consumption while maintaining compatibility.
Solution Approach 2:
The patent implements partial action by selectively transmitting only the necessary video streams at appropriate quality levels to each participant device. The system avoids transmitting all possible video stream variations to all devices, instead sending only the subset needed for each specific device, thereby reducing bandwidth consumption while maintaining full compatibility.
3Reliability
If video stream characteristics are dynamically adjusted based on network conditions and device capabilities, then video quality is maintained, but system complexity and computational overhead increase
Solution Approach 1:
The patent implements feedback mechanisms where the media server continuously monitors network conditions, device capabilities, and video stream performance, then uses this feedback to dynamically adjust video stream characteristics. This closed-loop control maintains video quality while managing system complexity through intelligent decision-making based on real-time system state.
Solution Approach 2:
The patent enables self-service by allowing participant devices to report their own capabilities and network conditions to the media server. The devices actively participate in the quality adjustment process by providing self-diagnostic information, reducing the computational burden on the media server while maintaining reliable video quality.
Data Source
AI summary
Techniques for dynamically changing characteristics of simulcast video streams in real-time multi-party video conferences. Once a video conference has been established for a plurality of participant devices, each participant device can provide a notification of its supported video communications characteristic(s) for sending simulcast video streams and receiving video streams. Having been provided such notification, the media server can determine video communications setting(s) and/or parameter(s) to be used by each participant device while sending simulcast video streams or receiving video streams based on the supported video communications characteristic(s) of the respective participant devices. In response to changes in conference, system, or network factors, the media server can request one or more of the participant devices to dynamically change the video communications setting(s) and/or parameter(s) used to send simulcast video streams or receive video streams to maintain acceptable levels of QoE at the respective participant devices.