Video Conferencing Server Mixing Algorithm for Bandwidth Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Video conferencing systems face challenges in reducing bandwidth usage due to the real-time nature of video streaming, which results in significant bandwidth expenditure when multiple participants are involved, as all video streams are typically sent regardless of necessity.
Innovation Solution
Implementing a server-client architecture where a mixing algorithm determines which video streams to include in the conference stream, allowing clients to selectively transmit their video streams only when required, either through autonomous estimation or server signaling, thereby reducing unnecessary bandwidth usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If all video streams are transmitted to all participants in a video conference, then every participant can see all other participants, but bandwidth usage increases significantly
Solution Approach 1:
The patent extracts only the necessary video streams from the complete set of available streams. The server determines which participants need to receive which video streams based on the mixing algorithm results, and transmits only those specific streams rather than all streams to all participants. This selective extraction reduces redundant data transmission while ensuring all participants receive the video content they need to see all other participants.
Solution Approach 2:
The patent applies local quality by providing different video stream sets to different participants based on their specific needs. Each participant receives a customized subset of video streams determined by the mixing algorithm, rather than a uniform distribution of all streams. This localized optimization reduces overall bandwidth consumption while maintaining the capability for every participant to see all other participants through selective stream assignment.
2Loss of energy
If video streams are selectively transmitted based on mixing algorithm, then bandwidth usage is reduced, but system complexity increases due to server processing requirements
Solution Approach 1:
The patent applies preliminary action by performing the mixing algorithm computation at the server端 before video stream transmission. The server determines in advance which participants should receive which video streams based on audio activity and conference state, and then transmits only the necessary streams. This preliminary processing at the server eliminates the need for complex processing at each client device, reducing overall system complexity while achieving bandwidth reduction through selective transmission.
3Loss of energy
If video streams are selectively transmitted only when needed, then bandwidth usage is reduced, but real-time responsiveness may be affected by processing delays
Solution Approach 1:
The patent maintains continuity of useful action by continuously executing the mixing algorithm at the server to track audio activity and participant states in real-time. This continuous monitoring and dynamic adjustment of video stream distribution ensures that the necessary streams are transmitted without interruption or significant delay, while still reducing bandwidth usage by eliminating unnecessary stream transmissions. The continuous operation keeps the system responsive to real-time conference conditions.
Data Source
AI summary
Video conferencing with reduced bandwidth usage is disclosed. One method comprises receiving an audio stream at a server station connected to a plurality of participants in the video conference, at least one participant being a client station connected to the server station by a network and supplying the audio stream, the server station including a first memory and processor, and the client station including a second memory and processor. A mixing algorithm is performed that determines which video streams of the participants to mix to form a conference video stream for display by at least one of the participants. A video stream from the client station is selectively transmitted to the server station responsive to the mixing algorithm, and the server station transmits the conference video stream and/or the streams to be mixed to the participant(s).