Selective Forwarding Unit Silence Level Equalization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video and audio conferencing systems face challenges in efficiently managing bandwidth and processing power, particularly in large conferences, as they rely on sending all data to all participants, which is not feasible due to limitations in client devices, and current solutions like MCUs require high processing power or simply forward packets without media processing, as seen in SFUs.
Innovation Solution
Implementing a method at a Selective Forwarding Unit (SFU) to equalize client-specific silence levels in RTP packet audio levels by determining the minimum audio level over time periods and using these silence levels to selectively forward packets, thereby improving dominant speaker identification and reducing unnecessary data transmission.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If all video and audio data from each participant is sent to every other participant, then complete audio coverage is achieved, but bandwidth consumption becomes unmanageable and client device processing power is overwhelmed
Solution Approach 1:
The patent extracts only the necessary audio packets (those above silence thresholds) from the complete audio stream and forwards only those to clients. This selective extraction approach maintains reliable audio coverage for actual speech while eliminating unnecessary bandwidth consumption from silence periods.
Solution Approach 2:
Instead of forwarding all audio packets (excessive action), the system performs partial forwarding by selectively transmitting only audio packets that exceed the determined silence threshold. This partial action approach ensures complete coverage of meaningful audio while reducing overall bandwidth usage.
2Loss of energy
If audio packets are selectively forwarded based on audio levels, then bandwidth efficiency is improved, but difficulty in detecting and measuring silence levels across different clients worsens
Solution Approach 1:
The system performs preliminary action by determining client-specific silence levels before the actual audio forwarding process. By pre-calibrating the silence threshold for each client based on their audio characteristics, the system simplifies subsequent packet filtering decisions and improves bandwidth efficiency without compromising detection accuracy.
Solution Approach 2:
The patent applies parameter changes by adjusting the silence level threshold according to each client's specific audio characteristics. This dynamic parameter adjustment allows the system to adapt to different microphones, environments, and audio sources, making silence detection more accurate while maintaining bandwidth efficiency.
3Measurement precision
If minimum audio level is determined over longer time periods, then silence level accuracy is improved, but processing time and complexity increase
Solution Approach 1:
The system applies dynamics by making the time period for minimum audio level determination adaptive rather than fixed. The silence level measurement period can be adjusted dynamically based on audio activity patterns, allowing longer periods for stability when needed and shorter periods for responsiveness, thus balancing accuracy with processing time efficiency.
Data Source
AI summary
A method for equalizing silence levels includes receiving, at a selective forwarding unit (SFU), media protocol packets corresponding to an audio stream, wherein each particular media protocol packet comprises a packet header comprising an audio level value identifying an audio level of an audio sample that is carried in that particular media protocol packet. The method further includes equalizing, by the SFU, a silence level of the audio stream by determining a minimum audio level of the audio stream over a time period using the audio level from each of a subset of the media protocol packets corresponding to the time period, setting the silence level for the audio stream to the minimum audio level by updating a stored silence level value in digital memory, performing, by the SFU, an action using the silence level and using packets communicated from the SFU toward client devices.