Audio Mixing Selecting Sound Sources by Energy Value
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In video conference systems, the current audio mixing methods degrade sound quality and inefficiently consume computing resources by including unnecessary sites in audio mixing, as they select sites based on volume rather than the energy value of sound sources.
Innovation Solution
An audio mixing method that analyzes sound streams to determine the energy value of each sound source, selects main sound sources based on descending energy values, and only mixes audio streams from sites where these sources are located, reducing unnecessary participation and computing resource consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If audio streams from all sites are mixed according to site volume, then comprehensive audio coverage is achieved, but sound quality degrades and computing resources are wasted on unnecessary sites
Solution Approach 1:
The patent extracts only the necessary audio streams from the conference system by identifying and removing unnecessary sites from the audio mixing process. It analyzes audio characteristics of each site, selects main sound source objects based on energy values, and extracts only the audio streams containing these main sound sources for mixing, thereby eliminating waste of computing resources on unnecessary sites while maintaining sound quality.
2Reliability
If audio mixing includes all sites, then no sound source is missed, but unnecessary sites consume computing resources and degrade sound quality
Solution Approach 1:
The patent changes the selection parameter from site volume to sound source energy value. By analyzing audio characteristics and calculating energy values of sound source objects in each site, the system dynamically identifies main sound sources based on their energy levels. This parameter change enables selective inclusion of only necessary audio streams, improving computing efficiency while ensuring comprehensive coverage of actual sound sources.
3Ease of operation
If site volume is used for selection, then simple selection criteria are applied, but main sound sources may be missed and sound quality degraded
Solution Approach 1:
The patent replaces the mechanical site volume selection method with an acoustic analysis system. Instead of simply measuring overall site volume, the system performs audio characteristic analysis on each site's audio stream, identifies sound source objects, and calculates their energy values. This substitution enables accurate identification of main sound sources based on actual acoustic properties rather than crude volume metrics, improving sound source selection accuracy.
Data Source
AI summary
An audio mixing method, apparatus and system, which can ensure sound quality after audio mixing and reduce consumption of computing resources. The method includes: receiving an audio stream of each site, and analyzing the audio stream of each site to obtain a sound characteristic value of a sound source object; selecting, according to a descending sequence of sound characteristic values of sound source objects, a predetermined number of sound source objects from the sound source objects to serve as main sound source objects; determining, according to a relationship between a target site and the sites where the main sound source objects are located, audio streams that require audio mixing for the target site; and performing audio mixing on the audio streams that require audio mixing for the target site and sending the audio streams after the audio mixing to the target site.