Sound mixing method, apparatus and device, and storage medium

Abstract

The embodiment of the invention discloses a sound mixing method, apparatus and device, and a storage medium. The sound mixing method comprises the following steps: receiving audio streams of at leasttwo sound channels; figuring out the waveform envelope line strength of the amplitude or energy of each audio stream; allocating a sound mixing weight of the audio stream according to the proportion of the waveform envelope line strength of each audio stream in the sum of the waveform envelope line strength of all audio streams, wherein the positive correlation of the sound mixing weight and the proportion is within a preset range; and performing sound mixing according to each audio stream and the sound mixing weight corresponding to the audio stream to obtain an audio stream subject to soundmixing. According to the sound mixing method disclosed by the embodiment of the invention, the sound mixing weight is allocated through the proportion of the waveform envelope line strength of the amplitude or energy of the audio stream in the sum of the waveform envelope line strength of all audio streams, so that the voice audio stream with higher amplitude or energy is allocated with a greatersound mixing weight due to the higher waveform envelope line strength, and then the voice audio stream is clearer after the sound mixing.

Description

technical field

[0001] The embodiments of the present invention relate to the technical field of sound mixing, and in particular, to a sound mixing method, device, equipment, and storage medium. Background technique

[0002] In a VOIP conference call, there are multiple people involved in the conversation, and in order for one receiver to hear everyone else's voice, everyone else's audio stream needs to be mixed. The audio mixing processing function is set on the server side, which can save bandwidth and reduce the computing pressure on the client, but it will increase the computing pressure on the server, which is suitable for many people to participate in the session at the same time; No pressure, suitable for a small number of people to talk at the same time.

[0003] No matter which end the sound mixing is placed on, it is necessary for the listener to clearly hear the voice of the speaker. The classic sound mixing algorithm in the prior art is a linear superposition al...

Examples

Embodiment 1

[0051] figure 1 It is a flow chart of the audio mixing method in Embodiment 1 of the present invention. This method is applicable to online voice call scenarios such as multi-party conference calls or web conferences. It can be executed by software / hardware and deployed in servers or clients, such as figure 1 As shown, a mixing method provided in this embodiment includes:

[0052] S102. Receive audio streams of at least two channels.

[0053] Receive the audio streams of all channels in the working state in the conference call or web conference, and the number of the sound channels in the working state is related to the number of participants or parties in the conference call or web conference. When the number of channels in the working state is higher than the preset channel number threshold, the mixing method described in this embodiment is preferably executed by the server; when the number of channels in the working state is lower than the preset channel number threshold, ...

Embodiment 2

[0063] figure 2 It is a flow chart of the sound mixing method in Embodiment 2 of the present invention, such as figure 2 As shown, compared with the previous embodiment, the audio mixing method provided by this embodiment adds the following operation to adjust the amplitude of all audio streams before obtaining the amplitude or energy waveform envelope strength of each audio stream, Make the amplitude of the audio stream meeting the preset amplitude condition fluctuate within a first threshold range, while the amplitude of other audio streams fluctuate within a second threshold range; wherein, the first threshold range is greater than the second threshold range.

[0064] Through this step, the amplitude variation range of each audio stream is controlled, and the audio stream that meets the preset amplitude conditions fluctuates in a large range as a human voice audio stream, while the audio streams of other channels fluctuate in a large range as a noise audio stream. Change...

Embodiment 3

[0072] Figure 4 It is a flow chart of the sound mixing method in Embodiment 3 of the present invention. This method is applicable to situations where there may often be two people speaking at the same time in a conference call or network conference, such as Figure 4 As shown, the audio mixing method provided by this embodiment is to adjust the amplitudes of all audio streams in the foregoing embodiments, so that the amplitudes of the audio streams that meet the preset amplitude conditions fluctuate within the first threshold range, while other audio streams The steps for optimizing the magnitude of fluctuations within a second threshold range include:

[0073] S1033. Obtain the first amplitude audio stream and the second amplitude audio stream, wherein the amplitude of the first amplitude audio stream is greater than the amplitude of the second amplitude audio stream, and the first amplitude audio stream and the second amplitude The value audio streams are the two audio str...

technical field

[0001] The embodiments of the present invention relate to the technical field of sound mixing, and in particular, to a sound mixing method, device, equipment, and storage medium. Background technique

[0002] In a VOIP conference call, there are multiple people involved in the conversation, and in order for one receiver to hear everyone else's voice, everyone else's audio stream needs to be mixed. The audio mixing processing function is set on the server side, which can save bandwidth and reduce the computing pressure on the client, but it will increase the computing pressure on the server, which is suitable for many people to participate in the session at the same time; No pressure, suitable for a small number of people to talk at the same time.

[0003] No matter which end the sound mixing is placed on, it is necessary for the listener to clearly hear the voice of the speaker. The classic sound mixing algorithm in the prior art is a linear superposition al...

Examples

Embodiment 1

[0051] figure 1 It is a flow chart of the audio mixing method in Embodiment 1 of the present invention. This method is applicable to online voice call scenarios such as multi-party conference calls or web conferences. It can be executed by software / hardware and deployed in servers or clients, such as figure 1 As shown, a mixing method provided in this embodiment includes:

[0052] S102. Receive audio streams of at least two channels.

[0053] Receive the audio streams of all channels in the working state in the conference call or web conference, and the number of the sound channels in the working state is related to the number of participants or parties in the conference call or web conference. When the number of channels in the working state is higher than the preset channel number threshold, the mixing method described in this embodiment is preferably executed by the server; when the number of channels in the working state is lower than the preset channel number threshold, ...

Embodiment 2

[0063] figure 2 It is a flow chart of the sound mixing method in Embodiment 2 of the present invention, such as figure 2 As shown, compared with the previous embodiment, the audio mixing method provided by this embodiment adds the following operation to adjust the amplitude of all audio streams before obtaining the amplitude or energy waveform envelope strength of each audio stream, Make the amplitude of the audio stream meeting the preset amplitude condition fluctuate within a first threshold range, while the amplitude of other audio streams fluctuate within a second threshold range; wherein, the first threshold range is greater than the second threshold range.

[0064] Through this step, the amplitude variation range of each audio stream is controlled, and the audio stream that meets the preset amplitude conditions fluctuates in a large range as a human voice audio stream, while the audio streams of other channels fluctuate in a large range as a noise audio stream. Change...

Embodiment 3

[0072] Figure 4 It is a flow chart of the sound mixing method in Embodiment 3 of the present invention. This method is applicable to situations where there may often be two people speaking at the same time in a conference call or network conference, such as Figure 4 As shown, the audio mixing method provided by this embodiment is to adjust the amplitudes of all audio streams in the foregoing embodiments, so that the amplitudes of the audio streams that meet the preset amplitude conditions fluctuate within the first threshold range, while other audio streams The steps for optimizing the magnitude of fluctuations within a second threshold range include:

[0073] S1033. Obtain the first amplitude audio stream and the second amplitude audio stream, wherein the amplitude of the first amplitude audio stream is greater than the amplitude of the second amplitude audio stream, and the first amplitude audio stream and the second amplitude The value audio streams are the two audio str...

Images