Multi-channel audio mixing processing method and system, audio mixing processor and storage medium

Abstract

The invention relates to a multi-channel audio mixing processing method and system, an audio mixing processor and a storage medium, audio streams input by a plurality of audio input sources are obtained, each audio input source corresponds to a buffer queue, and under the condition that the number of bytes of audio frames in the audio streams is the same, the buffer queues of the audio frames in the audio streams correspond to the buffer queues; caching all the audio frames to corresponding cache queues, putting the audio frames in the cache queues with the time stamps of the audio frames and the expected time stamps in a preset time into an array to be subjected to sound mixing, if the number of the audio frames in the array to be subjected to sound mixing is zero, outputting null audio frames, and if the number of the audio frames in the array to be subjected to sound mixing is zero, outputting null audio frames. Otherwise, audio frames in the array to be subjected to audio mixing are subjected to audio mixing processing, audio frames subjected to audio mixing are output, delayed or packet-lost audio frames do not participate in audio mixing, and the problem that when delay or packet loss exists in the audio stream collected by a certain audio input source, delay or packet loss also exists in the audio stream subjected to audio mixing is solved.

Description

technical field [0001] The present application relates to the field of audio and video technology, in particular to a processing method, system, audio mixing processor and storage medium for multi-channel audio mixing. Background technique [0002] During the live broadcast, the anchor will have the requirement of multi-channel audio mixing, such as mixing the MIC audio source, local audio source and network audio source. In related technologies, due to dynamic plugging and switching of audio sources or poor network conditions In some cases, there will be data delay or packet loss. When there is delay or packet loss in the audio stream collected by a certain audio input source, it will cause delay or packet loss in the audio stream after mixing. [0003] At present, in the related art, when the audio stream collected by a certain audio input source has delay or packet loss, the mixed audio stream will also have delay or packet loss, and no effective solution has been propose...

AI Technical Summary

Problems solved by technology

[0004] The embodiment of the present application provides a multi-channel audio mixing processing method, system, mixing processor and storage medium, so as to at least solve the problem of delay or packet loss in the audio stream collected by a certain audio input source in the related art. It will cause delay or packet loss in the mixed audio stream

Images