Audio processing method and device

Abstract

The invention provides an audio processing method and device. The method comprises the following steps: acquiring audio frames transmitted by at least one client in a next audio and video call at a current processing moment and a sampling time stamp of each audio frame in the audio frames transmitted by the at least one client; acquiring all sampling data in each audio frame according to the sampling time stamp of each audio frame; and mixing the all sampling data in each audio frame to obtain a hybrid audio frame shared by the at least one client. Compared with the way of acquiring one audioframe for all clients in one audio and video call, the audio processing method and device have the advantages that the quantity of the audio frames is reduced, and the computing burden and the computing resource consumption of an MCU (Microprogrammed Control Unit) can be lowered.

Description

technical field [0001] The invention belongs to the field of audio technology, and more specifically, relates to an audio processing method and device. Background technique [0002] With the popularity of instant messaging software, audio and video calls in instant messaging software have become the most effective communication method for information communication. There are two transmission methods of audio and video frames in audio and video calls: [0003] The first is the point-to-point transmission method, that is, in an audio and video call, any client sends audio and video frames to other clients in the audio and video call, and receives audio and video frames sent by other clients. This point-to-point transmission method does not need The server transfers, but when there are a large number of clients in the audio and video call, each client has to bear huge computing and network transmission pressure, so this point-to-point transmission method is seldom used in audio...

AI Technical Summary

Problems solved by technology

[0005] In mix mode, the MCU needs to mix one audio frame for each client in the audio and video call. For example, there are N clients in the audio and video call. For the i-th client, the MCU needs to start from the i-th client Obtain audio frames from audio frames sent by other clients other than the end, and then mix the acquired audio frames to obtain the mixed audio frames of the i-th client. Therefore, in the case of N clients in an audio and video call, the MCU N times of independent encoding, packing, and encryption operations are required to obtain N mixed audio frames, which increases the computational burden of the MCU, thereby increasing the computational resource consumption of the MCU.

Images