Audio stream mixing control method and device, equipment, medium and product

Abstract

The invention discloses an audio stream audio mixing control method and device, equipment, a medium and a product. The method comprises the following steps: correspondingly adding audio packets listed out of a jitter buffer queue corresponding to each path of audio stream to a queue to be subjected to audio mixing corresponding to each path of audio stream; mapping the timestamps of the audio packets of each path of queue be subjected to audio mixing to the same time coordinate system to realize time sequence alignment, obtaining a unified timestamp, and initializing the current timestamp to be the minimum unified timestamp on the time sequence; reading a plurality of audio packets from each path of queue to be subjected to audio mixing as audio mixing materials for stream mixing to obtain a target audio packet; judging whether the current timestamp exceeds a time zone defined by the minimum uniform timestamp and the maximum uniform timestamp of the audio packet in the audio mixing material, and when the current timestamp exceeds the time zone defined by the minimum uniform timestamp and the maximum uniform timestamp, finely adjusting the current timestamp according to a predetermined amount to approach the time zone; and outputting the target audio packet, and taking the current timestamp as an output timestamp of the target audio packet. According to the invention, through fine adjusting of the timestamp, the mixed audio stream is smoother.

Description

technical field [0001] The present application relates to audio processing technology, and in particular to an audio stream mixing control method and its corresponding device, computer equipment, computer-readable storage medium, and computer program product. Background technique [0002] When performing audio and video live broadcasting in the network live broadcast scene, it often adapts to the needs of the connection between anchor users, and mixes multiple audio and video streams uploaded by multiple anchor users to realize audio mixing and video mixing, and multiple audio and video streams Mix the streams into one audio and video stream, and then push it to the relevant live broadcast room, and then reach the terminal equipment of the relevant audience users for playback. This prevents viewers from pulling streams separately for multiple anchor users, saves the traffic of viewer users, and simplifies the playback business logic of audio and video streams. [0003] In r...

AI Technical Summary

Problems solved by technology

[0003] In reality, in the process of mixing multiple audio streams, the audio streams uploaded by the host user may have transmission delays, out-of-order, packet loss, uneven timestamps, etc., and may even cause the collected audio data to Insufficient, for example, only 58 seconds of data are collected per minute, and 2 seconds of data are missing, so as time goes by, the cumulative gap of collected data will become larger and larger

Images