Audio and video synchronous playing method based on audio scaling

Abstract

The invention discloses an audio and video synchronous playing method based on audio scaling. The whole playing process is processed according to an Audio playing thread and a Video playing thread, the Audio playing thread dominates the time control of the whole playing, the two threads share the same buffer area, the buffer area receives audio and video data transmitted from the upstream, two sample queues arranged according to a timestamp sequence are formed, and the sample at the foremost end of the queues is the sample to be played and processed at present; the method specifically comprises the following steps: after a buffer area is initialized, emptying a queue; setting media playing time mediaPlayTime, namely accumulated audio sample time, setting the media playing time mediaPlayTime by an Audio playing thread, and resetting an initial value; setting an audio scaling time value tDelta to represent the amplitude of the current Audio data needing to be scaled, setting the value bythe Video playing thread, reading the value by the Audio playing thread, and controlling playing according to the value. The invention has the advantages that audio and video playing synchronizationis achieved, the principle is simple, operation is convenient, implementation is easy, and the effect is obvious.

Description

technical field [0001] The present invention relates to the technical field related to media playing, in particular to an audio and video synchronous playing method based on audio stretching. Background technique [0002] In the network or other media playback environment, due to bandwidth or other device performance limitations, video data may be lost or delayed in transmission. The simple handling of this situation is to wait or drop frames. This will cause playback stagnation or out-of-sync audio and video, affecting the experience of media audiences. [0003] Audio data and video data are lost or delayed at the same time, which will cause playback freezes. In media playback, fortunately, the data volume of the audio stream is much less than that of the video stream, so the problem of unsmooth playback is mostly due to packet loss or delay in the transmission of video data. Contents of the invention [0004] The present invention aims to overcome the above-mentioned ...

AI Technical Summary

Problems solved by technology

This will cause playback stagnation or out-of-sync audio and video, affecting the experience of media audiences

[0003] Audio data and video data are lost or delayed at the same time, which will cause playback freeze

In media playback, fortunately, the data volume of the audio stream is much less than that of the video stream, so the problem of unsmooth playback is mostly due to packet loss or delay in the transmission of video data

Images