Synchronous playing method for audio and video buffer

Abstract

An audio-video buffer storage synchronous playing method comprises the following steps: when collected audio-video information is coded, timestamps of the current time information are respectively stamped on each audio packet and video packet and then the buffer time during which a playing device stores received audio packet and video packet is set; then, the playing device receives and stores the arrived audio packet and video packet with stamped timestamps; moreover, when the difference value of the minimum timestamp of the stored audio packet and video packet and the timestamp of the newly stored audio packet or video packet exceeds initial buffer time, the stored audio packet and video packet are searched to find out the corresponding audio packet and video packet of a time quantum (during which a timestamp falls down) taking the minimum timestamp as the starting point and having the duration equal to the initial buffer time; in addition, whether the searched audio packet or video packet are mutually corresponding is judged; when the packets are not mutually corresponding, the buffer time is modified to ensure that the searched audio packet or video packet are mutually corresponding. Therefore, audio-video labial synchronization is perfectly realized and the compatibility between multiplex audio-video communications can be improved.

Description

technical field [0001] The invention relates to a method for synchronously playing audio and video buffers. Background technique [0002] Audio and video synchronization (ie lip synchronization) is an important technical indicator for testing a video conferencing product. A good video conferencing product requires lip sync, which helps to improve the effectiveness of communication. When testing whether lip synchronization can be achieved, the operator at the sending end often counts from one to ten, gestures with fingers while reporting the number, and then observes the effect at the receiving end to judge whether the lip synchronization is good or not. [0003] In the video conferencing system, the reason for the asynchronous lip sound is that the audio and video signals are encoded and transmitted separately. Due to the influence of factors such as IP priority, audio and video packet size, and network transmission delay, the audio and video packets will arrive The order ...

AI Technical Summary

Problems solved by technology

For example, in "A device for realizing multiple video and audio stream format conversion" in Chinese Patent No. 02128329, a lip synchronization module is disclosed, which determines the network of audio and video data according to the RTP time information and the synchronization time information of the RTCP packet. Delay time, and then fill in silence or cache images according to the obtained relative network delay to achieve audio and video synchronization. This method of filling silence or cache images to achieve synchronization will inevitably lead to image and sound inconsistencies

Moreover, in a large-scale video conferencing system, there is often the transmission of multiple channels of audio and video information, and the network transmission delays of multiple streams are not completely consistent, so when the same terminal is playing multiple channels of audio and video information, the images and sounds that exist The out-of-synchronization and the incoordination of communication between each other are particularly prominent, which seriously affects the quality of the meeting

Images