Audio and video synchronization method based on simplified timestamps

Abstract

The invention relates to an audio and video synchronization method based on simplified timestamps, which comprises the steps that a counter is generated to serve as a timestamp supply source; the timestamps for an image inputted originally and audio are established independently according to frames; after audio and video frames are coded, the timestamps are typed into fixed fields of code stream frames; the frames are composited; when the code stream composite frames are received, the timestamps are extracted and decoded; recovery data and the timestamps are stored in buffer zone queues; when the audio is played, the empty and full degree of an audio buffer zone is monitored; if the degree exceeds a defined threshold, stepout in streams is adjusted by adopting audio skip frames or repeated frames; when a video is played, the video frames to be played currently are compared with the audio frames synchronized in the streams on the timestamps; and if a difference exceeds a set threshold, the stepout among the streams is adjusted by adopting video skip frames or the repeated frames. According to the method, a timestamp field is introduced; the stepout in the streams and among the streams is distinguished by the empty and full degree of the buffer zones and the difference of the timestamps; a global clock is not required; resource occupation is less; and the method is simple and efficient by utilizing the skip frames and the repeated frames to synchronize.

Description

technical field [0001] The invention relates to an audio and video synchronization method based on a simplified time stamp, which is applied to the field of audio and video transmission and processing. Background technique [0002] There is usually a strict timing relationship between related media such as audio and video in multimedia data and within the media stream. After the process of storage, processing and transmission, the presentation time between media and within the media is usually inconsistent, which affects users. audiovisual experience. The time stamp synchronization technology refers to a technology that realizes the synchronization between media through time stamps. Timestamps are time information used for synchronization, and their records can be expressed in various forms. The sender loads the timestamp information in the data packet for transmission, and the receiver synchronizes different objects according to the timestamp. [0003] At present, the st...

AI Technical Summary

Problems solved by technology

[0004] The technical problem solved by the present invention is: to overcome the deficiencies of the prior art, to provide an audio and video synchronization method based on simplified time stamps, and to solve the complex implementation of the current standard protocol method and the excessive system resource overhead in point-to-point and channel stable applications The problem

Images