Streaming media audio and video synchronization method and system

Abstract

The invention relates to a streaming media audio and video synchronization method and a system, and the system comprises a caching module which is divided into an audio caching module and a video caching module during pre-decoding and decoding, wherein, the audio caching module is divided into a first audio caching module and a second audio caching module; a decoding module which is divided into an audio decoding module and a video decoding module for decoding received audio and video data packets which are not decoded, wherein, the audio decoding module takes the data packets between the adjacent video frames as the unit for decoding the audio data packets, and the first audio caching module and the second audio caching module respectively cache the adjacent decoded audio data packets; and an input and output control module which is used for controlling the output of audio and video data after decoding, wherein, the input and output control module controls and selects the output of the audio data packets decoded by the first audio caching module or the second audio caching module, and controls the output of the next adjacent decoded video frame after completing the output of the audio data packets decoded by the first audio caching module or the second audio caching module.

Description

technical field [0001] The invention relates to mobile phone streaming media technology, in particular to a streaming media audio and video synchronization method and system. Background technique [0002] With the rapid development of Internet TV, communication technology and multimedia products, streaming media technology has become an online playback technology that has emerged in recent years, that is, playing while downloading, and the player does not have to wait until all multimedia files are downloaded to local storage before playing. Instead, download and play at the same time. The player opens up a buffer in the client's memory, usually a few megabytes of space, and the player waits until the buffer has enough data to start decoding and playing. During the "streaming media" transmission process, the transmission protocol used is real-time transmission Protocol, referred to as RTP protocol, this protocol is defined to work in one-to-one or one-to-many transmission s...

AI Technical Summary

Problems solved by technology

[0009] We will find that there is a problem with the above technology that it is impossible to determine the decoding amount of an audio decoding task, how long to perform an audio decoding process, and how to query the video timestamp

Obviously, if there are too many audio packets to be decoded at one time, the video decoding time will be delayed. The resources of the mobile phone are limited, and there is only one CPU

And frequently checking the video timestamp will increase the meaningless task switching rate, resulting in a waste of CPU utilization, which will also reduce the battery life of the mobile phone

Images