A Method for Eliminating Time Offset of Streaming Media Video Frames

Abstract

The invention discloses a streaming media video frame time offset elimination method. The method comprises the following steps: obtaining an image data flow; analyzing an image unit of the image data flow to obtain a sampling time label and recording arrival time; if an image frame marking the sampling time label already exists, adding unit data into the frame, and otherwise, establishing a new image frame; after the new image frame is established, calculating a difference between each frame of image decoding time and the arrival time, and sending the differences to an adjustment thread; and based on the deviation values, by use of a PID negative-feedback control algorithm, obtaining a time conversion coefficient K, and sending the time conversion coefficient K back to a video data receiving thread, for calculation of streaming media picture frame decoding time, wherein a control object is to stabilize the deviations to be at zero. By using the technical scheme provided by the invention, uniformity of image frame sequence decoding time is ensured, and timing errors between different electronic devices are eliminated.

Description

technical field [0001] The invention belongs to the technical field of streaming media transmission and decoding, in particular to a method for eliminating frame time offset of streaming media video. Background technique [0002] Network streaming video is usually transmitted in units of frames, and the streaming media receiver sends the video data to the decoder at the correct time after obtaining the video frame, so as to display the video image. Due to various unstable factors in network transmission, the time when a video frame is sent to the decoder cannot be determined only by the time when the frame is received, but needs to be calculated by a certain method. The algorithm needs to guarantee: [0003] 1. The time interval between every two frames of the image frame is basically the same when decoding, otherwise the decoded image will be fast and slow. [0004] 2. The average decoding time interval of the streaming media receiving end is consistent with the sampling t...

AI Technical Summary

Problems solved by technology

A defect of this method is that there is a minimum time delay between the image decoded and played by the receiving end and the image sent by the acquisition end, and the time deviation depends on the lower limit value of the buffer

Due to unstable factors in network transmission, such as out-of-order image frames, network interruption, etc., a larger buffer can better balance network fluctuations. Therefore, the lower limit of the buffer cannot be set too small, which will cause problems in image decoding. Minimum delay to avoid

On the other hand, as the total amount of buffered data fluctuates between the upper and lower limits of the buffer, the delay time of playing images also changes accordingly

Images