Method and system for synchronously playing audio and video

A technology of video synchronization and playback method, applied in image communication, selective content distribution, electrical components, etc., can solve problems such as decoding time exceeding 33 milliseconds, asynchronous audio and video, large jitter in decoding time, etc. Experience and avoid unstable frame rate effects

Inactive Publication Date: 2016-01-13
ALIBABA (CHINA) CO LTD
View PDF4 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For example, in an Android TV box, in order to improve business diversity, some videos are decoded using software decoding. Since the decoding efficiency of software is lower than that of hardware decoding, the actual decoding time will be greatly jittered. The normal video decoding rate is 30 frames per second, the time reserved for decoding cannot exceed 33 milliseconds. When playing high-definition video, the decoding time will exceed 33 milliseconds or the decoding time will fluctuate greatly and unevenly, which will cause the audio and video to be out of sync.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for synchronously playing audio and video
  • Method and system for synchronously playing audio and video
  • Method and system for synchronously playing audio and video

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0057] Such as figure 2 As shown, it is a method for synchronously playing audio and video according to Embodiment 1 of the present invention, including:

[0058] Step 201, the terminal acquires audio data and video data according to the multimedia playback request to play; wherein,

[0059] The terminal obtains the audio data and video data for decoding and playing, and the audio data and video data are all with time stamps.

[0060] Step 202, obtaining the currently played audio timestamp and video timestamp, and obtaining the delay value of the current audio and video playback according to the audio timestamp and the video timestamp;

[0061] Wherein, the delay value is a difference between the audio time stamp and the video time stamp.

[0062] Step 203, comparing the preset expected error value with the delay value to obtain a variable mark; wherein,

[0063] The expected error value is an error range value within which the user can tolerate non-absolute synchronizati...

Embodiment 2

[0072] Such as image 3 Shown, on the basis of embodiment 1, a kind of audio and video synchronous playing method of the present invention comprises:

[0073] In step 301, the terminal obtains audio data and video data according to a multimedia play request for playing.

[0074] Step 302, obtain the currently played audio time stamp and video time stamp, and obtain the delay value of the current audio and video play according to the audio time stamp and the video time stamp.

[0075] Step 303, comparing the preset expected error value with the delay value to obtain a variable flag. in,

[0076] The range of the expected error value is 0-200 milliseconds, preferably, the expected error value is 100 milliseconds. An excessively large expected error value will affect the effect of users viewing audio and video synchronization, while an error value that is too small may be below the actual error value. Performing audio and video synchronization processing according to a small e...

Embodiment 3

[0091] Such as Figure 4 As shown, it is a specific embodiment of the audio and video synchronous playback method of the present invention, including:

[0092] In step 401, the terminal acquires audio data and video data according to a multimedia playback request for playback.

[0093] Step 402, obtain the currently played audio time stamp and video time stamp, and obtain the delay value of the current audio and video play according to the audio time stamp and the video time stamp.

[0094] Step 403, set the expected error value as 90 milliseconds, and compare it with the delay value to obtain a variable mark.

[0095] Step 404: Generate an accumulative error value, a proportional error value, and a predictive error value according to the variable mark, and weight the accumulative error value, proportional error value, and predictive error value to obtain a video rendering interval.

[0096] Specifically, wherein, the cumulative error value is generated according to the vari...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for synchronously playing an audio and a video. The method comprises the following steps: acquiring audio data and video data according to a multimedia playing request to play the audio data and the video data by a terminal; acquiring an audio timestamp and a video timestamp of current playing, and acquiring a delay value of current audio and video playing according to the audio timestamp and the video timestamp; comparing a preset expected error value with the delay value to obtain a variable mark; generating a cumulative error value, a proportional error value and a predicted error value according to the variable mark, and weighting the cumulative error value, the proportional error value and the predicted error value to obtain a video rendering interval; rendering currently-played audio data, and rendering currently-played video data according to the video rendering interval; and playing the rendered audio data and video data on the terminal. Through adoption of the method, the video and the audio are played synchronously, and the phenomenon of lagging or stagnation due to an unstable video output frame rate and excessively-drastic adjustments and changes is avoided.

Description

technical field [0001] The present application relates to the technical field of multimedia data processing, in particular to a method and system for synchronously playing audio and video. Background technique [0002] Usually for media playback, the two data streams of audio data stream and video data stream are respectively input into the audio encoder and video encoder for decoding to obtain audio decoding data and video decoding data, and then send the two encoded data streams to file synthesis The device can synthesize file formats or directly play audio decoding data and video decoding data. In this process, audio and video playback out of synchronization is a major problem that plagues playback. The reason for audio and video out of synchronization may be that the audio data stream and video data stream are not interleaved before they are input into the audio decoder and video decoder respectively. , or did not interleave correctly, resulting in incorrect composition...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N21/8547H04N21/43
CPCH04N21/4307H04N21/8547
Inventor 王利军杨军姚键潘柏宇王冀
Owner ALIBABA (CHINA) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap