Audio and video synchronous playing method based on audio scaling

A technology of audio and video synchronization and playback method, applied in image communication, selective content distribution, electrical components, etc. Easy to achieve effects

Active Publication Date: 2021-03-16
HANGZHOU ARCVIDEO TECHNOLOGY CO LTD
View PDF13 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This will cause playback stagnation or out-of-sync audio and video, affecting the experience of media audiences
[0003] Audio data and video data are lost or delayed at the same time, which will cause playback freeze
In media playback, fortunately, the data volume of the audio stream is much less than that of the video stream, so the problem of unsmooth playback is mostly due to packet loss or delay in the transmission of video data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Audio and video synchronous playing method based on audio scaling
  • Audio and video synchronous playing method based on audio scaling

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments.

[0031] An audio and video synchronous playback method based on audio stretching. The entire playback process is handled by two threads, Audio playback and Video playback. The Audio playback thread dominates the time control of the entire playback. The two threads share the same buffer, and the buffer receives the upstream The audio and video data (Audio / Video Sample, a video frame that can be used for display, or a piece of PCM Audio data for playback) transmitted from (network or media files) forms two sample queues arranged in order of time stamps, the queue The front-end Sample (that is, the Sample with the smallest time stamp) is the Sample to be played and processed currently, which specifically includes the following steps:

[0032] (1) After the buffer is initialized, the queue is cleared;

[0033] (2) Set the media playback time mediaP...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an audio and video synchronous playing method based on audio scaling. The whole playing process is processed according to an Audio playing thread and a Video playing thread, the Audio playing thread dominates the time control of the whole playing, the two threads share the same buffer area, the buffer area receives audio and video data transmitted from the upstream, two sample queues arranged according to a timestamp sequence are formed, and the sample at the foremost end of the queues is the sample to be played and processed at present; the method specifically comprises the following steps: after a buffer area is initialized, emptying a queue; setting media playing time mediaPlayTime, namely accumulated audio sample time, setting the media playing time mediaPlayTime by an Audio playing thread, and resetting an initial value; setting an audio scaling time value tDelta to represent the amplitude of the current Audio data needing to be scaled, setting the value bythe Video playing thread, reading the value by the Audio playing thread, and controlling playing according to the value. The invention has the advantages that audio and video playing synchronizationis achieved, the principle is simple, operation is convenient, implementation is easy, and the effect is obvious.

Description

technical field [0001] The present invention relates to the technical field related to media playing, in particular to an audio and video synchronous playing method based on audio stretching. Background technique [0002] In the network or other media playback environment, due to bandwidth or other device performance limitations, video data may be lost or delayed in transmission. The simple handling of this situation is to wait or drop frames. This will cause playback stagnation or out-of-sync audio and video, affecting the experience of media audiences. [0003] Audio data and video data are lost or delayed at the same time, which will cause playback freezes. In media playback, fortunately, the data volume of the audio stream is much less than that of the video stream, so the problem of unsmooth playback is mostly due to packet loss or delay in the transmission of video data. Contents of the invention [0004] The present invention aims to overcome the above-mentioned ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04N21/43H04N21/8547H04N21/439H04N21/44
CPCH04N21/4307H04N21/8547H04N21/439H04N21/44004
Inventor 李宏元吴奕刚孙彦龙
Owner HANGZHOU ARCVIDEO TECHNOLOGY CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap