Unlock instant, AI-driven research and patent intelligence for your innovation.

A method and device for synchronous processing of audio and video

An audio-video synchronization and audio technology, applied in image communication, selective content distribution, electrical components, etc., can solve problems such as lip-synchronization

Active Publication Date: 2020-05-05
SANECHIPS TECH CO LTD
View PDF6 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to solve the above technical problems, the embodiments of the present invention expect to provide a method and device for synchronizing audio and video, which can accurately reconstruct the system clock at the decoding end that is consistent with the encoding end, thereby providing an accurate clock reference for audio and video synchronization. Then through audio and video synchronization processing to solve the lip sync problem during video playback

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method and device for synchronous processing of audio and video
  • A method and device for synchronous processing of audio and video
  • A method and device for synchronous processing of audio and video

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0089] see figure 2 , which shows a method for audio and video synchronization processing provided by an embodiment of the present invention, the method comprising:

[0090] S101. Compare the current program clock reference PCR value with the current system clock STC value to obtain a first comparison result.

[0091] see image 3 , specifically, step S101 includes steps S1011 to S1014:

[0092] S1011. Load the first PCR value or the reloaded PCR value into the local STC counter as an initial count value.

[0093] It should be noted that when the first PCR arrives or the PCR needs to be reloaded, the current PCR value is loaded into the local STC counter as the initial count value. The local STC counter is also divided into STC_base and STC_extension to count separately; among them, STC_base is the basic value of STC, which is the high 33bit of STC, the initial value is PCR_base, and then counts up under the drive of 90kHz clock, mainly used for PTS and DTS Compare to adj...

Embodiment 2

[0149] see Figure 9 , which shows an audio-video synchronization processing device 9 provided by an embodiment of the present invention, the device includes: a comparison module 901 and an adjustment module 902; wherein,

[0150] The comparison module 901 is configured to compare the current program clock reference PCR value with the current system clock STC value to obtain a first comparison result;

[0151] The adjustment module 902 is configured to rebuild the system clock STC by adjusting the current STC count step size when the first comparison result does not meet the preset judgment condition;

[0152] The comparison module 901 is further configured to compare the absolute value of the difference between the STC base value STC_base in the reconstructed system clock STC and the display time tag PTS value with a preset time interval to obtain a second comparison result ; Wherein, the preset time interval is M times the time between audio or video frames, and M is greate...

Embodiment 3

[0179] against Figure 9 device shown, see Figure 11 , which shows the hardware implementation device involved in the reconstruction of the system clock and the audio and video synchronization processing provided by the embodiment of the present invention. The hardware implementation device may specifically include three parts: CPU, demultiplexer demux and decoder decoder .

[0180] The demultiplexer demux is divided into a ts_ph_get module and a PCR_recovery module, wherein the ts_ph_get module performs packet header parsing, extracts PCR_flag and PCR values ​​in the adaptive area of ​​the MPEG2-TS stream, and sends them to the PCR_recovery module to rebuild the system clock.

[0181] The PCR_recovery module saves the PCR value, and specifically realizes that when the local STC counter deviates from the local system clock, the STC step size can be adjusted by the CPU to adjust the STC counter so that it is basically consistent with the current PCR. The PCR_recovery module ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

Disclosed is a method for synchronously processing an audio and a video. The method comprises: comparing a time clock reference value of a current program with a current system time clock value to obtain a first comparison result; adjusting a count step of a system time clock to reestablish the system time clock when the first comparison result does not meet a preset judgment condition; comparing an absolute difference value between a system time clock base value and a presentation time stamp in the reestablished system time clock with a preset time interval to obtain a second comparison result, wherein the preset time interval is M times an audio or video inter-frame time interval, and M is greater than 0 but smaller than 1; and adjusting the playing speed of the audio or the video according to the second comparison result. Also disclosed are a device for synchronously processing an audio and a video, and a storage medium.

Description

technical field [0001] The invention relates to the field of digital television, in particular to a method and device for synchronous processing of audio and video. Background technique [0002] There is a system clock (STC, System Time Clock) with a frequency of 27MHz in the encoder, which is used to generate the correct display time stamp (PTS, Presentation Time Stamp) and decoding time stamp (DTS, Decode Time Stamp) of audio and video, It can also be used to indicate the instantaneous sampling value of the system clock itself. The sending end inserts the instantaneous sampling value of the system clock into the PCR field of the MPEG-2 TS stream when the Program Clock Reference (PCR, Program Clock Reference) field leaves the multiplexer, and the receiving end can recover and encode it by extracting the PCR field The 27MHz system clock synchronized by the device is used, and then the PTS and DTS in the PES stream are used to realize the synchronization of audio and video. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04N21/242H04N21/43H04N21/8547
CPCH04N21/242H04N21/4305H04N21/4307H04N21/8547H04N21/43
Inventor 郭荣
Owner SANECHIPS TECH CO LTD