Method for testing lip synchronization for multimedia audio/video stream

A video, audio and multimedia technology, applied in the field of lip synchronization commissioning, can solve the problems of non-realization of the protocol, non-compulsory synchronization mechanism, non-transmission, etc.

Active Publication Date: 2008-07-02
ZTE CORP
View PDF0 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The disadvantage is that some protocols may not implement or enforce this synchronization mechanism, and the protocol i

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for testing lip synchronization for multimedia audio/video stream
  • Method for testing lip synchronization for multimedia audio/video stream
  • Method for testing lip synchronization for multimedia audio/video stream

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0064] The present invention obtains the synchronization between media streams in the media stream through an adaptive delay algorithm and a synchronous control algorithm on the basis of proposing a virtual clock model. Specifically, based on the minimum mean square error between media streams and media streams and packet loss meeting a certain threshold, and assuming that the Internet delay obeys the long-tail distribution (lognormal distribution), some evaluation synchronization performance is derived. The formula, and then elaborated the specific algorithm, including: adaptive delay algorithm and synchronous control algorithm and the adjustment of the virtual clock and so on. Among them, the adaptive delay algorithm includes: the calculation of the synchronization phase distortion (SPD), the calculation of the packet loss rate, and the calculation of the end-to-end average delay (ED); the synchronization control algorithm includes: MDU (Media Data Units, media data unit) Th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a regulating method of lip synchronization of multimedia video and audio stream, which relates to the regulating method of lip synchronization. In order to solve the problem that the existing method can not well realize the lip synchronization of the multimedia stream, the regulating method is invented. The regulating method builds a virtual clock model on the basis of a real-time clock of a decoding end of the multimedia video and audio stream; according to the calculation results of adaptive delay algorithm and synchronized control algorithm, the virtual clock is adjusted and the lip synchronization of multimedia video and audio stream is available, thus greatly improving lip synchronization performance applied to multimedia and internet.

Description

technical field [0001] The invention relates to a testing method for lip synchronization, in particular to a testing method for multimedia communication video and audio stream lip synchronization. Background technique [0002] As a packet-switching network, the Internet cannot provide timely transmission like E1 or ISDN, which are circuit-switching-based networks. For multimedia applications, if the correct control method is not adopted, the time relationship of the original data will be seriously distorted. Synchronous, large delays lead to discomfort and difficulty in user interaction. How to effectively offset the impact of network jitter through the control of the playback buffer through an adaptive algorithm, and at the same time minimize the end-to-end delay is a topic worth exploring and of great practical significance, which has attracted many academics. With engineering concerns, many related algorithms have been proposed. These algorithms model network delay and j...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04N7/62H04N7/60
Inventor 薛尧舜张学英
Owner ZTE CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products