A kind of audio and video synchronization device and method based on hls protocol

An audio and video synchronization, audio and video technology, applied in the direction of image communication, selective content distribution, electrical components, etc., can solve the problems of picture or sound retention, uncertain synchronization accuracy of audio and video, etc., to solve the problem of picture or sound retention. Effect

Active Publication Date: 2017-03-15
LE SHI ZHI ZIN ELECTRONIC TECHNOLOGY (TIANJIN) LTD
View PDF2 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Due to the complex factors of network transmission, in the process of playing the above audio and video data, the synchronization accuracy of audio and video is uncertain, which is greatly affected by abnormal conditions
Therefore, there will be picture or sound retention due to the continuous out of synchronization of the audio signal to be played and the video signal to be played

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A kind of audio and video synchronization device and method based on hls protocol
  • A kind of audio and video synchronization device and method based on hls protocol
  • A kind of audio and video synchronization device and method based on hls protocol

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0036] Please refer to figure 2 In this embodiment, the audio-video synchronization device based on the HLS protocol is provided with: a marking module 110 , a demultiplexing module 120 , a decoding module 130 , a detection module 140 and a playback module 150 .

[0037] The marking module 110 is configured to add a synchronization mark to the acquired first audio and video data after receiving the synchronization request, and notify the playing module 150 .

[0038] The demultiplexing module 120 is configured to demultiplex the audio and video data into audio data and video data, and update the time stamp of the audio data and / or video data according to the synchronization mark.

[0039] The decoding module 130 is configured to decode the above-mentioned audio data and video data, and output the audio signal to be played and the video signal to be played.

[0040] The detection module 140 is used to detect whether the time stamps carried in the audio signal to be played and...

Embodiment 2

[0046] This embodiment provides a more comprehensive audio-video synchronization device based on the HLS protocol. The device is sequentially provided with a marking module, a demultiplexing module, a decoding module, a detection module and a playback module. in:

[0047] The marking module is used to add a synchronization mark to the first audio and video data obtained after receiving the synchronization request, and notify the playback module.

[0048] The demultiplexing module is used to demultiplex the audio and video data into audio data and video data, and update the time stamp of the audio data and / or video data according to the synchronization mark.

[0049] The decoding module is used to decode the above audio data and video data, and output the audio signal to be played and the video signal to be played.

[0050] A detection module, configured to detect whether the time stamps carried in the audio signal to be played and the video signal to be played are consistent,...

Embodiment 3

[0061] Corresponding to the above device, the present invention provides an audio and video synchronization method based on the HLS protocol. Please refer to Figure 4 , the method includes:

[0062] After receiving the synchronization request, add a synchronization mark to the first audio and video data obtained;

[0063] Demultiplexing the audio and video data into audio data and video data, and updating the time stamps of the audio data and / or video data according to the synchronization mark;

[0064] Decode audio data and video data, output the audio signal to be played and the video signal to be played;

[0065] Detect whether the time stamps carried in the audio signal to be played and the video signal to be played are consistent, and send a synchronization request when the time stamps carried in the audio signal to be played and the video signal to be played are inconsistent;

[0066] The audio signal to be played and the video signal to be played are controlled to b...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an audio and video synchronization device and method based on an HLS protocol. The method comprises: after receiving a synchronization request, adding a synchronization mark to audio and video data obtained first; demultiplexing the audio and video data into audio data and video data, and updating timestamps of the audio data and / or video data based on the synchronization mark; decoding the audio data and video data and outputting an audio signal to be played and a video signal to be played; detecting whether the timestamps carried in the audio signal to be played and the video signal to be played are consistent, and sending the synchronization request when the timestamps carried in the audio signal to be played and the video signal to be played are not consistent; and controlling the audio signal to be played and the video signal to be played to be output synchronously based on the synchronization mark. Through the technical scheme in the invention, the problem of picture or sound retention due to continuous nonsynchronization of the audio and video is solved.

Description

technical field [0001] The invention relates to the technical field of streaming media playback, in particular to an audio and video synchronization device and method based on the HLS protocol. Background technique [0002] The HLS (Http live streaming) protocol is a streaming media transmission protocol based on the hypertext transfer protocol Http implemented by Apple. The HLS protocol segments the continuous media data with a huge capacity and divides it into a large number of small files for transmission, which caters to the needs of web pages. The file transmission of the server uses a constantly updated lightweight index file to control the download and playback of small media files after division, which can realize live streaming and on-demand streaming. The HLS protocol supports automatic switching of the bit rate on the premise of giving priority to fluency, and is currently widely used by major video websites. [0003] Through the HLS protocol, the multimedia data...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04N21/43H04N21/434H04N21/8547H04N21/643
Inventor 苍鹏李强
Owner LE SHI ZHI ZIN ELECTRONIC TECHNOLOGY (TIANJIN) LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap