Method and device for processing play abnormality of audio stream, computer device and computer readable storage medium

A technology for abnormal playback and processing methods, applied in the field of audio and video, which can solve problems such as inability to handle abnormal situations and sound interruptions

Active Publication Date: 2018-01-09
SHENZHEN STATE MICRO TECH CO LTD
View PDF9 Cites 24 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The embodiment of the present invention provides a method for processing abnormal playback of audio streams, aiming t...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for processing play abnormality of audio stream, computer device and computer readable storage medium
  • Method and device for processing play abnormality of audio stream, computer device and computer readable storage medium
  • Method and device for processing play abnormality of audio stream, computer device and computer readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0038] figure 1 A method for handling abnormal audio stream playback provided by an embodiment of the present invention is shown, and the details are as follows:

[0039] In step S110, the audio frame data in the cache is acquired.

[0040] In the embodiment of the present invention, the audio frame data can specifically receive real-time audio and video stream data through a communication port such as a network port or a USB port, and demultiplex the audio data after being demultiplexed by the demultiplexing module.

[0041] In step S120, the decoding parameters of the audio frame data are analyzed, relevant audio data is obtained, and the time stamp of the first frame of audio frame data is recorded.

[0042] As an embodiment of the present invention, the audio frame data includes an audio frame sequence, and the acquired audio frame sequence is transmitted to the AudioQueue audio processing framework for playback processing. After the AudioQueue audio processing framework ...

Embodiment 2

[0087] Figure 5 It shows another method for handling abnormal audio stream playback provided by the embodiment of the present invention, and the details are as follows:

[0088] In an embodiment of the present invention, the relevant audio data includes an audio frame duration, and the method further includes:

[0089] In step S210, the average decoding time of multiple consecutive audio frames is calculated.

[0090] In the embodiment of the present invention, after the audio frame data is parsed, it is decoded and rendered through the AudioQueue audio processing framework and output, and the decoding time of multiple consecutive audio frames is counted at the same time, and the time for receiving the audio frame data according to the AudioQueue audio processing framework, Obtain the difference between the two times, and calculate the length of time consumed by each audio frame according to the number of audio frames, which is the average time spent on decoding.

[0091] I...

Embodiment 3

[0098] Image 6It shows a device for handling abnormal playback of audio streams provided by the embodiment of the present invention. For convenience of description, only the parts related to the embodiment of the present invention are shown.

[0099] The device 300 for handling abnormal audio streams includes: an audio frame data acquisition unit 31, an analysis unit 32, a decoding unit 33, an actual audio rendering time acquisition unit 34, a real-time code stream playback time drift acquisition unit 35, a judging unit 36, and a first reset start Unit 37.

[0100] The audio frame data obtaining unit 31 is configured to obtain the audio frame data in the cache.

[0101] In the embodiment of the present invention, the audio frame data can specifically receive real-time audio and video stream data through a communication port such as a network port or a USB port, and demultiplex the audio data after being demultiplexed by the demultiplexing module.

[0102] The parsing unit 3...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention is suitable for the technical field of audios and videos, and provides a method and a device for processing play abnormality of an audio stream, a computer device and a computer readablestorage medium. The method comprises the steps of obtaining audio frame data in a cache; parsing decoding parameters in the audio frame data to obtain related audio data and recording the time stampof the first frame of the audio frame data; decoding and rendering the parsed audio frame data; obtaining the actual audio rendering time based on the related audio data and the time stamp of the first frame of the audio frame data; obtaining a real-time code stream playback time drift based on the actual audio rendering time; judging whether the audio frame data are abnormal based on the real-time code stream playback time drift; and when the judgment result is affirmative, starting and resetting an audio processing operation. According to the embodiment, the problem of sound interruption andstop caused by factors such as code stream shaking, signal instability or code stream hop can be processed efficiently, the stability of audio play is improved, and the conditions of unsmooth audio play are reduced.

Description

technical field [0001] The invention belongs to the technical field of audio and video, and in particular relates to a method, a device, a computer device and a computer-readable storage medium for dealing with abnormal audio stream playback. Background technique [0002] At present, audio and video players are designed with the process of demultiplexing, decoding, and rendering. Each link is transparent and controllable, and abnormalities in each link can be well judged and processed. For example, VLC player, based on FFMPEG A solution implemented by an open source project is open source and controllable from demultiplexing, decoding, and audio and video rendering. It is directly at the decoding output to determine whether the audio PCM frame data buffer is interrupted to control the audio rendering output. [0003] However, at present, audio and video players usually use the MacX AudioQueue framework for decoding and rendering in the audio processing part. Since the proces...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04N21/439H04N21/8547
Inventor 刘学文车明贤
Owner SHENZHEN STATE MICRO TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap