Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Audio stream mixing control method and device, equipment, medium and product

A control method and audio stream technology, applied in image communication, selective content distribution, electrical components, etc., can solve problems such as out-of-sequence, large accumulation gaps in collected data, uneven time stamps, etc., achieve fine-tuning and smoothness, and overcome transmission delays , to avoid the effect of audio playback freeze

Active Publication Date: 2022-02-01
GUANGZHOU HUADUO NETWORK TECH
View PDF6 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In reality, in the process of mixing multiple audio streams, the audio streams uploaded by the host user may have transmission delays, out-of-order, packet loss, uneven timestamps, etc., and may even cause the collected audio data to Insufficient, for example, only 58 seconds of data are collected per minute, and 2 seconds of data are missing, so as time goes by, the cumulative gap of collected data will become larger and larger

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Audio stream mixing control method and device, equipment, medium and product
  • Audio stream mixing control method and device, equipment, medium and product
  • Audio stream mixing control method and device, equipment, medium and product

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] Embodiments of the present application are described in detail below, examples of which are shown in the drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below by referring to the figures are exemplary only for explaining the present application, and are not construed as limiting the present application.

[0051] Those skilled in the art will understand that unless otherwise stated, the singular forms "a", "an", "said" and "the" used herein may also include plural forms. It should be further understood that the word "comprising" used in the specification of the present application refers to the presence of the features, integers, steps, operations, elements and / or components, but does not exclude the presence or addition of one or more other features, Integers, steps, operations, elements, components, and / or groups thereof. It will be under...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an audio stream audio mixing control method and device, equipment, a medium and a product. The method comprises the following steps: correspondingly adding audio packets listed out of a jitter buffer queue corresponding to each path of audio stream to a queue to be subjected to audio mixing corresponding to each path of audio stream; mapping the timestamps of the audio packets of each path of queue be subjected to audio mixing to the same time coordinate system to realize time sequence alignment, obtaining a unified timestamp, and initializing the current timestamp to be the minimum unified timestamp on the time sequence; reading a plurality of audio packets from each path of queue to be subjected to audio mixing as audio mixing materials for stream mixing to obtain a target audio packet; judging whether the current timestamp exceeds a time zone defined by the minimum uniform timestamp and the maximum uniform timestamp of the audio packet in the audio mixing material, and when the current timestamp exceeds the time zone defined by the minimum uniform timestamp and the maximum uniform timestamp, finely adjusting the current timestamp according to a predetermined amount to approach the time zone; and outputting the target audio packet, and taking the current timestamp as an output timestamp of the target audio packet. According to the invention, through fine adjusting of the timestamp, the mixed audio stream is smoother.

Description

technical field [0001] The present application relates to audio processing technology, and in particular to an audio stream mixing control method and its corresponding device, computer equipment, computer-readable storage medium, and computer program product. Background technique [0002] When performing audio and video live broadcasting in the network live broadcast scene, it often adapts to the needs of the connection between anchor users, and mixes multiple audio and video streams uploaded by multiple anchor users to realize audio mixing and video mixing, and multiple audio and video streams Mix the streams into one audio and video stream, and then push it to the relevant live broadcast room, and then reach the terminal equipment of the relevant audience users for playback. This prevents viewers from pulling streams separately for multiple anchor users, saves the traffic of viewer users, and simplifies the playback business logic of audio and video streams. [0003] In r...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04N21/236H04N21/242H04N21/8547H04N21/233H04N21/2187H04N21/4788
CPCH04N21/236H04N21/242H04N21/8547H04N21/233H04N21/2187H04N21/4788
Inventor 陈宇辉
Owner GUANGZHOU HUADUO NETWORK TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products