Audio mixing method and equipment thereof

A technology of sound mixing and speech frames, which is used in speech analysis, instruments, etc.

Active Publication Date: 2011-10-26
GUIYANG LONGMASTER INFORMATION & TECHNOLOGY CO LTD
View PDF4 Cites 42 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The main purpose of the present invention is to disclose a sound mixing method and equipme...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Audio mixing method and equipment thereof
  • Audio mixing method and equipment thereof
  • Audio mixing method and equipment thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0027] This embodiment discloses a sound mixing method, such as figure 1 As shown, the method includes:

[0028] Step S1, the server receives speech coded data sent by at least two source clients.

[0029] In the present invention, the source client refers to the client that provides voice data, that is, the sending end; the sink client refers to the client that receives voice data, that is, the receiving end; in usage scenarios such as VOIP multi-person conferences, any A client can be either a source client or a sink client, and details will not be described later.

[0030] Step S2, the server uniformly decodes the received coded data into a PCM (pulse-code modulation, pulse code modulation) format.

[0031] It should be noted that, unless otherwise specified, the speech data in the subsequent steps refers to the decoded speech data in PCM format.

[0032] Step S3, the server judges whether the sampling rates and channels of the speech coding data transmitted by all sourc...

Embodiment 2

[0055] This embodiment is an improvement made to the first embodiment above. That is, during the mixing process of the server, the Figure 5 Anti-spill treatment shown.

[0056] Such as Figure 5 As shown, the audio mixing process disclosed in this embodiment includes the following steps:

[0057] Step S10, superimposing the aligned PCM data of all source clients.

[0058] Step S20, judging whether the superimposed current speech frame overflows. If it overflows, turn to the following step S30; if it does not overflow (not shown in the figure), the attenuation factor is 1, and the attenuation process is not performed on the current speech frame, and ends at a speech frame before the subsequent beginning to overflow the speech frame, its attenuation Factors are all 1.

[0059] Step S30, calculating the attenuation factor of the current speech frame, the attenuation factor being the ratio of the overflow threshold to the maximum overflow value, and performing attenuation pr...

Embodiment 3

[0066] Corresponding to Embodiment 1 of the above method, this embodiment discloses a server for processing audio mixing in a multi-person conference. Such as Figure 6 As shown, the server includes:

[0067] Receiving and decoding module 100, configured to receive and decode speech coded data sent by at least two source clients, and the decoded data is unified into PCM format;

[0068] Judging module 200, for judging whether the sampling rate and sound channel of the speech coded data transmitted by all source clients are consistent with the standard;

[0069] The channel conversion module 300 is used to extend or merge the voice data of all source clients different from the standard channel when the judgment module 200 judges that the channel of the voice data of the source client is different from the standard channel;

[0070] The re-sampling module 400 is used for re-sampling the voice data of the different source client based on the standard sampling rate when the judg...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an audio mixing method and equipment thereof, so that a defect of a present server can be overcome, wherein the defect is that there is limitation of many conditions during audio mixing processing. The disclosed audio mixing method comprises the following steps that: a server receives and decodes voice coded data in the best fit sampling rate, channel amount and coding mode sent by at least two source clients, wherein formats of the decoded data are unified as a PCM format; the server determines whether the sampling rates and sound channels of the voice coded data transmitted by all source clients are in accord with standards; if not, the voice data of the source clients are sampled again according to a standard sample rate, wherein the sample rates of the voice data are different from the standard sample rate; and meanwhile, the voice data of the source clients are expanded or merged according to a standard sound channel, wherein the sound channels of the voice data are different from the standard sound channel; the voice data, which have a unified sample rate and a unified sound channel, are aligned according to a time stamp; and audio mixing processing is carried out on the aligned voice data, and then the processed voice data are sent to a lodge client. The disclosed method provide in the invention can be applied widely to a VOIP multi-people meeting.

Description

technical field [0001] The invention relates to the technical field of voice, in particular to a sound mixing method and equipment. Background technique [0002] Voice mixing is an important part of multimedia conferences. The current mixing solution adopts the traditional decoding-mixing-encoding mode. However, if the existing sound mixing method is implemented on the server side, the encoding and decoding methods, sampling rate and channel of the voice data transmitted by each client must be required to be consistent; Mixing data of various encoding specifications and lengths. As a result, existing servers have many limitations when processing audio mixing. Contents of the invention [0003] The main purpose of the present invention is to disclose a sound mixing method and equipment to solve the defect that existing servers are limited by many conditions when processing sound mixing. [0004] To achieve the above purpose, the present invention discloses a sound mixing...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G10L19/00G10L19/20
Inventor 王伟黄国宏潘年华周平胡海晏利平王海李锐李晓鹏
Owner GUIYANG LONGMASTER INFORMATION & TECHNOLOGY CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap