E-sports sound box noise reduction control method based on noise elimination and related device

Abstract

The invention discloses an E-sports sound box noise reduction control method based on noise elimination and a related device, and the method comprises the steps: carrying out the audio collection processing based on a plurality of microphone devices disposed on an E-sports sound box when the E-sports sound box is applied to an online game scene; inputting the collected mixed audio signal data into a group of band-pass filters for filtering processing; performing down-sampling rate conversion processing on each frequency band audio signal data in the plurality of frequency band audio signal data; sequentially carrying out noise elimination processing on the plurality of frequency band down-sampling audio signals; performing up-sampling processing on the plurality of frequency band down-sampling audio signals after noise reduction; and recombining the plurality of frequency band up-sampling audio signals according to the same time domain to generate combined audio signal data which is noise-reduced audio data. In the embodiment of the invention, good noise reduction processing is carried out on the acquired audio signal, so that a user does not need to wear an earphone, and the user experience is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of noise reduction, and in particular to an e-sports speaker noise reduction control method based on noise elimination and a related device. Background Art

[0002] With the advancement of technology, the popularization of the Internet, and the rapid development of AI, our lifestyles and working methods are constantly changing. More and more people are working from home, playing online games with friends, using smart home voice recognition, etc. The requirements for voice quality of voice systems and communication systems are getting higher and higher, and noise cancellation systems are becoming increasingly important.

[0003] While collecting user voice, the microphone also collects a lot of environmental noise. Each type of environmental noise has different characteristics. Voice signal processing is an essential technology used in scenarios such as far-field voice interaction, audio and video communication, and online games. It is commonly known as 3A noise reduction processing, which mainly includes AEC (Acoustic Echo Cancelling), AGC (Automatic Gain Control) and ANS (Active Noise Control) to improve call or live broadcast quality and user experience.

[0004] Moreover, few gaming speakers on the market are equipped with microphones. They usually only have microphone interfaces. When voice interaction is required, players need to wear headphones to play games, which will cause ear pressure, sweating, and discomfort for a long time. At the same time, since gaming speakers have a multi-channel 3D system, they cannot effectively eliminate the echo of the audio data collected by the microphone, resulting in severe echoes, which is very annoying and leads to a poor user experience. Summary of the invention

[0005] The purpose of the present invention is to overcome the shortcomings of the prior art. The present invention provides an e-sports speaker noise reduction control method and related devices based on noise cancellation, which can achieve good noise reduction and echo reduction processing of the collected audio signals, so that users do not need to wear headphones, thereby improving user experience.

[0006] In order to solve the above technical problems, an embodiment of the present invention provides a noise reduction control method for an e-sports speaker based on noise cancellation, which is applied to an e-sports speaker having a multi-channel 3D system and multiple microphone devices; the method comprises:

[0007] When the gaming speaker is used in an online game scenario, audio collection and processing are performed based on the multiple microphone devices provided on the gaming speaker to obtain collected mixed audio signal data;

[0008] Inputting the collected mixed audio signal data into a group of bandpass filters for filtering processing to obtain audio signal data of multiple frequency bands;

[0009] Performing down-sampling rate conversion processing on each frequency band audio signal data of the plurality of frequency band audio signal data to obtain a plurality of frequency band down-sampled audio signals;

[0010] Based on the noise elimination algorithm built into the gaming speaker, the multiple frequency band downsampled audio signals are processed with noise elimination in sequence to obtain multiple frequency band downsampled audio signals after noise reduction;

[0011] Performing upsampling processing on the multiple frequency band downsampled audio signals after noise reduction to obtain multiple frequency band upsampled audio signals;

[0012] The multiple frequency band up-sampled audio signals are recombined in the same time domain to generate combined audio signal data, where the combined audio signal data is noise reduction audio data.

[0013] Optionally, the performing audio acquisition processing based on the multiple microphone devices provided on the e-sports speaker to obtain acquired mixed audio signal data includes:

[0014] Based on each of the multiple microphone devices arranged on the gaming speaker performing real-time audio collection processing at the same collection frequency, a multi-channel real-time collected audio signal is obtained;

[0015] The multiple channels of real-time collected audio information are mixed and processed according to the time domain to obtain collected mixed audio signal data.

[0016] Optionally, the step of inputting the collected mixed audio signal data into a group of bandpass filters for filtering to obtain audio signal data of multiple frequency bands includes:

[0017] Inputting the collected mixed audio signal data into a group of bandpass filters for filtering processing respectively, to obtain spectrum data corresponding to the collected mixed audio signal data;

[0018] The spectrum data is subdivided according to frequency bands to obtain audio signal data of multiple frequency bands.

[0019] Optionally, performing downsampling rate conversion processing on each frequency band audio signal data of the multiple frequency band audio signal data to obtain multiple frequency band downsampled audio signals includes:

[0020] Each frequency band audio signal data of the multiple frequency band audio signal data is input into a downsampling module for downsampling conversion processing to obtain multiple frequency band downsampled audio signals; wherein the downsampling module is provided with a downsampling frequency.

[0021] Optionally, the performing noise elimination processing on the multiple frequency band downsampled audio signals in sequence based on the noise elimination algorithm built into the e-sports speaker to obtain the multiple frequency band downsampled audio signals after noise reduction includes:

[0022] Obtaining an echo reference signal in the same time domain as the multiple frequency band down-sampled audio signals when the e-sports speaker is playing;

[0023] Based on the echo reference signal, a noise elimination algorithm built into the e-sports speaker is called to perform noise elimination processing on the multiple frequency band downsampled audio signals respectively to obtain multiple frequency band downsampled audio signals after noise reduction.

[0024] Optionally, the invoking a built-in noise elimination algorithm of the e-sports speaker based on the echo reference signal to perform noise elimination processing on the multiple frequency band downsampled audio signals respectively to obtain multiple frequency band downsampled audio signals after noise reduction, includes:

[0025] Based on the echo reference signal, an echo cancellation algorithm is called to perform echo cancellation processing on the multiple frequency band downsampled audio signals respectively to obtain multiple frequency band downsampled audio signals after echo cancellation;

[0026] Inputting the multiple frequency band down-sampled audio signals after echo elimination into an adaptive beam former for adaptive beamforming processing to obtain the multiple frequency band down-sampled audio signals after beamforming;

[0027] Using an adaptive active noise reduction algorithm to perform noise reduction processing on the multiple frequency band downsampled audio signals after beamforming, to obtain the multiple frequency band downsampled audio signals after noise reduction;

[0028] Automatic gain processing is performed on the multiple frequency band down-sampled audio signals after noise reduction to obtain the multiple frequency band down-sampled audio signals after noise reduction.

[0029] Optionally, the upsampling processing is performed on the multiple frequency band downsampled audio signals after noise reduction to obtain multiple frequency band upsampled audio signals, including:

[0030] Each of the noise-reduced frequency band down-sampled audio signals is respectively input into the up-sampling module for up-sampling processing to obtain multiple frequency band up-sampled audio signals; the up-sampling module is provided with an up-sampling frequency so that the frequency of the multiple frequency band up-sampled audio signals is the same as the frequency of the multiple frequency band audio signal data.

[0031] In addition, an embodiment of the present invention further provides a noise reduction control device for an e-sports speaker based on noise cancellation, which is applied to an e-sports speaker having a multi-channel 3D system and multiple microphone devices; the device includes:

[0032] Audio acquisition module: used for performing audio acquisition processing based on the multiple microphone devices provided on the gaming speaker to obtain the collected mixed audio signal data when the gaming speaker is applied in an online gaming scenario;

[0033] Filter processing module: used for inputting the collected mixed audio signal data into a group of bandpass filters for filtering processing to obtain audio signal data of multiple frequency bands;

[0034] A downsampling module: configured to perform downsampling rate conversion processing on each frequency band audio signal data of the plurality of frequency band audio signal data to obtain a plurality of frequency band downsampled audio signals;

[0035] Noise elimination module: used for performing noise elimination processing on the multiple frequency band downsampled audio signals in sequence based on the noise elimination algorithm built into the e-sports speaker to obtain multiple frequency band downsampled audio signals after noise reduction;

[0036] Upsampling module: used for upsampling the multiple frequency band downsampled audio signals after noise reduction to obtain multiple frequency band upsampled audio signals;

[0037] The signal recombining module is used to recombine the multiple frequency band up-sampled audio signals according to the same time domain to generate combined audio signal data, where the combined audio signal data is noise reduction audio data.

[0038] In addition, an embodiment of the present invention further provides an e-sports speaker, including a processor and a memory, wherein the processor runs a computer program or code stored in the memory to implement the e-sports speaker noise reduction control method as described in any one of the above.

[0039] In addition, an embodiment of the present invention further provides a computer-readable storage medium for storing a computer program or code. When the computer program or code is executed by a processor, the e-sports speaker noise reduction control method as described in any one of the above is implemented.

[0040] In an embodiment of the present invention, when the e-sports speaker is used in an environment such as online games that require online voice calls, audio collection and processing are performed through multiple microphone devices arranged on the e-sports speaker; the collected mixed audio signal data is input into a group of bandpass filters for filtering processing; each frequency band audio signal data in the multiple frequency band audio signal data is subjected to downsampling rate conversion processing; the multiple frequency band downsampled audio signals are subjected to noise elimination processing in turn; the multiple frequency band downsampled audio signals after noise reduction are subjected to upsampling processing respectively; the multiple frequency band upsampled audio signals are recombined and processed in the same time domain to generate combined audio signal data, and the combined audio signal data is noise-reduced audio data; thereby effectively realizing echo elimination of the collected audio signal and noise reduction processing of other noises, and having good echo elimination and noise reduction effects; the user will no longer need to wear additional headphone equipment, which brings a good user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0042] Figure 1 is a flow chart of a noise reduction control method for an e-sports speaker based on noise cancellation in an embodiment of the present invention;

[0043] Figure 2 is a flow chart of a noise reduction control method for an e-sports speaker based on noise elimination in another embodiment of the present invention;

[0044] Figure 3 is a schematic diagram of the structural composition of a noise reduction control device for an e-sports speaker based on noise elimination in an embodiment of the present invention;

[0045] Figure 4 It is a schematic diagram of the structural composition of the e-sports speaker in an embodiment of the present invention. DETAILED DESCRIPTION

[0046] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0047] For example, see Figure 1 , Figure 1It is a flow chart of a noise reduction control method for an e-sports speaker based on noise elimination in an embodiment of the present invention.

[0048] like Figure 1 As shown, a noise reduction control method for an e-sports speaker based on noise cancellation is applied to an e-sports speaker, wherein the e-sports speaker has a multi-channel 3D system and multiple microphone devices; the method comprises:

[0049] S101: When the gaming speaker is used in an online game scenario, audio collection and processing are performed based on the multiple microphone devices provided on the gaming speaker to obtain collected mixed audio signal data;

[0050] In the specific implementation process of the present invention, the audio collection and processing is performed based on the multiple microphone devices set on the e-sports speaker to obtain collected mixed audio signal data, including: based on each of the multiple microphone devices set on the e-sports speaker, real-time audio collection and processing is performed at the same collection frequency to obtain multiple channels of real-time collected audio signals; the multiple channels of real-time collected audio information are mixed according to the time domain to obtain collected mixed audio signal data.

[0051] Specifically, the e-sports speaker is provided with a multi-channel 3D system and multiple microphone devices, and when the operating mode of the e-sports speaker is set to an online game scenario or an online call is required, each of the multiple microphone devices provided on the e-sports speaker will perform real-time audio acquisition processing at the same acquisition frequency to obtain multiple channels of real-time acquired audio signals; after obtaining the multiple channels of real-time acquired audio signals, the multiple channels of real-time acquired audio signals need to be mixed and processed in a consistent manner in the time domain, and finally the acquired mixed audio signal data can be obtained; at this time, the acquired mixed audio signal data obtained is mixed with the user's call voice audio, the audio played by the e-sports speaker, and other noise audio and other audio signals, so it is necessary to perform noise reduction processing to filter out other audio signals other than the call voice audio as much as possible.

[0052] S102: inputting the collected mixed audio signal data into a group of bandpass filters for filtering processing to obtain audio signal data of multiple frequency bands;

[0053] In the specific implementation process of the present invention, the inputting the collected mixed audio signal data into a group of bandpass filters for filtering processing to obtain multiple frequency band audio signal data includes: inputting the collected mixed audio signal data into a group of bandpass filters for filtering processing respectively to obtain frequency spectrum data corresponding to the collected mixed audio signal data; subdividing the frequency spectrum data according to frequency bands to obtain multiple frequency band audio signal data.

[0054] Specifically, after obtaining the number of collected mixed audio signals, filtering processing is required, that is, the collected mixed audio signal data are respectively input into a group of bandpass filters for filtering processing, so as to obtain the spectrum data corresponding to the collected mixed audio signal data, and then the spectrum data is subdivided according to the frequency band to obtain multiple frequency band audio signal data; the subdivision here is generally based on frequency.

[0055] S103: performing down-sampling rate conversion processing on each frequency band audio signal data of the plurality of frequency band audio signal data to obtain a plurality of frequency band down-sampled audio signals;

[0056] In the specific implementation process of the present invention, the downsampling rate conversion processing is performed on each frequency band audio signal data of the multiple frequency band audio signal data to obtain multiple frequency band downsampled audio signals, including: inputting each frequency band audio signal data of the multiple frequency band audio signal data into a downsampling module for downsampling conversion processing to obtain multiple frequency band downsampled audio signals; wherein the downsampling module is provided with a downsampling frequency.

[0057] Specifically, in order to facilitate subsequent noise reduction processing and improve the efficiency of noise reduction processing, it is necessary to downsample the signal data, that is, input each frequency band audio signal data of multiple frequency band audio signal data into the downsampling module for downsampling conversion processing to obtain multiple frequency band downsampled audio signals; wherein the downsampling module is provided with a downsampling frequency.

[0058] S104: performing noise elimination processing on the multiple frequency band downsampled audio signals in sequence based on the noise elimination algorithm built into the gaming speaker to obtain multiple frequency band downsampled audio signals after noise reduction;

[0059] In the specific implementation process of the present invention, the noise elimination algorithm built into the e-sports speaker is used to perform noise elimination processing on the multiple frequency band downsampled audio signals in sequence to obtain multiple frequency band downsampled audio signals after noise reduction, including: obtaining an echo reference signal in the same time domain as the multiple frequency band downsampled audio signals when the e-sports speaker is playing; based on the echo reference signal, calling the noise elimination algorithm built into the e-sports speaker to perform noise elimination processing on the multiple frequency band downsampled audio signals respectively to obtain multiple frequency band downsampled audio signals after noise reduction.

[0060] Furthermore, the method of calling the noise cancellation algorithm built into the e-sports speaker based on the echo reference signal to perform noise cancellation processing on the multiple frequency band downsampled audio signals respectively to obtain multiple frequency band downsampled audio signals after noise reduction includes: calling the echo cancellation algorithm based on the echo reference signal to perform echo cancellation processing on the multiple frequency band downsampled audio signals respectively to obtain multiple frequency band downsampled audio signals after echo cancellation; inputting the multiple frequency band downsampled audio signals after echo cancellation into an adaptive beamformer for adaptive beamforming processing to obtain multiple frequency band downsampled audio signals after beamforming; using an adaptive active noise reduction algorithm to perform noise reduction processing on the multiple frequency band downsampled audio signals after beamforming to obtain multiple frequency band downsampled audio signals after noise reduction; performing automatic gain processing on the multiple frequency band downsampled audio signals after noise reduction to obtain multiple frequency band downsampled audio signals after noise reduction.

[0061] Specifically, it is first necessary to obtain an echo reference signal in the same time domain as the multiple frequency-band down-sampled audio signals when the gaming speaker is playing; then, the noise elimination algorithm built into the gaming speaker is called through the echo reference signal to perform noise elimination processing on the multiple frequency-band down-sampled audio signals respectively, to obtain the multiple frequency-band down-sampled audio signals after noise reduction.

[0062] The echo reference signal is obtained by collecting audio signals at the output end of the power amplifier of the multi-channel 3D system. Generally, the power amplifier uses differential signal input and BTL output. The sampling can only sample the signal at the positive output end (no need to sample + / - output at the same time) to simplify the circuit. The output audio spectrum of the + / - end of the power amplifier is the same, and only one end needs to be taken to obtain complete audio information. By collecting the reference signal from the power amplifier end, the multi-channel signal is mixed into a single channel signal through filtering and level matching. This audio signal already contains all the echo information and can correspond well to the echo audio received from the Mic. After analog-to-digital conversion, it is input into the DSP to become the echo reference signal corresponding to the AEC echo cancellation.

[0063] The acquisition signal must filter high-frequency noise, such as the residual carrier of the Class D amplifier. Note that the output signal is the superposition of multi-channel acquisition signals. The output signal cannot be overloaded. The signal must be attenuated by about 20 to 30 dB using a resistor divider before mixing. Then, it is converted to digital audio through the built-in or external ADC and input to the DSP. The following formula can be used to estimate the amplitude of the superimposed signal:

[0064] Vout=-(V1*R f / R1+V2*R f / R2+…+V n *R f / R n );

[0065] After obtaining the echo reference signal, the echo cancellation algorithm is called through the echo reference signal to perform echo cancellation processing on the multiple frequency band downsampled audio signals respectively, so as to obtain the multiple frequency band downsampled audio signals after echo cancellation; then, the multiple frequency band downsampled audio signals after echo cancellation are input into the adaptive beam former for adaptive beamforming processing, so as to obtain the multiple frequency band downsampled audio signals after beam formation; the adaptive active noise reduction algorithm is used to perform noise reduction processing on the multiple frequency band downsampled audio signals after beam formation, so as to obtain the multiple frequency band downsampled audio signals after noise reduction; finally, the multiple frequency band downsampled audio signals after noise reduction are automatically gain processed, so as to obtain the multiple frequency band downsampled audio signals after noise reduction; thus, the noise reduction processing of the audio signal is completed.

[0066] S105: performing upsampling processing on the multiple frequency band downsampled audio signals after noise reduction to obtain multiple frequency band upsampled audio signals;

[0067] In a specific implementation of the present invention, the step of upsampling the noise-reduced multiple frequency band downsampled audio signals to obtain multiple frequency band upsampled audio signals includes:

[0068] Each of the noise-reduced frequency band down-sampled audio signals is respectively input into the up-sampling module for up-sampling processing to obtain multiple frequency band up-sampled audio signals; the up-sampling module is provided with an up-sampling frequency so that the frequency of the multiple frequency band up-sampled audio signals is the same as the frequency of the multiple frequency band audio signal data.

[0069] Specifically, after noise reduction is completed, in order to restore the frequency of the audio, each of the multiple frequency band downsampled audio signals after noise reduction needs to be input into the upsampling module for upsampling processing to obtain multiple frequency band upsampled audio signals; wherein the upsampling module is provided with an upsampling frequency so that the frequencies of the multiple frequency band upsampled audio signals are the same as the frequencies of the multiple frequency band audio signal data.

[0070] S106: recombining the multiple frequency band up-sampled audio signals in the same time domain to generate combined audio signal data, where the combined audio signal data is noise reduction audio data.

[0071] In the specific implementation process of the present invention, after obtaining the multiple frequency band up-sampled audio signals, it is necessary to recombine these signals, so the multiple frequency band up-sampled audio signals are recombinated and processed according to the same time domain to generate combined audio signal data, and the combined audio signal data is converted into noise-reduced audio data; in this way, the noise-reduced audio data can be sent to the netizen at the other end through network communication, thereby completing the online call.

[0072] In an embodiment of the present invention, when the e-sports speaker is used in an environment such as online games that require online voice calls, audio collection and processing are performed through multiple microphone devices arranged on the e-sports speaker; the collected mixed audio signal data is input into a group of bandpass filters for filtering processing; each frequency band audio signal data in the multiple frequency band audio signal data is subjected to downsampling rate conversion processing; the multiple frequency band downsampled audio signals are subjected to noise elimination processing in turn; the multiple frequency band downsampled audio signals after noise reduction are subjected to upsampling processing respectively; the multiple frequency band upsampled audio signals are recombined and processed in the same time domain to generate combined audio signal data, and the combined audio signal data is noise-reduced audio data; thereby effectively realizing echo elimination of the collected audio signal and noise reduction processing of other noises, and having good echo elimination and noise reduction effects; the user will no longer need to wear additional headphone equipment, which brings a good user experience.

[0073] For example 2, please refer to Figure 2 , Figure 2 Schematic diagram of a flow chart of a noise reduction control method for an e-sports speaker based on noise elimination in another embodiment of the present invention

[0074] like Figure 2 As shown, a noise reduction control method for an e-sports speaker based on noise cancellation is applied to an e-sports speaker, wherein the e-sports speaker has a multi-channel 3D system and multiple microphone devices; the method comprises:

[0075] S201: When the gaming speaker is used in an online game scenario, audio collection and processing are performed based on the multiple microphone devices provided on the gaming speaker to obtain collected mixed audio signal data;

[0076] S202: Inputting the collected mixed audio signal data into a group of bandpass filters for filtering processing to obtain audio signal data of multiple frequency bands;

[0077] S203: performing down-sampling rate conversion processing on each frequency band audio signal data of the plurality of frequency band audio signal data to obtain a plurality of frequency band down-sampled audio signals;

[0078] S204: Obtaining an echo reference signal in the same time domain as the multiple frequency band down-sampled audio signals when the e-sports speaker is playing;

[0079] S205: performing echo cancellation processing on the multiple frequency band downsampled audio signals respectively based on the echo reference signal by calling an echo cancellation algorithm to obtain multiple frequency band downsampled audio signals after echo cancellation;

[0080] S206: Inputting the multiple frequency band down-sampled audio signals after echo elimination into an adaptive beamformer for adaptive beamforming processing to obtain the multiple frequency band down-sampled audio signals after beamforming;

[0081] S207: using an adaptive active noise reduction algorithm to perform noise reduction processing on the multiple frequency band downsampled audio signals after beamforming, to obtain multiple frequency band downsampled audio signals after noise reduction;

[0082] S208: performing automatic gain processing on the multiple frequency band down-sampled audio signals after noise reduction to obtain the multiple frequency band down-sampled audio signals after noise reduction;

[0083] S209: performing upsampling processing on the multiple frequency band downsampled audio signals after noise reduction to obtain multiple frequency band upsampled audio signals;

[0084] S210: Recombining the multiple frequency band up-sampled audio signals in the same time domain to generate combined audio signal data, where the combined audio signal data is noise reduction audio data.

[0085] Specifically, the specific implementation of the second embodiment can be found in the above embodiments, which will not be described in detail here.

[0086] For example 3, please refer to Figure 3 , Figure 3 It is a schematic diagram of the structural composition of the noise reduction control device for an e-sports speaker based on noise elimination in an embodiment of the present invention.

[0087] like Figure 3 As shown, a noise reduction control device for an e-sports speaker based on noise cancellation is applied to an e-sports speaker, wherein the e-sports speaker has a multi-channel 3D system and multiple microphone devices; the device comprises:

[0088] The audio acquisition module 301 is used to perform audio acquisition processing based on the multiple microphone devices set on the gaming speaker to obtain the collected mixed audio signal data when the gaming speaker is used in an online game scenario;

[0089] In the specific implementation process of the present invention, the audio collection and processing is performed based on the multiple microphone devices set on the e-sports speaker to obtain collected mixed audio signal data, including: based on each of the multiple microphone devices set on the e-sports speaker, real-time audio collection and processing is performed at the same collection frequency to obtain multiple channels of real-time collected audio signals; the multiple channels of real-time collected audio information are mixed according to the time domain to obtain collected mixed audio signal data.

[0090] Specifically, the e-sports speaker is provided with a multi-channel 3D system and multiple microphone devices, and when the operating mode of the e-sports speaker is set to an online game scenario or an online call is required, each of the multiple microphone devices provided on the e-sports speaker will perform real-time audio acquisition processing at the same acquisition frequency to obtain multiple channels of real-time acquired audio signals; after obtaining the multiple channels of real-time acquired audio signals, the multiple channels of real-time acquired audio signals need to be mixed and processed in a consistent manner in the time domain, and finally the acquired mixed audio signal data can be obtained; at this time, the acquired mixed audio signal data obtained is mixed with the user's call voice audio, the audio played by the e-sports speaker, and other noise audio and other audio signals, so it is necessary to perform noise reduction processing to filter out other audio signals other than the call voice audio as much as possible.

[0091] Filter processing module 302: used for inputting the collected mixed audio signal data into a group of bandpass filters for filtering processing to obtain audio signal data of multiple frequency bands;

[0092] In the specific implementation process of the present invention, the inputting the collected mixed audio signal data into a group of bandpass filters for filtering processing to obtain multiple frequency band audio signal data includes: inputting the collected mixed audio signal data into a group of bandpass filters for filtering processing respectively to obtain frequency spectrum data corresponding to the collected mixed audio signal data; subdividing the frequency spectrum data according to frequency bands to obtain multiple frequency band audio signal data.

[0093] Specifically, after obtaining the number of collected mixed audio signals, filtering processing is required, that is, the collected mixed audio signal data are respectively input into a group of bandpass filters for filtering processing, so as to obtain the spectrum data corresponding to the collected mixed audio signal data, and then the spectrum data is subdivided according to the frequency band to obtain multiple frequency band audio signal data; the subdivision here is generally based on frequency.

[0094] The down-sampling module 303 is configured to perform down-sampling rate conversion processing on each frequency band audio signal data of the plurality of frequency band audio signal data to obtain a plurality of frequency band down-sampled audio signals;

[0095] In the specific implementation process of the present invention, the downsampling rate conversion processing is performed on each frequency band audio signal data of the multiple frequency band audio signal data to obtain multiple frequency band downsampled audio signals, including: inputting each frequency band audio signal data of the multiple frequency band audio signal data into a downsampling module for downsampling conversion processing to obtain multiple frequency band downsampled audio signals; wherein the downsampling module is provided with a downsampling frequency.

[0096] Specifically, in order to facilitate subsequent noise reduction processing and improve the efficiency of noise reduction processing, it is necessary to downsample the signal data, that is, input each frequency band audio signal data of multiple frequency band audio signal data into the downsampling module for downsampling conversion processing to obtain multiple frequency band downsampled audio signals; wherein the downsampling module is provided with a downsampling frequency.

[0097] Noise elimination module 304: used to perform noise elimination processing on the multiple frequency band downsampled audio signals in sequence based on the noise elimination algorithm built into the e-sports speaker to obtain multiple frequency band downsampled audio signals after noise reduction;

[0098] In the specific implementation process of the present invention, the noise elimination algorithm built into the e-sports speaker is used to perform noise elimination processing on the multiple frequency band downsampled audio signals in sequence to obtain multiple frequency band downsampled audio signals after noise reduction, including: obtaining an echo reference signal in the same time domain as the multiple frequency band downsampled audio signals when the e-sports speaker is playing; based on the echo reference signal, calling the noise elimination algorithm built into the e-sports speaker to perform noise elimination processing on the multiple frequency band downsampled audio signals respectively to obtain multiple frequency band downsampled audio signals after noise reduction.

[0099] Furthermore, the method of calling the noise cancellation algorithm built into the e-sports speaker based on the echo reference signal to perform noise cancellation processing on the multiple frequency band downsampled audio signals respectively to obtain multiple frequency band downsampled audio signals after noise reduction includes: calling the echo cancellation algorithm based on the echo reference signal to perform echo cancellation processing on the multiple frequency band downsampled audio signals respectively to obtain multiple frequency band downsampled audio signals after echo cancellation; inputting the multiple frequency band downsampled audio signals after echo cancellation into an adaptive beamformer for adaptive beamforming processing to obtain multiple frequency band downsampled audio signals after beamforming; using an adaptive active noise reduction algorithm to perform noise reduction processing on the multiple frequency band downsampled audio signals after beamforming to obtain multiple frequency band downsampled audio signals after noise reduction; performing automatic gain processing on the multiple frequency band downsampled audio signals after noise reduction to obtain multiple frequency band downsampled audio signals after noise reduction.

[0100] Specifically, it is first necessary to obtain an echo reference signal in the same time domain as the multiple frequency-band down-sampled audio signals when the gaming speaker is playing; then, the noise elimination algorithm built into the gaming speaker is called through the echo reference signal to perform noise elimination processing on the multiple frequency-band down-sampled audio signals respectively, to obtain the multiple frequency-band down-sampled audio signals after noise reduction.

[0101] The echo reference signal is obtained by collecting audio signals at the output end of the power amplifier of the multi-channel 3D system. Generally, the power amplifier uses differential signal input and BTL output. The sampling can only sample the signal at the positive output end (no need to sample + / - output at the same time) to simplify the circuit. The output audio spectrum of the + / - end of the power amplifier is the same, and only one end needs to be taken to obtain complete audio information. By collecting the reference signal from the power amplifier end, the multi-channel signal is mixed into a single channel signal through filtering and level matching. This audio signal already contains all the echo information and can correspond well to the echo audio received from the Mic. After analog-to-digital conversion, it is input into the DSP to become the echo reference signal corresponding to the AEC echo cancellation.

[0102] The acquisition signal must filter high-frequency noise, such as the residual carrier of the Class D amplifier. Note that the output signal is the superposition of multi-channel acquisition signals. The output signal cannot be overloaded. The signal must be attenuated by about 20 to 30 dB using a resistor divider before mixing. Then, it is converted to digital audio through the built-in or external ADC and input to the DSP. The following formula can be used to estimate the amplitude of the superimposed signal:

[0103] Vout=-(V1*R f / R1+V2*R f / R2+…+V n *R f / R n );

[0104] After obtaining the echo reference signal, the echo cancellation algorithm is called through the echo reference signal to perform echo cancellation processing on the multiple frequency band downsampled audio signals respectively, so as to obtain the multiple frequency band downsampled audio signals after echo cancellation; then, the multiple frequency band downsampled audio signals after echo cancellation are input into the adaptive beam former for adaptive beamforming processing, so as to obtain the multiple frequency band downsampled audio signals after beam formation; the adaptive active noise reduction algorithm is used to perform noise reduction processing on the multiple frequency band downsampled audio signals after beam formation, so as to obtain the multiple frequency band downsampled audio signals after noise reduction; finally, the multiple frequency band downsampled audio signals after noise reduction are automatically gain processed, so as to obtain the multiple frequency band downsampled audio signals after noise reduction; thus, the noise reduction processing of the audio signal is completed.

[0105] Upsampling module 305: used to perform upsampling processing on the multiple frequency band downsampled audio signals after noise reduction, to obtain multiple frequency band upsampled audio signals;

[0106] In a specific implementation of the present invention, the step of upsampling the noise-reduced multiple frequency band downsampled audio signals to obtain multiple frequency band upsampled audio signals includes:

[0107] Each of the noise-reduced frequency band down-sampled audio signals is respectively input into the up-sampling module for up-sampling processing to obtain multiple frequency band up-sampled audio signals; the up-sampling module is provided with an up-sampling frequency so that the frequency of the multiple frequency band up-sampled audio signals is the same as the frequency of the multiple frequency band audio signal data.

[0108] Specifically, after noise reduction is completed, in order to restore the frequency of the audio, each of the multiple frequency band downsampled audio signals after noise reduction needs to be input into the upsampling module for upsampling processing to obtain multiple frequency band upsampled audio signals; wherein the upsampling module is provided with an upsampling frequency so that the frequencies of the multiple frequency band upsampled audio signals are the same as the frequencies of the multiple frequency band audio signal data.

[0109] The signal recombining module 306 is configured to recombining the multiple frequency band up-sampled audio signals in the same time domain to generate combined audio signal data, where the combined audio signal data is noise reduction audio data.

[0110] In the specific implementation process of the present invention, after obtaining the multiple frequency band up-sampled audio signals, it is necessary to recombine these signals, so the multiple frequency band up-sampled audio signals are recombinated and processed according to the same time domain to generate combined audio signal data, and the combined audio signal data is converted into noise-reduced audio data; in this way, the noise-reduced audio data can be sent to the netizen at the other end through network communication, thereby completing the online call.

[0111] In an embodiment of the present invention, when the e-sports speaker is used in an environment such as online games that require online voice calls, audio collection and processing are performed through multiple microphone devices arranged on the e-sports speaker; the collected mixed audio signal data is input into a group of bandpass filters for filtering processing; each frequency band audio signal data in the multiple frequency band audio signal data is subjected to downsampling rate conversion processing; the multiple frequency band downsampled audio signals are subjected to noise elimination processing in turn; the multiple frequency band downsampled audio signals after noise reduction are subjected to upsampling processing respectively; the multiple frequency band upsampled audio signals are recombined and processed in the same time domain to generate combined audio signal data, and the combined audio signal data is noise-reduced audio data; thereby effectively realizing echo elimination of the collected audio signal and noise reduction processing of other noises, and having good echo elimination and noise reduction effects; the user will no longer need to wear additional headphone equipment, which brings a good user experience.

[0112] A computer-readable storage medium is provided in an embodiment of the present invention, wherein a computer program is stored on the computer-readable storage medium, and when the program is executed by a processor, the noise reduction control method of an e-sports speaker in any of the above embodiments is implemented. The computer-readable storage medium includes, but is not limited to, any type of disk (including floppy disk, hard disk, optical disk, CD-ROM, and magneto-optical disk), ROM (Read-Only Memory), RAM (Random Access Memory), EPROM (EraSable Programmable Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), flash memory, magnetic card or optical card. That is, the storage device includes any medium that can store or transmit information in a readable form by a device (for example, a computer, a mobile phone), which can be a read-only memory, a disk or an optical disk, etc.

[0113] An embodiment of the present invention further provides a computer application program that runs on a computer, and the computer application program is used to execute the noise reduction control method for an e-sports speaker of any one of the above embodiments.

[0114] also, Figure 4 It is a schematic diagram of the structural composition of the e-sports speaker in an embodiment of the present invention.

[0115] The embodiment of the present invention further provides an e-sports speaker, such as Figure 4 The gaming speaker includes a processor 402, a memory 403, an input unit 404, a display unit 405 and other components. Those skilled in the art will appreciate that Figure 4 The structural components of the e-sports speakers shown do not constitute a limitation on all devices, and may include more or fewer components than shown, or combine certain components. The memory 403 can be used to store the application 401 and various functional modules, and the processor 402 runs the application 401 stored in the memory 403, thereby executing various functional applications and data processing of the device. The memory can be an internal memory or an external memory, or include both internal and external memories. The internal memory may include a read-only memory (ROM), a programmable ROM (PROM), an electrically programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a flash memory, or a random access memory. The external memory may include a hard disk, a floppy disk, a ZIP disk, a U disk, a magnetic tape, etc. The memory disclosed in the present invention includes but is not limited to these types of memories. The memory disclosed in the present invention is only an example and not a limitation.

[0116] The input unit 404 is used to receive the input of the signal and the keyword input by the user. The input unit 404 may include a touch panel and other input devices. The touch panel can collect the user's touch operation on or near it (such as the user's operation on or near the touch panel using any suitable object or accessory such as a finger, stylus, etc.), and drive the corresponding connection device according to a pre-set program; other input devices may include but are not limited to one or more of a physical keyboard, a function key (such as a playback control key, a switch key, etc.), a trackball, a mouse, a joystick, etc. The display unit 405 can be used to display the information input by the user or the information provided to the user and various menus of the terminal device. The display unit 405 can be in the form of a liquid crystal display, an organic light emitting diode, etc. The processor 402 is the control center of the terminal device, which uses various interfaces and lines to connect the various parts of the entire device, and executes various functions and processes data by running or executing software programs and / or modules stored in the memory 403, and calling the data stored in the memory.

[0117] As an embodiment, the gaming speaker includes: one or more processors 402, a memory 403, and one or more applications 401, wherein the one or more applications 401 are stored in the memory 403 and are configured to be executed by the one or more processors 402, and the one or more applications 401 are configured to execute the corresponding gaming speaker noise reduction control method in any one of the above embodiments.

[0118] In an embodiment of the present invention, when the e-sports speaker is used in an environment such as online games that require online voice calls, audio collection and processing are performed through multiple microphone devices arranged on the e-sports speaker; the collected mixed audio signal data is input into a group of bandpass filters for filtering processing; each frequency band audio signal data in the multiple frequency band audio signal data is subjected to downsampling rate conversion processing; the multiple frequency band downsampled audio signals are subjected to noise elimination processing in turn; the multiple frequency band downsampled audio signals after noise reduction are subjected to upsampling processing respectively; the multiple frequency band upsampled audio signals are recombined and processed in the same time domain to generate combined audio signal data, and the combined audio signal data is noise-reduced audio data; thereby effectively realizing echo elimination of the collected audio signal and noise reduction processing of other noises, and having good echo elimination and noise reduction effects; the user will no longer need to wear additional headphone equipment, which brings a good user experience.

[0119] In addition, the above is a detailed introduction to the noise reduction control method and related devices of an e-sports speaker based on noise elimination provided by an embodiment of the present invention. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea; at the same time, for general technical personnel in the field, according to the idea of ​​the present invention, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present invention.

Claims

1. A noise reduction control method for an e-sports speaker based on noise elimination, characterized in that: Applied to a gaming speaker, the gaming speaker has a multi-channel 3D system and multiple microphone devices; the method comprises: When the gaming speaker is used in an online game scenario, audio collection and processing are performed based on the multiple microphone devices provided on the gaming speaker to obtain collected mixed audio signal data; Inputting the collected mixed audio signal data into a group of bandpass filters for filtering processing to obtain audio signal data of multiple frequency bands; Performing down-sampling rate conversion processing on each frequency band audio signal data of the plurality of frequency band audio signal data to obtain a plurality of frequency band down-sampled audio signals; Based on the noise elimination algorithm built into the gaming speaker, the multiple frequency band downsampled audio signals are processed with noise elimination in sequence to obtain multiple frequency band downsampled audio signals after noise reduction; Performing upsampling processing on the multiple frequency band downsampled audio signals after noise reduction to obtain multiple frequency band upsampled audio signals; The multiple frequency band up-sampled audio signals are recombined in the same time domain to generate combined audio signal data, where the combined audio signal data is noise reduction audio data.

2. The e-sports speaker noise reduction control method according to claim 1, characterized in that: The performing audio acquisition processing based on the multiple microphone devices arranged on the gaming speaker to obtain the acquired mixed audio signal data includes: Based on each of the multiple microphone devices arranged on the gaming speaker performing real-time audio collection processing at the same collection frequency, a multi-channel real-time collected audio signal is obtained; The multiple channels of real-time collected audio information are mixed and processed according to the time domain to obtain collected mixed audio signal data.

3. The e-sports speaker noise reduction control method according to claim 1, characterized in that: The step of inputting the collected mixed audio signal data into a group of bandpass filters for filtering to obtain multiple frequency band audio signal data comprises: Inputting the collected mixed audio signal data into a group of bandpass filters for filtering processing respectively, to obtain spectrum data corresponding to the collected mixed audio signal data; The spectrum data is subdivided according to frequency bands to obtain audio signal data of multiple frequency bands.

4. The e-sports speaker noise reduction control method according to claim 1, characterized in that: The down-sampling rate conversion process is performed on each of the plurality of frequency band audio signal data to obtain a plurality of frequency band down-sampled audio signals, comprising: Each frequency band audio signal data of the multiple frequency band audio signal data is input into a downsampling module for downsampling conversion processing to obtain multiple frequency band downsampled audio signals; wherein the downsampling module is provided with a downsampling frequency.

5. The e-sports speaker noise reduction control method according to claim 1, characterized in that: The method of performing noise elimination processing on the multiple frequency band downsampled audio signals in sequence based on the noise elimination algorithm built into the e-sports speaker to obtain multiple frequency band downsampled audio signals after noise reduction includes: Obtaining an echo reference signal in the same time domain as the multiple frequency band down-sampled audio signals when the e-sports speaker is playing; Based on the echo reference signal, a noise elimination algorithm built into the e-sports speaker is called to perform noise elimination processing on the multiple frequency band downsampled audio signals respectively to obtain multiple frequency band downsampled audio signals after noise reduction.

6. The e-sports speaker noise reduction control method according to claim 5, characterized in that: The method of calling the noise elimination algorithm built into the e-sports speaker based on the echo reference signal to perform noise elimination processing on the multiple frequency band downsampled audio signals respectively to obtain multiple frequency band downsampled audio signals after noise reduction includes: Based on the echo reference signal, an echo cancellation algorithm is called to perform echo cancellation processing on the multiple frequency band downsampled audio signals respectively to obtain multiple frequency band downsampled audio signals after echo cancellation; Inputting the multiple frequency band down-sampled audio signals after echo elimination into an adaptive beam former for adaptive beamforming processing to obtain the multiple frequency band down-sampled audio signals after beamforming; Using an adaptive active noise reduction algorithm to perform noise reduction processing on the multiple frequency band downsampled audio signals after beamforming, to obtain the multiple frequency band downsampled audio signals after noise reduction; Automatic gain processing is performed on the multiple frequency band down-sampled audio signals after noise reduction to obtain the multiple frequency band down-sampled audio signals after noise reduction.

7. The e-sports speaker noise reduction control method according to claim 1, characterized in that: The step of performing upsampling processing on the multiple frequency band downsampled audio signals after noise reduction to obtain multiple frequency band upsampled audio signals includes: Each of the noise-reduced frequency band down-sampled audio signals is respectively input into the up-sampling module for up-sampling processing to obtain multiple frequency band up-sampled audio signals; the up-sampling module is provided with an up-sampling frequency so that the frequency of the multiple frequency band up-sampled audio signals is the same as the frequency of the multiple frequency band audio signal data.

8. A noise reduction control device for an e-sports speaker based on noise elimination, characterized in that: Applied to a gaming speaker, the gaming speaker has a multi-channel 3D system and multiple microphone devices; the device comprises: Audio acquisition module: used for performing audio acquisition processing based on the multiple microphone devices provided on the gaming speaker to obtain the collected mixed audio signal data when the gaming speaker is applied in an online gaming scenario; Filter processing module: used for inputting the collected mixed audio signal data into a group of bandpass filters for filtering processing to obtain audio signal data of multiple frequency bands; A downsampling module: configured to perform downsampling rate conversion processing on each frequency band audio signal data of the plurality of frequency band audio signal data to obtain a plurality of frequency band downsampled audio signals; Noise elimination module: used for performing noise elimination processing on the multiple frequency band downsampled audio signals in sequence based on the noise elimination algorithm built into the e-sports speaker to obtain multiple frequency band downsampled audio signals after noise reduction; Upsampling module: used for upsampling the multiple frequency band downsampled audio signals after noise reduction to obtain multiple frequency band upsampled audio signals; The signal recombining module is used to recombine the multiple frequency band up-sampled audio signals according to the same time domain to generate combined audio signal data, where the combined audio signal data is noise reduction audio data.

9. An e-sports speaker, comprising a processor and a memory, characterized in that: The processor runs a computer program or code stored in the memory to implement the e-sports speaker noise reduction control method according to any one of claims 1 to 7.

10. A computer-readable storage medium for storing a computer program or code, characterized in that: When the computer program or code is executed by a processor, the e-sports speaker noise reduction control method as described in any one of claims 1 to 7 is implemented.

Images