Multi-channel digital audio signal processing method, equipment and medium

Abstract

The invention discloses a multi-channel digital audio signal processing method, equipment and a medium, relates to the technical field of audio signal processing, and solves the problem that an optimization result is difficult to quantitatively evaluate because current noise suppression lacks suppression of environmental noise and optimization of an audio signal lacks a quantitative standard. The method comprises the following steps: acquiring an audio signal output by audio source equipment, and converting the audio signal into a digital audio signal; performing noise suppression on the digital audio signal, and standardizing the digital audio signal after noise suppression; acquiring environment noise of an environment to which the audio source equipment belongs, and performing secondary optimization on the digital audio signal based on the environment noise; obtaining a noise source direction according to the environmental noise, and adjusting the output intensity of the audio signal based on the noise source direction; and converting the optimized digital audio signal into an audio signal, and outputting the audio signal through the audio source equipment, the audio signal output by the audio source equipment is dynamically optimized according to the environmental noise, and the optimization result is quantized.

Description

Technical Field

[0001] The present invention belongs to the technical field of audio signal processing, and in particular relates to a multi-channel digital audio signal processing method, device and medium. Background Art

[0002] A multi-channel digital audio signal is a data stream that contains multiple independent audio channels, each of which can transmit one or more audio signals. These channels can represent sound information from different audio sources, such as the left and right channels in stereo audio, or more complex systems such as 5.1 or 7.1 channel surround sound systems, where each channel transmits an independent audio signal. After these signals are converted to digital format, they are synchronously processed and transmitted in the processor to provide a richer and more spatial listening experience.

[0003] In the prior art, traditional noise suppression usually only focuses on removing background noise, lacks suppression of ambient noise, and cannot dynamically optimize the audio signal output by the audio source device according to the ambient noise. At the same time, the existing optimization of audio signals lacks quantitative standards, which makes it difficult to quantify and evaluate the optimization results. To this end, the present invention provides a multi-channel digital audio signal processing method, device and medium. Summary of the invention

[0004] The purpose of the present invention is to provide a multi-channel digital audio signal processing method, device and medium to solve the problems raised in the above background technology.

[0005] The technical problems to be solved by the present invention are: How to dynamically optimize the audio signal output by the audio source device according to the ambient noise and quantify the optimization results.

[0006] In order to achieve the above object, the present invention adopts the following technical solutions: A multi-channel digital audio signal processing method, the method is as follows: Step S1, obtaining an audio signal output by an audio source device, and converting the audio signal into a digital audio signal; Step S2, performing noise suppression on the digital audio signal, and standardizing the digital audio signal after noise suppression; Step S3, obtaining the environmental noise of the environment to which the audio source device belongs, and performing secondary optimization on the digital audio signal based on the environmental noise; Step S4, obtaining the direction of the noise source according to the ambient noise, and adjusting the output intensity of the audio signal based on the direction of the noise source; Step S5, converting the optimized digital audio signal into an audio signal, and outputting it through an audio source device.

[0007] Furthermore, the step S1 includes the following sub-steps: Step S11, setting the sampling rate corresponding to the audio signal of the audio source device to 40kHz, Step S12, acquiring an audio signal output by an audio source device, detecting the audio signal, detecting and obtaining an audio signal type corresponding to the audio signal, and setting a corresponding quantization bit depth based on the audio signal type; The audio signal types include microphone audio signals, instrument audio signals, and background sound effect audio signals; Step S13, quantizing the audio signal output by the audio source device to obtain a digital value corresponding to the audio signal, then encoding the digital value of the audio signal to obtain a binary number corresponding to the digital value of the audio signal, and integrating the binary numbers to obtain a digital audio signal corresponding to the audio signal.

[0008] Further, when the audio signal type is a microphone audio signal and a musical instrument audio signal, the quantization bit depth of the microphone audio signal and the musical instrument audio signal is set to 24-bit quantization; When the audio signal type is a background sound effect audio signal, the quantization bit depth of the background sound effect audio signal is set to 16-bit quantization.

[0009] Furthermore, the step S2 includes the following sub-steps: Step S21, performing noise suppression on the digital audio signal; Obtaining the amplitude value x(i) of any digital audio signal in the digital audio signal, where i is the sampling number when the digital audio signal is sampled, i=1, 2, ..., n, and n is a positive integer, and obtaining the weighting factor w(i) at the same time; wherein the weighting factor w(i) changes dynamically according to the value of the amplitude value x(i) of the digital audio signal; Step S22, calculating the output value of the digital audio signal by the formula y(i)=x(i)×w(i); Step S23, standardizing the digital audio signal, specifically: Traverse the output value y(i) of the digital audio signal to obtain the maximum output value max|y(i)| in the output value of the digital audio signal, and at the same time obtain the target amplitude z of the digital audio signal after standardization, and calculate the output value BZH(i) of the standardized digital audio signal through the formula. The specific formula is as follows: BZH(i)={y(i) / [max|y(i)|]}×z; where the target amplitude is the maximum amplitude that can be achieved after the digital audio signal is standardized, and the value range of the target amplitude is [-1, 1]; Step S24, converting the standardized digital audio signal into an audio signal, and calculating a first signal-to-noise ratio of the audio signal; If the first signal-to-noise ratio of the audio signal is greater than the first signal-to-noise ratio threshold, it is determined that the audio signal is qualified for standardization, and the next step is entered; If the first signal-to-noise ratio of the audio signal is less than or equal to the first signal-to-noise ratio threshold, it is determined that the standardization of the audio signal is unqualified, and the noise suppression and standardization steps are repeated.

[0010] Furthermore, the step S3 includes the following sub-steps: Step S31, placing a microphone in the environment to which the audio source device belongs, constructing a microphone array by using the microphone, collecting noise in the environment to which the audio source device belongs through the microphone, and analyzing the noise to obtain environmental noise; If the microphone array is collecting noise while the audio source device is outputting sound, the output sound of the audio source device is removed from the noise by using echo cancellation technology to obtain the ambient noise; Step S32, calculating an initial signal-to-noise ratio corresponding to the audio signal output by the audio source device, and using the initial signal-to-noise ratio as a second signal-to-noise ratio threshold of the audio signal; The initial signal-to-noise ratio corresponding to the audio signal output by the audio source device is a common signal-to-noise ratio of the ambient noise and the audio signal output by the audio source device.

[0011] Furthermore, the step S3 also includes the following sub-steps: Step S33, analyzing the environmental noise of the environment to which the audio source device belongs, and obtaining the type of environmental noise by analysis; The environmental noise is converted into a frequency domain signal by fast Fourier transform; When the frequency of the frequency domain signal belongs to the first frequency interval, determining that the type of environmental noise is high frequency noise; When the frequency of the frequency domain signal belongs to the second frequency interval, determining that the type of the environmental noise is low-frequency noise; The endpoint value of the first frequency interval is greater than the endpoint value of the second frequency interval, and the endpoint value of the second frequency interval is greater than zero; Step S34, converting the standardized audio signal into a digital audio signal again, and when the environmental noise type is high-frequency noise, suppressing the frequency of the high audio signal band in the standardized digital audio signal; When the environmental noise type is low-frequency noise, the frequency band of the low-frequency audio signal in the standardized digital audio signal is suppressed; Step S35, reconverting the frequency-suppressed digital audio signal into an audio signal, and calculating a second signal-to-noise ratio corresponding to the frequency-suppressed audio signal; If the second signal-to-noise ratio is greater than the second signal-to-noise ratio threshold, it is determined that the audio signal suppresses the ambient noise, and the process proceeds to the next step; If the second signal-to-noise ratio is greater than the second signal-to-noise ratio threshold, it is determined that the audio signal does not suppress the ambient noise, and the above optimization steps are repeated until the audio signal suppresses the ambient noise.

[0012] Furthermore, the step S4 includes the following sub-steps: Step S41, numbering the microphones in the microphone array, matching the environmental noise collected by all microphones in the microphone array with the microphone numbers according to the microphone numbers, and performing signal weighting on the environmental noise corresponding to the microphones according to the positions and directions of the microphones in the microphone array; Step S42, locating the direction of the noise source of the ambient noise by using the time delay difference of all microphones in the microphone array receiving the ambient noise; Step S43, obtaining the noise intensity ZSQj of the ambient noise at any time node, where j is the time node number, j=1, 2, ..., m, and m is a positive integer, traversing the noise intensity to obtain the maximum noise intensity ZSQo.

[0013] Furthermore, the step S4 further includes the following sub-steps: Step S44, reconvert the frequency suppressed audio signal into a digital audio signal, obtain the original output intensity ZYS of the left channel and the original output intensity YYS of the right channel in the digital audio signal of the audio source device, and calculate the first left channel increase intensity ZYZj and the first right channel increase intensity ZYYj required to be increased for the left channel and the right channel of the audio source device respectively by formulas, and the specific formulas are as follows: ZYZj=k×(ZSQj / ZSQo)×(ZYS-b), ZYYj=k×(ZSQj / ZSQo)×(YYS-b), where k is a fixed value adjustment coefficient and b is a constant used to control the minimum output intensity of the left and right channels; Step S45, obtaining the angle c between the noise source direction and the target listener, and calculating the left channel output intensity ZSCj and the right channel output intensity YSCj by formulas, the specific formulas are as follows: ZSCj=ZYS+{ZYZj×[1+cos(JD)]}, ZSCj=YYS+{ZYYj×[1+cos(JD)]}; Step S46, converting the digital audio signal into an audio signal, and calculating a third signal-to-noise ratio corresponding to the audio signal after the output intensity is adjusted; If the third signal-to-noise ratio is greater than the third signal-to-noise ratio threshold, it is determined that the output intensity is adjusted to suppress the environmental noise, and the next step is entered; If the third signal-to-noise ratio is less than or equal to the third signal-to-noise ratio threshold, it is determined that the adjusted output intensity does not suppress the ambient noise, and the above adjustment steps are repeated until the adjusted output intensity suppresses the ambient noise; The first signal-to-noise ratio threshold is smaller than the second signal-to-noise ratio threshold, and the second signal-to-noise ratio threshold is smaller than the third signal-to-noise ratio threshold.

[0014] In a second aspect, an electronic device includes: A memory storing a computer program; The processor is communicatively connected with the memory, and when the computer program is executed by the processor, a multi-channel digital audio signal processing method is implemented.

[0015] In a third aspect, a computer-readable storage medium stores a computer program, which implements a multi-channel digital audio signal processing method when executed by a processor.

[0016] In summary, due to the adoption of the above technical solution, the beneficial effects of the present invention are: The present invention first obtains an audio signal output by an audio source device, then converts the audio signal into a digital audio signal, performs noise suppression on the digital audio signal, standardizes the noise-suppressed digital audio signal, further obtains environmental noise of an environment to which the audio source device belongs, performs secondary optimization on the digital audio signal based on the environmental noise, finally obtains the direction of the noise source according to the environmental noise, adjusts the output intensity of the audio signal based on the direction of the noise source, converts the optimized digital audio signal into an audio signal, and outputs the audio signal through the audio source device. The present invention dynamically optimizes the audio signal output by the audio source device according to the environmental noise, and quantifies the optimization result. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to facilitate understanding by those skilled in the art, the present invention is further described below with reference to the accompanying drawings.

[0018] Figure 1 is the overall system block diagram of the present invention; Figure 2 is an example diagram of an environment to which an audio source device in the present invention belongs; Figure 3 This is an example diagram of the output intensity of the left and right channels of the audio source device before adjustment in the present invention; Figure 4 This is an example diagram of the output intensity of the left and right channels of the audio source device after adjustment in the present invention; Figure 5 It is a schematic diagram of the structure of the electronic device in the present invention. DETAILED DESCRIPTION

[0019] The technical solution of the present invention will be clearly and completely described below in conjunction with the embodiments. Obviously, the described embodiments are only part of the embodiments of the present invention, rather than all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0020] Example 1: Please refer to Figure 1-Figure 4 As shown, the technical solution provided by the present invention is: a multi-channel digital audio signal processing method, the method is used to: when there is noise in the environment where the audio source device is located, by optimizing the audio signal of the audio source device to reduce the interference of the noise on the target audience, the method is specifically as follows: Step S1, obtaining an audio signal output by an audio source device, and converting the audio signal into a digital audio signal; The audio source device is specifically an audio player, a synthesizer or a digital audio workstation, etc., which can connect 24 audio sources and output sound through 24 output channels; It should be specifically noted that the audio signal is sound data in the form of an electrical signal directly emitted by an audio source device, and is an analog signal, such as an analog voltage signal output through an audio interface; In this embodiment, step S1 includes the following sub-steps: Step S11, setting the sampling rate corresponding to the audio signal of the audio source device to 40kHz; It should be specifically noted that, in this embodiment, the frequency response of the digital audio signal finally output by the audio source device is between 20 Hz and 20 kHz ± 0.5 dB, and according to the Nyquist theorem, the sampling rate of the audio signal is 40 Hz; Step S12, acquiring an audio signal output by an audio source device, detecting the audio signal, detecting and obtaining an audio signal type corresponding to the audio signal, and setting a corresponding quantization bit depth based on the audio signal type; It should be specifically noted that identifying the corresponding audio signal type through an audio signal is a prior art, and the audio signal type of an audio signal can be determined through the frequency spectrum characteristics, dynamic range and time domain characteristics of the audio signal; The audio signal types include microphone audio signals, instrument audio signals, and background sound effect audio signals; Specifically, when the audio signal type is a microphone audio signal or a musical instrument audio signal, the quantization bit depth of the microphone audio signal and the musical instrument audio signal is set to 24-bit quantization; When the audio signal type is a background sound effect audio signal, the quantization bit depth of the background sound effect audio signal is set to 16-bit quantization; Step S13, quantizing the audio signal output by the audio source device to obtain a digital value corresponding to the audio signal, then encoding the digital value of the audio signal to obtain a binary number corresponding to the digital value of the audio signal, and integrating the binary numbers to obtain a digital audio signal corresponding to the audio signal.

[0021] Step S2, performing noise suppression on the digital audio signal, and standardizing the digital audio signal after noise suppression; In this embodiment, step S2 includes the following sub-steps: Step S21, performing noise suppression on the digital audio signal; Further, the amplitude value x(i) of any digital audio signal in the digital audio signal is obtained, where i is a sampling number when the digital audio signal is sampled, i=1, 2, ..., n, and n is a positive integer, and a weighting factor w(i) is obtained at the same time; Wherein, the weighting factor w(i) changes dynamically according to the value of the amplitude value x(i) of the digital audio signal; Step S22, calculating the output value of the digital audio signal by the formula y(i)=x(i)×w(i); Step S23, standardizing the digital audio signal, specifically: Traverse the output value y(i) of the digital audio signal to obtain the maximum output value max|y(i)| in the output value of the digital audio signal, and at the same time obtain the target amplitude z of the digital audio signal after standardization, and calculate the output value BZH(i) of the standardized digital audio signal through the formula. The specific formula is as follows: BZH(i)={y(i) / [max|y(i)|]}×z; The target amplitude is the maximum amplitude that can be achieved after the digital audio signal is standardized, and the value range of the target amplitude is [-1, 1]; Step S24, converting the standardized digital audio signal into an audio signal, and calculating a first signal-to-noise ratio of the audio signal; If the first signal-to-noise ratio of the audio signal is greater than the first signal-to-noise ratio threshold, it is determined that the audio signal is qualified for standardization, and the next step is entered; If the first signal-to-noise ratio of the audio signal is less than or equal to the first signal-to-noise ratio threshold, it is determined that the standardization of the audio signal is unqualified, and the noise suppression and standardization steps are repeated.

[0022] Step S3, obtaining the environmental noise of the environment to which the audio source device belongs, and performing secondary optimization on the digital audio signal based on the environmental noise; In this embodiment, step S3 includes the following sub-steps: Step S31, placing a microphone in the environment to which the audio source device belongs, constructing a microphone array by using the microphone, collecting noise in the environment to which the audio source device belongs through the microphone, and analyzing the noise to obtain environmental noise; Specifically, if the microphone array is collecting noise while the audio source device is outputting sound, the output sound of the audio source device is removed from the noise by using echo cancellation technology to obtain the ambient noise; It should be specifically noted that the echo cancellation technology is an existing technology. The echo cancellation compares the output sound of the audio source device with the noise received by the microphone array, calculates the output sound of the audio source device as the echo, and records the noise after the echo is removed as the environmental noise; Step S32, calculating an initial signal-to-noise ratio corresponding to the audio signal output by the audio source device, and using the initial signal-to-noise ratio as a second signal-to-noise ratio threshold of the audio signal; The initial signal-to-noise ratio corresponding to the audio signal output by the audio source device is the common signal-to-noise ratio of the ambient noise and the audio signal output by the audio source device; It should be specifically noted that the signal-to-noise ratio can be calculated using spectrum analysis tools; Step S33, analyzing the environmental noise of the environment to which the audio source device belongs, and obtaining the type of environmental noise by analysis; Specifically, the environmental noise is converted into a frequency domain signal by fast Fourier transform; When the frequency of the frequency domain signal belongs to the first frequency interval, determining that the type of environmental noise is high frequency noise; When the frequency of the frequency domain signal belongs to the second frequency interval, determining that the type of the environmental noise is low-frequency noise; The endpoint value of the first frequency interval is greater than the endpoint value of the second frequency interval, and the endpoint value of the second frequency interval is greater than zero; It should be specifically noted that the frequency domain signal is used to display the amplitude of the audio signal at different frequencies and the energy distribution of the audio signal at each frequency; Step S34, converting the standardized audio signal into a digital audio signal again, and when the environmental noise type is high-frequency noise, suppressing the frequency of the high audio signal band in the standardized digital audio signal; When the environmental noise type is low-frequency noise, the frequency band of the low-frequency audio signal in the standardized digital audio signal is suppressed; Step S35, reconverting the frequency-suppressed digital audio signal into an audio signal, and calculating a second signal-to-noise ratio corresponding to the frequency-suppressed audio signal; If the second signal-to-noise ratio is greater than the second signal-to-noise ratio threshold, it is determined that the audio signal suppresses the ambient noise, and the process proceeds to the next step; If the second signal-to-noise ratio is greater than the second signal-to-noise ratio threshold, it is determined that the audio signal does not suppress the environmental noise, and the above optimization steps are repeated until the audio signal suppresses the environmental noise.

[0023] Step S4, such as Figure 2-Figure 4 As shown, the direction of the noise source is obtained according to the ambient noise, and the output intensity of the audio signal is adjusted based on the direction of the noise source; In this embodiment, step S4 includes the following sub-steps: Step S41, numbering the microphones in the microphone array, matching the environmental noise collected by all microphones in the microphone array with the microphone numbers according to the microphone numbers, and performing signal weighting on the environmental noise corresponding to the microphones according to the positions and directions of the microphones in the microphone array; The ambient noise corresponding to the microphone is weighted to enhance the signal in the noise direction and weaken the signal in the non-noise direction; Step S42, locating the direction of the noise source of the ambient noise by using the time delay difference of all microphones in the microphone array receiving the ambient noise; For example, in Figure 2 In the figure, A, B, C, D, E and F are microphones placed in the room, forming a microphone array. When there is ambient noise emitted from the east direction, microphone A and microphone B receive the ambient noise at the same time, microphone C and microphone D receive the ambient noise secondly, and microphone E and microphone F receive the ambient noise last. The time delay difference of each microphone receiving the ambient noise is calculated, and the noise source direction of the ambient noise is obtained through the time delay difference. Step S43, obtaining the noise intensity ZSQj of the environmental noise at any time node, where j is the number of the time node, j=1, 2, ..., m, and m is a positive integer, traversing the noise intensity to obtain the maximum noise intensity ZSQo; Step S44, reconvert the frequency suppressed audio signal into a digital audio signal, obtain the original output intensity ZYS of the left channel and the original output intensity YYS of the right channel in the digital audio signal of the audio source device, and calculate the first left channel increase intensity ZYZj and the first right channel increase intensity ZYYj required to be increased for the left channel and the right channel of the audio source device respectively by formulas, and the specific formulas are as follows: ZYZj=k×(ZSQj / ZSQo)×(ZYS-b); ZYYj=k×(ZSQj / ZSQo)×(YYS-b); where k is a fixed value adjustment coefficient and b is a constant used to control the minimum output intensity of the left and right channels; It should be specifically noted that, in this embodiment, the output of the audio source device consists of a left channel and a right channel, and the output intensity of the left channel and the output intensity of the right channel can be freely adjusted; Step S45, obtaining the angle c between the noise source direction and the target listener, and calculating the left channel output intensity ZSCj and the right channel output intensity YSCj by formulas, the specific formulas are as follows: ZSCj=ZYS+{ZYZj×[1+cos(JD)]}; ZSCj=YYS+{ZYYj×[1+cos(JD)]}; Step S46, converting the digital audio signal into an audio signal, and calculating a third signal-to-noise ratio corresponding to the audio signal after the output intensity is adjusted; If the third signal-to-noise ratio is greater than the third signal-to-noise ratio threshold, it is determined that the output intensity is adjusted to suppress the environmental noise, and the next step is entered; If the third signal-to-noise ratio is less than or equal to the third signal-to-noise ratio threshold, it is determined that the adjusted output intensity does not suppress the ambient noise, and the above adjustment steps are repeated until the adjusted output intensity suppresses the ambient noise; The first signal-to-noise ratio threshold is smaller than the second signal-to-noise ratio threshold, and the second signal-to-noise ratio threshold is smaller than the third signal-to-noise ratio threshold.

[0024] Step S5, converting the optimized digital audio signal into an audio signal, and outputting it through an audio source device.

[0025] In this application, if corresponding calculation formulas appear, the above calculation formulas are all dimensionless and take their numerical calculations. The weight coefficients, proportional coefficients and other coefficients in the formulas are set to a result value obtained by quantifying each parameter. The size of the weight coefficient and the proportional coefficient can be determined as long as it does not affect the proportional relationship between the parameter and the result value.

[0026] Embodiment 2: Figure 5 An example of a structural diagram of an electronic device is shown in FIG. Figure 5As shown, the electronic device may include: a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus. The processor may call the logic instructions in the memory to execute a multi-channel digital audio signal processing method, the method comprising: obtaining an audio signal output by an audio source device, converting the audio signal into a digital audio signal; performing noise suppression on the digital audio signal, and standardizing the digital audio signal after noise suppression; obtaining the ambient noise of the environment to which the audio source device belongs, and performing secondary optimization on the digital audio signal based on the ambient noise; obtaining the direction of the noise source according to the ambient noise, and adjusting the output strength of the audio signal based on the direction of the noise source; converting the optimized digital audio signal into an audio signal, and outputting it through the audio source device.

[0027] In addition, the logic instructions in the above-mentioned memory can be implemented in the form of software functional units and can be stored in a computer-readable storage medium when sold or used as an independent product. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc. Various media that can store program codes.

[0028] On the other hand, the present application also provides a computer program product, which includes a computer program stored on a computer-readable storage medium, and the computer program includes program instructions. When the program instructions are executed by a computer, the computer can execute a multi-channel digital audio signal processing method provided by the above methods, the method including: obtaining an audio signal output by an audio source device, and converting the audio signal into a digital audio signal; performing noise suppression on the digital audio signal, and standardizing the digital audio signal after noise suppression; obtaining the ambient noise of the environment to which the audio source device belongs, and performing secondary optimization on the digital audio signal based on the ambient noise; obtaining the direction of the noise source based on the ambient noise, and adjusting the output intensity of the audio signal based on the direction of the noise source; converting the optimized digital audio signal into an audio signal, and outputting it through the audio source device.

[0029] On the other hand, the present application also provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, is implemented to execute a multi-channel digital audio signal processing method provided above, the method comprising: obtaining an audio signal output by an audio source device, and converting the audio signal into a digital audio signal; performing noise suppression on the digital audio signal, and standardizing the digital audio signal after noise suppression; obtaining ambient noise of an environment to which the audio source device belongs, and performing secondary optimization on the digital audio signal based on the ambient noise; obtaining a noise source direction based on the ambient noise, and adjusting the output intensity of the audio signal based on the noise source direction; converting the optimized digital audio signal into an audio signal, and outputting it through the audio source device.

[0030] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0031] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0032] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A multi-channel digital audio signal processing method, characterized in that: Here’s how: Step S1, obtaining an audio signal output by an audio source device, and converting the audio signal into a digital audio signal; Step S2, performing noise suppression on the digital audio signal, and standardizing the digital audio signal after noise suppression; Step S3, obtaining the environmental noise of the environment to which the audio source device belongs, and performing secondary optimization on the digital audio signal based on the environmental noise; Step S4, obtaining the direction of the noise source according to the ambient noise, and adjusting the output intensity of the audio signal based on the direction of the noise source; Step S5, converting the optimized digital audio signal into an audio signal, and outputting it through an audio source device.

2. A multi-channel digital audio signal processing method according to claim 1, characterized in that: The step S1 includes the following sub-steps: Step S11, setting the sampling rate corresponding to the audio signal of the audio source device to 40kHz, Step S12, acquiring an audio signal output by an audio source device, detecting the audio signal, detecting and obtaining an audio signal type corresponding to the audio signal, and setting a corresponding quantization bit depth based on the audio signal type; The audio signal types include microphone audio signals, instrument audio signals and background sound effect audio signals; Step S13, quantizing the audio signal output by the audio source device to obtain a digital value corresponding to the audio signal, then encoding the digital value of the audio signal to obtain a binary number corresponding to the digital value of the audio signal, and integrating the binary numbers to obtain a digital audio signal corresponding to the audio signal.

3. A multi-channel digital audio signal processing method according to claim 2, characterized in that: When the audio signal type is a microphone audio signal or a musical instrument audio signal, the quantization bit depth of the microphone audio signal and the musical instrument audio signal is set to 24-bit quantization; When the audio signal type is a background sound effect audio signal, the quantization bit depth of the background sound effect audio signal is set to 16-bit quantization.

4. A multi-channel digital audio signal processing method according to claim 1, characterized in that: The step S2 includes the following sub-steps: Step S21, performing noise suppression on the digital audio signal; Obtaining the amplitude value x(i) of any digital audio signal in the digital audio signal, where i is the sampling number when the digital audio signal is sampled, i=1, 2, ..., n, and n is a positive integer, and obtaining the weighting factor w(i) at the same time; wherein the weighting factor w(i) changes dynamically according to the value of the amplitude value x(i) of the digital audio signal; Step S22, calculating the output value of the digital audio signal by the formula y(i)=x(i)×w(i); Step S23, standardizing the digital audio signal, specifically: Traverse the output value y(i) of the digital audio signal to obtain the maximum output value max|y(i)| in the output value of the digital audio signal, and at the same time obtain the target amplitude z of the digital audio signal after standardization, and calculate the output value BZH(i) of the standardized digital audio signal through the formula. The specific formula is as follows: BZH(i)={y(i) / [max|y(i)|]}×z; where the target amplitude is the maximum amplitude that can be achieved after the digital audio signal is standardized, and the value range of the target amplitude is [-1, 1]; Step S24, converting the standardized digital audio signal into an audio signal, and calculating a first signal-to-noise ratio of the audio signal; If the first signal-to-noise ratio of the audio signal is greater than the first signal-to-noise ratio threshold, it is determined that the audio signal is qualified for standardization, and the next step is entered; If the first signal-to-noise ratio of the audio signal is less than or equal to the first signal-to-noise ratio threshold, it is determined that the standardization of the audio signal is unqualified, and the noise suppression and standardization steps are repeated.

5. A multi-channel digital audio signal processing method according to claim 1, characterized in that: The step S3 includes the following sub-steps: Step S31, placing a microphone in the environment to which the audio source device belongs, constructing a microphone array by using the microphone, collecting noise in the environment to which the audio source device belongs through the microphone, and analyzing the noise to obtain environmental noise; If the microphone array is collecting noise while the audio source device is outputting sound, the output sound of the audio source device is removed from the noise by using echo cancellation technology to obtain the ambient noise; Step S32, calculating an initial signal-to-noise ratio corresponding to the audio signal output by the audio source device, and using the initial signal-to-noise ratio as a second signal-to-noise ratio threshold of the audio signal; The initial signal-to-noise ratio corresponding to the audio signal output by the audio source device is a common signal-to-noise ratio of the ambient noise and the audio signal output by the audio source device.

6. A multi-channel digital audio signal processing method according to claim 5, characterized in that: The step S3 also includes the following sub-steps: Step S33, analyzing the environmental noise of the environment to which the audio source device belongs, and obtaining the type of environmental noise by analysis; The environmental noise is converted into a frequency domain signal by fast Fourier transform; When the frequency of the frequency domain signal belongs to the first frequency interval, determining that the type of environmental noise is high frequency noise; When the frequency of the frequency domain signal belongs to the second frequency interval, determining that the type of the environmental noise is low-frequency noise; The endpoint value of the first frequency interval is greater than the endpoint value of the second frequency interval, and the endpoint value of the second frequency interval is greater than zero; Step S34, converting the standardized audio signal into a digital audio signal again, and when the environmental noise type is high-frequency noise, suppressing the frequency of the high audio signal band in the standardized digital audio signal; When the environmental noise type is low-frequency noise, the frequency band of the low-frequency audio signal in the standardized digital audio signal is suppressed; Step S35, reconverting the frequency-suppressed digital audio signal into an audio signal, and calculating a second signal-to-noise ratio corresponding to the frequency-suppressed audio signal; If the second signal-to-noise ratio is greater than the second signal-to-noise ratio threshold, it is determined that the audio signal suppresses the ambient noise, and the process proceeds to the next step; If the second signal-to-noise ratio is greater than the second signal-to-noise ratio threshold, it is determined that the audio signal does not suppress the ambient noise, and the above optimization steps are repeated until the audio signal suppresses the ambient noise.

7. A multi-channel digital audio signal processing method according to claim 1, characterized in that: The step S4 includes the following sub-steps: Step S41, numbering the microphones in the microphone array, matching the environmental noise collected by all microphones in the microphone array with the microphone numbers according to the microphone numbers, and performing signal weighting on the environmental noise corresponding to the microphones according to the positions and directions of the microphones in the microphone array; Step S42, locating the direction of the noise source of the ambient noise by using the time delay difference of all microphones in the microphone array receiving the ambient noise; Step S43, obtaining the noise intensity ZSQj of the ambient noise at any time node, where j is the number of the time node, j=1, 2, ..., m, and m is a positive integer, traversing the noise intensity to obtain the maximum noise intensity ZSQo.

8. A multi-channel digital audio signal processing method according to claim 7, characterized in that: The step S4 further comprises the following sub-steps: Step S44, reconvert the frequency suppressed audio signal into a digital audio signal, obtain the original output intensity ZYS of the left channel and the original output intensity YYS of the right channel in the digital audio signal of the audio source device, and calculate the first left channel increase intensity ZYZj and the first right channel increase intensity ZYYj required to be increased for the left channel and the right channel of the audio source device respectively by formulas, and the specific formulas are as follows: ZYZj=k×(ZSQj / ZSQo)×(ZYS-b), ZYYj=k×(ZSQj / ZSQo)×(YYS-b), where k is a fixed value adjustment coefficient and b is a constant used to control the minimum output intensity of the left and right channels; Step S45, obtaining the angle c between the noise source direction and the target listener, and calculating the left channel output intensity ZSCj and the right channel output intensity YSCj by formulas, the specific formulas are as follows: ZSCj=ZYS+{ZYZj×[1+cos(JD)]}, ZSCj=YYS+{ZYYj×[1+cos(JD)]}; Step S46, converting the digital audio signal into an audio signal, and calculating a third signal-to-noise ratio corresponding to the audio signal after the output intensity is adjusted; If the third signal-to-noise ratio is greater than the third signal-to-noise ratio threshold, it is determined that the output intensity is adjusted to suppress the environmental noise, and the next step is entered; If the third signal-to-noise ratio is less than or equal to the third signal-to-noise ratio threshold, it is determined that the adjusted output intensity does not suppress the ambient noise, and the above adjustment steps are repeated until the adjusted output intensity suppresses the ambient noise; The first signal-to-noise ratio threshold is smaller than the second signal-to-noise ratio threshold, and the second signal-to-noise ratio threshold is smaller than the third signal-to-noise ratio threshold.

9. An electronic device, characterized in that: The electronic device comprises: A memory storing a computer program; A processor is communicatively connected to the memory, and when the computer program is executed by the processor, the method described in any one of claims 1 to 8 is implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 8 is implemented.

Images