Audio processing method and electronic equipment

Abstract

The embodiment of the invention provides an audio processing method and electronic equipment, and is applied to the technical field of audio data processing. The audio processing method comprises the steps that a first audio signal is input, and the first audio signal comprises a data audio signal and a howling noise signal; the frequency of the howling noise signal is higher than that of the data audio signal. Obtaining a first reference signal according to the first audio signal; the frequency difference between the first reference signal and the howling noise signal is smaller than a first value. Forming an adaptive wave trap based on an FIR filter, taking the first reference signal as a benchmark reference signal of the adaptive wave trap, and performing wave trapping algorithm processing on the first audio signal to obtain a second audio signal; the second audio signal includes a data audio signal. According to the embodiment of the invention, the adaptive wave trap is formed through the FIR filter, the nonlinear phase distortion caused by a traditional wave trap is avoided, and the processing precision of the howling noise signal is improved.

Description

Technical Field

[0001] The present application relates to the technical field of audio data processing, and in particular to an audio processing method and electronic device. Background Art

[0002] Voice intercom means that the local device obtains the local audio, generates an uplink audio signal and transmits it to the remote device, obtains the downlink audio signal transmitted by the remote device online or from the storage, processes the downlink audio signal to obtain the live audio on the remote side, and then plays the live audio on the remote side. Voice intercom can be achieved by the local device and the remote device interacting with the uplink and downlink audio signals. However, in actual applications, the collection and playback of live audio will inevitably produce acoustic feedback. Acoustic feedback refers to: when collecting live audio, because the audio is being played at the same time, the played audio will be collected together, and then the collected live audio will be played again. The subsequent audio will be collected again, and this cycle will be repeated to form a positive feedback loop. In this positive feedback loop, when the collected audio signal meets certain amplitude balance conditions and phase balance conditions, self-excited oscillation will be formed in the audio signal, that is, a howling audio signal will be generated. When playing this audio signal, the user will hear a relatively regular and harsh interference noise. In two-way voice intercom, this acoustic feedback phenomenon will be more obvious.

[0003] One way to optimize the acoustic feedback phenomenon is to perform algorithm processing on the uplink audio signal to remove the howling noise signal in the uplink audio signal. However, in actual applications, the processing accuracy of the howling noise signal is low and the playback effect is poor. Summary of the invention

[0004] The embodiments of the present application provide an audio processing method and an electronic device, which improve the processing accuracy of a howling noise signal.

[0005] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions:

[0006] In a first aspect, an audio processing method is provided, the method comprising: inputting a first audio signal. The first audio signal comprises a data audio signal and a howling noise signal. The howling noise signal is an interference signal whose frequency is higher than the frequency of the data audio signal. A first reference signal is obtained according to the first audio signal. The frequency difference between the first reference signal and the howling noise signal is less than a first value. An adaptive notch filter is formed based on an FIR filter, the first reference signal is used as a reference reference signal of the adaptive notch filter, and a notch algorithm is performed on the first audio signal to obtain a second audio signal. The second audio signal comprises a data audio signal.

[0007] In the embodiment of the present application, an adaptive notch filter is formed by using an FIR filter, and a first reference signal is obtained by calculating a howling noise signal, and the first reference signal is used as a reference reference signal for the adaptive notch filter to perform notch processing, thereby achieving real-time and accurate notch filtering of the howling noise signal in the first audio signal. Compared with using an IIR notch filter to perform notch processing on the first audio signal, the adaptive notch filter formed by the FIR filter does not produce nonlinear phase distortion. At the same time, based on the first reference signal as the reference reference signal for notch processing, the reliability and accuracy of filtering the howling noise signal can be improved.

[0008] In a possible implementation, the above-mentioned obtaining of the first reference signal according to the first audio signal includes: sampling and detecting the first audio signal to obtain at least one sample noise signal. The frequency value of at least one sample noise signal is less than the first frequency value. The first reference signal is obtained according to the at least one sample noise signal. In the audio processing method described in the embodiment of the present application, noise signals greater than or equal to the first frequency value are not processed. Because in practical applications, the human ear is not sensitive to these high-frequency noise signals. The embodiment of the present application can reduce the amount of data processing and the demand for computing power by not processing noise signals of the first frequency value and above. At the same time, the efficiency and timeliness of the operation are also improved.

[0009] In a possible implementation, the sampling detection processing of the first audio signal to obtain at least one sample noise signal includes: based on the fast Fourier transform algorithm, performing a first sampling detection processing on the first audio signal to obtain at least one initial sample noise signal. Based on the scaling fast Fourier transform algorithm, performing a second sampling detection processing on the first audio signal corresponding to the first initial sample noise signal to obtain at least one sample noise signal. The first initial sample noise signal is an initial sample noise signal whose frequency is less than the first frequency value in the initial sample noise signal. In an embodiment of the present application, after the first audio signal is subjected to the first sampling detection processing (i.e., coarse sampling) by using the FFT algorithm, the detected noise signal is subjected to the second sampling detection processing (i.e., fine detection) by using the ZFFT algorithm. Compared with the refined fine detection by using the CZT algorithm, the ZFFT algorithm has a lower computational load and a faster computational speed. And when only the noise signal below the first frequency value is subjected to refined fine detection by the ZFFT algorithm, the first reference signal can be sampled quickly, timely and accurately on the basis of a smaller computational load.

[0010] In a possible implementation, the duration of any sample noise signal in at least one sample noise signal is greater than the first duration. In the embodiment of the present application, the howling noise signal generally has a certain duration. Therefore, when performing sampling detection processing based on the FFT algorithm, the sample noise signal can be screened by duration. For example, the first duration is 3 signal frame lengths.

[0011] In a possible implementation, any of the at least one sample noise signal is a sample noise signal whose noise duration is greater than the first duration and less than the second duration. The first duration is less than the second duration. In the embodiment of the present application, it is necessary to filter the howling noise signal in real time. If the data processing time is long, it will affect the filtering effect of the howling noise signal. Therefore, when selecting the sample noise signal, it is necessary to generate the corresponding sample noise signal in time for subsequent data processing, so when the duration reaches a certain duration, it is necessary to generate the corresponding sample noise signal. For example, the second duration is 5 signal frame lengths.

[0012] In a possible implementation, the method further includes: obtaining the frequency value of the bottom noise of the first audio signal. Determine the sampling frequency threshold of the sampling detection processing according to the frequency value of the bottom noise. In an embodiment of the present application, when the audio processing method is applied to different scenarios, the background sounds and the like of different scenarios are different. Then the collected audio will also be different, so that the bottom noise is also different. In addition, in different application scenarios, device parameters and the like will also have certain changes, so that the bottom noise of the collected audio signal is also different. Therefore, in different application scenarios, the size of the bottom noise of the uplink audio signal and the downlink audio signal is different. To obtain the accuracy and reliability of the sample noise signal, and to ensure the audio quality as much as possible while accurately filtering out the howling noise signal, in actual applications, it is necessary to determine the sampling frequency threshold according to the frequency value of the bottom noise.

[0013] In a possible implementation, the first audio signal is a downlink audio data signal. The method further includes: collecting an uplink audio data signal and performing frequency shift processing on the uplink audio data signal. The frequency shift amplitude of the frequency shift processing is randomly selected within the first frequency shift amplitude range. In an embodiment of the present application, when the first audio signal is a downlink audio signal, it represents that the above-mentioned detection operation of the howling noise signal and the filtering operation of the howling noise signal both occur after receiving the downlink audio signal sent by the remote end. After receiving the downlink audio signal, data processing can be performed directly, or it can be stored in a memory, and then the downlink audio signal is read out from the memory and data processing is performed. After filtering the howling noise signal of the downlink audio signal, a second audio signal is obtained. At this time, the second audio signal is a downlink audio signal from which the howling noise signal has been filtered out. The downlink audio signal from which the howling noise signal has been filtered out can be sent to a player for playback. When the first audio signal is a downlink audio signal, the amount of data processing in the process of filtering out the howling noise signal is less, the processing accuracy is higher, and the processing speed is also faster. By performing frequency shift processing on the uplink audio signal, in the embodiment of the present application, in the process of filtering out the howling noise signal on the downlink audio signal, the uplink audio signal can also be randomly shifted by a certain amplitude before being sent to the remote end. Through the random frequency shift operation, the generation of new howling noise signals can be suppressed to a certain extent on the basis of processing the howling noise signal. And the frequency shift operation of the embodiment of the present application is based on a random frequency shift amplitude. Compared with the frequency shift processing based on a fixed amplitude, the frequency shift processing with a fixed amplitude may fail in some scenarios. In the early stage of the processing of the adaptive notch filter, a certain amount of howling noise signals will remain due to the failure of data processing to converge. The frequency shift processing with a random amplitude can destroy the generation conditions of the howling noise signal to avoid the residual howling noise signal from continuing to interfere with the voice intercom and avoid the generation of new howling noise signals. Exemplarily, a random function can be written at the software level to confirm the specific frequency amplitude of each frequency shift through a random function.

[0014] In a possible implementation, the method further includes: performing pre-playing pre-processing on the second audio signal. The pre-playing pre-processing includes at least one of the following processes: echo cancellation processing, speech noise reduction processing, automatic gain control processing, resampling processing, high-pass filtering processing, and gain adjustment processing. In the embodiment of the present application, the pre-playing pre-processing operation can improve the playback quality of the downlink audio signal being played.

[0015] In a possible implementation, the first audio signal is an uplink audio data signal. The method further includes: performing frequency shift processing on the first audio signal; the frequency shift amplitude of the frequency shift processing is randomly selected within the first frequency shift amplitude range. In an embodiment of the present application, when the first audio signal is an uplink audio signal, it represents that the above-mentioned detection operation of the howling noise signal and the filtering operation of the howling noise signal both occur in the stage of processing the uplink audio signal. At this time, after filtering the howling noise signal of the uplink audio signal, a second audio signal is obtained. The second audio signal is the uplink audio signal from which the howling noise signal is filtered out. The uplink audio signal from which the howling noise signal is filtered out can be sent to the remote end. However, in some application scenarios, the microphone for collecting the uplink audio signal may be a multi-microphone sound receiving structure, for example, some network cameras are dual-microphone sound receiving structures including a left channel and a right channel. At this time, the amount of data processing for filtering out the howling noise signal at the uplink audio signal will be large. In an embodiment of the present application, after filtering out the howling noise signal from the uplink audio signal, the uplink audio signal is randomly shifted by a certain amplitude before being sent to the remote end. Through the random frequency shift operation, the generation of new howling noise signals can be suppressed to a certain extent on the basis of processing the howling noise signal. Moreover, the frequency shift operation of the embodiment of the present application is based on a random frequency shift amplitude. Compared with the frequency shift processing based on a fixed amplitude, the frequency shift processing with a fixed amplitude may fail in some scenarios. In the early stage of the processing of the adaptive notch filter, a certain amount of howling noise signals will remain due to the failure of data processing to converge. The frequency shift processing with a random amplitude can destroy the generation conditions of the howling noise signal to avoid the residual howling noise signal from continuing to interfere with the voice intercom and avoid the generation of new howling noise signals. Exemplarily, a random function can be written at the software level to confirm the specific frequency amplitude of each frequency shift through a random function.

[0016] In a second aspect, an embodiment of the present application further provides an electronic device, which includes a sound pickup, a chip system, and a player. The chip system is coupled to the sound pickup and the player, respectively. The chip system is used to: in the process of interactive processing of uplink audio signals and downlink audio signals with a remote device, process a first audio signal based on the audio processing method described in the first aspect above; the first audio signal is an uplink audio signal, or the first audio signal is a downlink audio signal.

[0017] In a third aspect, an embodiment of the present application further provides a computer-readable storage medium, the computer-readable storage medium comprising instructions. When the instructions are executed on the electronic device as described in the second aspect, the electronic device executes the audio processing method as described in the first aspect.

[0018] For the description of the technical principles and beneficial effects of the second and third aspects, please refer to the relevant description of the first aspect, which will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 A schematic diagram of the principle of producing acoustic feedback phenomenon;

[0020] Figure 2 A schematic diagram of the structure of a voice intercom system provided in an embodiment of the present application;

[0021] Figure 3 A schematic diagram of the structure of a first electronic device provided in an embodiment of the present application;

[0022] Figure 4 A schematic diagram of the principle of acoustic feedback generated by the interaction between a first electronic device and a second electronic device provided in an embodiment of the present application;

[0023] Figure 5 A schematic flow chart of a first audio processing method provided in an embodiment of the present application;

[0024] Figure 6 A waveform diagram of a howling noise signal provided in an embodiment of the present application;

[0025] Figure 7 A method provided in the embodiment of the present application Figure 6 The spectrogram of the howling noise signal shown;

[0026] Figure 8 A schematic flow chart of a second audio processing method provided in an embodiment of the present application;

[0027] Fig. 9 A schematic flow chart of a third audio processing method provided in an embodiment of the present application;

[0028] Fig.10 A schematic flow chart of a fourth audio processing method provided in an embodiment of the present application;

[0029] Fig.11 A schematic flow chart of another fourth audio processing method provided in an embodiment of the present application;

[0030] Fig.12 A waveform diagram of a data audio signal provided in an embodiment of the present application;

[0031] Fig.13 A waveform diagram of another howling noise signal provided in an embodiment of the present application;

[0032] Fig.14 A spectrum diagram of a data audio signal provided in an embodiment of the present application;

[0033] Fig.15 A spectrum diagram of a howling noise signal provided in an embodiment of the present application;

[0034] Fig.16 A schematic diagram of a ZFFT algorithm-based fine sampling refinement provided in an embodiment of the present application;

[0035] Fig.17 A waveform diagram of a 5Hz frequency shift of an uplink audio signal provided in an embodiment of the present application;

[0036] Fig.18 A method provided in the embodiment of the present application Fig.17 Spectrogram of the uplink audio signal shown;

[0037] Fig.19 A waveform diagram of a 7 Hz frequency shift of an uplink audio signal provided in an embodiment of the present application;

[0038] Fig. 20 A method provided in the embodiment of the present application Fig.19 Spectrogram of the uplink audio signal shown;

[0039] Fig.21 A schematic diagram of a processing flow of a chip system provided in an embodiment of the present application;

[0040] Fig. 22 A schematic diagram of a module for processing a downlink audio signal provided in an embodiment of the present application;

[0041] Fig.23 A schematic diagram of the working principle of an adaptive notch filter provided in an embodiment of the present application. DETAILED DESCRIPTION

[0042] It should be noted that the terms "first", "second", etc. involved in the embodiments of the present application are only used to distinguish features of the same type and cannot be understood as indicating relative importance, quantity, order, etc.

[0043] The terms "exemplary" or "for example" and the like in the embodiments of the present application are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of the terms "exemplary" or "for example" is intended to present the related concepts in a specific way.

[0044] The terms "coupling" and "connection" involved in the embodiments of the present application should be understood in a broad sense. For example, they may refer to a direct physical connection, or an indirect connection achieved through electronic devices, such as a connection achieved through resistors, inductors, capacitors or other electronic devices.

[0045] First, some basic concepts involved in the embodiments of the present application are explained:

[0046] Acoustic feedback phenomena, such as Figure 1 As shown in the figure, when collecting live audio, the played audio will be collected at the same time because the audio is being played at the same time. Then the collected live audio will be played again. The audio played later will be collected again. This cycle repeats, forming a positive feedback loop. In this positive feedback loop, when the collected audio signal meets certain amplitude balance conditions and phase balance conditions, self-oscillation will be formed in the audio signal, that is, a howling audio signal will be generated. When playing this audio signal, the user will hear a more regular and harsh interference noise.

[0047] Oscillating flanger means that when the frequency shift processing is performed on the collected or played audio signal, the frequency of the continuous audio signal before and after the frequency shift will "flow" to the peak point of the room, and the peak point will cause acoustic feedback. In the subsequent repeated frequency shift process, the previous oscillation echo will inevitably be caused within the frequency shift cycle. Because electronic equipment continuously performs frequency shift processing in the process of collecting audio signals or processing audio signals to be played, the frequency of audio signals that were not originally at the peak point will also oscillate.

[0048] Beat frequency refers to the situation that the vibration frequencies (or simply referred to as frequencies) of two signals doing simple harmonic oscillation (SHO) are close, and the difference between their frequencies is much smaller than their respective frequencies. Then, when the two signals are superimposed, the signal obtained will have a beat frequency in time. Take two signals doing simple harmonic oscillation as an example. The two signals are x1(t) = cos(t) and x2(t) = sin(1.2t). After adding them together, it can be found that the vibration of the synthesized signal is not a simple harmonic oscillation. At this time, the vibration frequency of the synthesized signal is close to the vibration frequency of x1(t) and the vibration frequency of x2(t), but the amplitude of the synthesized signal changes with another larger period. When synthesizing two signals doing simple harmonic oscillation with a small frequency difference, the amplitude of the synthesized signal changes slowly and periodically, sometimes strong and sometimes weak, which is called a beat. The frequency of this beat is called the beat frequency. Beat frequency fringing refers to the fact that two signals with similar vibration frequencies will produce beats and difference beats when they beat each other. For example, when two audio signals with frequencies of 400Hz and 500Hz meet, a beat signal will be derived after beating, that is, a signal of 500Hz+400Hz=900Hz, and a difference beat signal will also be derived, that is, a signal of 500Hz-400Hz=100Hz. It can be seen that the frequency shifter always has "beat frequency fringing", especially when the phenomenon of oscillation fringing occurs, the phenomenon of beat frequency fringing will become more obvious.

[0049] Voice intercom means that the local device obtains the local live audio, generates an uplink audio signal and transmits it to the remote device, obtains the downlink audio signal transmitted by the remote device online or from the storage, processes the downlink audio signal to obtain the live audio on the remote side, and then plays the live audio on the remote side. Voice intercom can be achieved by the local device and the remote device interacting with the uplink and downlink audio signals.

[0050] The present application embodiment provides a voice intercom system, such as Figure 2 As shown, the voice intercom system 1000 includes a first electronic device 100 and a second electronic device 200. The first electronic device 100 is a local device. The second electronic device 200 is a remote device. The first electronic device 100 and the second electronic device 200 exchange uplink audio signals and downlink audio signals to achieve voice intercom. Among them, the uplink audio signal is an audio signal collected by the electronic device, and the downlink audio signal is an audio signal received by the electronic device. Then the uplink audio signal sent by the first electronic device 100 is the downlink audio signal received by the second electronic device 200. The downlink audio signal received by the first electronic device 100 is the uplink audio signal sent by the second electronic device 100. In some examples, the first electronic device 100 and the second electronic device 200 can exchange uplink audio signals and downlink audio signals based on wireless communication. In some examples, the first electronic device 100 and the second electronic device 200 can exchange uplink audio signals and downlink audio signals based on optical communication or other communication methods.

[0051] The following embodiments are described based on the first electronic device 100 .

[0052] like Figure 3 As shown, the first electronic device 100 includes a chip system 10, a microphone 20 and a player 30. The chip system 10 is used to receive a downlink audio signal, which is an audio signal sent by the second electronic device 200 to the first electronic device 100. The remote live audio information is obtained by parsing the downlink audio signal. The player 30 is used to play the live audio on the remote side according to the remote live audio information. The microphone 20 is used to collect the live audio on the local side and generate the local live audio information. The chip system 10 is also used to process the local live audio information to obtain an uplink audio signal; and send the uplink audio signal to the second electronic device 200.

[0053] In some possible implementations, the chip system 10 may include a processor or a memory, etc., and the processor may be used to perform data processing on the uplink audio signal and the downlink audio signal. In some examples, the processor may be a digital signal processor (DSP).

[0054] In some possible implementations, the sound pickup 20 and the player 30 may be used as external devices of the first electronic device 100. In some possible implementations, the sound pickup 20 and / or the player 30 may be used as internal devices of the first electronic device 100.

[0055] In some possible implementations, the first electronic device 100 and / or the second electronic device 200 may be any electronic device including a voice intercom function, or any electronic device including a function of receiving downlink audio data from a remote end and playing it at the local end, or any electronic device including a function of collecting live audio at the local end and generating uplink audio data to send to the remote end for playing. In some examples, the first electronic device 100 and / or the second electronic device 200 may be a voice intercom device, a mobile phone, a laptop computer, a desktop computer, a tablet computer, a smart watch, a smart camera device, a camera imaging device group, a camera monitoring platform, etc.

[0056] Among them, in the embodiments of the present application, Figure 4 As shown, when the microphone 20 of the first electronic device 100 collects the live audio on the local side, it will also collect the live audio on the remote side played by the player 30. The collected live audio information will be transmitted to the second electronic device 200 as an uplink audio signal for playback. Similarly, when the second electronic device 200 collects the live audio, it will also collect the played audio. In this case, the first electronic device 100 and / or the second electronic device 200 will easily experience acoustic feedback, thereby generating a howling noise signal in the uplink audio signal and the downlink audio signal, resulting in a reduced voice intercom experience.

[0057] In some possible implementations, based on Figure 3 and Figure 4 The first electronic device 100 shown in the figure can execute the first audio processing method to remove the howling noise signal caused by the acoustic feedback phenomenon. Figure 5 As shown, the first audio processing method includes the following steps S110 to S120:

[0058] S110: Collect the live audio on the local end to obtain an uplink audio signal.

[0059] In the embodiments of the present application, Figure 3 and Figure 4As shown, after the microphone 20 of the first electronic device 100 collects the local audio, it generates local audio information to the chip system 10, and the chip system 10 generates an uplink audio signal based on the local audio information. At this time, due to the influence of the acoustic feedback phenomenon, the uplink audio signal includes a data audio signal carrying the local audio information and a howling noise signal. Figure 6 As shown in Figure 1, it is a waveform diagram of the early stage of the howling noise signal. Figure 7 As shown, Figure 6 The spectrogram corresponding to the howling noise signal shown in FIG. Figure 7 is a spectrogram obtained by grayscale image processing of a color spectrogram, and Figure 7 This is a screenshot of the computer interface, and the grayscale image does not affect the analysis and understanding of the solution by those skilled in the art.

[0060] S120: Perform a fixed-amplitude frequency shift on the uplink audio signal.

[0061] In the embodiment of the present application, since the uplink audio signal includes a howling noise signal, Figure 3 and Figure 4 As shown, the uplink audio signal can be processed in the chip system 10. Exemplarily, the data processing can be: frequency shifting the uplink audio signal with a fixed amplitude. In the embodiment of the present application, the resonance peak can be avoided by continuously frequency shifting the uplink audio signal to change the frequency. This method can avoid the interference caused by the howling noise signal to a certain extent, but when the uplink audio signal is processed, the uplink audio signal is a dual-microphone radio signal corresponding to the left channel and the right channel, so the data processing amount is large. In addition, when the sound of the live audio is loud, there is a risk of failure in the process of frequency shifting the uplink audio signal using this solution. Finally, the operation of frequency shifting the uplink audio signal with a fixed amplitude is prone to produce an oscillation fringing phenomenon or a beat frequency fringing phenomenon, so that there is a certain regular echo interference when playing audio.

[0062] In some possible implementations, based on Figure 3 and Figure 4 The first electronic device 100 shown in the figure can perform the second audio processing method to remove the howling noise signal caused by the acoustic feedback phenomenon. Figure 8 As shown, the second audio processing method includes the following steps S210-S220:

[0063] S210: Collect the live audio on the local end to obtain an uplink audio signal.

[0064] The technical principle and technical effect of step S210 may refer to the relevant description of the aforementioned step S110 and will not be repeated here.

[0065] S220: Filter out the howling noise signal in the uplink audio signal based on an adaptive filter.

[0066] In the embodiment of the present application, the adaptive filter is a digital filter. In the chip system 10, the acoustic feedback path is detected and a model algorithm is established to simulate the howling noise signal, and the howling noise signal is offset and filtered. With this solution, the optimal processing of the howling noise can be achieved in theory. However, in practical applications, it is difficult to accurately model a complex howling loop. The howling noise signal simulation error is large, and there is no accurate reference signal to accurately filter the howling noise signal.

[0067] In some possible implementations, based on Figure 3 and Figure 4 The first electronic device 100 shown in the figure can perform the third audio processing method to remove the howling noise signal caused by the acoustic feedback phenomenon. Fig. 9 As shown, the third audio processing method includes the following steps S310-S320:

[0068] S310: Collect the live audio on the local end to obtain an uplink audio signal.

[0069] The technical principle and technical effect of step S310 may refer to the relevant description of the aforementioned step S110 and will not be repeated here.

[0070] S320: Detect a howling noise signal.

[0071] In some examples, the chip system 10 can use a fast Fourier transform (FFT) algorithm to detect the signal frequency of the howling noise signal. In an embodiment of the present application, the detection resolution of the signal frequency of the howling noise signal detected by the FFT algorithm is insufficient, and the detection is not accurate enough. Taking the sampling frequency fs as 8kHz and the sampling value N as 128-point FFT as an example, the resolution Δf is only 62.5Hz. When the sampling frequency increases to 16kHz or even greater, the resolution is lower. At this time, although the real-time performance of data processing is better, the detection accuracy of the howling noise signal cannot meet the detection requirements at all, and the detection result is inaccurate.

[0072] In some examples, the chip system 10 can use an FFT algorithm combined with a chirp-Z transform (CZT) algorithm to detect the signal frequency of the howling noise signal. In an embodiment of the present application, an FFT algorithm can be used to perform a rough detection of the howling noise signal. Then, based on the rough detection result of the howling noise signal, a fine detection of the howling noise signal is performed based on the CZT algorithm. However, in an embodiment of the present application, it is necessary to perform full-band detection based on the FFT algorithm and the CZT algorithm, and the amount of calculation is large. When the sampling frequency becomes larger, the real-time performance of data processing is poor, and it is difficult to achieve timely filtering of the howling noise signal.

[0073] S330: Filter out the howling noise signal based on a notch filter.

[0074] For example, Figure 6 , the establishment process of the howling noise signal is relatively short, and the maximum amplitude can be reached soon after the waveform is generated. In the process of forming the howling noise signal, its amplitude value is also constantly changing according to a certain rule, presenting a trumpet shape. When observing its waveform in the time domain, it can be seen that it is similar to a sine wave waveform, and the amplitude increases according to a certain rule. Due to the influence of background noise, the peaks and troughs of the sine wave will have a small range of changes in amplitude compared to the expected amplitude. Its frequency remains basically stable and unchanged, and it manifests itself as a harsh chirping sound. Therefore, the time-frequency characteristics of the howling signal in the early stage of establishment can be used as a judgment standard to automatically capture the howling frequency, and design an infinite impulse response (IIR) notch filter to eliminate the howling noise signal through the IIR notch filter. In an embodiment of the present application, the IIR notch filter has a nonlinear phase transformation. When filtering the howling noise signal of the uplink audio signal, nonlinear phase distortion will occur, thereby damaging the sound quality.

[0075] In summary, the first audio processing method, the second audio processing method and the third audio processing method are all unable to filter out the howling noise signal in a timely and high-precision manner.

[0076] In some possible implementations, in order to achieve timely and high-precision filtering of the howling noise signal, based on the following Figure 3 and Figure 4 The first electronic device 100 shown in the figure can perform the fourth audio processing method to remove the howling noise signal caused by the acoustic feedback phenomenon. Fig.10 As shown, the fourth audio processing method includes the following steps S410-S420:

[0077] S410: Input a first audio signal.

[0078] In the embodiment of the present application, the first audio signal includes a data audio signal and a howling noise signal. The howling noise signal is an interference signal with a frequency higher than that of the data audio signal.

[0079] S420: Obtain a first reference signal according to the first audio signal.

[0080] In an embodiment of the present application, the frequency difference between the first reference signal and the howling noise signal is less than the first value. The first reference signal is obtained by performing signal processing on the first audio signal to detect the howling noise signal. In theory, the first reference signal is the howling noise signal obtained by simulation, but based on the actual processing accuracy, etc., there may be a certain error between the first reference signal and the howling noise signal. Therefore, the frequency difference between the first reference signal and the howling noise signal actually obtained is less than the first value.

[0081] In some possible implementations, such as Fig.11 As shown, step S420 may also include the following operations recorded in steps S421 to S422:

[0082] S421. Perform sampling detection processing on the first audio signal to obtain at least one sample noise signal.

[0083] In some possible implementations, the frequency value of at least one sample noise signal is less than the first frequency value. In an embodiment of the present application, the human ear is not sensitive to high-frequency signals, that is, when the audio signal exceeds a certain frequency, it will exceed the perceptible range of the human ear. Therefore, in the process of sampling and detecting the first audio signal, the howling noise signal above a certain frequency value may not be processed. Taking the first frequency value of 2kHz as an example, when the noise signal obtained by the sampling and detection processing is lower than 2kHz, it can be used as a sample noise signal in at least one sample noise signal.

[0084] For example, Fig.12 As shown in FIG. , it is a schematic diagram of the waveform of the original data audio signal. Fig.13 As shown in Figure 1, it is a waveform diagram of a howling noise signal. Fig.14 As shown in, it is the spectrum of the original data audio signal. Fig.15 As shown, it is the spectrum diagram of the howling noise signal with a frequency of 285.5 Hz.

[0085] In some examples, a first sampling detection process can be performed on the first audio signal based on an FFT algorithm to screen out sample noise signals with a frequency less than a first frequency value, and obtain at least one initial sample noise signal. Then, based on a zoom fast Fourier transform (zoom FFT, ZFFT) algorithm, a second sampling detection process is performed on the first audio signal corresponding to the first initial sample noise signal to obtain at least one sample noise signal; the first initial sample noise signal is an initial sample noise signal with a frequency less than the first frequency value in the initial sample noise signal. In an embodiment of the present application, in the fourth audio processing method, only the noise signal less than the first frequency value is subjected to a fine sampling analysis process of the second sampling detection process, which can reduce the data processing amount of the sampling process without affecting the user experience. In addition, in the process of fine sampling analysis and processing, the fourth audio processing method performs fine sampling processing based on the ZFFT algorithm, and the ZFFT algorithm has a lower computational complexity than the CZT algorithm in the third audio processing method while ensuring the accuracy of the adopted analysis.

[0086] Exemplarily, when the first sampling detection processing is performed on the first audio signal, the peak-to-average power ratio (PAPR) and the peak-to-neighboring power ratio (PNPR) are respectively used as judgment criteria to obtain the intersection of the candidate acoustic feedback frequency set and obtain the initial sample noise signal. If the initial sample noise signal is greater than or equal to the first frequency value, no refinement processing is required. If the initial sample noise signal is less than the first frequency value, a refinement processing can be performed based on the ZFFT algorithm to locate the frequency value of the candidate howling noise signal with a higher spectral resolution. Finally, whether the frequency of the howling noise signal is adopted is determined based on the peak retention between signal frames. The peak retention is the duration of the sample noise signal. If the frequency value is confirmed to be adopted based on the peak retention, a corresponding sine signal or cosine signal is generated based on the frequency value to obtain a first reference signal. In subsequent operations, the first reference signal is used as a reference reference signal to filter out the howling noise signal.

[0087] In some examples, the duration of any sample noise signal in at least one sample noise signal is greater than the first duration. In an embodiment of the present application, the howling noise signal generally has a certain duration, so when performing sampling detection processing based on the FFT algorithm, the sample noise signal can be screened by duration. For example, the first duration is 3 signal frame lengths.

[0088] In some examples, the duration of any sample noise signal in at least one sample noise signal is greater than the first duration and less than the second duration. In the embodiment of the present application, because the howling noise signal needs to be filtered out in real time, if the data processing time is long, it will affect the filtering effect of the howling noise signal. Therefore, when selecting the sample noise signal, it is necessary to generate the corresponding sample noise signal in time for subsequent data processing, so that the corresponding sample noise signal needs to be generated when the duration reaches a certain duration. For example, the second duration is 5 signal frame lengths.

[0089] S422. Obtain a first reference signal according to at least one sample noise signal.

[0090] In step S421, a rough detection may be performed based on the FFT algorithm to obtain a noise sample set. The noise sample signals greater than or equal to 2 kHz in the noise sample set may be discarded, and the noise sample signals less than 2 kHz may be used as at least one sample noise signal. Fig.16 As shown in the figure, if the frequency of a sample noise signal is fc, then the candidate spectrum range [fc-Δf, fc+Δf] can be selected. The candidate spectrum range is refined to a certain multiple on the first audio signal, and a refined sampling analysis is performed based on ZFFT, and then the maximum frequency point f in the frequency range is searched. c ′ The frequency of the first reference signal.

[0091] In some possible implementations, before executing step S421, the fourth audio processing method may further include the following operations: obtaining the frequency value of the bottom noise of the first audio signal, and determining the sampling frequency threshold of the sampling detection processing according to the frequency value of the bottom noise. In the embodiment of the present application, when the fourth audio processing method is applied to different scenes, the background sounds of different scenes are different. Then the audio collected by the microphone 20 of the first electronic device 100 will also be different, so that the bottom noise is also different. In addition, in different application scenarios, device parameters, etc. will also have certain changes, so that the bottom noise of the collected audio signal is also different. Therefore, in different application scenarios, the size of the bottom noise of the uplink audio signal and the downlink audio signal is different. In order to ensure the accuracy and reliability of the sample noise signal obtained by the step S420 operation, while accurately filtering out the howling noise signal, the audio quality is guaranteed as much as possible. In actual applications, it is necessary to determine the sampling frequency threshold according to the frequency value of the bottom noise.

[0092] In some possible implementations, when the sampling detection process is performed in step S421, when the input audio signal frame is too long, the audio signal frame can be framed to implement FFT algorithm processing in a nearly steady state. In the frame processing, the spectrum leakage is reduced by increasing the signal window, and the transition properties between each processing operation can be analyzed more smoothly by overlapping the data.

[0093] S430: Form an adaptive notch filter based on the FIR filter, use the first reference signal as a reference signal of the adaptive notch filter, and perform notch algorithm processing on the first audio signal to obtain a second audio signal.

[0094] In an embodiment of the present application, the first reference signal obtained by simulation is used as a reference signal for notch algorithm processing to process the first audio signal. The digital notch filter can filter out interference signals of a certain frequency. Because the first audio signal includes a data audio signal and a howling noise signal, the first reference signal is detected in real time in step S420. The first reference signal is a signal obtained by simulating the howling noise signal, and the frequency difference between it and the howling noise signal is less than a certain value. The first reference signal is used as the reference reference signal of the FIR filter, so as to obtain an adaptive notch filter based on the FIR filter in the digital domain of the chip system 10. The adaptive notch filter constructed based on the FIT filter will perform notch processing on the first audio signal according to the first reference signal input in real time, thereby filtering out the howling noise signal and obtaining a second audio signal including the data audio signal. In the aforementioned third audio processing method, an IIR notch filter is used, and the IIR notch filter will produce nonlinear phase distortion, affecting the audio quality. In the fourth audio processing method, the FIR filter is used as a notch filter, and nonlinear phase distortion will not be generated, thereby improving the quality of audio processing. At the same time, the FIR filter is used as an adaptive notch filter, and the first reference signal obtained by detection is used as a reference reference signal for notch algorithm processing, which can improve the reliability and processing accuracy of notch processing on the howling noise signal.

[0095] In some examples, when the second audio signal is an uplink audio signal, the chip system 10 sends the obtained second audio signal to the second electronic device 200 at the remote end.

[0096] In some examples, when the second audio signal is a downlink audio signal, the chip system 10 transmits the second audio signal to the player 30 for playback. Exemplarily, the first electronic device 100 may include an audio amplifier. At this time, the chip system 10 may transmit the second audio signal to the audio amplifier, and the audio amplifier amplifies the second audio signal and then outputs it to the player 30 for playback.

[0097] In some possible implementations, when implementing voice intercom, the howling noise signal may be filtered out at the uplink audio signal, or the howling noise signal may be filtered out at the downlink audio signal.

[0098] In some examples, the first audio signal may be an uplink audio signal. In an embodiment of the present application, when the first audio signal is an uplink audio signal, the detection operation of the howling noise signal in step S420 and the filtering operation of the howling noise signal in step S430 both occur after the microphone 20 collects the live audio information to generate an uplink audio signal. After the chip system 10 filters the howling noise signal from the uplink audio signal, a second audio signal is obtained. At this time, the second audio signal is an uplink audio signal from which the howling noise signal has been filtered out. The first electronic device 100 sends the uplink audio signal from which the howling noise signal has been filtered out to the second electronic device 200. However, in some application scenarios, the microphone 20 may be a multi-microphone sound receiving structure, for example, some network cameras are dual-microphone sound receiving structures including a left channel and a right channel. At this time, the amount of data processing required to filter out the howling noise signal at the uplink audio signal will be relatively large.

[0099] In some examples, the first audio signal may be a downlink audio signal. In an embodiment of the present application, when the first audio signal is a downlink audio signal, the detection operation of the howling noise signal in step S420 and the filtering operation of the howling noise signal in step S430 both occur after the chip system 10 of the first electronic device 100 receives the audio signal sent by the second electronic device 200. After receiving the downlink audio signal, the chip system 10 may directly process the data, or store it in a memory, and then read the downlink audio signal from the memory and process the data. After the chip system 10 filters the howling noise signal from the downlink audio signal, a second audio signal is obtained. At this point, the second audio signal is a downlink audio signal from which the howling noise signal has been filtered out. The first electronic device 100 sends the downlink audio signal from which the howling noise signal has been filtered out to the player 30 for playback. When the first audio signal is a downlink audio signal, the chip system 10 has less data processing, higher processing accuracy, and faster processing speed.

[0100] In some possible implementations, the audio signal may be subjected to frequency shift processing. Exemplarily, the frequency shift amplitude of the frequency shift processing may be a fixed amplitude, or the frequency shift amplitude of the frequency shift processing may be randomly selected within a first frequency shift amplitude range.

[0101] In some examples, when the first audio signal is an uplink audio signal, after executing step S430, the fourth audio processing method further includes: performing frequency shift processing on the first audio signal. The frequency shift amplitude of the frequency shift processing is randomly selected within the first frequency shift amplitude range. In an embodiment of the present application, after the chip system 10 filters out the howling noise signal from the uplink audio signal, it randomly shifts the frequency of the uplink audio signal by a certain amplitude and then sends it to the second electronic device 200. Through the random frequency shift operation, the generation of new howling noise signals can be suppressed to a certain extent on the basis of processing the howling noise signal. And the frequency shift operation of the embodiment of the present application is based on a random frequency shift amplitude. In the above-mentioned first audio processing method, based on the frequency shift processing of a fixed amplitude, the frequency shift processing of a fixed amplitude may fail in some scenarios. In the early stage of the processing of the adaptive notch filter, a certain amount of howling noise signals will remain due to the failure of data processing to converge. The use of random amplitude frequency shift processing can destroy the generation conditions of the howling noise signal to avoid the residual howling noise signal from continuing to interfere with the voice intercom and avoid the generation of new howling noise signals. For example, a random function may be written at the software level to determine the specific frequency amplitude of each frequency shift through the random function.

[0102] In some examples, when the first audio signal is a downlink audio signal, in the process of executing the aforementioned steps S410-S430 on the downlink audio signal, the fourth audio processing method further includes: collecting an uplink audio data signal, and performing frequency shift processing on the uplink audio data signal; the frequency shift amplitude of the frequency shift processing is randomly selected within the first frequency shift amplitude range. In an embodiment of the present application, the chip system 10 of the first electronic device 100 filters out the howling noise signal from the received downlink audio signal, obtains the downlink audio signal (i.e., the second audio signal) after filtering out the howling noise signal, and sends it to the player 30 for playback. At the same time, in this process, the pickup 20 of the first electronic device 100 will continue to collect the live audio (i.e., the uplink audio data signal) on the local side, and send the uplink audio data signal to the chip system 10. The chip system 10 performs random frequency shift processing on the uplink audio data. Regarding the technical principle and technical effect of performing random frequency shift processing on the uplink audio signal, reference can be made to the aforementioned description of performing random frequency shift processing on the downlink audio signal, which will not be repeated here.

[0103] For example, the processing range of random audio processing (ie, the first frequency shift amplitude) may be selected between 3 Hz and 7 Hz. Fig.17 As shown in the figure, it is the waveform diagram when the spectrum is shifted by 5Hz. Fig.18 As shown in Fig.17 The corresponding spectrogram. Fig.19 As shown in the figure, it is the waveform diagram when the spectrum is shifted by 7Hz. Fig. 20 As shown, Fig.19Corresponding spectrogram. In actual applications, after each execution of the first audio processing method, taking its fixed frequency shift of 5Hz as an example, after each execution of the frequency shift operation of the first audio processing method, its spectrum is shown as a fixed increase or decrease of 5Hz. In the fourth audio processing method recorded in the embodiment of the present application, the frequency may be shifted by 5Hz in the previous frequency shift operation, and may be shifted by 7Hz in the second frequency shift operation. In actual applications, it can be detected that the change amplitude of the spectrum graph is different under each frequency shift operation. At the same time, according to Fig.17 , Fig.18 , Fig.19 and Fig. 20 It can be seen that the effect of frequency shifting on data transmission and accuracy is almost negligible. Fig.18 and Fig. 20 This is a screenshot of the computer interface under the simulation software. Its purpose is to show the effect of the spectrogram of the corresponding waveform. The figure is clear in showing the effect of the spectrogram.

[0104] For example, Fig.21As shown, it is a schematic diagram of the full processing flow of the chip system 10 for filtering the howling noise signal. First, the chip system 10 calculates the corresponding frequency value according to the bottom noise, and uses the frequency value as the sampling frequency threshold of the subsequent data processing. Then, the chip system 10 performs frame processing on the first audio signal input in step S410, and increases the number of signal windows for data processing. The first audio signal can be an uplink audio signal or a downlink audio signal. Next, the operation of step S421 is performed, and the first audio signal is sampled and processed by FFT operation based on the first frequency value as the sampling threshold to obtain the corresponding PAPR and PNPR. The frequency value fc is calculated based on the PAPR and PNPR. If the frequency value fc is empty, the processing flow is terminated. If the frequency value fc is not empty, an initial noise sample is obtained. Then, it is determined whether the frequency value fc corresponding to the noise signal in the initial noise sample is less than the first frequency value. If the frequency value fc of a certain noise signal is greater than or equal to the first frequency value, no data processing is performed. If the frequency value fc of a certain noise signal is less than the first frequency value, the second sampling detection process in step S421 is performed on the noise sample signal, that is, the ZFFT algorithm is processed on it. The noise sample signal is refined and analyzed by the ZFFT algorithm to obtain at least one sample noise signal. In order to ensure the reliability of at least one sample noise signal, its duration is judged. When its duration is greater than the first duration (or greater than the first duration and less than the second duration), it is determined to be a howling noise signal. Otherwise, the data processing operation is not performed. After determining the howling noise signal of this data processing, if the frequency of the howling noise signal is consistent with the frequency of the howling noise signal determined last time, the first reference signal corresponding to the last howling noise signal is kept input into the FIR adaptive notch filter to perform notch algorithm processing on the first audio signal. If the frequency of the howling noise signal is inconsistent with the frequency of the howling noise signal determined last time, a new first reference signal is regenerated in the digital domain of the chip system 10 through the adaptive notch filter algorithm to input the new first reference signal into the FIR adaptive notch filter to perform notch algorithm processing on the first audio signal. Taking the first audio signal as an uplink audio signal as an example, after filtering out the howling noise signal through the notch algorithm, the first audio signal can also be subjected to frequency shift processing. If the first audio signal is a downlink audio signal, the frequency shift processing is the processing performed on the uplink audio signal. At this time, the setting of the processing time of the frequency shift processing is not restrictedly associated with the data processing operation time and sequence of the first audio signal. After executing the above data processing operation, if the voice intercom is still in progress, the above data processing operation will continue to be executed in a loop. If the voice correspondence has ended, the chip system 10 stops executing the relevant data processing operation.

[0105] In some possible implementations, when the first audio signal is a downlink audio signal, such as Fig. 22As shown, the data processing module in the chip system 10 includes an audio decoding (audio encoder, AENC) module 11, a howling processing module 12, an audio processing module 13 and an audio output (audio output, AO) module 14. The audio decoding module 11 obtains the downlink audio signal from the memory or the online transmission link, and performs an audio decoding operation on the downlink audio signal. The decoded downlink audio signal is filtered out by the audio processing module 13 to remove the howling noise. Fig.23 As shown, the howling processing module 12 includes an FIR filter and an adaptive filtering algorithm module. The frequency of the howling noise signal is obtained by the adaptive filtering algorithm module, and the corresponding first reference signal is adjusted. The digital filter uses the first reference signal as a reference reference signal to perform a notch algorithm on the input downlink audio signal, thereby filtering out the howling noise signal. Fig. 22 As shown, the howling processing module 12 outputs the downlink audio signal after filtering. The audio processing module 13 performs pre-processing on the downlink audio signal (i.e., the second audio signal) after filtering before playing. Among them, the pre-processing before playing includes at least one of the following processes: acoustic echo cancellation (AEC) processing, audio noise reduction (ANR) processing, automatic gain control (AGC) processing, resampling (RES) processing, high pass filter (HPF) processing and gain adjustment processing, etc. The playback quality of the downlink audio signal is improved by pre-processing before playing. Then, the downlink audio signal pre-processed before playing is sent to the player 30 for pre-processing through the audio output module 14. In some examples, when the first electronic device 100 includes an audio amplifier, the downlink audio signal can also be amplified by the audio amplifier before playing.

[0106] In some possible implementations, the second electronic device 200 may also execute the fourth audio processing method described in the above embodiment. Regarding the technical principle and technical effect of the fourth electronic device 200 executing the fourth audio processing method, reference may be made to the relevant description of the embodiment in which the first electronic device 100 executes the fourth audio processing method, which will not be repeated here.

[0107] The embodiment of the present application provides an audio processing method and an electronic device. The audio processing method includes: inputting a first audio signal. The first audio signal includes a data audio signal and a howling noise signal. The input audio signal is sampled, analyzed and detected to obtain a first reference signal. The frequency difference between the first reference signal and the howling noise signal in the audio signal is less than a first value. An FIR filter is used to form an adaptive notch filter, and the obtained first reference signal is used as a reference reference signal of the adaptive notch filter. The input first audio signal is processed by a notch algorithm to filter out the howling noise signal, and a second audio signal after filtering out the howling noise signal is obtained, and the second audio signal includes a data audio signal. First, the embodiment of the present application forms an adaptive notch filter by using an FIR filter, and obtains a first reference signal by calculating the howling noise signal, and uses the first reference signal as a reference reference signal for the adaptive notch filter to perform notch processing, thereby realizing real-time and accurate notch filtering of the howling noise signal in the first audio signal. Compared with using an IIR notch filter to perform notch processing on the first audio signal, the adaptive notch filter formed by the FIR filter does not produce nonlinear phase distortion. At the same time, based on the first reference signal as the reference reference signal for notch processing, the reliability and accuracy of filtering the howling noise signal can be improved. Second, in the audio processing method recorded in the embodiment of the present application, the noise signal greater than or equal to the first frequency value is not processed. Because in practical applications, the human ear is not sensitive to these high-frequency noise signals. The embodiment of the present application can reduce the amount of data processing and the demand for computing power by not processing the noise signal of the first frequency value and above. At the same time, the efficiency and timeliness of the operation are also improved. Third, by using the ZFFT algorithm to perform precise detection on the detected noise signal, the ZFFT algorithm has a lower amount of calculation and faster operation than the CZT algorithm for refined precise detection. And when only the noise signal below the first frequency value is refined and precisely detected by the ZFFT algorithm, the first reference signal can be quickly, timely and accurately sampled on the basis of a smaller amount of calculation. Fourth, the howling noise signal can be filtered at the downlink audio signal. Compared with filtering the howling noise signal at the uplink audio signal, the amount of calculation required for filtering the howling noise signal at the downlink audio signal is smaller. Fifth, the uplink audio signal can be frequency-shifted while filtering out the howling noise signal to minimize the conditions for subsequent generation of the howling noise signal. And when the frequency shift is randomly shifted within a certain optional range, the frequency shift effect is best. Through the above operation, the embodiment of the present application can achieve fast, real-time and high-precision filtering of the howling noise signal at an accuracy of 1 Hz.

[0108] The present application also provides a computer-readable storage medium, which includes instructions. When the instructions are executed on an electronic device (e.g., the first electronic device 100 and / or the second electronic device 200) as in the above embodiment, the electronic device executes the audio processing method (e.g., Fig.10 , Fig.11 and Fig.21 method described).

[0109] The processor involved in the embodiments of the present application may be a chip. For example, it may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a microcontroller unit (MCU), a programmable logic device (PLD), or other integrated chips.

[0110] The memory involved in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct RAM (DR RAM). It should be noted that the memory of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0111] It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0112] Those of ordinary skill in the art will appreciate that the modules and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0113] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and modules described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0114] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules is only a logical function division. There may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or modules, which can be electrical, mechanical or other forms.

[0115] The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules, that is, they may be located in one device or distributed on multiple devices. Some or all of the modules may be selected according to actual needs to achieve the purpose of the present embodiment.

[0116] In addition, each functional module in each embodiment of the present application may be integrated into one device, or each module may exist physically separately, or two or more modules may be integrated into one device.

[0117] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using a software program, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loading and executing a computer program instruction on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, a computer, a server or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (Digital Subscriber Line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that a computer can access or may contain one or more servers, data centers and other data storage devices that can be integrated with a medium. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a DVD), or a semiconductor medium (eg, a solid state disk (SSD)).

[0118] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. An audio processing method, characterized in that: The method comprises: Input a first audio signal; the first audio signal includes a data audio signal and a howling noise signal; the howling noise signal is an interference signal with a frequency higher than that of the data audio signal; A first reference signal is obtained according to the first audio signal; a frequency difference between the first reference signal and the howling noise signal is less than a first value; An adaptive notch filter is formed based on a FIR filter, a first reference signal is used as a base reference signal of the adaptive notch filter, and a notch algorithm is performed on the first audio signal to obtain a second audio signal; the second audio signal includes the data audio signal.

2. The audio processing method according to claim 1, characterized in that: The obtaining a first reference signal according to the first audio signal includes: Performing sampling detection processing on the first audio signal to obtain at least one sample noise signal; the frequency value of the at least one sample noise signal is less than the first frequency value; The first reference signal is obtained according to the at least one sample noise signal.

3. The audio processing method according to claim 2, characterized in that: The sampling and detection processing of the first audio signal to obtain at least one sample noise signal includes: Based on a fast Fourier transform algorithm, performing a first sampling process on the first audio signal to obtain at least one initial sample noise signal; Based on a scaled fast Fourier transform algorithm, a second sampling detection process is performed on the first audio signal corresponding to a first initial sample noise signal to obtain the at least one sample noise signal; the first initial sample noise signal is an initial sample noise signal whose frequency is less than the first frequency value in the initial sample noise signal.

4. The audio processing method according to claim 2 or 3, characterized in that: The duration of any sample noise signal of the at least one sample noise signal is greater than the first duration.

5. The audio processing method according to claim 4, characterized in that: Any of the at least one sample noise signal is a sample noise signal whose noise duration is greater than the first duration and less than a second duration; and the first duration is less than the second duration.

6. The audio processing method according to any one of claims 2 to 5, characterized in that: The method further comprises: Acquire a frequency value of bottom noise of the first audio signal; A sampling frequency threshold of the sampling detection process is determined according to the frequency value of the bottom noise.

7. The audio processing method according to any one of claims 1 to 6, characterized in that: The first audio signal is a downlink audio data signal; the method further includes: An uplink audio data signal is collected and frequency shift processing is performed on the uplink audio data signal; the frequency shift amplitude of the frequency shift processing is randomly selected within a first frequency shift amplitude range.

8. The audio processing method according to claim 7, characterized in that: The method further comprises: The second audio signal is pre-processed before being played; the pre-processing before being played includes at least one of the following processes: echo cancellation processing, speech noise reduction processing, automatic gain control processing, resampling processing, high-pass filtering processing and gain adjustment processing.

9. The audio processing method according to any one of claims 1 to 6, characterized in that: The first audio signal is an uplink audio data signal; the method further includes: The first audio signal is subjected to frequency shift processing; the frequency shift amplitude of the frequency shift processing is randomly selected within a first frequency shift amplitude range.

10. An electronic device, characterized in that: It comprises a microphone, a chip system and a player; the chip system is coupled to the microphone and the player respectively; the chip system is used for: in the process of interactive processing of uplink audio signals and downlink audio signals with a remote device, processing a first audio signal based on the audio processing method as described in any one of claims 1 to 9 above; the first audio signal is the uplink audio signal, or the first audio signal is the downlink audio signal.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium includes instructions; when the instructions are executed on the electronic device as claimed in claim 10, the electronic device executes the audio processing method as claimed in any one of claims 1-9.

Images