Audio processing method and device, electronic equipment and storage medium

Abstract

The application discloses an audio processing method and device, electronic equipment and a storage medium. The audio processing method comprises the following steps: detecting a sub-band signal with howling existing in an audio signal collected by an audio collection module as a first sub-band signal; performing howling suppression processing on the first sub-band signal based on a howling parameter of the first sub-band signal to obtain a second sub-band signal, wherein the howling parameter is used to represent the howling degree of the first sub-band signal; and mixing the second sub-band signal with other sub-band signals in the audio signal except the first sub-band signal to obtain a target audio signal. The method can improve the howling suppression effect.

Description

Technical Field

[0001] This application relates to the field of electronic equipment technology, and more specifically, to an audio processing method, apparatus, electronic device, and storage medium. Background Technology

[0002] With advancements in technology and living standards, electronic devices with audio playback capabilities (such as headphones, smartphones, and tablets) are increasingly widely used in daily life, especially for listening to music and the radio. Therefore, the sound quality of electronic devices is crucial for users. However, in some cases, feedback (howling) may occur during the use of electronic devices. Feedback can negatively impact the user experience, damage speakers and microphones, increase power consumption, and even cause circuit burnout. Summary of the Invention

[0003] This application proposes an audio processing method, apparatus, electronic device, and storage medium that can improve howling suppression.

[0004] In a first aspect, embodiments of this application provide an audio processing method applied to an electronic device, the electronic device including an audio acquisition module, the method comprising: detecting a sub-frequency band signal with howling in an audio signal acquired by the audio acquisition module, as a first sub-frequency band signal; performing howling suppression processing on the first sub-frequency band signal based on howling parameters of the first sub-frequency band signal to obtain a second sub-frequency band signal, the howling parameters being used to characterize the howling degree of the first sub-frequency band signal; and mixing the second sub-frequency band signal with other sub-frequency band signals in the audio signal other than the first sub-frequency band signal to obtain a target audio signal.

[0005] Secondly, embodiments of this application provide an audio processing device applied to an electronic device. The electronic device includes an audio acquisition module, and the device includes: a feedback detection module, a feedback suppression module, and an audio synthesis module. The feedback detection module detects feedback sub-band signals present in the audio signal acquired by the audio acquisition module, which are designated as first sub-band signals. The feedback suppression module performs feedback suppression processing on the first sub-band signal based on feedback parameters of the first sub-band signal to obtain a second sub-band signal. The feedback parameters characterize the feedback degree of the first sub-band signal. The audio synthesis module mixes the second sub-band signal with other sub-band signals in the audio signal besides the first sub-band signal to obtain a target audio signal.

[0006] Thirdly, embodiments of this application provide an electronic device, including: one or more processors; a memory; and one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the one or more processors, and the one or more applications are configured to perform the audio processing method provided in the first aspect above.

[0007] Fourthly, embodiments of this application provide a computer-readable storage medium storing program code, which can be invoked by a processor to execute the audio processing method provided in the first aspect above.

[0008] The solution provided in this application detects a sub-frequency band signal with feedback (howling) in the audio signal acquired by the audio acquisition module, using it as the first sub-frequency band signal. Based on the feedback parameters of the first sub-frequency band signal, feedback suppression processing is performed on the first sub-frequency band signal to obtain a second sub-frequency band signal. These feedback parameters characterize the feedback degree of the first sub-frequency band signal. The second sub-frequency band signal is then mixed with other sub-frequency band signals in the audio signal besides the first sub-frequency band signal to obtain the target audio signal for output. Therefore, adaptive feedback suppression can be achieved based on the feedback degree of the sub-frequency band signal, thereby improving the accuracy of feedback suppression and ultimately enhancing the feedback suppression effect of the electronic device. Attached Figure Description

[0009] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0010] Figure 1 A schematic diagram of an audio system provided in an embodiment of this application is shown.

[0011] Figure 2 A schematic diagram of an application scenario provided by an embodiment of this application is shown.

[0012] Figure 3 A flowchart of an audio processing method according to an embodiment of this application is shown.

[0013] Figure 4 A flowchart of an audio processing method according to another embodiment of this application is shown.

[0014] Figure 5 A schematic diagram of frequency shifting processing in the audio processing method provided in the embodiments of this application is shown.

[0015] Figure 6This illustration shows a schematic diagram of the effect of frequency shifting processing provided in an embodiment of this application.

[0016] Figure 7 This illustration shows another effect diagram of the frequency shifting processing provided in the embodiments of this application.

[0017] Figure 8 A schematic diagram of an all-pass filter provided in an embodiment of this application is shown.

[0018] Figure 9 Another schematic diagram of the all-pass filter provided in this application embodiment is shown.

[0019] Figure 10 A schematic diagram of the amplitude-frequency response of the all-pass filter provided in an embodiment of this application is shown.

[0020] Figure 11 A schematic diagram of the phase frequency response of the all-pass filter provided in an embodiment of this application is shown.

[0021] Figure 12 A flowchart of an audio processing method according to yet another embodiment of this application is shown.

[0022] Figure 13 A flowchart of an audio processing method according to another embodiment of this application is shown.

[0023] Figure 14 A block diagram of an audio processing apparatus according to one embodiment of this application is shown.

[0024] Figure 15 This is a block diagram of an electronic device for performing an audio processing method according to an embodiment of this application.

[0025] Figure 16 This is a storage unit in this application embodiment for storing or carrying program code that implements the audio processing method according to this application embodiment. Detailed Implementation

[0026] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings.

[0027] In audio playback systems, because the microphone and speaker are in the same environment and are close to each other, the sound picked up by the microphone is amplified by the power amplifier and then played out by the speaker. This sound is then picked up by the microphone again, amplified again by the power amplifier, and then played out by the speaker. This creates positive feedback, causing a howling phenomenon. The speaker plays a harsh, shrill sound, which seriously affects the sound pickup and playback effect. Sometimes it may even burn out the power amplifier and the speaker. This effect is especially noticeable when the microphone and speaker are close together.

[0028] For example, in Figure 1 In the audio system shown, the microphone and speaker are in the same environment. x(n) is the signal acquired by the microphone, y(n) is the signal played back by the speaker, F(w) is the signal transfer function between the speaker and microphone (i.e., the feedback system), G(w) is the sound system transfer function, and k is the sound system gain. This sound system forms a closed-loop system, and its closed-loop transfer function is:

[0029]

[0030] According to the Nyquist principle of system stability, the amplitude and phase of the open-loop gain satisfy the following conditions.

[0031] |G(w)F(w)|≥1;

[0032] ∠G(w)F(w)=2nπ, where n is an integer

[0033] The system will be unstable.

[0034] In recent years, electronic products have become increasingly common, and electronic devices with audio playback capabilities are being used more and more widely. In some scenarios, electronic devices also play back the sound captured by their microphones, which can lead to feedback (howling) phenomena. For example, some headphones have a transparency mode. When a user activates this mode, the headphone microphone captures ambient sound from outside the headphones and processes it, making the ambient sound heard while wearing the headphones very similar to that heard without them. Furthermore, when the headphones are in transparency mode, if the user holds them or performs other actions that touch them, causing changes in the headphone cavity structure, the acoustic transmission path will change, resulting in a piercing howling sound.

[0035] In related technologies, howling suppression mainly includes frequency shifting, adaptive notch filtering, and adaptive feedback suppression algorithms. Among them, frequency shifting, by modulating the entire frequency band, changes the frequency of the output signal so that it does not overlap with the original signal frequency when it re-enters the system, thus suppressing howling. However, if there are many howling frequencies, the howling suppression effect of frequency shifting is not ideal.

[0036] The adaptive notch filtering algorithm detects and reduces the gain at the howling frequency points, thus disrupting the gain conditions that cause howling. In other words, it notches the more obvious howling frequency points in the signal to suppress howling. However, the adaptive notch filtering algorithm requires accurate detection of howling frequencies. This necessitates performing Fast Fourier Transform (FFT) spectral analysis on the signal acquired by the microphone to obtain acoustic features for howling frequency identification. The low resolution of FFT makes it prone to misidentification, resulting in the notch filtering not effectively eliminating the howling frequency band.

[0037] Adaptive feedback suppression algorithms filter out the feedback signal from the microphone's secondary acquisition by using adaptive algorithms such as Least Mean Square (LMS) and Normalized Least Mean Square (NLMS). Adaptive feedback suppression algorithms require significant computational power and are suitable for digital signal processors with high processing capabilities.

[0038] To address the aforementioned problems, the inventors have proposed an audio processing method, apparatus, electronic device, and storage medium as provided in the embodiments of this application. These methods adaptively suppress howling based on the degree of howling in a sub-frequency band signal, thereby improving the accuracy of howling suppression and ultimately enhancing the howling suppression effect of the electronic device. The specific audio processing method will be described in detail in subsequent embodiments.

[0039] The scenarios involved in the embodiments of this application will be introduced below.

[0040] like Figure 2 As shown, the electronic device includes a processor 110, a memory 120, an audio acquisition module 130, an operational amplifier 140, and a speaker 150. The processor 110 amplifies the audio data to be played through the operational amplifier 140, and then plays it through the speaker 150. The audio acquisition module 130 can be a microphone. When the speaker 150 plays the audio signal acquired by the audio acquisition module 130, the processor 150 can detect feedback in the acquired audio signal and, based on the degree of feedback in the sub-frequency band signal, adaptively suppress feedback in that sub-frequency band signal, thereby improving the accuracy of feedback suppression and ultimately enhancing the feedback suppression effect of the electronic device.

[0041] The audio processing method provided in the embodiments of this application will now be described in detail with reference to the accompanying drawings.

[0042] Please see Figure 3 , Figure 3A flowchart illustrating an embodiment of the audio processing method provided in this application is shown. In a specific embodiment, the audio processing method is applied to, for example... Figure 14 The audio processing device 400 shown and the electronic device 100 on which the audio processing device 400 is disposed ( Figure 15 The following will address... Figure 3 The process shown will be described in detail. The audio processing method may specifically include the following steps:

[0043] Step S110: Detect the presence of a howling sub-band signal in the audio signal acquired by the audio acquisition module, and use it as the first sub-band signal.

[0044] The audio signal is a carrier of information about the frequency and amplitude changes of sound waves containing speech, music, and sound effects. In this embodiment, when the electronic device is playing the sound collected by the audio acquisition module, feedback detection can be performed on the audio signal collected by the audio acquisition module to detect the sub-frequency band signal where feedback exists and use it as the first sub-frequency band signal. Feedback detection is used to detect whether the audio signal contains a signal with feedback.

[0045] In some implementations, after acquiring the audio signal from the audio acquisition module, the audio signal can be transformed from the time domain to the frequency domain, and the transformed signal can be divided into multiple sub-frequency bands to obtain multiple sub-frequency band signals. Then, it is detected whether there is feedback in each of the multiple sub-frequency band signals. Frequency domain transformation refers to transforming the audio signal from the time domain to the frequency domain. The time domain describes the relationship between the audio signal and time, and the time domain waveform of the audio signal can express the change of the audio signal over time. The frequency domain is a coordinate system used to describe the frequency characteristics of a signal. It refers to the change of the audio signal with frequency. The frequency domain graph shows the signal quantity in each given frequency band within a frequency range. The frequency domain representation can also include the phase shift information of each sine curve so that the frequency components can be recombined to recover the original time signal.

[0046] In one possible implementation, the electronic device can detect whether a sub-band signal exhibits feedback based on its power. For example, the electronic device can detect feedback using one or more of the following methods: Peak-to-Threshold Power Ratio (PTPR), Peak-to-Average Power Ratio (PAPR), Peak-to-Neighboring Power Ratio (PNPR), and Peak-to-Harmonics Power Ratio (PHPR).

[0047] In some implementations, after acquiring the audio signal from the audio acquisition module, the acquired signal can be converted into a digital signal, for example, through an analog-to-digital converter (ADC). This digital signal is then input into an amplifier to obtain an amplified audio signal, which is then subjected to the feedback detection described above. Because the audio signal is amplified, feedback detection and suppression are facilitated during subsequent feedback detection, suppression, and audio playback, making it easier for the user to listen while simultaneously handling feedback.

[0048] In some implementations, before detecting feedback on the audio signal, considering that the audio signal acquired by the audio acquisition module may contain noise, noise filtering can also be performed on the audio signal. The filtering parameters for noise filtering can be fixed values, or they can be specifically set according to the frequency bands corresponding to common noise in the sound acquired by the electronic device's audio acquisition module. The specific filtering parameters are not limited.

[0049] Step S120: Based on the howling parameters of the first sub-band signal, perform howling suppression processing on the first sub-band signal to obtain the second sub-band signal. The howling parameters are used to characterize the howling degree of the first sub-band signal.

[0050] After detecting the first sub-frequency band signal (i.e., the sub-frequency band signal with howling) in the audio signal acquired by the audio acquisition module, the electronic device can perform howling suppression processing on the first sub-frequency band signal. In this embodiment, the electronic device can separate the first sub-frequency band signal from the audio signal using a bandpass filter, and then perform howling suppression processing on the first sub-frequency band signal. When performing howling suppression processing on the first sub-frequency band signal, the howling parameters of the first sub-frequency band signal can be used to specifically suppress the first sub-frequency band signal, and the processed signal is used as the second sub-frequency band signal. The howling parameters characterize the howling degree of the first sub-frequency band signal. The howling parameters can be the power, energy, etc., of the first sub-frequency band signal, and are not limited here. The degree of howling suppression processing on the first sub-frequency band signal can be positively correlated with the howling degree, thereby achieving adaptive howling suppression, which not only avoids loss of sound quality. In addition, when the degree of howling is relatively low, when howling is suppressed by frequency shifting and phase shifting, the degree of suppression is also low, so the amount of frequency shifting and phase shifting is also relatively small. This can reduce the overlap of howling subbands after frequency shifting or the excitation of howling in other frequency bands.

[0051] In some implementations, howling suppression processing of the first sub-band signal can be achieved by frequency shifting, phase shifting, or similar methods. Frequency shifting refers to changing the frequency of the first sub-band signal, such as increasing or decreasing its frequency. The changed frequency output signal entering the system will not overlap with the original signal frequency, thus suppressing howling. Phase shifting works similarly; by changing the phase of the first sub-band signal, it prevents it from overlapping with the original signal, thereby suppressing howling. The amount of frequency or phase shift can be positively correlated with the howling parameters. Of course, the specific howling suppression method is not limited. For example, notch filtering can be used for howling suppression. In notch filtering, the gain of the first sub-band signal is reduced, disrupting the gain condition that causes howling, thus achieving howling suppression. The degree of gain reduction can also be positively correlated with the degree of howling.

[0052] Step S130: Mix the second sub-frequency band signal with other sub-frequency band signals in the audio signal other than the first sub-frequency band signal to obtain the target audio signal.

[0053] In this embodiment, the electronic device performs feedback suppression processing on the first sub-frequency band signal exhibiting feedback to obtain the second sub-frequency band signal. Then, the first sub-frequency band signal is mixed with other sub-frequency band signals in the audio signal to obtain the target audio signal. These other sub-frequency band signals are those without feedback. Mixing the second sub-frequency band signal with the other sub-frequency band signals yields the audio signal obtained after feedback suppression processing of the audio signal acquired by the audio acquisition module. This target audio signal is the audio signal output by the electronic device. Since the target audio signal is obtained after feedback suppression processing of the audio signal acquired by the audio acquisition module, feedback can be avoided during playback.

[0054] The audio processing method provided in this application detects the sub-frequency band signals with feedback in the audio signal acquired by the audio acquisition module, and performs feedback suppression processing only on the sub-frequency band signals with feedback. Therefore, it can reduce the sound quality damage of non-feedback sub-frequency bands, ensure the listening experience, and prevent damage to electronic device components. Furthermore, since the feedback of the sub-frequency band signals with feedback is adaptively suppressed based on the degree of feedback, the accuracy of feedback suppression is improved, sound quality loss is avoided, and the feedback suppression effect is enhanced.

[0055] Please see Figure 4 , Figure 4 A flowchart illustrating another embodiment of the audio processing method provided in this application is shown. This audio processing method is applied to the aforementioned electronic device, and will be discussed below. Figure 4The process shown will be described in detail. The audio processing method may specifically include the following steps:

[0056] Step S210: Detect the presence of a howling sub-band signal in the audio signal acquired by the audio acquisition module, and use it as the first sub-band signal.

[0057] In this embodiment, step S210 can be referred to the content of other embodiments, and will not be repeated here.

[0058] Step S220: Based on the howling parameters of the first sub-band signal, determine the howling suppression parameters. The howling parameters are used to characterize the howling degree of the first sub-band signal. The parameter value of the howling suppression parameters is positively correlated with the parameter value of the howling parameters.

[0059] In this embodiment, when the electronic device detects the first sub-band signal (i.e., the sub-band signal with howling) in the audio signal acquired by the audio acquisition module, and performs howling suppression processing on the first sub-band signal, it can determine the howling suppression parameter based on the howling parameter of the first sub-band signal. The value of the howling suppression parameter is positively correlated with the value of the howling parameter; that is, the larger the value of the howling parameter, the larger the value of the howling suppression parameter, and vice versa. The howling suppression parameter is determined by the howling suppression processing method. For example, if the howling suppression processing is performed by frequency shifting, the howling suppression parameter is the frequency offset, i.e., the frequency shift amount (the amount of frequency change). Another example is that if the howling suppression processing is performed by phase shifting, the howling suppression parameter is the phase offset, i.e., the phase shift amount (the amount of phase change). Yet another example is that if the howling suppression processing is performed by notch filtering, the howling suppression parameter is the gain reduction amount.

[0060] In some implementations, before performing howling suppression processing on the first sub-band signal based on the howling parameters of the first sub-band signal, the electronic device may acquire the howling parameters of the first sub-band signal. These howling parameters may include the power of the first sub-band signal, the detection value of the envelope detection signal corresponding to the first sub-band signal, energy, etc., and the specific howling parameters may not be limited.

[0061] In one possible implementation, the howling parameter may include the power of the first sub-band signal. The electronic device can acquire the power spectrum corresponding to the first sub-band signal; based on the power spectrum, it acquires the power of the first sub-band signal as the howling parameter. The signal power varies with frequency, i.e., the distribution of signal power in the frequency domain. By acquiring the power spectrum of the first sub-band signal, the power of the first sub-band signal can be determined. Furthermore, the power of the signal exhibiting howling reflects the degree of howling; the higher the power, the greater the howling, and vice versa.

[0062] In another possible implementation, the howling parameter may include the detection value of the envelope detection signal corresponding to the first sub-band signal. The electronic device can acquire the envelope detection signal corresponding to the first sub-band signal; and acquire the detection value of the envelope detection signal as the howling parameter of the first sub-band signal. Specifically, the electronic device can acquire the envelope detection signal by performing envelope detection on the first sub-band signal, and then determine the above detection value based on the envelope detection signal. Furthermore, the detection value of the envelope detection signal can also reflect the degree of howling; the larger the detection value, the greater the howling degree, and vice versa.

[0063] In some implementations, the electronic device may pre-store a mapping relationship between howling suppression parameters and howling parameters, wherein the parameter values ​​of the howling suppression parameters and the howling parameters are positively correlated. When the electronic device obtains the howling parameters of the first sub-band signal and determines the howling suppression parameters, it can determine the howling suppression parameters corresponding to the howling parameters of the first sub-band signal based on the mapping relationship.

[0064] Step S230: Based on the howling suppression parameters, perform howling suppression processing on the first sub-band signal to obtain the second sub-band signal.

[0065] In this embodiment of the application, after the electronic device determines the howling suppression parameters, it can perform howling suppression processing on the first sub-band signal based on the determined howling suppression parameters, and use the signal obtained after howling suppression processing as the second sub-band signal.

[0066] In some implementations, the howling suppression parameter may include a frequency offset. The electronic device can perform frequency shifting processing on the first sub-band signal based on this frequency offset to obtain a second sub-band signal. Specifically, when the frequency offset is positive, the frequency of the first sub-band signal can be increased according to the frequency offset; when the frequency offset is negative, the frequency of the first sub-band signal can be decreased according to the frequency offset.

[0067] In one possible implementation, the electronic device may include a frequency shifter whose frequency offset can be adjusted. Based on this, the electronic device can adjust the frequency offset of the frequency shifter according to the howling suppression parameters determined above, and then input the first sub-band signal to the frequency shifter to obtain the frequency-shifted signal, which is then used as the second sub-band signal.

[0068] In another possible implementation, the electronic device can use a first preset filter and, based on a frequency offset, perform frequency shifting processing on the first sub-band signal to obtain a second sub-band signal. The first preset filter can be a Hilbert transform filter.

[0069] Optionally, the electronic device may acquire a target sine signal and a target cosine signal based on the frequency offset; filter the first sub-band signal based on the Hilbert transform filter to obtain a first intermediate signal; acquire the product of the target sine signal and the first intermediate signal to obtain a second intermediate signal; acquire the product of the target cosine signal and the first sub-band signal to obtain a third intermediate signal; and add the second intermediate signal and the third intermediate signal to obtain a second sub-band signal.

[0070] In this embodiment, the frequency offset Δf can be expressed as: Δf = sin(2πf / fs)f max Where f is the frequency of the oscillator, fs is the resonant frequency of the oscillator, and the oscillator is used to generate the target sine and cosine signals mentioned above. max This represents the maximum frequency offset. f can be less than 10 Hz.

[0071] Electronic devices can determine the angular frequencies ω0 of the desired sine and cosine signals based on a frequency offset Δf, where ω0 = 2πΔf / fs. Based on this, an oscillator can be controlled to generate the target sine signal -sin(ω0n) and the target cosine signal cos(ω0n) according to ω0, and frequency shifting can be achieved using -sin(ω0n) and cos(ω0n). Optionally, the oscillator can be a digital oscillator to generate different sine and cosine signals as needed.

[0072] Please see Figure 5The electronic device inputs the time-domain signal x(n) of the first sub-band signal to a Hilbert transform filter to obtain a first intermediate signal conv(x(n),h(n)), where conv represents convolution or filtering. Then, the first intermediate signal conv(x(n),h(n)) is multiplied by the target sine signal -sin(ω0n) to obtain a second intermediate signal y1 = conv(x(n),h(n))*(-sin(ω0n)). In addition, the time-domain signal x(n) of the first sub-band signal is multiplied by the target cosine signal to obtain a third intermediate signal y2 = x(n)*cos(ω0n). Then, the second intermediate signal and the third intermediate signal are added to obtain a second sub-band signal y(n) = y1(n) + y2(n). Therefore, the frequency shift processing of the first sub-band signal by the above frequency offset Δf can be realized. When the frequency offset Δf dynamically changes with the howling parameters of the first sub-band signal, the frequency offset can be dynamically adjusted to achieve the effect of adaptive frequency shift processing. Thus, when the howling parameter value is relatively low, the frequency offset is also relatively small, thereby reducing the overlap of howling sub-bands after frequency shifting or the generation of howling in other frequency bands. For example, as... Figure 6 As shown, Figure 6 The following is a time-domain effect diagram of shifting a 600Hz sine wave by 10Hz using the above method, as shown. Figure 7 As shown, Figure 7 The diagram shows the frequency domain effect of shifting a 600Hz sine wave by 10Hz using the above method. When the frequency offset Δf changes at a low frequency within the upper and lower frequency shift range, it can effectively suppress howling.

[0073] In some implementations, the howling suppression parameter may include a phase offset. The electronic device may perform phase shifting processing on the first sub-band signal based on this phase offset, and use the resulting signal as the second sub-band signal. Specifically, when the phase offset is positive, the phase of the first sub-band signal can be shifted forward by the phase offset; when the phase offset is negative, the phase of the first sub-band signal can be shifted backward by the phase offset.

[0074] In one possible implementation, the electronic device may include a phase shifter whose phase offset can be adjusted. Based on this, the electronic device can adjust the phase offset of the phase shifter according to the squealing suppression parameters determined above, and then input the first sub-band signal to the phase shifter to obtain the phase-shifted signal, which is then used as the second sub-band signal.

[0075] In another possible implementation, the electronic device can use a second preset filter to perform phase shifting processing on the first sub-band signal based on the phase offset to obtain the second sub-band signal. The second preset filter can be an all-pass filter, which does not have the commonly understood filtering function but is used to achieve phase correction, delay, delay equalization, etc., by changing the phase of the input signal.

[0076] Alternatively, the transfer function of the all-pass filter is as follows:

[0077]

[0078] Where z represents the z-domain, g represents the gain, and d represents the delay.

[0079] like Figure 8 As shown, Figure 8 A schematic diagram of an all-pass filter is shown. Based on this, and by adaptively adjusting the delay 'd', a filter with a constant amplitude-frequency response but dynamically changing phase can be achieved, thus realizing the phase adjustment corresponding to the aforementioned phase offset. For example... Figure 9 As shown, in Figure 8 The all-pass filter shown is adjusted, and the oscillator input delay signal d is fed to the z-axis of the all-pass filter. -d In this context, the phase can be dynamically adjusted, where d = sin(2πf / fsn)M + Q, f is the oscillator frequency, fs is the oscillator resonant frequency (typically f is less than 10Hz), M is the maximum modulation delay sample value, and Q is the fixed delay sample value. Optionally, the oscillator can be a sine wave oscillator, a triangular wave oscillator, etc., and is not limited here. For example, such as... Figure 10 As shown, Figure 10 The amplitude-frequency response diagram of the above-mentioned all-pass filter is shown, as follows: Figure 11 As shown, Figure 11 The diagram shows the phase frequency response of the above-mentioned all-pass filter. It can be seen that the phase shifting process corresponding to the phase offset can be achieved through the all-pass filter.

[0080] Therefore, the first sub-band signal can be frequency shifted by the above phase offset. When the phase offset changes dynamically with the howling parameters of the first sub-band signal, the phase offset can be dynamically adjusted to achieve the effect of adaptive phase shifting. Thus, when the howling parameter value is relatively low, the phase offset is also relatively small, thereby reducing the overlap of howling sub-bands after frequency shifting or the generation of howling in other frequency bands.

[0081] In some other implementations, the howling suppression parameter may include a gain reduction amount. The electronic device may reduce the gain of the first sub-band signal based on this gain reduction amount, thereby achieving howling suppression of the first sub-band signal through notch filtering.

[0082] Step S240: Mix the second sub-frequency band signal with other sub-frequency band signals in the audio signal other than the first sub-frequency band signal to obtain the target audio signal.

[0083] In this embodiment, step S240 can be found in other embodiments and will not be repeated here.

[0084] It should be noted that different implementation methods can be combined in the foregoing embodiments. In one possible implementation method, the above-mentioned howling suppression parameters may include frequency offset and phase offset. The electronic device can adaptively shift the frequency of the first sub-band signal according to the determined frequency offset, and then adaptively shift the phase of the first sub-band signal according to the phase offset to obtain the second sub-band signal. Then, the second sub-band signal is mixed with other sub-band signals to obtain the target audio signal. After the target audio signal passes through the sound system gain K, it is converted into an analog signal by a digital-to-analog converter (DAC), and then amplified by an amplifier (AMP) before being output to the speaker and played through the speaker. Optionally, the electronic device can decompose the howling suppression process into two parts based on the howling parameters of the first sub-band signal: one part is achieved through frequency shifting, and the other part is achieved through phase shifting. This allows for the determination of both the frequency offset and the phase offset. The frequency offset can be less than the offset required for howling suppression using frequency shifting alone, and the phase offset can be less than the offset required for howling suppression using phase shifting alone. This further reduces the overlap of howling sub-bands after frequency shifting or the generation of howling in other frequency bands. It should be noted that in this embodiment, the first sub-band signal can also be phase-shifted first, followed by frequency shifting; the order of these two processes is not limited.

[0085] The audio processing method provided in this application determines the frequency offset or phase offset based on the howling parameters of the detected sub-band signal with howling. Then, it performs frequency shifting or phase shifting based on the determined parameters. Therefore, the frequency offset or phase offset is relatively small, which can reduce the overlap of howling sub-bands after frequency shifting or the excitation of howling in other frequency bands, thereby improving the howling suppression effect.

[0086] Please see Figure 12 , Figure 12A schematic flowchart of another embodiment of the audio processing method provided in this application is shown. This audio processing method is applied to the aforementioned electronic device, and will be discussed below. Figure 12 The process shown will be described in detail. The audio processing method may specifically include the following steps:

[0087] Step S310: Perform preset processing on the audio signal acquired by the audio acquisition module to obtain multiple sub-frequency band signals of each frame of audio signal in the multi-frame audio signal.

[0088] In this embodiment, when performing feedback detection on the audio signal acquired by the audio acquisition module, the audio signal can be pre-processed to obtain multiple sub-frequency band signals for each frame of the multi-frame audio signal. The pre-processing includes analog-to-digital conversion, downsampling, framing, windowing, and then performing an N-point (sampling point) Fast Fourier Transform (FFT). This yields multiple sub-frequency band signals X(ω) for each frame of the audio signal. i ,m),X(ω) i ,m) represents the i-th sub-band ω of the m-th frame signal at a certain moment. i .

[0089] Understandably, to better satisfy the periodicity requirement of the Fourier transform process and reduce signal loss in the time domain, audio signals can be framed and windowed. The window function used for windowing can be a rectangular window, a Gaussian window, or a Kaiser window, etc., and the specific function form is not limited.

[0090] Step S320: Based on the power of each sub-band signal, determine the sub-band signal in the multi-frame audio signal that has howling, and use it as the first sub-band signal.

[0091] In this embodiment of the application, after obtaining each sub-frequency band signal in each frame of audio signal, the sub-frequency band signal with howling in each frame of audio signal can be determined based on the power of each sub-frequency band signal in each frame of audio signal, and this sub-frequency band signal can be used as the first sub-frequency band signal.

[0092] In some implementations, the electronic device may determine candidate sub-frequency band signals that meet a first preset condition in the multi-frame audio signals based on the power of each sub-frequency band signal; and determine candidate sub-frequency band signals that meet a second preset condition in the candidate sub-frequency band signals based on the audio signals of adjacent frames of the frame containing the candidate sub-frequency band signal, and use them as the first sub-frequency band signal.

[0093] In one possible implementation, the first preset condition can be a preliminary candidate condition for the presence of howling. The first preset condition can be a condition consisting of one or more of the following: peak threshold power ratio, peak mean power ratio, and peak neighbor power ratio.

[0094] Optionally, the first preset condition can be a condition satisfied by the peak threshold power ratio, setting the sub-frequency band ω. i The power threshold is P0, and the formula for calculating the peak-to-threshold power ratio is:

[0095]

[0096] If the peak threshold power ratio (PTPR) is greater than the first threshold, then the first preset condition is satisfied. The first threshold can be 0.

[0097] Optionally, the first preset condition can be a condition satisfied by the peak-to-average power ratio, with the average power across the entire frequency band set to P. m The formula for calculating the peak-to-mean power ratio (t) is:

[0098]

[0099] If the peak-to-average power ratio (PAPR) is greater than the second threshold, then the first preset condition is met. The second threshold can be 0.

[0100] Optionally, the first preset condition can be a condition satisfied by the peak nearest neighbor power ratio, where N adjacent sub-bands are selected for comparison, and the formula for calculating the peak nearest neighbor power ratio is:

[0101]

[0102] If the peak nearest neighbor power ratio (PNPR) is greater than the third threshold, then the first preset condition is satisfied. The third threshold can be 0.

[0103] In one possible implementation, candidate sub-band signals ω are selected. i Then, the candidate sub-band signal ω is statistically analyzed. i If the signal in the adjacent k frames of the current frame has the characteristic of increasing power, then it can be determined that the sub-band signal has howling, and it can be regarded as the first sub-band signal.

[0104] In another possible implementation, after the candidate sub-band signal is determined, it can also be determined whether there is the same candidate sub-band signal in the adjacent frames of the frame where the candidate sub-band signal is located. If there is the same candidate sub-band signal, it means that the sub-band signal is the candidate howling sub-band signal in multiple consecutive frames of audio signal. Therefore, it can be determined that the sub-band signal has howling.

[0105] By using the above method, after the candidate sub-band signals are determined, howling detection is performed through the second preset condition, thereby accurately detecting sub-band signals with howling and reducing meaningless detection decisions.

[0106] Step S330: Based on the howling parameters of the first sub-band signal, perform howling suppression processing on the first sub-band signal to obtain the second sub-band signal. The howling parameters are used to characterize the howling degree of the first sub-band signal.

[0107] Step S340: Mix the second sub-frequency band signal with other sub-frequency band signals in the audio signal other than the first sub-frequency band signal to obtain the target audio signal.

[0108] In the embodiments of this application, steps S330 and S340 can be referred to the contents of other embodiments, and will not be repeated here.

[0109] The audio processing method provided in this application improves the accuracy of feedback suppression, avoids sound quality loss, and enhances the feedback suppression effect by adaptively suppressing feedback based on the feedback degree of the sub-frequency band signal. In addition, when performing feedback detection, the method selects suspected feedback sub-frequency band signals based on the power of the sub-frequency band signal and then performs feedback detection through preset conditions, thereby accurately detecting feedback sub-frequency band signals and reducing meaningless decisions during feedback detection.

[0110] Please see Figure 13 , Figure 13 A flowchart illustrating an audio processing method provided in another embodiment of this application is shown. This audio processing method is applied to the aforementioned electronic device; in this embodiment, the electronic device is a headset. The following will focus on... Figure 13 The process shown will be described in detail. The audio processing method may specifically include the following steps:

[0111] Step S410: Detect the presence of a howling sub-band signal in the audio signal acquired by the audio acquisition module, and use it as the first sub-band signal.

[0112] In this embodiment, step S410 can be referred to the content of the foregoing embodiments, and will not be repeated here.

[0113] Step S420: If the earphone is being worn, based on the howling parameters of the first sub-band signal, howling suppression processing is performed on the first sub-band signal to obtain the second sub-band signal.

[0114] In this embodiment, the headphones can also detect their usage status, which includes a worn state or an unworn state. The worn state refers to the user wearing the headphones in their ears; the unworn state refers to the user not wearing the headphones in their ears. Optionally, if the headphones are in-ear type, when the headphones are worn, the earbuds are inserted into the ear canal, and the audio played by the headphones' speaker is transmitted to the user's ear canal through the sound outlet channel covered by the earbuds.

[0115] In some embodiments, a wear detection module can be provided on the earphone shell. This module is located on a designated surface of the earphone shell, which is the surface where the earphone head contacts the concha of the ear when worn. Optionally, a black circular hole can be formed on this designated surface, and the wear detection module can be installed within this hole. This wear detection module can be a light sensor, which includes a light-emitting unit and a light-sensing unit. The light-emitting unit can be an LED light, which emits infrared light that passes through a prism sheet on the circular hole and radiates outwards from the earphone. If there is an opaque object blocking the light, most of the light will be reflected back. The light-sensing unit determines whether there is an obstruction based on the intensity of the reflected light, thus inferring whether the earphone is being worn. Similarly, a second earphone can also be equipped with a wear detector, and the wear detection is used to determine whether the earphone is being worn. Of course, the specific type of wear detector is not limited; it can also be a touch sensor, pressure sensor, etc.

[0116] In this implementation, a state threshold corresponding to the wear detection module can be preset. The detection value detected by the wear detection module can be compared with the state threshold, and the result of the comparison can be used to determine whether the headphones are being worn. For example, when the wear detection module is a light sensor, the state threshold is a preset light intensity threshold. If the light intensity detected by the light sensor is lower than the preset light intensity threshold, the headphones are determined to be being worn; if the light intensity detected by the light sensor is greater than or equal to the preset light intensity threshold, the headphones are determined to be not being worn.

[0117] In this embodiment of the application, after detecting the first sub-frequency band signal, if the headphones are in the wearing state, it means that the user can hear the audio signal played by the headphones. At this time, the audio signal collected by the audio acquisition module can be suppressed to avoid affecting the user's experience. Therefore, the first sub-frequency band signal can be suppressed based on the feedback parameters of the first sub-frequency band signal to obtain the second sub-frequency band signal.

[0118] Step S430: If the earphone is not being worn and the value of the howling parameter is greater than a preset threshold, then howling suppression processing is performed on the first sub-band signal based on the howling parameter of the first sub-band signal to obtain the second sub-band signal.

[0119] In this embodiment, after detecting the first sub-frequency band signal, if the headphones are not being worn, it means the user cannot hear the audio signal played by the headphones. In this case, there may be no need to suppress howling of the audio signal acquired by the audio acquisition module. Considering that howling may damage the headphones, the parameter value of the howling parameter of the first sub-frequency band signal can be obtained and compared with a preset threshold. If the parameter value is greater than the preset threshold, it indicates that the howling of the first sub-frequency band signal will damage the headphones. Therefore, howling suppression processing can be performed on the first sub-frequency band signal based on the howling parameter to obtain the second sub-frequency band signal. If the parameter value is less than or equal to the preset threshold, it indicates that the howling of the first sub-frequency band signal will not damage the headphones. Since the user will not hear the audio signal played by the headphones, there is no impact on the user experience. Therefore, in this case, howling suppression processing of the first sub-frequency band signal is not required, and the audio signal acquired by the audio acquisition module can be directly output as the target audio signal.

[0120] Step S440: Mix the second sub-frequency band signal with other sub-frequency band signals in the audio signal other than the first sub-frequency band signal to obtain the target audio signal.

[0121] In this embodiment, step S440 can be referred to the content of the foregoing embodiments, and will not be repeated here.

[0122] The audio processing method provided in this application improves the accuracy of feedback suppression, avoids sound quality loss, and enhances the feedback suppression effect by adaptively suppressing feedback based on the feedback degree of the sub-frequency band signal. In addition, feedback suppression processing is performed on the sub-frequency band signal with feedback when the headphones are being worn, while feedback suppression processing is only performed on the first sub-frequency band signal when the feedback parameter value of the sub-frequency band signal is greater than a preset threshold when the headphones are not being worn, thus reducing the power consumption of the headphones.

[0123] Please see Figure 14This document illustrates a structural block diagram of an audio processing device 400 provided in an embodiment of this application. The audio processing device 400 utilizes the aforementioned electronic device, which includes an audio acquisition module. The audio processing device 400 includes: a feedback detection module 410, a feedback suppression module 420, and an audio synthesis module 430. The feedback detection module 410 detects feedback sub-band signals present in the audio signal acquired by the audio acquisition module, designating them as a first sub-band signal. The feedback suppression module 420 performs feedback suppression processing on the first sub-band signal based on feedback parameters of the first sub-band signal to obtain a second sub-band signal, where the feedback parameters characterize the feedback degree of the first sub-band signal. The audio synthesis module 430 mixes the second sub-band signal with other sub-band signals in the audio signal besides the first sub-band signal to obtain a target audio signal.

[0124] In some implementations, the howling suppression module 420 may be specifically used to: determine howling suppression parameters based on howling parameters of the first sub-band signal, wherein the parameter value of the howling suppression parameter is positively correlated with the parameter value of the howling parameter; and perform howling suppression processing on the first sub-band signal based on the howling suppression parameters to obtain a second sub-band signal.

[0125] In one possible implementation, the howling suppression parameter includes a frequency offset. The howling suppression module 420 performs howling suppression processing on the first sub-band signal based on the howling suppression parameter to obtain a second sub-band signal, which may include: performing frequency shifting processing on the first sub-band signal based on the frequency offset to obtain the second sub-band signal.

[0126] Optionally, the howling suppression module 420 can be specifically used to: perform frequency shifting processing on the first sub-band signal through a first preset filter and based on the frequency offset to obtain a second sub-band signal.

[0127] In another possible implementation, the howling suppression parameter includes a phase offset. The howling suppression module 420 can be specifically used to: perform phase-shifting processing on the first sub-band signal based on the phase offset to obtain a second sub-band signal.

[0128] Optionally, the howling suppression module 420 can be specifically used to: perform phase shifting processing on the first sub-band signal through a second preset filter and based on the phase offset to obtain a second sub-band signal.

[0129] In some embodiments, the audio processing device 400 may further include a power spectrum acquisition module and a first parameter acquisition module. The power spectrum acquisition module is used to acquire the power spectrum corresponding to the first sub-frequency band signal before performing howling suppression processing on the first sub-frequency band signal based on the howling parameters of the first sub-frequency band signal to obtain the second sub-frequency band signal; the first parameter acquisition module is used to acquire the power of the first sub-frequency band signal based on the power spectrum, as the howling parameter of the first sub-frequency band signal.

[0130] In some embodiments, the audio processing device 400 may further include a detection acquisition module and a second parameter acquisition module. The detection acquisition module is used to acquire an envelope detection signal corresponding to the first sub-frequency band signal before performing howling suppression processing on the first sub-frequency band signal based on the howling parameters of the first sub-frequency band signal to obtain the second sub-frequency band signal; the second parameter acquisition module is used to acquire the detection value of the envelope detection signal as the howling parameters of the first sub-frequency band signal.

[0131] In some implementations, the howling detection module 410 can be specifically used to: perform preset processing on the audio signal acquired by the audio acquisition module to obtain multiple sub-frequency band signals of each frame of audio signal in the multi-frame audio signal; and determine the sub-frequency band signal in the multi-frame audio signal where howling exists based on the power of each sub-frequency band signal, and use it as the first sub-frequency band signal.

[0132] In one possible implementation, the howling detection module 410 can also be specifically used to: determine candidate sub-frequency band signals that meet the first preset condition in the multi-frame audio signals based on the power of each sub-frequency band signal; and determine candidate sub-frequency band signals that meet the second preset condition in the candidate sub-frequency band signals based on the audio signals of the adjacent frames of the frame where the candidate sub-frequency band signal is located, and use them as the first sub-frequency band signal.

[0133] In some implementations, the electronic device is an earphone, and the howling suppression module 420 can be specifically used to: if the earphone is being worn, perform howling suppression processing on the first sub-frequency band signal based on the howling parameters of the first sub-frequency band signal to obtain the second sub-frequency band signal.

[0134] In one possible implementation, the howling suppression module 420 can also be used to: if the earphone is not being worn and the parameter value of the howling parameter is greater than a preset threshold, then perform howling suppression processing on the first sub-frequency band signal based on the howling parameter of the first sub-frequency band signal to obtain the second sub-frequency band signal.

[0135] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working process of the above-described device and module can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0136] In the several embodiments provided in this application, the coupling between modules can be electrical, mechanical, or other forms of coupling.

[0137] Furthermore, the functional modules in the various embodiments of this application can be integrated into one processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The integrated modules described above can be implemented in hardware or as software functional modules.

[0138] In summary, the solution provided in this application detects a sub-frequency band signal with feedback (howling) in the audio signal acquired by the audio acquisition module, using this sub-frequency band signal as the first sub-frequency band signal. Based on the feedback parameters of the first sub-frequency band signal, feedback suppression processing is performed on the first sub-frequency band signal to obtain a second sub-frequency band signal. These feedback parameters characterize the feedback degree of the first sub-frequency band signal. The second sub-frequency band signal is then mixed with other sub-frequency band signals in the audio signal besides the first sub-frequency band signal to obtain the target audio signal for output. Therefore, adaptive feedback suppression can be achieved based on the feedback degree of the sub-frequency band signal, thereby improving the accuracy of feedback suppression and ultimately enhancing the feedback suppression effect of the electronic device.

[0139] Please refer to Figure 15 The diagram illustrates a structural block diagram of an electronic device provided in an embodiment of this application. The electronic device 100 in this application may include one or more of the following components: a processor 110, a memory 120, and one or more application programs. The one or more application programs may be stored in the memory 120 and configured to be executed by one or more processors 110. The one or more application programs are configured to perform the methods described in the foregoing method embodiments.

[0140] Processor 110 may include one or more processing cores. Processor 110 connects to various parts within the electronic device 100 using various interfaces and lines, and performs various functions and processes data of the electronic device 100 by running or executing instructions, programs, code sets, or instruction sets stored in memory 120, and by calling data stored in memory 120. Optionally, processor 110 may be implemented using at least one hardware form of Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), or Programmable Logic Array (PLA). Processor 110 may integrate one or more of the following: Central Processing Unit (CPU), Graphics Processing Unit (GPU), and modem. The CPU primarily handles the operating system, user interface, and applications; the GPU is responsible for rendering and drawing the displayed content; and the modem handles wireless communication. It is understood that the modem may also not be integrated into processor 110 and may be implemented separately using a communication chip.

[0141] The memory 120 may include random access memory (RAM) or read-only memory (ROM). The memory 120 can be used to store instructions, programs, code, code sets, or instruction sets. The memory 120 may include a program storage area and a data storage area. The program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as touch functionality, sound playback functionality, image playback functionality, etc.), and instructions for implementing the various method embodiments described below. The data storage area may also store data created by the electronic device 100 during use (such as phonebook data, audio and video data, chat log data, etc.).

[0142] Please refer to Figure 16 This diagram illustrates a structural block diagram of a computer-readable storage medium provided in an embodiment of this application. The computer-readable medium 800 stores program code that can be called by a processor to execute the methods described in the above method embodiments.

[0143] The computer-readable storage medium 800 may be an electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read-Only Memory), EPROM, hard disk, or ROM. Optionally, the computer-readable storage medium 800 includes a non-transitory computer-readable storage medium. The computer-readable storage medium 800 has storage space for program code 810 that performs any of the method steps described above. This program code can be read from or written to one or more computer program products. The program code 810 may be compressed, for example, in a suitable form.

[0144] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this application.

Claims

1. An audio processing method, characterized in that, Applied to an electronic device, the electronic device including an audio acquisition module, the method includes: The sub-frequency band signal with howling is detected in the audio signal acquired by the audio acquisition module and is taken as the first sub-frequency band signal; Based on the howling parameters of the first sub-band signal, howling suppression processing is performed on the first sub-band signal to obtain the second sub-band signal. The howling parameters are used to characterize the howling degree of the first sub-band signal. The second sub-frequency band signal is mixed with other sub-frequency band signals in the audio signal except for the first sub-frequency band signal to obtain the target audio signal; The process of suppressing howling based on the howling parameters of the first sub-band signal to obtain the second sub-band signal includes: Based on the howling parameters of the first sub-band signal, howling suppression parameters are determined, and the parameter values ​​of the howling suppression parameters are positively correlated with the parameter values ​​of the howling parameters. Based on the howling suppression parameters, the first sub-band signal is subjected to howling suppression processing to obtain the second sub-band signal. The howling suppression parameters include at least one of frequency offset and phase offset. The howling suppression processing includes at least one of frequency shift processing based on the frequency offset and phase shift processing based on the phase offset.

2. The method according to claim 1, characterized in that, The howling suppression parameters include a frequency offset. The process of performing howling suppression processing on the first sub-band signal based on the howling suppression parameters to obtain the second sub-band signal includes: Based on the frequency offset, the first sub-band signal is frequency-shifted to obtain the second sub-band signal.

3. The method according to claim 2, characterized in that, The step of performing frequency shifting processing on the first sub-band signal based on the frequency offset to obtain the second sub-band signal includes: The first sub-band signal is frequency-shifted using a first preset filter and based on the frequency offset to obtain the second sub-band signal.

4. The method according to claim 1, characterized in that, The howling suppression parameters include a phase offset. The process of performing howling suppression processing on the first sub-band signal based on the howling suppression parameters to obtain the second sub-band signal includes: Based on the phase offset, the first sub-band signal is phase-shifted to obtain the second sub-band signal.

5. The method according to claim 4, characterized in that, The step of performing phase-shifting processing on the first sub-band signal based on the phase offset to obtain the second sub-band signal includes: The first sub-band signal is phase-shifted using a second preset filter and based on the phase offset to obtain the second sub-band signal.

6. The method according to claim 1, characterized in that, Before performing howling suppression processing on the first sub-frequency band signal based on the howling parameters of the first sub-frequency band signal to obtain the second sub-frequency band signal, the method further includes: Obtain the power spectrum corresponding to the first sub-band signal; Based on the power spectrum, the power of the first sub-band signal is obtained and used as the howling parameter of the first sub-band signal.

7. The method according to claim 1, characterized in that, Before performing howling suppression processing on the first sub-frequency band signal based on the howling parameters of the first sub-frequency band signal to obtain the second sub-frequency band signal, the method further includes: Obtain the envelope detection signal corresponding to the first sub-frequency band signal; The detection value of the envelope detection signal is obtained and used as the howling parameter of the first sub-band signal.

8. The method according to any one of claims 1-7, characterized in that, The detection of a howling sub-band signal in the audio signal acquired by the audio acquisition module, designated as the first sub-band signal, includes: The audio signal acquired by the audio acquisition module is subjected to preset processing to obtain multiple sub-frequency band signals for each frame of audio signal in the multi-frame audio signal; Based on the power of each sub-band signal, the sub-band signal with howling in the multi-frame audio signal is determined and designated as the first sub-band signal.

9. The method according to claim 8, characterized in that, The step of determining the sub-frequency band signal with howling in the multi-frame audio signal based on the power of each sub-frequency band signal, and using it as the first sub-frequency band signal, includes: Based on the power of each sub-band signal, candidate sub-band signals that meet the first preset condition are determined from the multi-frame audio signals; Based on the audio signals of adjacent frames of the candidate sub-frequency band signal, the candidate sub-frequency band signal that meets the second preset condition is determined and used as the first sub-frequency band signal.

10. The method according to any one of claims 1-7, characterized in that, The electronic device is an earphone. The process of suppressing howling based on the howling parameters of the first sub-band signal to obtain the second sub-band signal includes: If the earphone is being worn, the first sub-band signal is subjected to feedback suppression processing based on the feedback parameters of the first sub-band signal to obtain the second sub-band signal.

11. The method according to claim 10, characterized in that, The step of performing howling suppression processing on the first sub-frequency band signal based on the howling parameters of the first sub-frequency band signal to obtain the second sub-frequency band signal further includes: If the earphone is not being worn and the value of the howling parameter is greater than a preset threshold, then howling suppression processing is performed on the first sub-band signal based on the howling parameter of the first sub-band signal to obtain the second sub-band signal.

12. An audio processing device, characterized in that, Applied to electronic devices, the electronic devices include an audio acquisition module, and the device includes: a feedback detection module, a feedback suppression module, and an audio synthesis module, wherein... The feedback detection module is used to detect feedback sub-band signals in the audio signals acquired by the audio acquisition module, and use them as the first sub-band signals; The howling suppression module is used to perform howling suppression processing on the first sub-band signal based on the howling parameters of the first sub-band signal to obtain the second sub-band signal. The howling parameters are used to characterize the howling degree of the first sub-band signal. The audio synthesis module is used to mix the second sub-frequency band signal with other sub-frequency band signals in the audio signal other than the first sub-frequency band signal to obtain the target audio signal; The audio synthesis module is specifically used to determine howling suppression parameters based on howling parameters of the first sub-band signal, wherein the parameter value of the howling suppression parameter is positively correlated with the parameter value of the howling parameter; and to perform howling suppression processing on the first sub-band signal based on the howling suppression parameters to obtain a second sub-band signal, wherein the howling suppression parameters include at least one of frequency offset and phase offset, and the howling suppression processing includes at least one of frequency shift processing based on the frequency offset and phase shift processing based on the phase offset.

13. An electronic device, characterized in that, include: One or more processors; Memory; One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs being configured to perform the method as described in any one of claims 1-11.

14. A computer-readable storage medium, characterized in that, The computer-readable storage medium contains program code that can be invoked by a processor to execute the method as described in any one of claims 1-11.

Images