Howling suppression method and apparatus, and electronic device and readable storage medium

Abstract

The present application belongs to the technical field of audio. Disclosed are a howling suppression method and apparatus, and an electronic device and a readable storage medium. The method comprises: on the basis of a cepstrum envelope of a first audio frame, determining a howling signal within a frequency range of the first audio frame, wherein the howling signal comprises a howling frequency point or a howling frequency band; and on the basis of the cepstrum envelope, suppressing the howling signal.

Description

Howling suppression method, device, electronic device and readable storage medium

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to Chinese patent application No. 202311154363.6, filed on September 7, 2023, entitled “Howling Suppression Method, Device, Electronic Device and Readable Storage Medium”, which is incorporated herein by reference in its entirety. Technical Field

[0003] The present application belongs to the field of audio technology, and specifically relates to a howling suppression method, device, electronic device and readable storage medium. Background Art

[0004] In the Public Address System (PAS) and Hands-free Communication System (HFCS), the presence of howling will greatly affect the voice call quality.

[0005] Currently, howling can be detected based on a signal model of adaptive filter feedback control (AFC) or by using a notch filter (NH), and the detected howling can be suppressed to improve voice call quality.

[0006] However, the above methods are all limited by traditional signal models, and will detect spectrum structures similar to howling as howling and suppress them, resulting in poor howling suppression effects.

[0007] Summary of the Invention

[0008] The purpose of the embodiments of the present application is to provide a howling suppression method, device, electronic device, and readable storage medium, which can solve the problem of poor howling suppression effect.

[0009] An embodiment of the present application provides a howling suppression method, the method comprising: determining a howling signal within a frequency range of the first audio frame based on a cepstrum envelope of the first audio frame, where the howling signal includes a howling frequency point or a howling frequency band; and suppressing the howling signal based on the cepstrum envelope.

[0010] An embodiment of the present application also provides a howling suppression device, which includes a determination module and a suppression module; the determination module is used to determine a howling signal within a frequency range of the first audio frame based on the cepstrum envelope of the first audio frame, where the howling signal includes a howling frequency point or a howling frequency band; the suppression module is used to suppress the howling signal based on the cepstrum envelope.

[0011] An embodiment of the present application also provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0012] An embodiment of the present application further provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0013] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0014] An embodiment of the present application further provides a computer program product, which is stored in a storage medium and is executed by at least one processor to implement the method as described in the first aspect.

[0015] In an embodiment of the present application, a howling signal within the frequency range of the first audio frame can be determined based on the cepstral envelope of the first audio frame, where the howling signal includes a howling frequency point or a howling frequency band. Furthermore, the howling signal can be suppressed based on the cepstral envelope. This solution allows for the determination and suppression of howling frequencies or frequency bands within an audio frame based on the cepstral envelope of the audio frame, i.e., it allows for howling detection and suppression based on the characteristics of the audio signal itself. Therefore, howling can be detected and suppressed without being constrained by traditional signal models, avoiding the suppression of spectral structures similar to howling, thereby improving the effectiveness of howling suppression. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] FIG1 is a schematic diagram of a sound feedback system with a single microphone and a single speaker in the related art;

[0017] FIG2 is a schematic diagram of a multi-microphone and multi-speaker sound feedback system in the related art;

[0018] FIG3 is a flow chart of a howling suppression method according to an embodiment of the present application;

[0019] FIG4 is a schematic diagram of a first audio frame and its cepstral envelope in the howling suppression method provided in an embodiment of the present application;

[0020] FIG5 is a second flowchart of the howling suppression method provided in an embodiment of the present application;

[0021] FIG6 is a third flowchart of the howling suppression method provided in an embodiment of the present application;

[0022] FIG7 is a fourth flowchart of the howling suppression method provided in an embodiment of the present application;

[0023] FIG8 is a fifth flowchart of the howling suppression method provided in an embodiment of the present application;

[0024] FIG9 is a sixth flowchart of the howling suppression method provided in an embodiment of the present application;

[0025] FIG10 is a schematic diagram showing the effect of suppressing the howling frequency band in the howling suppression method provided in an embodiment of the present application;

[0026] FIG11 is a schematic diagram of a howling suppression device provided in an embodiment of the present application;

[0027] FIG12 is a schematic diagram of an electronic device provided in an embodiment of the present application;

[0028] FIG13 is a hardware diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0029] The following will be combined with the accompanying drawings in the embodiments of this application to clearly describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field are within the scope of protection of this application.

[0030] The terms "first," "second," and the like in the specification and claims of this application are used to distinguish similar objects, and are not used to describe a specific order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate, so that the embodiments of this application can be implemented in an order other than that illustrated or described herein, and that the objects distinguished by "first," "second," and the like are generally of the same type, and do not limit the number of objects; for example, the first object can be one or more. In addition, the term "and / or" in the specification and claims refers to at least one of the connected objects, and the character " / " generally indicates that the objects connected are in an "or" relationship.

[0031] The term "indication" in this application can be either a direct indication (or explicit indication) or an indirect indication (or implicit indication). A direct indication can be understood as the sender explicitly informing the receiver of specific information, the operation to be performed, or the requested result, etc. in the instruction sent; an indirect indication can be understood as the receiver determining the corresponding information based on the instruction sent by the sender, or making a judgment and determining the operation to be performed or the requested result, etc. based on the judgment result.

[0032] The terms "at least one" and "at least one of" in the specification and claims of this application refer to any one, any two, or a combination of more than two of the objects included. For example, at least one of a, b, and c can be represented by: "a", "b", "c", "a and b", "a and c", "b and c", and "a, b, and c", where a, b, and c can be single or multiple. Similarly, "at least two" means two or more, and its meaning is similar to "at least one".

[0033] First, some nouns or terms involved in the description and claims of this application are explained below.

[0034] Howling: The tail sound of a microphone's sound at the critical point of acoustic feedback. Howling is a common abnormality in sound reinforcement systems. Two conditions must be met simultaneously for howling to occur: a phase condition, requiring the acoustic signal fed back to the microphone to be in phase with the original sound source input signal; and an amplitude condition, requiring the acoustic feedback loop to be positive, meaning the feedback gain is greater than 1.

[0035] Cepstrum envelope: the envelope of the cepstrum; the cepstrum is a signal obtained by performing a logarithmic operation on the Fourier transform spectrum of a signal and then performing an inverse Fourier transform. Since the Fourier spectrum is generally a complex spectrum, it is also called a complex cepstrum; the envelope is a graph formed by the interweaving of many elliptical curves, and it looks like it is wrapped. In mathematics, the envelope of a family of plane lines (or curves) refers to a curve that is tangent to any of the lines (or curves) in this family.

[0036] The howling suppression method, device, electronic device, and readable storage medium provided by the embodiments of the present application are described in detail below with reference to the accompanying drawings through specific embodiments and their application scenarios.

[0037] In PAS and HFCS, acoustic feedback has been a prominent problem that has long plagued the industry. Acoustic feedback refers to the phenomenon in which sound emitted by the speaker is transmitted back to the microphone through different paths.

[0038] Exemplarily, as shown in Figure 1, s(t) is the sound source signal, F is the transfer function of the sound feedback path, G is the transfer function of the electroacoustic forward path, and the output signal of the speaker is u(t) = G*y(t); wherein, y(t) = x(t) + s(t) represents the signal captured by the microphone, x(t) = F*u(t) represents the signal obtained by the speaker output after passing through the sound feedback transfer function, and * represents the convolution operation.

[0039] The main reason for howling in PAS and HFCS is that certain strong frequencies in the signal, through the gain of the electrical signal transmission path G and the feedback path F, their energy increases in this closed positive feedback system, leading to system instability and ultimately generating howling. Howling has several distinct characteristics. First, it presents a periodic, piercing, and sharp sound, the energy of which increases over time. Second, howling mostly occurs in the mid-frequency or high-frequency range, specifically manifesting as the energy of certain mid-frequency and high-frequency points far exceeding that of normal harmonics. Third, the howling frequency point can be a single frequency point or multiple frequencies, but generally does not appear continuously in the spectrum.

[0040] The presence of howling greatly affects the quality of voice calls. To solve this problem, many methods have emerged, such as adaptive filter-based feedback control (AFC) signal models or the use of NH to suppress specific howling frequencies. However, these methods all follow the principle of detecting howling first and then suppressing it, or suppressing it while detecting it. This means that the effectiveness of howling suppression depends largely on the accuracy of howling detection. Once howling detection is falsely triggered, it can easily damage normal speech. For example, there are many pronunciations in unvoiced speech, such as "shi", "zhi" or "qi", whose spectral structures show characteristics similar to howling. Once these pronunciations are detected as howling and the howling suppression algorithm is triggered, the speech can easily be damaged.

[0041] As shown in Figure 1, most current AFC and NH algorithms are based on this model: a single feedback path with a single speaker and microphone. This model is often used with acoustic echo cancellation (AEC). However, howling can arise from far more than just this feedback structure. Figure 2 illustrates the acoustic feedback path in a gaming chat scenario. Assume that multiple people are playing a team game chat, with two of them within 1 meter of each other and both using their phone's speakers and microphones. Figure 2 simulates this acoustic feedback path, with G1 and G2 representing the electrical signal paths between the two phones. Ideally, F' represents the propagation feedback path between the two phones. As users constantly operate their phones or move around during gaming, the position between the two phones changes in real time, causing F' to also change in real time. This makes the single feedback structure shown in Figure 1 inadequate for describing this scenario. Since single feedback structures typically assume F remains constant, the model is theoretically unsuitable for this complex feedback path scenario. This description describes an ideal scenario where the acoustic feedback path of two mobile phones shares a single F'. However, in reality, users may use different brands and models of mobile phones. Different mobile phones may have different structural features. The position of the microphone and speaker on the phone, the material of the phone itself, the conductive structure, etc. will all lead to different feedback paths for the two phones. The actual scenario is only more complex than this idealized model and is more prone to howling. Therefore, the traditional single feedback path model cannot solve this problem. This results in poor howling suppression effect, which in turn damages normal speech.

[0042] To improve the accuracy of howling detection and reduce false triggers, many howling detection metrics have been proposed. For example, the Peak-to-Threshold Power Ratio (PTPR) feature calculates the ratio of the energy in the frequency band where howling may occur to the threshold. When this ratio exceeds a certain range, howling is considered to have occurred. The Peak-to-Harmonic Power Ratio (PHPR) feature calculates the ratio of the energy in the howling frequency band to the energy of its harmonics. The Interframe Peak Magnitude Persistence (IPMP) feature calculates the persistence of the energy in the howling frequency band over consecutive time frames. There are many other similar howling detection features, but most of them are designed based on the energy characteristics of howling.

[0043] In addition to using the traditional signal models or features mentioned above, directly using neural networks (NNs) for howling suppression has also become a common approach in recent years. However, NN algorithms are often limited by the computing power of howling datasets and the inference capabilities of terminal devices. Therefore, when using NN algorithms for howling processing, howling is usually treated as noise and integrated into the noise reduction network, or noise reduction, echo cancellation, and howling suppression are all integrated into a single large model. This places certain demands on the computing power of terminal devices, thus limiting its scope of application.

[0044] To solve the above problems, the embodiments of the present application provide a howling suppression method, device, electronic device, and readable storage medium. The howling suppression method provided in the embodiments of the present application can be applied to scenarios such as hands-free calls, game voice chats, and multi-person conferences.

[0045] In the howling suppression method provided in an embodiment of the present application, a howling signal within the frequency range of the first audio frame can be determined based on the cepstral envelope of the first audio frame. The howling signal includes a howling frequency point or a howling frequency band. Furthermore, the howling signal is suppressed based on the cepstral envelope. This solution allows for the determination and suppression of howling frequencies or frequency bands within an audio frame based on the cepstral envelope of the audio frame. This allows for howling detection and suppression based on the characteristics of the audio signal itself. Therefore, the method eliminates the need for traditional signal models, avoids suppressing spectral structures similar to howling, and thus improves the effectiveness of howling suppression.

[0046] In addition, there is no need to perform a large amount of calculations through a large amount of data sets like the above-mentioned NN algorithm, which can save computing power and power consumption of electronic devices.

[0047] It should be noted that the howling suppression method provided in the embodiments of the present application can be executed by a howling suppression device, an electronic device, or a functional module in the electronic device. In some embodiments of the present application, the howling suppression method provided in the embodiments of the present application is described by taking an electronic device executing the howling suppression method as an example.

[0048] FIG3 shows a flow chart of a howling suppression method provided by an embodiment of the present application. As shown in FIG3 , the howling suppression method provided by an embodiment of the present application may include the following steps 301 and 302 .

[0049] Step 301: The electronic device determines a howling signal within a frequency range of the first audio frame based on a cepstrum envelope of the first audio frame.

[0050] The howling signal includes a howling frequency point or a howling frequency band.

[0051] In the embodiment of the present application, the above-mentioned howling frequency points are the frequency points that generate howling, that is, only isolated frequency points in the entire spectrum generate self-excited feedback. This kind of howling usually occurs in the low- to medium-frequency band below 6 kHz.

[0052] In the embodiment of the present application, the howling frequency band is a frequency band where howling occurs, that is, a certain sub-band on the spectrum generates howling. Such howling usually occurs in the mid-high frequency band above 2 kHz.

[0053] In some embodiments of the present application, the number of the howling frequency points may be one or more.

[0054] In some embodiments of the present application, the number of the howling frequency bands may be one or more.

[0055] In some embodiments of the present application, the first audio frame may be an audio frame of an audio signal picked up by the electronic device at the current moment of the system.

[0056] In some embodiments of the present application, the above-mentioned audio signal may be a voice call audio signal.

[0057] In some embodiments of the present application, the above-mentioned audio signal may include multiple continuous audio frames. Whenever the electronic device picks up an audio frame, the electronic device may determine the howling signal within the frequency range of the audio frame based on the cepstral envelope of the picked-up audio frame.

[0058] In some embodiments of the present application, after picking up the first audio frame, the electronic device may first calculate the cepstral envelope of the first audio frame.

[0059] For example, assuming that the first audio frame is s(t), the electronic device may first perform Fourier transform on s(t) using the following formula (1) to obtain a frequency domain signal X(jω):

[0060] Then, the electronic device calculates the cepstrum C of the first audio frame according to X(jω) using the following formula (2):

[0061] Among them, the first several points of the above cepstrum C are N, and then the electronic device continues to perform Fourier transform on the N points to obtain Finally, the electronic device can calculate the cepstrum envelope E(t, f) of the first audio frame using the following formula (3): E(t, f) = Real(C'(t, f)). (3)

[0062] It's important to note that the cepstral envelope reflects the changing characteristics of the spectrum, and the size of N determines how precisely the envelope depicts the spectrum. The larger N, the finer the depiction. In practice, with a 16kHz sampling rate and a 10ms frame length, a value of N between 10 and 15 generally yields ideal results, effectively capturing the characteristics of howling and speech.

[0063] Figure 4 shows a schematic diagram of the above-mentioned first audio frame and its cepstral envelope. As shown in Figure 4, curve 41 is the frequency spectrum of the first audio frame, and curve 42 is the cepstral envelope of the first audio frame. It can be seen that curve 42 can accurately reflect the changing characteristics of curve 41 and can effectively reduce the redundant information in curve 41.

[0064] In some embodiments of the present application, in combination with FIG. 3 , as shown in FIG. 5 , the above step 301 may be specifically implemented through the following step 301 a.

[0065] Step 301a: The electronic device determines the howling frequency according to the frequency strength of each peak frequency of the first audio frame and the frequency strength of the corresponding frequency of each peak frequency in the cepstrum envelope.

[0066] In some embodiments of the present application, before determining the howling frequency, the electronic device may first define a frequency set P, where the frequency set P satisfies the following condition (a):

[0067] Wherein, L is the window length of Fourier transform; It can be seen that the frequency points in the above frequency point set P are all the peak frequency points in the above first audio frame;

[0068] Then, the electronic device may determine a frequency set Q that satisfies the following condition (b) from the frequency set P based on the frequency strength of each peak frequency point and the frequency strength of the corresponding frequency point of each peak frequency point in the cepstrum envelope:

[0069] Among them, α and β are adjustable parameters, which determine the width of the frequency point of howling suppression; the smaller α and β are, the more it can be considered that the frequency point p i is the above-mentioned howling frequency point. On the contrary, the larger α and β are, the more it can be considered that p i It is not the howling frequency point; in actual application, when α = 10 and β = 20, the effect is better. It can be seen that each frequency point in the above frequency point set Q satisfies: the frequency point intensity is greater than the sum of the frequency point intensity of the previous frequency point and α, and greater than the sum of the frequency point intensity of the corresponding frequency point of the previous frequency point in the above cepstrum envelope and β;

[0070] Therefore, the electronic device may determine the frequency points in the frequency point set Q as the howling frequency points.

[0071] In the embodiment of the present application, since the electronic device can determine the howling frequency based on the frequency strength of each peak frequency point of the first audio frame and the frequency strength of the frequency point corresponding to each peak frequency point in the cepstrum envelope, the howling frequency point can be determined based on the curve characteristics of the audio signal itself, thereby improving the accuracy of determining the howling frequency point.

[0072] In some embodiments of the present application, in combination with FIG. 3 , as shown in FIG. 6 , the above step 301 may be specifically implemented through the following step 301 b.

[0073] Step 301b: The electronic device determines the howling frequency band according to the frequency domain position of the local maximum value and the frequency domain position of the local minimum value in the cepstrum envelope.

[0074] In some embodiments of the present application, before determining the howling frequency band, the electronic device may first determine the local maximum value |E MC |: |E MC |=max(H max ),H max ={h i :|E(h i )|>|E(h i +1)|&&|E(h i )|>|E(h i -1)|}; (c)

[0075] Then, the local minimum H is determined by the following condition (d): min : H min ={h i :|E(h i )|<|E(h i +1)|&&|E(h i )|<|E(h i -1)}; (d)

[0076] Then, according to the above |E MC The corresponding frequency domain position f MC , determine the frequency domain position f MC On the left and right sides, and the distance from the frequency domain position f MC The frequency domain position of the nearest local minimum is denoted as f MC-L and f MC-R , then:

[0077] Thus, the electronic device can MC-Land f MC-R The frequency band between is determined as the above-mentioned howling frequency band.

[0078] In the embodiment of the present application, since the electronic device can determine the above-mentioned howling frequency band based on the frequency domain position of the local maximum value and the frequency domain position of the local minimum value in the above-mentioned cepstrum envelope, the howling frequency band can be determined based on the curve characteristics of the audio signal itself, thereby improving the accuracy of determining the howling frequency band.

[0079] Step 302: The electronic device suppresses the howling signal based on the cepstrum envelope and the frame type of the first audio frame.

[0080] In some embodiments of the present application, the electronic device may suppress the howling signal based on the cepstrum envelope and the frame type of the first audio frame.

[0081] In some embodiments of the present application, the howling signal includes the howling frequency. For example, in conjunction with FIG3 , as shown in FIG7 , the step 302 can be implemented through the following steps 302a and 302b.

[0082] Step 302a: The electronic device determines at least one target frequency point of the first audio frame according to the frame type of the first audio frame.

[0083] The at least one target frequency point includes the howling frequency point.

[0084] In some embodiments of the present application, the at least one target frequency point is a frequency point other than the howling frequency point, that is, a frequency point adjacent to the howling frequency point and having a greater frequency intensity.

[0085] In some embodiments of the present application, the frame type may be a voiced frame, an unvoiced frame, or a non-speech frame.

[0086] In some embodiments of the present application, the above step 302a can be specifically implemented through the following step A or step B.

[0087] Step A: When the frame type of the first audio frame is a voiced sound frame, the electronic device determines at least one target frequency point in the first frequency point set.

[0088] Step B: When the frame type of the first audio frame is a non-voiced frame, the electronic device determines at least one target frequency point in the second frequency point set;

[0089] The frequency range of the first frequency set is smaller than or equal to the frequency range of the second frequency set.

[0090] In some embodiments of the present application, the non-voiced frames may be unvoiced frames or non-speech frames.

[0091] In some embodiments of the present application, the frequency range of the above-mentioned first frequency set is less than or equal to the frequency range of the above-mentioned second frequency set, that is, the number of frequencies in the first frequency set is less than or equal to the number of frequencies in the second frequency set.

[0092] For example, the frequency range of the first frequency set is [-a, a], and the frequency range of the second frequency set is [-b, b], where a and b are both positive integers, and a is less than or equal to b.

[0093] It should be noted that, in actual implementation, the frequency range of the above-mentioned first frequency point set is usually smaller than the frequency range of the above-mentioned second frequency point set; and for some audio frames that meet specific spectral characteristics (such as critical curve characteristics of voiced frames and non-voiced frames), the frequency range of the first frequency point set can be made equal to the frequency range of the second frequency point set, that is, regardless of whether the frame type is a voiced frame or a non-voiced frame, at least one target frequency point can be determined within the same frequency point set, thereby simplifying the computational complexity of determining the target frequency point while ensuring the suppression effect.

[0094] In the embodiment of the present application, since the electronic device can determine the at least one target frequency from the frequency set corresponding to the frame type of the first audio frame according to the frame type of the first audio frame, different numbers of target frequencies near the howling frequency can be determined as frequencies to be suppressed according to the frame type, thereby improving the flexibility of howling suppression.

[0095] Step 302b: The electronic device suppresses at least one target frequency point according to the frequency point strength of each target frequency point and the frequency point strength of the corresponding frequency point of each target frequency point in the cepstrum envelope.

[0096] In some embodiments of the present application, the electronic device may suppress the at least one target frequency point using the following formula (4):

[0097] Wherein, the above-mentioned γ is an adjustable parameter used to control the suppression strength of the above-mentioned at least one target frequency point. Usually, the value of γ is between (0, 1); if the above-mentioned frame type is a voiced frame, then K=1 or K=3; if the frame type is an unvoiced frame, then K=3 or K=5.

[0098] It should be noted that, in actual implementation, the electronic device may also suppress only the above-mentioned howling frequency points. In this case, it is only necessary to set the value of m in the above-mentioned formula (4) to 0.

[0099] In an embodiment of the present application, since the electronic device can suppress the at least one target frequency determined by the frame type of the first audio frame based on the frequency strength of each target frequency and the frequency strength of the frequency corresponding to each target frequency in the cepstral envelope, the howling frequency and several frequency points adjacent to the howling frequency can be suppressed based on the characteristics of the audio signal itself, thereby improving the effect of suppressing the howling frequency.

[0100] In some embodiments of the present application, the howling signal includes the howling frequency band. For example, in conjunction with FIG3 , as shown in FIG8 , the step 302 can be implemented by the following step 302c.

[0101] Step 302c: When the first probability value is greater than or equal to the first threshold, the electronic device suppresses the howling frequency band based on the cepstrum envelope and the frame type of the first audio frame.

[0102] In which, the above-mentioned first probability value is used to indicate the probability of frequency band howling occurring in the above-mentioned first audio frame, and the first probability value is determined based on at least one of the first feature, the second feature and the third feature, the first feature is used to indicate the ratio of the frequency point intensity peak and the low-frequency energy difference in the above-mentioned cepstrum envelope, the second feature is used to indicate the bandwidth of the spectral peak of the cepstrum envelope, and the third feature is used to indicate the slope between the spectral peak and the spectral valley of the cepstrum envelope.

[0103] It should be noted that the above-mentioned first feature, second feature and third feature are all defined based on the above-mentioned cepstrum envelope, and are not designed directly from the energy perspective of the frequency domain or time domain like PTPR or PHPR in related technologies, so that howling can be more easily distinguished from normal speech.

[0104] In some embodiments of the present application, the first feature may be a ratio of the cepstrum envelope peak to low frequency strength (CEPTLFS), which may be defined as the following formula (5):

[0105] in, is the average energy of the low spectrum peak, which can be obtained based on the above condition (a) If the above frame type is a voiced frame, then It can be approximated as the energy intensity of voiced sound; if the above frame type is non-voiced frame, then is the energy intensity in the low frequency region.

[0106] For example, if the frame type is a voiced frame and |E MC| falls in the mid-frequency band, the larger the CEPTLFS, the greater the probability of howling in the mid-frequency band; if the frame type is a non-voiced frame, the value of the first feature can be used as a reference for the difference in mid- and low-frequency energy, and other features need to be introduced for judgment.

[0107] In some embodiments of the present application, the second feature may be a Cepstrum Envelope Peak Band Width Ratio (CEPBWR), which may be defined as the following formula (6):

[0108] In some embodiments of the present application, if it is speech, then f MC-R -f MC-L The larger the value, the smaller the corresponding CEPBWR will be. If it is howling, the energy of howling is usually more concentrated and mostly narrowband signal. MC-R -f MC-L It will be smaller, and the corresponding CEPBWR will be larger.

[0109] In some embodiments of the present application, the third feature may be a Cepstrum Envelope Peak-to-Valley Slope (CEPTVS), which may be defined as the following formula (7):

[0110] In some embodiments of the present application, the above-mentioned CEPTVS describes the speed of change from the envelope spectrum peak to the spectrum valley. Howling is usually a rapid change from low energy to high energy in the frequency domain, while the energy distribution of speech in the frequency domain is relatively stable. Therefore, the larger the CEPTVS, the more likely it is howling.

[0111] For example, taking the case where the first probability value is determined based on the first feature, the second feature, and the third feature, before suppressing the howling frequency band, the electronic device may first calculate the first probability value prob using the following formula (8): prob = w1CEPTLFS + w2CEPBWR + w3CEPTVS; (8)

[0112] Among them, w1, w2 and w3 are weights.

[0113] In some embodiments of the present application, the above-mentioned first threshold may be preset by the system, or may be set by the user according to actual usage requirements, which is not limited in the embodiments of the present application.

[0114] It should be noted that, the greater the first probability value, the greater the probability that the first audio frame will have frequency band howling; conversely, the smaller the first probability value, the smaller the probability that the first audio frame will have frequency band howling.

[0115] In the embodiment of the present application, since the electronic device suppresses the howling frequency band based on the cepstrum envelope and the frame type only when the first probability value indicating the probability of frequency band howling occurring in the first audio frame is greater than or equal to the first threshold, unnecessary howling frequency band suppression can be improved and reduced, thereby saving power consumption of the electronic device.

[0116] In some embodiments of the present application, as shown in FIG9 in combination with FIG8 , the above step 302c can be specifically implemented through the following step 302c1 , step 302c2 or step 302c3 .

[0117] Step 302c1: When the first probability value is greater than or equal to the first threshold and the frame type is a non-voice frame, the electronic device suppresses the howling frequency band according to the frequency intensity of each frequency point in the howling frequency band.

[0118] In some embodiments of the present application, when the frame type is the non-speech frame, the electronic device may suppress the howling frequency band using the following formula (9):

[0119] Step 302c2: When the first probability value is greater than or equal to the first threshold and the frame type is a voiced frame, the electronic device suppresses the howling frequency band based on the frequency intensity of each frequency point in the howling frequency band, the frequency intensity peak value, and the average energy of the low frequency spectrum peak of the cepstrum envelope.

[0120] In some embodiments of the present application, when the frame type is the voiced frame, the electronic device may suppress the howling frequency band using the following formula (10):

[0121] Step 302c1: When the first probability value is greater than or equal to the first threshold and the frame type is an unvoiced frame, the electronic device suppresses the howling frequency band based on the frequency intensity and frequency intensity peak of each frequency point in the howling frequency band and the intensity of the first audio frame.

[0122] In some embodiments of the present application, when the frame type is the unvoiced frame, the electronic device may specifically suppress the howling frequency band using the following formula (11):

[0123] in, The intensity of the first audio frame may be determined by the intensity of the voiced frame closest to the first audio frame.

[0124] In this way, electronic devices can suppress the above-mentioned howling frequency bands according to different frame types, so as to effectively protect the voice when the howling and voice frames overlap, suppressing the howling to an intensity close to the voice energy, thereby maximizing the listening experience without damaging the voice.

[0125] In the embodiment of the present application, since the electronic device can perform howling frequency band suppression based on the frame type of the first audio frame using a suppression strategy corresponding to the frame type, the flexibility and accuracy of suppressing the howling frequency band can be improved.

[0126] It should be noted that if there are multiple howling frequencies or frequency bands, the above method can be used to suppress each howling frequency or frequency band separately to ensure the quality of the picked up voice. Moreover, the howling suppression methods provided in the embodiments of the present application only adjust the amplitude of the signal; the phase of the signal remains unchanged throughout the suppression process.

[0127] The following is an illustrative description of the effect of howling suppression using the howling suppression method provided in the embodiments of the present application with reference to the accompanying drawings.

[0128] For example, as shown in FIG10 , there is a test corpus when howling occurs. The audio frame has a sampling rate of 16 kHz, a frame length of 10 ms, a fast Fourier transform length of 512, and an offset of 160. The first channel is the original input signal, and the second channel is the signal after howling suppression is performed on the original signal using the howling suppression method provided in the embodiment of the present application. Among them, the signal in region 12 is the signal after suppressing the howling frequency band in region 11, and the signal in region 12 is the signal after suppressing the howling frequency point in region 13. It can be seen that the howling suppression method provided in the embodiment of the application can accurately suppress the frequency points and frequency bands where howling occurs, and when howling and speech overlap, it can also suppress the howling while reducing the speech damage to a sub-band of limited width. For scenarios such as multi-person hands-free calls and game voice chats, it does not affect the user's listening experience, and the computing power consumption based on traditional signal processing algorithms is extremely low, making it easy to deploy.

[0129] In the howling suppression method provided in the embodiment of the present application, since the howling frequency point or howling frequency band in the audio frame can be determined and suppressed based on the cepstrum envelope of the audio frame, that is, howling detection and suppression can be performed based on the characteristics of the audio signal itself, there is no need to be restricted by traditional signal models, and the suppression of spectral structures similar to howling can be avoided, thereby improving the effect of howling suppression.

[0130] The howling suppression method provided in the embodiment of the present application may be performed by a howling suppression device. In the embodiment of the present application, the howling suppression device performing the howling suppression method is taken as an example to illustrate the howling suppression device provided in the embodiment of the present application.

[0131] As shown in FIG11 , an embodiment of the present application provides a howling suppression device 110 . The howling suppression device 80 may include a determining module 111 and a suppressing module 112 .

[0132] The determining module 111 may be configured to determine a howling signal within a frequency range of the first audio frame based on a cepstral envelope of the first audio frame, the howling signal including a howling frequency point or a howling frequency band. The suppressing module 112 may be configured to suppress the howling signal based on the cepstral envelope.

[0133] In a possible implementation, the determination module 111 may be configured to determine the howling frequency based on the frequency strength of each peak frequency of the first audio frame and the frequency strength of the corresponding frequency of each peak frequency in the cepstrum envelope.

[0134] In one possible implementation, the howling signal includes the howling frequency, and the suppression module 112 may include a determination submodule and a suppression submodule. The determination submodule may be configured to determine, based on the frame type of the first audio frame, at least one target frequency of the first audio frame, the at least one target frequency including the howling frequency. The suppression submodule may be configured to suppress the at least one target frequency based on the frequency strength of each target frequency in the at least one target frequency and the frequency strength of the corresponding frequency of each target frequency in the cepstrum envelope.

[0135] In one possible implementation, the determination submodule may be specifically configured to: determine the at least one target frequency within a first frequency set when the frame type is a voiced frame; and determine the at least one target frequency within a second frequency set when the frame type is an unvoiced frame. The frequency range of the first frequency set is less than or equal to the frequency range of the second frequency set.

[0136] In a possible implementation, the determination module 111 may be specifically configured to determine the howling frequency band according to the frequency domain position of the local maximum value and the frequency domain position of the local minimum value in the cepstrum envelope.

[0137] In one possible implementation, the howling signal includes the howling frequency band. The suppression module 112 can be specifically configured to suppress the howling frequency band based on the cepstrum envelope and the frame type of the first audio frame when a first probability value is greater than or equal to a first threshold; wherein the first probability value is used to indicate the probability of frequency band howling occurring in the first audio frame, and the first probability value is determined based on at least one of a first feature, a second feature, and a third feature, wherein the first feature is used to indicate the ratio of the frequency point intensity peak to the low-frequency energy difference in the cepstrum envelope, the second feature is used to indicate the bandwidth of the spectral peak of the cepstrum envelope, and the third feature is used to indicate the slope between the spectral peak and the spectral valley of the cepstrum envelope.

[0138] In one possible implementation, the suppression module 112 can be specifically used to: when the frame type of the above-mentioned first video frame is a non-speech frame, suppress the howling frequency band according to the frequency strength of each frequency point in the above-mentioned howling frequency band; when the frame type of the first video frame is a voiced sound frame, suppress the howling frequency band according to the frequency strength of each frequency point in the howling frequency band, the frequency strength peak value, and the average energy of the low-frequency spectrum peak of the above-mentioned cepstrum envelope; when the frame type of the first video frame is an unvoiced frame, suppress the howling frequency band according to the frequency strength of each frequency point in the howling frequency band, the frequency strength peak value, and the strength of the first audio frame.

[0139] In the howling suppression device provided in the embodiment of the present application, since the howling suppression device can determine and suppress the howling frequency point or howling frequency band in the audio frame based on the cepstrum envelope of the audio frame, that is, howling detection and suppression can be performed based on the characteristics of the audio signal itself, there is no need to be limited by the traditional signal model, and the suppression of spectral structures similar to howling can be avoided, thereby improving the effect of howling suppression.

[0140] The howling suppression device in the embodiments of the present application can be an electronic device or a component of an electronic device, such as an integrated circuit or chip. The electronic device can be a terminal or other device other than a terminal. For example, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, a mobile internet device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc. It can also be a server, a network attached storage (NAS), a personal computer (PC), a television (TV), a teller machine, or a self-service machine, etc., and the embodiments of the present application do not specifically limit this.

[0141] The howling suppression device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0142] The howling suppression device provided in the embodiment of the present application can implement each process implemented in the above method embodiment and achieve the same technical effect. To avoid repetition, it will not be described here.

[0143] As shown in Figure 12, an embodiment of the present application also provides an electronic device 120, including a processor 121 and a memory 122, and the memory 122 stores a program or instruction that can be run on the processor 121. When the program or instruction is executed by the processor 121, the various steps of the above-mentioned howling suppression method embodiment are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0144] It should be noted that the electronic devices in the embodiments of the present application include mobile electronic devices and non-mobile electronic devices.

[0145] FIG13 is a schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.

[0146] As shown in Figure 13, the electronic device 1000 includes but is not limited to: a radio frequency unit 1001, a network module 1002, an audio output unit 1003, an input unit 1004, a sensor 1005, a display unit 1006, a user input unit 1007, an interface unit 1008, a memory 1009, and a processor 1010 and other components.

[0147] Those skilled in the art will appreciate that the electronic device 1000 may further include a power source (such as a battery) for powering various components. The power source may be logically connected to the processor 1010 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption. The electronic device structure shown in FIG13 does not limit the electronic device. The electronic device may include more or fewer components than shown, or may combine certain components, or have different component arrangements, which will not be described in detail here.

[0148] The processor 1010 may be configured to determine a howling signal within a frequency range of the first audio frame based on a cepstrum envelope of the first audio frame, the howling signal including a howling frequency point or a howling frequency band; and suppress the howling signal based on the cepstrum envelope.

[0149] In a possible implementation, the processor 1010 may be specifically configured to determine the howling frequency based on the frequency strength of each peak frequency of the first audio frame and the frequency strength of a corresponding frequency of each peak frequency in the cepstrum envelope.

[0150] In one possible implementation, the howling signal includes the howling frequency. Processor 1010 may be specifically configured to determine, based on the frame type of the first audio frame, at least one target frequency for the first audio frame, the at least one target frequency including the howling frequency; and suppress the at least one target frequency based on the frequency strength of each target frequency in the at least one target frequency and the frequency strength of the corresponding frequency of each target frequency in the cepstrum envelope.

[0151] In one possible implementation, the processor 1010 may be specifically configured to: when the frame type is a voiced frame, determine the at least one target frequency within a first frequency point set; and when the frame type is an unvoiced frame, determine the at least one target frequency within a second frequency point set. The frequency range of the first frequency point set is less than or equal to the frequency range of the second frequency point set.

[0152] In a possible implementation, the processor 1010 may be specifically configured to determine the howling frequency band according to the frequency domain position of the local maximum value and the frequency domain position of the local minimum value in the cepstrum envelope.

[0153] In one possible implementation, the howling signal includes the howling frequency band. The processor 1010 may be specifically configured to suppress the howling frequency band based on the cepstrum envelope and the frame type of the first audio frame when a first probability value is greater than or equal to a first threshold; wherein the first probability value is used to indicate the probability of frequency band howling occurring in the first audio frame, and the first probability value is determined based on at least one of a first feature, a second feature, and a third feature, the first feature being used to indicate the ratio of the frequency point intensity peak to the low-frequency energy difference in the cepstrum envelope, the second feature being used to indicate the bandwidth of the spectral peak of the cepstrum envelope, and the third feature being used to indicate the slope between the spectral peak and the spectral valley of the cepstrum envelope.

[0154] In one possible implementation, the processor 1010 may be specifically configured to: when the frame type of the first video frame is a non-speech frame, suppress the howling frequency band based on the frequency strength of each frequency point in the howling frequency band; when the frame type of the first video frame is a voiced sound frame, suppress the howling frequency band based on the frequency strength of each frequency point in the howling frequency band, the frequency strength peak value, and the average energy of the low-frequency spectrum peak of the cepstrum envelope; when the frame type of the first video frame is an unvoiced frame, suppress the howling frequency band based on the frequency strength of each frequency point in the howling frequency band, the frequency strength peak value, and the strength of the first audio frame.

[0155] In the electronic device provided in the embodiment of the present application, since the electronic device can determine and suppress the howling frequency point or howling frequency band in the audio frame based on the cepstrum envelope of the audio frame, that is, howling detection and suppression can be performed based on the characteristics of the audio signal itself, there is no need to be limited by the traditional signal model, and the suppression of spectral structures similar to howling can be avoided, thereby improving the effect of suppressing howling.

[0156] It should be understood that in an embodiment of the present application, the input unit 1004 may include a graphics processing unit (GPU) 10041 and a microphone 10042, and the graphics processor 10041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 1006 may include a display panel 10061, and the display panel 10061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 1007 includes a touch panel 10071 and at least one of other input devices 10072. The touch panel 10071 is also called a touch screen. The touch panel 10071 may include two parts: a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and an operating stick, which will not be repeated here.

[0157] The memory 1009 can be used to store software programs and various data. The memory 1009 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, applications or instructions required for at least one function (such as a sound playback function, an image playback function, etc.). In addition, the memory 1009 may include a volatile memory or a non-volatile memory, or the memory 1009 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM), and a direct memory bus random access memory (DRRAM). The memory 1009 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0158] Processor 1010 may include one or more processing units. Optionally, processor 1010 integrates an application processor and a modem processor. The application processor primarily handles operations related to the operating system, user interface, and application programs, while the modem processor primarily processes wireless communication signals, such as a baseband processor. It is understood that the modem processor may not be integrated into processor 1010.

[0159] An embodiment of the present application further provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, each process of the above-mentioned howling suppression method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it is not repeated here.

[0160] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0161] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, the communication interface and the processor are coupled, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned howling suppression method embodiment, and can achieve the same technical effect. To avoid repetition, it is not repeated here.

[0162] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0163] An embodiment of the present application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the above-mentioned howling suppression method embodiment, and can achieve the same technical effect. To avoid repetition, it is not described here.

[0164] It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, it should be noted that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the opposite order according to the functions involved. For example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0165] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), including a number of instructions for enabling a terminal (which can be a mobile phone, computer, server, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0166] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of this application, ordinary technicians in this field can also make many forms without departing from the purpose of this application and the scope of protection of the claims, all of which are within the protection of this application.

Claims

1. A howling suppression method, the method comprising: Determine, based on the cepstrum envelope of the first audio frame, a howling signal within a frequency range of the first audio frame, where the howling signal includes a howling frequency point or a howling frequency band; The howling signal is suppressed based on the cepstrum envelope.

2. The method according to claim 1, wherein: The determining, based on the cepstrum envelope of the first audio frame, a howling signal within a frequency range of the first audio frame comprises: The howling frequency point is determined according to the frequency point strength of each peak frequency point of the first audio frame and the frequency point strength of a frequency point corresponding to each peak frequency point in the cepstrum envelope.

3. The method according to claim 1 or 2, wherein: The howling signal includes the howling frequency point; The step of suppressing the howling signal based on the cepstrum envelope comprises: Determine, according to the frame type of the first audio frame, at least one target frequency point of the first audio frame, where the at least one target frequency point includes the howling frequency point; The at least one target frequency point is suppressed according to the frequency point strength of each target frequency point and the frequency point strength of a frequency point corresponding to each target frequency point in the cepstrum envelope.

4. The method according to claim 3, wherein: The determining, according to the frame type of the first audio frame, at least one target frequency point of the first audio frame includes: When the frame type is a voiced frame, determining the at least one target frequency point in the first frequency point set; When the frame type is a non-voiced frame, determining the at least one target frequency point in the second frequency point set; The frequency range of the first frequency set is smaller than or equal to the frequency range of the second frequency set.

5. The method according to claim 1, wherein: The determining, based on the cepstrum envelope of the first audio frame, a howling signal within a frequency range of the first audio frame comprises: The howling frequency band is determined according to the frequency domain position of the local maximum value and the frequency domain position of the local minimum value in the cepstrum envelope.

6. The method according to claim 1 or 5, wherein: The howling signal includes the howling frequency band; Based on the cepstrum envelope, suppressing the howling signal includes: When the first probability value is greater than or equal to a first threshold, suppressing the howling frequency band based on the cepstrum envelope and the frame type of the first audio frame; Among them, the first probability value is used to indicate the probability of frequency band howling occurring in the first audio frame, and the first probability value is determined based on at least one of the first feature, the second feature and the third feature, the first feature is used to indicate the ratio of the frequency point intensity peak value to the low-frequency energy difference in the cepstrum envelope, the second feature is used to indicate the bandwidth of the spectral peak of the cepstrum envelope, and the third feature is used to indicate the slope between the spectral peak and the spectral valley of the cepstrum envelope.

7. The method according to claim 6, wherein: The step of suppressing the howling frequency band based on the cepstrum envelope and the frame type of the first audio frame comprises: In the case where the frame type is a non-speech frame, suppressing the howling frequency band according to the frequency point strength of each frequency point in the howling frequency band; In the case where the frame type is a voiced frame, suppressing the howling frequency band according to the frequency point intensity of each frequency point in the howling frequency band, the frequency point intensity peak value, and the average energy of the low frequency spectrum peak of the cepstrum envelope; When the frame type is an unvoiced frame, the howling frequency band is suppressed according to the frequency point intensity of each frequency point in the howling frequency band, the frequency point intensity peak value, and the intensity of the first audio frame.

8. A howling suppression device, wherein: The device includes a determination module and a suppression module; The determining module is configured to determine a howling signal within a frequency range of the first audio frame based on a cepstrum envelope of the first audio frame, wherein the howling signal includes a howling frequency point or a howling frequency band; The suppression module is used to suppress the howling signal based on the cepstrum envelope.

9. The device according to claim 8, wherein: The determination module is specifically configured to determine the howling frequency point according to the frequency point strength of each peak frequency point of the first audio frame and the frequency point strength of a frequency point corresponding to each peak frequency point in the cepstrum envelope.

10. The device according to claim 8 or 9, wherein: The howling signal includes the howling frequency point, and the suppression module includes a determination submodule and a suppression submodule; The determining submodule is configured to determine at least one target frequency point of the first audio frame according to the frame type of the first audio frame, wherein the at least one target frequency point includes the howling frequency point; The suppression submodule is used to suppress the at least one target frequency point according to the frequency point strength of each target frequency point and the frequency point strength of the corresponding frequency point of each target frequency point in the cepstrum envelope.

11. The device according to claim 10, wherein: The determining submodule is also used for: When the frame type is a voiced frame, determining the at least one target frequency point in the first frequency point set; When the frame type is a non-voiced frame, determining the at least one target frequency point in the second frequency point set; The frequency range of the first frequency set is smaller than or equal to the frequency range of the second frequency set.

12. The device according to claim 8, wherein: The determination module is specifically configured to determine the howling frequency band according to the frequency domain position of the local maximum value and the frequency domain position of the local minimum value in the cepstrum envelope.

13. The device according to claim 8 or 12, wherein: The howling signal includes the howling frequency band; The suppression module is specifically configured to suppress the howling frequency band based on the cepstrum envelope and the frame type of the first audio frame when the first probability value is greater than or equal to a first threshold; Among them, the first probability value is used to indicate the probability of frequency band howling occurring in the first audio frame, and the first probability value is determined based on at least one of the first feature, the second feature and the third feature, the first feature is used to indicate the ratio of the frequency point intensity peak value to the low-frequency energy difference in the cepstrum envelope, the second feature is used to indicate the bandwidth of the spectral peak of the cepstrum envelope, and the third feature is used to indicate the slope between the spectral peak and the spectral valley of the cepstrum envelope.

14. The device according to claim 13, wherein: The suppression module is further configured to: In the case where the frame type is a non-speech frame, suppressing the howling frequency band according to the frequency point strength of each frequency point in the howling frequency band; In the case where the frame type is a voiced frame, suppressing the howling frequency band according to the frequency point intensity of each frequency point in the howling frequency band, the frequency point intensity peak value, and the average energy of the low frequency spectrum peak of the cepstrum envelope; When the frame type is an unvoiced frame, the howling frequency band is suppressed according to the frequency point intensity of each frequency point in the howling frequency band, the frequency point intensity peak value, and the intensity of the first audio frame.

15. An electronic device, comprising a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the howling suppression method according to any one of claims 1 to 7 are implemented.

16. A readable storage medium storing a program or an instruction, wherein the program or the instruction, when executed by a processor, implements the steps of the howling suppression method according to any one of claims 1 to 7.

17. A chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or an instruction to implement the steps of the howling suppression method according to any one of claims 1 to 7.

18. A computer program product, wherein the computer program product is stored in a storage medium and is executed by at least one processor to implement the steps of the howling suppression method according to any one of claims 1 to 7.

Images