Tooth sound processing method and device and electronic equipment

Abstract

The invention relates to the field of audio, and provides a tooth sound processing method and device and electronic equipment. In the tooth sound processing method, the core suppression frequency band and the self-adaptive suppression frequency band are determined, the suppression frequency band of the tooth sound can be expanded through the self-adaptive suppression frequency band, and a better tooth sound suppression effect can be obtained by performing tooth sound processing on the suppression frequency band with a relatively large range. Moreover, because the adaptive suppression frequency band expands the core suppression frequency band, for the expanded suppression frequency bands except the core suppression frequency band in the expanded adaptive suppression frequency bands, the second suppression gain of the expanded suppression frequency bands is increased from the first suppression gain of the core suppression frequency band to 1, and the gradually increased second suppression gain can gentle the tone quality damage, so that the tone quality is improved. Damage to tone quality is reduced as much as possible. In a word, according to the tooth sound processing method, sound quality and tooth sound suppression are well balanced, and the tooth sound suppression effect can be effectively improved under the condition that sound quality damage is reduced as much as possible.

Description

Technical Field

[0001] The present application relates to the field of audio, and more specifically, to a method, device and electronic device for sibilant sound processing in the field of audio. Background Art

[0002] Sibilance refers to all sibilant sounds made by humans, with strongly stressed friction consonants. Sibilance is usually in the frequency range of 4kHz to 8kHz, corresponding to a higher sharpness, and is generally not suitable for human ears to hear. Therefore, electronic devices will suppress sibilance in audio signals to reduce sibilance energy and try to keep each frame of audio within the appropriate sharpness range to avoid damage to human hearing caused by high-sharp sibilance.

[0003] When sibilance suppression is performed, the sound quality of the audio signal will be damaged to a certain extent. Considering the sound quality, the frequency band range of the sibilance segment of the audio signal currently suppressed is relatively small, resulting in an unsatisfactory sibilance suppression effect.

[0004] Therefore, it is necessary to provide a method for sibilance processing that can improve the effect of sibilance suppression while taking into account the sound quality. Summary of the invention

[0005] The embodiment of the present application provides a method for sibilant sound processing, which achieves a good balance between sound quality and sibilant sound suppression, and can effectively improve the sibilant sound suppression effect while minimizing sound quality damage.

[0006] In a first aspect, a method for sibilant sound processing is provided, comprising: determining that a current audio frame is a sibilant sound frame; determining a core suppression frequency band and an adaptive suppression frequency band of the current audio frame; determining a first suppression gain of the core suppression frequency band; when the frequency band range of the adaptive suppression frequency band includes the frequency band range of the core suppression frequency band, or, when the frequency band range of the adaptive suppression frequency band partially overlaps with the frequency band range of the core suppression frequency band, the suppression frequency band of the sibilant sound is expanded by the adaptive suppression frequency band, and at least one extended suppression frequency band other than the core suppression frequency band is determined; determining a second suppression gain of each extended suppression frequency band, and increasing the second suppression gain of each extended suppression frequency band from the first suppression gain to 1 according to the frequency change direction from the first boundary frequency closest to the core suppression frequency band in each extended suppression frequency band to the second boundary frequency farthest from the core suppression band; applying the first suppression gain to the energy of the current audio frame in the core suppression frequency band, and applying the second suppression gain of each extended suppression frequency band to the energy of the current audio frame in each of the extended suppression frequency bands.

[0007] In the above embodiment, the determined suppression frequency band of the audio frame includes a core suppression frequency band and an adaptive suppression frequency band for extending the core suppression frequency band. When the frequency band range of the adaptive suppression frequency band includes the frequency band range of the core suppression frequency band or the frequency band range of the adaptive suppression frequency band partially overlaps with the frequency band range of the core suppression frequency band, the suppression frequency band of the sibilance is expanded by the adaptive suppression frequency band, that is, an extended suppression frequency band other than the core suppression frequency band is obtained, the frequency band range of the suppression frequency band is increased, and the sibilance processing is performed on the suppression frequency band with a larger range, so that a better sibilance suppression effect can be obtained. Moreover, since the adaptive suppression frequency band expands the core suppression frequency band, the gain of the core suppression frequency band is the first suppression gain, and for the expanded extended suppression frequency band, the second suppression gain of the extended suppression frequency band increases from the first suppression gain to 1, which can avoid the problem of sound quality damage caused by still using a smaller gain to suppress the energy of the extended suppression frequency band. Therefore, the gradually increasing second suppression gain can smooth the sound quality damage, and while improving the sibilance suppression effect, it can minimize the damage to the sound quality. In summary, the method for sibilant sound processing provided in the embodiment of the present application achieves a good balance between sound quality and sibilant sound suppression, and can effectively improve the sibilant sound suppression effect while minimizing sound quality damage.

[0008] Optionally, before the step of determining the core suppression frequency band and the adaptive suppression frequency band of the current audio frame in the above embodiment, the method also includes: determining the first bark frequency band in the bark domain corresponding to the maximum sharpness according to the sharpness distribution of the current audio frame; and, in the step of determining the core suppression frequency band and the adaptive suppression frequency band of the current audio frame in the above embodiment, the core suppression frequency band and the adaptive suppression frequency band are determined according to the first bark frequency band, and both the core suppression frequency band and the adaptive suppression frequency band include the first bark frequency band.

[0009] Since the first bark frequency band is the frequency band corresponding to the maximum sharpness, the sibilant energy of the first bark frequency band is relatively high. Based on the core suppression frequency band determined based on the first bark frequency band, the frequency band with overall higher sibilant energy can be better determined to improve the sibilant suppression effect.

[0010] Optionally, in the step of determining the core suppression frequency band according to the first bark frequency band in the above embodiment, the first bark frequency band is taken as the center frequency band, and M1 bark frequency bands are extended to both sides of the first bark frequency band to obtain the core suppression frequency band, where M1 is an integer greater than 1 or equal to 1.

[0011] Generally speaking, areas with high sibilance energy are concentrated on both sides of the first bark frequency band. Therefore, the core suppression frequency band obtained by expanding M1 bark frequency bands on both sides of the first bark frequency band can well and comprehensively obtain the frequency band with overall higher sibilance energy, so as to further improve the effect of sibilance suppression. In addition, by expanding the frequency band by the number of bark frequency bands M1, the implementation process is simple and easy to implement.

[0012] Optionally, in the step of determining an adaptive suppression frequency band according to the first bark frequency band in the above embodiment, the frequency band is expanded to both sides of the first bark frequency band according to the sharpness distribution of the current audio frame to determine the adaptive suppression frequency band, wherein the frequency band sharpness of the adaptive suppression frequency band satisfies a first preset condition for limiting the expansion of the adaptive suppression frequency band.

[0013] In the above embodiment, the frequency band is extended to both sides of the first bark frequency band according to the sharpness distribution of the current audio frame, and when the frequency band sharpness of the extended frequency band meets the first preset condition, the frequency band extension is stopped to obtain an adaptive suppression frequency band. Since the adaptive suppression frequency band is extended based on the sharpness distribution of the current audio frame, it is highly related to the characteristics of the audio frame itself. Therefore, the adaptive suppression frequency band obtained for each audio frame is more in line with the characteristics of each audio frame, so as to accurately determine the suppression frequency band of each audio frame, thereby better improving the effect of sibilance suppression and at the same time improving the flexibility of sibilance processing.

[0014] Optionally, in the step of extending the frequency band to both sides of the first bark frequency band to determine the adaptive suppression frequency band according to the sharpness distribution of the current audio frame in the above embodiment, the sharpness corresponding to each bark frequency band in the multiple bark frequency bands on both sides of the first bark frequency band is compared K times according to the sharpness distribution of the current audio frame. When the frequency band sharpness of the candidate suppression interval obtained in the Kth comparison process meets the first preset condition, the frequency band corresponding to the candidate suppression interval obtained in the Kth comparison process is determined as the adaptive suppression frequency band, and K is an integer greater than 1; wherein,

[0015] In the first comparison process, the sharpnesses corresponding to the two bark frequency bands on both sides of the first bark frequency band are compared, and the bark frequency band corresponding to the maximum sharpness in the first comparison process is determined as the initial candidate bark frequency band; the interval between the first bark frequency band and the initial candidate bark frequency band, including the first bark frequency band and the initial candidate bark frequency band, is determined as the candidate suppression interval in the first comparison process, and the frequency band sharpness of the candidate suppression interval in the first comparison process does not meet the first preset condition;

[0016] In the i-th comparison process, the sharpnesses corresponding to the two bark frequency bands on both sides of the candidate suppression interval obtained in the i-1-th comparison process are compared, and the bark frequency band corresponding to the maximum sharpness in the i-th comparison process is determined as the middle candidate bark frequency band, i is greater than 1 and less than K; the interval between the middle candidate bark frequency band and the boundary bark frequency band including the middle candidate bark frequency band and the boundary bark frequency band obtained in the i-1-th comparison process is determined as the candidate suppression interval in the i-th comparison process, the boundary bark frequency band is the frequency band far away from the middle candidate bark frequency band in the candidate suppression interval obtained in the i-1-th comparison process, and the frequency band sharpness of the candidate suppression interval in the i-th comparison process does not meet the first preset condition;

[0017] Ki comparison processes are performed after the i-th comparison process until the adaptive suppression frequency band is determined in the K-th comparison process.

[0018] In the above embodiment, according to the sharpness distribution of the current audio frame, the sharpness corresponding to each bark frequency band in the multiple bark frequency bands on both sides of the first bark frequency band is compared K times, and the maximum sharpness among the sharpness corresponding to the two bark frequency bands on both sides of the first bark frequency band is determined through each comparison process, and the candidate suppression interval of each comparison process is determined based on the maximum sharpness obtained in each comparison process, so as to achieve the purpose of extending a part of the suppression interval in each comparison process, and finally complete the expansion of the suppression interval through multiple comparison processes to obtain an adaptive suppression frequency band. Based on the adaptive suppression frequency band obtained by cyclically traversing the sharpness of the current audio frame, the bark frequency band with a larger sharpness value can be searched comprehensively as much as possible based on the characteristics of the current audio frame, so as to more accurately obtain the adaptive suppression frequency band that meets the current audio frame.

[0019] Optionally, the first preset condition is that the frequency band sharpness of the candidate suppression interval obtained in each comparison process is greater than a first sharpness threshold.

[0020] Optionally, the first sharpness threshold is a product of a frame sharpness of a current audio frame and a coefficient, and the coefficient is less than 1.

[0021] Since the frame sharpness of the current audio frame is related to the current audio frame, the first sharpness threshold is designed to be the product of the frame sharpness of the current audio frame and the coefficient, so that the first preset condition is related to each audio frame, and the obtained adaptive suppression frequency band is more in line with each audio frame, which is conducive to more accurately determining the suppression frequency band of each audio frame, thereby better improving the effect of sibilance suppression.

[0022] Optionally, in the step of determining the first suppression gain of the core suppression frequency band in the above embodiment, the first suppression gain is determined according to a gain coefficient and an initial suppression gain, and the gain coefficient is related to the current audio frame.

[0023] Since the gain coefficient is related to the current audio frame, for different audio frames, the gain coefficient changes dynamically according to each audio frame, that is, for different audio frames, the gain coefficient can be different. In this way, the first compression gain obtained based on the gain coefficient and the initial compression gain can make the first compression gain more consistent with and adapt to each audio frame, improve the effect of sibilance suppression, and improve the flexibility of sibilance processing.

[0024] Optionally, the gain coefficient is related to the frame sharpness of the current audio frame and a second sharpness threshold.

[0025] By associating the gain coefficient with the frame sharpness of the audio frame and the second sharpness threshold, it is possible to conveniently realize dynamic change of the gain coefficient with different audio frames.

[0026] Optionally, in the step of determining the second suppression gain of each extended suppression frequency band in the above embodiment, the second suppression gain of each extended suppression frequency band is determined according to the frequency change direction from the first boundary frequency to the second boundary frequency of each extended suppression frequency band, with the first suppression gain as a reference, and in a manner of increasing one gain step for each incremental increase in the frequency band width.

[0027] Optionally, the gain step size is obtained according to the following formula:

[0028]

[0029] Among them, step is the gain step size, P is the number of frequency points in each extended suppression frequency band, and gain is the first suppression gain.

[0030] Optionally, the method further includes: when the frequency band range of the core suppression frequency band includes the frequency band range of the adaptive suppression frequency band, a first suppression gain acts on the energy of the current audio frame in the core suppression frequency band.

[0031] Optionally, in the step of determining that the current audio frame is a sibilant frame in the above embodiment, a target feature value of the current audio frame is determined; when the target feature value satisfies a second preset condition, the current audio frame is determined to be a sibilant frame.

[0032] Optionally, the target feature value is the frame sharpness of the current audio frame; and the second preset condition is: the frame sharpness of the current audio frame is greater than a second sharpness threshold.

[0033] In a second aspect, an electronic device is provided, and the electronic device is used to execute the method provided in the first aspect. Specifically, the electronic device may include a module for executing any possible implementation manner of the first aspect.

[0034] In a third aspect, an electronic device is provided, comprising a processor. The processor is coupled to a memory and can be used to execute instructions in the memory to implement the method in any possible implementation of the first aspect. Optionally, the electronic device also includes a memory. Optionally, the device also includes a communication interface, and the processor is coupled to the communication interface.

[0035] According to a fourth aspect, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a device, the device implements the method in any possible implementation manner of the first aspect.

[0036] According to a fifth aspect, a computer program product comprising instructions is provided, wherein when the instructions are executed by a computer, the device implements the method in any possible implementation manner of the first aspect.

[0037] In a sixth aspect, a chip is provided, comprising: an input interface, an output interface, a processor and a memory, wherein the input interface, the output interface, the processor and the memory are connected via an internal connection path, and the processor is used to execute the code in the memory. When the code is executed, the processor is used to execute the method in any possible implementation of the first aspect above. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Figure 1 It is a schematic architecture diagram of an electronic device provided in an embodiment of the present application.

[0039] Figure 2 It is a software structure block diagram of the electronic device provided in the embodiment of the present application.

[0040] Figure 3 It is a schematic flow chart of the method for sibilant sound processing provided in an embodiment of the present application.

[0041] Figure 4 It is a schematic diagram of the suppression frequency band and suppression gain provided in the embodiment of the present application.

[0042] Figure 5 This is another schematic diagram of the suppression frequency band and suppression gain provided in an embodiment of the present application.

[0043] Figure 6 This is another schematic diagram of the suppression frequency band and suppression gain provided in the embodiment of the present application.

[0044] Figure 7It is another schematic flowchart of the method for sibilant sound processing provided in an embodiment of the present application.

[0045] Figure 8 It is a schematic diagram of the sharpness distribution of an audio frame represented by the bark domain provided in an embodiment of the present application.

[0046] Fig. 9 It is a schematic diagram of candidate suppression intervals determined during multiple comparisons provided in an embodiment of the present application.

[0047] Fig.10 This is a comparison diagram of the energy of an audio frame before and after sibilance processing is performed on the audio frame, provided in an embodiment of the present application.

[0048] Fig.11 It is a schematic flowchart of a method for determining the frame sharpness of an audio frame provided in an embodiment of the present application.

[0049] Fig.12 This is another schematic flowchart of the method for sibilant sound processing provided in an embodiment of the present application.

[0050] Fig.13 It is an exemplary block diagram of the device for sibilant sound processing provided in an embodiment of the present application.

[0051] Fig.14 It is a schematic structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0052] The technical solution in this application will be described below in conjunction with the accompanying drawings.

[0053] In order to facilitate understanding of the solution, first, the relevant terms involved in the embodiments of the present application are introduced.

[0054] Teeth

[0055] Sibilants are all sibilant sounds made by humans, with strongly stressed fricative consonants, corresponding to a high degree of sharpness, and are generally not suitable for human ears. Sibilants are usually concentrated in the frequency range of 4kHz to 8kHz.

[0056] For the received audio signal, the electronic device will process the sibilance in the audio signal to suppress the sibilance so that each frame of audio in the audio signal is within an appropriate sharpness range, thereby preventing the high-sharp sibilance from causing damage to the human ear's hearing.

[0057] Sharpness

[0058] Sharpness is a feeling of whether a sound is pleasant to people, used to distinguish whether the sound is sharp or dull. The feeling of sharpness is mainly related to the spectral components and center frequency of narrowband sound, and does not depend on the loudness level and the details of the spectral components. The unit of sharpness is acum, and the reference sound of 1 acum is a narrowband noise with a center frequency of 1 kHz, a sound pressure level of 60 dB, and a bandwidth equal to a critical band.

[0059] Loudness

[0060] The strength of a sound is called loudness. Loudness describes the brightness of a sound and indicates the subjective feeling of the human ear towards the sound. The unit of measurement for loudness is sone. The loudness of a pure tone with a frequency of 1kHz and a sound pressure level of 40dB is defined as 1 sone.

[0061] The human ear's perception of sound is not only related to sound pressure, but also to frequency. Sounds with the same sound pressure level but different frequencies sound different in loudness. For example, an air compressor and an electric saw both have a sound pressure level of 100 decibels, but the sound of the electric saw sounds much louder. According to the human ear's perception of sound, the subjective sound perception of sound is defined based on sound pressure and frequency, which is called loudness level, and the unit is square.

[0062] bark domain

[0063] Since the human ear's perception of sound (such as frequency and pitch) is nonlinear, a series of scales have been developed to measure the perception of sound, such as the Mel-spectrometer scale and the bark scale. The bark scale is an earlier psychoacoustic scale for sound. The bark scale uses Hz as the unit and maps the physical frequency to the 24 critical frequency bands of psychoacoustics. Simply put, it converts the physical frequency to the psychoacoustic frequency.

[0064] For example, the 0Hz to 16kHz range within the audible range of the human ear is usually divided into 24 critical frequency bands, and the critical frequency band level is used to represent the width of the critical frequency band (abbreviated as critical bandwidth), and the unit is bark: 1 bark = 1 critical bandwidth. When the frequency f is less than 500Hz, 1bark = f / 100, and the critical bandwidth is almost constant at 100Hz; when the frequency f is greater than 500Hz, 1bark = 4log(f / 100), and the critical bandwidth increases with the increase of the center frequency, which is about 20% of the center frequency. Therefore, the frequency domain represented by the bark scale can be understood as the bark domain. The unit of the bark domain is bark, and the frequency band bandwidths corresponding to different positions in the bark domain are not necessarily the same.

[0065] Exemplarily, taking the example of dividing 0 Hz to 16 kHz within the audible range of human ears into 24 critical frequency bands, Table 1 shows the critical bandwidth, frequency boundary, and critical frequency band level of different center frequencies.

[0066] Table 1

[0067]

[0068]

[0069] Regarding the critical frequency band, it refers to the frequency bandwidth of the auditory filter generated by the structure of the cochlea. In the auditory system, the cochlea plays the role of spectrum analysis. The specific position point on the basilar membrane has the largest response to a certain characteristic frequency (Characteristic Frequency, CF). When the sound wave deviates from CF, the response of this point decreases. Therefore, each point on the basilar membrane can be equivalent to a bandpass filter with CF. The entire auditory system can be equivalent to a series of overlapping bandpass filters with continuous CF, which are called "auditory filters." The critical frequency band is a reflection of the bandpass filtering function of the auditory system, and the bandwidth of the auditory filter is the critical bandwidth.

[0070] Therefore, in acoustic research, people use auditory filters to simulate different critical frequency bands. The audio signal can present 24 critical frequency bands on the frequency band, from 1 to 24, which is the bark domain. Eberhanrd Zwicker proposed that auditory filters can be roughly used to simulate the 24 critical frequency bands of hearing, that is, the signal description method using the bark domain.

[0071] It should be understood that although the above example divides the frequency band of 0 Hz to 16 kHz into 24 critical frequency bands (i.e., 24 barks), in implementation, the frequency band of 0 Hz to 16 kHz may also be subdivided into more critical frequency bands, for example, the frequency band of 0 Hz to 16 kHz may be divided into 240 critical frequency bands (i.e., 240 barks). In the following embodiments, 240 barks are taken as an example to illustrate the relevant processing process of the audio frame.

[0072] For sibilance, electronic devices will suppress the sibilance in the audio signal to reduce the energy of the sibilance, and try to make each frame of the audio signal within the appropriate sharpness range to avoid damage to the human ear caused by the high-sharp sibilance. Taking a call scenario as an example, if the sibilance energy is high, the speech will have an unnatural harshness, which will reduce the quality of the audio signal and make the user feel annoyed. By suppressing the energy of the sibilance segment through relevant algorithms, the human voice can be clearer, rounder, and less harsh.

[0073] However, when performing sibilance suppression, the sound quality of the audio signal will be damaged to a certain extent. Considering the sound quality, the bandwidth of the suppression frequency band for sibilance suppression is currently small, resulting in unsatisfactory sibilance suppression effect. If the bandwidth of the sibilance suppression frequency band is blindly expanded, the sound quality of the audio signal will be greatly damaged.

[0074] In order to solve the above problems, an embodiment of the present application provides a method for sibilant sound processing. When it is determined that an audio frame is a sibilant sound frame, a core suppression frequency band is determined and an adaptive suppression frequency band of the audio frame is dynamically determined. The first suppression gain (less than 1) of the core suppression frequency band is a fixed value. When the frequency band range of the adaptive suppression frequency band includes the frequency band range of the core suppression frequency band or there is a partial intersection between the frequency band range of the adaptive suppression frequency band and the frequency band range of the core suppression frequency band, the first suppression gain of the core suppression frequency band is used as a reference, and the suppression gain of at least one extended suppression frequency band in the adaptive suppression frequency band except the core suppression frequency band is smoothed according to the gain step, so that the suppression gain of each extended frequency band increases from the first suppression gain to 1, and the audio frame is processed with the first suppression gain and the second suppression gain. In this way, in addition to the core suppression frequency band, the suppression frequency band is expanded through the adaptive suppression frequency band, which effectively improves the effect of sibilance suppression; and the suppression gain of at least one extended suppression frequency band other than the core suppression frequency band in the adaptive suppression frequency band is smoothed according to the gain step, so that the suppression gain of the extended suppression frequency band can smoothly transition from the first suppression gain to 1, reducing the damage to the sound quality of the audio frame. In short, the embodiment of the present application has a good balance between sound quality and sibilance suppression, and can effectively improve the sibilance suppression effect while minimizing the damage to sound quality.

[0075] It can be understood that the core suppression frequency band and the adaptive suppression frequency band are both frequency bands used for sibilance suppression in the audio frame.

[0076] The core suppression frequency band is a frequency band with a smaller frequency range. The overall sibilance energy is high and concentrated. It is the core frequency band for sibilance suppression and can suppress more sibilance energy.

[0077] The adaptive suppression frequency band is used to expand the core suppression frequency band to add an additional frequency band for sibilance suppression. In addition, the sibilance suppression of the extended suppression frequency band based on the adaptive suppression frequency band is small, and the sibilance energy of the extended suppression frequency band is smoothed to maintain the sound quality as much as possible.

[0078] The method for sibilant sound processing provided in the embodiments of the present application can be applied to various electronic devices that can play and process sound, such as mobile phones, tablet computers, wearable devices, laptops, netbooks, speakers, multimedia consoles, and vehicle-mounted terminal devices. The embodiments of the present application do not impose any restrictions on the specific types of electronic devices.

[0079] Figure 1 1 shows a schematic diagram of the structure of the electronic device 100. The electronic device 100 may include a processor 110, a mobile communication module 120, a wireless communication module 130, an audio module 140, a display screen 151, a camera 152, and a subscriber identification module (SIM) card interface 153, etc. The audio module 140 includes a speaker 140A, a receiver 140B, a microphone 140C, and an earphone interface 140D.

[0080] In an embodiment of the present application, the processor 110 is used to determine whether an audio frame is a sibilant frame. When it is determined that the audio frame is a sibilant frame, the processor 110 determines a suppression frequency band and a suppression gain so as to perform sibilant processing on the audio frame through the suppression frequency band and the suppression gain.

[0081] Exemplarily, the processor 110 is configured to determine whether an audio frame is a sibilant frame according to the frame sharpness of the audio frame.

[0082] Exemplarily, the processor 110 is also used to perform the following steps: determine a core suppression frequency band and dynamically determine an adaptive suppression frequency band of the audio frame to obtain a suppression frequency band; determine a first suppression gain (less than 1) of the core suppression frequency band; based on the first suppression gain of the core suppression frequency band, smooth the gain of at least one extended suppression frequency band in the adaptive suppression frequency band except the core suppression frequency band according to a gain step to obtain a second suppression gain (less than 1) for each extended suppression frequency band; and process the audio frame according to the first suppression gain and the second suppression gain to suppress sibilance.

[0083] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0084] The controller may be the nerve center and command center of the electronic device 100. The controller may generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0085] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0086] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0087] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 120, the wireless communication module 130, the modem processor and the baseband processor.

[0088] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0089] The mobile communication module 120 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 120 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 120 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 120 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 120 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 120 can be set in the same device as at least some of the modules of the processor 110.

[0090] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 120 or other functional modules.

[0091] The wireless communication module 130 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 130 can be one or more devices integrating at least one communication processing module. The wireless communication module 130 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 130 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0092] In some embodiments, the antenna 1 of the electronic device 100 is coupled to the mobile communication module 120, and the antenna 2 is coupled to the wireless communication module 130, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. The GNSS may include a global positioning system (GPS), a global navigation satellite system (GLONASS), a Beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS) and / or a satellite based augmentation system (SBAS).

[0093] The electronic device 100 implements the display function through a GPU, a display screen 151, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 151 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0094] The electronic device 100 can realize the shooting function through the ISP, the camera 152, the video codec, the GPU, the display screen 151 and the application processor.

[0095] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 140 , the speaker 140A, the receiver 140B, the microphone 140C, the headphone jack 140D, and the application processor.

[0096] The audio module 140 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 140 can also be used to encode and decode audio signals. In some embodiments, the audio module 140 can be arranged in the processor 110, or some functional modules of the audio module 140 can be arranged in the processor 110.

[0097] The speaker 140A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or listen to a hands-free call through the speaker 140A.

[0098] The receiver 140B, also called a "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or voice message, the voice can be received by placing the receiver 140B close to the human ear.

[0099] Microphone 140C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to the microphone 140C to input the sound signal into the microphone 140C. The electronic device 100 can be provided with at least one microphone 140C. In other embodiments, the electronic device 100 can be provided with two microphones 140C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 140C to collect sound signals, reduce noise, identify the sound source, realize directional recording function, etc.

[0100] The earphone jack 140D is used to connect a wired earphone.

[0101] The SIM card interface 153 is used to connect a SIM card. The SIM card can be connected to or separated from the electronic device 100 by inserting it into the SIM card interface 153 or removing it from the SIM card interface 153. The electronic device 100 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The electronic device 100 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0102] It should be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware. For example, the electronic device 100 may also include an external memory interface, a charging management module, a power management module, a battery, an internal memory, a sensor module, a button, a motor, an indicator, and the like.

[0103] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software structure of the electronic device 100.

[0104] Figure 2 1 is a software structure diagram of the electronic device 100 provided in an embodiment of the present application. The layered architecture divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into five layers, from top to bottom, namely, the application layer, the application framework layer, the Android runtime (Android runtime) and the system library, the hardware abstraction layer, and the kernel layer.

[0105] The application layer can include a series of application packages.

[0106] Exemplarily, the application package may include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.

[0107] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0108] Exemplarily, the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

[0109] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0110] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0111] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0112] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).

[0113] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0114] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0115] Android Runtime includes core libraries and virtual machines. Android Runtime is responsible for scheduling and management of the Android system.

[0116] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0117] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0118] The system library can include multiple functional modules, such as surface manager, media libraries, audio and video processing libraries, etc.

[0119] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0120] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0121] The hardware abstraction layer is an abstract structure between the kernel layer and the system library. The hardware abstraction layer can be a package of hardware drivers, providing a unified interface for the calls of upper-layer applications.

[0122] Exemplarily, the hardware abstraction layer may include: an audio module, a video module, a hardware configuration module, etc.

[0123] The kernel layer is the layer between hardware and software, including various drivers.

[0124] Exemplarily, the kernel layer may include a display driver, a camera driver, an audio driver, a sensor driver, etc.

[0125] It should be understood that the embodiments of the present application are only illustrated using the Android system as an example. In other operating systems (such as Windows system, IOS system, etc.), as long as the functions implemented by each functional module are similar to the embodiments of the present application, the solutions of the present application can also be implemented.

[0126] It should be noted that the embodiments of the present application determine whether an audio frame is a sibilance frame, determine the suppression frequency band and suppression gain, and suppress sibilance according to the suppression frequency band and suppression gain, etc., which can be implemented in multiple software architecture layers of electronic devices. For example, audio and video related applications (for example, calls, music, videos, etc.) in the application layer of the electronic device can perform the above-mentioned processing; in addition, the audio and video processing library in the system library of the electronic device, the audio and video module of the hardware abstraction layer, and the audio and video driver of the driver layer can all perform the above-mentioned processing, thereby realizing sibilance processing of audio frames. The specific software level for implementing sibilance processing is not specifically limited in the embodiments of the present application.

[0127] The method for sibilant sound processing of the embodiment of the present application can be applied to various application scenarios for processing audio signals, such as call scenarios, music or video playing scenarios, etc.

[0128] It should also be understood that the audio signal includes multiple audio frames, and the electronic device executes the embodiment of the present application for each audio frame, that is, when an audio frame is determined to be a sibilant frame, sibilant processing is performed on the audio frame.

[0129] The following, combined Figures 3 to 12 , explain the process of sibilant sound processing method.

[0130] It should be noted that the method for sibilant sound processing of the embodiment of the present application may be an electronic device, or a device such as a processor or chip in an electronic device. For the sake of ease of description, the embodiment of the present application is described with the electronic device as the execution subject.

[0131] Figure 3It is a schematic flow chart of the method 300 for sibilant sound processing provided in an embodiment of the present application. Figures 4 to 6 It is a schematic diagram of the suppression frequency band and suppression gain in various situations provided in the embodiments of the present application.

[0132] In step S310, the electronic device obtains a current audio frame.

[0133] In this step, the electronic device performs frame processing on the collected audio signal to obtain each audio frame, where the current audio frame is any audio frame.

[0134] It should be understood that the audio signal may be real-time data (eg, data collected in real time in a call scenario) or recorded data, and the present application embodiment does not impose any limitation thereto.

[0135] In step S320, the electronic device determines a target feature value of the current audio frame.

[0136] The target feature value may be any audio parameter that can be used to measure or judge audio.

[0137] In one example, the target feature value may include sharpness for measuring the sharpness of a sound. For the current audio frame, the target feature value may be the frame sharpness of the current audio frame.

[0138] In another example, the target feature value may also include other audio parameters such as loudness.

[0139] In some embodiments, the current audio frame is a frequency domain signal. In implementation, the electronic device converts the current audio frame from a time domain signal to a frequency domain signal, and then determines a target feature value of the frequency domain signal.

[0140] Regarding the process of the electronic device determining the target feature value of the current audio frame, please refer to the specific description of this step in method 500 below, which will not be repeated here.

[0141] In step S330, the electronic device determines whether the current audio frame is a sibilant frame according to the target feature value of the current audio frame.

[0142] When it is determined that the current audio frame is a sibilant frame, the electronic device executes step S340; when it is determined that the current audio frame is not a sibilant frame, the electronic device does not perform sibilant processing on the current audio frame and outputs the current audio frame in a normal manner.

[0143] In some embodiments, when the target feature value of the current audio frame meets preset conditions, the electronic device determines that the current audio frame is a sibilant frame; when the target feature value of the current audio frame does not meet the preset conditions, the electronic device determines that the current audio frame is not a sibilant frame.

[0144] In one example, the preset condition is that the target feature value of the current audio frame is greater than a threshold.

[0145] That is, when the target feature value of the current audio frame is greater than the threshold, the electronic device determines that the current audio frame is a sibilant frame; when the target feature value of the current audio frame is less than the threshold, the electronic device determines that the current audio frame is not a sibilant frame.

[0146] It should be understood that for the case where the target feature value is equal to the threshold, it can be divided into the case where the current audio frame is determined to be a sibilant frame, or it can be divided into the case where the current audio frame is not determined to be a sibilant frame. No limitation is made here.

[0147] In step S340, the electronic device determines a suppressed frequency band.

[0148] It should be understood that the suppressed frequency band is a frequency band that needs to be processed with sibilance, and is a partial frequency band of the frequency band occupied by the current audio frame.

[0149] In some embodiments, the suppression band may include a full set of two bands, the two bands being: a core suppression band and an adaptive suppression band. The electronic device needs to determine the core suppression band and the adaptive suppression band to obtain the suppression band and determine the suppression gain.

[0150] In the algorithm design process, in theory, the core suppression frequency band is a frequency band with a smaller frequency band range. The purpose of determining the adaptive suppression frequency band in the embodiment of the present application is to expand the range of the suppression frequency band. Therefore, based on the design idea, in most cases, the frequency band range of the adaptive suppression frequency band includes the frequency band range of the core suppression frequency band or the frequency band range of the adaptive suppression frequency band partially overlaps with the frequency band range of the core suppression frequency band. In very rare cases, the frequency band range of the core suppression frequency band includes the frequency band range of the adaptive suppression frequency band. Especially for call scenarios, it is rare that the frequency band range of the core suppression frequency band includes the frequency band range of the adaptive suppression frequency band. Therefore, the situation where the frequency band range of the core suppression frequency band includes the frequency band range of the adaptive suppression frequency band can be regarded as an extreme scenario of the embodiment of the present application.

[0151] The following, combined Figures 4 to 6 , a schematic illustration is given of a suppression frequency band formed based on a core suppression frequency band and an adaptive suppression frequency band.

[0152] Case 1: The frequency range of the adaptive suppression band includes the frequency range of the core suppression band

[0153] refer to Figure 4In case 1, the maximum frequency point of the adaptive suppression band is greater than the maximum frequency point of the core suppression band, and the minimum frequency point of the adaptive suppression band is less than the minimum frequency point of the core suppression band. In this case, the suppression band is the adaptive suppression band with a larger frequency band range, that is, the full set of the adaptive suppression band and the core suppression band is the adaptive suppression band.

[0154] For the convenience of description, the frequency bands other than the core suppression frequency band in the adaptive suppression frequency band are referred to as extended suppression frequency bands. In case 1, the suppression frequency band includes two extended suppression frequency bands, which are respectively located at both sides of the core suppression frequency band.

[0155] Case 2: The frequency range of the adaptive suppression band partially overlaps with the frequency range of the core suppression band

[0156] In case 2, the two extreme frequency points of the adaptive suppression frequency band are both greater than or less than the two extreme frequency points of the core suppression frequency band.

[0157] In one example, reference Figure 5 In (a), the maximum frequency point of the adaptive suppression frequency band is greater than the maximum frequency point of the core suppression frequency band, and the minimum frequency point of the adaptive suppression frequency band is located between the minimum frequency point and the maximum frequency point of the core suppression frequency band. In this case, the suppression frequency band includes the core suppression frequency band and an extended suppression frequency band in the adaptive suppression frequency band except for the intersection of the two frequency bands, and the extended suppression frequency band is located on one side of the maximum frequency point of the core suppression frequency band.

[0158] In another example, reference Figure 5 In (b), the minimum frequency point of the adaptive suppression band is less than the minimum frequency point of the core suppression band, and the maximum frequency point of the adaptive suppression band is between the minimum frequency point and the maximum frequency point of the core suppression band. In this case, the suppression band includes the core suppression band and an extended suppression band in the adaptive suppression band except for the intersection of the two bands, and the extended suppression band is located on one side of the minimum frequency point of the core suppression band.

[0159] It can be seen that in case 2, the suppression band includes a core suppression band and an extended suppression band, or in other words, the full set of the adaptive suppression band and the core suppression band includes the core suppression band and the extended suppression band.

[0160] Case 3: The frequency band range of the core suppression band includes the frequency band range of the adaptive suppression band

[0161] refer to Figure 6 In case 3, the maximum frequency point of the adaptive suppression frequency band is smaller than the maximum frequency point of the core suppression frequency band, and the minimum frequency point of the adaptive suppression frequency band is larger than the minimum frequency point of the core suppression frequency band.

[0162] In this case, in one example, the suppression frequency band is the core suppression frequency band, that is, the whole set of the adaptive suppression frequency band and the core suppression frequency band is the core suppression frequency band, and there is no extended suppression frequency band. It can be understood that in the design process, the frequency band range of the core suppression frequency band itself is relatively small, and suppressing the energy of the core suppression frequency band does not have a significant impact on the sound quality or is within an acceptable range. Therefore, even if the frequency band range of the core suppression frequency band is smaller than the frequency band range of the adaptive suppression frequency band, in order to facilitate the algorithm implementation and avoid excessive judgment logic, the core suppression frequency band can be used as the suppression frequency band, and the energy of the core suppression frequency band can be processed with sibilance.

[0163] Of course, in other examples, for situation 3, the adaptive suppression frequency band can also be used as the suppression frequency band to suppress the energy of a small range of the adaptive suppression frequency band. While achieving the effect of sibilance suppression, the impact on the sound quality can be better reduced.

[0164] In step S350, the electronic device determines a compression gain.

[0165] The suppression gain is the suppression gain corresponding to the above-mentioned suppression frequency band, which is a value less than 1.

[0166] In the application embodiment, the frequency band that does not require sibilance processing is called a non-suppressed frequency band, and the suppression gain of the non-suppressed frequency band is 1, which means that the energy of the non-suppressed frequency band does not need to be suppressed.

[0167] In the embodiment of the present application, the suppression gain of the core suppression frequency band is always a fixed value.

[0168] In the above cases 1 and 2, the suppression gain of the suppressed frequency band includes two parts of gain, one part of the gain is the suppression gain of the core suppressed frequency band (recorded as the first suppression gain), and the other part of the gain is the suppression gain of the extended suppressed frequency band other than the core suppressed frequency band in the adaptive suppressed frequency band (recorded as the second suppression gain), wherein the second suppression gain is greater than the first suppression gain, and the second suppression gain is increasing. In the extended suppressed frequency band, the second suppression gain increases from the first suppression gain to the gain of the non-suppressed frequency band, that is, the second suppression gain increases from the first suppression gain to 1.

[0169] For the second suppression gain of the extended suppression frequency band, the second suppression gain is gradually increased, which can be understood as the second suppression gain including multiple gains with different values, the extended suppression frequency band is divided into multiple sub-frequency bands, one gain corresponds to a sub-frequency band of the extended suppression frequency band, and in the extended suppression frequency band, multiple gains increase from the first suppression gain to 1 according to the corresponding multiple sub-frequency bands. In one example, the frequency band widths of the multiple sub-frequency bands are the same. In other examples, the frequency band widths of the multiple sub-frequency bands are not exactly the same, and no limitation is made here.

[0170] For example, the extended suppression band includes 5 sub-bands with the same band width, and in order of frequency from small to large, the 5 sub-bands are recorded as sub-band 1, sub-band 2, sub-band 3, sub-band 4 and sub-band 5. The second suppression gain includes 5 gains, and in order of gain from small to large, the 5 gains are recorded as gain 1, gain 2, gain 3, gain 4 and gain 5. Then, the corresponding relationship between the 5 sub-bands and the 5 gains is: sub-band 1-gain 1, sub-band 2-gain 2, sub-band 3-gain 3, sub-band 4-gain 4, sub-band 5-gain 5.

[0171] Next, continue to combine Figures 4 to 6 , a schematic illustration of the suppression gain of the suppression frequency band is given.

[0172] For case 1, continue to refer to Figure 4 The suppression frequency band includes a core suppression frequency band and two extended suppression frequency bands. Assume that the first suppression gain is 0.6. For each extended suppression frequency band, starting from the boundary frequency close to the core suppression frequency band, the second suppression gain of each extended suppression frequency band increases from 0.6 to 1, and the gain of the non-suppressed frequency band is 1.

[0173] For case 2, continue to refer to Figure 5 The suppression frequency band includes a core suppression frequency band and an extended suppression frequency band. Assume that the first suppression gain is 0.6. For the extended suppression frequency band, starting from the boundary frequency close to the core suppression frequency band, the second suppression gain of the extended suppression frequency band increases from 0.6 to 1.

[0174] For case 3, continue to refer to Figure 6 Since the suppression frequency band is the core suppression frequency band, the suppression gain of the suppression frequency band is the first suppression gain of the core suppression frequency band, which is a fixed value of 0.6.

[0175] It should be noted that Figure 4 and Figure 5 The second suppression gain of the extended suppression frequency band shown as a smooth straight line is only for schematic illustration, which only indicates that the second suppression gain is an increasing trend, and does not mean that the second suppression gain of the extended suppression frequency band in the actual curve graph is also formed as a straight line. In the actual curve graph, the second suppression gain may be a zigzag line composed of multiple points, and only the overall trend is increasing.

[0176] The following is a detailed description of the process of the electronic device determining the core suppression frequency band and the adaptive suppression frequency band and determining the two suppression gains, which will not be repeated here.

[0177] In step S360, the electronic device performs sibilance processing on the current audio frame according to the suppression frequency band and the suppression gain.

[0178] In this step, the electronic device applies the suppression gain to the energy of the current audio frame in the suppression frequency band to implement sibilance processing on the current audio frame to suppress sibilance.

[0179] For the above-mentioned cases 1 and 2, the suppression frequency band includes a core suppression frequency band and an extended suppression frequency band, and the suppression gain includes a first suppression gain and a second suppression gain. The first suppression gain is applied to the energy of the current audio frame in the core suppression frequency band, and the second suppression gain is applied to the energy of the current audio frame in the extended suppression frequency band.

[0180] Since the first suppression gain and the second suppression gain are both less than 1, when these two suppression gains are applied to the corresponding suppression frequency bands, it is equivalent to multiplying the original energy of the current audio frame by a coefficient less than 1, thereby reducing the energy of the current audio frame in the suppression frequency band and achieving the purpose of sibilance suppression; and, since the extended suppression frequency band is a suppression frequency band that is determined based on the adaptive suppression frequency band and the core suppression frequency band and thus extends the core suppression frequency band, the frequency band range of the suppression frequency band is increased, and sibilance processing is performed on suppression frequency bands with a larger range, which can achieve a better sibilance suppression effect.

[0181] In addition, since the core suppression frequency band is expanded, the second suppression gain of the expanded suppression frequency band gradually increases from the first suppression gain, which can avoid the problem of sound quality damage caused by still using a smaller gain to suppress the energy of the extended suppression frequency band. Therefore, the gradually increasing second suppression gain can smooth out the sound quality damage, while improving the sibilance suppression effect, it can reduce the damage to the sound quality.

[0182] For case 3, although the frequency band range of the adaptive suppression band is smaller than that of the core suppression band, the frequency band range of the core suppression band itself is relatively small. The core suppression band is taken as the final suppression band, and sibilance processing is performed on the core suppression band. When sibilance suppression can be achieved, the impact on the sound quality is not significant or is within an acceptable range. Moreover, since the first suppression gain itself is the gain of the core suppression band, directly using the first suppression gain to perform sibilance processing on the core suppression band can avoid the increase in algorithm difficulty due to the addition of extra steps, and facilitates algorithm implementation.

[0183] Figure 7 is a schematic flow chart of a method 400 for processing sibilant sounds provided in an embodiment of the present application. Figure 3 The method 300 and the method 400 shown in the figure focus on describing how the electronic device determines the suppression frequency band and the suppression gain when an audio frame is determined to be a sibilance frame, and the process of performing sibilance processing based on the suppression frequency band and the suppression gain.

[0184] In method 400, the electronic device determines a core suppression frequency band and an adaptive suppression frequency band according to the sharpness distribution of an audio frame to obtain a suppression frequency band, determines a suppression gain according to different situations, and finally performs sibilance processing on the audio frame according to the suppression frequency band and the suppression gain.

[0185] As mentioned above, since the human ear's perception of sound (such as frequency, pitch) is nonlinear, it is more accurate to measure the human ear's perception of sound by using a scale different from the linear frequency domain. For example, the embodiment of the present application uses the bark scale to measure the sharpness distribution of the audio frame, and after determining the core suppression interval and the adaptive suppression interval of the bark domain, the core suppression interval and the adaptive suppression interval are converted to the linear frequency domain to obtain the corresponding core suppression frequency band and the adaptive suppression frequency band.

[0186] It should be understood that the bark scale used to measure the sharpness of the audio frame and the determination of the core suppression frequency band and the adaptive suppression frequency band according to the sharpness distribution listed below are only for illustrative purposes, and other scales such as the Mel spectrum scale may also be used to measure the human ear's perception of sound. When other scales such as the Mel spectrum scale are used, it is not limited to determining the core suppression frequency band and the adaptive suppression frequency band according to the target feature value of the sharpness of the current audio frame, and the core suppression frequency band and the adaptive suppression frequency band may be determined according to other target feature values ​​used to characterize audio characteristics.

[0187] In step S410, the electronic device determines a first bark frequency band corresponding to the maximum sharpness according to the sharpness distribution of the current audio frame.

[0188] The sharpness measured by the bark size represents the sharpness distribution of the current audio frame in each bark frequency band in the bark domain. Here, a bark frequency band is a frequency band represented by a bark number in the bark domain, different bark numbers represent different frequency bands, and the frequency band widths of frequency bands represented by different bark numbers are not necessarily the same.

[0189] The maximum sharpness indicates the sharpness with the largest value among the sharpnesses corresponding to the bark frequency bands of the current audio frame. For the convenience of description, the bark frequency band corresponding to the maximum sharpness of the current audio frame is defined as the first bark frequency band.

[0190] Figure 8 It is a schematic diagram of the sharpness distribution of an audio frame represented by the bark domain provided in an embodiment of the present application.

[0191] refer to Figure 8, the horizontal axis is the bark domain, which divides the 0Hz~16kHz in the audible range of the human ear into 240 critical frequency bands. One number represents a bark number, and one bark number represents a bark frequency band. For example, the center frequency corresponding to the 50th bark is 500Hz, and the frequency band width is 10Hz, which means that the bark frequency band corresponding to the 50th bark is 495Hz to 505Hz; the center frequency corresponding to the 150th bark is 2718Hz, and the frequency band width is 31.25Hz, which means that the bark frequency band corresponding to the 150th bark is 2702.375Hz to 2733.625Hz. In addition, the frequency band widths corresponding to different bark numbers are not necessarily the same. For example, the frequency band width corresponding to the 50th bark is 10Hz, and the frequency band width corresponding to the 150th bark is 31.25hz. The vertical axis is sharpness, and the bark frequency bands represented by different bark numbers have different sharpness. Among the sharpnesses corresponding to the bark frequency bands, the peak value A is the maximum sharpness, and the bark frequency band indicated by the bark number corresponding to the peak value A is the first bark frequency band.

[0192] In step S420, the electronic device determines a core suppression interval according to the first bark frequency band. In some embodiments, the electronic device determines a core suppression interval according to the first bark frequency band and a bandwidth parameter.

[0193] It can be understood that the bandwidth parameter is used to extend the frequency band and can be used to determine the bark frequency band that needs to be extended. The bandwidth parameter can be a predefined parameter or a parameter that changes dynamically according to different audio frames, and no limitation is made here.

[0194] Exemplarily, the bandwidth parameter is used to indicate the number M1 of bark frequency bands. In implementation, the electronic device takes the first bark frequency band as the center frequency band, and expands M1 bark frequency bands to both sides of the first bark frequency band to obtain a core suppression interval. The core suppression interval can be represented as follows: [(index max -M1)bark,(index max +M1)bark], the unit is bark, where index max Indicates the bark number of the first bark frequency band corresponding to the maximum sharpness.

[0195] For example, refer to Figure 8 , assuming that the bark number of the first bark frequency band is 165, that is, the first bark frequency band is the 165th bark, M1=35, then, index max -M1=165-35=130, index max+M1=165+35=200, therefore, the core suppression interval is [130 bark, 200 bark], that is, the core suppression interval is greater than or equal to the 130th bark and less than or equal to the 200th bark.

[0196] In step S430, the electronic device determines an adaptive suppression interval according to the first bark frequency band.

[0197] In this step, the electronic device takes the first bark frequency band as a reference, gradually expands the suppression interval according to the sharpness corresponding to the bark frequency bands on both sides of the first bark frequency band, and finally obtains an adaptive suppression interval.

[0198] In some embodiments, the electronic device uses the first bark frequency band as a reference and performs multiple comparison processes. Through each comparison process, the maximum sharpness among the sharpnesses corresponding to the two bark frequency bands on both sides of the first bark frequency band is determined, and the candidate suppression interval for each comparison process is determined based on the maximum sharpness, so as to achieve the purpose of expanding a part of the suppression interval in each comparison process. Finally, the expansion of the suppression interval is completed through multiple comparison processes to obtain an adaptive suppression interval.

[0199] It should be understood that the two bark frequency bands on both sides of the first bark frequency band in any two comparison processes are not exactly the same, wherein the two bark frequency bands on both sides of the first bark frequency band in the current comparison process are the two bark frequency bands on both sides of the candidate suppression interval obtained in the previous comparison process.

[0200] It should also be understood that the two bark frequency bands on both sides of the candidate suppression interval represent two bark frequency bands located on both sides of the candidate suppression interval with the same spacing as the boundary frequency band of the candidate suppression interval. Exemplarily, the two bark frequency bands on both sides of the candidate suppression interval represent two bark frequency bands located on both sides of the candidate suppression interval closest to the two boundary frequency bands of the candidate suppression interval. For example, if the candidate suppression interval is [165bark, 166bark], then the two bark frequency bands on both sides of the candidate suppression interval are the 164th bark and the 167th bark, respectively.

[0201] For each comparison process, the candidate suppression interval of each comparison process is determined based on the maximum sharpness. For example, the electronic device uses the bark frequency band corresponding to the maximum sharpness as a boundary frequency band of the current candidate suppression interval, and uses a boundary frequency band in the candidate suppression interval obtained in the previous comparison process that is far away from the bark frequency band corresponding to the maximum sharpness as another boundary frequency band of the current candidate suppression interval. For example, the candidate suppression interval obtained in the last comparison process is [165bark, 166bark]. The two bark frequency bands on both sides of the candidate suppression interval are the 164th bark and the 167th bark respectively. The bark frequency band corresponding to the maximum sharpness is the 164th bark. Therefore, for the current candidate suppression interval, the bark frequency band corresponding to the maximum sharpness (164th bark) is a boundary frequency band of the current candidate suppression interval. A boundary frequency band in the candidate suppression interval [165bark, 166bark] away from the bark frequency band corresponding to the maximum sharpness (164th bark) is the 166th bark. Therefore, the current candidate suppression interval is [164bark, 166bark].

[0202] In the process of expanding the suppression interval to determine the adaptive suppression interval, in some embodiments, for the candidate suppression interval obtained in each comparison process, the sharpness of each bark frequency band in the candidate suppression interval is accumulated and summed to obtain the frequency band sharpness of the candidate suppression interval. If the frequency band sharpness of the candidate suppression interval in a certain comparison process meets the preset condition (recorded as the first preset condition), the expansion interval is stopped, and the candidate suppression interval obtained in the certain comparison process is determined as the adaptive suppression interval; if the frequency band sharpness of the candidate suppression interval in a certain comparison process does not meet the first preset condition, the next comparison process is continued to continue to expand the suppression interval until a candidate suppression interval meets the first preset condition.

[0203] It should be understood that the frequency band sharpness of the candidate suppression interval represents the sum of the sharpness of each bark frequency band of the candidate suppression interval.

[0204] In one example, the first preset condition is that the frequency band sharpness of the candidate suppression interval obtained in each comparison process is greater than a first sharpness threshold.

[0205] That is to say, when the frequency band sharpness of the candidate suppression interval obtained in a certain comparison process is greater than the first sharpness threshold, it means that the frequency band sharpness of the candidate suppression interval is large enough to meet the first preset condition and does not need to be expanded. Therefore, the electronic device stops expanding the interval and determines the candidate suppression interval obtained in the certain comparison process as the adaptive suppression interval. If the frequency band sharpness of the candidate suppression interval obtained in a certain comparison process is less than the first sharpness threshold, it means that the frequency band sharpness of the candidate suppression interval is small and does not meet the first preset condition. The suppression interval can continue to be expanded. Therefore, the next comparison process is continued to continue to expand the suppression interval.

[0206] It should be noted that, for the case where the frequency band sharpness of the candidate suppression interval is equal to the first sharpness threshold, it can be divided into the case where the first preset condition is met, or it can be divided into the case where the first preset condition is not met, and no limitation is made here.

[0207] Exemplarily, the first sharpness threshold may be: the product of the frame sharpness of the current audio frame and a coefficient coef (coefficient), wherein the coefficient coef is less than 1.

[0208] Exemplarily, the coefficient coef is greater than or equal to 0.5 and less than or equal to 0.9. For example, the coefficient coef is 0.55, 0.6, 0.65, 0.7, 0.75, 0.8, 0.9, etc.

[0209] The following, combined Figure 8 and Fig. 9 , a process of determining an adaptive suppression interval according to the first bark frequency band by an electronic device is specifically described.

[0210] Fig. 9 is a schematic diagram of the candidate suppression interval determined in each comparison process provided by the embodiment of the present application. As an example, Fig. 9 Only three candidate suppression intervals determined in the comparison process are illustrated, which should not be construed as limiting the embodiments of the present application.

[0211] The first comparison process

[0212] The electronic device uses the first bark frequency band as a reference, compares the sharpness corresponding to the two bark frequency bands on both sides of the first bark frequency band, determines the maximum sharpness among the sharpness corresponding to the two bark frequency bands, retains the bark frequency band corresponding to the maximum sharpness (recorded as candidate bark frequency band 1), and records the interval between the first bark frequency band and candidate bark frequency band 1 including the first bark frequency band and candidate bark frequency band 1 as candidate suppression interval 1, accumulates and sums the sharpness corresponding to each bark frequency band of candidate suppression interval 1, and if the frequency band sharpness obtained by the summation result is less than the first sharpness threshold, the suppression interval continues to be expanded.

[0213] For example, Figure 8 Take the 165th bark as an example. Fig. 9 In the example, the two bark frequency bands on both sides of the 165th bark are the 164th bark and the 166th bark. The sharpness corresponding to the 164th bark and the 166th bark are compared. The sharpness corresponding to the 166th bark is greater than the sharpness corresponding to the 164th bark. The 166th bark is retained, and the interval between the 166th bark and the 165th bark (i.e., [165bark-166bark]) including the 166th bark and the 165th bark is recorded as the candidate suppression interval 1. The sharpness corresponding to the 166th bark and the 165th bark in the candidate suppression interval 1 is accumulated and summed. The frequency band sharpness of the obtained candidate suppression interval 1 is less than the first sharpness threshold, and the suppression interval is continued to be expanded.

[0214] Second comparison process

[0215] Taking the candidate suppression interval 1 obtained in the first comparison process as a reference, the electronic device compares the sharpness corresponding to the two bark frequency bands on both sides of the candidate suppression interval 1, determines the maximum sharpness among the sharpness corresponding to the two bark frequency bands, retains the bark frequency band with the maximum sharpness (recorded as candidate bark frequency band 2), and records the interval between the boundary bark frequency band 1 and the candidate bark frequency band 2, including the boundary bark frequency band 1 of the candidate suppression interval 1 far away from the candidate bark frequency band 2, as the candidate suppression interval 2. The sharpness corresponding to each bark frequency band of the candidate suppression interval 2 is accumulated and summed. If the frequency band sharpness of the candidate suppression interval 2 obtained by the summation is less than the first sharpness threshold, the suppression interval is continued to be expanded.

[0216] Continue with Fig. 9Taking candidate suppression interval 1 as an example, the two bark frequency bands on both sides of candidate suppression interval 1 are the 164th bark and the 167th bark. The sharpness corresponding to the 164th bark and the 167th bark are compared. The sharpness corresponding to the 164th bark is greater than the sharpness corresponding to the 167th bark. The 164th bark is retained, and the interval between the 164th bark and the 166th bark (i.e., [164bark-166bark]) including the 164th bark and the 166th bark is recorded as candidate suppression interval 2. The sharpness corresponding to the 164th bark, the 165th bark and the 166th bark in the candidate suppression interval 2 is accumulated and summed. The obtained frequency band sharpness of the candidate suppression interval 2 is less than the first sharpness threshold, and the suppression interval is continued to be expanded.

[0217] The third comparison process

[0218] Taking the candidate suppression interval 2 obtained in the second comparison process as a reference, the electronic device compares the sharpness corresponding to the two bark frequency bands on both sides of the candidate suppression interval 2, determines the maximum sharpness among the sharpness corresponding to the two bark frequency bands, retains the bark frequency band with the maximum sharpness (recorded as candidate bark frequency band 3), and records the interval between the boundary bark frequency band 2 and the candidate bark frequency band 3, including the boundary bark frequency band 2 of the candidate suppression interval 2 far away from the candidate bark frequency band 3, as candidate suppression interval 3. The sharpness corresponding to each bark frequency band of the candidate suppression interval 3 is accumulated and summed. The frequency band sharpness of the candidate suppression interval 3 obtained by the summation result is less than the first sharpness threshold, and the suppression interval continues to be expanded.

[0219] Continue with Fig. 9 Taking candidate suppression interval 2 as an example, the two bark frequency bands on both sides of candidate suppression interval 2 are the 163rd bark and the 167th bark. The sharpness corresponding to the 163rd bark and the 167th bark are compared. The sharpness corresponding to the 163rd bark is greater than the sharpness corresponding to the 167th bark. The 163rd bark is retained, and the interval between the 163rd bark and the 166th bark (i.e., [163bark-166bark]) including the 163rd bark and the 166th bark is recorded as candidate suppression interval 3. The sharpness corresponding to the 163rd bark, the 164th bark, the 165th bark and the 166th bark in the candidate suppression interval 3 is accumulated and summed. The obtained frequency band sharpness of candidate suppression interval 3 is less than the first sharpness threshold, and the suppression interval is continued to be expanded.

[0220] In the same way, and by analogy, the comparison process is continued multiple times until the sum of the sharpness corresponding to each bark frequency band in the extended candidate suppression interval (i.e., the frequency band sharpness) is greater than the first sharpness threshold, then the expansion interval is stopped, and the final candidate suppression interval is determined as the adaptive suppression interval.

[0221] It should be understood that Figure 8 The schematic diagram shows a case where the frequency band range of the adaptive suppression interval includes the frequency band range of the core suppression interval, and should not be construed as limiting the embodiments of the present application. Based on the above description of cases 1 to 3 of the suppression frequency band, in implementation, the frequency band range of the adaptive suppression interval and the frequency band range of the core suppression interval may also partially overlap, or the frequency band range of the core suppression interval may also include the frequency band range of the adaptive suppression interval.

[0222] In step S440, the electronic device converts the core suppression interval and the adaptive suppression interval from the bark domain to the linear frequency domain to obtain the core suppression frequency band and the adaptive suppression frequency band.

[0223] The linear frequency domain here is the frequency domain in Hz.

[0224] The electronic device converts the core suppression interval and the adaptive suppression interval from the bark domain to linear frequency respectively, and obtains a core suppression frequency band corresponding to the core suppression interval and an adaptive suppression frequency band corresponding to the adaptive suppression interval.

[0225] Among them, the relationship between the core suppression frequency band and the adaptive suppression frequency band can be as above Figures 4 to 6 The three situations shown.

[0226] In step S450, the electronic device determines a first suppression gain of a core suppression frequency band.

[0227] The first suppression gain of the core suppression frequency band is a fixed value, which can be a predefined value or a dynamically changing value.

[0228] Since the sibilance energy of each audio frame is different, designing the first suppression gain to be a dynamically changing value can make the first suppression gain more consistent with and adaptable to each audio frame, thereby improving the sibilance suppression effect and increasing the flexibility of sibilance processing.

[0229] In some embodiments, the first suppression gain can be obtained by the following first formula:

[0230] gain = ucgain × coef-prob

[0231] in, gain is the first compression gain, ucgain is the initial gain, coef-prob is the gain coefficient, sharpness is the frame sharpness of the current audio frame, and threold is the sharpness threshold.

[0232] In step S460, the electronic device determines whether there is an extended squeezing frequency band between the core squeezing frequency band and the adaptive squeezing frequency band.

[0233] The extended suppression frequency band is a frequency band other than the core suppression frequency band in the adaptive suppression frequency band.

[0234] If the electronic device determines that there is an extended suppression band between the core suppression band and the adaptive suppression band, the electronic device executes step S470; if the electronic device determines that there is no extended suppression band between the core suppression band and the adaptive suppression band, the electronic device executes step S492.

[0235] As mentioned above, in the above case 1 (the frequency band range of the adaptive suppression band includes the frequency band range of the core suppression band) and case 2 (the frequency band range of the adaptive suppression band partially overlaps with the frequency band range of the core suppression band), there is an extended suppression band between the core suppression band and the adaptive suppression band; in the above case 3 (the frequency band range of the core suppression band includes the frequency band range of the adaptive suppression band), there is no extended suppression band between the core suppression band and the adaptive suppression band.

[0236] Since the core suppression frequency band is a relatively small frequency band, and the purpose of the adaptive suppression frequency band is to expand the range of the suppression frequency band, based on the design concept, the relationship between the core suppression frequency band and the adaptive suppression frequency band is mostly case 1 and case 2, and case 3 occurs in very rare cases.

[0237] In step S470, the electronic device determines at least one extended suppressed frequency band.

[0238] In this step, the electronic device determines the frequency bands other than the core suppression frequency band in the adaptive suppression frequency band as extended suppression frequency bands, wherein the extended suppression frequency bands may be one or two.

[0239] In case 1, refer to Figure 4 The frequency band range of the adaptive suppression frequency band includes the frequency band range of the core suppression frequency band, and two extended suppression frequency bands are determined. The two extended suppression frequency bands are respectively located on both sides of the core suppression frequency band.

[0240] In case 2, refer to Figure 5 , the frequency band range of the adaptive suppression frequency band partially overlaps with the frequency band range of the core suppression frequency band, and an extended suppression frequency band is determined, and the extended suppression frequency band is located on one side of the core suppression frequency band.

[0241] In step S480, the electronic device determines a second suppression gain for each extended suppression frequency band.

[0242] In some embodiments, the electronic device determines the second suppression gain of each extended suppression frequency band according to the frequency change direction from the first boundary frequency close to the core suppression frequency band in each extended suppression frequency band to the second boundary frequency far from the core suppression frequency band, with the first suppression gain as the reference, and in a manner of increasing the gain step by one increment for each increment of the frequency band width. The second suppression gain of each extended suppression frequency band increases from the first suppression gain to 1.

[0243] It can be understood that the first boundary frequency is a frequency in the extended suppression frequency band close to the core suppression frequency band, and the second boundary frequency is a frequency in the extended suppression frequency band far from the core suppression frequency band. Figure 4 Taking the two extended suppressed frequency bands shown as examples, one extended suppressed frequency band is located on the right side of the core suppressed frequency band, the first boundary frequency of the extended suppressed frequency band is the boundary frequency on the left side of the extended suppressed frequency band, and the second boundary frequency of the extended suppressed frequency band is the boundary frequency on the right side of the extended suppressed frequency band; the other extended suppressed frequency band is located on the left side of the core suppressed frequency band, the first boundary frequency of the other extended suppressed frequency band is the boundary frequency on the right side of the other extended suppressed frequency band, and the second boundary frequency of the other extended suppressed frequency band is the boundary frequency on the left side of the other extended suppressed frequency band.

[0244] The band width can be of any length and represents the granularity of frequency change when the gain of the extended suppression band changes.

[0245] For example, the frequency band width may be 15.625 Hz. Such a frequency band width is small, the gain change is relatively smooth, and the impact on the sound quality can be better reduced while the sibilance is suppressed.

[0246] The gain step indicates the granularity of the gain change. The gain of the extended suppression frequency band increases by one gain step for each increase in the frequency band width.

[0247] Exemplarily, the gain step size may be obtained by the following second formula: Wherein, step is the gain step length, P is the number of frequency points in the extended suppression frequency band, and gain is the first suppression gain. It should be understood that 1 actually represents the gain of the non-suppressed frequency band.

[0248] Assume that the first suppression gain is gain = 0.6, an extended suppression frequency band is [5kHz, 5.2kHz], and the frequency band width is 10Hz. Therefore, the number of frequency points P = 20, and the gain step size is For the second suppression gain of the extended suppression frequency band, the gain of 5kHz is 0.6, the gain of 5.01kHz is 0.62, the gain of 5.02kHz is 0.64... and so on, and finally the second suppression gain of the extended suppression frequency band is obtained.

[0249] In step S491, the electronic device applies a first suppression gain to the energy of the current audio frame in the core suppression frequency band, and applies a second suppression gain of each extended suppression frequency band to the energy of the current audio frame in each extended suppression frequency band to perform sibilance suppression.

[0250] In step S492, the electronic device applies the first suppression gain to the energy of the current audio frame in the core suppression frequency band to perform sibilance suppression.

[0251] For the specific description of step S491 and step S492, please refer to the relevant description of step S360, which will not be repeated here.

[0252] In method 300 and method 400, steps S420 to S440 may be understood as a specific description of step S340, steps S450 to S480 may be understood as a specific description of step S350, and steps S491 and S492 may be understood as a specific description of step S360.

[0253] It should be understood that the size of the sequence number of each process in the above embodiment does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present invention.

[0254] For example, the order of step S420 and step S430 can be swapped. For another example, step S450 can be executed at any time before step S491 or step S492.

[0255] Fig.10 is a comparison diagram of the energy of an audio frame before and after sibilance processing provided by an embodiment of the present application. Among them, Fig.10 (a) in the figure shows the energy of the audio frame before the sibilance processing is performed on the audio frame, and (b) in the figure shows the energy of the audio frame after the sibilance processing is performed on the audio frame.

[0256] Fig.10 The area S1 in (a) is the energy of the dental sound segment before the dental sound processing, which is generally high. Fig.10 Area S2 in (b) illustrates the energy of the dental sound segment after the dental sound processing, which is obviously different from the energy of area S1 and has a lighter color, which means that the energy of the dental sound segment after the dental sound processing is reduced, achieving the effect of suppressing the dental sound.

[0257] As mentioned above, for an audio frame, the electronic device determines whether the audio frame is a sibilant frame according to the target feature value of the audio frame. The target feature value may be an audio parameter such as the sharpness or loudness of the audio frame. Fig.11 , taking the target feature value being the frame sharpness of an audio frame as an example, the process of an electronic device determining the frame sharpness of an audio frame is explained.

[0258] Fig.11 It is a schematic flowchart of a method 500 for determining the frame sharpness of an audio frame provided in an embodiment of the present application.

[0259] It should be noted that method 500 describes a process of determining the frame sharpness of an audio frame based on the loudness model specified in the DIN45631 standard. The embodiment of the present application only briefly introduces the process. For a specific description, please refer to the relevant description of the loudness model.

[0260] It should also be noted that before executing method 500 , the electronic device converts the audio frame from a time domain signal to a frequency domain signal and processes the frequency domain signal of the audio frame.

[0261] In step S510, the electronic device calculates the frequency sound pressure level of the current audio frame.

[0262] In step S520, the electronic device obtains the frequency band sound pressure level of the current audio frame through 1 / 3 octave filtering.

[0263] In step S530, the electronic device determines the frequency band characteristic loudness of the current audio frame.

[0264] In this step, in order to simulate human ear filtering, the low-frequency band needs to be corrected and merged. The frequency band characteristic loudness of the current audio frame in the bark domain can be obtained according to the following formula:

[0265]

[0266] Among them, E TQ is the quiet hearing threshold sound pressure level, E 0 is the frequency band sound pressure level corresponding to the reference sound pressure level, N' is the frequency band loudness, and the unit of the frequency band characteristic loudness is sone / bark, which is the loudness value determined according to the bark domain.

[0267] For the frequency band characteristic loudness of the bark domain, it is moved within the frequency band of the bark domain with a unit step size (for example, the step size is 1 bark frequency band). By comparing the frequency band characteristic loudness of adjacent bark frequency bands, it is determined whether there is a masking effect. If so, a slope absorption loudness simulation mask is introduced to simulate the masking effect on certain components.

[0268] In step S540, the electronic device calculates the total loudness of the current audio frame according to the frequency band characteristic loudness of the current audio frame.

[0269] It should be understood that the total loudness of the audio frame represents the sum of the frequency band characteristic loudness of each bark frequency band in the bark domain.

[0270] Taking the bark domain including 240 frequency bands as an example, the electronic device integrates the characteristic loudness of the frequency bands in the bark domain to obtain the total loudness:

[0271] In step S550, the electronic device determines the frame sharpness of the current audio frame according to the frequency band characteristic loudness and the total loudness of the current audio frame.

[0272] Exemplarily, the electronic device may determine the frame sharpness of the current audio frame according to the following formula:

[0273]

[0274] Among them, S is the frame sharpness of the audio frame, N is the total loudness of the audio frame, z is the critical frequency band, N' is the frequency band characteristic loudness of the audio frame in the bark domain, g(z) is the weighting coefficient,

[0275] After determining the frame sharpness of the current audio frame, if the frame sharpness of the current audio frame meets a preset condition (recorded as the second preset condition), the current audio frame is determined to be a sibilant frame; if the frame sharpness of the current audio frame does not meet the second preset condition, the current audio frame is determined not to be a sibilant frame.

[0276] Exemplarily, the second preset condition is: the frame sharpness of the current audio frame is greater than a second sharpness threshold.

[0277] That is, when the frame sharpness of the current audio frame is greater than the second sharpness threshold, the electronic device determines that the current audio frame is a sibilant frame. When the frame sharpness of the current audio frame is less than the second sharpness threshold, the electronic device determines that the current audio frame is not a sibilant frame.

[0278] It should be understood that for the case where the frame sharpness of the current audio frame is equal to the second sharpness threshold, it can be divided into the case where the current audio frame is determined to be a sibilant frame, or it can be divided into the case where the current audio frame is not determined to be a sibilant frame. No limitation is made here.

[0279] It should be understood that the process of determining the frame sharpness of an audio frame described in method 500 is for illustrative purposes only and should not be construed as limiting the embodiments of the present application. Any method capable of determining the frame sharpness of an audio frame is within the protection scope of the embodiments of the present application.

[0280] Fig.12 It is a schematic flow chart of the method 600 for sibilant sound processing provided in an embodiment of the present application.

[0281] In step S610, the electronic device determines that the current audio frame is a sibilant frame.

[0282] As mentioned above, the electronic device can determine whether the current audio frame is a sibilant sound frame based on the target feature value of the current audio frame: when the target feature value meets the second preset condition, the electronic device determines that the current audio frame is a sibilant sound frame; when the target feature value does not meet the second preset condition, the electronic device determines that the current audio frame is not a sibilant sound frame.

[0283] In some embodiments, the target feature value may be a frame sharpness of the current audio frame; and the second preset condition may be: the frame sharpness of the current audio frame is greater than a second sharpness threshold.

[0284] For a specific description of determining that the current audio frame is a sibilant frame when the frame sharpness of the current audio frame satisfies the second preset condition, reference may be made to the above related description, which will not be repeated here.

[0285] In step S620, the electronic device determines a core suppression frequency band and an adaptive suppression frequency band of the current audio frame.

[0286] In some embodiments, the electronic device may use the bark scale to measure the sharpness distribution of the audio frame and determine the core suppression frequency band and the adaptive suppression frequency band of the current audio frame.

[0287] In other embodiments, the electronic device may use other scales such as the Mel-spectrogram scale to measure the human ear's perception of sound. It is not limited to determining the core suppression frequency band and the adaptive suppression frequency band based on the sharpness of the current audio frame, but may also determine the core suppression frequency band and the adaptive suppression frequency band based on other target feature values ​​for characterizing audio characteristics.

[0288] In an embodiment of using the bark scale to measure the sharpness distribution of an audio frame, optionally, before determining a core suppression frequency band and an adaptive suppression frequency band of a current audio frame, the method includes: the electronic device determines a first bark frequency band in a bark domain corresponding to a maximum sharpness based on the sharpness distribution of the current audio frame; and in the step of determining a core suppression frequency band and an adaptive suppression frequency band of the current audio frame, the electronic device determines a core suppression frequency band and an adaptive suppression frequency band based on the first bark frequency band, and both the core suppression frequency band and the adaptive suppression frequency band include the first bark frequency band.

[0289] Since the first bark frequency band is the frequency band corresponding to the maximum sharpness, the sibilant energy of the first bark frequency band is relatively high. Based on the core suppression frequency band and the adaptive suppression frequency band determined based on the first bark frequency band, the frequency band with overall higher sibilant energy can be better determined to improve the sibilant suppression effect.

[0290] For a detailed description of the electronic device determining the first bark frequency band, reference may be made to the related description of step S410 above, which will not be repeated here.

[0291] The following specifically describes the process of the electronic device determining the core suppression frequency band and the adaptive suppression frequency band according to the first bark frequency band.

[0292] 1. Electronic equipment determines the core suppression frequency band based on the first bark frequency band

[0293] In the step of the electronic device determining the core suppression frequency band according to the first bark frequency band, the electronic device determines the core suppression interval according to the first bark frequency band, converts the core suppression interval from the bark domain to the linear frequency domain, and obtains the core suppression frequency band corresponding to the core suppression interval.

[0294] In some embodiments, the electronic device determines a core suppression interval based on the first bark frequency band and bandwidth parameters to obtain a core suppression frequency band corresponding to the core suppression interval, wherein the core suppression frequency band includes the first bark frequency band and a frequency band extended based on the channel bandwidth parameter.

[0295] It can be understood that the bandwidth parameter is used to extend the frequency band.

[0296] Exemplarily, the bandwidth parameter is used to indicate the number M1 of bark frequency bands. In implementation, the electronic device determines a core suppression interval according to M1 and the first bark frequency band to obtain a core suppression frequency band.

[0297] In one example, the electronic device takes the first bark frequency band as the central frequency band, and expands M1 bark frequency bands to both sides of the first bark frequency band to obtain a core suppression frequency band.

[0298] In this embodiment, the electronic device takes the first bark frequency band as the center frequency band, expands M1 bark frequency bands on both sides of the first bark frequency band to obtain a core suppression interval, converts the core suppression interval from the bark domain to the linear frequency domain, and obtains a core suppression frequency band corresponding to the core suppression interval.

[0299] Generally speaking, areas with high sibilance energy are concentrated on both sides of the first bark frequency band. Therefore, the core suppression frequency band obtained by expanding M1 bark frequency bands on both sides of the first bark frequency band can well and comprehensively obtain the frequency band with overall higher sibilance energy, so as to further improve the sibilance suppression effect.

[0300] For a specific description of the electronic device determining the core suppression interval, reference may be made to the above description of step S420 and will not be repeated here.

[0301] In other examples, the electronic device may also expand M1 bark frequency bands to either side of the first bark frequency band to obtain a core suppression interval, and convert the core suppression interval from the bark domain to the linear frequency domain to obtain a core suppression frequency band corresponding to the core suppression interval. For example, M1=35, the first bark frequency band is the 165th bark, then the core suppression interval is [165bark, 200bark] or [130bark, 165bark].

[0302] It should be understood that the above method of determining the core suppression frequency band according to the first bark frequency band and the bandwidth parameter is only an illustrative description. In other embodiments, the electronic device can also determine the core suppression frequency band according to the first bark frequency band and some rules.

[0303] For example, the core suppression interval can be determined by referring to the method of determining the adaptive suppression interval in step S430 above to obtain the core suppression frequency band. However, since the adaptive suppression frequency band itself is used to expand the core suppression frequency band, the first preset condition for limiting the frequency band expansion itself will be set relatively loose. When the core suppression frequency band is determined in a similar manner, the preset condition for limiting the frequency band expansion can be set relatively strict (for example, the first sharpness threshold is set to a larger value).

[0304] 2. The electronic device determines the adaptive suppression frequency band according to the first bark frequency band

[0305] In the step of an electronic device determining an adaptive suppression frequency band based on a first bark frequency band, in some embodiments, the electronic device expands the frequency band to both sides of the first bark frequency band based on the sharpness distribution of a current audio frame to determine an adaptive suppression frequency band, wherein the frequency band sharpness of the adaptive suppression frequency band satisfies a first preset condition, and the first preset condition is used to limit the expansion of the adaptive suppression frequency band.

[0306] That is, in this embodiment, the electronic device expands the frequency band to both sides of the first bark frequency band according to the sharpness distribution of the current audio frame until the frequency band sharpness of the expanded adaptive suppression frequency band meets the first preset condition, and the electronic device no longer expands the frequency band.

[0307] Since the adaptive suppression frequency band is expanded based on the sharpness distribution of the current audio frame and is closely related to the characteristics of the audio frame itself, the adaptive suppression frequency band obtained for each audio frame is more in line with the characteristics of each audio frame, so as to accurately determine the suppression frequency band of each audio frame, thereby better improving the effect of sibilance suppression and, at the same time, improving the flexibility of sibilance processing.

[0308] In the above embodiment of extending the frequency band to both sides of the first bark frequency band to determine the adaptive suppression frequency band according to the sharpness distribution of the current audio frame, the adaptive suppression frequency band can be determined in the following two ways.

[0309] Method 1

[0310] The electronic device performs K comparison processes on the sharpness corresponding to each bark frequency band in multiple bark frequency bands on both sides of the first bark frequency band according to the sharpness distribution of the current audio frame. When the frequency band sharpness of the candidate suppression interval obtained in the Kth comparison process meets the first preset condition, the frequency band corresponding to the candidate suppression interval obtained in the Kth comparison process is determined as the adaptive suppression frequency band, where K is an integer greater than 1.

[0311] That is to say, in method 1, the electronic device performs K comparison processes, and each comparison process will obtain a candidate suppression interval. The sharpness of the frequency band of the candidate suppression interval obtained in each comparison process is judged. If the first preset condition is not met, the next comparison process is continued to expand the suppression interval. Until the candidate suppression interval obtained in the Kth comparison process meets the first preset condition, the suppression interval is no longer expanded, and the frequency band corresponding to the candidate suppression interval obtained in the Kth comparison process is determined as the final adaptive suppression frequency band.

[0312] During the first comparison process, the electronic device compares the sharpness corresponding to the two bark frequency bands on both sides of the first bark frequency band, and determines the bark frequency band corresponding to the maximum sharpness in the first comparison process as the initial candidate bark frequency band; the electronic device determines the interval between the first bark frequency band and the initial candidate bark frequency band, including the first bark frequency band and the initial candidate bark frequency band, as the candidate suppression interval in the first comparison process, and the frequency band sharpness of the candidate suppression interval in the first comparison process does not meet the first preset condition.

[0313] It should be understood that the two bark frequency bands on both sides of the first bark frequency band represent two bark frequency bands located on both sides of the first bark frequency band and having the same spacing as the boundary frequency band of the first bark frequency band. Exemplarily, the two bark frequency bands on both sides of the first bark frequency band represent two bark frequency bands located on both sides of the first bark frequency band and closest to the two boundary frequency bands of the candidate suppression interval.

[0314] For a detailed description of the first comparison process, reference may be made to the related description of the first comparison process of step S430 above, where the initial candidate bark frequency band and candidate suppression interval may correspond to candidate bark frequency band 1 and candidate suppression interval 1 of step S430 respectively.

[0315] During the i-th comparison process, the electronic device compares the sharpness corresponding to the two bark frequency bands on both sides of the candidate suppression interval obtained during the i-1-th comparison process, and determines the bark frequency band corresponding to the maximum sharpness during the i-th comparison process as the intermediate candidate bark frequency band, where i is greater than 1 and less than K; the electronic device determines the interval between the intermediate candidate bark frequency band and the boundary bark frequency band, including the intermediate candidate bark frequency band and the boundary bark frequency band obtained during the i-1-th comparison process, as the candidate suppression interval during the i-th comparison process, the boundary bark frequency band is the frequency band in the candidate suppression interval obtained during the i-1-th comparison process that is far away from the intermediate candidate bark frequency band, and the frequency band sharpness of the candidate suppression interval during the i-th comparison process does not meet the first preset condition.

[0316] It should be understood that the two bark frequency bands on both sides of the candidate suppression interval represent two bark frequency bands located on both sides of the candidate suppression interval with the same spacing as the boundary frequency band of the candidate suppression interval. Exemplarily, the two bark frequency bands on both sides of the candidate suppression interval represent two bark frequency bands located on both sides of the candidate suppression interval and closest to the two boundary frequency bands of the candidate suppression interval.

[0317] In layman's terms, the boundary bark frequency band is the frequency band in the candidate suppression interval obtained in the previous comparison process that is far away from the middle candidate bark frequency band obtained in the current comparison process.

[0318] The i-th comparison process here can be any comparison process except the first comparison process and the K-th comparison process in the K-th comparison process. For each comparison process except the first comparison process and the K-th comparison process, the candidate suppression interval of the i-th comparison process is obtained through the i-th comparison process. In addition, when i is equal to 2, the i-1-th comparison process is the first comparison process.

[0319] For a specific description of the ith comparison process, reference may be made to the relevant description of the 2nd comparison process or the 3rd comparison process of step S430 above. When the ith comparison process here corresponds to the 3rd comparison process above, the middle candidate bark band here may correspond to the candidate bark band 2 above, and the boundary bark band here may correspond to the boundary bark band 1 above. When the ith comparison process here corresponds to the 3rd comparison process above, the middle candidate bark band here may correspond to the candidate bark band 3 above, and the boundary bark band here may correspond to the boundary bark band 2 above.

[0320] For the Ki comparison processes after the i-th comparison process, the electronic device continues to perform the Ki comparison processes until an adaptive suppression frequency band is determined in the K-th comparison process.

[0321] In the implementation, in the Kth comparison process, the candidate suppression interval of the Kth comparison process is obtained based on the same method as the i-th comparison process, the frequency band sharpness of the candidate suppression interval obtained in the K-th comparison process is judged, and it is determined that the frequency band sharpness of the candidate suppression interval obtained in the K-th comparison process meets the first preset condition. Then, the candidate suppression interval obtained in the K-th comparison process is determined as an adaptive suppression interval, and the adaptive suppression interval is converted from the bark domain to the linear frequency domain to obtain an adaptive suppression frequency band corresponding to the adaptive interval.

[0322] In the above embodiment, the electronic device performs K comparison processes on the sharpness corresponding to each bark frequency band in the multiple bark frequency bands on both sides of the first bark frequency band according to the sharpness distribution of the current audio frame, determines the maximum sharpness among the sharpness corresponding to the two bark frequency bands on both sides of the first bark frequency band through each comparison process, determines the candidate suppression interval for each comparison process based on the maximum sharpness obtained in each comparison process, and achieves the purpose of expanding a part of the suppression interval in each comparison process, and finally completes the expansion of the suppression interval through multiple comparison processes to obtain an adaptive suppression frequency band. Based on the adaptive suppression frequency band obtained by cyclically traversing the sharpness of the current audio frame, it is possible to comprehensively search for bark frequency bands with larger sharpness values ​​based on the characteristics of the current audio frame as much as possible, so as to more accurately obtain an adaptive suppression frequency band that conforms to the current audio frame.

[0323] Regarding the first preset condition, in some embodiments, the first preset condition is that the frequency band sharpness of the candidate suppression interval obtained in each comparison process is greater than a first sharpness threshold.

[0324] Exemplarily, the first sharpness threshold is the product of the frame sharpness of the current audio frame and a coefficient, and the coefficient is less than 1.

[0325] For a detailed description of the first preset condition, please refer to the relevant description in step S430 above, which will not be repeated here.

[0326] Since the frame sharpness of the current audio frame is related to the current audio frame, the first sharpness threshold is designed to be the product of the frame sharpness of the current audio frame and the coefficient, so that the first preset condition is related to each audio frame, and the obtained adaptive suppression frequency band is more in line with each audio frame, which is conducive to more accurately determining the suppression frequency band of each audio frame, thereby better improving the effect of sibilance suppression.

[0327] In addition, for the specific description of method 1, please refer to the relevant description of step S430 above, which will not be repeated here.

[0328] Method 2

[0329] In other embodiments, with the bark interval as the granularity, the electronic device may also gradually expand the suppression interval according to the sharpness corresponding to each bark interval in the multiple bark intervals on both sides of the first bark frequency band, and finally obtain an adaptive suppression interval to obtain an adaptive suppression frequency band.

[0330] Exemplarily, the electronic device performs multiple comparison processes, determines the maximum sharpness among the sharpnesses corresponding to the two bark intervals on both sides of the first bark frequency band through each comparison process, determines the candidate suppression interval for each comparison process based on the maximum sharpness, expands the suppression interval by a part of the frequency band in each comparison process, and finally expands the suppression interval through multiple comparison processes to obtain an adaptive suppression interval, so as to obtain an adaptive suppression frequency band.

[0331] It should be understood that the two bark intervals on both sides of the first bark frequency band in any two comparison processes are not exactly the same, wherein the two bark intervals on both sides of the first bark frequency band in the current comparison process are the two bark intervals on both sides of the candidate suppression interval obtained in the previous comparison process.

[0332] It should also be understood that a bark interval includes at least one bark frequency band, and illustratively, the frequency band widths of two bark intervals in each comparison process are the same. In addition, the frequency band widths of two bark intervals in any two comparison processes may also be the same.

[0333] During the first comparison process, the electronic device compares the sharpness corresponding to the two bark intervals on both sides of the first bark frequency band, determines the maximum sharpness among the sharpness corresponding to the two bark intervals, retains the bark interval corresponding to the maximum sharpness (recorded as candidate bark interval 1), and records the interval between the first bark frequency band including the first bark frequency band and the candidate bark interval 1 and the candidate bark interval 1 as the candidate suppression interval 1, accumulates and sums the sharpness corresponding to each bark frequency band of the candidate suppression interval 1, and if the frequency band sharpness of the candidate suppression interval 1 obtained by the summation does not meet the first preset condition, the suppression interval continues to be expanded.

[0334] Take the first preset condition that the frequency band sharpness of the candidate suppression interval obtained in each comparison process is greater than the first sharpness threshold as an example. For example, continue to take the first bark frequency band as the 165th bark as an example, the two bark intervals on both sides of the 165th bark are [166bark-167bark] and [163bark-164bark], respectively, compare the sharpness of these two bark intervals, the sharpness corresponding to [166bark-167bark] is greater than the sharpness corresponding to [163bark-164bark], therefore, the interval between the 165th bark and [166bark-167bark] including the 165th bark and [166bark-167bark] is recorded as candidate suppression interval 1, and the sharpness corresponding to each bark frequency band in the candidate suppression interval 1 is accumulated and summed, the frequency band sharpness of the candidate suppression interval 1 obtained is less than the first sharpness threshold, and the suppression interval is continued to be expanded.

[0335] In the second comparison process, taking the candidate suppression interval 1 obtained in the first comparison process as a reference, the electronic device compares the sharpness corresponding to the two bark intervals on both sides of the candidate suppression interval 1, determines the maximum sharpness among the sharpness corresponding to the two bark intervals, retains the bark interval corresponding to the maximum sharpness (recorded as candidate bark interval 2), and records the interval between the candidate suppression interval 1 and the candidate bark interval 2, including the candidate suppression interval 1 and the candidate bark interval 2, as the candidate suppression interval 2, accumulates and sums the sharpness corresponding to each bark frequency band of the candidate suppression interval 2, and if the frequency band sharpness of the candidate suppression interval 2 obtained by the summation does not meet the first preset condition, the suppression interval is continued to be expanded.

[0336] Subsequently, the same method is adopted, and so on, to continue multiple comparison processes until the sum of the sharpness corresponding to each bark frequency band in the extended candidate suppression interval K (i.e., the frequency band sharpness) meets the first preset condition, then the expansion interval is stopped, and the candidate suppression interval K obtained in the last comparison process is determined as the adaptive suppression interval to obtain an adaptive suppression frequency band.

[0337] It should be understood that the above method of extending the frequency band to both sides of the first bark frequency band to determine the adaptive suppression frequency band according to the sharpness distribution of the current audio frame is only an illustrative description and should not constitute a limitation to the embodiments of the present application.

[0338] In other embodiments, the electronic device may determine the adaptive suppression frequency band according to the first bark frequency band and the frequency band parameter.

[0339] For example, the frequency band parameter is used to indicate the number M2 of bark frequency bands. The electronic device takes the first bark frequency band as the center frequency band, and expands M2 bark frequency bands on both sides of the first bark frequency band to obtain an adaptive suppression interval, so as to obtain an adaptive suppression frequency band.

[0340] For another example, the electronic device takes the first bark frequency band as the central frequency band, expands M2 bark frequency bands to either side of the first bark frequency band, obtains an adaptive suppression interval, and thus obtains an adaptive suppression frequency band.

[0341] It should be understood that in this embodiment, the number M2 of bark bands indicated by the frequency band parameter used to determine the adaptive suppression frequency band is greater than the number M1 of bark bands indicated by the bandwidth parameter used to determine the core suppression frequency band. Therefore, the frequency band range of the adaptive suppression frequency band obtained based on this embodiment includes the frequency band range of the core suppression frequency band.

[0342] In step S630, the electronic device determines a first squeezing gain of a core squeezing frequency band.

[0343] In some embodiments, the electronic device determines the first compression gain based on the gain coefficient and the initial compression gain, where the gain coefficient is related to the current audio frame.

[0344] That is to say, in this embodiment, the gain coefficient is dynamically changed according to the current audio frame, so the gain coefficient may be different for different audio frames. In this way, the first suppression gain can be more consistent with and adaptable to each audio frame, the effect of sibilance suppression can be improved, and the flexibility of sibilance processing can be improved.

[0345] The gain coefficient may be related to any audio parameter used to measure the audio. In one example, the gain coefficient is related to the frame sharpness of the current audio frame and the second sharpness threshold. Exemplarily, the relationship between the gain coefficient, the current audio frame, and the second sharpness threshold may be represented by the first formula in step S450 above. For a specific description of the first formula, reference may be made to the relevant description above, which will not be repeated here.

[0346] In this way, by associating the gain coefficient with the frame sharpness of the audio frame and the second sharpness threshold, it is possible to conveniently realize the dynamic change of the gain coefficient with different audio frames.

[0347] In step S640, when the frequency band range of the adaptive suppression band includes the frequency band range of the core suppression band, or when the frequency band range of the adaptive suppression band partially overlaps with the frequency band range of the core suppression band, at least one extended suppression band is determined.

[0348] For the specific description of this step, please refer to the relevant description of step S470 above, which will not be repeated here.

[0349] In step S650, the electronic device determines a second suppression gain for each extended suppression frequency band.

[0350] In some embodiments, the electronic device determines the second suppression gain of each extended suppression frequency band according to the frequency change direction from the first boundary frequency to the second boundary frequency of each extended suppression frequency band, with the first suppression gain as a reference, and in a manner of increasing the gain step by one frequency band width for each incremental increase. Exemplarily, the gain step can be obtained according to the second formula in the above step S480. For the specific description of the second formula, reference can be made to the relevant description above, and no further description is given.

[0351] For the specific description of this step, please refer to the relevant description of step S480 above, which will not be repeated here.

[0352] In step S670, the electronic device applies the first suppression gain to the energy of the current audio frame in the core suppression frequency band, and applies the second suppression gain of each extended suppression frequency band to the energy of the current audio frame in each extended suppression frequency band to perform sibilance suppression.

[0353] For the specific description of step S670, please refer to the relevant description of step S360 above, which will not be repeated here.

[0354] In the method for sibilance processing provided by the embodiment of the present application, the determined suppression frequency band of the audio frame includes a core suppression frequency band and an adaptive suppression frequency band for extending the core suppression frequency band. When the frequency band range of the adaptive suppression frequency band includes the frequency band range of the core suppression frequency band or the frequency band range of the adaptive suppression frequency band partially overlaps with the frequency band range of the core suppression frequency band, the suppression frequency band of the sibilance is expanded by the adaptive suppression frequency band, that is, an extended suppression frequency band other than the core suppression frequency band is obtained, the frequency band range of the suppression frequency band is increased, and the sibilance processing is performed on the suppression frequency band with a larger range, so that a better sibilance suppression effect can be obtained. Moreover, since the adaptive suppression frequency band expands the core suppression frequency band, the gain of the core suppression frequency band is the first suppression gain, and for the extended suppression frequency band, the second suppression gain of the extended suppression frequency band increases from the first suppression gain to 1, which can avoid the problem of sound quality damage caused by still using a smaller gain to suppress the energy of the extended suppression frequency band. Therefore, the gradually increasing second suppression gain can smooth the sound quality damage, and while improving the sibilance suppression effect, it can minimize the damage to the sound quality. In summary, the method for sibilant sound processing provided in the embodiment of the present application achieves a good balance between sound quality and sibilant sound suppression, and can effectively improve the sibilant sound suppression effect while minimizing sound quality damage.

[0355] In some embodiments, the method 600 further includes: when the frequency band range of the core suppression band includes the frequency band range of the adaptive suppression band, applying the first suppression gain to the energy of the current audio frame in the core suppression band.

[0356] Although the frequency band range of the core suppression band includes the frequency band range of the adaptive suppression band, the frequency band range of the core suppression band itself is relatively small. Taking the core suppression band as the final suppression band and performing sibilance processing on the core suppression band will have little impact on the sound quality or will be within an acceptable range if sibilance suppression can be achieved. Moreover, since the first suppression gain itself is the gain of the core suppression band, directly using the first suppression gain to perform sibilance processing on the core suppression band can avoid the increase in algorithm difficulty due to the addition of extra steps, thereby facilitating algorithm implementation.

[0357] It should be understood that the order of execution of the processes in the above embodiment does not mean the order of execution, and the execution order of the processes should be determined by their functions and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present invention. For example, step S630 can be executed after step S640 or step S650.

[0358] Above, combined Figures 1 to 12 , the method for processing dental sounds provided by the embodiment of the present application is described in detail, and the following will be combined with Figure 13 to Figure 14 , describe in detail the device and electronic device for sibilant sound processing provided according to the embodiments of the present application.

[0359] Fig.13 1 is an exemplary block diagram of a device 700 for sibilant sound processing provided in an embodiment of the present application. The device 700 is an electronic device, or a chip in an electronic device.

[0360] The apparatus 700 is used to execute each process and step corresponding to the terminal device in the above method 600. The apparatus 700 includes: a processing unit 710, and the processing unit 710 is used to execute the following steps:

[0361] Determine that the current audio frame is a sibilant frame;

[0362] Determining a core suppression frequency band of the current audio frame;

[0363] Determining an adaptive suppression frequency band of the current audio frame;

[0364] Determining a first suppression gain of the core suppression frequency band, wherein the first suppression gain is less than 1;

[0365] When the frequency band range of the adaptive suppression frequency band includes the frequency band range of the core suppression frequency band, or when the frequency band range of the adaptive suppression frequency band partially overlaps with the frequency band range of the core suppression frequency band, at least one extended suppression frequency band is determined, each extended suppression frequency band being a frequency band in the adaptive suppression frequency band except the core suppression frequency band;

[0366] Determine a second suppression gain of each extended suppression frequency band, wherein the second suppression gain of each extended suppression frequency band increases from the first suppression gain to 1 according to a frequency change direction from a first boundary frequency of each extended suppression frequency band that is closest to the core suppression frequency band to a second boundary frequency that is farthest from the core suppression frequency band;

[0367] The first suppression gain is applied to the energy of the current audio frame in the core suppression frequency band, and the second suppression gain of each extended suppression frequency band is applied to the energy of the current audio frame in each extended suppression frequency band.

[0368] Optionally, the processing unit 710 is specifically used to: determine a first bark frequency band in the bark domain corresponding to the maximum sharpness according to the sharpness distribution of the current audio frame; determine the core suppression frequency band according to the first bark frequency band, and the core suppression frequency band includes the first bark frequency band.

[0369] Optionally, the processing unit 710 is specifically configured to: take the first bark frequency band as a central frequency band, and respectively expand M1 bark frequency bands on both sides of the first bark frequency band to obtain the core suppression frequency band.

[0370] Optionally, the processing unit 710 is specifically used to: determine a first bark frequency band in the bark domain corresponding to the maximum sharpness according to the sharpness distribution of the current audio frame; determine the adaptive suppression frequency band according to the first bark frequency band, and the adaptive suppression frequency band includes the first bark frequency band.

[0371] Optionally, the processing unit 710 is specifically used to: expand the frequency band to both sides of the first bark frequency band according to the sharpness distribution of the current audio frame to determine the adaptive suppression frequency band, wherein the frequency band sharpness of the adaptive suppression frequency band satisfies a first preset condition, and the first preset condition is used to limit the expansion of the adaptive suppression frequency band.

[0372] Optionally, the processing unit 710 is specifically used to: perform K comparison processes on the sharpness corresponding to each bark frequency band in the multiple bark frequency bands on both sides of the first bark frequency band according to the sharpness distribution of the current audio frame, and when the frequency band sharpness of the candidate suppression interval obtained in the Kth comparison process meets the first preset condition, determine the frequency band corresponding to the candidate suppression interval obtained in the Kth comparison process as the adaptive suppression frequency band, where K is an integer greater than 1; wherein,

[0373] In the first comparison process, the sharpnesses corresponding to the two bark frequency bands on both sides of the first bark frequency band are compared, and the bark frequency band corresponding to the maximum sharpness in the first comparison process is determined as the initial candidate bark frequency band;

[0374] determining an interval between the first bark frequency band and the initial candidate bark frequency band, including the first bark frequency band and the initial candidate bark frequency band, as a candidate suppression interval in the first comparison process, wherein the frequency band sharpness of the candidate suppression interval in the first comparison process does not satisfy the first preset condition;

[0375] In the i-th comparison process, the sharpnesses corresponding to the two bark frequency bands on both sides of the candidate suppression interval obtained in the i-1-th comparison process are compared, and the bark frequency band corresponding to the maximum sharpness in the i-th comparison process is determined as the middle candidate bark frequency band, where i is greater than 1 and less than K;

[0376] determining an interval between the intermediate candidate bark frequency band and the boundary bark frequency band obtained in the (i-1)th comparison process as a candidate suppression interval in the i-th comparison process, wherein the boundary bark frequency band is a frequency band far from the intermediate candidate bark frequency band in the candidate suppression interval obtained in the (i-1)th comparison process, and the frequency band sharpness of the candidate suppression interval in the i-th comparison process does not satisfy the first preset condition;

[0377] Ki comparison processes are performed after the i-th comparison process until the adaptive suppression frequency band is determined in the K-th comparison process.

[0378] Optionally, the first preset condition is that the frequency band sharpness of the candidate suppression interval obtained in each comparison process is greater than a first sharpness threshold.

[0379] Optionally, the first sharpness threshold is a product of a frame sharpness of the current audio frame and a coefficient, and the coefficient is less than 1.

[0380] Optionally, the processing unit 710 is specifically configured to: determine the first compression gain according to a gain coefficient and an initial compression gain, wherein the gain coefficient is related to the current audio frame.

[0381] Optionally, the gain coefficient is related to the frame sharpness of the current audio frame and a second sharpness threshold.

[0382] Optionally, the processing unit 710 is specifically used to determine the second suppression gain of each extended suppression frequency band according to the frequency change direction from the first boundary frequency to the second boundary frequency of each extended suppression frequency band, taking the first suppression gain as a reference, and increasing the gain step by one increment for each incremental increase in the frequency band width.

[0383] Optionally, the gain step is obtained according to the following formula:

[0384]

[0385] Among them, step is the gain step size, P is the number of frequency points in each extended suppression frequency band, and gain is the first suppression gain.

[0386] Optionally, the processing unit 710 is further configured to: when the frequency band range of the core suppression frequency band includes the frequency band range of the adaptive suppression frequency band, apply the first suppression gain to the energy of the current audio frame in the core suppression frequency band.

[0387] Optionally, the processing unit 710 is specifically configured to: determine a target feature value of the current audio frame;

[0388] When the target feature value satisfies a second preset condition, it is determined that the current audio frame is a sibilant frame.

[0389] Optionally, the target feature value is the frame sharpness of the current audio frame; and the second preset condition is: the frame sharpness of the current audio frame is greater than a second sharpness threshold.

[0390] It should be understood that the processing unit 710 can be used to execute each step performed by the electronic device in the method 600. For specific descriptions, please refer to the relevant descriptions above and will not be repeated here.

[0391] In the embodiments of the present application, Fig.13 The device may also be a chip or a chip system, such as a system on chip (SoC).

[0392] Fig.14 8 is a schematic structural diagram of an electronic device 800 provided in an embodiment of the present application. The electronic device 800 is used to execute the corresponding steps and / or processes in the above method embodiment.

[0393] The electronic device 800 includes a processor 810, a transceiver 820, and a memory 830. The processor 810, the transceiver 820, and the memory 830 communicate with each other through an internal connection path, and the processor 810 can implement the functions of the processor 810 in various possible implementations of the electronic device 800. The memory 830 is used to store instructions, and the processor 800 is used to execute the instructions stored in the memory 830, or in other words, the processor 810 can call these stored instructions to implement the functions of the processor 810 in the electronic device 800.

[0394] Optionally, the memory 830 may include a read-only memory and a random access memory, and provide instructions and data to the processor. A portion of the memory may also include a non-volatile random access memory. For example, the memory may also store information about the device type. The processor 810 may be used to execute instructions stored in the memory, and when the processor 810 executes instructions stored in the memory, the processor 810 is used to execute the various steps and / or processes of the above-mentioned method embodiment corresponding to the network device or the terminal device.

[0395] also, Fig.14 The electronic device 800 shown may correspond to Figure 1 In the electronic device 100 shown, the processor 810 in the electronic device 800 may correspond to the processor 110 in the electronic device 100 , and the transceiver 820 in the electronic device 800 may correspond to the antenna 1 and the antenna 2 in the electronic device 100 .

[0396] The electronic device 800 is used to execute the various processes and steps corresponding to the electronic device in the above-mentioned method 600, and the steps executed by the processor 810 can correspond to the various steps executed by the processing unit 710 in the device 700. The specific description refers to the above description and will not be repeated here.

[0397] It should be understood that in the embodiments of the present application, the processor of the above-mentioned device may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0398] In the implementation process, each step of the above method can be completed by an integrated logic circuit of hardware in a processor or an instruction in the form of software. The steps of the method disclosed in conjunction with the embodiment of the present application can be directly embodied as a hardware processor for execution, or a combination of hardware and software units in a processor for execution. The software unit can be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, etc. The storage medium is located in a memory, and the processor executes the instructions in the memory, and completes the steps of the above method in conjunction with its hardware. To avoid repetition, it is not described in detail here.

[0399] The embodiment of the present application provides a computer program product, when the computer program product is run on a terminal device, the terminal device executes the technical solution in the above embodiment. Its implementation principle and technical effect are similar to those of the above method-related embodiments, and will not be repeated here.

[0400] The embodiment of the present application provides a readable storage medium, the readable storage medium contains instructions, when the instructions are executed in a terminal device, the terminal device executes the technical solution of the above embodiment. The implementation principle and technical effect are similar, and will not be repeated here.

[0401] The embodiment of the present application provides a chip, which is used to execute instructions. When the chip is running, the technical solution in the above embodiment is executed. The implementation principle and technical effect are similar and will not be repeated here.

[0402] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (digital subscriber line, DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a high-density digital video disc (DVD)), or a semiconductor medium (eg, a solid state disk (SSD)).

[0403] It should be understood that the "embodiment" mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, the various embodiments in the entire specification do not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the size of the sequence number of the above-mentioned processes does not mean the order of execution, and the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present application.

[0404] It should also be understood that in the present application, "when", "if" and "if" all mean that the UE or base station will take corresponding actions under certain objective circumstances. It is not a time limit, and it does not require the UE or base station to make judgments when implementing it, nor does it mean that there are other limitations.

[0405] A person skilled in the art may understand that the various numerical numbers such as first and second involved in the present application are only used for the convenience of description and are not used to limit the scope of the embodiments of the present application, and also indicate the order of precedence.

[0406] In this application, elements expressed in the singular are intended to mean "one or more" rather than "one and only one", unless otherwise specified. In this application, "at least one" is intended to mean "one or more", and "more than one" is intended to mean "two or more", unless otherwise specified.

[0407] The term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that there may be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. A can be singular or plural, and B can be singular or plural.

[0408] In this document, the term "at least one of..." or "at least one of..." means all or any combination of the listed items. For example, "at least one of A, B, and C" may mean: A exists alone, B exists alone, C exists alone, A and B exist at the same time, B and C exist at the same time, and A, B, and C exist at the same time, where A may be singular or plural, B may be singular or plural, and C may be singular or plural.

[0409] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0410] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0411] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0412] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0413] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0414] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage media include: various media that can store program codes, such as USB flash drives, mobile hard disks, read-only memories (ROM), random access memories (RAM), magnetic disks or optical disks.

[0415] The same or similar parts between the various embodiments in this application can refer to each other. In the various embodiments in this application, and the various implementation methods / implementation methods / implementation methods in each embodiment, if there is no special explanation and logical conflict, the terms and / or descriptions between different embodiments and the various implementation methods / implementation methods / implementation methods in each embodiment are consistent and can be referenced to each other. The technical features in different embodiments and the various implementation methods / implementation methods / implementation methods in each embodiment can be combined to form new embodiments, implementation methods, implementation methods, or implementation methods according to their inherent logical relationships. The above-described implementation methods of this application do not constitute a limitation on the scope of protection of this application.

[0416] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims. In short, the above is only a preferred embodiment of the technical solution of the present application, and is not used to limit the protection scope of the present application. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present application should be included in the protection scope of the present application.

Claims

1. A method for processing sibilant sound, characterized in that: include: Determine that the current audio frame is a sibilant frame; Determining a core suppression frequency band and an adaptive suppression frequency band of the current audio frame; Determining a first suppression gain of the core suppression frequency band, wherein the first suppression gain is less than 1; When the frequency band range of the adaptive suppression frequency band includes the frequency band range of the core suppression frequency band, or when the frequency band range of the adaptive suppression frequency band partially overlaps with the frequency band range of the core suppression frequency band, at least one extended suppression frequency band is determined, each extended suppression frequency band being a frequency band in the adaptive suppression frequency band except the core suppression frequency band; Determine a second suppression gain of each extended suppression frequency band, wherein the second suppression gain of each extended suppression frequency band increases from the first suppression gain to 1 according to a frequency change direction from a first boundary frequency of each extended suppression frequency band that is closest to the core suppression frequency band to a second boundary frequency that is farthest from the core suppression frequency band; The first suppression gain is applied to the energy of the current audio frame in the core suppression frequency band, and the second suppression gain of each extended suppression frequency band is applied to the energy of the current audio frame in each extended suppression frequency band.

2. The method according to claim 1, characterized in that Before determining the core suppression frequency band and the adaptive suppression frequency band of the current audio frame, the method further includes: Determining a first bark frequency band in a bark domain corresponding to a maximum sharpness according to the sharpness distribution of the current audio frame; and determining a core suppression frequency band and an adaptive suppression frequency band of the current audio frame, including: The core suppression frequency band and the adaptive suppression frequency band are determined according to the first bark frequency band, and both the core suppression frequency band and the adaptive suppression frequency band include the first bark frequency band.

3. The method according to claim 2, characterized in that Determining the core suppression frequency band according to the first bark frequency band includes: Taking the first bark frequency band as the central frequency band, M1 bark frequency bands are respectively extended to both sides of the first bark frequency band to obtain the core suppression frequency band, where M1 is an integer greater than 1 or equal to 1.

4. The method according to claim 2 or 3, characterized in that: Determining the adaptive suppression frequency band according to the first bark frequency band includes: According to the sharpness distribution of the current audio frame, the frequency band is expanded to both sides of the first bark frequency band to determine the adaptive suppression frequency band, wherein the frequency band sharpness of the adaptive suppression frequency band satisfies a first preset condition, and the first preset condition is used to limit the expansion of the adaptive suppression frequency band.

5. The method according to claim 4, characterized in that The step of extending the frequency band to both sides of the first bark frequency band according to the sharpness distribution of the current audio frame to determine the adaptive suppression frequency band includes: According to the sharpness distribution of the current audio frame, the sharpness corresponding to each bark frequency band in the multiple bark frequency bands on both sides of the first bark frequency band is compared K times, and when the frequency band sharpness of the candidate suppression interval obtained in the Kth comparison process meets the first preset condition, the frequency band corresponding to the candidate suppression interval obtained in the Kth comparison process is determined as the adaptive suppression frequency band, where K is an integer greater than 1; wherein, In the first comparison process, the sharpnesses corresponding to the two bark frequency bands on both sides of the first bark frequency band are compared, and the bark band corresponding to the maximum sharpness in the first comparison process is determined as the initial candidate bark frequency band; determining an interval between the first bark frequency band and the initial candidate bark frequency band, including the first bark frequency band and the initial candidate bark frequency band, as a candidate suppression interval in the first comparison process, wherein the frequency band sharpness of the candidate suppression interval in the first comparison process does not satisfy the first preset condition; In the i-th comparison process, the sharpnesses corresponding to the two bark frequency bands on both sides of the candidate suppression interval obtained in the i-1-th comparison process are compared, and the bark frequency band corresponding to the maximum sharpness in the i-th comparison process is determined as the middle candidate bark frequency band, where i is greater than 1 and less than K; determining an interval between the intermediate candidate bark frequency band and the boundary bark frequency band obtained in the (i-1)th comparison process as a candidate suppression interval in the i-th comparison process, wherein the boundary bark frequency band is a frequency band far from the intermediate candidate bark frequency band in the candidate suppression interval obtained in the (i-1)th comparison process, and the frequency band sharpness of the candidate suppression interval in the i-th comparison process does not satisfy the first preset condition; Ki comparison processes are performed after the i-th comparison process until the adaptive suppression frequency band is determined in the K-th comparison process.

6. The method according to claim 5, characterized in that The first preset condition is that the frequency band sharpness of the candidate suppression interval obtained in each comparison process is greater than the first sharpness threshold.

7. The method according to claim 6, characterized in that The first sharpness threshold is a product of a frame sharpness of the current audio frame and a coefficient, and the coefficient is less than 1.

8. The method according to any one of claims 1 to 7, characterized in that The determining of the first suppression gain of the core suppression frequency band comprises: The first compression gain is determined according to a gain coefficient and an initial compression gain, wherein the gain coefficient is related to the current audio frame.

9. The method according to claim 8, characterized in that The gain coefficient is related to the frame sharpness of the current audio frame and a second sharpness threshold.

10. The method according to any one of claims 1 to 9, characterized in that The determining of the second suppression gain of each extended suppression frequency band comprises: According to the frequency change direction from the first boundary frequency to the second boundary frequency of each extended suppression frequency band, the second suppression gain of each extended suppression frequency band is determined based on the first suppression gain and the gain step size is increased for each incremental increase in the frequency band width.

11. The method according to claim 10, characterized in that The gain step size is obtained according to the following formula: Among them, step is the gain step size, P is the number of frequency points in each extended suppression frequency band, and gain is the first suppression gain.

12. The method according to any one of claims 1 to 11, characterized in that The method further comprises: In a case where the frequency band range of the core suppression frequency band includes the frequency band range of the adaptive suppression frequency band, the first suppression gain is applied to the energy of the current audio frame in the core suppression frequency band.

13. The method according to any one of claims 1 to 12, characterized in that The determining that the current audio frame is a sibilant frame includes: Determining a target feature value of the current audio frame; When the target feature value satisfies a second preset condition, it is determined that the current audio frame is a sibilant frame.

14. The method according to claim 13, characterized in that The target feature value is the frame sharpness of the current audio frame; and the second preset condition is: the frame sharpness of the current audio frame is greater than a second sharpness threshold.

15. An electronic device, characterized in that: include: Memory, for storing computer instructions; A processor, configured to call the computer instructions stored in the memory to execute the method according to any one of claims 1 to 14.

16. A computer-readable storage medium, characterized in that: Used to store computer instructions, wherein the computer instructions are used to implement the method according to any one of claims 1 to 14.

17. A chip, characterized in that: The chip comprises: Memory: used to store instructions; A processor is used to call and execute the instructions from the memory so that an electronic device equipped with the chip system executes the method as described in any one of claims 1 to 14.

Images