Audio processing methods, apparatus, terminal devices and readable storage media

Abstract

This application discloses an audio processing method, apparatus, terminal device, and readable storage medium, including acquiring an audio to be processed; dividing the audio to be processed into a first audio and a second audio based on the sibilance amplitude corresponding to the audio to be processed; determining adjustment signals corresponding to the first audio and the second audio respectively to obtain a first adjustment signal corresponding to the first audio and a second adjustment signal corresponding to the second audio; and eliminating the sibilance of the audio to be processed according to the first adjustment signal and the second adjustment signal. This scheme can improve the flexibility of audio processing.

Description

Technical Field

[0001] This application relates to the field of information processing technology, specifically to an audio processing method, apparatus, terminal device, and storage medium. Background Technology

[0002] Sibilance refers to all the hissing sounds produced by humans, corresponding to high sharpness, and is generally unsuitable for human hearing. Audio acquisition software (such as karaoke software) typically performs band-stop filtering on the acquired audio data to detect sibilance before outputting the processed audio data to the user. This ensures that each frame of the audio data is within a suitable sharpness range, preventing high-sharp sibilance from damaging human hearing.

[0003] However, since different audio files have different volumes, current audio processing solutions use the same sibilance suppression method for all audio files, which can easily lead to poor sibilance suppression results. Summary of the Invention

[0004] In view of this, this application provides an audio processing method, apparatus, terminal device, and storage medium, which can improve the flexibility of audio processing.

[0005] This application provides an audio processing method, including:

[0006] Obtain the audio to be processed;

[0007] Based on the sibilance amplitude corresponding to the audio to be processed, the audio to be processed is divided into a first audio and a second audio.

[0008] The adjustment signals corresponding to the first audio and the second audio are determined respectively to obtain the first adjustment signal corresponding to the first audio and the second adjustment signal corresponding to the second audio.

[0009] Based on the first adjustment signal and the second adjustment signal, the sibilance of the audio to be processed is eliminated.

[0010] Optionally, in some embodiments of this application, the step of determining the adjustment signals corresponding to the first audio and the second audio respectively, and obtaining the first adjustment signal corresponding to the first audio and the second adjustment signal corresponding to the second audio, includes:

[0011] The sibilant signal corresponding to the audio to be processed is detected, and the sibilant signal is filtered.

[0012] Frequency band attenuation is applied to the sibilance region of the first audio signal;

[0013] The second audio signal is then filtered.

[0014] Based on the filtered signal, the first audio after frequency band attenuation, and the filtered second audio, a first adjustment signal corresponding to the first audio and a second adjustment signal corresponding to the second audio are determined.

[0015] Optionally, in some embodiments of this application, determining the first adjustment signal corresponding to the first audio and the second adjustment signal corresponding to the second audio based on the filtered signal, the first audio after frequency band attenuation, and the filtered second audio includes:

[0016] Calculate the first intermediate parameter based on the filtered signal and the first audio after frequency band attenuation;

[0017] Based on the filtered signal and the filtered second audio, calculate the second intermediate parameter;

[0018] The sum of the first intermediate parameter and the filtered signal is calculated to obtain the first adjustment signal corresponding to the first audio.

[0019] The second intermediate parameter is summed with the filtered signal to obtain the second adjustment signal corresponding to the second audio.

[0020] Optionally, in some embodiments of this application, calculating the first intermediate parameter based on the filtered signal and the first audio signal after frequency band attenuation includes:

[0021] The filtered signal is adjusted to obtain the adjusted signal;

[0022] The first intermediate parameter is obtained by multiplying the adjusted signal with the first audio frequency after frequency band attenuation.

[0023] Optionally, in some embodiments of this application, calculating the second intermediate parameter based on the filtered signal and the filtered second audio includes:

[0024] The filtered signal is adjusted to obtain the adjusted signal;

[0025] The second intermediate parameter is obtained by calculating the product of the adjusted signal and the filtered second audio.

[0026] Optionally, in some embodiments of this application, the step of determining the adjustment signals corresponding to the first audio and the second audio respectively, and obtaining the first adjustment signal corresponding to the first audio and the second adjustment signal corresponding to the second audio, includes:

[0027] Detect the sibilance signal corresponding to the audio to be processed;

[0028] The sibilant signal is filtered using a first filter to obtain a first filtered signal, and;

[0029] The sibilance signal is filtered using a second filter to obtain a second filtered signal.

[0030] Frequency band attenuation is applied to the sibilance region of the first audio signal;

[0031] The second audio signal is then filtered.

[0032] Based on the first filtered signal, the second filtered signal, the first audio after frequency band attenuation, and the second audio after filtering, a first adjustment signal corresponding to the first audio and a second adjustment signal corresponding to the second audio are determined.

[0033] Optionally, in some embodiments of this application, determining the first adjustment signal corresponding to the first audio and the second adjustment signal corresponding to the second audio based on the first filtered signal, the second filtered signal, the first audio after frequency band attenuation, and the second audio after filtering includes:

[0034] Based on the first filtered signal and the first audio after frequency band attenuation, calculate the third intermediate parameter;

[0035] Based on the second filtered signal and the filtered second audio, calculate the fourth intermediate parameter;

[0036] The sum of the third intermediate parameter and the first filtered signal is calculated to obtain the first adjustment signal corresponding to the first audio.

[0037] The sum of the fourth intermediate parameter and the second filtered signal is calculated to obtain the second adjustment signal corresponding to the second audio.

[0038] Optionally, in some embodiments of this application, the step of eliminating sibilance in the audio to be processed based on the first adjustment signal and the second adjustment signal includes:

[0039] The sum of the first adjustment signal and the second adjustment signal is calculated to obtain the sibilance-removed audio corresponding to the audio to be processed.

[0040] Optionally, in some embodiments of this application, the step of segmenting the audio to be processed into a first audio and a second audio based on the sibilance amplitude corresponding to the audio to be processed includes:

[0041] Detect whether the sibilance amplitude corresponding to the audio point in the audio to be processed is greater than a preset value;

[0042] Audio points with sibilance amplitude greater than or equal to a preset value are assigned to a first set to obtain a first audio;

[0043] Audio points with sibilance amplitude less than a preset value are assigned to a second set to obtain the second audio.

[0044] Optionally, in some embodiments of this application, the audio domain of the first audio is in the range of -5 dB to 0 dB.

[0045] Optionally, in some embodiments of this application, the audio domain of the second audio is in the range of -120 dB to -5 dB.

[0046] Optionally, in some embodiments of this application, the first adjustment signal is the same as the second adjustment signal.

[0047] Optionally, in some embodiments of this application, the first adjustment signal is different from the second adjustment signal.

[0048] Accordingly, this application also provides an audio processing apparatus, including:

[0049] The acquisition module is used to acquire the audio to be processed;

[0050] The segmentation module is used to segment the audio to be processed into a first audio and a second audio based on the sibilance amplitude corresponding to the audio to be processed;

[0051] The determining module is used to determine the adjustment signals corresponding to the first audio and the second audio respectively, so as to obtain the first adjustment signal corresponding to the first audio and the second adjustment signal corresponding to the second audio.

[0052] The elimination module is used to eliminate sibilance in the audio to be processed based on the first adjustment signal and the second adjustment signal.

[0053] In addition, this application also provides a terminal device, which includes a processor and a memory. The memory is used to store a computer program, and the processor runs the computer program to enable the terminal device to perform the above-described method.

[0054] In addition, this application also provides a readable storage medium storing a computer program, which, when executed by a processor, performs the above-described method.

[0055] This application provides an audio processing method, apparatus, terminal device, and readable storage medium. After acquiring the audio to be processed, the audio is segmented into a first audio and a second audio based on the sibilance amplitude corresponding to the audio. Then, adjustment signals corresponding to the first and second audio are determined respectively, resulting in a first adjustment signal for the first audio and a second adjustment signal for the second audio. Finally, the sibilance of the audio to be processed is eliminated based on the first and second adjustment signals. In the audio processing scheme provided by this application, the audio to be processed is segmented using the sibilance amplitude corresponding to the audio, and a first adjustment signal corresponding to the first audio and a second adjustment signal corresponding to the second audio are output. Finally, the sibilance of the audio to be processed is eliminated based on the first and second adjustment signals. For different audio to be processed, sibilance can be flexibly eliminated according to its sibilance amplitude, avoiding the use of the same sibilance suppression processing for all audio, which leads to poor sibilance suppression effect. Therefore, the sibilance suppression effect of the audio to be processed can be improved. Attached Figure Description

[0056] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0057] Figure 1 This is a schematic diagram of a scenario for the audio processing method provided in an embodiment of this application;

[0058] Figure 2 This is a schematic flowchart of the audio processing method provided in the embodiments of this application;

[0059] Figure 3 This is a schematic diagram of the specific process of step 102 in the audio processing method provided in the embodiments of this application;

[0060] Figure 4 This is a schematic flowchart of step 103 in the audio processing method provided in the embodiments of this application;

[0061] Figure 5 This is a schematic diagram of the specific flow of step S24 in the audio processing method provided in the embodiments of this application;

[0062] Figure 6 This is a schematic diagram of the specific flow of step S31 in the audio processing method provided in the embodiments of this application;

[0063] Figure 7 This is a schematic diagram of step S32 in the audio processing method provided in the embodiments of this application;

[0064] Figure 8 This is another specific flowchart of step 103 in the audio processing method provided in the embodiments of this application;

[0065] Figure 9 This is a schematic diagram of the specific flow of step S65 in the audio processing method provided in the embodiments of this application;

[0066] Figure 10 This is a schematic diagram illustrating the specific process of the audio processing method provided in this application;

[0067] Figure 11 This is another specific flowchart illustrating the audio processing method provided in this application;

[0068] Figure 12 This is another flowchart illustrating the audio processing method provided in this application;

[0069] Figure 13 This is a schematic diagram of the structure of the audio processing device provided in the embodiments of this application. Detailed Implementation

[0070] The technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application. In the absence of conflict, the following embodiments and their technical features can be combined with each other.

[0071] This application provides an audio processing method, apparatus, terminal device, and readable storage medium.

[0072] Specifically, the audio processing device can be integrated into a server or a terminal. The server can include a stand-alone server or a distributed server, or a server cluster consisting of multiple servers. The terminal can include a mobile phone, tablet computer, or personal computer (PC).

[0073] For example, please see Figure 1 This application provides an audio processing device integrated in a mobile phone 10. The mobile phone 10 acquires the audio to be processed, and then, based on the sibilance amplitude corresponding to the audio to be processed, the mobile phone 10 divides the audio to be processed into a first audio and a second audio. Next, the mobile phone 10 determines the adjustment signals corresponding to the first audio and the second audio respectively, and obtains a first adjustment signal corresponding to the first audio and a second adjustment signal corresponding to the second audio. Finally, the mobile phone 10 removes the sibilance of the audio to be processed according to the first adjustment signal and the second adjustment signal, and plays the sibilance-removed audio to the user 20.

[0074] The audio processing solution provided in this application divides the audio to be processed by utilizing the sibilance amplitude corresponding to the audio to be processed, and outputs a first adjustment signal corresponding to the first audio and a second adjustment signal corresponding to the second audio. Finally, based on the first adjustment signal and the second adjustment signal, the sibilance of the audio to be processed is eliminated. For different audio to be processed, the sibilance can be flexibly eliminated according to its sibilance amplitude, avoiding the use of the same sibilance suppression processing for all audio, which would result in poor sibilance suppression effect. Thus, the sibilance suppression effect of the audio to be processed can be improved.

[0075] The following sections provide detailed descriptions of each example. It should be noted that the order in which the embodiments are described is not intended to limit the priority of the embodiments.

[0076] This application provides an audio processing method, comprising: acquiring an audio to be processed; dividing the audio to be processed into a first audio and a second audio based on the sibilance amplitude corresponding to the audio to be processed; determining adjustment signals corresponding to the first audio and the second audio respectively to obtain a first adjustment signal corresponding to the first audio and a second adjustment signal corresponding to the second audio; and eliminating sibilance from the audio to be processed according to the first adjustment signal and the second adjustment signal.

[0077] Please see Figure 2 , Figure 2 This is a flowchart illustrating the audio processing method provided in an embodiment of this application. The specific flow of the audio processing method can be as follows:

[0078] 101. Obtain the audio to be processed.

[0079] The audio to be processed can be acquired through a microphone, through a network, or from a local database. The choice can be made based on the actual situation, and this application does not restrict the method of acquiring the audio to be processed.

[0080] 102. Based on the sibilance amplitude corresponding to the audio to be processed, the audio to be processed is divided into a first audio and a second audio.

[0081] Dental sounds are produced by pressing the tongue or the tip of the tongue against or near the incisors. In physics, sound is produced by the vibration of objects; the object producing the sound is called the sound source. The amplitude of a dental sound is also called its intensity. Sound intensity (or simply sound strength) represents the amount of sound energy. In acoustics, sound strength refers to the sound energy per unit time (one second) passing through a unit area perpendicular to the direction of sound propagation.

[0082] Optionally, in some embodiments, the audio domain of the first audio is in the range of -5 dB to 0 dB.

[0083] Optionally, in some embodiments, the audio domain of the second audio is in the range of -120 dB to -5 dB.

[0084] 103. Determine the adjustment signals corresponding to the first audio and the second audio respectively, to obtain the first adjustment signal corresponding to the first audio and the second adjustment signal corresponding to the second audio.

[0085] After segmenting the audio to be processed into a first audio and a second audio, adjustment signals corresponding to the first and second audio are output through a sidechain, so that the audio to be processed can be de-essentialized according to the first and second adjustment signals.

[0086] 104. Eliminate sibilance in the audio to be processed based on the first adjustment signal and the second adjustment signal.

[0087] The first adjustment signal and the second adjustment signal are the results of the first audio and the second audio after sibilance optimization, respectively. The difference is that the sibilance of the first audio and the second audio is optimized based on different sibilance amplitudes. Therefore, after obtaining the first adjustment signal and the second adjustment signal, they are superimposed to output the final audio signal. The output audio signal is the result of sibilance removal of the audio to be processed.

[0088] Optionally, in some embodiments, the step "eliminating sibilance of the audio to be processed according to the first adjustment signal and the second adjustment signal" may specifically include: calculating the sum of the first adjustment signal and the second adjustment signal to obtain the sibilance-eliminated audio corresponding to the audio to be processed.

[0089] In step 102, the audio to be processed can be segmented by determining the difference between the sibilance intensity of each audio point (or each frame of audio signal) and a preset value. (See also...) Figure 3 The step "based on the sibilance amplitude corresponding to the audio to be processed, divide the audio to be processed into a first audio and a second audio" can specifically include:

[0090] S11. Detect whether the sibilance amplitude corresponding to the audio point in the audio to be processed is greater than the preset value;

[0091] S12. Divide the audio points with sibilance amplitude greater than or equal to a preset value into a first set to obtain a first audio, and divide the audio points with sibilance amplitude less than a preset value into a second set to obtain a second audio.

[0092] For example, the preset value can be -5 dB. Audio points with sibilance amplitude greater than or equal to -5 dB are assigned to the first set to obtain the first audio, and audio points with sibilance amplitude less than -5 dB are assigned to the second set to obtain the second audio. Of course, the preset value can be other values, and can be set according to the actual situation. It will not be elaborated here.

[0093] In step 103, please refer to Figure 4 The step "determine the adjustment signals corresponding to the first audio and the second audio respectively, and obtain the first adjustment signal corresponding to the first audio and the second adjustment signal corresponding to the second audio" can specifically include:

[0094] S21. Detect the sibilance signal corresponding to the audio to be processed, and filter the sibilance signal;

[0095] S22. Attenuate the frequency band of the sibilance region of the first audio frequency.

[0096] S23. Filter the second audio signal;

[0097] S24. Based on the filtered signal, the first audio after frequency band attenuation, and the filtered second audio, determine the first adjustment signal corresponding to the first audio and the second adjustment signal corresponding to the second audio.

[0098] For example, specifically, the audio to be processed can be divided into multiple frequency bands, including sibilant bands (such as the band from 4kHz to 12kHz) and non-sibilant bands. Then, the sibilant signal corresponding to the sibilant band is filtered to remove at least some of the sibilant sounds for subsequent sibilant elimination. At the same time, the sibilant region of the first audio is attenuated, and the second audio is filtered. This ensures that sibilant reduction only affects the signal of the first audio, and also ensures the audio fidelity of the second audio. Finally, based on the filtered signal, the frequency-attenuated first audio, and the filtered second audio, the first adjustment signal corresponding to the first audio and the second adjustment signal corresponding to the second audio are determined.

[0099] Optionally, in some embodiments, intermediate parameters can be calculated using the filtered signal, the first audio signal after frequency band attenuation, and the second audio signal after filtering. These calculated intermediate parameters can then be used to output the first adjustment signal and the second adjustment signal. That is, optionally, in some embodiments, please refer to... Figure 5 The step "Based on the filtered signal, the first audio after frequency band attenuation, and the filtered second audio, determine the first adjustment signal corresponding to the first audio and the second adjustment signal corresponding to the second audio" can specifically include:

[0100] S31. Calculate the first intermediate parameter based on the filtered signal and the first audio after frequency band attenuation;

[0101] S32. Calculate the second intermediate parameter based on the filtered signal and the filtered second audio.

[0102] S33. Calculate the sum of the first intermediate parameter and the filtered signal to obtain the first adjustment signal corresponding to the first audio.

[0103] S34. Calculate the sum of the second intermediate parameter and the filtered signal to obtain the second adjustment signal corresponding to the second audio.

[0104] In this embodiment, the sibilance signal in the audio to be processed is filtered in advance to obtain a filtered signal, thus completing the overall processing of the audio to be processed. Then, a first audio and a second audio are segmented from the audio to be processed. Based on the filtered signal and the first audio, a first adjustment signal corresponding to the first audio is output, and a second adjustment signal corresponding to the first audio is output based on the filtered signal and the second audio. Specifically, after obtaining the filtered signal, the weight of the filtered signal is adjusted. Then, the adjusted signal is multiplied with the first audio after frequency band attenuation to obtain a first intermediate parameter. Next, the sum of the first intermediate parameter and the filtered signal is calculated to obtain the first adjustment signal corresponding to the first audio. Similarly, the adjusted signal is multiplied with the filtered second audio to obtain a second intermediate parameter. Then, the sum of the second intermediate parameter and the filtered signal is calculated to obtain the second adjustment signal corresponding to the second audio.

[0105] It should be noted that the weights adjusted for the filtered signal when calculating the first intermediate parameter can be the same as or different from the weights adjusted for the filtered signal when calculating the second intermediate parameter. The specific weights can be set according to the actual situation. For example, when calculating the first intermediate parameter s1, if the weight is adjusted to 0.6, then the first intermediate parameter s1 = (0.6 * filtered signal z) + the first audio frequency a after frequency band attenuation. Similarly, when calculating the second intermediate parameter s2, if the weight is adjusted to 0.5, then the second intermediate parameter s2 = (0.5 * filtered signal z) + the second audio frequency b. The specific weights can be set according to the actual situation, and will not be elaborated further here.

[0106] Optionally, in some embodiments, please refer to Figure 6 The step "Calculate the first intermediate parameter based on the filtered signal and the first audio after frequency band attenuation" can specifically include:

[0107] S41. Adjust the filtered signal to obtain the adjusted signal;

[0108] S42. Calculate the product of the adjusted signal and the first audio frequency after frequency band attenuation to obtain the first intermediate parameter.

[0109] Optionally, in some embodiments, please refer to Figure 7 The step "Calculate the second intermediate parameter based on the filtered signal and the filtered second audio" can specifically include:

[0110] S51. Adjust the filtered signal to obtain the adjusted signal;

[0111] S52. Calculate the product of the adjusted signal and the filtered second audio signal to obtain the second intermediate parameter.

[0112] Optionally, in some embodiments, please refer to Figure 8 The step "determine the adjustment signals corresponding to the first audio and the second audio respectively, and obtain the first adjustment signal corresponding to the first audio and the second adjustment signal corresponding to the second audio" can specifically include:

[0113] S61. Detect the sibilance signal corresponding to the audio to be processed;

[0114] S61. The sibilant signal is filtered by a first filter to obtain a first filtered signal, and the sibilant signal is filtered by a second filter to obtain a second filtered signal.

[0115] S63. Attenuate the frequency band of the sibilance region of the first audio frequency.

[0116] S64. Filter the second audio signal;

[0117] S65. Based on the first filtered signal, the second filtered signal, the first audio after frequency band attenuation, and the second audio after filtering, determine the first adjustment signal corresponding to the first audio and the second adjustment signal corresponding to the second audio.

[0118] The difference from the previous embodiment is that in this embodiment, the sibilant signal is processed by a first filter and a second filter respectively, thereby obtaining two filtered signals (a first filtered signal and a second filtered signal). The subsequent process is similar to that of the previous embodiment, and you can refer to the previous embodiment for details, which will not be repeated here.

[0119] Optionally, in some embodiments, please refer to Figure 9 The step "Based on the first filtered signal, the second filtered signal, the first audio after frequency band attenuation, and the second filtered audio, determine the first adjustment signal corresponding to the first audio and the second adjustment signal corresponding to the second audio" can specifically include:

[0120] S71. Calculate the third intermediate parameter based on the first filtered signal and the first audio after frequency band attenuation;

[0121] S72. Based on the second filtered signal and the filtered second audio, calculate the fourth intermediate parameter;

[0122] S73. Calculate the sum of the third intermediate parameter and the first filtered signal to obtain the first adjustment signal corresponding to the first audio.

[0123] S74. Calculate the sum of the fourth intermediate parameter and the second filtered signal to obtain the second adjustment signal corresponding to the second audio.

[0124] It should be noted that the weight adjusted for the first filtered signal when calculating the third intermediate parameter can be the same as or different from the weight adjusted for the second filtered signal when calculating the fourth intermediate parameter. The specific weight can be set according to the actual situation. For example, if the weight is adjusted to 0.6 when calculating the third intermediate parameter s1, then the third intermediate parameter s3 = (0.6 * first filtered signal y) + the first audio frequency a after band attenuation. Similarly, if the weight is adjusted to 0.5 when calculating the fourth intermediate parameter s4, then the fourth intermediate parameter s4 = (0.5 * second filtered signal e) + the second audio frequency b. The specific weight can be set according to the actual situation, and will not be elaborated further here.

[0125] Optionally, in some embodiments, please refer to Figure 10 , Figure 10 This is a schematic diagram of the audio processing method provided in this application. In this embodiment, sibilance removal is performed on the audio to be processed by combining sidechains, a first audio signal, and a second audio signal, as detailed below:

[0126] 1. Input (audio to be processed) enters point F.

[0127] 2. Point F is identified as: High level layer (first audio).

[0128] Low level layer (second audio)

[0129] Side (side chain channel)

[0130] 3. The Side (side-chain channel) undergoes dental Sense for sibilance detection.

[0131] 4. The Side channel uses EQ1 to preset the attenuation of sibilant frequencies:

[0132] 5. High-level signals pass through the dental level (sibilance level):

[0133] When the sibilance amplitude is greater than -5dB at point F, the Dental level takes effect, using the PEAK filter to attenuate the sibilance band in the sibilance region.

[0134] 6. When the amplitude of the sibilance is less than -5dB at point F, the signal is at a low level.

[0135] 7. The K1 = side signal is multiplied by the High Level signal via the Dental Level signal after passing through EQ1 and undergoing weight control (automatic).

[0136] 8. K2 = side is multiplied by the Low Level signal after passing through EQ1 and undergoing weight control (automatic).

[0137] 9. K3 = High level and Side are added together in a specific ratio.

[0138] 10. K4 = low level and side are added in a specific ratio.

[0139] 11. K3 + K4 equals the output.

[0140] Optionally, in some embodiments, please refer to Figure 11 , Figure 11 This is another specific flowchart illustrating the audio processing method provided in this application, and... Figure 10 The difference lies in the fact that the first filter EQ1 and the second filter EQ2 are used respectively to preset the attenuation of the sibilant region, as follows:

[0141] 1. Input (audio to be processed) enters point F.

[0142] 2. Point F is identified as: High level layer (first audio).

[0143] Low level layer (second audio)

[0144] Side (side chain channel)

[0145] 3. The Side (side-chain channel) undergoes dental Sense for sibilance detection.

[0146] 4. The Side channel uses EQ1 to preset the attenuation of sibilant areas, and EQ2 to preset the attenuation of sibilant areas:

[0147] 5. High-level signals pass through the dental level (sibilance level):

[0148] When the sibilance amplitude is greater than -5dB at point F, the Dental level takes effect, using the PEAK filter to attenuate the sibilance band in the sibilance region.

[0149] 6. When the amplitude of the sibilance is less than -5dB at point F, the signal is at a low level.

[0150] 7. The K1 = side signal is multiplied by the High Level signal after passing through EQ1 and undergoing weight control (automatic) and then by the Dental Level signal.

[0151] 8. K2 = side is multiplied by the Low Level signal after passing through EQ2 and undergoing weight control (automatic).

[0152] 9. K3 = High level and Side are added together in a specific ratio.

[0153] 10. K4 = low level and side are added in a specific ratio.

[0154] 11. K3 + K4 equals the output.

[0155] As can be seen from the above, this application provides an audio processing method. After acquiring the audio to be processed, the audio is segmented into a first audio and a second audio based on the sibilance amplitude corresponding to the audio. Then, adjustment signals corresponding to the first audio and the second audio are determined respectively to obtain a first adjustment signal corresponding to the first audio and a second adjustment signal corresponding to the second audio. Finally, the sibilance of the audio to be processed is eliminated according to the first adjustment signal and the second adjustment signal. The audio processing scheme provided by this application uses the sibilance amplitude corresponding to the audio to be processed to segment the audio to be processed and outputs a first adjustment signal corresponding to the first audio and a second adjustment signal corresponding to the second audio. Finally, the sibilance of the audio to be processed is eliminated according to the first adjustment signal and the second adjustment signal. For different audio to be processed, sibilance can be flexibly eliminated according to its sibilance amplitude, avoiding the use of the same sibilance suppression processing for all audio, which leads to poor sibilance suppression effect. Therefore, the sibilance suppression effect of the audio to be processed can be improved.

[0156] In this embodiment, the audio processing device will be specifically integrated into the terminal device as an example for explanation.

[0157] Please see Figure 12 An audio processing method, the specific process of which can be as follows:

[0158] 201. The terminal device acquires the audio to be processed.

[0159] The audio to be processed can be acquired through a microphone, through a network, or from a local database. The choice can be made based on the actual situation, and this application does not restrict the method of acquiring the audio to be processed.

[0160] 202. The terminal device divides the audio to be processed into a first audio and a second audio based on the sibilance amplitude corresponding to the audio to be processed.

[0161] The process of step 202 is similar to that of step 102. Please refer to the specific process of step 102 for details, which will not be repeated here.

[0162] 203. The terminal device determines the adjustment signals corresponding to the first audio and the second audio respectively, and obtains the first adjustment signal corresponding to the first audio and the second adjustment signal corresponding to the second audio.

[0163] The process of step 203 is similar to that of step 103. Please refer to the specific process of step 103 for details, which will not be repeated here.

[0164] 204. The terminal device eliminates sibilance in the audio to be processed based on the first adjustment signal and the second adjustment signal.

[0165] The process of step 204 is similar to that of step 104. Please refer to the specific process of step 104 for details, which will not be repeated here.

[0166] As can be seen from the above, this application provides an audio processing method. After acquiring the audio to be processed, the terminal device segments the audio to be processed into a first audio and a second audio based on the sibilance amplitude corresponding to the audio. Then, the terminal device determines the adjustment signals corresponding to the first audio and the second audio respectively, obtaining a first adjustment signal corresponding to the first audio and a second adjustment signal corresponding to the second audio. Finally, the terminal device eliminates the sibilance of the audio to be processed according to the first adjustment signal and the second adjustment signal. The audio processing scheme provided by this application segments the audio to be processed using the sibilance amplitude corresponding to the audio, outputs a first adjustment signal corresponding to the first audio and a second adjustment signal corresponding to the second audio, and finally eliminates the sibilance of the audio to be processed according to the first adjustment signal and the second adjustment signal. For different audio to be processed, sibilance can be flexibly eliminated according to its sibilance amplitude, avoiding the use of the same sibilance suppression processing for all audio, which leads to poor sibilance suppression effect. Therefore, the sibilance suppression effect of the audio to be processed can be improved.

[0167] Accordingly, this application also provides an audio processing apparatus; please refer to [link / reference]. Figure 13 , Figure 13 This is a schematic diagram of the structure of an audio processing device provided in an embodiment of this application. The audio processing device 30 may include an acquisition module 301, a segmentation module 302, a determination module 303, and an elimination module 304, which may be as follows:

[0168] The acquisition module 301 is used to acquire the audio to be processed.

[0169] The audio to be processed can be acquired through a microphone, through a network, or from a local database. The choice can be made based on the actual situation, and this application does not restrict the method of acquiring the audio to be processed.

[0170] The segmentation module 302 is used to segment the audio to be processed into a first audio and a second audio based on the sibilance amplitude corresponding to the audio to be processed.

[0171] Optionally, in some embodiments, the audio to be processed can be segmented by determining the difference between the sibilance intensity of each audio point (or each frame of audio signal) in the audio to be processed and a preset value. Specifically, the segmentation module 302 can be used to: detect whether the sibilance amplitude corresponding to the audio point in the audio to be processed is greater than the preset value; divide the audio points with sibilance amplitude greater than or equal to the preset value into a first set to obtain the first audio, and divide the audio points with sibilance amplitude less than the preset value into a second set to obtain the second audio.

[0172] The determining module 303 is used to determine the adjustment signals corresponding to the first audio and the second audio respectively, so as to obtain the first adjustment signal corresponding to the first audio and the second adjustment signal corresponding to the second audio.

[0173] After obtaining the first and second audio frequencies, the corresponding adjustment signals can be obtained by attenuating the sibilance region of the first audio frequency and filtering the second audio frequency.

[0174] Optionally, in some embodiments, determining module 303 may specifically include:

[0175] The detection unit is used to detect the sibilance signal corresponding to the audio to be processed and to filter the sibilance signal.

[0176] The attenuation unit is used to attenuate the sibilance region of the first audio signal.

[0177] The processing unit is used to filter the second audio signal.

[0178] The determining unit is used to determine the first adjustment signal corresponding to the first audio and the second adjustment signal corresponding to the second audio based on the filtered signal, the first audio after frequency band attenuation, and the filtered second audio.

[0179] Optionally, in some embodiments, the determining unit may specifically include:

[0180] The first calculation subunit is used to calculate the first intermediate parameter based on the filtered signal and the first audio after frequency band attenuation.

[0181] The second calculation subunit is used to calculate the second intermediate parameter based on the filtered signal and the filtered second audio.

[0182] The third calculation subunit is used to calculate the sum of the first intermediate parameter and the filtered signal to obtain the first adjustment signal corresponding to the first audio.

[0183] The fourth calculation subunit is used to calculate the sum of the second intermediate parameter and the filtered signal to obtain the second adjustment signal corresponding to the second audio.

[0184] Optionally, in some embodiments, the first calculation subunit may be specifically used to: adjust the filtered signal to obtain an adjusted signal; calculate the product of the adjusted signal and the first audio signal after frequency band attenuation to obtain a first intermediate parameter.

[0185] Optionally, in some embodiments, the second calculation subunit may be specifically used to: adjust the filtered signal to obtain an adjusted signal; calculate the product of the adjusted signal and the filtered second audio to obtain a second intermediate parameter.

[0186] Elimination module 304 is used to eliminate sibilance in the audio to be processed based on the first adjustment signal and the second adjustment signal.

[0187] Optionally, in some embodiments, the elimination module 304 may be specifically used to: calculate the sum of the first adjustment signal and the second adjustment signal to obtain the sibilance-eliminating audio corresponding to the audio to be processed.

[0188] The above completes the audio processing procedure for this application.

[0189] As can be seen from the above, this application provides an audio processing apparatus. After the acquisition module 301 acquires the audio to be processed, the segmentation module 302 segments the audio to be processed into a first audio and a second audio based on the sibilance amplitude corresponding to the audio to be processed. Then, the determination module 303 determines the adjustment signals corresponding to the first audio and the second audio respectively, obtaining a first adjustment signal corresponding to the first audio and a second adjustment signal corresponding to the second audio. Finally, the elimination module 304 eliminates the sibilance of the audio to be processed based on the first adjustment signal and the second adjustment signal. The audio processing scheme provided by this application uses the sibilance amplitude corresponding to the audio to be processed to segment the audio to be processed and outputs a first adjustment signal corresponding to the first audio and a second adjustment signal corresponding to the second audio. Finally, it eliminates the sibilance of the audio to be processed based on the first adjustment signal and the second adjustment signal. For different audio to be processed, sibilance can be flexibly eliminated according to its sibilance amplitude, avoiding the use of the same sibilance suppression processing for all audio, which leads to poor sibilance suppression effect. Therefore, the sibilance suppression effect of the audio to be processed can be improved.

[0190] The division of the various units in the above-described device is for illustrative purposes only. In other embodiments, the above-described device can be divided into different units as needed to complete all or part of the functions of the above-described device. For specific limitations of the above-described device, please refer to the limitations of the method above, which will not be repeated here.

[0191] That is, the above description is only an embodiment of this application and does not limit the patent scope of this application. Any equivalent structural or procedural changes made using the content of this application’s specification and drawings, such as the combination of technical features between different embodiments, or direct or indirect application in other related technical fields, are similarly included within the patent protection scope of this application.

[0192] Furthermore, for structural elements with the same or similar characteristics, this application may use the same or different reference numerals for identification. In addition, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Therefore, features defined with "first" and "second" may explicitly or implicitly include one or more features. In the description of this application, "a plurality of" means two or more, unless otherwise explicitly specified.

[0193] In this application, the word "for example" is used to mean "used as an example, illustration, or explanation." Any embodiment described as "for example" in this application is not necessarily to be construed as more preferred or advantageous than other embodiments. This application has been provided above to enable any person skilled in the art to make and use it. Various details are set forth in the above description for purposes of explanation.

[0194] It should be understood that those skilled in the art will recognize that this application can be implemented without using these specific details. In other embodiments, well-known structures and processes will not be described in detail to avoid obscuring the description of this application with unnecessary detail. Therefore, this application is not intended to be limited to the embodiments shown, but is consistent with the broadest scope of the principles and features disclosed herein.

Claims

1. An audio processing method, characterized in that, include: Obtain the audio to be processed; Based on the sibilance amplitude corresponding to the audio to be processed, the audio to be processed is divided into a first audio and a second audio. The sibilance signal corresponding to the audio to be processed is detected and filtered; the sibilance region of the first audio is attenuated; and the second audio is filtered. Based on the filtered signal, the first audio after frequency band attenuation, and the filtered second audio, a first adjustment signal corresponding to the first audio and a second adjustment signal corresponding to the second audio are determined. Based on the first adjustment signal and the second adjustment signal, the sibilance of the audio to be processed is eliminated.

2. The method according to claim 1, characterized in that, The step of determining the first adjustment signal corresponding to the first audio and the second adjustment signal corresponding to the second audio based on the filtered signal, the first audio after frequency band attenuation, and the filtered second audio includes: Calculate the first intermediate parameter based on the filtered signal and the first audio after frequency band attenuation; Based on the filtered signal and the filtered second audio, calculate the second intermediate parameter; The sum of the first intermediate parameter and the filtered signal is calculated to obtain the first adjustment signal corresponding to the first audio. The second intermediate parameter is summed with the filtered signal to obtain the second adjustment signal corresponding to the second audio.

3. The method according to claim 2, characterized in that, The calculation of the first intermediate parameter based on the filtered signal and the first audio after frequency band attenuation includes: The filtered signal is adjusted to obtain the adjusted signal; The first intermediate parameter is obtained by multiplying the adjusted signal with the first audio frequency after frequency band attenuation.

4. The method according to claim 2, characterized in that, The calculation of the second intermediate parameter based on the filtered signal and the filtered second audio includes: The filtered signal is adjusted to obtain the adjusted signal; The second intermediate parameter is obtained by calculating the product of the adjusted signal and the filtered second audio.

5. The method according to claim 1, characterized in that, The step of eliminating sibilance in the audio to be processed based on the first adjustment signal and the second adjustment signal includes: The sum of the first adjustment signal and the second adjustment signal is calculated to obtain the sibilance-removed audio corresponding to the audio to be processed.

6. The method according to any one of claims 1 to 5, characterized in that, The step of segmenting the audio to be processed into a first audio and a second audio based on the sibilance amplitude corresponding to the audio to be processed includes: Detect whether the sibilance amplitude corresponding to the audio point in the audio to be processed is greater than a preset value; Audio points with sibilance amplitude greater than or equal to a preset value are assigned to a first set to obtain a first audio; Audio points with sibilance amplitude less than a preset value are assigned to a second set to obtain the second audio.

7. The method according to any one of claims 1 to 5, characterized in that, The audio range of the first audio is from -5 dB to 0 dB.

8. The method according to any one of claims 1 to 5, characterized in that, The second audio frequency range is from -120 dB to -5 dB.

9. An audio processing method, characterized in that, include: Obtain the audio to be processed; Based on the sibilance amplitude corresponding to the audio to be processed, the audio to be processed is divided into a first audio and a second audio. The process involves detecting the sibilance signal corresponding to the audio to be processed; filtering the sibilance signal using a first filter to obtain a first filtered signal; filtering the sibilance signal using a second filter to obtain a second filtered signal; attenuating the sibilance region of the first audio; filtering the second audio; and determining a first adjustment signal corresponding to the first audio and a second adjustment signal corresponding to the second audio based on the first filtered signal, the second filtered signal, the attenuated first audio, and the filtered second audio. Based on the first adjustment signal and the second adjustment signal, the sibilance of the audio to be processed is eliminated.

10. The method according to claim 9, characterized in that, The step of determining the first adjustment signal corresponding to the first audio and the second adjustment signal corresponding to the second audio based on the first filtered signal, the second filtered signal, the first audio after frequency band attenuation, and the second audio after filtering includes: Based on the first filtered signal and the first audio after frequency band attenuation, calculate the third intermediate parameter; Based on the second filtered signal and the filtered second audio, calculate the fourth intermediate parameter; The sum of the third intermediate parameter and the first filtered signal is calculated to obtain the first adjustment signal corresponding to the first audio. The sum of the fourth intermediate parameter and the second filtered signal is calculated to obtain the second adjustment signal corresponding to the second audio.

11. An audio processing apparatus, characterized in that, include: The acquisition module is used to acquire the audio to be processed; The segmentation module is used to segment the audio to be processed into a first audio and a second audio based on the sibilance amplitude corresponding to the audio to be processed; The determination module detects the sibilance signal corresponding to the audio to be processed and filters the sibilance signal; it attenuates the frequency band of the sibilance region of the first audio; and it filters the second audio. Based on the filtered signal, the first audio after frequency band attenuation, and the filtered second audio, a first adjustment signal corresponding to the first audio and a second adjustment signal corresponding to the second audio are determined. The elimination module is used to eliminate sibilance in the audio to be processed based on the first adjustment signal and the second adjustment signal.

12. A terminal device, characterized in that, The terminal device includes a processor and a memory, the memory being used to store a computer program, and the processor running the computer program to cause the terminal device to perform the audio processing method according to any one of claims 1 to 8, or 9 to 10.

13. A readable storage medium, characterized in that, The readable storage medium stores a computer program that, when executed by a processor, implements the audio processing method according to any one of claims 1 to 8, or 9 to 10.

Images