Audio processing method, electronic equipment and readable storage medium

Abstract

The invention provides an audio processing method, communication equipment, a communication system and a readable storage medium, and the method comprises the steps: obtaining a to-be-processed audio signal; inputting the audio signal and a preset target attenuation coefficient into a first filter to obtain a first output audio signal with an echoing sound effect; inputting the first output audio signal and the target attenuation coefficient into a second filter to obtain a second output audio signal with a sound trailing phenomenon; respectively inputting the second output audio signal into a plurality of third filters to obtain a third output audio signal corresponding to each third filter; and superposing the plurality of third output audio signals to obtain a target output audio signal with a reverberation sound effect. According to the method, the reverberation time of each frequency band can be accurately controlled, the reverberation reality sense of the output audio is effectively improved, the reverberation effect is closer to the convolution reverberation effect, meanwhile, the requirement for the computing power is greatly reduced, the calculation amount of the algorithm is effectively reduced, and the application channel of the algorithm is effectively widened.

Description

Technical Field

[0001] This application relates to the technical field of audio signal processing, and in particular, to an audio processing method, an electronic device, and a readable storage medium. Background Art

[0002] With the continuous development of technology, people's pursuit of the quality of life is constantly improving, and the sound quality of audio devices has also attracted much attention from users.

[0003] In related technologies, the theater mode of high-quality in-vehicle audio devices uses the method of convolutional reverberation. The true impulse response of the convolutional theater has a large amount of calculation and also requires the support of additional digital signal processing (DSP). The reverberation results of general audio devices using artificial reverberation algorithms are not natural enough, and the listening experience is average. Summary of the Invention

[0004] This application aims to at least solve one of the technical problems in the related technologies to some extent.

[0005] To this end, the following technical solutions are proposed:

[0006] The first aspect embodiment of this application proposes an audio processing method, including:

[0007] Obtain an audio signal to be processed;

[0008] Input the audio signal and a preset target attenuation coefficient into a first filter to obtain a first output audio signal. The first filter is used to adjust the energy of the audio signal at different frequencies, and the first output audio signal is an audio signal with a reverberation sound effect;

[0009] Input the first output audio signal and the target attenuation coefficient into a second filter to obtain a second output audio signal. The second filter is used to perform iterative filtering on the first output audio signal, and the second output audio signal is an audio signal with a sound tailing phenomenon;

[0010] Input the second output audio signal into a plurality of third filters respectively to obtain a third output audio signal corresponding to each third filter. The third filter is used to adjust the density of the second output audio signal in the time domain, and the third output audio signal is an audio signal with a preset time domain density;

[0011] Superimpose the third output audio signals obtained by the plurality of third filters to obtain a target output audio signal. The target output audio signal is an audio signal with a reverberation sound effect.

[0012] Optionally, the method further includes:

[0013] Determine the target attenuation coefficient based on the reverberation time of a target octave, or based on the transfer function of a target audio in a desired scenario.

[0014] Optionally, the first filter is an infinite impulse response (IIR) filter, and the first filter is further configured to perform spectral equalization on the frequency response corresponding to the target octave or the target audio.

[0015] Optionally, the step of inputting the first output audio signal and the target attenuation coefficient into a second filter to obtain a second output audio signal includes:

[0016] Iteratively add the first output audio signal and a signal obtained by introducing the target attenuation coefficient through a system response after delaying the first output audio signal and passing it through the second filter, to obtain the second output signal;

[0017] wherein, the second filter is an infinite impulse response (IIR) filter.

[0018] Optionally, the third filter is a sparse filter taking target noise as an effective order, and the third filter is a finite impulse response (FIR) filter.

[0019] Optionally, the step of superimposing the third output audio signals to obtain a target output audio signal includes:

[0020] Delay the third output audio signal corresponding to each third filter by the same period to obtain a plurality of delayed third output audio signals;

[0021] Superimpose the plurality of delayed third output audio signals to obtain the target output audio signal.

[0022] An embodiment of the second aspect of the present application provides an audio processing apparatus, including:

[0023] The apparatus includes:

[0024] An acquisition module, configured to acquire an audio signal to be processed;

[0025] A first filtering module, configured to input the audio signal and a preset target attenuation coefficient into a first filter to obtain a first output audio signal, where the first filter is configured to adjust the energy of the audio signal at different frequencies, and the first output audio signal is an audio signal with a reverberation effect;

[0026] A second filtering module inputs the first output audio signal and the target attenuation coefficient into a second filter to obtain a second output audio signal. The second filter is used to perform iterative filtering on the first output audio signal, and the second output audio signal is an audio signal with a sound trailing phenomenon;

[0027] A third filtering module inputs the second output audio signal into a plurality of third filters respectively to obtain a third output audio signal corresponding to each third filter. The third filter is used to adjust the density of the second output audio signal in the time domain, and the third output audio signal is an audio signal with a preset time domain density;

[0028] An audio output module is used to superimpose the third output audio signals obtained by the plurality of third filters to obtain a target output audio signal, and the target output audio signal is an audio signal with a reverberation effect.

[0029] Optionally, the apparatus further includes:

[0030] An attenuation determination module is used to determine the target attenuation coefficient based on the reverberation time of the target octave or based on the transfer function of the target audio in the desired scenario.

[0031] Optionally, the first filter is an infinite impulse response IIR filter, and the first filter is further used to perform spectral equalization on the frequency response corresponding to the target octave or the target audio.

[0032] Optionally, the second filtering module specifically is used to:

[0033] Iteratively add the first output audio signal and the signal obtained by introducing the target attenuation coefficient through the system response after delaying the first output audio signal and passing it through the second filter to obtain the second output signal;

[0034] Wherein, the second filter is an infinite impulse response IIR filter.

[0035] Optionally, the third filter is a sparse filter with the target noise as the effective order, and the third filter is a finite impulse response FIR filter.

[0036] Optionally, the audio output module specifically is used to:

[0037] Delay the third output audio signal corresponding to each third filter for the same period to obtain a plurality of third output audio signals after delay;

[0038] Superimpose the plurality of third output audio signals after delay to obtain the target output audio signal.

[0039] The third - aspect embodiment of the present application provides an electronic device, including a storage medium, a processor, and a computer program stored on the storage medium and executable on the processor. When the processor executes the computer program, it implements the audio - processing method proposed in the first - aspect embodiment of the present application.

[0040] The fourth - aspect embodiment of the present application provides a chip, including at least one processor and a communication interface. The communication interface is used to receive signals input to the chip or signals output from the chip. The processor communicates with the communication interface and implements the audio - processing method proposed in the first - aspect embodiment of the present application through logic circuits or by executing code instructions.

[0041] The fifth - aspect embodiment of the present application provides a vehicle, including an intelligent cockpit. Among them, the intelligent cockpit includes an in - vehicle infotainment system, a processor, and a speaker. The in - vehicle infotainment system is communicatively connected to the processor, and the processor is communicatively connected to the speaker. The in - vehicle infotainment system is used to read an audio stream to be played and input it to the processor for processing. The processor is used to execute the audio - processing method proposed in the first - aspect embodiment to obtain a target output audio signal, and the speaker is used to obtain and play the target output audio signal output by the processor.

[0042] The sixth - aspect embodiment of the present application provides a non - transitory computer - readable storage medium. When the instructions in the storage medium are executed by a processor of a communication device, the communication device can execute the audio - processing method proposed in the first - aspect embodiment of the present application.

[0043] The technical solution of the present application includes: obtaining an audio signal to be processed; inputting the audio signal and a preset target attenuation coefficient into a first filter to obtain a first output audio signal, where the first filter is used to adjust the energy of the audio signal at different frequencies, and the first output audio signal is an audio signal with a reverberation effect; inputting the first output audio signal and the target attenuation coefficient into a second filter to obtain a second output audio signal, where the second filter is used to perform iterative filtering on the first output audio signal, and the second output audio signal is an audio signal with a sound tailing phenomenon; inputting the second output audio signal into a plurality of third filters respectively to obtain a third output audio signal corresponding to each third filter, where the third filter is used to adjust the density of the second output audio signal in the time domain, and the third output audio signal is an audio signal with a preset time domain density; superimposing the third output audio signals obtained by the plurality of third filters to obtain a target output audio signal, where the target output audio signal is an audio signal with a reverberation effect, enabling precise control of the reverberation time of each frequency band, effectively improving the reverberation realism of the output audio, being closer to the effect of convolutional reverberation, while significantly reducing the demand for computing power, effectively reducing the computational complexity of the algorithm, saving hardware costs, and effectively broadening the application channels of the algorithm.

[0044] Additional aspects and advantages of the present application will be given in part in the following description, become apparent in part from the following description, or be understood through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] The above and / or additional aspects and advantages of the present application will become apparent and be readily understood from the following description of the embodiments in conjunction with the accompanying drawings, where:

[0046] Figure 1 is a schematic flowchart of an audio processing method provided by an embodiment of the present application;

[0047] Figure 2 is a schematic flowchart of another audio processing method provided by an embodiment of the present application;

[0048] Figure 3 is a schematic internal processing flowchart of the second filter provided by an embodiment of the present application;

[0049] Figure 4 is a schematic diagram of multiple groups of target noise sampling sequences provided by an embodiment of the present application;

[0050] Figure 5 is a schematic flowchart of an audio processing algorithm provided by an embodiment of the present application;

[0051] Figure 6 is a schematic structural diagram of an audio processing device provided by an embodiment of the present application;

[0052] Figure 7 A structural block diagram of a communication device provided by an embodiment of the present application. Detailed implementation manners

[0053] The embodiments of the present application will be described in detail below. Examples of the embodiments are shown in the accompanying drawings, where the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to explain the present application and should not be construed as a limitation to the present application.

[0054] The audio processing method, electronic device, and computer-readable storage medium of the embodiments of the present application will be described in detail below with reference to the accompanying drawings.

[0055] Figure 1 A flowchart of an audio processing method provided by an embodiment of the present application.

[0056] The execution subject of the audio processing method in the embodiments of the present application is an audio processing device, and this device can be set in an electronic device. In some embodiments, the electronic device may include at least one of an automobile with communication function, a smart car, a mobile phone, a wearable device, an Internet of Things device, a tablet computer (Pad), a computer with wireless transceiver function, a virtual reality (VR) terminal device, an augmented reality (AR) terminal device, a wireless terminal device in industrial control, a wireless terminal device in self-driving, a wireless terminal device in remote medical surgery, a wireless terminal device in smart grid, a wireless terminal device in transportation safety, a wireless terminal device in smart city, and a wireless terminal device in smart home, but is not limited thereto.

[0057] As Figure 1 shown, the audio processing method may include the following steps:

[0058] Step 101, obtain an audio signal to be processed.

[0059] In the embodiments of the present application, it is possible to obtain an audio signal to be processed.

[0060] The audio signal to be processed is the audio signal that needs to add reverberation effects, and the embodiments of the present application can obtain a real-time audio stream.

[0061] Optionally, the audio signal may be multimedia music data or the like, which is not limited in this embodiment.

[0062] Step 102: Input the audio signal and a preset target attenuation coefficient into a first filter to obtain a first output audio signal.

[0063] In the embodiment of the present application, the audio signal to be processed can be processed by a first filter with a target attenuation coefficient introduced to obtain a first output audio signal.

[0064] Among them, the first filter is used to adjust the energy of the audio signal at different frequencies. The first output audio signal obtained after being processed by the first filter is an audio signal with a reverberation effect.

[0065] Among them, optionally, the first filter is an Infinite Impulse Response (IIR) filter.

[0066] Among them, the target attenuation coefficient is used to reflect the attenuation rate of the signal energy in the target frequency band. The target frequency band is the frequency band corresponding to the target octave.

[0067] In some embodiments, the target attenuation coefficient can be determined based on the reverberation time of the target octave or based on the transfer function of the target audio in the desired scenario.

[0068] Among them, it should be noted that the octave, also known as the octave band, refers to the interval between two frequencies or wavelengths with a frequency or wavelength ratio of 2 or 1 / 2 on the filter characteristic curve.

[0069] The reverberation time refers to the time when the sound in the room has reached a steady state and the sound source stops emitting sound, that is, the time required for the sound source to decay by 60 dB after stopping emitting sound.

[0070] The transfer function is an acoustic transfer function, and the acoustic transfer function is the transfer function from a sound source (loudspeaker) to the reproduction area (target area). In the embodiment of the present application, the transfer function of the target audio in the desired scenario, such as a transfer function in a concert hall, can reflect the changes in the output signal of the audio device during the process of the output signal being transmitted to the target area in the concert hall scenario. Based on the transfer function, the corresponding impulse response can be calculated.

[0071] In some embodiments, the first filter is further used to perform spectral equalization on the frequency response corresponding to the target octave or the target audio.

[0072] Step 103: Input the first output audio signal and the target attenuation coefficient into a second filter to obtain a second output audio signal.

[0073] In the embodiments of the present application, the first output audio signal can be processed by a second filter with a target attenuation coefficient introduced thereto to obtain a second output audio signal.

[0074] Among them, the second filter is used to perform iterative filtering on the first output audio signal, and can simulate the process of iterative attenuation after sound is reflected and scattered in space. The second output audio signal obtained after being processed by the second filter is an audio signal with a sound tailing phenomenon.

[0075] Among them, optionally, the second filter is also an infinite impulse response (IIR) filter.

[0076] In some embodiments, the target attenuation coefficient can be determined based on the reverberation time of a target octave or based on the transfer function of a target audio in a desired scenario.

[0077] Optionally, for the processing of the second filter, it can be to iteratively add the first output audio signal and the signal obtained by delaying the first output audio signal and introducing the target attenuation coefficient through the system response of the second filter to obtain the second output signal.

[0078] It should be noted that in the embodiments of the present application, both the first filter and the second filter are IIR filters, and the purpose is to achieve the sound tailing phenomenon of late reverberation, which is an iterative attenuation process of sound reflected and scattered in space. The sound tailing phenomenon is a sound phenomenon with a reverberation effect that occurs after sound is reflected and scattered by walls in space and undergoes iterative attenuation.

[0079] Step 104: Input the second output audio signal into a plurality of third filters respectively to obtain a third output audio signal corresponding to each third filter.

[0080] In the embodiments of the present application, the second output audio signal can be processed by a plurality of third filters respectively to obtain a third output audio signal corresponding to each third filter.

[0081] Among them, the third filter is used to adjust the density of the second output audio signal in the time domain. The third output audio signal obtained after being processed by the third filter is an audio signal with a preset time domain density.

[0082] Among them, optionally, the third filter is a sparse filter with target noise as the effective order, and the third filter is a finite impulse response (FIR) filter.

[0083] Optionally, the target noise can be, for example, velvet noise, which is a sparse discrete signal composed of a small number of non-zero (1 or -1) elements.

[0084] Step 105, superimpose the third output audio signals obtained by multiple third filters to obtain a target output audio signal, which is an audio signal with a reverberation effect.

[0085] In the embodiments of the present application, a target output audio signal with a reverberation effect can be obtained based on the third output audio signals output by at least one third filter.

[0086] In some embodiments, the third output audio signal corresponding to each third filter is delayed for the same period, and then the delayed signals are superimposed to obtain the target output audio signal with the reverberation effect.

[0087] In some embodiments, the audio signal with the reverberation effect can be output frame by frame through a speaker.

[0088] In the embodiments of the present application, an audio signal to be processed is obtained; the audio signal and a preset target attenuation coefficient are input into a first filter to obtain a first output audio signal. The first filter is used to adjust the energy of the audio signal at different frequencies, and the first output audio signal is an audio signal with an echo effect; the first output audio signal and the target attenuation coefficient are input into a second filter to obtain a second output audio signal. The second filter is used to perform iterative filtering on the first output audio signal, and the second output audio signal is an audio signal with a sound tailing phenomenon; the second output audio signal is respectively input into multiple third filters to obtain a third output audio signal corresponding to each third filter. The third filter is used to adjust the density of the second output audio signal in the time domain, and the third output audio signal is an audio signal with a preset time domain density; the third output audio signals obtained by multiple third filters are superimposed to obtain a target output audio signal, which is an audio signal with a reverberation effect. This enables precise control of the reverberation time of each frequency band, effectively improves the reverberation realism of the output audio, is closer to the effect of convolutional reverberation, while significantly reducing the demand for computing power, effectively reducing the computational amount of the algorithm, saving hardware costs, and effectively broadening the application channels of the algorithm.

[0089] Figure 2 It is a schematic flowchart of an audio processing method provided by the embodiments of the present application.

[0090] As Figure 2 shown, the audio processing method may include the following steps:

[0091] Step 201, obtain an audio signal to be processed.

[0092] In the embodiments of the present application, an audio signal to be processed can be obtained.

[0093] The audio signal to be processed is the audio signal for which a reverberation effect needs to be added. In the embodiments of the present application, a real-time audio stream can be obtained.

[0094] Optionally, the audio signal can be multimedia music data, etc., which is not limited in this embodiment.

[0095] Step 202: Determine a target attenuation coefficient based on the reverberation time of a target octave or based on the transfer function of a target audio in a desired scenario.

[0096] In the embodiments of the present application, the target attenuation coefficient can be determined based on the reverberation time of a target octave or based on the transfer function of a target audio in a desired scenario.

[0097] Wherein, the target attenuation coefficient is used to reflect the attenuation rate of the signal energy in the target frequency band. The target frequency band is the frequency band corresponding to the target octave.

[0098] Optionally, the target attenuation coefficient = attenuation 60dB corresponding coefficient / reverberation time / sampling rate * iteration step size.

[0099] Optionally, the target octave can be an octave in a pre-specified frequency band.

[0100] It should be noted that an octave, also known as a doubling wavelength, refers to the interval between two frequencies or wavelengths with a frequency or wavelength ratio of 2 or 1 / 2 on a filter characteristic curve.

[0101] The reverberation time refers to the time when the sound in a room has reached a steady state and the sound source stops emitting sound, that is, the time required for the sound source to decay by 60dB after stopping emitting sound.

[0102] The transfer function is an acoustic transfer function. The acoustic transfer function is the transfer function from a sound source (loudspeaker) to a reproduction area (target area). In the embodiments of the present application, the transfer function of a target audio in a desired scenario, such as a transfer function in a concert hall, can reflect the changes in the output signal of an audio device during the process of the output signal being transmitted to the target area in the concert hall scenario. Based on the transfer function, the corresponding impulse response can be calculated.

[0103] Step 203: Input the audio signal and the target attenuation coefficient into a first filter to obtain a first output audio signal.

[0104] In the embodiments of the present application, the audio signal to be processed can be processed by a first filter introducing a target attenuation coefficient to obtain a first output audio signal.

[0105] Among them, the first filter is used to adjust the energy of the audio signal at different frequencies. The first output audio signal obtained after being processed by the first filter is an audio signal with a reverberation effect.

[0106] Among them, optionally, the first filter is an infinite impulse response (IIR) filter.

[0107] In some embodiments, the first filter is further used to perform spectral equalization on the frequency response corresponding to the target octave or the target audio.

[0108] Step 204: Input the first output audio signal and the target attenuation coefficient into a second filter to obtain a second output audio signal.

[0109] In the embodiments of the present application, the first output audio signal can be processed by a second filter introducing a target attenuation coefficient to obtain a second output audio signal.

[0110] Among them, the second filter is used to perform iterative filtering on the first output audio signal, and can simulate the process of iterative attenuation after sound is reflected and scattered in space. The second output audio signal obtained after being processed by the second filter is an audio signal with a sound tailing phenomenon.

[0111] Among them, optionally, the second filter is also an infinite impulse response (IIR) filter.

[0112] Optionally, the number of the second filters can be multiple.

[0113] Optionally, for the processing of the second filter, it can be to iteratively add the first output audio signal and the signal obtained by delaying the first output audio signal and then introducing the target attenuation coefficient through the system response of the second filter to obtain the second output signal.

[0114] As an example, the internal processing process of the second filter can be as Figure 3 shown. The input signal on the left is the first output audio signal, H loop,i (z) is the system response of the second filter after introducing the target attenuation coefficient, z -Li is the iterative time delay, where L is the step size of the number of points.

[0115] It should be noted that in the embodiments of the present application, both the first filter and the second filter are IIR filters, and the purpose is to achieve the sound tailing phenomenon of late reverberation, which is an iterative attenuation process of sound reflected and scattered in space. The sound tailing phenomenon is a sound phenomenon with reverberation effects that occurs after sound is reflected and scattered by walls in space and undergoes iterative attenuation. The first filter can be regarded as the first filter of the second filter bank, but the first filter also performs spectral equalization adjustment on the frequency response of the desired impulse response (i.e., the input for determining the target attenuation coefficient in step 202), and its spectral modification makes it different from the second filter. Among them, spectral modification refers to adjusting the signal energy at different frequencies.

[0116] Step 205: Input the second output audio signal into at least one third filter to obtain a third output audio signal.

[0117] In the embodiments of the present application, the second output audio signal can be processed through at least one third filter to obtain a third output audio signal corresponding to each third filter.

[0118] Optionally, the third filter is a sparse filter with the target noise as the effective order, and the third filter is a finite impulse response FIR filter.

[0119] Optionally, the target noise can be, for example, velvet noise, which is a sparse discrete signal composed of a small number of non-zero (1 or -1) elements.

[0120] In some embodiments, multiple groups of target noise can be used to determine the third filter, which can effectively avoid the overlap of noise sequences in a short time and generate a flanger effect.

[0121] It should be noted that the flanger effect refers to a buzzing sound similar to metal friction.

[0122] As an example, the third filter is a sparse filter with four groups of velvet noise as the effective order. The results of passing each group of velvet noise sequences through the sparse filter are subjected to an equal-period delay, as shown in the first four row sequences in Figure 4 shown.

[0123] Step 206: Superimpose the third output audio signals after multiple delays to obtain a target output audio signal, where the third output audio signals after multiple delays are obtained by delaying the third output audio signal corresponding to each third filter by the same period.

[0124] In the embodiments of the present application, the third output audio signals corresponding to each third filter can be delayed for the same period to obtain multiple third audio output signals after delay; and the multiple third audio output signals after delay can be superimposed to obtain the target output audio signal with reverberation effect.

[0125] As an example, as Figure 5 shown, where the input is the result of the audio signal to be processed after passing through the first filter, that is, the first audio output signal, G(z) is the second filter, SFIR is the sparse filter corresponding to the target noise (such as velvetnoise), and z -Td is the relative delay of four groups of noise sequences (i.e., Figure 4 the number of misaligned samples in), and the output is the target output audio signal with reverberation effect finally output.

[0126] In the embodiments of the present application, by obtaining the audio signal to be processed; determining the target attenuation coefficient based on the reverberation time of the target octave or based on the transfer function of the target audio in the desired scenario; inputting the audio signal and the target attenuation coefficient into the first filter to obtain the first output audio signal; inputting the first output audio signal and the target attenuation coefficient into the second filter to obtain the second output audio signal; inputting the second output audio signal into multiple third filters respectively to obtain the third output audio signals corresponding to each third filter; superimposing the multiple third output audio signals after delay to obtain the target output audio signal, where the multiple third output audio signals after delay are obtained by delaying the third output audio signals corresponding to each third filter for the same period; it is possible to precisely control the reverberation time of each frequency band, effectively improve the reverberation realism of the output audio, be closer to the effect of convolutional reverberation, at the same time greatly reduce the demand for computing power, effectively reduce the computational amount of the algorithm, save hardware costs, and effectively broaden the application channels of the algorithm.

[0127] To implement the above embodiments, the present application also proposes an audio processing device.

[0128] Figure 6 It is a schematic structural diagram of an audio processing device provided by an embodiment of the present application.

[0129] As Figure 6 shown, the audio processing device includes: an acquisition module 610, a first filtering module 620, a second filtering module 630, a third filtering module 640, and an audio output module 650.

[0130] The acquisition module 610 acquires the audio signal to be processed;

[0131] The first filtering module 620 inputs the audio signal and the target attenuation coefficient into a first filter to obtain a first output audio signal;

[0132] The second filtering module 630 inputs the first output audio signal and the target attenuation coefficient into a second filter to obtain a second output audio signal;

[0133] The third filtering module 640 inputs the second output audio signal into at least one third filter to obtain a third output audio signal;

[0134] The audio output module 650 is configured to superimpose the third output audio signals to obtain a target output audio signal, and the target output audio signal is an audio signal with a reverberation effect.

[0135] Optionally, the apparatus further includes:

[0136] An attenuation determination module (not shown in the figure) for determining the target attenuation coefficient based on the reverberation time of the target octave or based on the transfer function of the target audio in the desired scenario.

[0137] Optionally, the first filter is an infinite impulse response IIR filter, and the first filter is further configured to perform spectral equalization on the frequency response corresponding to the target octave or the target audio.

[0138] Optionally, the second filtering module 630 is specifically configured to:

[0139] Iteratively add the first output audio signal and the signal obtained by introducing the target attenuation coefficient through the system response after delaying the first output audio signal and passing it through the second filter to obtain the second output signal;

[0140] Wherein, the second filter is an infinite impulse response IIR filter.

[0141] Optionally, the third filter is a sparse filter with the target noise as the effective order, and the third filter is a finite impulse response FIR filter.

[0142] Optionally, the audio output module 650 is specifically configured to:

[0143] Superimpose the signals after delaying the third output signals corresponding to each third filter by the same period to obtain the target output audio signal.

[0144] The audio processing device according to the embodiment of the present application obtains an audio signal to be processed; inputs the audio signal and a preset target attenuation coefficient into a first filter to obtain a first output audio signal. The first filter is used to adjust the energy of the audio signal at different frequencies, and the first output audio signal is an audio signal with a reverberation effect; inputs the first output audio signal and the target attenuation coefficient into a second filter to obtain a second output audio signal. The second filter is used to perform iterative filtering on the first output audio signal, and the second output audio signal is an audio signal with a sound tailing phenomenon; inputs the second output audio signal into a plurality of third filters respectively to obtain a third output audio signal corresponding to each third filter. The third filter is used to adjust the density of the second output audio signal in the time domain, and the third output audio signal is an audio signal with a preset time domain density; superimposes the third output audio signals obtained by the plurality of third filters to obtain a target output audio signal. The target output audio signal is an audio signal with a reverberation effect, enabling precise control of the reverberation time of each frequency band, effectively improving the reverberation realism of the output audio, being closer to the effect of convolutional reverberation. At the same time, it greatly reduces the demand for computing power, effectively reduces the computational complexity of the algorithm, saves hardware costs, and effectively broadens the application channels of the algorithm.

[0145] It should be noted that the foregoing explanation of the embodiment of the audio processing method applied to the audio processing device also applies to the audio processing device of this embodiment, and will not be repeated here.

[0146] To implement the above embodiment, the embodiment of the present application also proposes an electronic device, including a storage medium, a processor, and a computer program stored on the storage medium and executable on the processor. Wherein, when the above processor executes the above computer program, it implements the foregoing Figures 1 - 2 audio processing method proposed in the embodiment.

[0147] To implement the above embodiment, the embodiment of the present application also provides a chip, including at least one processor and a communication interface; the above communication interface is used to receive signals input into the above chip or signals output from the above chip, and the above processor communicates with the above communication interface and implements the foregoing Figures 1 - 2 audio processing method proposed in the embodiment.

[0148] To implement the above embodiment, the embodiment of the present application also proposes a non-temporary computer-readable storage medium. When the instructions in the storage medium are executed by the processor of the communication device, the communication device can execute the foregoing Figures 1 - 2 audio processing method proposed in the embodiment.

[0149] Figure 7It is a block diagram of a communication device shown according to an exemplary embodiment. For example, the communication device 700 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0150] Referring to Figure 7 , the communication device 700 may include one or more of the following components: a processing component 702, a memory 704, a power component 706, a multimedia component 708, an audio component 710, an input / output (I / O) interface 712, a sensor component 714, and a communication component 716.

[0151] The processing component 702 generally controls the overall operation of the communication device 700, such as operations associated with display, telephone calls, data communication, camera operations, and recording operations. The processing component 702 may include one or more processors 720 to execute instructions to complete all or part of the steps of the above methods. In addition, the processing component 702 may include one or more modules to facilitate the interaction between the processing component 702 and other components. For example, the processing component 702 may include a multimedia module to facilitate the interaction between the multimedia component 708 and the processing component 702.

[0152] The memory 704 is configured to store various types of data to support the operation of the communication device 700. Examples of such data include instructions for any application or method operating on the communication device 700, contact data, phone book data, messages, pictures, videos, etc. The memory 704 may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, a magnetic disk, or an optical disk.

[0153] The power component 706 provides power to the various components of the communication device 700. The power component 706 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the communication device 700.

[0154] The multimedia component 708 includes a screen that provides an output interface between the communication device 700 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors can sense not only the boundaries of a touch or swipe action but also detect the duration and pressure associated with the touch or swipe operation. In some embodiments, the multimedia component 708 includes a front camera and / or a rear camera. When the communication device 700 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each of the front camera and the rear camera can be a fixed optical lens system or have a focal length and optical zoom capabilities.

[0155] The audio component 710 is configured to output and / or input audio signals. For example, the audio component 710 includes a microphone (MIC) that is configured to receive external audio signals when the communication device 700 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals can be further stored in the memory 704 or transmitted via the communication component 716. In some embodiments, the audio component 710 further includes a speaker for outputting audio signals.

[0156] The I / O interface 712 provides an interface between the processing component 702 and a peripheral interface module, which can be a keyboard, a click wheel, buttons, etc. These buttons can include but are not limited to: a home button, a volume button, a power button, and a lock button.

[0157] The sensor component 714 includes one or more sensors for providing an assessment of the status of various aspects of the communication device 700. For example, the sensor component 714 can detect the open / closed state of the communication device 700, the relative positioning of components, such as the display and keypad of the communication device 700. The sensor component 714 can also detect a change in the position of the communication device 700 or a component of the communication device 700, the presence or absence of user contact with the communication device 700, the orientation or acceleration / deceleration of the communication device 700, and a change in the temperature of the communication device 700. The sensor component 714 can include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor component 714 can also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 714 can further include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0158] The communication component 716 is configured to facilitate communication between the communication device 700 and other devices in a wired or wireless manner. The communication device 700 can access a communication standard-based wireless network, such as WiFi, 4G, or 7G, or a combination thereof. In an exemplary embodiment, the communication component 716 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 716 further includes a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on Radio Frequency Identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0159] In an exemplary embodiment, the communication device 700 can be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components for performing the above method.

[0160] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 704 including instructions, and the above instructions can be executed by a processor 720 of the communication device 700 to complete the above method. For example, the non-transitory computer-readable storage medium can be a ROM, Random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0161] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples", etc. means that the specific features, structures, materials, or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described can be combined in a suitable manner in any one or more embodiments or examples. In addition, without contradiction, those skilled in the art can combine and combine the different embodiments or examples described in this specification and the features of different embodiments or examples.

[0162] Furthermore, the terms "first" and "second" are used for descriptive purposes only and cannot be construed as indicating or implying relative importance or implicitly indicating the quantity of the indicated technical features. Thus, the features defined with "first" and "second" can explicitly or implicitly include at least one of the features. In the description of the present application, "a plurality" means at least two, such as two, three, etc., unless otherwise specifically defined.

[0163] Any process or method description represented in the flowchart or otherwise described herein can be understood to represent a module, segment, or portion of code including one or more executable instructions for implementing a customized logical function or process, and the scope of the preferred embodiments of the present application includes additional implementations, where the functions may be executed in a substantially simultaneous manner or in a reverse order according to the functions involved, rather than in the order shown or discussed, which should be understood by those skilled in the technical field to which the embodiments of the present application pertain.

[0164] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing a logical function, and can be specifically implemented in any computer-readable medium for use by an instruction execution system, apparatus, or device (such as a computer-based system, a system including a processor, or other systems that can fetch and execute instructions from the instruction execution system, apparatus, or device), or in conjunction with these instruction execution systems, apparatuses, or devices. For the purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium include the following: an electrical connection portion having one or more wirings (electronic device), a portable computer diskette (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium can even be paper or other suitable media on which the program can be printed, as the program can be obtained electronically, for example, by optically scanning the paper or other media, followed by editing, interpretation, or other suitable processing as necessary, and then stored in a computer memory.

[0165] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, any one or a combination of the following techniques well known in the art can be used: discrete logic circuits having logic gate circuits for implementing logical functions on data signals, application specific integrated circuits having appropriate combinational logic gate circuits, programmable gate arrays (PGAs), field programmable gate arrays (FPGAs), etc.

[0166] Those of ordinary skill in the art can understand that all or part of the steps carried out in implementing the methods of the above embodiments can be completed by instructing relevant hardware through a program. The program can be stored in a computer-readable storage medium. When the program is executed, it includes one or a combination of the steps of the method embodiments.

[0167] In addition, in each of the embodiments of the present application, the functional units can be integrated into one processing module, or each unit can exist physically alone, or two or more units can be integrated into one module. The above integrated module can be implemented in the form of hardware or in the form of a software functional module. When the above integrated module is implemented in the form of a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium.

[0168] The above-mentioned storage medium can be a read-only memory, a magnetic disk, an optical disc, etc. Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and should not be construed as limiting the present application. Those of ordinary skill in the art can make changes, modifications, substitutions, and variations to the above embodiments within the scope of the present application.

Claims

1. An audio processing method, characterized in that, The method includes: Obtain an audio signal to be processed; Input the audio signal and a preset target attenuation coefficient into a first filter to obtain a first output audio signal. The first filter is used to adjust the energy of the audio signal at different frequencies, and the first output audio signal is an audio signal with a reverberation effect; Input the first output audio signal and the target attenuation coefficient into a second filter to obtain a second output audio signal. The second filter is used to perform iterative filtering on the first output audio signal, and the second output audio signal is an audio signal with a sound tailing phenomenon; Input the second output audio signal into a plurality of third filters respectively to obtain a third output audio signal corresponding to each third filter. The third filter is used to adjust the density of the second output audio signal in the time domain, and the third output audio signal is an audio signal with a preset time domain density; Superimpose the third output audio signals obtained by the plurality of third filters to obtain a target output audio signal. The target output audio signal is an audio signal with a reverberation effect.

2. The method according to claim 1, characterized in that, The method further includes: Determine the target attenuation coefficient based on the reverberation time of a target octave or based on the transfer function of a target audio in a desired scenario.

3. The method according to claim 2, wherein The first filter is an infinite impulse response (IIR) filter, and the first filter is further used to perform spectral equalization on the frequency response corresponding to the target octave or the target audio.

4. The method according to claim 3, wherein The step of inputting the first output audio signal and the target attenuation coefficient into the second filter to obtain a second output audio signal includes: Iteratively add the first output audio signal and a signal obtained by introducing the target attenuation coefficient through the system response after delaying the first output audio signal and passing it through the second filter to obtain the second output signal; Wherein, the second filter is an infinite impulse response (IIR) filter.

5. The method according to claim 4, characterized in that The third filter is a sparse filter with a target noise as the effective order, and the third filter is a finite impulse response (FIR) filter.

6. The method according to claim 5, characterized in that The step of superimposing the third output audio signals to obtain a target output audio signal includes: Delay the third output audio signal corresponding to each third filter for the same period to obtain a plurality of delayed third output audio signals; Superimpose the plurality of delayed third output audio signals to obtain the target output audio signal.

7. An audio processing device, characterized in that, The apparatus includes: An acquisition module, which acquires an audio signal to be processed; A first filtering module, which inputs the audio signal and a preset target attenuation coefficient into a first filter to obtain a first output audio signal. The first filter is used to adjust the energy of the audio signal at different frequencies, and the first output audio signal is an audio signal with a reverberation effect; A second filtering module inputs the first output audio signal and the target attenuation coefficient into a second filter to obtain a second output audio signal. The second filter is used to perform iterative filtering on the first output audio signal, and the second output audio signal is an audio signal with a sound trailing phenomenon; A third filtering module inputs the second output audio signal into a plurality of third filters respectively to obtain third output audio signals corresponding to each third filter. The third filter is used to adjust the density of the second output audio signal in the time domain, and the third output audio signal is an audio signal with a preset time domain density; An audio output module is used to superimpose the third output audio signals obtained by the plurality of third filters to obtain a target output audio signal, and the target output audio signal is an audio signal with a reverberation effect.

8. The method according to claim 7, wherein The device further includes: An attenuation determination module is used to determine the target attenuation coefficient based on the reverberation time of a target octave or based on the transfer function of a target audio in a desired scenario.

9. The method according to claim 8, wherein The first filter is an infinite impulse response (IIR) filter, and the first filter is further used to perform spectral equalization on the frequency response corresponding to the target octave or the target audio.

10. The method according to claim 9, characterized in that, The second filtering module is specifically used for: iteratively adding the first output audio signal and a signal obtained by introducing the target attenuation coefficient through the system response after delaying the first output audio signal and passing it through the second filter to obtain the second output signal; wherein, the second filter is an infinite impulse response (IIR) filter.

11. The method according to claim 10, wherein The third filter is a sparse filter with a target noise as an effective order, and the third filter is a finite impulse response (FIR) filter.

12. The method according to claim 11, wherein The audio output module is specifically used for: delaying the third output audio signals corresponding to each third filter for the same period to obtain a plurality of delayed third output audio signals; superimposing the plurality of delayed third output audio signals to obtain the target output audio signal.

13. An electronic device, comprising a storage medium, a processor, and a computer program stored on the storage medium and executable on the processor, wherein, When the processor executes the computer program, it implements the method according to any one of claims 1 to 6.

14. A chip, characterized in that, It includes at least one processor and a communication interface; the communication interface is used to receive signals input to the chip or signals output from the chip, and the processor communicates with the communication interface and implements the method according to any one of claims 1 - 6 through a logic circuit or by executing code instructions.

15. A vehicle, characterized in that, It includes: An intelligent cockpit; wherein, the intelligent cockpit includes an in - vehicle infotainment system, a processor, and a speaker. The in - vehicle infotainment system is communicatively connected to the processor, and the processor is communicatively connected to the speaker. The in - vehicle infotainment system is used to read an audio stream to be played and input it to the processor for processing. The processor is used to execute the method according to any one of claims 1 to 6 to obtain a target output audio signal, and the speaker is used to obtain and play the target output audio signal output by the processor.

16. A non-transitory computer-readable storage medium, characterized in that, When the instructions in the storage medium are executed by a processor of a communication device, the communication device is enabled to execute the method according to any one of claims 1-6.

Images