Audio processing method, apparatus, device, and computer readable storage medium

Abstract

Embodiments of the present application relate to the technical field of audio processing, and disclose an audio processing method, device, equipment and computer readable storage medium. The method comprises: obtaining sampling data and sound effect free data, wherein the sampling data comprises a target sound effect; correcting an impulse response of the sampling data according to the sound effect free data, calculating a sound effect parameter corresponding to the target sound effect according to the corrected impulse response; and performing audio processing on original audio data according to the sound effect parameter to obtain target audio data with the target sound effect added. Through the above method, the embodiments of the present application load the sound effect parameter corresponding to the target sound effect on the original audio data through a simple audio processing process, obtain the target audio data with the target sound effect added, and correct the impulse response to reduce the influence of a recording device and an audio line on the sampling data, so that the effect of the sound effect finally obtained by the target audio data is consistent with the target sound effect.

Description

TECHNICAL FIELD

[0001] Embodiments of the present application relate to the technical field of audio processing, in particular to an audio processing method, device, equipment and computer readable storage medium. BACKGROUND

[0002] Currently, to realize loading of sound effect parameters on target audio data, so as to obtain target audio data with target sound effects, professional personnel needs to use sound effect modules such as equalizers and reverberators to manually calculate experimental parameters through auditory judgment, which is complex and time-consuming. SUMMARY

[0003] In view of the above problems, embodiments of the present application provide an audio processing method, device, equipment and computer readable storage medium, to solve the problems of complex implementation process and long time period required for completing audio processing in the prior art.

[0004] According to an aspect of an embodiment of the present application, an audio processing method is provided, the method comprising:

[0005] obtaining sampling data and sound effect-free data, the sampling data comprising target sound effects;

[0006] correcting an impulse response of the sampling data according to the sound effect-free data, and calculating sound effect parameters corresponding to the target sound effects according to the corrected impulse response;

[0007] performing audio processing on original audio data according to the sound effect parameters, to obtain target audio data with the target sound effects.

[0008] In an optional manner, the correcting of the impulse response of the sampling data according to the sound effect-free data comprises:

[0009] calculating a sampling offset between the sound effect-free data and the sampling data;

[0010] calculating a sound effect-free impulse response according to the sound effect-free data;

[0011] clipping the sound effect-free impulse response according to the sampling offset, to obtain an impulse response of recording interference;

[0012] correcting the impulse response according to the impulse response of recording interference, to obtain the corrected impulse response.

[0013] In an optional manner, before the performing of audio processing on the original audio data according to the sound effect parameters, the method further comprises:

[0014] obtaining a sampling rate of the original audio data;

[0015] According to a sampling rate of the original audio data, the sound effect parameter is subjected to sampling rate conversion, so as to obtain the sound effect parameter consistent with the sampling rate of the original audio data.

[0016] In an optional manner, the original audio data is subjected to audio processing according to the sound effect parameter, so as to obtain target audio data with the target sound effect, specifically:

[0017] The original audio data and the sound effect parameter are subjected to Fourier transform respectively, so as to obtain Fourier transform of the original audio data and Fourier transform of the sound effect parameter;

[0018] According to the Fourier transform of the original audio data and the Fourier transform of the sound effect parameter, Fourier transform of target audio data is obtained;

[0019] The Fourier transform of the target audio data is subjected to inverse Fourier transform, so as to obtain target audio data with the target sound effect.

[0020] In an optional manner, the sampling data and the sound effect-free data are obtained, including:

[0021] The target sound effect and the sweep data are recorded, so as to obtain the sampling data;

[0022] The sweep data is recorded, so as to obtain the sound effect-free data;

[0023] The sampling data includes sweep data and corresponding target sound effect; the sweep data is audio data including preset frequency range audio; and the sound effect-free data includes sweep data.

[0024] In an optional manner, the original audio data is audio data subjected to fragmentation processing.

[0025] According to another aspect of the embodiment of the present application, an audio processing device is provided, including:

[0026] A sampling module is configured to obtain sampling data and sound effect-free data;

[0027] An effect parameter calculation module is configured to correct an impulse response of the sampling data according to the sound effect-free data, and calculate the sound effect parameter corresponding to the target sound effect according to the corrected impulse response;

[0028] An effect loading module is configured to subject the original audio data to audio processing according to the sound effect parameter, so as to obtain target audio data with the target sound effect.

[0029] In an optional manner, the effect parameter calculation module is further configured to:

[0030] calculating a sampling offset of the anechoic data and the sampling data;

[0031] calculating an anechoic impulse response according to the anechoic data;

[0032] clipping the anechoic impulse response according to the sampling offset to obtain a recorded interference impulse response;

[0033] correcting the impulse response according to the recorded interference impulse response to obtain the corrected impulse response.

[0034] According to another aspect of the embodiments of the present application, an audio processing device is provided, comprising a processor, a memory, a communication interface and a communication bus, the processor, the memory and the communication interface complete communication with each other through the communication bus;

[0035] The memory is used to store at least one executable instruction, and the executable instruction makes the processor execute the operations of the above-mentioned audio processing method.

[0036] According to still another aspect of the embodiments of the present application, a computer readable storage medium is provided, the storage medium stores at least one executable instruction, and the executable instruction makes the audio processing device execute the operations of the above-mentioned audio processing method when running on the audio processing device.

[0037] The embodiments of the present application calculate the sound effect parameters according to the sampling data and the anechoic data, load the sound effect parameters corresponding to the target sound effect on the original audio data to obtain the target audio data with the target sound effect, do not need to use the sound effect technology of equalization and reverberation, the audio processing process is simple, and the subsequent sound effect parameter calculation process of audio processing is completed by professional personnel through auditory judgment, the cycle of audio processing is short, and through correcting the impulse response, the sampling data is affected by the recording device and the audio line, so that the effect of the sound effect of the target audio data finally obtained is consistent with the target sound effect.

[0038] Further, through the fragmentation processing of the target audio data, real-time audio processing of the target audio data can be realized.

[0039] The above description is only a summary of the technical solutions of the embodiments of the present application, in order to more clearly understand the technical means of the embodiments of the present application, the embodiments of the present application can be implemented according to the content of the specification, and in order to make the above and other purposes, characteristics and advantages of the embodiments of the present application more obvious and easy to understand, the specific embodiments of the present application are described as follows. BRIEF DESCRIPTION OF DRAWINGS

[0040] The accompanying drawings are included to provide a further understanding of the application and are incorporated in and constitute a part of this specification. The drawings are not intended to be restrictive in any way. In the drawings:

[0041] Figure 1 A flowchart of an audio processing method according to an embodiment of the present application is shown in FIG. 1.

[0042] Figure 2 A structural diagram of an audio processing device according to an embodiment of the present application is shown in FIG. 2.

[0043] Figure 3 A structural diagram of an audio effect device according to an embodiment of the present application is shown in FIG. 3. DETAILED DESCRIPTION

[0044] Exemplary embodiments of the present application will be described herein below with reference to the accompanying drawings. Although exemplary embodiments of the present application are shown in the drawings, it is understood that the present application can be implemented in various forms and should not be limited by the embodiments set forth herein.

[0045] First, the inventive concept of the present application is described in further detail. To implement the audio effect of a competitor, a professional needs to use an equalizer, a reverb, and other audio effect modules to manually experiment with parameters to complete an audio effect, which generally takes several weeks. The existing solution has at least three problems. First, the implementation speed is slow and the development of an audio effect takes a long period of time. Second, the current solution requires a professional to make a judgment by hearing, mainly imitating equalization and reverb, and other effects are difficult to distinguish. In the case of consuming manpower, the accuracy of implementing the audio effect cannot be guaranteed. Third, in the case where the technology for implementing the audio effect of a competitor is not available and the implemented audio effect is lower than that of the competitor, the existing solution cannot imitate the audio effect of the competitor.

[0046] Figure 1 A flowchart of an audio processing method according to an embodiment of the present application is shown in FIG. 1. The method is performed by a computing device. The computing device can be a personal computer, a palmtop computer, a mobile phone, or the like. As shown in FIG. 1, the method includes the following steps: Figure 1

[0047] Step 110: Obtain sample data and audio effect-free data. The sample data includes a target audio effect.

[0048] In an embodiment of the present application, the obtaining of the sample data and the audio effect-free data includes: recording the target audio effect and the sweep data to obtain the sample data; recording the sweep data to obtain the audio effect-free data. The sample data includes sweep data and a corresponding target audio effect. The sweep data is audio data including a preset frequency range. The audio effect-free data includes sweep data.

[0049] ​The sampling data is audio data in a WAV format. In the embodiment of the present application, the sweep data is audio data including a preset frequency range audio, and the preset frequency range is 20 Hz-20000 Hz. The sweep data is a double-channel file, and the left channel data and the right channel data are consistent. In the embodiment of the present application, the length of the sweep data can be 19-21 seconds.

[0050] In the embodiment of the present application, the target sound effect and the sweep data are recorded to obtain the sampling data, and the sweep data is recorded to obtain the sound effect-free data. Specifically, in the case that the original device and application of the target sound effect are enabled, the sweep data is played to record the sampling data. The recording method can be in the form of internal recording of an operating system or in the form of connecting a microphone jack of a computer to an earphone jack. In the case that the target sound effect is not enabled, the sweep data is played through an API of an operating system to record the sound effect-free data.

[0051] Step 120: correcting the impulse response of the sampling data according to the sound effect-free data, and calculating the sound effect parameters corresponding to the target sound effect according to the corrected impulse response.

[0052] The method for correcting the impulse response of the sampling data according to the sound effect-free data and calculating the sound effect parameters corresponding to the target sound effect according to the corrected impulse response includes: obtaining the sound effect-free data; calculating the sampling offset of the sound effect-free data and the sampling data; calculating the sound effect-free impulse response according to the sound effect-free data; clipping the sound effect-free impulse response according to the sampling offset to obtain the impulse response of recording interference; and correcting the impulse response according to the impulse response of recording interference to obtain the corrected impulse response.

[0053] In the embodiment of the present application, the impulse response is calculated according to the sampling data. Specifically, the data of the sweep data of the sampling data is denoted as In, the sampling data is denoted as Out, the data In of the sweep data includes the left channel data Inl of the sweep data and the right channel data Inr of the sweep data, and the sampling data Out includes the left channel data Outl of the sampling audio data and the right channel data Outr of the sampling audio data. The impulse response includes the first left channel impulse response and the first right channel impulse response. The calculation of the impulse response of the sampling data includes the calculation of the first left channel impulse response and the first right channel impulse response of the sampling data.

[0054] The Fourier transform of the first left channel impulse response is calculated as follows:

[0055] Hl=FFT(Inl) / FFT(Outl)

[0056] wherein FFT(Inl) represents the Fourier transform of the left channel data Inl of the sweep data, and FFT(Outl) represents the Fourier transform of the left channel data Outl of the sample data.

[0057] The Fourier transform of the first right channel impulse response is calculated as follows:

[0058] Hl = FFT(Inr) / FFT(Outr);

[0059] wherein FFT(Inr) represents the Fourier transform of the right channel data Inr of the sweep data, and FFT(Outr) represents the Fourier transform of the right channel data Outr of the sample data.

[0060] In the embodiment of the present application, the sampling offset of the soundless data and the sample data is calculated. Specifically, the soundless data and the sample data are aligned, and the offset of the soundless data and the sample data is calculated according to the following formula:

[0061]

[0062] wherein x represents the data sequence of the sample data, y represents the data sequence of the soundless data, and d represents the sequence number of the data in the sequence. All values of d are traversed, and when the value of R(d) is maximum, the d at this time is the offset.

[0063] In the embodiment of the present application, the soundless impulse response is calculated according to the soundless data. Specifically, the soundless impulse response includes a third left channel impulse response and a third right channel impulse response; the soundless sweep data is denoted as In', and the soundless data is denoted as Out'; the soundless sweep data In' includes soundless sweep data left channel data In'l and soundless sweep data right channel data In'r, and the soundless data Out' includes soundless left channel data Out'l and soundless right channel data Out'r; the Fourier transform of the third left channel impulse response is calculated as follows:

[0064] Hnl = FFT(In'l) / FFT(Out'l);

[0065] wherein FFT(In'l) represents the Fourier transform of the left channel data of the soundless sweep data, and FFT(Out'l) represents the Fourier transform of the left channel data of the soundless data.

[0066] The Fourier transform of the third right channel impulse response is calculated as follows:

[0067] Hnl = FFT(In'r) / FFT(Out'r);

[0068] FFT(In' r) represents the Fourier transform of the sound effect free sweep data right channel data, and FFT(Out' r) represents the Fourier transform of the sound effect free data right channel data.

[0069] In the embodiment of the present application, the sound effect free impulse response is cropped according to the sampling offset to obtain the recording interference impulse response. Specifically, Hnl and Hnr are cropped using the offset to obtain the recording interference impulse response aligned with Hl and Hr, and the recording interference impulse response includes a fourth left channel impulse response Hn'l and a fourth right channel impulse response Hn'r. Specifically, the impulse response is an integer data sequence, for example, a one-second single-channel audio data has 44100 samples, corresponding to a first sample number 0, a second sample number 1, and so on. The cropping of Hnl and Hnl using the offset means deleting samples with a sample number less than or equal to the offset.

[0070] In the embodiment of the present application, the impulse response is corrected according to the recording interference impulse response to obtain the corrected impulse response. Specifically, the corrected impulse response includes a second left channel impulse response Hel and a second right channel impulse response Her; the second left channel impulse response is calculated by the following formula:

[0071] Hel=IFFT(FFT(Hl) / FFT(Hn'l));

[0072] wherein IFFT() represents an inverse Fourier transform, FFT(Hl) represents the Fourier transform of the first left channel impulse response Hl, and FFT(Hn'l) represents the Fourier transform of the fourth left channel impulse response Hn'l.

[0073] wherein the second right channel impulse response is obtained by the following formula:

[0074] Her=IFFT(FFT(Hr) / FFT(Hn'r));

[0075] wherein IFFT() represents an inverse Fourier transform, FFT(Hr) represents the Fourier transform of the first right channel impulse response Hr, and FFT(Hn'r) represents the Fourier transform of the fourth right channel impulse response Hn'r.

[0076] In the embodiment of the present application, the impact response is an array, and the first m (such as 10000) elements of the array are intercepted and recorded as the sound effect parameter P, the P is recorded by using a floating point number, the maximum value is 1, and the minimum value is -1, the P includes a left sound channel sound effect parameter Pl and a right sound channel sound effect parameter Pr, the Pl is intercepted by Hel, and the Pr is intercepted by Her, and the Pl and the Pr are in a PCM audio format. It can be understood that the left sound channel sound effect parameter Pl and the right sound channel sound effect parameter Pr have the same number of elements.

[0077] Step 130: performing audio processing on the original audio data according to the sound effect parameter to obtain target audio data with the target sound effect.

[0078] In the embodiment of the present application, the original audio data is processed according to the sound effect parameter to obtain target audio data with the target sound effect. Specifically, the sound effect parameter and the original audio data are respectively subjected to Fourier transform to obtain Fourier transform of the sound effect parameter and Fourier transform of the original audio data; Fourier transform of the target audio data is obtained according to the Fourier transform of the original audio data and the Fourier transform of the sound effect parameter; and the Fourier transform of the target audio data is subjected to inverse Fourier transform to obtain the target audio data with the target sound effect.

[0079] In the embodiment of the present application, before the original audio data is processed according to the sound effect parameter, the method further includes: obtaining a sampling rate of the original audio data; and performing sampling rate conversion on the sound effect parameter according to the sampling rate of the original audio data to obtain the sound effect parameter with the same sampling rate as the original audio data. Specifically, the impact response is related to the sampling rate, and the same sound effect recorded by using different sampling rates of sampling data will not be the same. The impact response calculated according to the sampling data can only process audio data with the same sampling rate. In the embodiment of the present application, taking a song file as the original audio data, before step 130, the method further includes: obtaining a sampling rate of the song file; and using an algorithm for converting the audio sampling rate to obtain a converted sampling rate sound effect parameter T (P), the T (P) has the same sampling rate as the song file, and the T (P) includes a converted sampling rate left sound channel sound effect parameter T (Pl) and a converted sampling rate right sound channel sound effect parameter T (Pr).

[0080] In the embodiment of the present application, the original audio data is audio data processed by slicing. Taking a song file as the original audio data, the song file is processed by slicing, i.e., the song is divided into a plurality of data segments, and the length of each data segment is not required. Taking one of the data segments as S, the data segment S is in the PCM format, and the data segment S includes a left channel data segment Sl and a right channel data segment Sr. The audio processing of the original audio data according to the sound effect parameter to obtain the target audio data with the target sound effect includes: performing Fourier transform on the data segment S to obtain F(S), performing Fourier transform on the sound effect parameter T(P) of the converted sampling rate to obtain FT(P), and calculating the Fourier transform of the song data with the target sound effect as F(E) = F(S)*FT(P).

[0081] F(E) = F(S)*FT(P);

[0082] wherein E represents the song data with the target sound effect corresponding to the sound effect parameter, and the inverse Fourier transform of F(E) obtains the song data E with the target sound effect.

[0083] In the embodiment of the present application, the sound effect parameter is calculated according to the sampling data and the soundless data, and the original audio data is loaded with the sound effect parameter corresponding to the target sound effect to obtain the target audio data with the target sound effect. The audio processing process is simple without using the sound effect technology of equalization and reverberation. The subsequent audio processing of the sound effect parameter is completed without the judgment of professionals through hearing, the cycle of the audio processing is short, and the sampling data is less affected by the recording equipment and the audio line through the correction of the impulse response, so that the effect of the target audio data with the target sound effect is consistent with the target sound effect.

[0084] Further, the real-time audio processing of the target audio data can be realized by slicing the target audio data.

[0085] Figure 2 Fig. 2 shows a structure schematic diagram of an audio processing device provided by the embodiment of the present application. As shown in Fig. 2, the device 200 includes a sampling module 210, a sound effect parameter calculation module 220 and a sound effect loading module 230. Figure 2

[0086] The sampling module 210 is configured to acquire sampling data and soundless data. The sound effect parameter calculation module 220 is configured to correct the impulse response of the sampling data according to the soundless data, and calculate the sound effect parameter corresponding to the target sound effect according to the corrected impulse response. The sound effect loading module 230 is configured to perform audio processing on the original audio data according to the sound effect parameter to obtain the target audio data with the target sound effect.

[0087] ​In an optional mode, the sound effect parameter calculation module 220 is further configured to: calculate a sampling offset between the soundless data and the sampling data; calculate a soundless impulse response based on the soundless data; clip the soundless impulse response based on the sampling offset to obtain a recording interference impulse response; and correct the impulse response based on the recording interference impulse response to obtain the corrected impulse response.

[0088] In an optional mode, before the original audio data is processed based on the sound effect parameter, the method further includes: obtaining a sampling rate of the original audio data; and performing sampling rate conversion on the sound effect parameter based on the sampling rate of the original audio data to obtain the sound effect parameter consistent with the sampling rate of the original audio data.

[0089] In an optional mode, the original audio data is processed based on the sound effect parameter to obtain target audio data with the target sound effect, specifically: performing Fourier transform on the original audio data and the sound effect parameter respectively to obtain Fourier transform of the original audio data and Fourier transform of the sound effect parameter; obtaining Fourier transform of target audio data based on the Fourier transform of the original audio data and the Fourier transform of the sound effect parameter; and performing inverse Fourier transform on the Fourier transform of the target audio data to obtain the target audio data with the target sound effect.

[0090] In an optional mode, the sampling data and the soundless data are obtained by: recording the target sound effect and the sweep data to obtain the sampling data; and recording the sweep data to obtain the soundless data; the sampling data includes the sweep data and the corresponding target sound effect; the sweep data is audio data including a preset frequency range; and the soundless data includes the sweep data.

[0091] In an optional mode, the original audio data is audio data processed by slicing.

[0092] According to the sampling data and the soundless data, the sound effect parameter is calculated, and the original audio data is loaded with the sound effect parameter corresponding to the target sound effect to obtain the target audio data with the target sound effect, without using equalization and reverberation sound effect technology, so that the audio processing process is simple, and the subsequent sound effect parameter calculation process of audio processing is completed by professional personnel through auditory judgment, the cycle of audio processing is short, and the sampling data is corrected to reduce the influence of recording equipment and audio lines on the sampling data, so that the effect of the sound effect of the target audio data finally obtained is consistent with the target sound effect.

[0093] Further, by performing the fragmenting processing on the target audio data, real-time audio processing on the target audio data can be realized.

[0094] Figure 3 A structure diagram of an audio processing device provided by an embodiment of the present application is shown, and the embodiment of the present application does not limit the specific implementation of the audio processing device. As shown in the figure, the audio processing device can include a processor 402, a communications interface 404, a memory 406, and a communications bus 408. Figure 3

[0095] The processor 402, the communications interface 404, and the memory 406 can complete the communication with each other through the communications bus 408. The communications interface 404 is configured to communicate with network elements of other devices, such as clients or other servers. The processor 402 is configured to execute the program 410, and specifically can execute the related steps in the above-mentioned embodiments of the audio processing method.

[0096] Specifically, the program 410 can include program codes, and the program codes include computer executable instructions.

[0097] The processor 402 can be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application. The one or more processors included in the audio processing device can be processors of the same type, such as one or more CPUs; or can be processors of different types, such as one or more CPUs and one or more ASICs.

[0098] The memory 406 is configured to store the program 410. The memory 406 can include a high-speed RAM memory, and can also include a non-volatile memory, such as at least one disk memory.

[0099] The program 410 specifically can be invoked by the processor 402 to enable the audio processing device to perform the following operations:

[0100] Obtaining sampling data and non-audio effect data; correcting an impulse response of the sampling data according to the non-audio effect data, calculating an audio effect parameter corresponding to the target audio effect according to the corrected impulse response; and performing audio processing on original audio data according to the audio effect parameter to obtain target audio data with the target audio effect.

[0101] ​In an optional mode, the correction of the impulse response of the sampling data according to the no-audio effect data comprises: calculating a sampling offset of the no-audio effect data and the sampling data; calculating a no-audio effect impulse response according to the no-audio effect data; clipping the no-audio effect impulse response according to the sampling offset to obtain a recording interference impulse response; and correcting the impulse response according to the recording interference impulse response to obtain the corrected impulse response.

[0102] In an optional mode, before the audio processing of the original audio data according to the audio effect parameter, the method further comprises: obtaining a sampling rate of the original audio data; and performing sampling rate conversion on the audio effect parameter according to the sampling rate of the original audio data to obtain the audio effect parameter consistent with the sampling rate of the original audio data.

[0103] In an optional mode, the audio processing of the original audio data according to the audio effect parameter to obtain the target audio data with the target audio effect comprises: performing Fourier transform on the original audio data and the audio effect parameter respectively to obtain Fourier transform of the original audio data and Fourier transform of the audio effect parameter; obtaining Fourier transform of the target audio data according to the Fourier transform of the original audio data and the Fourier transform of the audio effect parameter; and performing inverse Fourier transform on the Fourier transform of the target audio data to obtain the target audio data with the target audio effect.

[0104] In an optional mode, the obtaining of the sampling data and the no-audio effect data comprises: recording the target audio effect and the sweep data to obtain the sampling data; and recording the sweep data to obtain the no-audio effect data; the sampling data comprises the sweep data and the corresponding target audio effect; the sweep data is audio data comprising a preset frequency range audio; and the no-audio effect data comprises the sweep data.

[0105] In an optional mode, the original audio data is audio data processed by slicing.

[0106] The embodiment of the application calculates the audio effect parameter according to the sampling data and the no-audio effect data, loads the audio effect parameter corresponding to the target audio effect on the original audio data, and obtains the target audio data with the target audio effect, without using equalization and reverberation audio effect technology, so that the audio processing process is simple, the subsequent audio processing of the audio effect parameter calculation process is completed by professional personnel through auditory judgment, the cycle of the audio processing is short, the sampling data is corrected to reduce the influence of the recording equipment and the audio line on the sampling data, and the effect of the audio effect of the target audio data finally obtained is consistent with the target audio effect.

[0107] Further, by performing the slicing processing on the target audio data, real-time audio processing on the target audio data can be realized.

[0108] The embodiment of the present application provides a computer readable storage medium, the storage medium stores at least one executable instruction, and the executable instruction enables an audio processing device to perform the audio processing method in any method embodiment described above when the executable instruction runs on the audio processing device.

[0109] The executable instruction can be specifically used for enabling the audio processing device to perform the following operations:

[0110] The sampling data includes sweep data and corresponding target sound effect, and the sweep data is audio data including audio of a preset frequency range.

[0111] In an optional manner, the obtaining of the sampling data and the sound effect free data includes: recording the target sound effect and the sweep data to obtain the sampling data; and recording the sweep data to obtain the sound effect free data.

[0112] In an optional manner, the correction of the impulse response of the sampling data according to the sound effect free data includes: calculating a sampling offset of the sound effect free data and the sampling data; calculating a sound effect free impulse response according to the sound effect free data; clipping the sound effect free impulse response according to the sampling offset to obtain an impulse response of recording interference; and correcting the impulse response according to the impulse response of the recording interference to obtain the corrected impulse response.

[0113] In an optional manner, after the calculation of the sound effect parameter corresponding to the target sound effect, the method further includes: obtaining a sampling rate of the original audio data; and performing sampling rate conversion on the sound effect parameter according to the sampling rate of the original audio data to obtain the sound effect parameter consistent with the sampling rate of the original audio data.

[0114] In an alternative manner, the audio processing of the original audio data according to the sound effect parameter to obtain the target audio data with the target sound effect comprises: calculating the Fourier transform of the original audio data and the sound effect parameter respectively to obtain the Fourier transform of the original audio data and the Fourier transform of the sound effect parameter; calculating the Fourier transform of the target audio data according to the Fourier transform of the original audio data and the Fourier transform of the sound effect parameter; and performing inverse Fourier transform on the Fourier transform of the target audio data to obtain the target audio data with the target sound effect.

[0115] In an alternative manner, the original audio data is audio data processed by slicing.

[0116] The embodiment of the present application calculates the sound effect parameter according to the sweep data, loads the sound effect parameter to the target audio data, and obtains the target audio data with the target sound effect, without using the sound effect technology of equalization and reverberation, so that the audio processing process is simple, the sound effect parameter calculation process of subsequent audio processing is completed by professional personnel through auditory judgment, the cycle of audio processing is short, the sampling data is influenced by the recording equipment and the audio line through correction of the impulse response, so that the effect of the sound effect of the target audio data finally obtained is consistent with the target sound effect.

[0117] Further, the real-time audio processing of the target audio data can be realized through slicing processing of the target audio data.

[0118] The embodiment of the present application provides an audio processing device for executing the above-mentioned audio processing method.

[0119] The embodiment of the present application provides a computer program, which can be called by a processor to make an audio processing device execute the audio processing method in any method embodiment.

[0120] The embodiment of the present application provides a computer program product, which comprises a computer program stored on a computer readable storage medium, and the computer program comprises program instructions, which, when executed on a computer, make the computer execute the audio processing method in any method embodiment.

[0121] The algorithms or displays provided herein are not inherently related to any particular computer, virtual system, or other apparatus. Various general purpose systems can be used with these teachings, based on the description as provided herein. Those skilled in the art will recognize that structures for a variety of these systems will appear from the description provided herein. In addition, the present embodiment is not intended to be limited to any particular programming language. It will be appreciated that a variety of programming languages can be used to implement the teachings of the present application as described herein, and any references below to specific languages are provided for disclosure of enablement only.

[0122] In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the application can be practiced without these specific details. In some instances, well-known methods, structures and techniques have not been described in detail in order not to obscure the understanding of this description.

[0123] Similarly, it is to be understood that the mechanical details of the application that have been set forth in the description above of exemplary embodiments of the application are intended to be illustrative only. As such, changes in form and detail can be made without departing from the spirit, scope, and application of the application. It should be understood that the application is not limited to these specific aspects of the embodiments of the application, but is capable of claims as broad or as narrow as the disclosure will allow.

[0124] It will be understood by those within the art that, in some embodiments, aspects of the apparatus and techniques can be performed by specific hardware components. It will further be understood that each of the steps within such apparatus and techniques can be performed, at least partially, on a computer- readable medium having stored on it computer-executable instructions that are executed by a computer processor. Further, it will be appreciated that embodiments of the disclosure can be implemented via a computer program product that can include a computer-readable medium having stored thereon computer-executable instructions that, when executed by a computer processor, implement aspects of the present disclosure.

[0125] It is to be understood that the embodiments of the application described above are illustrative only and that modifications of detail can be effected without departing from the spirit, scope and application of the application. Accordingly, the application is not limited to the specific examples described herein, but rather only by the claims that follow, the intent being to fully cover all modifications that come within the scope of the following claims and their equivalents. It is further noted that the specific guard positions and / or guard shapes described herein are illustrative only and that other guard positions and / or guard shapes can be used without departing from the scope of the application. It is also noted that the specific guard shapes described herein are illustrative only and that other guard shapes can be used without departing from the scope of the application. It is further noted that the specific guard shapes described herein are illustrative only and that other guard shapes can be used without departing from the scope of the application. It is further noted that the specific guard shapes described herein are illustrative only and that other guard shapes can be used without departing from the scope of the application. It is further noted that the specific guard shapes described herein are illustrative only and that other guard shapes can be used without departing from the scope of the application. It is further noted that the specific guard shapes described herein are illustrative only and that other guard shapes can be used without departing from the scope of the application. It is further noted that the specific guard shapes described herein are illustrative only and that other guard shapes can be used without departing from the scope of the application. It is further noted that the specific guard shapes described herein are illustrative only and that other guard shapes can be used without departing from the scope of the application. It is further noted that the specific guard shapes described herein are illustrative only and that other guard shapes can be used without departing from the scope of the application. It is further noted that the specific guard shapes described herein are illustrative only and that other guard shapes can be used without departing from the scope of the application. It is further noted that the specific guard shapes described herein are illustrative only and that other guard shapes can be used without departing from the scope of the application. It is further noted that the specific guard shapes described herein are illustrative only and that other guard shapes can be used without departing from the scope of the application. It is further noted that the specific guard shapes described herein are illustrative only and that other guard shapes can be used without departing from the scope of the application. It is further noted that the specific guard shapes described herein are illustrative only and that other guard shapes can be used without departing from the scope of the application. It is further noted that the specific guard shapes described herein are illustrative only and that other guard shapes can be used without departing from the scope of the application. It is further noted that the specific guard shapes described herein are illustrative only and that other guard shapes can be used without departing from the scope of the application.

Claims

1. An audio processing method, characterized by, The method comprises: obtaining sampling data and soundless data, the sampling data comprising a target sound effect; correcting an impulse response of the sampling data according to the soundless data, and calculating an audio parameter corresponding to the target sound effect according to the corrected impulse response; wherein the correction of the impulse response of the sampling data according to the soundless data comprises: calculating a sampling offset between the soundless data and the sampling data; calculating a soundless impulse response according to the soundless data; clipping the soundless impulse response according to the sampling offset to obtain a recording interference impulse response; and correcting the impulse response of the sampling data according to the recording interference impulse response to obtain the corrected impulse response; performing audio processing on original audio data according to the audio parameter to obtain target audio data with the target sound effect added; wherein the audio processing on the original audio data according to the audio parameter to obtain the target audio data with the target sound effect added comprises: performing Fourier transform on the original audio data and the audio parameter respectively to obtain Fourier transform of the original audio data and Fourier transform of the audio parameter; obtaining Fourier transform of the target audio data according to the Fourier transform of the original audio data and the Fourier transform of the audio parameter; and performing inverse Fourier transform on the Fourier transform of the target audio data to obtain the target audio data with the target sound effect added.

2. The method of claim 1, wherein, Before the audio processing on the original audio data according to the audio parameter, the method further comprises: obtaining a sampling rate of the original audio data; performing sampling rate conversion on the audio parameter according to the sampling rate of the original audio data to obtain the audio parameter consistent with the sampling rate of the original audio data.

3. The method of claim 1, wherein, The obtaining of the sampling data and the soundless data comprises: recording a target sound effect and sweep data to obtain the sampling data; recording the sweep data to obtain the soundless data; the sampling data comprises sweep data; the sweep data is audio data comprising a preset frequency range audio; and the soundless data comprises sweep data.

4. The method of claim 1, wherein, The original audio data is audio data processed by slicing.

5. An audio processing apparatus, characterized by comprising: The device comprises: a sampling module configured to obtain sampling data and soundless data, the sampling data comprising a target sound effect; an audio parameter calculation module configured to correct an impulse response of the sampling data according to the soundless data, and calculate an audio parameter corresponding to the target sound effect according to a corrected impulse response; wherein the correction of the impulse response of the sampling data according to the soundless data comprises: calculating a sampling offset between the soundless data and the sampling data; calculating a soundless impulse response according to the soundless data; clipping the soundless impulse response according to the sampling offset to obtain a recording interference impulse response; and correcting the impulse response of the sampling data according to the recording interference impulse response to obtain the corrected impulse response; The sound effect loading module is configured to perform audio processing on the original audio data according to the sound effect parameter, to obtain target audio data with the target sound effect added thereto; wherein the audio processing on the original audio data according to the sound effect parameter, to obtain target audio data with the target sound effect added thereto, specifically comprises: performing Fourier transform on the original audio data and the sound effect parameter respectively, to obtain Fourier transform of the original audio data and Fourier transform of the sound effect parameter; obtaining Fourier transform of target audio data according to the Fourier transform of the original audio data and the Fourier transform of the sound effect parameter; and performing inverse Fourier transform on the Fourier transform of the target audio data, to obtain target audio data with the target sound effect added thereto.

6. An audio processing device, characterized by Comprise: a processor, a memory, a communication interface and a communication bus, the processor, the memory and the communication interface complete mutual communication through the communication bus; The memory is used for storing at least one executable instruction, and the executable instruction makes the processor execute the operations of the audio processing method in any one of claims 1-4.

7. A computer readable storage medium characterized in that, The storage medium has at least one executable instruction stored therein, and the executable instruction, when running on the audio processing device, causes the audio processing device to execute the operations of the audio processing method in any one of claims 1-4.

Images