Method and device for cloning reverberator

Abstract

The invention belongs to the technical field of reverberators, and relates to a reverberator cloning method and device. The reverberator cloning method comprises the following steps: acquiring a cloning signal, sending a test audio signal, and collecting a return audio signal of the test audio signal; performing deconvolution operation on the test audio signal and the return audio signal to obtain a pulse response signal; segmenting the pulse response signal to obtain a plurality of signal segments; performing fast Fourier transform processing on each signal segment to obtain a clone sample of each signal segment; a cloning sample is selected according to requirements so as to realize cloning of the reverberator; the return audio signal has a reverberation feature. According to the invention, a one-stop reverberation cloning scheme can be provided, the blank of a small convolution reverberator and reverberation cloning equipment in the market is filled, and a user can clone any kind of reverberation effect through very simple operation.

Description

Technical Field

[0001] The present application relates to the technical field of reverberators, and in particular to a cloning method and device for a reverberator. Background Art

[0002] With the development of science and technology and the advancement of technology, the replacement of reverberators is also changing with each passing day.

[0003] In the prior art, there are three main types of reverberation technologies on the market.

[0004] The first is algorithm + reverberation: the sound reflection and attenuation characteristics of different spaces are simulated through digital signal processing algorithms. Algorithmic reverberation is widely used because of its flexibility and controllability, but its realism often depends on the complexity and accuracy of the algorithm.

[0005] The second is convolution reverb: using the impulse response of the actual space to create a reverberation effect through convolution operations. Convolution reverb can provide very natural and realistic reverberation effects, but its computational cost is relatively high and requires pre-recorded high-quality impulse responses.

[0006] The third is hardware reverberation device: reverberation is generated through physical equipment (such as reverberation chamber or dedicated hardware). These methods generally provide high-quality reverberation effects, but they are less flexible and the cost and maintenance workload are relatively high.

[0007] However, there is currently no one-stop reverb cloning device on the market, that is, a reverb device that is highly similar to a specified device or environment can be obtained with just one click. Summary of the invention

[0008] Based on this, it is necessary to provide a reverberator cloning method and device to address the above technical problems, which can provide a one-stop reverberation cloning solution, fill the gap in small convolution reverberators and reverberation cloning devices on the market, and allow users to clone any kind of reverberation effect with very simple operations.

[0009] The cloning method of the reverb, including:

[0010] Acquire a cloned signal, send a test audio signal, and collect a return audio signal of the test audio signal;

[0011] Deconvolve the test audio signal and the return audio signal to obtain an impulse response signal;

[0012] Segmenting the impulse response signal to obtain a plurality of signal segments;

[0013] Perform fast Fourier transform processing on each signal segment to obtain a clone sample of each signal segment;

[0014] Select the clone sample according to your needs to clone the reverb.

[0015] In one embodiment, the return audio signal has a reverberation characteristic.

[0016] In one embodiment, deconvolution operation is performed on the test audio signal and the return audio signal to obtain an impulse response signal, including:

[0017]

[0018] Where I is the impulse response signal, ifft is the inverse fast Fourier transform, fft is the fast Fourier transform, y(t) is the return audio signal, and x(t) is the test audio signal.

[0019] In one embodiment, before performing the deconvolution operation on the test audio signal and the return audio signal, the method further includes: padding the signal length of the test audio signal with 0 to make the signal length of the test audio signal the same as the signal length of the return audio signal.

[0020] In one embodiment, the impulse response signal is segmented to obtain a plurality of signal segments, including:

[0021] Each sample point of the impulse response signal is numbered starting from 1;

[0022] For sample points numbered 1 to 2048, every 64 sample points constitute a signal segment;

[0023] For sample points after number 2048, every 2048 sample points constitute a signal segment.

[0024] In one embodiment, each signal segment is subjected to a fast Fourier transform process to obtain a clone sample of each signal segment, including:

[0025]

[0026] Where x is the signal input by the user, I is the convolution kernel, and S1 and S2 are segmentation points.

[0027] In one embodiment, the test audio signal includes: a 1-second long sweep frequency signal or a 1-second long white noise signal.

[0028] Reverb cloning device, including:

[0029] An acquisition module, used to acquire a cloned signal, send a test audio signal, and collect a return audio signal of the test audio signal;

[0030] An operation module, used for performing a deconvolution operation on the test audio signal and the return audio signal to obtain an impulse response signal;

[0031] A segmentation module, used for segmenting the impulse response signal to obtain multiple signal segments;

[0032] A processing module, used for performing fast Fourier transform processing on each signal segment to obtain a clone sample of each signal segment;

[0033] The cloning module is used to select clone samples according to requirements to achieve cloning of the reverberator.

[0034] In one embodiment, the acquisition module includes: a trigger button, an output port, and an input port;

[0035] The trigger button is used to obtain a clone signal, the output port is used to send a test audio signal, and the input port is used to collect a return audio signal of the test audio signal.

[0036] In one embodiment, the cloning module includes: a selection button for selecting a clone sample according to demand.

[0037] The above-mentioned reverberator cloning method and device adopt a large-scale deconvolution method for learning and a fast convolution method for reproduction, thereby realizing cloning, providing a one-stop reverberation cloning solution, filling the gap of small convolution reverberators and reverberation cloning devices on the market, and allowing users to clone any kind of reverberation effect with very simple operations, reducing the cost of users purchasing various different reverberation devices at high prices, and realizing reverberation freedom. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] Figure 1 is a flow chart of a method for cloning a reverberator in one embodiment;

[0039] Figure 2 is a structural block diagram of a cloning device for a reverberator in one embodiment;

[0040] Figure 3 A connection diagram of a one-click cloning process in an embodiment;

[0041] Figure 4 FIG. 4 is a connection diagram of an actual cloning process in an embodiment. DETAILED DESCRIPTION

[0042] In order to make the purpose, technical solutions and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present application.

[0043] It should be noted that all directional indications in the embodiments of the present application (such as up, down, left, right, front, back, etc.) are only used to explain the relative position relationship, movement status, etc. between the components under a certain specific posture (as shown in the accompanying drawings). If the specific posture changes, the directional indication will also change accordingly.

[0044] In addition, the descriptions of "first", "second", etc. in this application are only for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of this application, "multiple groups" means at least two groups, such as two groups, three groups, etc., unless otherwise clearly and specifically defined.

[0045] In this application, unless otherwise clearly specified and limited, the terms "connection", "fixation", etc. should be understood in a broad sense. For example, "fixation" can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection, an electrical connection, a physical connection, or a wireless communication connection; it can be a direct connection, or an indirect connection through an intermediate medium, or it can be the internal connection of two elements or the interaction relationship between two elements, unless otherwise clearly defined. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances.

[0046] In addition, the technical solutions between the various embodiments of the present application can be combined with each other, but it must be based on the fact that ordinary technicians in the field can implement it. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such combination of technical solutions does not exist and is not within the scope of protection required by this application.

[0047] This application provides a reverberator cloning method, such as Figure 1 The flowchart shown, in one embodiment, includes:

[0048] Step 102: Acquire a clone signal, send a test audio signal, and collect a return audio signal of the test audio signal.

[0049] in:

[0050] The cloning signal is a trigger signal. When the cloning signal is obtained, it indicates the start of the cloning process. The test audio signal includes: a 1-second sweep frequency signal or a 1-second white noise signal. The return audio signal corresponds to the test audio signal one by one. Every time a test audio signal is sent, the corresponding return audio signal can be collected.

[0051] In this step, the returned audio signal has reverberation characteristics to meet the basic conditions for cloning.

[0052] Step 104: Deconvolve the test audio signal and the return audio signal to obtain an impulse response signal.

[0053] Specifically:

[0054] Deconvolute the test audio signal and the return audio signal to obtain the impulse response signal:

[0055]

[0056] Where I is the impulse response signal, ifft is the inverse fast Fourier transform, fft is the fast Fourier transform, y(t) is the return audio signal, and x(t) is the test audio signal.

[0057] In this step, before the test audio signal and the return audio signal are deconvolved, the step also includes: padding the signal length of the test audio signal with 0 so that the signal length of the test audio signal x(t) is the same as the signal length of the return audio signal y(t), that is, fft(x(t)) and fft(y(t)) are two sequences of the same length to meet the requirements of sequence point-to-point division, so that each point in the same position of the two sequences is divided accordingly.

[0058] It should be noted that the inverse fast Fourier transform and the fast Fourier transform are both existing technologies and will not be described in detail here.

[0059] Step 106: segment the impulse response signal to obtain multiple signal segments.

[0060] Specifically:

[0061] Each sample point of the impulse response signal is numbered starting from 1; for sample points numbered from 1 to 2048, every 64 sample points constitute a signal segment; for sample points numbered after 2048, every 2048 sample points constitute a signal segment.

[0062] In this step, the above segmentation method can preprocess the learned convolution kernel so as to perform real-time and low-latency fast convolution operations and reproduce the learned signal by segmented convolution.

[0063] Step 108, performing fast Fourier transform processing on each signal segment to obtain a clone sample of each signal segment.

[0064] Specifically, due to:

[0065]

[0066] but:

[0067]

[0068] Where x is the signal input by the user, I is the convolution kernel, S1 and S2 are segmentation points (for example: 64, 128, ... 1984, 2048, 4096, ...).

[0069] In this step, clone samples of each signal segment are stored for user selection.

[0070] Step 110, selecting a clone sample according to requirements to implement cloning of the reverberator.

[0071] In this step, when the user actually starts playing with the device, the input end of the device performs AD sampling on the user's input signal, and then sends it to the processing unit for convolution processing. Due to the convolution operation of the two signals, it is the fft of the two signals followed by multiplication and ifft, that is:

[0072] x*I=ifft(fft(x)·fft(I))

[0073] Therefore, each of the above segments can be convolved with fft for fast convolution operation, and the fft of each segment I has been pre-processed and stored, that is, the convolution kernel I has been pre-processed, and the user input signal x is convolved with the cloned convolution kernel I, which is equivalent to the same linear operation as the cloned device. Since fft requires a complete block of data to be performed, a fast convolution operation can be performed when the current input reaches 64 samples, thus achieving a fast convolution operation. After using this fast convolution operation to convolve the input signal with the previously pre-stored segmented fft of the impulse response, the same reverberation effect as the measurement is reproduced, achieving the cloning of the reverberation effect.

[0074] The above-mentioned reverberator cloning method adopts a large-scale deconvolution method for learning and a fast convolution method for reproduction, thereby realizing cloning, providing a one-stop reverberation cloning solution, filling the gap of small convolution reverberators and reverberation cloning devices on the market, and allowing users to clone any kind of reverberation effect with very simple operations, reducing the cost of users purchasing various different reverberation devices at high prices, and realizing reverberation freedom.

[0075] It should be understood that although Figure 1 The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, Figure 1At least part of the steps may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least part of the sub-steps or stages of other steps.

[0076] The present application also provides a reverberator cloning device, such as Figure 2 As shown, in one embodiment, it includes: an acquisition module 202, a calculation module 204, a segmentation module 206, a processing module 208 and a cloning module 210, wherein:

[0077] An acquisition module 202, used to acquire a clone signal, send a test audio signal, and collect a return audio signal of the test audio signal;

[0078] The operation module 204 is used to perform a deconvolution operation on the test audio signal and the return audio signal to obtain an impulse response signal;

[0079] A segmentation module 206, used to segment the impulse response signal to obtain multiple signal segments;

[0080] A processing module 208 is used to perform fast Fourier transform processing on each signal segment to obtain a clone sample of each signal segment;

[0081] The cloning module 210 is used to select clone samples according to requirements to achieve cloning of the reverberator.

[0082] The acquisition module includes: a trigger button, an output port and an input port; the trigger button is used to acquire the clone signal, the output port is used to send the test audio signal, and the input port is used to collect the return audio signal of the test audio signal.

[0083] The cloning module includes: a selection button for selecting a cloned sample according to demand.

[0084] In a specific embodiment, the reverberator cloning device is a reverberation effector, more specifically, a convolution reverberation effector.

[0085] The reverb effector includes: a trigger button, an output port, an input port, a processor, and a selection button.

[0086] Specifically:

[0087] like Figure 3As shown, when the user correctly connects the device, that is, connects the output of this effector to the input of the target device, and the input of this effector to the output of the target device, press the trigger button to start one-key cloning; the output port is a stereo audio output interface, and a test audio is played as a test audio signal; the output port and the input port are connected to another reverberation device, such as a reverberation effector, or a real environment; the input port is a stereo audio input interface, and a return audio signal with reverberation characteristics is collected; the processor processes the test audio signal and the return audio signal, including deconvolution operation, segmentation, fast Fourier transform processing, storage of cloned samples of each signal segment, and realization of reverberator cloning; after the one-key cloning is completed, the device display ends, and the stored cloned samples can be renamed, sorted, etc. through the mobile phone APP Bluetooth connection device. The specific operation of connecting the device through the mobile phone APP Bluetooth belongs to the prior art.

[0088] like Figure 4 As shown, when the user connects his own device (such as a guitar or microphone) to the input port of this effector, and connects the output port of this effector to the input port of a speaker, a mixer or other subsequent effector, by pressing the select button and selecting the previously stored cloned sample, the reverb effect that is exactly the same as that of the target device can be used; the trigger button and the select button can also be integrated into one user operation interface.

[0089] The specific definition of the reverberator cloning device can be found in the definition of the reverberator cloning method above, which will not be repeated here. Each module in the above device can be implemented in whole or in part by software, hardware and a combination thereof. Each module can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to each of the above modules.

[0090] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0091] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A reverberator cloning method, characterized in that: include: Acquire a cloned signal, send a test audio signal, and collect a return audio signal of the test audio signal; Deconvolve the test audio signal and the return audio signal to obtain an impulse response signal; Segmenting the impulse response signal to obtain a plurality of signal segments; Perform fast Fourier transform processing on each signal segment to obtain a clone sample of each signal segment; Select the clone sample according to your needs to clone the reverb.

2. The reverberator cloning method according to claim 1, characterized in that: The return audio signal has a reverberation characteristic.

3. The reverberator cloning method according to claim 1 or 2, characterized in that: Deconvolve the test audio signal and the return audio signal to obtain an impulse response signal, including: Where I is the impulse response signal, ifft is the inverse fast Fourier transform, fft is the fast Fourier transform, y(t) is the return audio signal, and x(t) is the test audio signal.

4. The reverberator cloning method according to claim 3, characterized in that: Before performing the deconvolution operation on the test audio signal and the return audio signal, the method further includes: padding the signal length of the test audio signal with 0 so that the signal length of the test audio signal is the same as the signal length of the return audio signal.

5. The reverberator cloning method according to claim 1 or 2, characterized in that: The impulse response signal is segmented to obtain multiple signal segments, including: Each sample point of the impulse response signal is numbered starting from 1; For sample points numbered 1 to 2048, every 64 sample points constitute a signal segment; For sample points after number 2048, every 2048 sample points constitute a signal segment.

6. The reverberator cloning method according to claim 1 or 2, characterized in that: Perform fast Fourier transform on each signal segment to obtain clone samples of each signal segment, including: Where x is the signal input by the user, I is the convolution kernel, and S1 and S2 are segmentation points.

7. The reverberator cloning method according to claim 1 or 2, characterized in that: The test audio signal includes: a 1-second long sweep frequency signal or a 1-second long white noise signal.

8. A reverberator cloning device, characterized in that include: An acquisition module, used to acquire a cloned signal, send a test audio signal, and collect a return audio signal of the test audio signal; An operation module, used for performing a deconvolution operation on the test audio signal and the return audio signal to obtain an impulse response signal; A segmentation module, used for segmenting the impulse response signal to obtain multiple signal segments; A processing module, used for performing fast Fourier transform processing on each signal segment to obtain a clone sample of each signal segment; The cloning module is used to select clone samples according to requirements to achieve cloning of the reverberator.

9. The reverberator cloning device according to claim 8, characterized in that: The acquisition module includes: a trigger button, an output port and an input port; The trigger button is used to obtain a clone signal, the output port is used to send a test audio signal, and the input port is used to collect a return audio signal of the test audio signal.

10. The reverberator cloning device according to claim 9, characterized in that: The cloning module includes: a selection button for selecting a clone sample according to demand.

Images