Seamless loading method and apparatus for ultra-long pulse response, and device and medium

Abstract

The present application belongs to the technical field of music devices, and relates to a seamless loading method and apparatus for an ultra-long pulse response, and a device and a medium. The method comprises: acquiring an input signal and an ultra-long pulse response file to be loaded; performing segmentation on the ultra-long pulse response file, so as to obtain a plurality of file segments; when a signal for switching a pulse response is received, performing a convolution operation on the input signal and a first file segment, so as to obtain a first signal segment, and outputting the first signal segment in real time; and sequentially traversing the file segments according to the sequence of the file segments, and outputting corresponding file segments in real time. Therefore, upon the completion of loading of a file segment, a subsequent signal segment has been output, thereby realizing seamless loading. By means of the present application, real-time convolution can be realized, and seamless loading of an ultra-long pulse response can also be realized.

Description

Traceless loading method, device and equipment of super long impulse response and medium TECHNICAL FIELD

[0001] The present application relates to the technical field of musical instruments, in particular to a traceless loading method, device and equipment of super long impulse response and medium. BACKGROUND

[0002] The super long impulse response technology is generally used for impulse response reverberation, that is, directly using a device input signal to perform convolution operation with a super long impulse response file (typically more than 3 seconds in length) in the device and output in real time.

[0003] In the prior art, the device loads the impulse from the storage device to the memory when switching the impulse.

[0004] However, loading the impulse to the memory requires a certain loading time, that is, after pressing the switch impulse response button, a certain time (such as one second) is required before switching to the new impulse response sound effect. When performing a show, the user often has a high requirement for time when switching the tone at different segments, for example, switching the tone at the beat. When switching the tone, the effect disappears for a period of time due to loading, which causes unnatural sound, such as loss of the head of the reverberation tone, and loading also affects the smoothness of the continuous tone switching operation. SUMMARY

[0005] Therefore, it is necessary to provide a traceless loading method, device and equipment of super long impulse response and medium to realize real-time convolution and traceless loading of super long impulse response in view of the above technical problems.

[0006] The traceless loading method of super long impulse response comprises the following steps.

[0007] Obtain an input signal and a super long impulse response file to be loaded.

[0008] Segment the super long impulse response file to obtain a plurality of file segments.

[0009] When a signal for switching the impulse response is received, sequentially perform segmented convolution according to the order of the file segments based on the input signal and output in real time to realize traceless loading.

[0010] In one embodiment, when a signal for switching the impulse response is received, sequentially perform segmented convolution according to the order of the file segments based on the input signal and output in real time to realize traceless loading, comprising the following steps.

[0011] When a signal for switching the impulse response is received, perform convolution operation on the input signal and the first file segment to obtain a first signal segment and output in real time.

[0012] According to the order of the file segments, each file segment is traversed in sequence, and the corresponding signal segment is output in real time, so that the previous signal segment is loaded when the next signal segment has been output, to realize traceless loading.

[0013] In one embodiment, the loading time of the previous signal segment is greater than or equal to the time when the convolution operation of the next file segment is completed and output.

[0014] In one embodiment, the super-long impulse response file is segmented to obtain a plurality of file segments, including:

[0015] The super-long impulse response file is evenly segmented to obtain a plurality of file segments with equal lengths.

[0016] In one embodiment, according to the order of the file segments, the input signal is segmented and convolved in sequence, including:

[0017] In the formula, x is the input signal, h is the convolution kernel, i is the i th file segment, n is the number of file segments, h(i) is the convolution kernel of the i th file segment, z (i-1)n is the delay of the input signal by (i-1) n samples.

[0018] In one embodiment, the super-long impulse response file is segmented to obtain a plurality of file segments; when receiving the signal of the switching impulse response, the input signal is segmented and convolved in sequence according to the order of the file segments, and is output in real time to realize traceless loading, including:

[0019] The super-long impulse response file is segmented to obtain a plurality of file segments;

[0020] When receiving the signal of the switching impulse response, the input signal is convolved with the first file segment to obtain the first signal segment, and is output in real time for loading;

[0021] While the first signal segment is being loaded, the input signal is convolved with the second file segment to obtain the second signal segment, and is output in real time for loading after the first signal segment is loaded;

[0022] The loading time of the first signal segment is compared with the time when the convolution operation of the second file segment is completed and output, and the super-long impulse response file excluding the first file segment and the second file segment is segmented to obtain new file segments;

[0023] According to the order of the new file segments, each new file segment is traversed in sequence, segment convolution is performed according to the input signal in sequence, and the corresponding signal segment is output in real time, so that the previous signal segment is loaded while the next signal segment starts to output, so as to realize traceless loading.

[0024] In one embodiment, the super-long impulse response file refers to an impulse response file with a time length of more than 3 seconds.

[0025] The traceless loading device of the super-long impulse response comprises:

[0026] The acquisition module is configured to acquire an input signal and a super-long impulse response file to be loaded.

[0027] The segmentation module is configured to segment the super-long impulse response file to obtain a plurality of file segments.

[0028] The convolution module is configured to, when receiving a signal for switching the impulse response, perform segment convolution according to the input signal in sequence according to the order of the file segments and output in real time, so as to realize traceless loading.

[0029] A computer device comprises a memory and a processor, the memory stores a computer program, and the processor implements the following steps when executing the computer program:

[0030] An input signal and a super-long impulse response file to be loaded are acquired.

[0031] The super-long impulse response file is segmented to obtain a plurality of file segments.

[0032] When receiving a signal for switching the impulse response, segment convolution is performed according to the input signal in sequence according to the order of the file segments and output in real time, so as to realize traceless loading.

[0033] A computer readable storage medium stores a computer program, and the computer program is executed by a processor to implement the following steps:

[0034] An input signal and a super-long impulse response file to be loaded are acquired.

[0035] The super-long impulse response file is segmented to obtain a plurality of file segments.

[0036] When receiving a signal for switching the impulse response, segment convolution is performed according to the input signal in sequence according to the order of the file segments and output in real time, so as to realize traceless loading.

[0037] The traceless loading method, device, equipment and medium of the super-long impulse response completely eliminate the loading and switching time of the convolution reverb, so that even a long convolution does not require any loading time, ensuring the real-time effect switching and operation convenience of the product in professional scenarios such as user on-site performances and recordings, and can be applied to the fields of musical instrument and audio signal processing technology, such as a guitar effecter (when the guitar effecter uses convolution reverb, the user switches effects, and the application can achieve instantaneous switching in hearing). BRIEF DESCRIPTION OF DRAWINGS

[0038] FIG. 1 is a flowchart of a traceless loading method of a super-long impulse response in an embodiment;

[0039] FIG. 2 is a structural block diagram of a traceless loading device of a super-long impulse response in an embodiment;

[0040] FIG. 3 is an architectural diagram of a traceless loading device of a super-long impulse response in an embodiment;

[0041] FIG. 4 is an internal structure diagram of a computer device in an embodiment. DETAILED DESCRIPTION

[0042] In order to make the purpose, technical scheme and advantages of the present application clearer, the present application will be further described in detail below in combination with the drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and not to limit the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative labor fall within the scope of the present application.

[0043] In addition, the description such as "first", "second" and the like in the present application is only for the purpose of description and cannot be understood as indicating or implying the relative importance of the indicated technical features or implicitly indicating the number of the indicated technical features. Therefore, the features limited by "first" and "second" can explicitly or implicitly include at least one of the features. In the description of the present application, the meaning of "multiple groups" is at least two groups, such as two groups, three groups, etc., unless otherwise explicitly specified.

[0044] In the present application, unless otherwise explicitly specified and limited, the terms "connection", "fixing" and the like should be understood broadly, for example, "fixing" can be fixed connection, or detachable connection, or integral; can be mechanical connection, or electrical connection, or physical connection or wireless communication connection; can be directly connected, or indirectly connected through an intermediate medium, or the internal communication of two elements or the interaction relationship between two elements, unless otherwise explicitly limited. For those of ordinary skill in the art, the specific meaning of the above terms in the present application can be understood according to the specific circumstances.

[0045] In addition, the technical solutions among the various embodiments of the present application can be combined with each other, but it must be based on the implementation by the ordinary skilled in the art, when the combination of the technical solutions appears contradictory or unimplementable, it should be considered that the combination of the technical solutions does not exist, and is not within the protection scope required by the present application.

[0046] The present application provides a traceless loading method of super-long impulse response, as shown in the flowchart of Figure 1, in one embodiment, comprising:

[0047] Step 102, obtaining the input signal and the super-long impulse response file to be loaded.

[0048] In this step, the super-long impulse response file refers to the impulse response file with a time length of more than 3 seconds.

[0049] Step 104, segmenting the super-long impulse response file to obtain multiple file segments.

[0050] In this step, the segmentation can be: evenly segmenting the super-long impulse response file to obtain multiple file segments with equal lengths, to facilitate implementation; the segmentation can also be: evenly segmenting the super-long impulse response file to obtain multiple file segments with equal lengths, starting from the first file segment, performing convolution operation, and comparing the loading time of the previous signal segment with the time when the convolution operation of the next file segment is completed and output, to re-segment the unconvoluted super-long impulse response file, and realize real-time adjustment.

[0051] Step 106, when receiving the signal of switching impulse response, sequentially performing segmented convolution according to the order of the file segments and the input signal, and outputting in real time, to realize traceless loading.

[0052] Specifically:

[0053] For the case of even segmentation: when receiving the signal of switching impulse response, performing convolution operation on the input signal and the first file segment to obtain the first signal segment, and outputting in real time; sequentially traversing each file segment according to the order of the file segments, and outputting the corresponding signal segment in real time, so that when the previous signal segment is loaded, the next signal segment has been output, to realize traceless loading;

[0054] Among them, sequentially performing segmented convolution according to the order of the file segments and the input signal includes:

[0055] In the formula, x is the input signal, h is the convolution kernel, i is the i-th file segment, n is the number of file segments, h(i) is the convolution kernel of the i-th file segment, z (i-1)n is the delay of the input signal by (i-1)n samples.

[0056] For uneven segmentation: when receiving the signal of the switching impulse response, the input signal is convolved with the first file segment to obtain the first signal segment, and is output in real time for loading; while the first signal segment is being loaded, the input signal is convolved with the second file segment to obtain the second signal segment, and is output in real time for loading after the first signal segment is loaded; the loading time of the first signal segment is compared with the time when the second file segment completes the convolution operation and is output, and the super-long impulse response file other than the first file segment and the second file segment is segmented to obtain new file segments; according to the order of the new file segments, each new file segment is traversed in turn, and segmented convolution is performed according to the input signal to output the corresponding signal segment in real time, so that the previous signal segment is loaded while the next signal segment is output, to realize seamless loading.

[0057] In this step, the loading time of the previous signal segment is greater than or equal to the time when the next file segment completes the convolution operation and is output.

[0058] In a specific embodiment, first, for IR reverberation, segmented convolution is performed, that is, there is a convolution kernel h with a length of N, which is divided into n segments, each with a length of L, wherein N+L>L*n≥N, and then:

[0059] In the formula, x is the input signal, h is the convolution kernel, i is the i-th file segment, n is the number of file segments, h(i) is the convolution kernel of the i-th file segment, z (i-1)n is the delay of the input signal by (i-1)n samples.

[0060] Then, when loading the IR, the method of streaming loading is innovatively adopted. Assuming that the sampling rate of the system is Sr, and assuming that the time point of switching the IR is 0, after switching, h(1) is first read from the storage medium into the memory, and then h(2) is read from the storage medium into the memory within the next n / Sr seconds, and so on, so that the switching is formed in the hearing without any loading trace. Since the entire convolution kernel data does not need to be loaded at the time of switching, the loading time is greatly shortened, and can be reduced to within 5 milliseconds, which is an imperceptible delay.

[0061] The above method for seamless loading of super-long impulse responses completely eliminates the loading and switching time of convolution reverberation, so that even a long convolution does not require any loading time, ensuring the real-time effect switching and operation convenience of the product in professional scenarios such as user on-site performances and recordings, and can be applied to the fields of musical instrument and audio signal processing technology, such as a guitar effecter (when the guitar effecter uses convolution reverberation, the user switches effects, and the application can achieve instantaneous switching in the hearing).

[0062] It should be understood that although the steps in the flowchart of FIG. 1 are shown in sequence according to the direction of the arrows, the steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified herein, the execution of the steps is not strictly limited in sequence, and the steps can be executed in other sequences. Moreover, at least part of the steps in FIG. 1 can include multiple sub-steps or multiple stages, which are not necessarily executed at the same time, but can be executed at different times, and the execution sequence of the sub-steps or stages is not necessarily sequential, but can be alternately executed with at least part of other steps or sub-steps or stages of other steps.

[0063] The application also provides a traceless loading device for an ultra-long impulse response, as shown in FIG. 2, which includes, in one embodiment, an acquisition module 202, a segmentation module 204, and a convolution module 206, wherein:

[0064] The acquisition module 202 is configured to acquire an input signal and an ultra-long impulse response file to be loaded;

[0065] The segmentation module 204 is configured to segment the ultra-long impulse response file to obtain multiple file segments;

[0066] The convolution module 206 is configured to, when receiving a signal of a switching impulse response, sequentially perform segmented convolution according to the input signal in the order of the file segments and output in real time, so as to realize traceless loading.

[0067] It should be noted that, as shown in FIG. 3, the acquisition module, the segmentation module, and the convolution module collectively form a computing unit; in addition to the computing unit, the traceless loading device for the ultra-long impulse response also includes a storage unit to store the ultra-long impulse response file, such as a non-volatile storage element, eMMC, SSD, or SD card, etc. In use, the file is divided into many small segments, and each segment is copied into a volatile storage element such as RAM for convolution operation according to the method of the application, thereby solving the problem that the RAM in the prior art cannot store an ultra-large impulse file at one time, or even if there is a large enough RAM to load the entire impulse file, the time spent in copying the entire file from the external storage into the RAM exceeds the allowable delay range.

[0068] The specific limitations of the traceless loading device for the ultra-long impulse response can be referred to the limitations of the traceless loading method for the ultra-long impulse response described above, which will not be repeated here. The modules in the above device can be realized by software, hardware, and combinations thereof, in whole or in part. The above modules can be embedded in or independent of the processor in the computer device in hardware form, or can be stored in the memory in the computer device in software form, so as to be called and executed by the processor to perform the operations corresponding to the above modules.

[0069] In one embodiment, a computer device is provided, which can be a terminal, and its internal structure diagram can be shown in FIG. 4. The computer device includes a processor, a memory, a network interface, a display screen and an input device connected through a system bus. The processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for running the operating system and the computer program in the non-volatile storage medium. The network interface of the computer device is configured to communicate with external terminals through network connection. The computer program is executed by the processor to implement the method for traceless loading of super-long impulse response. The display screen of the computer device can be a liquid crystal display screen or an electronic ink display screen. The input device of the computer device can be a touch layer overlaid on the display screen, or a key, trackball or touchpad arranged on the shell of the computer device, or an external keyboard, touchpad or mouse, etc.

[0070] Those skilled in the art can understand that the structure shown in FIG. 4 is only a block diagram of part of the structure related to the scheme of the present application, and does not constitute a limitation on the computer device to which the scheme of the present application is applied. Specifically, the computer device can include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0071] In one embodiment, a computer device is provided, which includes a memory and a processor. The memory stores a computer program, and the processor executes the computer program to implement the steps of the method in the above embodiments.

[0072] In one embodiment, a computer readable storage medium is provided, which stores a computer program. The computer program is executed by a processor to implement the steps of the method in the above embodiments.

[0073] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer readable storage medium, and when the computer program is executed, the processes of the above-mentioned embodiments of the methods can be included. Any reference to memory, storage, databases, or other media in the embodiments provided by the present application can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration but not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0074] The technical features of the above embodiments can be combined in any way. In order to make the description simple, not all possible combinations of the technical features in the above embodiments are described, but as long as the combinations of the technical features do not exist, they should be considered as the scope of the present application.

[0075] The above embodiments only express several implementation manners of the present application, and the description is more specific and detailed, but it should not be understood as a limitation on the scope of the patent of the present application. It should be pointed out that for ordinary skilled in the art, without departing from the concept of the present application, a number of modifications and improvements can be made, which are all within the scope of the present application. Therefore, the scope of protection of the patent of the present application should be subject to the appended claims.

Claims

1. A method for traceless loading of an ultralong pulse response, characterized in that, The method comprises the following steps: acquiring an input signal and a super-long impulse response file to be loaded; segmenting the super-long impulse response file to obtain a plurality of file segments; when a signal of switching impulse response is received, sequentially performing segmented convolution according to the input signal in the order of the file segments and outputting in real time to realize traceless loading; specifically comprising: when the signal of switching impulse response is received, performing convolution operation on the input signal and a first file segment to obtain a first signal segment and output in real time to load; while the first signal segment is being loaded, performing convolution operation on the input signal and a second file segment to obtain a second signal segment and output in real time to load after the first signal segment is loaded; comparing the loading time of the first signal segment with the time when the convolution operation of the second file segment is completed and outputting, and re-segmenting the super-long impulse response file except the first file segment and the second file segment to obtain new file segments; sequentially traversing each new file segment in the order of the new file segments, sequentially performing segmented convolution according to the input signal, and outputting corresponding signal segments in real time, so that the previous signal segment is loaded and the subsequent signal segment is outputted at the same time to realize traceless loading.

2. The ultra-long impulse response trace loading method of claim 1, wherein, when a signal of switching impulse response is received, sequentially performing segmented convolution according to the input signal in the order of the file segments and outputting in real time to realize traceless loading, comprising: when the signal of switching impulse response is received, performing convolution operation on the input signal and a first file segment to obtain a first signal segment and output in real time; sequentially traversing each file segment in the order of the file segments and outputting corresponding signal segments in real time, so that the previous signal segment is loaded and the subsequent signal segment is outputted at the same time to realize traceless loading.

3. The ultra-long impulse response trace loading method of claim 2, wherein, The loading time of the previous signal segment is greater than or equal to the time when the convolution operation of the subsequent file segment is completed and outputting.

4. The ultra-long impulse response trace loading method according to any one of claims 1 to 3, wherein, The super-long impulse response file is segmented to obtain a plurality of file segments, comprising: The super-long impulse response file is equally segmented to obtain a plurality of file segments with equal length.

5. The ultra-long impulse response trace loading method of claim 4, wherein, in accordance with the order of the file segments, sequentially performing segment convolution in accordance with the input signal, comprising: In the formula, x is an input signal, h is a convolution kernel, i is the i-th file segment, n is the number of file segments, h(i) is the convolution kernel of the i-th file segment, z (i-1)n is a delay of the input signal by (i-1) n samples.

6. The ultra-long impulse response trace loading method according to any one of claims 1 to 3, wherein, The super-long impulse response file refers to an impulse response file with a time length of more than 3 seconds.

7. A markless loading device with an ultralong impulse response, characterized by The method comprises the following steps: an acquisition module is configured to acquire an input signal and a super-long impulse response file to be loaded; a segmentation module is configured to segment the super-long impulse response file to obtain a plurality of file segments; a convolution module is configured to, when a signal of switching impulse response is received, sequentially perform segmented convolution according to the input signal in the order of the file segments and output in real time to realize traceless loading; specifically comprising: when the signal of switching impulse response is received, performing convolution operation on the input signal and a first file segment to obtain a first signal segment and output in real time to load; while the first signal segment is being loaded, performing convolution operation on the input signal and a second file segment to obtain a second signal segment and output in real time to load after the first signal segment is loaded; The loading time of the first signal segment is compared with the time of completing convolution operation and outputting of the second file segment, and the super-long impulse response file except the first file segment and the second file segment is re-segmented to obtain new file segments; According to the sequence of the new file segments, each new file segment is traversed in sequence, and segment convolution is performed according to the input signal in sequence, and the corresponding signal segment is output in real time, so that the previous signal segment is loaded and completed at the same time as the next signal segment starts to output, so as to realize seamless loading.

8. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that, The processor executes the computer program to implement the steps of the method in any one of claims 1 to 6.

9. A computer readable storage medium having stored thereon a computer program, characterized in that, The computer program is executed by the processor to implement the steps of the method in any one of claims 1 to 6.

Images