Acoustic signal processing device, musical instrument, acoustic signal processing method and acoustic signal processing program

Abstract

To provide an acoustic signal processing technology which realizes various expressions with intuitive and flexible operation by a user.SOLUTION: An acoustic signal processing unit 4 includes: a first signal processing unit 41 for performing first pitch shift processing on a first acoustic signal SD1; a second signal processing unit 42 for performing second pitch shift processing on a second acoustic signal SD2; a cross coupling unit 50 for cross-coupling a first effect processing signal AD1 outputted from the first signal processing unit 41 and a second effect processing signal AD2 outputted from the second signal processing unit 42; and a parameter setting unit 25 for setting a parameter which continuously changes a coupling degree of the first effect processing signal AD1 and the second effect processing signal AD2 in the cross coupling unit 50.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to an audio signal processing device, a musical instrument equipped with an audio signal processing device, an audio signal processing method, and an audio signal processing program. [Background technology]

[0002] There are audio signal processing devices that perform various audio processes on input audio signals. Non-Patent Document 1 below discloses an audio signal processing device that has two signal processing systems that include delay and loop processing. In this device, cross-coupling processing is performed between the two signal processing systems. [Prior art documents] [Non-patent literature]

[0003] [Non-Patent Document 1] Studio sound, December 1971 issue, p634 Summary of the Invention [Problem to be solved by the invention]

[0004] The device disclosed in Non-Patent Document 1 is capable of cross-coupling two systems of signals. If a mechanism is provided that enables more flexible processing in cross-coupling processing, it would be very convenient for users.

[0005] An object of the present invention is to provide an audio signal processing technique that enables a wide variety of expressions through intuitive and flexible user operations. [Means for solving the problem]

[0006] An audio signal processing device according to one embodiment of the present invention includes a first signal processing unit that receives a first audio signal and performs a first pitch shift process on the first audio signal, a second signal processing unit that receives a second audio signal and performs a second pitch shift process on the second audio signal, a cross-coupling unit that cross-couples a first effect-processed signal output from the first signal processing unit and a second effect-processed signal output from the second signal processing unit, and a parameter setting unit that sets a parameter in the cross-coupling unit that continuously changes the degree of coupling between the first effect-processed signal and the second effect-processed signal.

[0007] An acoustic signal processing method according to another aspect of the present invention includes inputting a first acoustic signal and performing a first pitch shift process on the first acoustic signal in a first signal processing unit, inputting a second acoustic signal and performing a second pitch shift process on the second acoustic signal in a second signal processing unit, cross-coupling a first effect-processed signal output from the first signal processing unit and a second effect-processed signal output from the second signal processing unit, and setting a parameter that provides continuous variation in the degree of coupling in the cross-coupling between the first effect-processed signal and the second effect-processed signal.

[0008] An audio signal processing program according to another aspect of the present invention is a program for causing a computer to execute an audio signal processing method, the program causing the computer to execute a first signal processing step in which a first audio signal is input and a first pitch shift processing step is performed on the first audio signal, a second signal processing step in which a second audio signal is input and a second pitch shift processing step is performed on the second audio signal, a cross-coupling processing step in which a first effect-processed signal output from the first signal processing step is cross-coupled with a second effect-processed signal output from the second signal processing step, and a process in which a parameter is set to continuously change the degree of coupling in the cross-coupling processing between the first effect-processed signal and the second effect-processed signal.

[0009] The present invention is also directed to a musical instrument equipped with the above-described acoustic signal processing device. [Effects of the Invention]

[0010] According to the present invention, it is possible to provide an audio signal processing device, a musical instrument, an audio signal processing method, and an audio signal processing program that enable a variety of expressions through intuitive and flexible operations by the user. [Brief explanation of the drawings]

[0011] [Figure 1] 1 is a diagram illustrating a configuration of a musical instrument according to an embodiment. [Figure 2] 1 is a block diagram showing a functional configuration of a musical instrument according to an embodiment. [Figure 3] FIG. 2 is a functional block diagram showing an acoustic signal processing unit according to the embodiment. [Figure 4] FIG. 2 is a functional block diagram showing details of an acoustic signal processing unit according to the embodiment. [Figure 5] FIG. 10 is a diagram illustrating an interface for adjusting the gain of an amplification processing unit of a cross-coupling unit. [Figure 6] 10A and 10B are diagrams illustrating the relationship of gains of the amplification processing units of the cross-coupling unit. [Figure 7] FIG. 10 is a diagram illustrating another embodiment for adjusting the gain of the amplification processing section of the cross-coupling section. DETAILED DESCRIPTION OF THE INVENTION

[0012] An audio signal processing device, a musical instrument, an audio signal processing method, and an audio signal processing program according to embodiments of the present invention will now be described with reference to the accompanying drawings.

[0013] {1. Instrument Composition} 1 is a schematic diagram of a musical instrument 1 equipped with an audio signal processing unit 4 according to this embodiment. The musical instrument 1 includes a keyboard 111, a control unit 2, and a user interface (user IF) 3. The control unit 2 includes an audio signal processing unit 4. In this embodiment, the musical instrument 1 is an electronic keyboard instrument equipped with the keyboard 111.

[0014] The control unit 2 performs overall control of the musical instrument 1. When a user operates the user IF 3, various instructions are given to the control unit 2 in accordance with the operation input to the user IF 3. The audio signal processing unit 4 imparts various effects to the audio signal output by the musical instrument 1.

[0015] In this embodiment, the audio signal processing unit 4 performs processing to shift the pitch of the audio signal and processing to impart a reverb effect to the audio signal. For example, the audio signal processing unit 4 can create a fantastical, deep sound, such as a so-called shimmer reverb, by imparting a reverb effect to the pitch-shifted audio signal. The shimmer reverb can produce, for example, an effect in which the reverberation sound gradually changes to a higher pitch, an effect in which the reverberation sound gradually changes to a lower pitch, or an effect in which the reverberation sound repeatedly changes in pitch.

[0016] In this embodiment, the audio signal processing unit 4 performs cross-coupling processing to combine two systems of signals in order to further impart effects to audio signals that have already been subjected to pitch shifting and reverb effects. Here, in this specification, "cross-coupling processing" refers to inputting two systems of signals, combining (mixing) the two systems of signals, and outputting two new systems of coupled signals. In the present invention, the degree of coupling of the two systems of signals is adjusted using parameters that are continuous numerical values. Specifically, the two input systems of signals are multiplied by two types of gains according to the parameters, and the results are added together to generate a first coupled signal. Furthermore, the two input systems of signals are multiplied by two types of gains that are different (or the same) as those used to generate the first coupled signal according to the parameters, and the results are added together to output a second coupled signal.

[0017] Fig. 2 is a block diagram showing the functional configuration of the musical instrument 1. As shown in Fig. 2, the musical instrument 1 includes performance controls 11, a storage device 12, a sound source 13, a sound system 14, a control unit 2, a user IF 3, and an external interface 15. The control unit 2 includes a CPU (Central Processing Unit) 21, a RAM (Random Access Memory) 22, and a ROM (Read Only Memory) 23. The user IF 3 includes controls 31 and a display 32.

[0018] The performance controller 11 includes a keyboard 111 and is connected to the bus 20. The keyboard 111 has an arrangement of multiple keys. In this embodiment, the keyboard 111 has 88 keys. However, the number of keys that the keyboard 111 has is not limited to this. For example, the keyboard 111 may have 61 keys. The keyboard 111 of the performance controller 11 may be an image of a keyboard displayed on the screen of a touch panel display, which will be described later.

[0019] The storage device 12 includes a storage medium such as a hard disk, an optical disk, a magnetic disk, or a memory card. Computer programs such as a program PG and a control program are stored in the storage device 12. The program PG is a program for executing acoustic signal processing.

[0020] The CPU 21, RAM 22, and ROM 23 are connected via a bus 20. The RAM 22 is, for example, a volatile memory, and is used as a work area for the CPU 21, and temporarily stores various data. The ROM 23 is, for example, a nonvolatile memory, and stores various programs, setting data, etc. The CPU 21 executes programs stored in the storage device 12 or the ROM 23, using the RAM 22 as a work area.

[0021] The sound source 13 is connected to the bus 20 and outputs audio data (sound signals) based on pitches specified by operating the keyboard 111. The audio data is sampling data (e.g., PCM (Pulse Code Modulation) data) that indicates the waveform of a sound. Hereinafter, the audio data output by the sound source 13 will be referred to as sound signals. The sound source 13 stores sound signals for all pitches in advance. The sound system 14 includes a digital-to-analog (D / A) conversion circuit, an amplifier, and a speaker. The sound system 14 converts the sound signals provided by the sound source 13 into analog sound signals and generates sounds based on the analog sound signals.

[0022] The controls 31 include switches that are operated to turn on / off, switches that are operated to rotate, switches that are operated to slide, etc., and are connected to the bus 20. The controls 31 are used to perform various settings including turning the power on / off, adjusting the volume, and settings for applying various effects to the sound signals output from the musical instrument 1. The controls 31 may also be used for performance operations. The display 32 includes, for example, a liquid crystal display, and is connected to the bus 20. The display 32 displays the name of a piece of music, musical scores, or various other information. The display 32 may be a touch panel display. In this case, the keyboard 111 or some or all of the controls 31 may be displayed on the display 32. The performer can instruct various operations by operating the display 32.

[0023] The external interface 15 is an interface for connecting to an external storage medium ED or a network. The CPU 21 can access a storage medium ED such as a CD-ROM, DVD, MD, or USB storage memory via the external interface 15.

[0024] {2. Configuration of the Acoustic Signal Processing Unit} Next, the configuration of the acoustic signal processing unit 4 according to this embodiment will be described below. Fig. 3 is a block diagram showing the acoustic signal processing unit 4 according to this embodiment.

[0025] The acoustic signal processing unit 4 includes a first signal processing unit 41, a second signal processing unit 42, a cross-coupling unit 50, and delay processing units 51 and 52. The acoustic signal processing unit 4 is a functional unit realized by the CPU 21 executing a program PG stored in the storage device 12 while using hardware resources such as the RAM 22. In other words, the first signal processing unit 41, the second signal processing unit 42, the cross-coupling unit 50, and the delay processing units 51 and 52 are functional units realized by executing the program PG. The acoustic signal processing unit 4 is an example of an acoustic signal processing device according to the present invention.

[0026] Fig. 4 is a block diagram illustrating in more detail the acoustic signal processing unit 4 according to the embodiment. Fig. 4 shows functional blocks for explaining the processing flow of the first signal processing unit 41, the second signal processing unit 42, and the cross-coupling unit 50.

[0027] The acoustic signal processing unit 4 includes a first signal processing unit 41, a second signal processing unit 42, delay processing units 51 and 52, and a cross-coupling unit 50. The first signal processing unit 41 includes an addition processing unit 411, a first A acoustic processing unit 412, a pitch shift processing unit 413, and a first B acoustic processing unit 414. The second signal processing unit 42 includes an addition processing unit 421, a second A acoustic processing unit 422, a pitch shift processing unit 423, and a second B acoustic processing unit 424. The cross-coupling unit 50 includes amplification processing units 531, 532, 533, and 534, and addition processing units 55 and 56.

[0028] The addition unit 411 of the first signal processing unit 41 adds the first acoustic signal SD1 output from the sound source 13 and the first coupling signal CP1 output from the cross-coupling unit 50. The first-A acoustic processing unit 412 of the first signal processing unit 41 performs first-A acoustic processing on the acoustic signal output from the addition unit 411. The first-A acoustic processing includes, for example, reverb processing, high-pass filtering, low-pass filtering, equalizer processing, and delay processing. The pitch shift processing unit 413 of the first signal processing unit 41 performs pitch shift processing on the acoustic signal output from the first-A acoustic processing unit 412. The first-B acoustic processing unit 414 of the first signal processing unit 41 performs first-B acoustic processing on the acoustic signal output from the pitch shift processing unit 413. The first-B acoustic processing includes, for example, reverb processing, high-pass filtering, low-pass filtering, equalizer processing, and delay processing. In this way, the first signal processing unit 41 performs effect processing, including pitch shift processing, on the first acoustic signal SD1.

[0029] The addition unit 421 of the second signal processing unit 42 adds the second acoustic signal SD2 output from the sound source 13 and the second coupling signal CP2 output from the cross-coupling unit 50. The second-A acoustic processing unit 422 of the second signal processing unit 42 performs second-A acoustic processing on the acoustic signal output from the addition unit 421. The second-A acoustic processing includes, for example, reverb processing, high-pass filtering, low-pass filtering, and equalization. The pitch shift processing unit 423 of the second signal processing unit 42 performs pitch shift processing on the acoustic signal output from the second-A acoustic processing unit 422. The second-B acoustic processing unit 424 of the second signal processing unit 42 performs second-B acoustic processing on the acoustic signal output from the pitch shift processing unit 423. The second-B acoustic processing includes, for example, reverb processing, high-pass filtering, low-pass filtering, and equalization. In this way, the second signal processing unit 42 performs effect processing, including pitch shift processing, on the second acoustic signal SD2.

[0030] In this embodiment, the 1A acoustic processing unit 412 and the 2A acoustic processing unit 422 perform the same processing on the input acoustic signal. Also, in this embodiment, the 1B acoustic processing unit 414 and the 2B acoustic processing unit 424 perform the same acoustic processing on the input acoustic signal. However, the 1A acoustic processing unit 412 and the 2A acoustic processing unit 422 may perform different processing on the input acoustic signal. Also, the 1B acoustic processing unit 414 and the 2B acoustic processing unit 424 may perform different acoustic processing on the input acoustic signal. Also, the pitch shift processing unit 413 and the pitch shift processing unit 423 may perform different pitch shift processing.

[0031] In this embodiment, the first acoustic signal SD1 and the second acoustic signal SD2 are the same signal, but the first acoustic signal SD1 and the second acoustic signal SD2 may be different signals.

[0032] The first signal processing unit 41 outputs a first effect-processed signal AD1 after the effect processing to the sound system 14 and the cross-coupling unit 50. The second signal processing unit 42 outputs a second effect-processed signal AD2 after the effect processing to the sound system 14 and the cross-coupling unit 50.

[0033] The delay processing unit 51 receives the first effect-processed signal AD1 and holds it for one sample period. The delay processing unit 51 outputs the held first effect-processed signal AD1 to the amplification processing units 531 and 532 at the next sample timing. The delay processing unit 52 receives the second effect-processed signal AD2 and holds it for one sample period. The delay processing unit 52 outputs the held second effect-processed signal AD2 to the amplification processing units 533 and 534 at the next sample timing.

[0034] Amplification processing units 531 and 532 multiply the acoustic signal output from delay processing unit 51 by gains a and b, respectively, and output the gain-multiplied acoustic signals. Amplification processing units 533 and 534 multiply the acoustic signal output from delay processing unit 52 by gains c and d, respectively, and output the gain-multiplied acoustic signals.

[0035] The addition processing unit 55 adds the acoustic signal output from the amplification processing unit 531 and the acoustic signal output from the amplification processing unit 533, and outputs the added signal as a first coupling signal CP1. The addition processing unit 56 adds the acoustic signal output from the amplification processing unit 532 and the acoustic signal output from the amplification processing unit 534, and outputs the added signal as a second coupling signal CP2.

[0036] In the acoustic signal processing unit 4 configured as described above, the first signal processing unit 41 performs effect processing, including acoustic processing 1A, pitch shift processing, and acoustic processing 1B, on the first acoustic signal SD1. In parallel, the second signal processing unit 42 performs effect processing, including acoustic processing 2A, pitch shift processing, and acoustic processing 2B, on the second acoustic signal SD2. The first effect-processed signal AD1 output from the first signal processing unit 41 and the second effect-processed signal AD2 output from the second signal processing unit 42 are cross-coupled in the cross-coupling unit 50 after the degree of coupling is adjusted using gains a, b, c, and d. The first coupling signal CP1 is then fed back to the first signal processing unit 41 and added to the first acoustic signal SD1 output from the sound source 13. The second coupling signal CP2 is fed back to the second signal processing unit 42 and added to the second acoustic signal SD2 output from the sound source 13. In this way, the cross-coupling process and the feedback process are repeated on the signals that have been effect-processed in the first signal processing section 41 and the second signal processing section 42.

[0037] {3. Adjusting the degree of bonding} Next, a method for adjusting the degree of coupling in the cross-coupling unit 50 will be described with reference to Fig. 5 and Fig. 6. Fig. 5 is a diagram showing a user interface for adjusting the gains of the amplification processing units 531 to 534 of the cross-coupling unit 50. Fig. 6 is a diagram showing the relationship between the gains of the amplification processing units 531 to 534 of the cross-coupling unit 50.

[0038] As shown in FIG. 5, a setting screen 33 for the cross-coupling process is displayed on the display 32. An operation interface including the setting screen 33 is generated by executing a program stored in the storage device 12 or the ROM 23. This program may be included in the program PG. The user operates the controls 31 on the setting screen 33 displayed on the display 32 to input a parameter indicating the degree of coupling in the cross-coupling process. As shown in FIG. 5, the user can set the parameter indicating the degree of coupling using a continuous numerical value. In the example shown, the user can set a numerical value in the range of 0.000 to 1.000, up to three decimal places.

[0039] When parameters are input to the setting screen 33 by operating the controls 31, the parameter setting unit 25 of the control unit 2 receives the input parameters. The parameter setting unit 25 is generated by executing a program stored in the storage device 12 or the ROM 23. This program may be included in the program PG. The parameter setting unit 25 sets gains a, b, c, and d of the amplification processing units 531 to 534 of the acoustic signal processing unit 4 in accordance with the input parameters. The amplification processing units 531 to 534 are configured to vary their respective gains in response to instructions from the parameter setting unit 25.

[0040] The parameter setting unit 25 sets the gains a, b, c, and d of the amplification processing units 531 to 534 so that they become matrix elements of a rotation matrix with a rotation angle θ as shown in Fig. 6. As a result, the cross coupling unit 50 outputs the following as the first coupling signal CP1: CP1=a·AD1+c·AD2=cosθ·AD1-sinθ·AD2 and As the second coupling signal CP2, CP2=b・AD1+d・AD2=sinθ・AD1+cosθ・AD2 Output.

[0041] In the configuration of FIG. 4, in the above equations, AD1 and AD2 are signals one sample before CP1 and CP2.

[0042] When the user sets the parameter to 0.000 on the setting screen 33, the rotation angle θ is set to 0°. As a result, the cross-coupling unit 50 outputs AD1 as the first coupling signal CP1 with a delay of one sample, and outputs AD2 as the second coupling signal CP2 with a delay of one sample. In other words, the signals output from the first signal processing unit 41 and the second signal processing unit 42 are fed back respectively without being combined (distributed).

[0043] When the user sets the parameter to 1.000 on the setting screen 33, the rotation angle θ is set to 90°. As a result, the cross-coupling unit 50 outputs −AD2 as the first coupling signal CP1 with a delay of one sample, and outputs AD1 as the second coupling signal CP2 with a delay of one sample. In other words, the signals output from the first signal processing unit 41 and the second signal processing unit 42 are completely cross-fed back.

[0044] When the user sets a parameter to any value between 0.000 and 1.000 on the setting screen 33, a rotation angle of 0°<θ<90° is set, and the degree of coupling (degree of distribution) of the signals output from the first signal processing unit 41 and the second signal processing unit 42 is adjusted accordingly.

[0045] As described above, the audio signal processing unit 4 of this embodiment is configured so that the user can freely set the gains of the amplification processing units 531 to 534, allowing the user to freely adjust the degree of coupling of the cross-coupling unit 50. This allows the user to freely mix the feedback signals of the first effect-processed signal AD1, which has been pitch-shifted in the first signal processing unit 41, and the second effect-processed signal AD2, which has been pitch-shifted in the second signal processing unit 42, according to the user's preferences, thereby outputting an audio signal to which an effect has been applied according to the user's preferences. As described above, the user can set the degree of coupling of the cross-coupling process using continuous numerical values, allowing the user to intuitively set the cross-coupling process in detail according to the user's preferences. For example, unlike discrete settings such as turning an effect on / off or changing the mode, the effect can be continuously changed by setting numerical values. This allows the effect to be changed in real time, even during real-time performance, for example.

[0046] Furthermore, reverb processing can be performed in the first-A sound processing unit 412 or the first-B sound processing unit 414, and reverb processing can be performed in the second-A sound processing unit 422 or the second-B sound processing unit 424. In this case, the feedback signals of the first effect-processed signal AD1 that has been reverb-processed and pitch-shifted in the first signal processing unit 41 and the second effect-processed signal AD2 that has been reverb-processed and pitch-shifted in the second signal processing unit 42 can be freely mixed according to the user's preferences. This makes it possible to output an audio signal with a shimmer reverb effect that suits the user's preferences. As described above, the user can set the degree of cross-coupling processing using continuous numerical values, allowing the user to intuitively set the shimmer reverb effect in detail according to their preferences.

[0047] {4. Other Embodiments} 5, the user operates the controls 31 to freely input cross-coupling parameters into the setting screen 33, thereby adjusting the degree of coupling in the cross-coupling processing. Alternatively, if the display 32 is a touch panel display as described above, the performer can input the cross-coupling parameters by operating a GUI displayed on the display 32. In another embodiment, the parameter setting unit 25 may set the gains a, b, c, and d using a parameter data set PD that is prepared in advance.

[0048] 7 is a diagram showing a parameter setting method according to another embodiment. A parameter dataset PD is stored in the storage device 12. The parameter dataset PD is data in which parameters indicating the degree of coupling in the cross-coupling process are set. The parameter setting unit 25 reads the parameter dataset PD from the storage device 12, and sets the gains a, b, c, and d of the amplification processing units 531 to 534 in accordance with the parameters set in the parameter dataset PD.

[0049] In the above embodiment, the pitch shift processing is arranged in the forward section of the feedback loop processing. In another embodiment, the pitch shift processing may be arranged in the feedback section of the feedback loop processing. In other words, either or both of the pitch shift processing section 413 and the pitch shift processing section 423 may be arranged in the feedback section of the feedback loop.

[0050] In the above embodiment, the cross-coupling processing is arranged in a feedback section within the feedback loop processing. In another embodiment, the cross-coupling processing may be arranged in a forward section within the feedback loop processing. When the pitch shift processing and the cross-coupling processing are both arranged in the forward section, the pitch-shifted signals of the two systems are swapped.

[0051] In the above embodiment, adjusting the degree of cross-coupling processing allows the user to fine-tune the shimmer reverb effect, for example, to suit their preferences. As an example of application of the present invention, the cross-coupling unit 50 according to the present invention may be applied to a voice changer. For example, by inputting a user's voice signal as a first audio signal SD1 and a second audio signal SD2 and processing them in an audio signal processing unit 4 equipped with the cross-coupling unit 50 according to the present invention, voice conversion with high privacy protection performance can be achieved. In this case, privacy protection performance can be further improved by randomly changing the gains of the amplification processing units 531 to 534 over time. Here, directly randomly changing the gains a, b, c, and d of the amplification processing units 531 to 534 may cause the feedback signal to diverge. However, by randomly changing the rotation angle θ, the gains a, b, c, and d can be indirectly changed randomly within a range of values ​​less than 1. Since the degree of cross-coupling processing can be set using continuous values, the degree of cross-coupling processing can be changed over time during playback of the input audio signal. For example, the parameter dataset PD may include parameters that are randomly changed over time. Alternatively, the input speech signal may be provided as a parameter to the parameter setting unit 25. For example, the speech signal may be determined to be a vowel or a consonant, and appropriate parameters may be set. By preparing a data set of parameters according to the vowel / consonant determination result in the parameter data set PD, parameters according to the determination result may be selected. Alternatively, features may be extracted from the input speech signal, and parameters may be set using a randomization method according to the features.

[0052] In the above embodiment, the gains a, b, c, and d have a relationship using a rotation matrix as shown in Fig. 6. In another embodiment, a transpose of the rotation matrix may be used. Alternatively, a method may be used in which the first coupling signal CP1 and the second coupling signal CP2 are simply added together without using a rotation matrix, and the gain is reduced where the norm exceeds 1.

[0053] In the above embodiment, the acoustic signal processing unit 4 includes a 1A acoustic processing unit 412, a 1B acoustic processing unit 414, a 2A acoustic processing unit 422, and a 2B acoustic processing unit 424, but some or all of these processing units may be bypass processing units (through processing units) that pass the signal through as is.

[0054] In the above embodiment, the delay processing units 51 and 52 are arranged immediately before the cross-coupling unit 50, but this is not limiting. The delay processing units 51 and 52 may be arranged in other positions. Alternatively, the delay processing unit 51 may be included in any of the 1A acoustic processing unit 412, the pitch shift processing unit 413, or the 1B acoustic processing unit 414. The delay processing unit 52 may be included in any of the 2A acoustic processing unit 422, the pitch shift processing unit 423, or the 2B acoustic processing unit 424.

[0055] In the above embodiment, the first coupling signal CP1 is fed back to the first signal processing unit 41 in the addition processing unit 411, and the second coupling signal CP2 is fed back to the second signal processing unit 42 in the addition processing unit 421. The positions at which the first coupling signal CP1 and the second coupling signal CP2 are fed back are not limited to this embodiment. The first coupling signal CP1 and the second coupling signal CP2 may be fed back at any position in the first signal processing unit 41 or the second signal processing unit 42.

[0056] In the above embodiment, the program PG is stored in the storage device 12. In another embodiment, the program PG may be provided by being stored in a storage medium ED. The CPU 21 may access the storage medium ED via the external interface 15 and store the program PG stored in the storage medium ED in the storage device 12 or the ROM 23. Alternatively, the CPU 21 may access the storage medium ED via the external interface 15 and execute the program PG stored in the storage medium ED. Alternatively, the CPU 21 may download the program PG from a server on a network via a communication interface and store the downloaded program PG in the storage device 12 or the ROM 23. Alternatively, the CPU 21 may directly execute the program PG stored in a server on the network via the communication interface.

[0057] {5. Features and Effects of the Embodiments} (1) An audio signal processing device according to one embodiment of the present invention includes a first signal processing unit 41 that receives a first audio signal SD1 and performs a first pitch shift process on the first audio signal SD1, a second signal processing unit 42 that receives a second audio signal SD2 and performs a second pitch shift process on the second audio signal SD2, a cross-coupling unit 50 that cross-couples a first effect-processed signal AD1 output from the first signal processing unit 41 and a second effect-processed signal AD2 output from the second signal processing unit 42, and a parameter setting unit 25 that sets a parameter in the cross-coupling unit 50 that continuously changes the degree of coupling between the first effect-processed signal AD1 and the second effect-processed signal AD2.

[0058] The degree of coupling between the first effect-processed signal AD1 and the second effect-processed signal AD2 can be flexibly changed.

[0059] (2) The acoustic signal processing device described in (1) above may further include a user interface for inputting user instructions to the parameter setting unit 25.

[0060] The degree of coupling between the first effect-processed signal AD1 and the second effect-processed signal AD2 can be flexibly changed by user operation, allowing the user to intuitively control the degree of coupling between the outputs of the two systems.

[0061] (3) In the acoustic signal processing device described in (1) above, the parameter setting unit 25 may set the parameters in the cross-coupling unit 50 based on a parameter data set in which the parameters are set.

[0062] The degree of coupling between the first effect-processed signal AD1 and the second effect-processed signal AD2 can be flexibly changed based on the set parameter data set.

[0063] (4) In the acoustic signal processing device described in (1) above, the first signal processing unit 41 and the second signal processing unit 42 may each include a reverb processing unit.

[0064] In an audio signal processing device that combines pitch shift and reverb, it is possible to flexibly change the degree of coupling between the first effect-processed signal AD1 and the second effect-processed signal AD2.

[0065] (5) In the acoustic signal processing device described in (1) above, the first signal processing unit 41 and the second signal processing unit 42 may each include a feedback processing unit.

[0066] In an audio signal processing device that combines pitch shift and reverb, it is possible to flexibly change the degree of coupling between the first effect-processed signal AD1 and the second effect-processed signal AD2.

[0067] (6) In the acoustic signal processing device described in (1) above, the cross-coupling unit 50 may include rotation matrix processing, and the parameter setting unit 25 may set matrix elements of the rotation matrix using parameters.

[0068] By setting the matrix elements of the rotation matrix, it is possible to flexibly change the degree of coupling between the first effect-processed signal AD1 and the second effect-processed signal AD2.

[0069] (7) In the acoustic signal processing device described in (1) above, the first signal processing unit 41 and the second signal processing unit 42 may perform the same signal processing on the input acoustic signal.

[0070] It is possible to flexibly change the degree of coupling between the first effect-processed signal AD1 and the second effect-processed signal AD2 output from the same two signal processing units.

[0071] In the acoustic signal processing device described in (5) above, the processing unit that performs the pitch shift may be disposed in a forward unit within the feedback loop processing.

[0072] In the acoustic signal processing device described in (5) above, the processing unit that performs the pitch shift may be disposed in a feedback unit within the feedback loop processing.

[0073] In the acoustic signal processing device described in (5) above, the cross-coupling unit 50 may be disposed in a forward unit within the feedback loop processing.

[0074] In the acoustic signal processing device described in (5) above, the cross-coupling unit 50 may be disposed in a feedback unit within the feedback loop processing.

[0075] (8) A musical instrument according to another aspect includes the acoustic signal processing device according to any one of (1) to (7) above.

[0076] (9) An acoustic signal processing method according to another aspect of the present invention includes inputting a first acoustic signal SD1 and performing a first pitch shift process on the first acoustic signal SD1 in a first signal processing unit 41; inputting a second acoustic signal SD2 and performing a second pitch shift process on the second acoustic signal SD2 in a second signal processing unit 42; cross-coupling a first effect-processed signal AD1 output from the first signal processing unit 41 and a second effect-processed signal AD2 output from the second signal processing unit 42; and setting a parameter that continuously changes the degree of cross-coupling between the first effect-processed signal AD1 and the second effect-processed signal AD2.

[0077] The degree of coupling between the first effect-processed signal AD1 and the second effect-processed signal AD2 can be flexibly changed.

[0078] (10) An audio signal processing program according to another aspect of the present invention is a program for causing a computer to execute an audio signal processing method, the program causing the computer to execute the following: first signal processing in which a first audio signal SD1 is input and a first pitch shift processing is performed on the first audio signal SD1; second signal processing in which a second audio signal SD2 is input and a second pitch shift processing is performed on the second audio signal SD2; cross-coupling processing in which a first effect-processed signal AD1 output from the first signal processing and a second effect-processed signal AD2 output from the second signal processing are cross-coupled; and processing in which a parameter is set to continuously change the degree of coupling in the cross-coupling processing of the first effect-processed signal AD1 and the second effect-processed signal AD2.

[0079] The degree of coupling between the first effect-processed signal AD1 and the second effect-processed signal AD2 can be flexibly changed.

[0080] (11) Moreover, an acoustic signal processing device according to another aspect of the present invention comprises means for carrying out the method described in (9) above.

[0081] (12) Furthermore, a computer program according to another aspect of the present invention includes instructions for causing a computer to carry out the method described in (9) above.

[0082] (13) Furthermore, a computer-readable storage medium storing a computer program according to another aspect of the present invention stores the computer program described in (12) above. [Explanation of symbols]

[0083] 4: Acoustic signal processing section 25: Parameter setting section 33: Settings screen 41: First signal processing section 42: Second signal processing section 50: Cross coupling section 51, 52: Delay processing section 55, 56: Addition processing section 411, 421: Addition processing section 413: Pitch shift processing unit 423: Pitch shift processing unit 531 to 534: Amplification processing section AD1: 1st effect processing signal AD2: Second effect processed signal CP1: 1st coupling signal CP2: Second coupling signal SD1: First sound signal SD2: Second acoustic signal

Claims

1. a first signal processing unit that receives a first acoustic signal and performs a first pitch shift process on the first acoustic signal; a second signal processing unit that receives a second acoustic signal and performs a second pitch shift process on the second acoustic signal; a cross-coupling unit that cross-couples the first effect-processed signal output from the first signal processing unit and the second effect-processed signal output from the second signal processing unit; a parameter setting unit that sets a parameter that continuously changes the degree of coupling between the first effect-processed signal and the second effect-processed signal in the cross-coupling unit; An acoustic signal processing device comprising:

2. The acoustic signal processing device according to claim 1 , further comprising a user interface for inputting user instructions to the parameter setting unit.

3. The acoustic signal processing device according to claim 1 , wherein the parameter setting unit sets the parameters in the cross-coupling unit based on a parameter data set in which the parameters are set.

4. The acoustic signal processing device according to claim 1 , wherein the first signal processing section and the second signal processing section each include a reverb processing section.

5. The acoustic signal processing device according to claim 1 , wherein the first signal processing section and the second signal processing section each include a feedback processing section.

6. The acoustic signal processing device according to claim 1 , wherein the cross-coupling unit includes a rotation matrix process, and the parameter setting unit sets matrix elements of the rotation matrix according to the parameters.

7. The acoustic signal processing device according to claim 1 , wherein the first signal processing unit and the second signal processing unit perform the same signal processing on the input acoustic signal.

8. A musical instrument comprising the acoustic signal processing device according to any one of claims 1 to 7.

9. inputting a first acoustic signal and performing a first pitch shift process on the first acoustic signal in a first signal processing unit; a second acoustic signal is input, and a second signal processing unit performs a second pitch shift process on the second acoustic signal; cross-coupling the first effect-processed signal output from the first signal processing unit and the second effect-processed signal output from the second signal processing unit; setting a parameter that continuously changes the degree of cross-coupling between the first effect-processed signal and the second effect-processed signal; An acoustic signal processing method comprising:

10. A program for causing a computer to execute an acoustic signal processing method, The program causes the computer to: a first signal processing step of inputting a first acoustic signal and performing a first pitch shift process on the first acoustic signal; a second signal processing step of inputting a second acoustic signal and performing a second pitch shift process on the second acoustic signal; a cross-coupling process for cross-coupling a first effect-processed signal output from the first signal processing and a second effect-processed signal output from the second signal processing; a process of setting a parameter that continuously changes the degree of coupling in the cross-coupling process between the first effect-processed signal and the second effect-processed signal; An acoustic signal processing program that executes the above.

Images