Sound processing device, method and computer program product

Abstract

A sound processing device, method, and computer program product. The sound processing device comprises: a sound data output unit that mixes, for each of a plurality of output channels, first sound output data with one or more types of second sound output data for adding an acoustic effect to the first sound output data, thereby outputting third sound output data; a crosstalk processing unit that performs crosstalk processing between the first sound output data and the second sound output data, or between the second sound output data and the third sound output data, for each of the plurality of output channels; and a crosstalk control unit that causes the crosstalk processing unit to perform the crosstalk processing so that, in the third sound output data, the ratio of crosstalk between the plurality of output channels caused by components of the second sound output data is smaller than the ratio of crosstalk between the plurality of output channels caused by components of the first sound output data.

Description

Technical Field

[0001] The present invention relates to a sound processing device, method, and computer program product capable of mixing and outputting original sound and effect sound. Background Art

[0002] The following prior art technology is known: when listening to data recorded by multiple microphones and mixed down to, for example, two-channel stereo through headphones, in order to reduce the unnatural feeling caused by crosstalk and reflection components when there are no speakers to reproduce, crosstalk is simulated by applying signals of opposite channels to each other (for example, Japanese Patent Publication No. 2017-126944 and Japanese Patent Publication No. 09-198056).

[0003] In an audio processing device, such as an electronic musical instrument, a sound diffusion effect is achieved by mixing the directly output instrument sound (hereinafter referred to as "direct sound") with the effect sound (hereinafter referred to as "indirect sound") using a mixer and outputting it as musical sound output data. The effect sound is obtained by adding reverberation effects such as reverberation and resonance effects to the direct sound. Summary of the Invention

[0004] In one embodiment, the present invention includes: an audio data output unit that mixes, for each of a plurality of output channels, first audio output data with one or more types of second audio output data for adding an acoustic effect to the first audio output data, thereby outputting third audio output data; a crosstalk processing unit that performs crosstalk processing between the first audio output data and the second audio output data, or between the second audio output data and the third audio output data, on the plurality of output channels; and a crosstalk control unit that causes the crosstalk processing unit to perform crosstalk processing so that, in the third audio output data, a ratio of crosstalk between the plurality of output channels of a component of the second audio output data is smaller than a ratio of crosstalk between the plurality of output channels of a component of the first audio output data. BRIEF DESCRIPTION OF THE DRAWINGS

[0005] Figure 1 This is a block diagram showing an example of the hardware configuration of an electronic musical instrument.

[0006] Figure 2 This is a block diagram showing a configuration example of a sound source and an effect adding unit in the first embodiment.

[0007] Figure 3 This is a block diagram showing a configuration example centered around the indirect audio crosstalk processing unit in the first embodiment.

[0008] Figure 4 It is a diagram showing a configuration example of crosstalk setting table data in the first embodiment.

[0009] Figure 5 This is a flowchart showing a processing example of the crosstalk control unit in the first embodiment.

[0010] Figure 6 This is a flowchart showing a detailed example of the indirect audio crosstalk setting process or the direct audio crosstalk setting process in the first embodiment.

[0011] Figure 7 This is a block diagram showing a configuration example of a sound source and an effect adding unit in the second embodiment.

[0012] Figure 8 This is a block diagram showing a configuration example centered around an indirect audio crosstalk processing unit and an output audio crosstalk processing unit in the second embodiment.

[0013] Figure 9 It is a diagram showing a configuration example of a crosstalk setting table data group in the third embodiment.

[0014] Figure 10 This is a flowchart showing an example of the indirect audio crosstalk setting process or the direct audio crosstalk setting process in the third embodiment.

[0015] Figure 11 This is a block diagram showing a configuration example of a sound source and an effect adding unit in the fourth embodiment.

[0016] Figure 12 This is a block diagram showing a configuration example centered around an indirect audio crosstalk processing unit and an output audio crosstalk processing unit in the fourth embodiment. DETAILED DESCRIPTION

[0017] Hereinafter, a mode for implementing the present disclosure will be described in detail with reference to the accompanying drawings. Figure 1 This is a block diagram showing an example of an embodiment of an electronic musical instrument 100 to which the first to fourth embodiments described below are applied. The electronic musical instrument 100 has the following configuration: a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, a tone generator (TG) 104, an effect applying unit 105, a keyboard 106, a pedal 107, and an operating element 108 are connected to a system bus 109. Furthermore, the output of the tone generator (TG) 104 is connected to a sound system 110 via the effect applying unit 105.

[0018] The CPU 101 issues a sound generation instruction to the sound source 104 based on the music playing operation information from the keyboard 106 and the operating element 108 by executing a control program loaded from the ROM 102 to the RAM 103 .

[0019] In accordance with the aforementioned sound generation instructions, the sound source (TG) 104 reads waveform data from a waveform ROM (not specifically shown) to generate musical sound data. This musical sound data is output to the sound system 110 via the effect applying unit 105, which is, for example, a signal processor (DSP). The effect applying unit 105 applies effects to the musical sound data, such as reverberation, or the resonance of piano strings when the pedal 107 is depressed. The musical sound data output from the effect applying unit 105 is converted into an analog musical sound signal by a digital-to-analog converter in the sound system 110, amplified by an analog amplifier, and then emitted from the speakers.

[0020] Figure 2 This is a block diagram of the sound source (TG) 104 and the effect imparting unit 105 in the first embodiment, showing Figure 1 The sound source (TG) 104 has a sound generating section 201 (CH1) to 201 (CHn) for generating sound data for n channels of CH1 to CHn, which are generated by pressing keys on the keyboard 106. Figure 1 In response to the sound generation instruction from CPU 101, independent musical sound data is generated for each key. The musical sound generation unit 201 (CHi) (1≤i≤n) corresponding to the sound generation channel CHi includes a waveform generation unit WG.CHi for generating waveform data; a filter processing unit TVF.CHi for processing the timbre of the generated waveform data; and an amplifier envelope processing unit TVA.CHi for processing the amplitude envelope of the generated waveform data.

[0021] The first sound source mixer units 203 (Lch) and 203 (Rch) within the mixing unit 202 multiply the musical sound data output by the musical sound generating units 201 (CHi) (1≤i≤n) for the respective sound sound channels (CHi) by predetermined levels and then integrate and mix the resulting data. This generates Lch direct sound output data 205 (Lch) and Rch direct sound output data 205 (Rch) for the Lch (left channel) and Rch (right channel) output channels, respectively, and outputs these data to the effect applying unit 105. The Lch and Rch direct sound output data 205 are examples of first sound output data.

[0022] Similarly, the second sound source mixer sections 204 (Lch) and 204 (Rch) in the mixing section 202 respectively multiply the musical sound data output by the musical sound generating sections 201 (CHi) (1≤i≤n) of the respective sound producing channels (CHi) by a prescribed level and then accumulate and mix them, thereby generating Lch indirect sound input data 206 (Lch) and Rch indirect sound input data 206 (Rch) for Lch (left channel) and Rch (right channel), and inputting them into the Lch reverberation / resonance section 210 (Lch) and Rch reverberation / resonance section 210 (Rch) in the effect imparting section 105, respectively.

[0023] In addition, Figure 2 In the example, the symbols "*" and "∑" within the first sound source mixer units 203 (Lch) and 203 (Rch), and the second sound source mixer units 204 (Lch) and 204 (Rch), indicate that the input data is multiplied by a predetermined level, integrated, and output. In this case, the sound channels generated within the sound source (TG) 104 are mixed into the left and right output channels (Lch and Rch) of the stereophonic system.

[0024] After the Lch indirect sound input data 206 (Lch) and the Rch indirect sound input data 206 (Rch) are respectively input to the effect applying unit 105, the Lch reverberation / resonance unit 210 (Lch) and the Rch reverberation / resonance unit 210 (Rch) implemented by the DSP processing of the effect applying unit 105 impart reverberation / resonance effects to the Lch and Rch, respectively. Furthermore, the indirect sound crosstalk processing unit 208 performs crosstalk processing between the Lch and Rch indirect sounds outputted by these units, and outputs Lch indirect sound output data 211 (Lch) and Rch indirect sound output data 211 (Rch). The Lch and Rch indirect sound output data 211, respectively, are examples of second sound output data. Furthermore, in the effect imparting section 105, the final stage mixer section 207 (Lch) mixes the Lch indirect sound output data 211 (Lch) with the Lch direct sound output data 205 (Lch) output from the first sound source mixer section 203 (Lch) in the sound source (TG) 104, thereby outputting the Lch musical sound output data 212 (Lch) to the sound source (TG) 104. Figure 1 Similarly, in the effect imparting section 105, the final stage mixer section 207 (Rch) mixes the Rch indirect sound output data 211 (Rch) with the Rch direct sound output data 205 (Rch) output from the first sound source mixer section 203 (Rch) in the sound source (TG) 104, thereby outputting the Rch musical sound output data 212 (Rch) to the sound source (TG) 104. Figure 1The musical sound output data 212 of each of Lch and Rch is an example of the third sound output data.

[0025] The audio system 110 digitally / analog-converts the Lch musical sound output data 212 (Lch) and the Rch musical sound output data 212 (Rch) into Lch analog musical sound signals and Rch analog musical sound signals, respectively, amplifies the Lch analog musical sound signals and the Rch analog musical sound signals using analog amplifiers, and plays the amplified outputs from the speakers of Lch and Rch.

[0026] The Lch reverb / resonance section 210 (Lch) and the Rch reverb / resonance section 210 (Rch), for example, each provide a reverb effect and a resonance effect by convolving the Lch or Rch indirect sound input data 206 (Lch or Rch) with a direct sound impulse response, as part of the DSP processing that constitutes the effect imparting section 105. The specific configurations of the Lch reverb / resonance section 210 (Lch) and the Rch reverb / resonance section 210 (Rch) can be configured to perform convolution operations of arbitrary lengths by combining an FIR filter that performs the convolution in the time domain with an FFT / iFFT (Fast Fourier Transform / inverse FFT) that performs the convolution in the frequency domain. The specific configurations can employ the techniques described in the following patent documents, for example, and therefore their detailed disclosure is omitted.

[0027] Patent document: Japanese Patent Application Laid-Open No. 2018-151589

[0028] Figure 3 Yes Figure 2 The block diagram of the configuration example of the indirect audio crosstalk processing unit 208 in the configuration of the first embodiment is shown. Figure 2 However, in the first embodiment, by changing the signal path within the DSP constituting the effect imparting section 105, it is configured on each output side of the Lch reverberation / resonance section 210 (Lch) and the Rch reverberation / resonance section 201 (Rch).

[0029] like Figure 3As shown, in the indirect sound crosstalk processing unit 208, the output data of the Lch reverberation / resonance unit 210 (Lch) is multiplied by A (A is a real number) times by the crosstalk multiplier 301 (Lch), and the sign of the multiplication result is inverted and input to the crosstalk adder 302 (Rch). Similarly, the output data of the Rch reverberation / resonance unit 201 (Rch) is multiplied by A times by the crosstalk multiplier 301 (Rch), and the sign of the multiplication result is inverted and input to the crosstalk adder 302 (Lch). The crosstalk adder 302 (Lch) subtracts the multiplication result of the crosstalk multiplier 301 (Rch) from the output data of the Lch reverberation / resonance section 210 (Lch). The subtraction result is multiplied by b (b is a real number) times by the crosstalk output multiplier 303 (Lch). The multiplication result is output as the Lch indirect sound output data 211 (Lch) and input to the Figure 2 Similarly, the crosstalk adder 302 (Rch) subtracts the multiplication result of the crosstalk multiplier 301 (Lch) from the output data of the Rch reverberation / resonance section 210 (Rch). The subtraction result is multiplied by b times by the crosstalk output multiplier 303 (Rch). The multiplication result is output as the Rch indirect sound output data 211 (Rch) and input to the Figure 2 The final stage mixer section 207 (Rch).

[0030] exist Figure 3 In the indirect audio crosstalk processing unit 208, by Figure 1 The processing function of CPU101 Figure 2 The crosstalk control unit 209 sets the multiplication value A in the crosstalk multipliers 301 (Lch) and 301 (Rch), and the multiplication value b in the crosstalk output multipliers 303 (Lch) and 303 (Rch), respectively, to determine the ratio of the crosstalk between the Lch indirect sound output data 211 (Lch) and the Rch indirect sound output data 212.

[0031] On the other hand, Figure 2 In the structure of the first embodiment, crosstalk processing is also performed on the Lch direct sound output data 205 (Lch) and the Rch direct sound output data 205 (Rch) input from the sound source (TG) 104 to the effect applying unit 105. Even if a dedicated crosstalk processing unit is not provided, this crosstalk processing can be replaced by parameter settings from the crosstalk control unit 209 to the first sound source mixer units 203 (Lch) and 203 (Rch) in the sound source (TG) 104. The first sound source mixer units 203 (Lch) and 203 (Rch) have Figure 3Therefore, the structure of the crosstalk processing of the first mixer units 203 (Lch) and 203 (Rch) on the Lch direct sound output data 205 (Lch) and the Rch direct sound output data 205 (Rch) is the same as that of the first mixer units 203 (Lch) and 203 (Rch). Figure 3 The functional structure of the indirect audio crosstalk processing unit 208 is the same as that of the indirect audio crosstalk processing unit 208 shown in FIG. However, the multiplication results of the multiplication functions of the crosstalk multipliers 301 (Lch) and 301 (Rch) are the same as those of the indirect audio crosstalk processing unit 208 shown in FIG. Figure 3 Unlike the case of , the sign is not inverted and input to the addition function equivalent to the crosstalk adder 302 (Lch) and 302 (Rch). In addition, the multiplication value set by the crosstalk control unit 209 in the first mixer unit 203 (Lch) and 203 (Rch) is different from Figure 3 The combination of A and b shown is different, for example, it is set to a (a is a real value different from or the same as A) times. In addition, the first mixer sections 203 (Lch) and 203 (Rch) do not have the same Figure 3 The crosstalk output multipliers 303 (Lch) and 303 (Rch) correspond to the function, which is unnecessary.

[0032] In the configuration of the first embodiment described above, the crosstalk control unit 209 sets the multiple values ​​A, b, and a so that Figure 3 The ratio of the crosstalk set to the multiple values ​​A and b in the indirect sound crosstalk processing unit 208 relative to the Lch indirect sound output data 211 (Lch) and the Rch indirect sound output data 211 (Rch) is greater than that in Figure 2 In the first mixer units 203 (Lch) and 203 (Rch), the ratio of the crosstalk set to the multiplier value a with respect to the Lch direct sound output data 207 and the Rch direct sound output data 205 (Rch) is small.

[0033] Figure 4 is stored in Figure 1 FIG. 1 is a diagram showing an example of the structure of the crosstalk setting table data in the first embodiment in the ROM 102. Figure 4 The following is shown in the figure: The items of "CH1" and "CH2" are in Figure 2 In the sound source (TG) 104, in order to generate Figure 2 The effect imparting unit 105 outputs the Figure 1 The stereo Lch musical sound output data 212 (Lch) and Rch musical sound output data 212 (Rch) of the sound system 110 use two sound channels (CHi) (i=1, 2) of "CH1" and "CH2" in the sound source (TG) 104, and use Figure 2The musical tone generating parts 201 (CH1) and 201 (CH2) are as follows. Figure 4 In the figure, the percentage values ​​in the "Direct Sound Lch" row and the "Direct Sound Rch" row respectively indicate the magnification values ​​corresponding to the Lch direct sound output data 205 (Lch) and the Rch direct sound output data 205 (Rch) (the actual value is the percentage value divided by 100). The percentage values ​​in the "Indirect Sound Lch" row and the "Indirect Sound Rch" row respectively indicate the magnification values ​​corresponding to the Lch indirect sound output data 211 (Lch) and the Rch indirect sound output data 211 (Rch), which are indirect sounds. Furthermore, the percentage values ​​in the "Effect Off (Normal Operation)" column indicate the magnification values ​​when crosstalk processing is not performed on both direct and indirect sounds, and the percentage values ​​in the "Effect On" column indicate the magnification values ​​when crosstalk processing is performed on both direct and indirect sounds.

[0034] exist Figure 4 In the row of direct sound Lch of CH1, the following situation is shown: as the output of the pronunciation channel CH1, when the effect is turned on and when the effect is turned off, a value of 100% 1 is set as the multiplication value in the multiplier of CH1 input to the first mixer section 203 (Lch), and the musical sound waveform data generated by the musical sound generating section 201 (CH1) through the multiplier should be directly output as Lch direct sound output data 205 (Lch).

[0035] In addition, Figure 4 In the row for the direct sound Rch of CH1, the following is shown: When the effect is on, the multiplier for CH1 input to the first mixer section 203 (Rch) is set to a value of 0.2, which is 20%, as the multiplier value. This indicates that the musical sound waveform data generated by the musical sound generating section 201 (CH1) via this multiplier should be crosstalked with the Rch direct sound output data 205 (Rch) at a ratio of 0.2. On the other hand, when the effect is off, the multiplier for CH1 input to the first mixer section 203 (Rch) is set to a value of 0, which is 0%, as the multiplier value. This indicates that the musical sound waveform data generated by the musical sound generating section 201 (CH1) via this multiplier should not be crosstalked with the Rch direct sound output data 205 (Rch).

[0036] And, in Figure 4 In the row of the indirect sound Lch of CH1, the following is shown: as the output of the sound channel CH1, when the effect is on and when the effect is off, Figure 2 as well as Figure 3The indirect sound crosstalk processing unit 208 sets the value of 40% as 0.4 as the multiplication value, and the sound waveform data generated by the sound generating unit 201 (CH1) should be output to the Lch indirect sound output data 211 (Lch) at a ratio of 0.4. Specifically, for example, Figure 3 The magnification value A is set to 0 in the crosstalk multiplier 301 (Rch), and the magnification value b is set to 0.4 in the crosstalk output multiplier 303 (Lch).

[0037] In addition, Figure 4 In the row of indirect sound Rch of CH1, the following is shown: as the output of the sound channel CH1, when the effect is on and when the effect is off, Figure 2 as well as Figure 3 The indirect sound crosstalk processing unit 208 sets the value 0 of 0% as the multiplication value, and the musical sound waveform data generated by the musical sound generating unit 201 (CH1) is not crosstalked. Therefore, specifically, for example, in Figure 3 The magnification value A is set to 0 in the crosstalk multiplier 301 (Rch), and the magnification value b is set to 0.4 in the crosstalk output multiplier 303 (Lch).

[0038] Then, in Figure 4 In the example above, the setting values ​​for the row of direct sound Lch and the row of direct sound Rch for CH2 are opposite to those for CH1, with the setting values ​​for the row of direct sound Rch for CH1 and the setting values ​​for the row of direct sound Lch for CH1 being set separately. Specifically, for example, the row of direct sound Rch for CH2 shows that, as the output of sound channel CH2, the multiplier for CH2 input to the first mixer section 203 (Rch) is set to 100% as the multiplication value, both when the effect is on and when the effect is off. The musical tone waveform data generated by the musical tone generating section 201 (CH2) via this multiplier is output directly as Rch direct tone output data 205 (Rch). Furthermore, the row for the direct sound Lch of CH2 shows that, as the output of the sound channel CH2, when the effect is on, a value of 0.2, which is 20%, is set as the multiplier value in the multiplier input to CH2 of the first mixer section 203 (Lch). The musical sound waveform data generated by the musical sound generating section 201 (CH2) via this multiplier should crosstalk with the Lch direct sound output data 205 (Lch) at a ratio of 0.2. On the other hand, when the effect is off, a value of 0, which is 0%, is set as the multiplier value in the multiplier input to CH2 of the first mixer section 203 (Lch). The musical sound waveform data generated by the musical sound generating section 201 (CH2) via this multiplier setting does not crosstalk with the Lch direct sound output data 205 (Lch).

[0039] In addition, the setting values ​​of the indirect sound Lch row and the indirect sound Rch row of CH2 are also opposite to those of CH1, and are set to 0% value 0 and 40% value 0.4 respectively. Therefore, specifically, for example, Figure 3 The magnification value A is set to 0 in the crosstalk multiplier 301 (Lch), and the magnification value b is set to 0.4 in the crosstalk output multiplier 303 (Rch). In addition, the magnification value A is set to 0 in the crosstalk multiplier 301 (Rch), and the magnification value b is set to 0.4 in the crosstalk output multiplier 303 (Lch).

[0040] according to Figure 4 In the example setting shown, the crosstalk ratio between Lch direct sound output data 205 (Lch) (direct sound Lch) and Rch direct sound output data 205 (Rch) (direct sound Rch) is 20% to 100% = 0.2. Meanwhile, the crosstalk ratio between Lch indirect sound output data 211 (Lch) (indirect sound Lch) and Rch indirect sound output data 211 (Rch) (indirect sound Rch) is 0% to 40% = 0 (in this case, no crosstalk occurs). As in this example, the crosstalk ratio of indirect sound can be freely controlled so that it is smaller than the crosstalk ratio of direct sound.

[0041] Figure 5 Yes Figure 1 The flowchart of a processing example of a crosstalk control process in which the CPU 101 loads a crosstalk control program stored in the ROM 102 into the RAM 103 and executes the crosstalk control process is similar to the flowchart of a processing example of a crosstalk control process in which the CPU 101 loads a crosstalk control program stored in the ROM 102 into the RAM 103 and executes the crosstalk control process. Figure 2 The crosstalk control process is executed by the CPU 101 in a main process not shown in the figure. Figure 1 When the user operates a key on the keyboard 106, the process is called out as a subroutine and executed.

[0042] CPU101 first passes Figure 1 It is determined whether or not an instruction to turn on an effect is given by operating a switch on a switch panel (not particularly shown) of the electronic keyboard instrument 100 having a structure (step S501).

[0043] If the determination in step S501 is "yes", the CPU 101 will, for example, Figure 2 The status flag stored as a variable in RAM 203 is set to on (for example, set to a value of 1) (step S502).

[0044] If the determination in step S501 is "NO", the CPU 101 turns off the status flag (for example, sets it to a value of 0) (step S503).

[0045] After the processing of step S502 or S503, the CPU 101 executes the Figure 2 or Figure 3 The indirect audio crosstalk processing unit 208 performs indirect audio crosstalk processing with the multiplication value set (step S504).

[0046] Furthermore, the CPU 101 executes Figure 2 The first mixer 203 (Lch) and 203 (Rch) set the multiple value of the direct sound crosstalk processing (step S505). Then, the CPU 101 ends Figure 5 The crosstalk control process illustrated in the flowchart returns to the execution of the main process (not shown in the figure).

[0047] Figure 6 Yes Figure 5 Flowchart of a detailed example of the indirect audio crosstalk setting process of step S504 or the direct audio crosstalk setting process of step S505.

[0048] Until the CPU 101 determines in step S603 that the number of sound channels instructed to be sounded has been processed, that is, while the determination in step S603 is "NO," the CPU 101 repeatedly executes the processes of steps S601 and S602 for each sound channel instructed to be sounded.

[0049] First, the CPU 101 reads the Figure 4 The crosstalk setting table data shown in the example has the following multiplier value, which corresponds to the sound channel (CH1 or CH2) currently being processed and corresponds to the indirect sound (as Figure 5 step S504) or direct sound (as Figure 5 The row corresponding to the state is the same as that in step S505. Figure 5 The multiple value of the column corresponding to the status flag set in step S502 or S503 (step S601).

[0050] Then, the CPU 101 converts the multiplier value obtained in step S601 into Figure 6 As described above, set the input Figure 2 The first mixer sections 203 (Lch) and 203 (Rch) (as Figure 5 Each multiplier of the current pronunciation channel in the case of step S504 execution) or Figure 3 The crosstalk multipliers 301 (Lch) and 301 (Rch) and the crosstalk output multipliers 303 (Lch) and 303 (Rch) (as Figure 5 In the case where step S505 is executed) (step S602).

[0051] If the determination result of step S603 is "No", the CPU 101 returns to the process of step S601 and repeatedly executes the processes of steps S601 and S602. If the determination result of step S603 is "Yes", the CPU 101 ends the process. Figure 6 As shown in the flowchart Figure 5 The crosstalk setting process of the indirect sound or direct sound in step S504 or S505 is performed.

[0052] As described above, in the first embodiment, by using Figure 4 The crosstalk setting table data shown in the example Figure 5 as well as Figure 6 Crosstalk control processing is achieved Figure 2 The function of the crosstalk control unit 209 can be freely controlled so that the ratio of the crosstalk between the Lch indirect sound output data 211 (Lch) and the Rch indirect sound output data 211 (Rch) is smaller than the ratio of the crosstalk between the Lch direct sound output data 205 (Lch) and the Rch direct sound output data 205 (Rch). This can eliminate the unnatural feeling associated with the crosstalk in the Lch musical sound output data 212 (Lch) and the Rch musical sound output data 212 (Rch) without damaging the acoustic effect of the indirect sound based on the Lch reverberation / resonance section 210 (Lch) and the Rch reverberation / resonance section 201 (Rch).

[0053] In addition, Figure 2 as well as Figure 3 In the structure of the first embodiment illustrated as an example, as described above, only the conventional arrangement in the final output stage (eg Figure 2 By changing the crosstalk processing section at the output side of the final stage mixer section 207 (Lch) or 207 (Rch) to the signal path within the DSP constituting the effect imparting section 105, an indirect sound crosstalk processing section 208 can be configured at each output side of the Lch reverberation / resonance section 210 (Lch) and the Rch reverberation / resonance section 201 (Rch), and the indirect sound crosstalk processing section 208 can be utilized. Figure 2 The first mixer sections 203 (Lch) and 203 (Rch) in the sound source (TG) 104 replace the crosstalk processing on the direct sound side, and the unnatural feeling associated with the crosstalk that was a problem in the conventional technology can be eliminated without significantly changing the conventional hardware structure.

[0054] As another embodiment related to the first embodiment described above, the following structure may also be adopted: Figure 2 If the Lch reverberation / resonance section 210 (Lch) and the Rch reverberation / resonance section 210 (Rch) have a function of adjusting the output level at their output stages, Figure 3The functions of the crosstalk output multipliers 303 (Lch) and 303 (Rch) in the indirect sound crosstalk processing unit 208 are replaced by the above-mentioned output level adjustment function, and Figure 3 The functions of the crosstalk multipliers 301 (Lch) and 301 (Lch) and the crosstalk adders 302 (Lch) and 302 (Lch) in the indirect sound crosstalk processing unit 208 are similar to those of the first mixer units 203 (Lch) and 203 (Rch) in the case of direct sound, and are replaced by the second mixer units 204 (Lch) and 204 (Rch) in the sound source (TG) 104. This can further reduce the scale of the hardware.

[0055] Next, a second embodiment will be described. Figure 7 This is a block diagram of the sound source (TG) 104 and the effect imparting unit 105 in the second embodiment. Figure 7 In the Figure 2 The same reference numerals as those in the first embodiment are the same as those in the first embodiment. Figure 7 The second embodiment has the following structure: the output side of the mixer units 207 (Lch) and 207 (Rch) in the final stage is configured with an output sound crosstalk processing unit 701 having the same structure as the conventional technology, and therefore, the indirect sound crosstalk processing unit 208 is newly provided.

[0056] Figure 8 This is a block diagram showing a configuration example centered around the indirect audio crosstalk processing unit 208 (first crosstalk unit) and the output audio crosstalk processing unit 701 (second crosstalk unit) in the second embodiment. The configuration of the indirect audio crosstalk processing unit 208 operating as the second crosstalk unit is similar to that in the first embodiment. Figure 3 However, the magnification values ​​A and b set as described later are different from those in the first embodiment.

[0057] like Figure 8As shown, in the output sound crosstalk processing unit 701 operating as the first crosstalk unit, the output data of the final-stage mixer unit 207 (Lch) is multiplied by a (a is a real number) times by the crosstalk multiplier 801 (Lch). The multiplication result is input to the crosstalk adder 802 (Rch) without sign inversion. Similarly, the output data of the final-stage mixer unit 207 (Rch) is multiplied by a times by the crosstalk multiplier 801 (Rch). The multiplication result is input to the crosstalk adder 802 (Lch) without sign inversion. The output data of the final-stage mixer unit 207 (Lch) and the multiplication result of the crosstalk multiplier 801 (Rch) are added by the crosstalk adder 802 (Lch), and the added result is output as Lch musical sound output data 212 (Lch). Similarly, the output data of the final stage mixer section 207 (Rch) and the multiplication result of the crosstalk multiplier 801 (Lch) are added by the crosstalk adder 802 (Rch), and the addition result is output as Rch musical tone output data 212 (Rch).

[0058] exist Figure 8 The output audio crosstalk processing unit 701 and the indirect audio crosstalk processing unit 208 are processed by Figure 1 The processing function of CPU101 Figure 7 The crosstalk control unit 209 respectively sets the multiplication value a in the crosstalk multipliers 801 (Lch) and 801 (Rch), the multiplication value A in the crosstalk multipliers 301 (Lch) and 301 (Rch), and the multiplication value b in the crosstalk output multipliers 303 (Lch) and 303 (Rch) to determine the crosstalk ratio between the Lch indirect sound output data 211 (Lch) and the Rch indirect sound output data 211 (Rch), and the crosstalk ratio between the Lch musical sound output data 212 (Lch) and the Rch musical sound output data 212 (Rch).

[0059] Here, the crosstalk control section 209 sets the above-mentioned multiplication values ​​a, A, and b so that the indirect sound crosstalk processing, which is the second crosstalk processing performed by the indirect sound crosstalk processing section 208, reduces the output sound crosstalk processing, which is the first crosstalk processing performed by the output sound crosstalk processing section 701. Now, the Lch musical sound output data 212 (Lch) and the Rch musical sound output data 212 (Rch) are set to LchOut and RchOut, respectively, the Lch direct sound output data 205 (Lch) and the Rch direct sound output data 205 (Rch) are set to LchSOut and RchSOut, respectively, the outputs of the final stage mixer sections 207 (Lch) and 207 (Rch) are set to LchMix and RchMix, the outputs of the Lch reverberation / resonance section 210 (Lch) and the Rch reverberation / resonance section 210 (Rch) are set to LchE and RchE, and the Lch The outputs of the indirect sound output data 211 (Lch) and the Rch indirect sound output data 211 (Rch) are set to LchEOut and RchEOut, and the components of the Lch indirect sound output data 211 (Lch) and the Rch indirect sound output data 211 (Rch) respectively contained in the Lch musical sound output data 212 (Lch) and the Rch musical sound output data 212 (Rch) and the components of the Lch direct sound output data 205 (Lch) and the Rch direct sound output data 205 (Rch) are set to LchEOut' and RchEOut', and LchSOut' and RchSOut'.

[0060] In this case, first, the calculations in the mixer units 207 (Lch) and 207 (Rch) in the final stage are represented by the following equations (1) and (2).

[0061] LchMix=LchSOut+LchEOut...(1)

[0062] RchMix=RchSOut+RchEOut...(2)

[0063] In addition, the following equations (3) and (4) hold true.

[0064] LchOut=LchSOut'+LchEOut'...(3)

[0065] RchOut=RchSOut'+RchEOut'...(4)

[0066] Next, the calculation in the output sound crosstalk processing unit 701 is represented by the following equations (5) and (6).

[0067] LchOut=LchMix+RchMix×a...(5)

[0068] RchOut=RchMix+LchMix×a...(6)

[0069] By substituting equations (1) and (2) and equations (3) and (4) into equations (5) and (6), respectively, the following equations (7) and (8) and equations (9) and (10) are derived.

[0070] (LchSOut'+LchEOut')=(LchSOut+LchEOut)

[0071] +(RchSOut+RchEOut)×a

[0072] therefore,

[0073] LchSOut'=LchSOut+RchSOut×a...(7)

[0074] LchEOut'=LchEOut+RchEOut×a...(8)

[0075] RchSOut'=RchSOut+LchSOut×a...(9)

[0076] RchEOut'=RchEOut+LchEOut×a...(10)

[0077] On the other hand, the calculation in the indirect audio crosstalk processing unit 208 is represented by the following equations (11) and (12).

[0078] LchEOut=(LchE-RchE×A)×b...(11)

[0079] RchEOut=(RchE-LchE×A)×b...(12)

[0080] In the second embodiment, the crosstalk control unit 209 calculates the multiplication factor b using the multiplication factor value A and a using the following formula (13).

[0081] b=1 / (1-A×a)...(13)

[0082] Based on the above equations (8), (11), (12), and (13), the following equation (14) is derived.

[0083] LchEOut′=LchEOut+RchEOut×a

[0084] =(LchE-RchE×A)×b+(RchE-LchE×A)×b×a

[0085] =LchE×(1-A×a)×b+RchE×b×(a-A)

[0086] therefore,

[0087] LchEOut'=LchE+RchE×(a-A)×b

[0088] =LchE+RchE×(a-A) / (1-A×a) ...(14)

[0090] Similarly to the above, the following formula (15) is derived from formula (10), formula (11), formula (12), and formula (13).

[0091] RchEOut′=RchEOut+LchEOut×a

[0092] =(RchE-LchE×A)×b+(LchE-RchE×A)×b×a

[0093] =RchE×(1-A×a)×b+LchE×b×(a-A)

[0094] therefore,

[0095] RchEOut'=RchE+LchE×(a-A)×b

[0096] =RchE+LchE×(a-A) / (1-A×a) ...(15)

[0098] According to the above formula (14) or formula (15), Figure 7 The crosstalk control unit 209 can control the ratio of each crosstalk in the indirect sound component LchEOut′ in the Lch musical sound output data 212 (Lch) and the indirect sound component RchEOut′ in the Rch musical sound output data 212 (Rch) by setting the range of the multiplication value A to 0≤A≤a.

[0099] For example, when A=0, equations (14) and (15) become equations (16) and (17) below, which are the same as those in the conventional art.

[0100] LchEOut'=LchE+RchE×(a-A) / (1-A×a)

[0101] =LchE+RchE×(a-0) / (1-0×a)

[0102] therefore,

[0103] LchEOut'=LchE+RchE×a...(16)

[0104] RchEOut'=RchE+LchE×(a-A) / (1-A×a)

[0105] =RchE+LchE×(a-0) / (1-0×a)

[0106] therefore,

[0107] RchEOut'=RchE+LchE×a...(17)

[0108] For example, when A=a, equations (14) and (15) become equations (18) and (19) below, and the effect of crosstalk on the indirect sound side is canceled out.

[0109] LchEOut'=LchE+RchE×(a-A) / (1-A×a)

[0110] =LchE+RchE×(a-a) / (1-a×a)

[0111] therefore,

[0112] LchEOut'=LchE...(18)

[0113] RchEOut'=RchE+LchE×(a-A) / (1-A×a)

[0114] =RchE+LchE×(a-a) / (1-a×a)

[0115] therefore,

[0116] RchEOut'=RchE...(19)

[0117] In this way, according to the second embodiment, an indirect sound crosstalk processing unit 208 is added to the conventional structure, and the crosstalk control unit 209 sets the above-mentioned multiple values ​​a, A and b through the calculation processing shown in Formulas (14), (15) and (13), so that the indirect sound crosstalk processing performed by the indirect sound crosstalk processing unit 208 reduces the output sound crosstalk processing performed by the output sound crosstalk processing unit 701, thereby not damaging the acoustic effect of the indirect sound based on the Lch reverberation / resonance unit 210 (Lch) and the Rch reverberation / resonance unit 201 (Rch), and eliminating the unnatural feeling associated with crosstalk in the Lch musical sound output data 212 (Lch) and the Rch musical sound output data 212 (Rch).

[0118] As another embodiment related to the second embodiment described above, similarly to the first embodiment, Figure 2When the Lch reverberation / resonance section 210 (Lch) and the Rch reverberation / resonance section 210 (Rch) have a function of adjusting the output level at their output stages, the following configuration may be employed: the output level adjustment function may be used instead of Figure 3 The functions of the crosstalk output multipliers 303 (Lch) and 303 (Rch) in the indirect sound crosstalk processing unit 208 are replaced by the second mixer units 204 (Lch) and 204 (Rch) in the sound source (TG) 104. Figure 3 The functions of the crosstalk multipliers 301 (Lch) and 301 (Rch) and the crosstalk adders 302 (Lch) and 302 (Rch) in the indirect audio crosstalk processing unit 208 are realized. Thus, the effects of the second embodiment described above can be achieved without increasing the scale of hardware compared to the conventional ones.

[0119] Next, the third embodiment will be described. Figure 2 The first embodiment or Figure 7 In the third embodiment, the crosstalk control unit 209 determines the ratio of the crosstalk of the direct sound, for example, based on the magnitude of the correlation between the left and right output channels of the musical sound output data to be output. Figure 1 The ROM 102 stores a correlation value for each of one or more values ​​of the timbre, range, or velocity of the musical sound to be output. Furthermore, the crosstalk control unit 209 can refer to the correlation value stored in the ROM 102, for example, based on one or more of the timbre, range, or velocity specified as a sound generation instruction by the CPU 101 to the sound source (TG) 104 in response to a user's key operation on the keyboard 106, and determine the magnification value a corresponding to the ratio of the crosstalk described in the first or second embodiment based on the referenced correlation value.

[0120] Figure 9 This is a diagram showing an example of the structure of the crosstalk setting table data group in the third embodiment. These table data groups are stored, for example, in Figure 1 ROM102. First, Figure 9 (a) is a diagram showing an example of a timbre data table. In this table, a plurality of sets of timbre names, channel numbers, and pointers to waveform split data (split data) are stored for each timbre.

[0121] Figure 9 (b) means from Figure 9(a) illustrates an example of a waveform segmentation data table storing multiple sets of waveform segmentation data, referenced by pointers to waveform segmentation data within each entry of the illustrated timbre data table. Each waveform segmentation data entry stores, for example, pointers to waveform data to be reproduced by sound source (TG) 104, i.e., reproduced waveform information (L, R), and a correlation value indicating the magnitude of the correlation between the waveform data for the left and right channels, for each of the sound ranges (lowest, low, mid, high, and highest).

[0122] Regarding the pointers to the reproduced waveform information (L, R), pointers to two waveform data are stored as array data for each left and right channel. Figure 9 In (b), for example, in "wav_0_0L_R", "wav_0" is as follows Figure 9 (a) corresponds to one timbre. "wav_1" corresponds to another timbre. "wav_0_0," for example, corresponds to the lowest register. "wav_0_1" corresponds to the low register, and "wav_0_2" corresponds to the mid-range. "L_R" is the array element value corresponding to the left and right channels, Lch and Rch.

[0123] Figure 9 (c) shows the Figure 9 One array element value of the reproduced waveform information (L, R) of (b) refers to the "start address", "loop start address" and "loop end address" in a waveform ROM (not shown) of one waveform data. Figure 2 The waveform generators WG.CHi (1≤i≤n) within the musical sound generators 201(CH1) to 201(CHn) within the sound source (TG) 104 shown begin reading waveform data from the address indicated by the "Start Address" within the waveform ROM (not specifically shown). After reading waveform data to the address indicated by the "Loop End Address," they return to the address indicated by the "Loop Start Address" and continue reading waveform data. The waveform data reading from the "Loop Start Address" to the "Loop End Address" is then repeated until a note-off (key-off) occurs for the corresponding sound channel (CHi).

[0124] Regarding the correlation value, a value of 0 indicates that the waveform data for the left and right channels have no correlation with each other, and a value of 1 indicates that the waveform data for the left and right channels have the greatest correlation with each other. Figure 9 The table "mixer set crosstalk value" on the right side of (b) does not actually need to be stored as a table, and can be calculated by arithmetic processing corresponding to the following formula (20).

[0125] Crosstalk ratio mv = (1 - correlation value) × 0.25…(20)

[0126] For example, when the lowest or highest range is specified, Figure 9 (b) The waveform split data is referred to the correlation value 0.2, and based on the above formula (20), the mixer setting crosstalk ratio is calculated to be 0.200. In addition, when the low range or high range sound range is specified, the crosstalk ratio is calculated based on Figure 9 (b) The waveform segmentation data refers to the correlation value 0.5, and based on the above formula (20), the mixer setting crosstalk ratio is calculated to be 0.125. Figure 9 The waveform segmentation data of (b) refers to the correlation value 0.8 and is calculated based on the above formula (20) to set the mixer crosstalk ratio to 0.050.

[0127] As an example of a related value, Figure 9 As shown in (b), the left and right channel correlation values ​​are set to smaller values ​​as they correspond to the waveforms with a sense of diffusion, that is, the left and right ends of the keyboard 105, i.e., the lowest range or the highest range. The left and right channel correlation values ​​are set to larger values ​​as they correspond to the waveforms located in the center, i.e., the middle range. The crosstalk control unit 209 uses the Figure 9 The crosstalk ratio can be obtained by performing calculations corresponding to the above-mentioned equation (20) on the correlation values ​​obtained by dividing the waveform data (b), and the above-mentioned magnification values ​​A, b, and a can be determined.

[0128] The crosstalk ratio is calculated as a calculation corresponding to the above-mentioned equation (20), but if no other processing is required, it may be stored as a preset data as a mixer setting value.

[0129] In the third embodiment, the processing example of the crosstalk control unit 209 is the same as that in the first embodiment. Figure 5 The illustrated flowcharts are the same. Figure 10 In the third embodiment, Figure 5 Flowchart of a detailed example of the indirect audio crosstalk setting process in step S504 or the direct audio crosstalk setting process in step S505.

[0130] and Figure 6 Similarly to the case of the first embodiment illustrated, CPU 101 repeatedly executes the processing of steps S1001 and S1002 for each pronunciation channel with pronunciation instructions until it determines in step S1003 that an amount corresponding to the number of pronunciation channels with pronunciation instructions has been processed, that is, while the determination in step S1003 is "No".

[0131] First, the CPU 101 selects a tone from the ROM 102 stored in the ROM 102 based on the timbre corresponding to the currently processed sound channel (CH1 or CH2) and the range including the pitch indicated by the sound. Figure 9 (a) The timbre data table shown as an example is further Figure 9 (b) The waveform segmentation data table shown as an example is used to obtain the corresponding correlation value (step S1002).

[0132] Then, the CPU 101 calculates the crosstalk ratio by arithmetic processing corresponding to the formula (20), and sets a corresponding multiplication value for each crosstalk processing unit in the same manner as in the first or second embodiment (step S1003).

[0133] If the determination result of step S1003 is "No", the CPU 101 returns to the process of step S1001 and repeatedly executes the processes of steps S1001 and S1002. If the determination result of step S1003 is "Yes", the CPU 101 ends the process. Figure 10 In the third embodiment illustrated by the flowchart Figure 5 The crosstalk setting process of the indirect sound or direct sound in step S504 or S505 is performed.

[0134] According to the third embodiment, crosstalk processing can be changed according to the timbre, range, or speed of each musical sound, and the sense of expansion of the musical sound can be finely controlled. In addition, the third embodiment can be applied not only to direct sound but also to specific indirect sound (effect sound).

[0135] Finally, a fourth embodiment will be described. Figure 11 is a block diagram of the sound source (TG) 104 and the effect imparting unit 105 in the fourth embodiment, and Figure 12 This is a block diagram showing a configuration example centered around the indirect audio crosstalk processing units 208 (#1) and 208 (#2) and the output audio crosstalk processing unit 701 in the fourth embodiment. Figure 11 as well as Figure 12 In the Figure 7 as well as Figure 8 The same reference numerals as those in the second embodiment are the same as those in the second embodiment. Figure 11 as well as Figure 12 In a fourth embodiment, Figure 7 as well as Figure 8In the second embodiment, the reverberation and resonance effect parts of the Lch reverberation / resonance part 210 (Lch) and the Rch reverberation / resonance part 201 (Rch) are separated as the second mixer part 204 ((#1)(Lch)) and the Lch resonance part 210 (#1)(Lch) and the second mixer part 204 ((#1)(Rch)) and the Rch resonance part 210 (#1)(Rch), and the second mixer part 204 ((#2)(Lch)) and the Lch reverberation part 210 (#2)(Lch) and the second mixer part 204 ((#2)(Rch)) and the Rch reverberation part 210 (#2)(Lch). 0(Rch)(#2) and has an independent structure, and is provided with an indirect sound crosstalk processing unit 208(#1) and an indirect sound crosstalk processing unit 208(#2) corresponding to each other. Then, the outputs of the left and right channels of each indirect sound crosstalk processing unit 208(#1) and 208(#2) are mixed by the indirect sound mixer units 1101(Lch) and 1101(Rch), respectively, and input to the final stage mixer units 207(Lch) and 207(Rch) as Lch indirect sound output data 211(Lch) and Rch indirect sound output data 211(Rch), respectively, as in the case of the second embodiment. Figure 12 The structures of the indirect audio crosstalk processing units 208(#1) and 208(#1) are respectively the same as those of Figure 8 The structure of the indirect audio crosstalk processing unit 208 is the same as that of the second embodiment. Figure 12 The structure of the output sound crosstalk processing unit 701 is similar to Figure 8 The same is true for the second embodiment.

[0136] In a fourth embodiment, Figure 11 The crosstalk control unit 209 in the indirect audio crosstalk processing unit 208 (#1) and 208 (#2) can provide different crosstalk ratios. Figure 12 In the fourth embodiment, the magnification values ​​A1 and b1, as well as A2 and b2, can be set to different value pairs. In the fourth embodiment, there are two indirect sound crosstalk processing units 208. This allows, for example, starting with the one with the higher crosstalk ratio, to set the direct sound, pedal resonance sound, and reverberation sound, making it possible to finely control the sense of expansion of the musical sound.

[0137] According to the fourth embodiment, the sense of expansion of sound can be controlled for each type of indirect sound.

[0138] In the aforementioned third embodiment, the crosstalk control unit 209 controls the crosstalk ratio based on different correlation values ​​determined according to the timbre, range, speed, etc. of the musical sound. However, the above embodiment can also be applied to sound processing devices other than electronic musical instruments. For example, in a driving device for headphones, the crosstalk ratio between the sound output data of the left and right channels can also be controlled based on different correlation values ​​determined according to the type of headphones.

[0139] The above-described embodiments are applied to two-channel stereophonic sound, but are also applicable to a higher number of channels.

Claims

1. A sound processing device, wherein: have: The sound source part generates musical sounds; a sound data output unit that mixes, for each of a plurality of output channels, first sound output data, which is direct sound output data output from the sound source unit, with one or more types of second sound output data to output third sound output data, which is musical sound output data, wherein the second sound output data is indirect sound output data for adding a sound effect to the musical sound and is used to add the sound effect to the first sound output data; a crosstalk processing unit configured to perform crosstalk processing between the plurality of output channels on the first sound output data and the second sound output data, or on the second sound output data and the third sound output data; as well as The crosstalk control unit causes the crosstalk processing unit to perform the crosstalk processing so that, in the third sound output data, a ratio of crosstalk between the plurality of output channels of a component of the second sound output data is smaller than a ratio of crosstalk between the plurality of output channels of a component of the first sound output data.

2. The sound processing device according to claim 1, wherein The crosstalk control unit determines at least one of a ratio of crosstalk between the plurality of output channels of components of the first acoustic output data or a ratio of crosstalk between the plurality of output channels of components of the second acoustic output data based on a magnitude of correlation between the plurality of output channels of the acoustic output data to be output, and causes the crosstalk processing unit to perform the crosstalk processing based on the determination.

3. The sound processing device according to claim 2, wherein The crosstalk control unit determines the ratio of crosstalk between the multiple output channels of the component of the direct sound output data in the musical sound output data based on the correlation value stored for each value of any one or more of the timbre, range, or speed of the musical sound to be output, or determines the ratio of crosstalk between the multiple output channels of the component of the indirect sound output data.

4. The sound processing device according to claim 3, wherein The crosstalk processing unit is replaced by a sound source mixer unit in the sound source unit, and the sound source mixer unit mixes the musical sound data of each of the plurality of sound production channels generated by the sound source unit into the direct sound output data or the indirect sound output data of the plurality of output channels.

5. The sound processing device according to any one of claims 1 to 4, wherein The crosstalk processing unit includes: a first crosstalk unit configured to perform a first crosstalk process between the plurality of output channels during an output stage of the third sound output data; as well as a second crosstalk unit that performs a second crosstalk process between the plurality of output channels on the second sound output data before mixing with the first sound output data; The crosstalk control section sets parameters for the first crosstalk processing and parameters for the second crosstalk processing in the crosstalk processing section so that the second crosstalk processing reduces crosstalk caused by the first crosstalk processing.

6. The sound processing device according to any one of claims 1 to 4, wherein: The one or more second sound output data include resonance sound data and reverberation sound data, wherein the resonance sound data is used to add a resonance sound effect to the first sound output data, and the reverberation sound data is used to add a reverberation sound effect to the first sound output data. The crosstalk control unit causes the crosstalk processing unit to perform the crosstalk processing so that, in the third sound output data, the components of the second sound output data have different ratios of crosstalk between the plurality of output channels and are smaller than the ratio of crosstalk between the plurality of output channels of the components of the first sound output data.

7. The sound processing device according to any one of claims 1 to 4, wherein The plurality of output channels are stereo left and right channels.

8. A sound processing method, wherein: Make the processor perform the following processing: Processing of musical sound generation; sound data output processing for outputting third sound output data as musical sound output data by mixing, for each of a plurality of output channels, first sound output data as direct sound output data output from a sound source unit with one or more types of second sound output data, wherein the second sound output data is indirect sound output data for adding a sound effect to the musical sound and is used to add the sound effect to the first sound output data; crosstalk processing, performing crosstalk processing between the plurality of output channels on any two or more of the first sound output data, the second sound output data, and the third sound output data; as well as The crosstalk control process is performed so that, in the third sound output data, a ratio of crosstalk between the plurality of output channels of a component of the second sound output data is smaller than a ratio of crosstalk between the plurality of output channels of a component of the first sound output data.

9. The sound processing method according to claim 8, wherein: The crosstalk processing is as follows: In the output stage of the third sound output data, a first crosstalk process is performed between the plurality of output channels. performing a second crosstalk process between the plurality of output channels on the second sound output data before mixing with the first sound output data, The crosstalk control process is as follows: Parameters for the first crosstalk processing and parameters for the second crosstalk processing are set so that the second crosstalk processing mitigates crosstalk caused by the first crosstalk processing.

10. The sound processing method according to claim 8 or 9, wherein: The one or more second sound output data include resonance sound data for adding a resonance sound effect to the first sound output data and reverberation sound data for adding a reverberation sound effect to the first sound output data. The crosstalk control processing controls the crosstalk processing so that, in the third audio output data, the components of the second audio output data have different ratios of crosstalk between the plurality of output channels and are smaller than the ratios of crosstalk between the plurality of output channels of the components of the first audio output data.

11. The sound processing method according to claim 8 or 9, wherein: The plurality of output channels are stereo left and right channels.

12. A computer program product comprising a computer program, wherein: When the computer program is executed by a processor, the sound processing method according to any one of claims 8 to 11 is implemented.

Images