Sound signal processing method and sound signal processing device

Abstract

To provide a sound signal processing method and a sound signal processing device, capable of improving a realistic sensation even with less equipment.SOLUTION: A audio signal processing method includes steps of: acquiring an audio signal; determining a type of the audio signal; generating a first audio signal on which localization processing for localizing an acoustic image at any one virtual speaker of the plurality of virtual speakers has been performed when the type of a determined audio signal is a first type; generating a second audio signal on which distributed processing to distribute and localize an acoustic image at two or more virtual speakers of the plurality of virtual speakers has been performed when the type of a determined audio signal is a second type; generating an additional signal by adding the first and second audio signals; and outputting the additional signal to a plurality of real speakers.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to a sound signal processing method and a sound signal processing device for processing a sound signal. [Background technology]

[0002] Patent Document 1 discloses an audio signal compensation device equipped with a compensation speaker that outputs compensation sound to compensate for sounds reproduced from speakers at venues such as public viewings being masked by background noise and other noise. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2017-200025 A Summary of the Invention [Problem to be solved by the invention]

[0004] Installing a large number of speakers and other equipment in a venue will improve the sound quality and the sense of realism, but increasing the amount of equipment also requires wiring, securing a power source, and securing manpower.

[0005] SUMMARY OF THE PRESENT DISCLOSURE An object of the present invention is to provide a sound signal processing method and a sound signal processing device that can improve the sense of realism even with a small amount of equipment. [Means for solving the problem]

[0006] The sound signal processing method acquires a sound signal, determines a type of the sound signal, sets a plurality of virtual speakers, and when the determined type of the sound signal is a first type, generates a first sound signal that has been subjected to localization processing to localize a sound image in one of the plurality of virtual speakers, and when the determined type of the sound signal is a second type, generates a second sound signal that has been subjected to distribution processing to localize a sound image in two or more of the plurality of virtual speakers, adds the first sound signal and the second sound signal to generate a sum signal, and outputs the sum signal to a plurality of real speakers. Effect of the Invention

[0007] Users can improve the sense of realism even with less equipment. [Brief description of the drawings]

[0008] [Figure 1] 1 is a block diagram showing a configuration of a sound signal processing system 1. FIG. [Diagram 2] 2 is a schematic plan view showing an installation state of a plurality of speakers 14A to 14G. [Diagram 3] FIG. 2 is a block diagram showing a configuration of a mixer 11. [Figure 4] 2 is a block diagram showing the functional configuration of a mixer 11. FIG. [Diagram 5] 4 is a flowchart showing the operation of the mixer 11. [Figure 6] FIG. 1 is a schematic plan view of a live music venue 70 showing virtual speakers. [Figure 7] 4 is a plan view illustrating an output mode of a first sound signal and a second sound signal. FIG. [Figure 8] 1 is a plan view showing a schematic view environment of each listener using an information processing terminal 13. FIG. [Figure 9] 1 is a plan view showing a schematic view environment of each listener using an information processing terminal 13. FIG. [Figure 10] 1 is a plan view showing a schematic view environment of each listener using an information processing terminal 13. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] 1 is a block diagram showing the configuration of a sound signal processing system 1. The sound signal processing system 1 includes a mixer 11, a plurality of information processing terminals 13, and a plurality of speakers 14A to 14G.

[0010] The mixer 11 and the information processing terminals 13 are installed in different locations, and are connected to each other via the Internet.

[0011] The mixer 11 is connected to a plurality of speakers 14 to 14 G. The mixer 11 and the plurality of speakers 14 A to 14 G are connected via a network cable or an audio cable.

[0012] The mixer 11 is an example of the sound signal processing device of the present invention. The mixer 11 receives sound signals from a plurality of information processing terminals 13 via the Internet, performs panning processing and effect processing, and supplies the sound signals to a plurality of speakers 14A to 14G.

[0013] 2 is a schematic plan view showing an installation state of multiple speakers 14A to 14G. Multiple speakers 14A to 14G are installed along the walls of a live music venue 70. The live music venue 70 in this example has a rectangular shape in a plan view. A stage 50 is disposed in front of the live music venue 70. On the stage 50, performers perform singing, musical instruments, etc.

[0014] Speaker 14A is installed on the left side of stage 50, and speaker 14B is installed on the right side of stage 50. Speaker 14C is installed on the left side of the center between the front and rear of live house 70, and speaker 14D is installed on the right side of the center between the front and rear of live house 70. Speaker 14E is installed on the left side at the rear of live house 70, speaker 14F is installed in the center between the left and right at the rear of live house 70, and speaker 14G is installed on the right side at the rear of live house 70.

[0015] A listener L1 is in front of the speaker 14F. The listener L1 listens to the performance of the performers and cheers, claps, calls, etc. on the performers. The sound signal processing system 1 outputs the sounds of the cheers, claps, calls, etc. of the other listeners to the live music venue 70 via the speakers 14A to 14G. The sounds of the cheers, claps, calls, etc. of the other listeners are input to the mixer 11 from the information processing terminal 13. The information processing terminal 13 is a portable information processing device such as a personal computer (PC), a tablet computer, or a smartphone. The user of the information processing terminal 13 is a listener who remotely listens to the performance such as singing or playing in the live music venue 70. The information processing terminal 13 acquires the sounds of the cheers, claps, calls, etc. of the listeners via a microphone (not shown). Alternatively, the information processing terminal 13 may display icon images such as "cheering," "applause," "calling," and "bustling noise" on a display (not shown) and accept a selection operation for these icon images from the listener. When the information processing terminal 13 accepts a selection operation for these icon images, it may generate a sound signal corresponding to each icon image and obtain it as the sound of the listener's cheering, applause, or call.

[0016] The information processing terminal 13 transmits sounds such as cheers, applause, or calls from each listener to the mixer 11 via the Internet. The mixer 11 receives sounds such as cheers, applause, or calls from each listener. The mixer 11 performs panning and effect processing on the received sounds, and distributes the sound signals to the multiple speakers 14A to 14G. In this way, the sound signal processing system 1 can deliver sounds such as cheers, applause, or calls from a large number of listeners to the live music venue 70.

[0017] The configuration and operation of mixer 11 will be described in detail below. Fig. 3 is a block diagram showing the hardware configuration of mixer 11. Fig. 4 is a block diagram showing the functional configuration of mixer 11. Fig. 5 is a flowchart showing the operation of mixer 11.

[0018] The mixer 11 includes a display 101, a user I / F (interface) 102, an audio I / O (Input / Output) 103, a signal processing unit (DSP) 104, a network I / F 105, a CPU 106, a flash memory 107, and a RAM 108. These components are connected via a bus 171.

[0019] The CPU 106 is a control unit that controls the operation of the mixer 11. The CPU 106 performs various operations by reading out a predetermined program stored in a flash memory 107, which is a storage medium, into a RAM 108 and executing it.

[0020] It should be noted that the program read by CPU 106 does not need to be stored in flash memory 107 in the device itself. For example, the program may be stored in a storage medium of an external device such as a server. In this case, CPU 106 may read the program from the server to RAM 108 each time and execute it.

[0021] The signal processing unit 104 is composed of a DSP for performing various signal processing. The signal processing unit 104 receives sound signals related to cheers, applause, calls, etc. from the listeners from the information processing terminal 13 via the network I / F 105.

[0022] The signal processing unit 104 performs panning and effect processing on the received sound signal, and outputs the processed sound signal via the audio I / O 103 to the speakers 14A to 14G.

[0023] As shown in FIG. 4, the CPU 106 and the signal processing unit 104 functionally include an acquisition unit 301 , a determination unit 302 , a setting unit 303 , a localization processing unit 304 , a distribution processing unit 305 , and an addition unit 306 .

[0024] The acquiring unit 301 acquires sound signals related to cheers, applause, calls, etc. from listeners from each of the multiple information processing terminals 13 (S11). After that, the determining unit 302 determines the type of the sound signal (S12).

[0025] The types of sound signals include a first type and a second type. The first type includes cheers from individual listeners such as "Go for it!", calling out the performer's name, or exclamations such as "Bravo." In other words, the first type is a sound that can be recognized as the voice of an individual listener without being drowned out by the audience. The second type is a sound that cannot be recognized as the voice of an individual listener and is made by many listeners at the same time, and includes, for example, applause, singing together, cheers such as "Wow!", murmuring, etc.

[0026] When the determination unit 302 recognizes a voice such as "Go for it!" or "Bravo" as described above, for example, through a voice recognition process, the determination unit 302 determines that the sound signal is of the first type. The determination unit 302 determines that a sound signal for which no voice is recognized is of the second type.

[0027] The determination unit 302 outputs the sound signal determined to be the first type to the localization processing unit 304, and outputs the sound signal determined to be the second type to the distribution processing unit 305. The localization processing unit 304 and the distribution processing unit 305 set a plurality of virtual speakers (S13).

[0028] FIG. 6 is a schematic plan view of the live music venue 70 showing the virtual speakers. As shown in FIG. 6, the localization processing unit 304 and the distributed processing unit 305 set a plurality of virtual speakers 14N1 to 14N16. The localization processing unit 304 and the distributed processing unit 305 manage the positions of the speakers 14A to 14G and the virtual speakers 14N1 to 14N16 in two-dimensional or three-dimensional orthogonal coordinates with a predetermined position of the live music venue (for example, the center of the stage 50) as the origin. The speakers 14A to 14G are real speakers. Therefore, the coordinates of the speakers 14A to 14G are stored in advance in the flash memory 107 (or a server, not shown). The localization processing unit 304 and the distributed processing unit 305 evenly arrange the virtual speakers 14N1 to 14N16 throughout the live music venue 70 as shown in FIG. 6. In the example of FIG. 6, the localization processing unit 304 and the distribution processing unit 305 also set a virtual speaker 14N16 at a position outside the live music venue 70.

[0029] The virtual speaker setting process (S13) does not need to be performed after the sound signal type determination process (S12). The virtual speaker setting process (S13) may be performed before the sound signal acquisition process (S11) or the sound signal type determination process (S12).

[0030] Thereafter, the localization processing unit 304 performs localization processing to generate a first sound signal, and the distribution processing unit 305 performs distribution processing to generate a second sound signal (S14).

[0031] The localization process is a process of localizing a sound image at the position of one of the virtual speakers 14N1 to 14N16. However, the position at which the sound image is localized is not limited to the virtual speakers 14N1 to 14N16. When the position at which the sound image is localized coincides with the position of the speakers 14A to 14G, the localization processor 304 outputs a sound signal to one of the speakers 14A to 14G.

[0032] The localization position of the first type of sound signal may be set randomly, but the mixer 11 may include a position information receiving unit that receives position information from the listener. The listener operates the information processing terminal 13 to specify the localization position of his / her own sound. For example, the information processing terminal 13 displays an image simulating a plan view or a perspective view of the live music venue 70, and receives the localization position from the user. The information processing terminal 13 transmits position information (coordinates) corresponding to the received localization position to the mixer 11. The localization processing unit 304 of the mixer 11 sets a virtual speaker at the coordinates corresponding to the position information received from the information processing terminal 13, and performs processing to localize a sound image at the position of the set virtual speaker.

[0033] The localization processing unit 304 performs panning processing or effect processing in order to localize the sound image at the positions of the virtual speakers 14N1 to 14N16.

[0034] The panning process is a process of supplying the same sound signal to a plurality of speakers among the speakers 14A to 14G and controlling the volume of the supplied sound signal to phantom-localize a sound image at the position of a virtual speaker. For example, if the same sound signal with the same volume is supplied to the speaker 14A and the speaker 14C, the sound image is localized as if the virtual speaker was installed at the center position on the line connecting the speaker 14A and the speaker 14C. In other words, the panning process is a process of increasing the volume of the sound signal supplied to the speaker close to the position of the virtual speaker and decreasing the volume of the sound signal supplied to the speaker far from the position of the virtual speaker. Note that in FIG. 6, a plurality of virtual speakers 14N1 to 14N16 are set on the same plane. However, the localization processing unit 304 can also localize a sound image at a virtual speaker at any position on the three-dimensional coordinate system by supplying the same sound signal to a plurality of speakers installed at different heights.

[0035] Moreover, the effect processing includes, for example, a process of applying a delay. If a delay is applied to the sound signals supplied to the real speakers 14A to 14G, the listener perceives a sound image at a position farther away than the real speakers. Therefore, by applying a delay to the sound signals, the localization processing unit 304 can localize the sound image at a virtual speaker set at a position farther away than the real speakers 14A to 14G.

[0036] The effect processing may include a process of adding reverb. If reverb is added to the sound signal, the listener perceives the sound image at a position farther than the position of the actual speaker. Therefore, by adding reverb to the sound signal, the localization processing unit 304 can localize the sound image at a virtual speaker set at a position farther than the actual speakers 14A to 14G.

[0037] The effect processing may include a process of adding frequency characteristics by an equalizer. A listener perceives a sound image not only by the volume difference and time difference between the two ears, but also by the difference in frequency characteristics. Therefore, the localization processing unit 304 can localize a sound image at the position of the set virtual speaker by adding a frequency characteristic according to the transfer characteristic from the position of the target virtual speaker to the target listening position (for example, the center of the stage 50).

[0038] On the other hand, the distributed processing is a process for localizing a sound image by distributing it to a plurality of the virtual speakers 14N1 to 14N16. When the position where the sound image is to be localized coincides with the position of the real speakers 14A to 14G, the distributed processing unit 305 also outputs a sound signal to one of the speakers 14A to 14G.

[0039] The distributed processing unit 305 performs panning processing or effect processing in order to localize sound images at a plurality of positions of the virtual speakers 14N1 to 14N16. The method of localizing each sound image at any of the positions of the virtual speakers 14N1 to 14N16 is the same as that of the localization processing unit 304. The distributed processing unit 305 reproduces sounds such as applause, chorus, cheers, or murmurs by localizing sound images in a distributed manner among a plurality of virtual speakers.

[0040] In the above, an example has been shown in which a sound image is localized in a virtual speaker set at a position farther than the actual speakers 14A to 14G by adding reverb. However, reverb can make a listener perceive a spatial spread of sound. Therefore, the distributed processing unit 305 may perform a process of making a listener perceive a spatial spread such as reverb in addition to the process of localizing a sound image in a plurality of virtual speakers.

[0041] Moreover, it is preferable that the distribution processing unit 305 adjusts the output timing of the sound signals output to the speakers 14A to 14G to shift the timing at which the sounds output from the multiple real speakers reach the listener. This enables the distribution processing unit 305 to further distribute the sound and provide a spatial spread.

[0042] The adder 306 adds the first sound signal that has been localized and the second sound signal that has been distributed as described above (S15). The addition process is performed by an adder for each speaker. The adder 306 outputs an added signal obtained by adding the first sound signal and the second sound signal to each of the multiple real speakers (S16).

[0043] In this manner, the first sound signal reaches the listener using any one of the virtual speakers 14N1 to 14N16 as a sound source. The second sound signal reaches the listener by being distributed from the plurality of virtual speakers 14N1 to 14N16. FIG. 7 is a plan view showing the output mode of the first sound signal and the second sound signal. As shown in FIG. 7, a sound such as "Bravo" is output from a specific virtual speaker. In the example of FIG. 7, a sound such as "Bravo" is output from the virtual speaker 14N3 in the center in front of the audience seats, the virtual speakers 14N9 on the left and right rear of each seat, the virtual speaker 14N12, and the virtual speaker 14N16 in the rear outside the live music house 70. Applause and cheers such as "Wow" are output from a plurality of virtual speakers.

[0044] This allows the performers on stage 50 to hear the voices, applause, cheers, etc. of listeners from places other than listener L1, and allows the live performance to be performed in a more realistic environment. Also, listener L1 in live house 70 can hear the voices, applause, cheers, etc. of many listeners in the same space, and can watch the live performance in a more realistic environment.

[0045] In particular, the sound signal processing method of this embodiment can emit the voices, applause, cheers, etc. of the listeners from the virtual speakers 14N1 to 14N16, which are more numerous than the real speakers 14A to 14G. Therefore, the sound signal processing method of this embodiment can output the voices, applause, cheers, etc. of the listeners from various positions even with a small amount of equipment, thereby improving the sense of realism. Furthermore, the sound signal processing method of this embodiment can output the voices, applause, cheers, etc. of the listeners by simulating the environment of a venue that is even larger than the real space by setting the positions of the virtual speakers to positions outside the space of the real venue.

[0046] In the above embodiment, an example has been shown in which the sense of realism is improved in the live music venue 70. However, the sound signal processing method of the present embodiment can also improve the sense of realism for each listener in a remote location who uses the information processing terminal 13.

[0047] 8, 9, and 10 are plan views that show schematic views of the audio-visual environments of the listeners who use the information processing terminal 13. In this example, the speakers 14FL, 14FR, 14C, 14SL, and 14SR are installed along the walls of a living room 75. The living room 75 in this example has a rectangular shape in a plan view. A display 55 is disposed in front of the living room 75. The listener L2 is located in the center of the living room. The listener L2 watches the performance of the performer displayed on the display 55.

[0048] Speaker 14FL is installed to the left of display 55, speaker 14C is installed in front of display 55, and speaker 14FR is installed to the right of display 55. Speaker 14SL is installed on the rear left side of living room 75, and speaker 14SR is installed on the rear right side of living room 75.

[0049] The information processing terminal 13 acquires video and audio related to the performer's performance. For example, in the example of FIG.

[0050] The information processing terminal 13, like the mixer 11, performs signal processing such as panning and effect processing on the acquired sound, and outputs the processed sound signals to the speakers 14FL, 14FR, 14C, 14SL, and 14SR. The speakers 14FL, 14FR, 14C, 14SL, and 14SR output sounds related to the performers' performances.

[0051] Furthermore, the information processing terminal 13 acquires sound signals related to cheers, applause, calls, etc. of other listeners from the other information processing terminals 13. Like the mixer 11, the information processing terminal 13 determines the type of the sound signal and performs localization processing or distribution processing.

[0052] This allows the listener L2, even in a room 75, to feel as if he or she were in the center of a live music venue 70 and watching a performer's performance together with a large audience, as shown in FIG.

[0053] The information processing terminal 13 may include a seat designation receiving unit that receives seat position designation information from a listener. In this case, the information processing terminal 13 changes the contents of the panning process and the effect process based on the seat position designation information. For example, if a listener designates a seat position immediately in front of the stage 50, the information processing terminal 13 sets the listener L2 to a position immediately in front of the stage 50 as shown in FIG. 10, sets multiple virtual speakers, and performs localization process and distribution process of sound signals related to cheers, applause, calls, etc. of other listeners. This allows the listener L2 to feel as if he or she is right in front of the stage 50.

[0054] The provider of the sound signal processing system provides tickets for seats in front of the stage, seats beside the stage, seats in the center of the live music venue, seats at the back, and the like. The user of the information processing terminal 13 purchases tickets for any of these seat positions. The user can, for example, choose a seat position in front of the stage which is more expensive and provides a greater sense of realism, or a seat position at the back which is less expensive. The information processing terminal 13 changes the contents of the panning process and the effect process according to the seat position selected by the user. This allows the user to experience a sense of realism as if they were watching a performance in the seat position they purchased. Furthermore, the provider of the sound signal processing method can conduct business equivalent to that of providing an event in a real space.

[0055] Furthermore, in the sound signal processing method of this embodiment, multiple users may specify the same seat position. For example, multiple users may each specify a seat position immediately in front of the stage 50. In this case, the information processing terminal 13 of each user provides a sense of realism as if they were in a seat position immediately in front of the stage 50. This allows multiple listeners to watch a performer's performance with the same sense of realism for one seat. Therefore, a provider of the sound signal processing method can provide a service that exceeds the capacity of an actual space to accommodate spectators.

[0056] The description of the present embodiment is illustrative in all respects and is not restrictive. The scope of the present invention is indicated by the claims, not by the above-described embodiments. Furthermore, the scope of the present invention is intended to include all modifications within the meaning and scope of the claims.

[0057] For example, in the above embodiment, the sound signal is subjected to voice recognition processing, and if the voice is recognized by the voice recognition processing, the type of the sound signal is determined to be the first type, and if the voice cannot be recognized by the voice recognition processing, the type of the sound signal is determined to be the second type. However, the sound signal may include a plurality of channels and may include additional information (metadata) indicating whether the channel is the first type or the second type. For example, when the information processing terminal 13 receives a selection operation such as "cheering," "applause," "calling," or "bustling" from the listener and generates a corresponding sound signal, the information processing terminal 13 generates a sound signal of a channel corresponding to the selected sound, attaches the additional information, and transmits the sound signal to the mixer 11. In this case, the determination unit 302 of the mixer 11 determines the type of the sound signal for each channel based on the additional information.

[0058] Also, the sound signal may include both the first type and the second type of sound sources. In this case, the mixer 11 (or the information processing terminal 13) separates the first type of sound signal and the second type of sound signal into sound sources. The localization processing unit 304 and the distribution processing unit 305 generate the first sound signal and the second sound signal from each of the separated sound signals. Any method of sound source separation may be used. For example, as described above, the first type is the speech sound of a specific listener. Therefore, the determination unit 302 separates the first type of sound signal using noise reduction processing that treats the speech sound as a target sound and eliminates other sounds as noise sounds. [Explanation of symbols]

[0059] 1...Sound signal processing system 11…Mixer 13...Information processing terminal 14A~14G…Speakers 14FL, 14FR, 14C, 14SL, 14SR...Speakers 14N1~14N16...Virtual speakers 50…Stage 55...Indicator 70…Live House 75…Room 101...Indicator 102...User I / F 103…Audio I / O 104...signal processing unit 105…Network I / F 106…CPU 107...Flash memory 108…RAM 171…Bus 301…Acquisition Department 302...Judgment section 303…Settings section 304...Localization processing unit 305...Distributed processing unit 306…Addition section

Claims

1. accepting a selection of an icon image and generating an audio signal corresponding to the selected icon image; determining a type of the sound signal; Set up multiple virtual speakers generating a first sound signal that has been subjected to a localization process for localizing a sound image to any one of the plurality of virtual speakers when the determined type of the sound signal is a first type; When the type of the determined sound signal is a second type, a second sound signal is generated by performing a distribution process for distributing the sound signal to two or more virtual speakers among the plurality of virtual speakers and localizing a sound image; adding the first sound signal and the second sound signal to generate a sum signal; outputting the summed signal to a plurality of real speakers; A method for processing an audio signal.

2. the audio signal includes a plurality of channels; determining the type for each channel; The method for processing a sound signal according to claim 1 .

3. When the sound signal includes both the first type and the second type of sound sources, the sound sources are separated into the first type of sound signal and the second type of sound signal; generating the first sound signal and the second sound signal from the respective separated sound signals; The method for processing a sound signal according to claim 1 .

4. performing a voice recognition process on the sound signal; When a voice is recognized by the voice recognition process, the type of the sound signal is determined to be the first type; if the speech cannot be recognized by the speech recognition processing, the type of the sound signal is determined to be the second type. The method for processing a sound signal according to any one of claims 1 to 3.

5. The localization process includes a process of outputting the first sound signal solely to a real speaker when the position to be localized coincides with the real speaker. The method for processing a sound signal according to any one of claims 1 to 4.

6. Accept location information from the user, The localization process localizes the first sound signal at a position of the received position information. The method for processing a sound signal according to any one of claims 1 to 5.

7. The localization process realizes the virtual speaker by panning and effect processing. The method for processing a sound signal according to any one of claims 1 to 6.

8. Accept seat location designation information from the user, changing the contents of the panning process and the effect process based on the seat position designation information; A method for processing a sound signal according to claim 7.

9. The effect processing includes a delay, an equalizer, or a reverb. The sound signal processing method according to claim 7 or 8.

10. The distributed processing includes adjusting an output timing of the second sound signal. The method for processing a sound signal according to any one of claims 1 to 9.

11. an acquisition unit that receives a selection of an icon image and generates a sound signal corresponding to the selected icon image; A determination unit for determining a type of the sound signal; A setting unit that sets a plurality of virtual speakers; generating a first sound signal that has been subjected to a localization process for localizing a sound image to any one of the plurality of virtual speakers when the determined type of the sound signal is a first type; When the type of the determined sound signal is a second type, a second sound signal is generated by performing a distribution process for distributing the sound signal to two or more virtual speakers among the plurality of virtual speakers and localizing a sound image; adding the first sound signal and the second sound signal to generate a sum signal; A signal processing unit that outputs the summed signal to a plurality of real speakers; A sound signal processing device comprising:

12. the audio signal includes a plurality of channels; The determination unit determines the type for each channel. The sound signal processing device according to claim 11 .

13. a sound source separation unit that separates the sound signals into the first type of sound signal and the second type of sound signal when the sound signals include both the first type and the second type of sound sources; generating the first sound signal and the second sound signal from the respective separated sound signals; The sound signal processing device according to claim 11 .

14. a voice recognition processing unit that performs voice recognition processing on the sound signal, The determination unit is When a voice is recognized by the voice recognition process, the type of the sound signal is determined to be the first type; if the speech cannot be recognized by the speech recognition processing, the type of the sound signal is determined to be the second type. The sound signal processing device according to any one of claims 11 to 13.

15. The localization process includes a process of outputting the first sound signal solely to a real speaker when the position to be localized coincides with the real speaker. The sound signal processing device according to any one of claims 11 to 14.

16. A location information receiving unit is provided for receiving location information from a user, The localization process localizes the first sound signal at a position of the received position information. The sound signal processing device according to any one of claims 11 to 15.

17. The localization process realizes the virtual speaker by panning and effect processing. The sound signal processing device according to any one of claims 11 to 16.

18. a seat designation receiving unit that receives seat position designation information from a user; the signal processing unit changes the contents of the panning process and the effect process based on the seat position designation information. The sound signal processing device according to claim 17.

19. The effect processing includes a delay, an equalizer, or a reverb. The sound signal processing device according to claim 17 or 18.

20. The distributed processing includes adjusting an output timing of the second sound signal. The sound signal processing device according to any one of claims 11 to 19.

Images