Sound image localization processing method and sound image localization processing device

Abstract

The present invention provides a sound image localization processing method and a sound image localization processing device that suppress the reduction in localization caused by speaker placement conditions and movement of sound sources in an acoustic space. [Solution] The sound image localization processing method is a sound image localization system having a first group of speakers installed in an acoustic space, a second group of speakers installed at a different position from the first group of speakers, a first signal processing unit that generates a first sound signal to be output to the first group of speakers, and a second signal processing unit that generates a second sound signal to be output to the second group of speakers. The same sound source signal and localization information are input to the first signal processing unit and the second signal processing unit, and the first signal processing unit is instructed to perform a first localization processing on the sound source signal to generate a first sound signal so that the sound of the sound source is localized at the position indicated by the localization information, and the second signal processing unit is instructed to perform a second localization processing on the sound source signal to generate a second sound signal so that the sound of the sound source is localized at the position indicated by the localization information.

Description

Technical Field

[0001] The present invention relates to an audio-visual localization processing method and an audio-visual localization processing apparatus used in a live venue.

Background Art

[0002] Patent Document 1 discloses an acoustic control device that can individually select source sound sources to be used in each individual space within a predetermined space and can suppress the influence of sound leaking from other individual spaces in each individual space.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, the acoustic control device of Patent Document 1 does not consider the situation of outputting the same sound signal from speakers installed at different positions. For example, a user may want to localize and output the same sound signal from speakers installed in different regions to the same sound source position. Also, for example, depending on the installation conditions of a plurality of speakers installed in an acoustic space, there may be a case where a region that cannot be fully covered by the first speaker group is covered by installing the second speaker group. In such a case, for a sound source that moves across the first speaker group and the second speaker group, it may not be possible to clearly give localization.

[0005] An object of the present invention is to provide an audio-visual localization processing method that suppresses a decrease in the localization feeling caused by the installation conditions of speakers and the movement of sound sources in an acoustic space.

Means for Solving the Problems

[0006] An embodiment of the present invention provides a sound localization method for a sound image localization system comprising: a first group of speakers installed in an acoustic space; a second group of speakers installed in the acoustic space at a different position from the first group of speakers; a first signal processing unit that generates a first sound signal to be output to the first group of speakers; and a second signal processing unit that generates a second sound signal to be output to the second group of speakers. The method is characterized by inputting a sound source signal and localization information of the same sound source to the first signal processing unit and the second signal processing unit; causing the first signal processing unit to perform a first localization process on the sound source signal based on the localization information and the position information of the first group of speakers so that the sound of the sound source is localized at the position indicated by the localization information to generate the first sound signal; and causing the second signal processing unit to perform a second localization process on the sound source signal based on the localization information and the position information of the second group of speakers so that the sound of the sound source is localized at the position indicated by the localization information to generate the second sound signal. [Effects of the Invention]

[0007] According to the sound image localization processing method of the present invention, it is possible to suppress the decrease in localization caused by speaker placement conditions, listener movement, and sound source movement in the acoustic space. [Brief explanation of the drawing]

[0008] [Figure 1] This is a block diagram showing an example of the configuration of the sound image localization processing device 1 according to the first embodiment. [Figure 2] This is a schematic transmission perspective view showing room R1, which is an example of an acoustic space according to the first embodiment. [Figure 3] This block shows an example of the functional configuration of processor 15. [Figure 4] This is a flowchart showing the operation of the sound image localization processing device 1 according to the first embodiment. [Figure 5] This figure shows an example of playback information according to the first embodiment. [Figure 6] This is a schematic diagram illustrating an example of classifying sound types in the time waveform of impulse response data. [Figure 7] This is a schematic transmission perspective view showing room R1, which is an example of an acoustic space according to the second embodiment. [Figure 8] This is a flowchart showing the operation of the sound image localization processing device 1A according to the second embodiment. [Figure 9] This is an example of information showing the correspondence between the main speakers and the front fill speakers. [Figure 10] This is an example of information showing the correspondence between the main speakers and the front fill speakers. [Modes for carrying out the invention]

[0009] Hereafter, the sound image localization processing device according to embodiments of the present invention will be described with reference to the drawings. The same reference numerals are used for the same parts in each figure. In the second embodiment and subsequent embodiments, descriptions of matters common to the first embodiment will be omitted, and only the differences will be described. In particular, similar functions and effects due to similar configurations will not be mentioned sequentially for each embodiment.

[0010] 《First Embodiment》 Figure 1 is a block diagram showing an example of the configuration of the sound image localization processing device 1 according to the first embodiment.

[0011] As shown in Figure 1, the sound image localization processing device 1 includes a communication unit 11, a display unit 12, a flash memory 13, a RAM 14, a processor 15, an audio interface 16, and a user interface 17.

[0012] The sound localization processing device 1 consists of a personal computer, smartphone, or tablet computer, etc. Audio equipment such as an audio mixer or dedicated signal processing hardware is also an example of a sound localization processing device.

[0013] The communication unit 11 communicates with other devices such as a server. The communication unit 11 has a wireless communication function such as Bluetooth (registered trademark) or Wi-Fi (registered trademark), or a wired communication function such as USB or LAN. The communication unit 11 receives, for example, an audio source signal.

[0014] The display 12 is composed of an LCD or the like. The display 12 displays, for example, a playback information setting screen as shown in FIG. 5.

[0015] The processor 15 is composed of a CPU, a DSP, or a SoC (System on a Chip), etc. The processor 15 reads a program from the flash memory 13 which is a storage medium, and temporarily stores it in the RAM 14, thereby performing various operations. The processor 15 realizes functional configurations such as a playback information acquisition unit 151, a first signal processing unit 152, and a second signal processing unit 153 according to the read program. The playback information acquisition unit 151, the first signal processing unit 152, and the second signal processing unit 153 perform the processes of S001, S002, and S003 shown in the flowchart of FIG. 4, respectively. Note that the program does not necessarily need to be stored in the flash memory 13. The processor ı5 may, for example, download it from other devices such as a server when necessary and temporarily store it in the RAM 14.

[0016] The audio I / F 16 is composed of an analog audio terminal or a digital audio terminal, etc. The audio I / F 16 is connected to the main speakers SP101 to SP103, the front fill speakers SP201 to SP206, the ceiling speakers SP301 to SP303, and the surround speakers SP401 to SP403.

[0017] In this embodiment, the first signal processing unit 152 of the processor 15 outputs audio signals to the main speakers SP101 to SP103, the ceiling speakers SP301 to SP303, and the surround speakers SP401 to SP403 via the audio I / F 16. The second signal processing unit 153 outputs audio signals to the front fill speakers SP201 to SP206 via the audio I / F 16. The main speakers SP101 to SP103, the front fill speakers SP201 to SP206, the ceiling speakers SP301 to SP303, and the surround speakers SP401 to SP403 are connected via the communication unit 11, and the audio signals may be output to these speakers via the communication unit 11.

[0018] In the present invention, the main speakers SP101 to SP103 correspond to the first speakers, and the front fill speakers SP201 to SP206 correspond to the second speakers, respectively.

[0019] The user I / F 17 is an example of an operation unit. The user I / F 17 includes a mouse, a keyboard, a touch panel, or the like. The user I / F 17 receives the operations of the user. The touch panel may be laminated on the display 12.

[0020] FIG. 2 is a perspective view showing schematically a room R1 which is an example of an acoustic space according to the first embodiment. The room R1 forms an acoustic space having a substantially rectangular parallelepiped shape. The room R1 is, for example, a live venue having a stage. A stage is installed in the front of the room R1. Also, seats for listeners are installed in the rear of the room R1. The shape of the room R1 is not limited to the example of FIG. 1.

[0021] Room R1 is equipped with main speakers SP101, SP102, and SP103. In this embodiment, main speakers SP101 to SP103 are suspended from the ceiling along the left-right direction, in a position that allows sound to be emitted to the rear of Room R1. Furthermore, the sound emission direction of main speakers SP101, SP102, and SP103 is set toward the audience seating area.

[0022] Furthermore, Room R1 is equipped with front fill speakers SP201, SP202, SP203, SP204, SP205, and SP206. In this embodiment, the front fill speakers SP201 to SP206 are installed on the stage along the left-right direction so that they can emit sound towards the audience seats near the stage and directly below the main speakers. The shaded area in Figure 2 indicates the region (output region) to which the sound emitted from the front fill speakers SP201 to SP206 reaches.

[0023] Furthermore, ceiling speakers SP301, SP302, and SP303 are installed in room R1. In this embodiment, ceiling speakers SP301 to SP303 are installed on the ceiling in the center of the seating area, aligned from left to right.

[0024] Furthermore, surround speakers SP401, SP402, and SP403 are installed in room R1. In this embodiment, surround speakers SP401 to SP403 are installed on the wall at the rear of the seating area, aligned from left to right.

[0025] However, in this invention, ceiling speakers SP301 to SP303 and surround speakers SP401 to SP403 are not essential components, and the number and location of installations are not limited to this example.

[0026] In this embodiment, the main speaker SP101 corresponds to the front fill speakers SP201 and SP202. The main speaker SP102 corresponds to the front fill speakers SP203 and SP204. The main speaker SP103 corresponds to the front fill speakers SP205 and SP206. In other words, the number of front fill speakers is greater than the number of main speakers, with two front fill speakers installed for each main speaker.

[0027] Furthermore, the main speaker and front fill speaker, which have the aforementioned correspondence, are installed in approximately the same position when viewed in the vertical direction. In other words, the main speaker and front fill speaker are installed in different positions in the height direction (vertical direction).

[0028] However, in this invention, the number and placement of main speakers and front fill speakers are not limited to this example. Specifically, main speakers do not necessarily have to be suspended from the ceiling. Also, front fill speakers do not necessarily have to be placed on the stage. Main speakers and front fill speakers do not have to be installed at different heights; they just need to be installed in different positions. Furthermore, three or more front fill speakers may be installed for each main speaker.

[0029] Furthermore, the main speakers and front fill speakers may be the same model or different models.

[0030] Furthermore, one or more subwoofers may be installed in room R1. The one or more subwoofers output sounds in a lower frequency range than the sounds output by the main speakers SP101~SP103 and the front fill speakers SP201~SP206. When multiple subwoofers are installed, it is preferable that these multiple subwoofers output the same sound signal as the sound signals output by the main speakers SP101~SP103 and the front fill speakers SP201~SP206, so as to localize them at the same position.

[0031] Figure 3 is a block diagram showing an example of the functional configuration of the processor 15. The number of input / output ports of the first signal processing unit 152 is greater than the number of input / output ports of the second signal processing unit 153. The first signal processing unit 152 generates sound signals to be output to, for example, the main speakers SP101~SP103, the ceiling speakers SP301~SP303, the surround speakers SP401~SP403, and the subwoofer SW501. The second signal processing unit 153 generates sound signals to be output to the front fill speakers SP201~SP206. In the example in Figure 3, one processor 15 functionally constitutes multiple signal processing units, but multiple processors may each constitute multiple signal processing units.

[0032] (Specific details of sound processing) Figure 4 is a flowchart showing the operation of the sound image localization processing device 1 according to the first embodiment.

[0033] The playback information acquisition unit 151 of the processor 15 acquires the sound source signal and sound source localization information received via the communication unit 11 (S001).

[0034] Figure 5 shows an example of playback information according to the first embodiment. As shown in Figure 5, the playback information is information indicating the type of sound source signal and localization information indicating the localization position of the sound source. The localization information is a three-dimensional logical coordinate system with a predetermined position as the origin. In the example in Figure 5, the localization information is a three-dimensional coordinate system, but it may also be a two-dimensional (plane) coordinate system. In this embodiment, the position indicated by the three-dimensional coordinate system in Figure 5 is the position of the sound source 1000 in Figure 2.

[0035] The playback information acquisition unit 151 may acquire the sound source signal and sound source localization information via the audio I / F 16 instead of the communication unit 11. The sound source signal and sound source localization information may also be stored in the flash memory 13. Furthermore, the user may input sound source localization information by selecting the desired location for sound localization from the schematic diagram of room R1 displayed on the display unit 12.

[0036] The first signal processing unit 152 of the processor 15 converts the acquired localization information into physical coordinates of the room R1, and performs a first localization process on the sound source signal based on the localization information and the position information of the main speakers SP101 to SP103 to generate a first sound signal so that the sound of the sound source is localized to the position indicated by the physical coordinates (S002).

[0037] The second signal processing unit 153 of the processor 15 converts the acquired localization information into physical coordinates of room R1, and performs a second localization process on the sound source signal based on the localization information and the position information of the front fill speakers SP201 to SP206 to generate a second sound signal so that the sound of the sound source is localized at the position indicated by the physical coordinates (S003).

[0038] Specifically, in the first localization process, based on localization information and the position information of the main speakers SP101 to SP103, the level balance of the sound signals output to the main speakers SP101 to SP103 is calculated and the level of the sound signals is adjusted to localize the sound image of the sound source signal to the corresponding position, thereby generating the first sound signal. The position information of the main speakers may be stored in the flash memory 13, or it may be input by the user of the sound image localization processing device 1 each time. In addition, the first signal processing device 152 may adjust the output timing of the sound signals output to the main speakers SP101 to SP103 so that the sound signals of the sound source signal are localized to the corresponding position.

[0039] In the second localization process, based on the localization information and the position information of the front fill speakers SP201 to SP206, the level balance of the sound signals output to the front fill speakers SP201 to SP206 is calculated and the level of the sound signals is adjusted to localize the sound image of the sound source signal to the corresponding position, thereby generating a second sound signal. The position information of the front fill speakers may be stored in the flash memory 13, or it may be input by the user of the sound image localization processing device 1 each time. In addition, the second signal processing device 153 may adjust the output timing of the sound signals output to the front fill speakers SP201 to SP206 so that the sound signals of the sound source signal are localized to the corresponding position.

[0040] As a result, the sound image localization processing device 1 can localize both the sound source of the first tone signal output from the main speakers SP101 to SP103 and the sound source of the second tone signal output from the front fill speakers SP201 to SP206 to the desired position (for example, the position of sound source 1000 shown in Figure 2).

[0041] Here, the main speakers SP101-SP103 installed in room R1 need to output sound to the entire audience area. For example, in the example in Figure 2, the main speakers SP101-SP103 are suspended from the ceiling. Therefore, depending on the installation of the main speakers SP101-SP103, the sound output from the main speakers SP101-SP103 may be unclear to listeners in the front of the audience area (for example, the shaded area in Figure 2). Therefore, the front fill speakers SP201-206 are installed to deliver sound to listeners in the front of the audience area. In this case, listeners in the front of the audience area will mainly hear the sound output from the front fill speakers SP201-SP206. However, in conventional technology, sound localization processing was not applied to the sound output from the front fill speakers. Therefore, the sound heard by listeners in the front of the audience area lacked a sense of localization.

[0042] When the sound image localization position of the sound source signal moves, for example, from the back of the audience to the front of the audience, when the sound image localization position is at the back of the audience, the sound heard by the listener is mainly the clear sound with a sense of localization output from the main speakers SP101~103, ceiling speakers SP301~SP303, and surround speakers SP401~SP403. On the other hand, when the sound image localization position is at the front of the audience, the sound heard by the listener is mainly the unclear sound with a sense of localization output from the front fill speakers SP201~206. In other words, when the sound image localization position of the sound source signal moves from the back of the audience to the front of the audience, listeners sometimes feel as if they have suddenly lost their sense of sound localization.

[0043] However, the sound localization processing device 1 of this embodiment can output the same sound source signal from main speakers SP101~SP103 (first speaker group) and front fill speakers SP201~SP206 (second speaker group), which have different output areas, in a single acoustic space, so as to localize it to the same position. Therefore, a listener in the front of the audience seating area, as shown in the shaded area of ​​Figure 2, will hear a sound with a clear sense of sound localization output from the second speaker group. Similarly, a listener in the back of the audience seating area will hear a sound with a clear sense of sound localization output from the first speaker group. Furthermore, even if a listener in the back of the audience seating area moves beyond the output area of ​​the first speaker group to the front of the audience seating area, the listener will always hear a sound localized to the sound source 1000. Also, even when the sound source is located in the back of the audience seating area, the sense of localization of the sound output from the front fill speakers can be clearly perceived. In other words, the sound localization processing device 1 can suppress the decrease in localization caused by speaker placement conditions, listener movement, and sound source movement in the acoustic space.

[0044] Furthermore, since the second group of speakers is installed on the stage, it emits sound from a location close to the performers on stage. Therefore, listeners in the front of the audience can enjoy a more immersive listening experience.

[0045] Furthermore, the first sound signal described above may include not only direct sound but also indirect sound. The indirect sound referred to here corresponds to the first indirect sound of the present invention and includes the first early reflection and the first late reverberation.

[0046] Similarly, the second tone signal described above may include not only direct sound but also indirect sound. The indirect sound referred to here corresponds to the second indirect sound of the present invention and includes a second early reflection and a second late reverberation.

[0047] In this case, the first signal processing unit 152 calculates the level balance of the sound signals output to the main speakers SP101 to SP103 so that the sound image of each sound source of the first early reflections is localized to the corresponding position, based on localization information and the position information of the main speakers, and generates the first early reflections by adjusting the level of the sound signals. Similarly, the second signal processing unit 153 calculates the level balance of the sound signals output to the front fill speakers SP201 to SP206 so that the sound image of each sound source of the second early reflections is localized to the corresponding position, based on localization information and the position information of the front fill speakers, and generates the second early reflections by adjusting the level of the sound signals.

[0048] Furthermore, in order to reduce the burden on signal processing, the second signal processing unit 153 may receive the first early reflection from the first signal processing unit 152 and output the received first early reflection as the second early reflection.

[0049] The first signal processing unit 152 and the second signal processing unit 153 generate the first rear reverberation and the second late reverberation, respectively, by convolving the impulse response data of room R1 into the sound source signal. The impulse response data is measured, for example, by emitting a test tone (pulse tone) at the position of the sound source 1000 in room R1 and capturing it with a measurement microphone (not shown). Alternatively, the impulse response may be obtained by simulation based on, for example, the sound ray method or the virtual image method. The sound ray method is a method of tracking the trajectory (sound ray) of sound radiated from the sound source and calculating the time pattern of the energy of the sound ray passing through the listening position. A simulation using the sound ray method determines the direction from each virtual sound source, arrival time, and arrival level at the listening position, based on the energy of the sound ray in the listening region, assuming that each sound ray is a virtual sound image of the reverberation. The virtual image method is a technique that creates virtual sound sources (virtual sound sources) as virtual sound sources against the walls of space, and determines the direction, arrival time, and arrival level from each virtual sound source at the listening position. The first signal processing unit 152 and the second signal processing unit 153 may generate impulse responses of head-related transfer functions that represent the direction, arrival time, and arrival level of each virtual sound source obtained by simulation, and perform processing to localize indirect sound by convolving these impulse responses into the sound source signal. The impulse response data may be stored in the flash memory 13. Alternatively, the impulse response data may be downloaded from a server (not shown) or the like each time.

[0050] Here, we will explain the impulse response data. Figure 6 is a schematic diagram showing an example of classifying sound types in the time waveform of impulse response data. The horizontal axis of the graph is time, and the vertical axis is amplitude. As shown in Figure 6, the impulse response can be distinguished into direct sound, early reflections, and reverberation, which are arranged on the time axis. In this case, the first signal processing unit 152 and the second signal processing unit 153 acquire the impulse response data containing the direct sound, early reflections, and reverberation, and extract the early reflections and reverberation, respectively, and convolve them into the sound source signal. Alternatively, the first signal processing unit 152 and the second signal processing unit 153 may perform processing to localize indirect sound by applying level delay filtering to the sound source signal, which has delay and attenuation amounts corresponding to each virtual sound source obtained by simulation.

[0051] Furthermore, the first signal processing unit 152 and the second signal processing unit 153 may generate the first and second rear reverberations by adding the user's preferred reverb to the sound source signal.

[0052] Furthermore, the second indirect sound does not necessarily have to include the second rear reverberation. In other words, the second signal processing unit 153 does not generate the second rear reverberation, and only the second direct sound and the second early reflections are output from the front fill speakers. Early reflections are sounds with a fixed direction of arrival and phase, but rear reverberation has a random direction of arrival and phase, so even if the reverberation is output only from the main speakers, it will not cause any discomfort to the listeners throughout the venue.

[0053] 《Second Embodiment》 Figure 7 is a schematic transmission perspective view of room R1, which is an example of an acoustic space according to the second embodiment. Figure 8 is a flowchart showing the operation of the sound image localization processing device 1A according to the second embodiment.

[0054] The sound image localization processing device 1A according to the second embodiment differs from the sound image localization processing device 1 in that it further has a function to determine a speaker that outputs a sound signal according to the sound image localization position of the sound source signal.

[0055] The first signal processing unit 152 of the sound image localization processing device 1A assigns the sound source signal to the first group of main speakers based on the localization information of the sound source signal and the position information of the main speakers (S011).

[0056] Specifically, the first signal processing unit 152 determines the main speaker to output the sound source signal according to the localization position of the acquired sound source signal and assigns it to the first group. The first signal processing unit 152 determines the main speaker based, for example, on information indicating the correspondence between the localization position of the sound source signal and the main speaker to output the sound source signal, which is stored in the flash memory 13. In the example in Figure 7, the sound source 2000, which indicates the localization position of the sound source signal, is located on the left side of the stage. In this case, the first signal processing unit 152 assigns, for example, main speaker SP101 and main speaker SP102 to the first group. Alternatively, the user may specify the main speaker to output the sound source signal via the user I / F 17, according to the localization position of the sound source signal.

[0057] The second signal processing unit 153 of the sound image localization processing device 1A assigns the sound source signal to the second group of front fill speakers based on the localization information of the sound source signal and the position information of the front fill speakers (S012).

[0058] Specifically, the second signal processing unit 153 determines the front fill speaker that outputs the sound source signal according to the localization position of the acquired sound source signal and assigns it to the second group. The second signal processing unit 153 determines the front fill speaker based, for example, on information indicating the correspondence between the main speaker and the front fill speaker stored in the flash memory 13.

[0059] Figure 9 shows an example of information indicating the correspondence between the main speaker and the front fill speakers. In this case, the second signal processing unit 153 assigns the main speaker SP101, which is assigned to the first group, and the front fill speakers SP201 to SP204, which have a correspondence with the main speaker SP102, to the second group. Alternatively, the user may specify the front fill speaker to output the sound source signal via the user I / F 17, depending on the localization position of the sound source signal.

[0060] This allows the user of the sound image localization processing device 1A to localize the first and second sound signals to the position of the sound source 2000, while limiting the range in which the first and second sound signals are output to the range shown in the shaded area of ​​Figure 7.

[0061] Note that the correspondence between main speakers and front fill speakers is not limited to the example in Figure 9. In the example above, one main speaker is shown to correspond to two front fill speakers, but the number of front fill speakers corresponding to one main speaker does not have to be two. Specifically, one main speaker may correspond to three or more front fill speakers. Also, two main speakers may correspond to three front fill speakers.

[0062] Figure 10 shows an example of information indicating the correspondence between main speakers and front fill speakers. As shown in Figure 10, main speakers SP101 and SP102 correspond to front fill speakers SP201 to SP203. Also, main speakers SP102 and SP103 correspond to front fill speakers SP204 to SP206. As shown in Figure 7, when the sound source 2000 is located on the left side of the stage, the first signal processing unit 152 assigns, for example, main speakers SP101 and SP102 to the first group, and the second signal processing unit 153 assigns front fill speakers SP201 to SP203 to the second group.

[0063] Thus, the sound image localization processing device 1A can flexibly set the speaker that outputs the sound signal according to the position where the sound source signal is localized. Furthermore, the user of the sound image localization processing device 1A can intuitively control the range of the sound field created according to the position where the sound source signal is localized.

[0064] The description of this embodiment should be considered in all respects to be illustrative and not restrictive. The scope of the invention is indicated by the claims, rather than by the embodiments described above. Furthermore, the scope of the invention includes the scope equivalent to the claims. [Explanation of Symbols]

[0065] 1,1A: Sound localization processing unit, 11: Communication unit, 12: Display unit, 13: Flash memory, 14: RAM, 15: Processor, 16: Audio I / F, 17: User I / F, 151: Playback information acquisition unit, 152: First signal processing unit, 153: Second signal processing unit, 1000,2000: Sound source, SP101~SP103: Main speakers, SP201~SP206: Front fill speakers, SP301~SP303: Ceiling speakers, SP401~SP403: Surround speakers, SW501: Subwoofer

Claims

1. A sound image localization processing method in a sound image localization system having a first group of speakers installed in an acoustic space, a second group of speakers installed in the acoustic space at a different position from the first group of speakers, a first signal processing unit that generates a first sound signal to be output to the first group of speakers, and a second signal processing unit that generates a second sound signal to be output to the second group of speakers, The first signal processing unit and the second signal processing unit are input to the sound source signal and localization information of the same sound source. The first signal processing unit is instructed to perform a first localization process on the sound source signal based on the localization information and the position information of the first speaker group so that the sound of the sound source is localized to the position indicated by the localization information, thereby generating the first sound signal. The second signal processing unit is instructed to perform a second localization process on the sound source signal based on the localization information and the position information of the second speaker group, so that the sound of the sound source is localized to the position indicated by the localization information, and generate the second sound signal. A sound image localization processing method characterized by the following:

2. The first speaker group and the second speaker group are installed at different positions in the height direction. The sound image localization processing method according to claim 1.

3. Based on the localization information and the position information of the first speaker group, the sound source signal is assigned to the first group of the first speaker group and the first localization processing is performed. Based on the localization information and the position information of the second speaker group, the sound source signal is assigned to the second group of the second speaker group and the second localization processing is performed. The sound image localization processing method according to claim 1 or claim 2.

4. The number of the second speaker group is greater than the number of the first speaker group. Multiple second speakers from the second speaker group are installed in correspondence with one first speaker from the first speaker group. The sound image localization processing method according to claim 1 or claim 2.

5. The first localization process includes localization processing of the first direct sound and the first indirect sound of the sound source signal. The second localization process includes localization processing of the second direct sound and the second indirect sound of the sound source signal. The sound image localization processing method according to claim 1 or claim 2.

6. The first indirect sound includes a first early reflection and a first rear reverberation. The second indirect sound includes a second early reflection and a second rear reverberation. The sound image localization processing method according to claim 5.

7. The first indirect sound includes a first early reflection and a first rear reverberation. The aforementioned second indirect sound includes a second early reflection. The sound image localization processing method according to claim 5.

8. A sound image localization processing device in a sound image localization system having: a first group of speakers installed in an acoustic space; a second group of speakers installed in the acoustic space at a different position from the first group of speakers; a first signal processing unit that generates a first sound signal to be output to the first group of speakers; and a second signal processing unit that generates a second sound signal to be output to the second group of speakers, A playback information acquisition unit inputs the sound source signal of the same sound source and the localization information of the sound source to the first signal processing unit and the second signal processing unit, The first signal processing unit causes the first signal processing unit to perform a first localization process on the sound source signal based on the localization information and the position information of the first speaker group so that the sound of the sound source is localized to the position indicated by the localization information, and generates the first sound signal. The second signal processing unit generates a second sound signal by performing a second localization process on the sound source signal based on the localization information and the position information of the second speaker group, so that the sound of the sound source is localized to the position indicated by the localization information. Equipped with, A sound image localization processing device characterized by the following:

9. The first speaker group and the second speaker group are installed at different positions in the height direction. The sound image localization processing device according to claim 8.

10. The first signal processing unit performs the first localization processing by assigning the sound source signal to the first group of the first speaker group based on the localization information and the position information of the first speaker group. The second signal processing unit performs the first localization processing by assigning the sound source signal to the second group of the second speaker group based on the localization information and the position information of the second speaker group. The sound image localization processing device according to claim 8 or claim 9.

11. The number of the second speaker group is greater than the number of the first speaker group. Multiple second speakers from the second speaker group are installed in correspondence with one first speaker from the first speaker group. The sound image localization processing device according to claim 8 or claim 9.

12. The first localization process includes localization processing of the first direct sound and the first indirect sound of the sound source signal. The second localization process includes localization processing of the second direct sound and the second indirect sound of the sound source signal. The sound image localization processing device according to claim 8 or claim 9.

13. The first indirect sound includes a first early reflection and a first rear reverberation. The second indirect sound includes a second early reflection and a second rear reverberation. The sound image localization processing device according to claim 12.

14. The first indirect sound includes a first early reflection and a first rear reverberation. The aforementioned second indirect sound includes a second early reflection. The sound image localization processing device according to claim 12.

Images