Sound field support method and sound field support device

Abstract

To enable comparison between a sound of a virtual sound source and a simulated reproduced sound emitted in an object space.SOLUTION: A sound field support method selects either position information of a sound source set in a virtual space or localization information of a sound source when the sound of the sound source is simulated with the output sound from a speaker set in a target space, and the sound based on the selected position information and localization information is used to adjust the sound image localization of the sound source by the speaker.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] An embodiment of the present invention relates to a sound field support method and sound field support device that perform processing to simulate a sound field caused by a sound source set in a virtual space, in a target space in which speakers are arranged. [Background technology]

[0002] Various technologies have been devised to simulate the sound of a virtual space in the real world.

[0003] For example, the simulation system disclosed in Patent Document 1 sets the positions of multiple virtual speakers so that they follow changes in the viewer's position while maintaining their relative positional relationship with the viewer in the virtual space. Furthermore, the simulation system disclosed in Patent Document 1 sets the volume balance of the multiple virtual speakers.

[0004] The simulation system disclosed in Patent Document 1 executes sound processing using multiple virtual speakers based on these settings. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2017-184174 A Summary of the Invention [Problem to be solved by the invention]

[0006] However, when a sound set using a virtual sound source (the virtual speaker in Patent Document 1) is emitted in a target space, the sound is emitted by a speaker that is placed in the target space and to which the virtual sound source is assigned. In other words, the sound emitted in the target space is a simulation of the sound of the virtual sound source by the sound of the speaker.

[0007] Conventionally, it has not been possible to compare the sound from a virtual sound source with the sound simulated by speakers in a target space (simulated playback sound). Therefore, viewers have been unable to check to what extent the simulated playback sound has simulated the sound from the virtual sound source, and have been unable to make adjustments easily.

[0008] Therefore, an object of one embodiment of the present invention is to make it possible to compare the sound of a virtual sound source with a simulated reproduced sound. [Means for solving the problem]

[0009] The sound field support method selects either position information of a sound source set in a virtual space or localization information of the sound source when simulating the sound of the sound source with output sound from a speaker set in a target space, and adjusts the sound image localization of the sound source by the speaker using sound based on the selected position information and localization information. Effect of the Invention

[0010] The sound field assistance method allows the listener to compare the sound of a virtual sound source with the simulated reproduced sound. [Brief description of the drawings]

[0011] [Figure 1] 1 is a functional block diagram showing a configuration of a sound field support system including a sound field support device according to a first embodiment of the present invention. [Diagram 2] FIG. 1 is a diagram showing an example of the positional relationship between a sound source, a listening point, and multiple speakers in the sound field support method according to the first embodiment of the present invention, showing the position coordinates of the sound source, the position coordinates of the listening point, and the position coordinates of multiple speakers. [Diagram 3] FIG. 13 is a diagram showing an image of sound being emitted from a sound source, and a diagram showing an image of the sound source being rendered to a speaker and emitted as sound. [Figure 4] 5 is a flowchart showing a first method of the sound field assistance method according to the first embodiment of the present invention. [Diagram 5] 5 is a flowchart showing a second method of the sound field assistance method according to the first embodiment of the present invention. [Figure 6]FIG. 13 is a diagram illustrating an example of a GUI for adjusting parameters. [Figure 7] FIG. 11 is a functional block diagram showing a configuration of a sound field support system including a sound field support device according to a second embodiment of the present invention. [Figure 8] FIG. 11 is a diagram showing an example of the positional relationship among a sound source, a listening point, multiple speakers, and a virtual space in a sound field support method according to a second embodiment of the present invention. [Figure 9] FIG. 13 is a diagram showing an example of a GUI for adjusting the spread and localization of sound. [Figure 10] 10 is a flowchart showing a sound field assistance method according to a second embodiment of the present invention. [Figure 11] FIG. 11 is a functional block diagram showing a configuration of a sound field support system including a sound field support device according to a third embodiment of the present invention. [Figure 12] 13 is a flowchart showing a sound field assistance method according to a third embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] A sound field support method and a sound field support device according to an embodiment of the present invention will be described with reference to the drawings.

[0013] In this embodiment, the target space is a space where a viewer actually listens to the sound of a sound source set in a virtual space using a speaker or the like. More specifically, in the sound field assistance method of this embodiment, the target space does not mean a space where a speaker is actually placed, but a space where a speaker is placed and a viewer is expected to listen to the sound from the speaker. The virtual space is a space where a sound source to be simulated in the target space is set.

[0014] [First embodiment] Fig. 1 is a functional block diagram showing a configuration of a sound field support system including a sound field support device according to a first embodiment of the present invention. Fig. 2(A) is a diagram showing an example of the positional relationship between a sound source, a listening point, and multiple speakers in a sound field support method according to the first embodiment of the present invention, and Fig. 2(B) is a diagram showing the position coordinates of the sound source, the position coordinates of the listening point, and the position coordinates of multiple speakers in the case of Fig. 2(A). Fig. 3(A) is a diagram showing an image of sound being emitted from a sound source, and Fig. 3(B) is a diagram showing an image of sound being rendered to a speaker and emitted.

[0015] 2(A), a listening point 900 from which a viewer listens and a plurality of speakers SP1-SP5 are arranged in a target space 90. A virtual space is set in this target space 90. A sound source OBJ is set in the virtual space.

[0016] In the description of this embodiment, the number of sound sources is one, but the number of sound sources may be multiple. When the number of sound sources is multiple, the sound field support method described below may be applied to each of the multiple sound sources. Alternatively, the sound field support method described below may be applied to multiple sound sources collectively. In the description of this embodiment, the case of one sound source is described. Also, in the description of this embodiment, the number of speakers is five, but the number of speakers is not limited to this.

[0017] The coordinate system of the target space 90 and the coordinate system of the virtual space are set, for example, so that the directions of the three orthogonal axes and the center points are the same. In this case, the position coordinates according to the coordinate system in the target space 90 and the position coordinates according to the coordinate system of the virtual space are the same. Note that even if the coordinate system of the target space 90 and the coordinate system of the virtual space do not match, in this case, it is sufficient that a coordinate transformation matrix between the target space 90 and the virtual space is set.

[0018] 1, the sound field support system includes a sound field support device 10 and headphones 80. The sound field support device 10 includes a listening point setting unit 21, a sound source position setting unit 22, a speaker position setting unit 23, an adjustment operation unit 29, a simulated playback sound signal generating unit 30, a selection unit 40, and a binaural processing unit 50. The sound field support device 10 is realized by a program that executes each of the above-mentioned functional units, a storage medium that stores the program, and a calculation processing unit such as a CPU that executes the program.

[0019] The listening point setting unit 21 sets the position coordinates Pr of the listening point 900 in the target space 90. The listening point setting unit 21 outputs the position coordinates Pr of the listening point 900 to the simulated reproduction sound signal generating unit 30 and the binaural processing unit 50.

[0020] The sound source position setting unit 22 sets the position coordinates Pobj of the sound source OBJ in the virtual space (more specifically, the position coordinates of the sound source in the virtual space projected onto the target space 90). The sound source position setting unit 22 outputs the position coordinates Pobj of the sound source OBJ to the simulated reproduction sound signal generating unit 30 and the binaural processing unit 50.

[0021] The speaker position setting unit 23 sets position coordinates Psp1-Psp5 of the multiple speakers SP1-SP5 in the target space 90. The speaker position setting unit 23 outputs the position coordinates Psp1-Psp5 of the multiple speakers SP1-SP5 to the simulated reproduction sound signal generation unit 30 and the binaural processing unit 50.

[0022] The adjustment operation unit 29 receives an input of an adjustment parameter and outputs the adjustment parameter to the simulated reproduction sound signal generation unit 30.

[0023] The simulated reproduction sound signal generating unit 30 generates a simulated reproduction sound signal to be output to the speakers SP1-SP5 in the target space 90 from the object reproduction sound signal.

[0024] Here, the object reproduction sound signal is a sound signal output from the sound source OBJ. The simulated reproduction sound signal is a sound signal for performing sound image localization of the sound source OBJ by a speaker that renders the sound source OBJ.

[0025] More specifically, the simulated reproduction sound signal generator 30 calculates the positional relationship between the position coordinate Pobj of the sound source OBJ and the position coordinates Psp1-Psp5 of the multiple speakers SP1-SP5, using the position coordinate Pr of the listening point 900 as a reference point. The simulated reproduction sound signal generator 30 uses this positional relationship to set sound image localization information of the sound source OBJ. The sound image localization information is information that sets the sound output from the multiple speakers SP1-SP5 so that sound is emitted from the sound source OBJ at the listening point 900, and is information that determines the volume and output timing of the output sound from the multiple speakers SP1-SP5.

[0026] The simulated reproduction sound signal generation unit 30 uses the sound image localization information of the sound source OBJ to set multiple speakers for rendering the sound source OBJ (see FIG. 3(B)). The simulated reproduction sound signal generation unit 30 generates a simulated reproduction sound signal to be reproduced by the multiple speakers on which the sound source OBJ has been rendered. The simulated reproduction sound signal generation unit 30 outputs the simulated reproduction sound signal to the selection unit 40.

[0027] The selection unit 40 receives an operation input from a viewer or the like, and selects an object reproduction sound signal and a simulated reproduction sound signal. More specifically, when a setting for listening to sound directly output from a sound source OBJ set in a virtual space (the state of FIG. 3(A)) is selected, the selection unit 40 selects and outputs the object reproduction sound signal. On the other hand, when a setting for listening to sound from a plurality of rendered speakers (the state of FIG. 3(B)) is selected, the selection unit 40 selects and outputs the simulated reproduction sound signal. In other words, when position information of the sound source OBJ is selected, the object reproduction sound signal is selected and output, and when position information of the sound source OBJ using speakers is selected, the simulated reproduction sound signal is selected and output.

[0028] The selection unit 40 outputs the selected sound signal to the binaural processing unit 50.

[0029] The binaural processing unit 50 performs binaural processing on the sound signal selected by the selection unit 40. Note that the binaural processing uses a head-related transfer function, and the details of the binaural processing are known, so a detailed description of the binaural processing will be omitted.

[0030] More specifically, when the selection unit 40 selects the object reproduction sound signal, the binaural processing unit 50 performs binaural processing on the sound signal of the sound source OBJ, using the position coordinate Pobj of the sound source OBJ and the position coordinate Pr of the listening point 900. When the selection unit 40 selects the simulated reproduction sound signal, the binaural processing unit 50 performs binaural processing on the simulated reproduction sound signal, using the position coordinate Psp of the speaker SP where the sound source OBJ is rendered, and the position coordinate Pr of the listening point 900.

[0031] 2(A), 2(B), 3(A), and 3(B), when the selection unit 40 selects the object reproduction sound signal, the binaural processing unit 50 performs binaural processing on the object reproduction sound signal using the position coordinate Pobj of the sound source OBJ and the position coordinate Pr of the listening point 900. When the selection unit 40 selects the simulated reproduction sound signal, the binaural processing unit 50 performs binaural processing on the simulated reproduction sound signal using the position coordinates Psp1, Psp5 of the speakers SP1, SP5 at which the sound source OBJ is rendered and the position coordinate Pr of the listening point 900.

[0032] The binaural processing unit 50 outputs the sound signal that has been subjected to the binaural processing (binaural signal) to the headphones 80.

[0033] The headphones 80 reproduce and emit sound based on binaural sound signals. Note that, although the present embodiment has been described as using the headphones 80 to emit sound, it is also possible to emit sound using two-channel stereo speakers.

[0034] With this configuration, when an object reproduction sound signal is selected, the viewer can hear a sound (object reproduction sound) in which the sound source is localized at the position of the sound source OBJ through the headphones 80. On the other hand, when a simulated reproduction sound signal is selected, the viewer can hear a sound (simulated reproduction sound) in which the sound source is simulated and localized at the position of the sound source OBJ by a speaker rendered on the sound source OBJ through the headphones.

[0035] This allows the viewer to compare the object playback sound and the simulated playback sound without actually placing speakers in the real space. Therefore, the viewer can directly experience the difference between the object playback sound and the simulated playback sound, and can judge whether the simulated playback sound accurately reproduces (simulates) the object playback sound and whether there is any discomfort between the object playback sound and the simulated playback sound.

[0036] Furthermore, the viewer can adjust the parameters for adjusting the simulated playback sound signal by referring to such a bodily sensation result. Then, by repeating such parameter adjustment, the viewer can accurately reproduce the object playback sound by the simulated playback sound.

[0037] Here, a mode of adjusting the simulated playback sound signal has been shown in order to reproduce the sound of the sound source OBJ with high accuracy. However, for example, in a case where it is difficult to change the position of the speaker in the target space 90 or change the parameter settings, but it is possible to change the position settings of the sound source OBJ, the viewer can change the settings of the sound source OBJ by listening to the binaurally processed sound described above, and realize a desired sound field.

[0038] (Sound field support method 1 of the first embodiment) Fig. 4 is a flowchart showing a first method of the sound field support method according to the first embodiment of the present invention. The sound field support method shown in Fig. 4 is executed up to outputting a sound signal subjected to binaural processing. Since the detailed explanation of each process shown in Fig. 4 has been given above, detailed explanation will be omitted below. In addition, the following will be described by taking the arrangements shown in Figs. 2(A), 2(B), 3(A), and 3(B) as examples.

[0039] The sound source position setting unit 22 sets the position of the sound source OBJ in the virtual space (S11). The speaker position setting unit 23 sets the positions of the speakers SP1-SP5 in the target space (S12).

[0040] The simulated reproduction sound signal generation unit 30 renders the sound source OBJ on the speakers SP1 and SP5 using the position coordinate Pobj of the sound source OBJ, the position coordinates Psp1-Psp5 of the speakers SP1-SP5, and the position coordinate Pr of the listening point 900 (S13). The simulated reproduction sound signal generation unit 30 generates a simulated reproduction sound signal using the rendering result (S14).

[0041] The selection unit 40 selects the object reproduction sound signal and the simulated reproduction sound signal according to an operation by the viewer or the like (S15). For example, the sound field supporting device 10 is provided with a GUI (Graphical User Interface) or the like. The GUI is provided with an operator for selecting a sound signal to be reproduced. If the viewer selects output of the object reproduction sound signal, the selection unit 40 selects the object reproduction sound signal (S150: YES). If the viewer selects output of the simulated reproduction sound signal, the selection unit 40 selects the simulated reproduction sound signal (S150: NO). Note that the selection between the object reproduction sound signal and the simulated reproduction sound signal can be automatically switched according to a switching time set by setting the switching time.

[0042] The binaural processing unit 50 performs binaural processing on the selected sound signal to generate a binaural signal. More specifically, if an object reproduction sound signal is selected, the binaural processing unit 50 performs binaural processing on the object reproduction sound signal to generate a binaural signal of the object reproduction sound signal (S161). If a simulated reproduction sound signal is selected, the binaural processing unit 50 performs binaural processing on the simulated reproduction sound signal to generate a binaural signal of the simulated reproduction sound signal (S162).

[0043] The headphones 80 reproduce the binaural signal (S17). More specifically, if the binaural signal of the object reproduction sound signal is input, the headphones 80 reproduces the binaural signal. If the binaural signal of the simulated reproduction sound signal is input, the headphones 80 reproduces the binaural signal.

[0044] By performing such processing, the sound field assistance method can selectively provide object reproduction sound and simulated reproduction sound to a viewer or the like.

[0045] (Sound field support method 2 of the first embodiment) Fig. 5 is a flowchart showing a second method of the sound field supporting method according to the first embodiment of the present invention. The sound field supporting method shown in Fig. 5 is obtained by adding parameter adjustment to the sound field supporting method shown in Fig. 4. Note that a description of the same processing in Fig. 5 as that shown in Fig. 4 will be omitted. In the following, the arrangements shown in Figs. 2(A), 2(B), 3(A), and 3(B) will be described as examples.

[0046] The sound field support method shown in FIG. 5 executes the same processes as the sound field support method shown in FIG. 4 up to step S17.

[0047] The viewer executes the processes from step S15 to step S17 to switch the sound signal to be reproduced, whereby the viewer hears the sound of the binaural signal of the object reproduction sound signal and the sound of the binaural signal of the simulated reproduction sound signal, and compares these sounds.

[0048] If parameter adjustment is not required (S23: NO), that is, if the sound of the binaural signal of the simulated playback sound signal can accurately reproduce the sound of the binaural signal of the object playback sound signal, the process ends. If parameter adjustment is required (S23: YES), the viewer adjusts the parameters using the adjustment operation unit 29 (S24). The simulated playback sound signal generation unit 30 generates the simulated playback sound signal using the adjusted parameters (S14).

[0049] The parameters to be adjusted include, for example, rendering settings for the sound source OBJ and the speaker, the volume level of the simulated playback sound signal, frequency characteristics, etc. Fig. 6 is a diagram showing an example of a GUI for adjusting parameters. As shown in Fig. 6, the GUI 100 includes a positional relationship confirmation window 111, a waveform confirmation window 112, and a plurality of operators 113. Each of the plurality of operators 113 includes a knob 1131 and an adjustment value display window 1132.

[0050] The positional relationship confirmation window 111 displays the sound sources OBJ1-OBJ3 and the multiple speakers SP1-SP5 at their respective set position coordinates. The speaker SP to be assigned to the sound source OBJ can be set, for example, by selecting the sound source OBJ and the speaker SP to be rendered in the positional relationship confirmation window 111.

[0051] The waveform confirmation window 112 displays the waveform of the simulated reproduced sound signal. The simulated reproduced sound signal to be displayed can be selected by, for example, selecting one of the multiple speakers SP1-SP5 displayed in the positional relationship confirmation window 111.

[0052] The multiple operators 113 are operators that accept, for example, the Q of the simulated reproduction sound signal, filter processing settings, gain value settings, etc., for each of multiple frequency bands (Hi, Mid, Low). The knob 1131 accepts operations from the viewer, and the adjustment value display window 1132 displays the numerical value set by the knob 1131. The parameters of the simulated reproduction sound signal are adjusted by the operation input from the multiple operators 113. Then, a waveform based on these adjusted parameters is displayed in the waveform confirmation window 112.

[0053] The viewer can adjust and set parameters by operating this GUI 100 while viewing it.

[0054] Thereafter, the viewer adjusts the parameters while listening to and comparing the sound produced by the binaural signal of the object playback sound signal and the sound produced by the binaural signal of the simulated playback sound signal. This allows the viewer to adjust the sound produced by the binaural signal of the simulated playback sound signal so that the sound produced by the binaural signal of the object playback sound signal is accurately reproduced, that is, so that the simulated playback sound produced by the speaker accurately simulates the object playback sound of the sound source OBJ. The "adjustment unit" of the present invention is realized by the means for outputting and comparing the object playback sound and the simulated playback sound, and the adjustment operation unit 29.

[0055] The sound field support device 10 and the sound field support method of the present embodiment show a mode in which an object reproduction sound by binaural reproduction is compared with a simulated reproduction sound. However, the sound field support device 10 and the sound field support method of the present embodiment can also adjust parameters by comparing, for example, a waveform, a frequency spectrum, and HOA (Higher Order Ambisonics) of an object reproduction sound signal with a waveform, a frequency spectrum, and HOA (Higher Order Ambisonics) of a simulated reproduction sound signal.

[0056] [Second embodiment] A sound field support device and a sound field support method according to a second embodiment of the present invention will be described with reference to the drawings.

[0057] Fig. 7 is a functional block diagram showing a configuration of a sound field support system including a sound field support device according to a second embodiment of the present invention. Fig. 8 is a diagram showing an example of the positional relationship between a sound source, a listening point, multiple speakers, and a virtual space in the sound field support method according to the second embodiment of the present invention.

[0058] 7, the sound field support device 10A according to the second embodiment differs from the sound field support device 10 according to the first embodiment in that a reverb processing unit 60 is added. Other configurations of the sound field support device 10A are similar to those of the sound field support device 10, and descriptions of similar parts will be omitted.

[0059] The sound field supporting device 10A includes a reverberation processor 60. The reverberation processor 60 receives an object reproduction sound signal and a simulated reproduction sound signal.

[0060] The reverberation processing unit 60 generates an early reflection sound signal and a reverberation sound signal using information on the virtual space 99. The early reflection sound signal is a sound signal that simulates the sound of the sound source OBJ that is reflected (first reflection) by the wall of the virtual space and reaches the listening point. The early reflection sound signal is determined by the geometric shape of the virtual space, the position of the sound source OBJ in the virtual space, and the position of the listening point. The reverberation sound signal is a sound signal that simulates the sound that is reflected multiple times in the virtual space and reaches the listening point. The reverberation sound signal is determined by the geometric shape of the virtual space and the position of the listening point in the virtual space.

[0061] More specifically, the reverberation processor 60 generates an early reflection sound signal and a reverberation sound signal for the object reproduction sound signal by using the position information of the sound source OBJ, the information of the virtual space 99, and the position information of the listening point. The reverberation processor 60 adds the generated early reflection sound signal and the reverberation sound signal to the object reproduction sound signal, and outputs the result to the selector 40.

[0062] The reverberation processor 60 generates an early reflection sound signal and a reverberation sound signal for the simulated reproduction sound signal using the position information of the sound source OBJ, the position information of the speakers SP1 to SP5, the information of the virtual space 99, and the position information of the listening point. As a specific example, the reverberation processor 60 sets a virtual sound source that simulates the generation position of the early reflection sound for the sound source OBJ based on the position information of the sound source OBJ and the listening point and the information of the virtual space 99. The reverberation processor 60 generates an early reflection sound signal based on the positional relationship between the virtual sound source and the speaker SP to which the virtual sound source is assigned. The reverberation processor 60 generates a reverberation sound signal using the geometric shape of the virtual space and the position of the listening point in the virtual space. The reverberation processor 60 adds the early reflection sound signal and the reverberation sound signal thus generated to the simulated reproduction sound signal and outputs the signal to the selection unit 40.

[0063] With this configuration, the sound field support device 10A can add reverb components (early reflection sounds and reverberation sounds) to the object reproduction sound (sound from the sound source OBJ) and the simulated reproduction sound (sound simulated by the speaker) and output them. This allows the listener to judge the accuracy of the reproduction of the object reproduction sound by the simulated reproduction sound, taking into account the reverb components.

[0064] Furthermore, the reverberation processor 60 can also impart a sense of spread and localization to the early reflection sound signal and the reverberation sound signal of the simulated reproduction sound signal. In this case, the listener can make adjustments using, for example, a GUI as shown in FIG. 9. FIG. 9 is a diagram showing an example of a GUI for adjusting the spread and localization of sound. As shown in FIG. 9, the GUI 100A includes a setting display window 111A, an output status display window 115, and a plurality of operators 116. The plurality of operators 116 includes a knob 1161 and an adjustment value display window 1162.

[0065] The setting display window 111A displays the virtual sound source SS, the multiple speakers SP, the virtual space 99, and the listening point RP set for the sound source OBJ, with their respective set position coordinates.

[0066] The multiple operators 116 are operators for setting weight volumes for setting weight values, shape volumes for setting shape values, etc. The operators 116 for weight volumes include operators 116 for setting left / right weights, front / rear weights, and up / down weights, each of which includes an operator for setting a gain value and an operator for setting a delay amount. The operators 116 for shape volumes include an operator for setting spread, an operator for setting a gain value, and an operator for setting a delay amount. The listener can adjust the spread and localization of the sound by operating the multiple operators 116.

[0067] The output status display window 115 graphically and typically displays the sound spread and localization achieved by the weight values ​​and shape values ​​set by the multiple operators 116. This allows the user to easily recognize as an image the sound spread and localization set by the multiple operators 116. Note that when binaurally processed sound is listened to through headphones 80, the output status display window 115 can also display an image representing a head in combination with an image expressing the sound spread and localization in accordance with the image of the head.

[0068] This allows the viewer to judge the accuracy of the reproduction of the object reproduction sound by the simulated reproduction sound, taking into consideration the spread and localization of the sound.

[0069] For example, by operating the setting display window 111A, the viewer can adjust the shape of the virtual space 99, its position relative to the reproduction space, the position of the sound source OBJ, and the positions of the multiple speakers SP. In this case, the sound field support device generates an object reproduction sound signal and a simulated reproduction sound signal according to the various adjustments, and performs the same reverb processing. This allows the viewer to judge the accuracy of the reproduction of the object reproduction sound by the simulated reproduction sound even after this adjustment.

[0070] (Sound field support method according to the second embodiment) Fig. 10 is a flowchart showing a sound field supporting method according to the second embodiment of the present invention. The sound field supporting method shown in Fig. 10 is obtained by adding a reverb component adding process to the sound field supporting method shown in Fig. 4. Note that the description of the same processes in Fig. 10 as those shown in Fig. 4 will be omitted.

[0071] The sound field support method shown in FIG. 10 executes the same processes as the sound field support method shown in FIG. 4 up to step S14.

[0072] The reverb processing unit 60 generates reverb components (early reflection sound signals and reverberation sound signals) for the object reproduction sound signal and the simulated reproduction sound signal, and adds them to the object reproduction sound signal and the simulated reproduction sound signal (S31).

[0073] The sound field support device 10A executes the processes from step S15 onward using the sound signal to which the reverb component has been added and the simulated reproduced sound signal to which the reverb component has been added.

[0074] As a result, the sound field assistance method of the second embodiment can add reverb components (early reflection sounds and reverberation sounds) to the object reproduction sound (sound from the sound source OBJ) and the simulated reproduction sound (sound simulated by the speaker) and output them. This allows the listener to judge the accuracy of the reproduction of the object reproduction sound by the simulated reproduction sound, taking into account the reverb components.

[0075] [Third embodiment] A sound field support device and a sound field support method according to a third embodiment of the present invention will be described with reference to the drawings. Fig. 11 is a functional block diagram showing the configuration of a sound field support system including the sound field support device according to the third embodiment of the present invention.

[0076] 11, the sound field support device 10B according to the third embodiment differs from the sound field support device 10 according to the first embodiment in that it further includes a posture detection unit 70. The other configuration of the sound field support device 10B is the same as that of the sound field support device 10, and a description of the same parts will be omitted.

[0077] The posture detection unit 70 is attached to the head of the viewer and detects the posture of the head of the viewer. For example, the posture detection unit 70 is a posture detection sensor with three orthogonal axes, and is attached to the headphones 80. The posture detection unit 70 outputs the detected posture of the head of the viewer to the binaural processing unit 50.

[0078] The binaural processing unit 50 performs binaural processing on the object reproduction sound signal and the simulated reproduction sound signal using the result of detection of the viewer's head posture, that is, the direction of the viewer's face.

[0079] As a result, the sound field supporting device 10B allows the viewer to experience the object reproduction sound and the simulated reproduction sound according to the direction of the viewer's face. Therefore, the viewer can compare and hear the object reproduction sound and the simulated reproduction sound according to the direction of the viewer's face while changing the direction of the viewer's face in the target space. Therefore, the viewer can directly experience the difference between the object reproduction sound and the simulated reproduction sound in a plurality of directions in the target space, and can more accurately judge whether the simulated reproduction sound accurately reproduces (simulates) the object reproduction sound and whether there is any discomfort between the object reproduction sound and the simulated reproduction sound. Furthermore, as a result, the viewer can more accurately reproduce the object reproduction sound by the simulated reproduction sound.

[0080] (Sound field support method according to the third embodiment) Fig. 12 is a flowchart showing a sound field supporting method according to a third embodiment of the present invention. The sound field supporting method shown in Fig. 12 is obtained by adding a process related to head posture detection to the sound field supporting method shown in Fig. 4. Note that a description of each process shown in Fig. 12 that is the same as the process shown in Fig. 4 will be omitted.

[0081] The sound field support method shown in FIG. 12 executes the same processes as the sound field support method shown in FIG. 4 up to step S14.

[0082] The posture detection section 70 detects the posture of the viewer's head (S41).

[0083] The selection unit 40 selects between the object reproduction sound signal and the simulation reproduction sound signal in response to an operation by the viewer or the like (S15).

[0084] If the object reproduction sound signal is selected (S150: YES), the binaural processing unit 50 performs binaural processing on the object reproduction sound signal using the detected head posture (S461). If the simulated reproduction sound signal is selected (S150: NO), the binaural processing unit 50 performs binaural processing on the simulated reproduction sound signal using the detected head posture (S462).

[0085] The sound field support device 10B executes the process of step S17 using the sound signal that has been subjected to the binaural process.

[0086] As a result, the sound field assistance method of the third embodiment can output an object reproduction sound and a simulated reproduction sound according to the direction of the viewer's face. Therefore, the viewer can compare and hear the object reproduction sound and the simulated reproduction sound according to the direction of the viewer's face while changing the direction of the viewer's face in the target space. Therefore, the viewer can directly experience the difference between the object reproduction sound and the simulated reproduction sound in a plurality of directions in the target space, and can more accurately judge whether the simulated reproduction sound accurately reproduces (simulates) the object reproduction sound and whether there is any discomfort between the object reproduction sound and the simulated reproduction sound. Furthermore, as a result, the viewer can more accurately reproduce the object reproduction sound by the simulated reproduction sound.

[0087] The configurations and processes of the above-described embodiments can be combined as appropriate, and effects according to each combination can be achieved.

[0088] Moreover, the description of the present embodiment is illustrative in all respects and is not restrictive. The scope of the present invention is indicated by the claims, not by the above-described embodiment. Furthermore, the scope of the present invention is intended to include all modifications within the meaning and scope of the claims. [Explanation of symbols]

[0089] 10, 10A, 10B: Sound field support device 21: Viewing point setting section 22: Sound source position setting section 23: Speaker position setting section 29: Adjustment operation section 30: Simulated playback sound signal generation section 40: Selection section 50: Binaural processing section 60: Reverb processor 70: Attitude detection section 80: Headphones 90: Target space 99: Virtual Space 100, 100A: GUI 111: Position confirmation window 111A: Setting display window 112: Waveform confirmation window 113, 116: Operator 115: Output status display window 900: Viewing score

Claims

1. Select the location information of the sound source set in the virtual space, selecting localization information of the sound source when simulating the sound of the sound source with an output sound from a speaker set in a target space; adjusting a sound image localization of the sound source by the speaker using the sound based on the selected position information and the localization information; Sound field support method.

2. comparing the selected sounds based on the position information and the localization information, and adjusting the sound image localization based on the comparison result; The sound field support method according to claim 1 .

3. adding an early reflection sound or a reverberation sound to the sound based on the selected position information and the selected localization information, The sound field support method according to claim 1 or 2.

4. A viewing position is set in the target space, setting a binaural process based on the position information or the localization information and the listening position; outputting the binaurally processed sound; The sound field support method according to any one of claims 1 to 3.

5. Setting the direction of the viewer's face at the viewing position; setting the binaural processing based on the position information or the localization information, the listening position, and the face direction; The sound field support method according to claim 4.

6. Select the location information of the sound source set in the virtual space, selecting localization information of the sound source when simulating the sound of the sound source with an output sound from a speaker set in a target space; A selection unit; an adjustment unit that adjusts a sound image localization of the sound source by the speaker using the sound based on the selected position information and the localization information; A sound field support device comprising:

7. The adjustment unit is comparing the selected sounds based on the position information and the localization information, and adjusting the sound image localization based on the comparison result; The sound field supporting device according to claim 6.

8. a reverberation processor that adds an early reflection sound or a reverberation sound to the sound based on the selected position information and the selected localization information, The sound field supporting device according to claim 6 or 7.

9. A viewing point setting unit that sets a viewing position in the target space; a binaural processing unit that performs binaural processing on the sound based on the position information or the localization information and the listening position, and outputs the binaurally processed sound; Equipped with The sound field supporting device according to any one of claims 6 to 8.

10. a posture detection unit that detects a facial orientation of a viewer at the viewing position; The binaural processing unit includes: setting the binaural processing based on the position information or the localization information, the listening position, and the face direction; The sound field supporting device according to claim 9.

Images