Sound processing method, sound processing device, and program

Abstract

To provide a sound processing method capable of arbitrarily setting sound transmission characteristics according to a purpose.SOLUTION: A sound processing method includes: acquiring location information of a virtual wall arranged in a virtual space; acquiring information including sound transmission characteristics of the virtual wall, which are a first transmission characteristic of sound in instances of passing through the virtual wall along a first direction and a second transmission characteristic of sound in instances of passing through the virtual wall along a second direction that is the inverse direction of the first direction; acquiring information on a sound source location and a listening location; determining either the first transmission characteristic or the second transmission characteristic based on the sound source location, the listening location, and the location information of the wall; and applying sound processing to a sound signal of the sound source based on the determined transmission characteristic.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] An embodiment of the present invention relates to a sound processing method, a sound processing device, and a program. [Background technology]

[0002] Patent Document 1 discloses a virtual sound barrier forming unit that blocks sound from the outside and prevents sound from radiating to the outside.

[0003] Patent document 2 discloses an external information detection device that has a speaker installed inside a soundproof room and a microphone installed outside, allowing outside sounds to be heard from within the soundproof room without emitting noise from inside the soundproof room to the outside.

[0004] Patent Document 3 discloses an audio area setting device comprising: a detection means for detecting division information that divides a space surrounded by walls into a number of rooms; and an audio amplification means for amplifying an input audio signal within the space, and which is characterized in that a different audio signal is amplified for each of the divided rooms based on the division information. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Patent Publication No. 2010-107884 [Patent Document 2] Utility Model Registration No. 3089220 [Patent Document 3] Patent Publication No. 2001-128298 Summary of the Invention [Problem to be solved by the invention]

[0006] None of the inventions of Patent Documents 1 to 3 arbitrarily sets the passing characteristics of a sound going out from a certain area and a sound going in from the outside of a certain area.

[0007] One object of this embodiment is to provide a sound processing method that can arbitrarily set sound passing characteristics according to a purpose. [Means for solving the problem]

[0008] A sound processing method according to one embodiment of the present invention acquires positional information of a virtual wall arranged in a virtual space, acquires information on sound passing characteristics of the virtual wall, including a first passing characteristic of sound when passing through the virtual wall along a first direction and a second passing characteristic of sound when passing through the virtual wall along a second direction opposite to the first direction, acquires information on a sound source position and a listening position, determines either the first passing characteristic or the second passing characteristic based on the sound source position, the listening position, and the positional information of the wall, and applies sound processing to a sound signal of the sound source based on the determined passing characteristic. Effect of the Invention

[0009] According to one embodiment of the present invention, the sound passing characteristics can be set arbitrarily depending on the purpose. [Brief description of the drawings]

[0010] [Figure 1] FIG. 2 is a block diagram showing the configuration of a PC 1. [Diagram 2] FIG. 2 is a plan view showing the configuration of a virtual space. [Diagram 3] 4 is a flowchart showing the operation of a processor 34. [Figure 4] FIG. 13 is a list of transmission characteristics of virtual walls. [Diagram 5] 11 is a list diagram showing the relationship between the first pass characteristic and the second pass characteristic. FIG. [Figure 6] FIG. 13 is a plan view showing the configuration of a virtual space in Modification 3. [Figure 7] FIG. 13 is a plan view showing the configuration of a virtual space in Modification 5. [Figure 8] FIG. 23 is a plan view showing the configuration of a virtual space in Modification 6. [Figure 9]FIG. 23 is a plan view showing the configuration of a virtual space in Modification 8. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] 1 is a block diagram showing the configuration of a PC1. The PC1 is an example of a sound processing device of the present invention, and is a general-purpose information processing device. A user connects a head mounted display (HMD) 51 and headphones 81 to the PC1. The PC1 includes a display interface (I / F) 31, a user I / F 32, a flash memory 33, a processor 34, a RAM 35, a communication I / F 36, and an audio I / F 37.

[0012] The display I / F 31 is connected to a display. The display I / F 31 of the PC1 is connected to a head mounted display (HMD) 51, which is an example of a display. Note that, although the present embodiment shows an example in which the HMD 51 is connected to the PC1, a display such as an LCD may be connected to the PC1.

[0013] The user I / F 32 is a keyboard, a mouse, or a touch panel that is laminated on a display. When the user I / F 32 is a touch panel, the user I / F 32 and the display configure a GUI (Graphical User Interface).

[0014] The communication I / F 36 includes a network interface, and is connected to a network such as the Internet via a router (not shown).

[0015] The audio I / F 37 has an audio terminal. The audio I / F 37 is connected to an audio device via an audio cable. In this embodiment, the audio I / F 37 of the PC 1 is connected to a headphone 81. The audio I / F 37 outputs an audio signal to the headphone 81.

[0016] The processor 34 is composed of a CPU, a DSP, or a SoC (System-on-a-Chip), and reads a program stored in a flash memory 33, which is a storage medium, into a RAM 35 to control each configuration of the PC1A and the PC1B. The flash memory 33 stores the program of this embodiment.

[0017] The processor 34 decodes audio data received from another device such as a server via the communication I / F 36, and outputs the decoded sound signal to the audio I / F 37. The audio data transmitted by another device such as a server includes a sound signal of a sound source located in a virtual space and position information of the sound source.

[0018] Processor 34 also decodes video data received from other devices via communication I / F 36, and outputs the decoded video signal to the display via display I / F 31. Video data transmitted by other devices such as a server includes information on the shape of the virtual space, position information of objects placed in the virtual space, CG images of the objects, etc. The information on the shape of the virtual space (hereinafter referred to as spatial information) and the position information of the objects are expressed in three-dimensional coordinates with a certain position as the origin.

[0019] 2 is a plan view showing the configuration of a virtual space. The virtual space in the example of FIG. 2 includes a lobby space 101, a conference space 102, a terrace space 103, a meeting space 104, and an exhibition space 105.

[0020] The lobby space 101, the conference space 102, the terrace space 103, the meeting space 104, and the exhibition space 105 are each composed of virtual wall objects arranged in the virtual space.

[0021] The processor 34 renders a CG image of the virtual space based on the position information of the object, and generates a video image of the virtual space viewed in a predetermined direction from a certain viewpoint. Note that the video data transmitted by another device such as a server may be the video data after rendering.

[0022] The processor 34 performs level reduction processing on the sound signal of a sound source located in the virtual space according to the position of the sound source and the listening position. The level of the sound from the sound source decreases inversely proportional to the square of the distance from the sound source. In order to reproduce distance attenuation, the processor 34 performs level reduction processing, for example, inversely proportional to the square of the distance, according to the position of the sound source and the listening position. However, the level reduction processing does not necessarily have to be inversely proportional to the square of the distance. For example, the processor 34 may perform level reduction processing that does not attenuate at a position very close to the sound source, but is inversely proportional to the distance at a medium distance, and inversely proportional to the square of the distance at a long distance. The processor 34 may also perform level reduction processing based on a physical model that expresses the audible level attenuation according to the distance.

[0023] The processor 34 performs localization processing on the sound signal of a sound source arranged in the virtual space so that a sound image is localized at the position of the sound source. The processor 34 performs localization processing based on, for example, HRTF (Head Related Transfer Function). The HRTF represents a transfer function from a certain virtual sound source position to the right ear and left ear of the user. For example, as shown in FIG. 2, the first sound source 151 is located in front of the listening position L1, the second sound source 152 is located on the right side of the listening position L1, and the third sound source 153 is located on the left side of the listening position L1. The first sound source 151 is, for example, a guidance voice played in the lobby space 101. The second sound source 152 is the voice of a lecturer in the conference space 102. The third sound source 153 is the voice of a conference participant in the meeting space 104.

[0024] The processor 34 performs binaural processing to convolve an HRTF on a sound signal corresponding to the first sound source 151 such that the sound source is localized in a position directly in front of the user. The processor 34 also performs binaural processing to convolve an HRTF on a sound signal corresponding to the second sound source 152 such that the sound source is localized in a position to the right in front of the user. The processor 34 also performs binaural processing to convolve an HRTF on a sound signal corresponding to the third sound source 153 such that the sound source is localized in a position to the left in front of the user. However, since the sound of the third sound source 153 is blocked by the wall of the meeting space 104 as described later, the processor 34 does not need to perform localization processing based on the HRTF on the third sound source 153 when the listening position L1 is located outside the meeting space 104.

[0025] This allows the user to perceive as if he or she is at listening position L1 in the virtual space and is listening to the sound of first sound source 151 from directly in front of him or her. Also, the user can perceive as if he or she is at listening position L1 in the virtual space and is listening to the sound of second sound source 152 from the right in front of him or her.

[0026] Furthermore, the processor 34 performs sound processing based on the sound source position, the listening position, and the position information of the wall. Fig. 3 is a flowchart showing the operation of the sound processing method by the processor 34. The processor 34 acquires position information of a virtual wall (hereinafter referred to as a virtual wall) arranged in a virtual space (S11). The processor 34 also acquires sound passing characteristics of the virtual wall (S12). The passing characteristics include a first passing characteristic of the sound when the sound passes through the virtual wall along a first direction, and a second passing characteristic of the sound when the sound passes through the virtual wall along a second direction opposite to the first direction.

[0027] 4 is a list diagram of the sound transmission characteristics of the virtual walls. A lobby space 101, a conference space 102, a terrace space 103, a meeting space 104, and an exhibition space 105 each specify the sound transmission characteristics of the virtual walls that compose them. A first sound transmission characteristic when passing through a virtual wall along a first direction is, for example, the sound transmission characteristic (To Inside) of a sound entering a space. A second sound transmission characteristic when passing through a virtual wall along a second direction opposite to the first direction is the sound transmission characteristic (To Outside) of a sound leaving a space.

[0028] The pass characteristics include the first characteristic "Insulation" for complete sound insulation, the second characteristic "Passage" for complete passage, and the third characteristic "Weak" other than complete sound insulation and complete passage.

[0029] For example, the first pass characteristic and the second pass characteristic of the lobby space 101 are both defined as "Weak". The first pass characteristic of the conference space 102 is complete sound insulation "Insulation", and the second pass characteristic of the conference space 102 is "Weak". The first pass characteristic and the second pass characteristic of the terrace space 103 are both defined as "Passage". The first pass characteristic and the second pass characteristic of the meeting space 104 are both defined as "Insulation". The first pass characteristic of the exhibition space 105 is "Insulation", and the second pass characteristic is "Passage". In this way, the first pass characteristic and the second pass characteristic may be the same or different.

[0030] Processor 34 acquires information on the sound source position and the listening position (S13), and determines either the first passing characteristic or the second passing characteristic based on the sound source position, the listening position, and the position information of the virtual wall (S14).

[0031] 2, there is a virtual wall of the lobby space 101 and a virtual wall of the conference space 102 between the second sound source 152 and the listening position L1. Therefore, the processor 34 determines the second pass characteristic (To Outside) of the conference space 102 to be "Weak" and the first pass characteristic (To Inside) of the lobby space 101 to be "Weak." In this case, the first pass characteristic (To Inside) and the second pass characteristic (To Outside) are both "Weak." Therefore, the processor 34 determines the pass characteristic of "Weak" for the sound signal of the second sound source 152.

[0032] FIG. 5 is a list diagram of the relationship between the first pass characteristic and the second pass characteristic. The processor 34 determines either the first pass characteristic (To Inside) or the second pass characteristic (To Outside) based on the relationship shown in FIG. 5. For example, when the first pass characteristic (To Inside) is "Insulation", the processor 34 determines the first pass characteristic to be "Insulation" even if the second pass characteristic is "Weak" or "Passage". Also, when the second pass characteristic (To Outside) is "Insulation", the processor 34 determines the second pass characteristic to be "Insulation" even if the first pass characteristic is "Weak" or "Passage". When the first pass characteristic (To Inside) is "Weak", the processor 34 determines the first pass characteristic to be "Weak" even if the second pass characteristic is "Passage". When the second pass characteristic (To Outside) is "Weak", the processor 34 determines the second pass characteristic to be "Weak" even if the first pass characteristic is "Passage".

[0033] 2, there is a virtual wall of the lobby space 101 and a virtual wall of the meeting space 104 between the third sound source 153 and the listening position L1. The processor 34 determines the pass characteristic of "Insulation" for the sound signal of the third sound source 153 by referring to the relationship between "Insulation" of the second pass characteristic (To Outside) of the meeting space 104 and "Weak" of the first pass characteristic (To Inside) of the lobby space 101.

[0034] 2, there is no virtual wall between the first sound source 151 and the listening position L1. In this case, the processor 34 determines the passage characteristic of "Passage" for the sound signal of the first sound source 151.

[0035] Then, the processor 34 performs sound processing on the sound signal of the sound source based on the determined pass characteristic (S15). If the determined pass characteristic is "Insulation", the processor 34 performs muting processing on the sound signal of the sound source. If the determined pass characteristic is "Passage", the processor 34 passes the sound signal of the sound source. If the determined pass characteristic is "Weak", the processor 34 performs filtering processing on the sound signal of the sound source.

[0036] The filtering process includes at least low-pass filtering. The low-pass filtering process causes the sound of the sound source to pass through the wall and have a quality with attenuated high frequencies. In this case, the user can perceive the sound of the sound source as leaking through the wall. For example, the processor 34 applies low-pass filtering to the sound signal of the second sound source 152. This allows the user to perceive the voice of the speaker leaking through the wall of the conference space 102.

[0037] Moreover, the filter processing may include reverb processing. The reverb processing reproduces the reverberation of a space. The parameters of the reverb processing are determined for each space. The processor 34 performs reverb processing with parameters corresponding to the lobby space 101 on the sound signal of the first sound source 151. The processor 34 also performs reverb processing with parameters corresponding to the conference space 102 on the sound signal of the second sound source 152. At this time, it is preferable that the processor 34 does not perform reverb processing with parameters corresponding to the lobby space 101 on the sound signal of the second sound source 152. This allows the user to perceive the speaker's voice, which is heard through the wall of the conference space 102, more realistically.

[0038] Furthermore, the filtering process is not limited to a level attenuation process such as a low-pass filtering process. For example, the filtering process may be an amplification process. As a result, the sound processing method of the present embodiment can realize a wall having an amplifying transmission characteristic that cannot be realized in an actual space.

[0039] As shown in the example of FIG. 4, the first pass characteristic (To Inside) and the second pass characteristic (To Outside) of each space may be the same or different. For example, the first pass characteristic (To Inside) of the conference space 102 is "Insulation" and the second pass characteristic (To Outside) is "Weak". As a result, the voice of the speaker in the conference space 102 leaks out and can be heard outside the conference space 102, but if you are inside the conference space 102, you cannot hear the sounds outside the conference space 102. Therefore, a person who manages a lecture in the conference space 102 can attract the interest of the lecture by letting users outside the conference space 102 hear the voice of the speaker. Also, by not letting users inside the conference space 102 hear the sounds outside the conference space 102, users can concentrate on the lecture.

[0040] Also, for example, the first pass characteristic (To Inside) and the second pass characteristic (To Outside) of the meeting space 104 are both "Insulation". As a result, the sound of the conference in the meeting space 104 cannot be heard outside the meeting space 104, and when you are inside the meeting space 104, you cannot hear sounds outside the meeting space 104. Therefore, people holding a conference in the meeting space 104 can concentrate on the conference and ensure confidentiality by preventing the contents of the conference from being overheard.

[0041] Furthermore, for example, by making the virtual walls constituting the meeting space 104 completely transparent, sound insulation can be ensured even in an open space. That is, the sound processing method of the present embodiment can realize an open space with sound insulation, which cannot be realized in an actual space.

[0042] Also, for example, the first pass characteristic (To Inside) of the exhibition space 105 is "Insulation", and the second pass characteristic (To Outside) is "Passage". As a result, the guide voice in the exhibition space 105 can be clearly heard outside the exhibition space 105, but if you are inside the exhibition space 105, you cannot hear sounds outside the exhibition space 105. Therefore, a person using the exhibition space 105 can attract the interest of users outside the exhibition space 105 in the exhibition contents by playing the guide voice. Also, a person using the exhibition space 105 can prevent users inside the exhibition space 105 from hearing sounds outside the exhibition space 105, allowing them to concentrate on appreciating the exhibition contents. In other words, the sound processing method of this embodiment can realize a light-shielding wall that completely passes sound, which cannot be realized in a real space.

[0043] As described above, the sound processing method of the present embodiment can arbitrarily set the sound passing characteristics according to the purpose. As a result, the sound processing method of the present embodiment can provide a new customer experience by configuring various virtual walls that were not possible in the past, such as a light-shielding wall that completely passes sound and an open space that completely blocks sound.

[0044] (Variation 1) The filtering process may include a first filtering process and a second filtering process having relatively different strengths.

[0045] The strength is, for example, the height of the cutoff frequency in low-pass filtering. The higher the cutoff frequency, the weaker the filtering, and the lower the cutoff frequency, the stronger the filtering. A user of the sound processing method of this embodiment sets a low cutoff frequency for a virtual wall with high sound insulation, and sets a high cutoff frequency for a virtual wall with low sound insulation.

[0046] In this way, the sound processing method according to the first modification can change the sound insulation of the virtual wall.

[0047] (Variation 2) In the above embodiment, the processor 34 performs sound image localization processing on the sound signal of the sound source based on the sound source position and the listening position, and performs sound processing based on the determined pass characteristics on the sound signal that has been subjected to the sound image localization processing. However, the processor 34 may perform sound image localization processing on the sound signal that has been subjected to the sound processing based on the pass characteristics.

[0048] Also, sound image localization processing is not essential. For example, a sound whose quality has been degraded by filtering processing has a lower sense of localization than a sound whose quality has not been degraded. Therefore, for example, when the determined pass characteristic is "Weak", the processor 34 does not need to perform binaural processing in which HRTF is convolved with respect to the sound signal of the sound source. In this way, the sound processing method according to the second modification can reduce the consumption of resources of the processor 34 while suppressing the impact on the user's hearing by omitting sound image localization processing for leakage sounds whose quality has been degraded.

[0049] (Variation 3) In the above embodiment, an example was shown in which the first passing characteristic corresponds to the passing characteristic of a sound passing from a first area separated by a virtual wall to a second area different from the first area, and the second passing characteristic corresponds to the passing characteristic of a sound passing from the second area to the first area. That is, in the above embodiment, an example was shown in which the first characteristic corresponds to the passing characteristic of a sound entering a certain area (To Inside), and the second passing characteristic corresponds to the passing characteristic of a sound leaving a certain area (To Outside).

[0050] However, the first and second pass characteristics do not need to be set uniquely for each area. Fig. 6 is a plan view showing the configuration of a virtual space in Modification 3. In the example of Fig. 6, a virtual wall 191 is defined that separates the lobby space 101 and the conference space 102. However, the virtual wall 191 separates half of the boundary between the lobby space 101 and the conference space 102. As a result, as shown in Fig. 6, at a listening position L1 separated by the virtual wall 191 from the position of the second sound source 152, the sound of the second sound source 152 is perceived as leaking out and being heard. At a listening position L2 that is visible from the position of the second sound source 152, the sound of the second sound source 152 is clearly heard.

[0051] (Variation 4) The sound source includes a sound source corresponding to a speaker fixed as equipment. For example, the first sound source 151 shown in Fig. 2 is a sound source corresponding to a speaker fixed as equipment. The processor 34 may process the sound signal of the sound source corresponding to the speaker according to the acoustic characteristics of the speaker, and may perform a level reduction process different from that for sound sources other than the speaker.

[0052] The processing for the acoustic characteristics of the speaker is, for example, high-pass filter processing or distortion processing. The high-pass filter processing or distortion processing reduces the sound quality of the sound source. Generally, a speaker fixed to the ceiling as equipment is a speaker with low sound quality and low clarity. The processor 34 according to the fourth modification can reproduce the sound quality of such a speaker fixed to the ceiling as equipment by performing processing for the acoustic characteristics of the speaker.

[0053] Furthermore, the level reduction process that differs from that for sound sources other than speakers is the process of weakening distance attenuation. As described above, the level reduction process is a process that reduces the level in inverse proportion to the square of the distance from the sound source. However, in the level reduction process for speakers, the distance attenuation is weakened. This allows the processor 34 to further reproduce the sound quality of speakers that are fixed to the ceiling as equipment.

[0054] (Variation 5) The sound source may include environmental sound. Fig. 7 is a plan view showing the configuration of the virtual space in Modification 5. In the example of Fig. 7, an environmental sound source 171 is defined in the entire lobby space 101, and an environmental sound source 172 is defined in the entire terrace space 103. For example, the environmental sound source 171 in the lobby space 101 is background music. The environmental sound source 172 in the terrace space 103 is natural sounds such as birdsong. It is preferable not to perform localization processing on the environmental sound sources 171 and 172.

[0055] As a result, the sound processing method according to the fifth modification can reproduce the atmosphere of a lobby or a terrace.

[0056] (Variation 6) In the above embodiment, the processor 34 performs the first sound processing such as muting or filtering on the sound signal related to the direct sound of the sound source based on the determined pass characteristics. However, the processor 34 may perform the second sound processing on the sound signal related to the indirect sound of the sound source based on the determined pass characteristics.

[0057] Fig. 8 is a plan view showing the configuration of a virtual space in Modification 6. In the example of Fig. 8, the door to the conference space 102 is open, and the indirect sound of the second sound source 152 reaches the listening position L1. As the second sound processing, the processor 34 performs a localization process such that the sound arrives from the reflection position of the second sound source 152 (the wall surface of the meeting space 104 in the example of Fig. 8).

[0058] This allows users to more realistically perceive not only the sounds that leak through the walls of each space, but also the sounds that leak through open doors.

[0059] (Variation 7) The processor 34 according to the seventh modification acquires sound source information indicating pass characteristics determined for each sound source. The processor 34 performs sound processing on the sound signal of the sound source with pass characteristics based on the sound source information. That is, pass characteristics may be determined for each sound source. For example, conversational voices may be blocked by the walls of each space, and environmental sounds such as background music may be allowed to leak through the walls of each space. Alternatively, the voice of the lecturer may be allowed to leak through the walls of each space, and voices other than the lecturer may be blocked by the walls of each space.

[0060] As a result, the sound processing method of variant example 7 can provide a new customer experience in that various passing characteristics can be set for each sound source, such as a sound source that completely passes sound or a sound source that completely blocks sound.

[0061] (Variation 8) FIG. 9 is a plan view showing the configuration of a virtual space in the eighth modification. In the example of FIG. 9, the virtual walls of the conference space 102 include a first virtual wall 102A and a second virtual wall 102B. The processor 34 acquires wall information indicating the pass characteristics determined for each of the first virtual wall 102A and the second virtual wall 102B. The processor 34 performs sound processing on the sound signal of the sound source with the pass characteristics based on the wall information. For example, the wall information indicating the pass characteristics determined for the first virtual wall 102A in the example of FIG. 9 is "Passage" indicating complete pass. The wall information indicating the pass characteristics determined for the second virtual wall 102B is "Weak". The processor 34 performs filtering on the sound signal of the second sound source 152 so that the sound of the second sound source 152 leaks out and is heard at the listening position L1 separated by the second virtual wall 102B as viewed from the position of the second sound source 152. The processor 34 passes the sound signal of the second sound source so that the sound of the second sound source 152 can be clearly heard at a listening position L2 separated by the first virtual wall 102A as viewed from the position of the second sound source 152.

[0062] As a result, the sound processing method of variant example 8 can provide a new customer experience in that various sound passing characteristics can be set for each wall, such as a wall sound source that completely passes sound, or a wall that completely blocks sound, even in the same space.

[0063] The description of the present embodiment should be considered as illustrative in all respects and not restrictive. The scope of the present invention is indicated by the claims, not by the above-described embodiments. Furthermore, the scope of the present invention includes the scope equivalent to the claims. [Explanation of symbols]

[0064] 31: display I / F, 32: user I / F, 33: flash memory, 34: processor, 35: RAM, 36: communication I / F, 37: audio I / F, 51: HMD, 81: headphones, 101: lobby space, 102: conference space, 102A: first virtual wall, 102B: second virtual wall, 103: terrace space, 104: meeting space, 105: exhibition space, 151: first sound source, 152: second sound source, 153: third sound source

Claims

1. Acquire position information of a virtual wall placed in the virtual space, Acquire information on sound transmission characteristics of the virtual wall, the information including a first transmission characteristic of the sound when the sound passes through the virtual wall along a first direction and a second transmission characteristic of the sound when the sound passes through the virtual wall along a second direction opposite to the first direction; Acquire information on the sound source position and the listening position, determining either the first transmission characteristic or the second transmission characteristic based on the sound source position, the listening position, and position information of the wall; applying sound processing to the sound signal of the sound source based on the determined pass characteristic; Sound processing methods.

2. the first pass characteristic and the second pass characteristic are different from each other; The sound processing method according to claim 1 .

3. The pass characteristic includes a first characteristic of complete sound insulation, a second characteristic of complete passage, and a third characteristic other than the complete sound insulation and the complete passage, When the determined pass characteristic is a first characteristic, a muting process is performed on the sound signal of the sound source; If the determined pass characteristic is a second characteristic, a sound signal of the sound source is passed through; If the determined pass characteristic is a third characteristic, a filter process is performed on the sound signal of the sound source. The sound processing method according to claim 1 or 2.

4. The filtering process includes a first filtering process and a second filtering process having relatively different intensities. The sound processing method according to claim 3.

5. performing a sound image localization process on the sound signal of the sound source based on the sound source position and the listening position; The sound processing method according to claim 1 or 2.

6. the first passing characteristic corresponds to a passing characteristic of a sound passing from a first area separated by the virtual wall to a second area different from the first area, The second pass characteristic corresponds to a pass characteristic of a sound passing from the second area to the first area. The sound processing method according to claim 1 or 2.

7. The sound source includes a sound source corresponding to a speaker fixed as equipment, A processing is performed on the sound signal of the sound source corresponding to the speaker according to the acoustic characteristics of the speaker, and a level reduction processing different from that of the sound source other than the speaker is performed. The sound processing method according to claim 1 or 2.

8. The sound source includes an environmental sound. The sound processing method according to claim 1 or 2.

9. performing a first sound processing on a sound signal related to a direct sound of the sound source based on the determined pass characteristic; performing a second sound processing on a sound signal related to the indirect sound of the sound source based on the determined pass characteristic; The sound processing method according to claim 1 or 2.

10. Acquire sound source information indicating a pass characteristic determined for each of the sound sources; applying sound processing to a sound signal of the sound source using a pass characteristic based on the sound source information; The sound processing method according to claim 1 or 2.

11. the virtual wall includes a first wall and a second wall; acquiring wall information indicating transmission characteristics respectively defined for the first wall and the second wall; applying sound processing to the sound signal of the sound source using a transmission characteristic based on the wall information; The sound processing method according to claim 1 or 2.

12. Acquire position information of a virtual wall placed in the virtual space, Acquire information on sound transmission characteristics of the virtual wall, the information including a first transmission characteristic of the sound when the sound passes through the virtual wall along a first direction and a second transmission characteristic of the sound when the sound passes through the virtual wall along a second direction opposite to the first direction; Acquire information on the sound source position and the listening position, determining either the first transmission characteristic or the second transmission characteristic based on the sound source position, the listening position, and position information of the wall; applying sound processing to the sound signal of the sound source based on the determined pass characteristic; A sound processing device having a processor.

13. the first pass characteristic and the second pass characteristic are different from each other; The sound processing device according to claim 12.

14. The pass characteristic includes a first characteristic of complete sound insulation, a second characteristic of complete passage, and a third characteristic other than the complete sound insulation and the complete passage, The processor, When the determined pass characteristic is a first characteristic, a muting process is performed on the sound signal of the sound source; If the determined pass characteristic is a second characteristic, a sound signal of the sound source is passed through; If the determined pass characteristic is a third characteristic, a filter process is performed on the sound signal of the sound source. The sound processing device according to claim 12 or 13.

15. The filtering process includes a first filtering process and a second filtering process having relatively different intensities. The sound processing device according to claim 14.

16. The processor, performing a sound image localization process on the sound signal of the sound source based on the sound source position and the listening position; The sound processing device according to claim 12 or 13.

17. the first passing characteristic corresponds to a passing characteristic of a sound passing from a first area separated by the virtual wall to a second area different from the first area, The second pass characteristic corresponds to a pass characteristic of a sound passing from the second area to the first area. The sound processing device according to claim 12 or 13.

18. The sound source includes a sound source corresponding to a speaker fixed as equipment, The processor, A processing is performed on the sound signal of the sound source corresponding to the speaker according to the acoustic characteristics of the speaker, and a level reduction processing different from that of the sound source other than the speaker is performed. The sound processing device according to claim 12 or 13.

19. The sound source includes an environmental sound. The sound processing device according to claim 12 or 13.

20. Acquire position information of a virtual wall placed in the virtual space, Acquire information on sound transmission characteristics of the virtual wall, the information including a first transmission characteristic of the sound when the sound passes through the virtual wall along a first direction and a second transmission characteristic of the sound when the sound passes through the virtual wall along a second direction opposite to the first direction; Acquire information on the sound source position and the listening position, determining either the first transmission characteristic or the second transmission characteristic based on the sound source position, the listening position, and position information of the wall; applying sound processing to the sound signal of the sound source based on the determined pass characteristic; A program that causes a sound processing device to execute processing.

Images