Acoustic processing method, program, and acoustic processing system

Abstract

In the sound processing method, sound information relating to a sound including a predetermined sound and meta-information including information relating to a space in which the predetermined sound is reproduced are acquired (S1), and sound processing for generating a sound signal is performed on the basis of the sound information and the meta-information. The sound signal indicates a sound (S2) including a direct sound to a user from a sound source object and an initial reflected sound reaching the user, and an output sound signal (S3) including the sound signal is output. In sound processing, a parameter for generating an initial reflected sound is determined, the parameter including a position of a dummy sound source object that generates the initial reflected sound in a space (S21), and the initial reflected sound is generated on the basis of the determined parameter (S22). At least a portion of the parameter varies over time in accordance with a predetermined condition.

Description

Technical Field

[0001] The present disclosure relates to a sound processing method, a program, and a sound processing system for realizing stereo sound in a space. Background Art

[0002] Patent Document 1 discloses a sound environment simulation experience device that reproduces the sound environment in an arbitrary space without using an actual room or model.

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent No. 3152818 Summary of the invention

[0006] Problems to be solved by the invention

[0007] An object of the present disclosure is to provide an audio processing method and the like that can easily reproduce a sound that is unlikely to make the user feel uncomfortable while reducing the amount of calculation.

[0008] Means used to solve problems

[0009] In a sound processing method according to a technical solution of the present disclosure, sound information related to a sound including a predetermined sound and meta-information including information related to a space for reproducing the predetermined sound are obtained, and based on the sound information and the meta-information, sound processing is performed to generate a sound signal representing a sound including an initial reflected sound that reaches the user after a direct sound from a sound source object to the user, and an output sound signal including the sound signal is output. In the sound processing, parameters for generating the initial reflected sound are determined, the parameters including the position of a false sound source object that generates the initial reflected sound in the space, the initial reflected sound is generated based on the determined parameters, and at least a part of the parameters changes over time according to predetermined conditions.

[0010] Furthermore, a program according to one technical aspect of the present disclosure causes a computer to execute the above-mentioned sound processing method.

[0011] In addition, a sound processing system related to a technical solution of the present disclosure includes an acquisition unit, a sound processing unit and an output unit. The acquisition unit acquires sound information related to a sound including a specified sound, and meta-information including information related to a space for reproducing the specified sound. The sound processing unit performs sound processing to generate the following sound signal based on the sound information and the meta-information, wherein the sound signal represents a sound including an initial reflected sound that reaches the user after the direct sound from the sound source object to the user. The output unit outputs an output sound signal including the sound signal. The sound processing unit includes a parameter determination unit and an initial reflected sound generation processing unit. The parameter determination unit determines the parameters for generating the initial reflected sound, and the parameters include the position of the false sound source object that generates the initial reflected sound in the space. The initial reflected sound generation processing unit generates the initial reflected sound based on the determined parameters. At least a part of the parameters changes over time according to specified conditions.

[0012] In addition, these inclusive or specific technical solutions can also be implemented by systems, devices, methods, integrated circuits, computer programs, or non-temporary recording media such as computer-readable CD-ROMs, or by any combination of systems, devices, methods, integrated circuits, computer programs, and recording media.

[0013] Effects of the Invention

[0014] According to the present disclosure, there is an advantage that it is easy to reproduce a sound that is unlikely to make the user feel uncomfortable while reducing the amount of calculation. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 This is a schematic diagram showing an example of use of the sound reproduction device according to the embodiment.

[0016] Figure 2 This is a block diagram showing the functional structure of the sound reproduction device according to the embodiment.

[0017] Figure 3 It is a block diagram showing a more detailed functional structure of the sound processing system according to the embodiment.

[0018] Figure 4 It is an explanatory diagram showing the temporal change of the parameters of the initial reflected sound.

[0019] Figure 5 This is a flowchart showing the basic operation of the sound processing system according to the embodiment.

[0020] Figure 6 This is a block diagram showing a functional configuration of a first example of a sound processing system according to an embodiment.

[0021] Figure 7This is a flowchart showing the operation of the first example of the sound processing system according to the embodiment.

[0022] Figure 8 It is an explanatory diagram of the operation in the second example of the sound processing system according to the embodiment.

[0023] Fig. 9 This is a flowchart showing the operation of the second example of the sound processing system according to the embodiment. DETAILED DESCRIPTION

[0024] Conventionally, there is known a technology related to sound reproduction for making a user perceive stereoscopic sound by controlling the position of a sound image as a sound source object perceived by the user in a virtual three-dimensional space (hereinafter sometimes referred to as a three-dimensional sound field). By positioning the sound image at a predetermined position in the virtual three-dimensional space, the user can perceive the sound as if it were arriving from a direction parallel to a straight line connecting the predetermined position and the user (i.e., a predetermined direction). In order to position the sound image at a predetermined position in the virtual three-dimensional space, for example, it is necessary to perform calculation processing on the collected sound so as to produce a sound that is perceived as stereoscopic, such as a sound arrival time difference between the two ears and a sound level difference (or sound pressure difference) between the two ears.

[0025] In addition, in recent years, the development of technologies related to virtual reality (VR) or augmented reality (AR) has been actively carried out. For example, in virtual reality, the main focus is that the position of the virtual space does not follow the movement of the user, and it can be felt as if the user is moving in the virtual space. In particular, in the technology of virtual reality or augmented reality, attempts are made to further improve the sense of presence by integrating auditory elements into visual elements. In particular, in order to improve the auditory immersion, it is useful to emphasize the positioning of the sound and image so that the sound is heard from outside the user's head as described above.

[0026] In order to realize stereoscopic sound in a three-dimensional sound field, various sound processing is useful. The sound processing mentioned here is a process for generating sound other than direct sound from a sound source object to a user in a three-dimensional sound field.

[0027] The sound processing may include, for example, the processing of generating initial reflected sound. Initial reflected sound is the reflected sound that reaches the user after one or more reflections at a relatively early stage (e.g., about tens of milliseconds from the arrival of the direct sound) after the direct sound reaches the user from the sound source object. In addition, when reproducing content in virtual reality or augmented reality, it is required to reduce the amount of calculation required for generating initial reflected sound.

[0028] Here, as a method for generating the initial reflected sound with a relatively small amount of calculation, for example, a method of determining an arbitrary point in the three-dimensional sound field as the position of the false sound source object that generates the initial reflected sound can be cited. That is, in this method, the initial reflected sound is represented as a direct sound reaching the user from the false sound source object.

[0029] However, when the above method is adopted, the following problems may occur. That is, in real space, when the reflected sound reaches the user from the sound source object via the reflection point, the sound wave from the reflection point toward the user fluctuates in its direction or sound pressure. Therefore, even if the reflection point continues to be in the same position, the exact same sound wave will not continue to reach the user from the reflection point. However, when the above method is adopted, since the same reflected sound continues to reach the user from the reflection point (the position of the false sound source object), the user may feel uncomfortable.

[0030] Alternatively, it is possible to simulate the fluctuations of sound waves from the reflection point in real space to generate the initial reflected sound, but this requires a huge amount of calculation, so there is a problem that it is not possible to reduce the amount of calculation required for generating the initial reflected sound.

[0031] In view of the above circumstances, an object of the present disclosure is to provide an acoustic processing method and the like that can easily reproduce a sound that is unlikely to make the user feel uncomfortable while reducing the amount of calculation by varying at least a part of the parameters for generating the initial reflected sound over time.

[0032] More specifically, in the sound processing method related to the first technical solution of the present disclosure, sound information related to a sound including a prescribed sound and meta-information including information related to a space for reproducing the prescribed sound are obtained, and based on the sound information and the meta-information, sound processing is performed to generate the following sound signal, the sound signal representing a sound including an initial reflected sound that reaches a user after a direct sound from a sound source object to the user, and an output sound signal including the sound signal is output. In the sound processing, parameters for generating the initial reflected sound are determined, the parameters including the position of a false sound source object that generates the initial reflected sound in the space, and the initial reflected sound is generated based on the determined parameters. At least a part of the parameters changes over time according to prescribed conditions.

[0033] This allows the direction and sound pressure of the initial reflected sound reaching the user to change over time, thereby providing an advantage of being able to easily reproduce a sound that is less likely to make the user feel uncomfortable while reducing the amount of calculation.

[0034] Furthermore, for example, in the sound processing method according to the second technical means of the present disclosure, in the first technical means, the parameter that changes with time is the position of a false sound source object that generates the initial reflection sound in space.

[0035] This has the advantage that the direction and sound pressure of the initial reflected sound reaching the user can be easily varied over time by processing that requires only a relatively small amount of calculation, such as varying the position of the false sound source object over time.

[0036] Furthermore, for example, in the sound processing method according to the third technical means of the present disclosure, in the second technical means, the predetermined condition is a random number for determining the position of the false sound source object.

[0037] This has the advantage that the user is less likely to feel uncomfortable with the initial reflected sound by processing that requires only a relatively small amount of calculation, such as randomly changing the position of the false sound source object over time.

[0038] Furthermore, for example, in the sound processing method according to the fourth technical aspect of the present disclosure, in the second technical aspect, the predetermined condition is a trajectory in space for determining the position of the false sound source object.

[0039] This has the advantage that the user is less likely to feel uncomfortable with the initial reflected sound by processing that requires a relatively small amount of calculation, such as changing the position of the false sound source object along the trajectory over time.

[0040] Furthermore, for example, in the sound processing method according to the fifth technical means of the present disclosure, in any one of the second to fourth technical means, the variable range of the position of the false sound source object is determined based on the positional relationship between the user and the false sound source object.

[0041] Thus, appropriate initial reflected sound is generated according to the positional relationship between the user and the false sound source object, so there is an advantage that the user is less likely to feel uncomfortable.

[0042] Furthermore, for example, in the sound processing method according to a sixth aspect of the present disclosure, in any one of the second to fifth aspects, the variable range of the position of the false sound source object is determined based on the acoustic characteristics of the space.

[0043] This provides an advantage in that appropriate initial reflected sound is generated according to the acoustic characteristics of the space, so that the user is less likely to feel uncomfortable.

[0044] Furthermore, for example, a program according to a seventh aspect of the present disclosure causes a computer to execute the sound processing method according to any one of the first to sixth aspects.

[0045] This has the advantage of being able to produce the same effects as the above-mentioned sound processing method.

[0046] In addition, for example, the sound processing system related to the 8th technical solution of the present disclosure includes an acquisition unit, an sound processing unit and an output unit. The acquisition unit acquires sound information related to a sound including a specified sound, and meta-information including information related to a space for reproducing the specified sound. The sound processing unit performs sound processing to generate the following sound signal based on the sound information and the meta-information, and the sound signal represents a sound including an initial reflected sound that will reach the user after the direct sound from the sound source object to the user. The output unit outputs an output sound signal including the sound signal. The sound processing unit has a parameter determination unit and an initial reflected sound generation processing unit. The parameter determination unit determines parameters for generating initial reflected sound, and the parameters include the position of a false sound source object that generates initial reflected sound in space. The initial reflected sound generation processing unit generates initial reflected sound based on the determined parameters. At least a part of the parameters changes over time according to specified conditions.

[0047] This has the advantage of being able to produce the same effects as the above-mentioned sound processing method.

[0048] Furthermore, these inclusive or specific technical solutions may also be implemented by systems, devices, methods, integrated circuits, computer programs, or non-temporary recording media such as computer-readable CD-ROMs, or by any combination of systems, devices, methods, integrated circuits, computer programs, and recording media.

[0049] Hereinafter, the embodiments are described in detail with reference to the accompanying drawings. In addition, the embodiments described below all represent inclusive or specific examples. The numerical values, shapes, materials, constituent elements, configuration positions and connection forms of constituent elements, steps, or the order of steps, etc. shown in the following embodiments are examples and are not intended to limit the present disclosure. In addition, regarding the constituent elements of the following embodiments that are not described in the independent claims, they are described as arbitrary constituent elements. In addition, each figure is a schematic diagram and is not necessarily a strict illustration. In addition, in each figure, the same reference numerals are given to substantially the same structure, and repeated descriptions are sometimes omitted or simplified.

[0050] (Implementation Method)

[0051] [1. Summary]

[0052] First, an overview of the sound reproduction device according to the embodiment will be described. Figure 1 This is a schematic diagram showing an example of use of the sound reproduction device according to the embodiment. Figure 1 (a) shows a user U1 using an example of the sound reproduction device 100 . Figure 1 (b) shows a user U1 using another example of the sound reproduction device 100 .

[0053] Figure 1The sound reproduction device 100 shown is used, for example, together with a display device that displays images or a stereoscopic image reproduction device that reproduces stereoscopic images. The stereoscopic image reproduction device is an image display device worn on the head of the user U1, and changes the displayed image in accordance with the movement of the head of the user U1, so that the user U1 perceives as if the head is moving in a three-dimensional sound field (virtual space). In addition, the stereoscopic image reproduction device displays two images with deviations corresponding to parallax in the left and right eyes of the user U1, respectively. The user U1 can perceive the three-dimensional position of an object on the image based on the deviation of the displayed image corresponding to the parallax. In addition, although it is set as a stereoscopic image reproduction device here, it can also be a normal image display device as described above.

[0054] The sound reproduction device 100 is a sound prompt device worn on the head of the user U1. Therefore, the sound reproduction device 100 moves together with the head of the user U1. For example, the sound reproduction device 100 of the embodiment can be as follows: Figure 1 (a) is a so-called headphone type device, which can also be Figure 1 (b) shows two earbud-type devices that are independently worn on the left and right ears of the user U1. The two devices communicate with each other to synchronously present sounds for the right ear and the left ear.

[0055] The sound reproduction device 100 changes the prompt sound according to the movement of the user U1's head, so that the user U1 perceives that the user U1 moves his head in the three-dimensional sound field. Therefore, as described above, the sound reproduction device 100 moves the three-dimensional sound field in the opposite direction to the movement of the user U1.

[0056] [2. Structure]

[0057] Next, use Figure 2 and Figure 3 The configuration of sound reproduction device 100 according to the embodiment will be described. Figure 2 1 is a block diagram showing a functional configuration of sound reproduction device 100 according to the embodiment.

[0058] Figure 3 1 is a block diagram showing a more detailed functional structure of the sound processing system 10 according to the embodiment. Figure 2 As shown, sound reproduction device 100 according to the embodiment includes a processing module 1 , a communication module 2 , a sensor 3 , and a driver 4 .

[0059] The processing module 1 is a computing device for performing various signal processing in the sound reproduction device 100. The processing module 1 includes, for example, a processor and a memory, and various functions are achieved by the processor executing a program stored in the memory.

[0060] Processing module 1 functions as an audio processing system 10 including acquisition unit 11 including extraction unit 12, audio processing unit 13, and output unit 14. Details of each functional unit of audio processing system 10 are described below together with details of configurations other than processing module 1.

[0061] The communication module 2 is an interface device for receiving input of sound information and meta-information to the sound reproduction device 100. The communication module 2 includes, for example, an antenna and a signal converter, and receives sound information and meta-information from an external device through wireless communication. More specifically, the communication module 2 uses the antenna to receive a wireless signal representing sound information after being converted into a format for wireless communication, and the signal converter performs a reconversion from the wireless signal to the sound information. Thus, the sound reproduction device 100 obtains sound information from the external device through wireless communication. Similarly, the communication module 2 uses the antenna to receive a wireless signal representing meta-information after being converted into a format for wireless communication, and the signal converter performs a reconversion from the wireless signal to the meta-information. Thus, the sound reproduction device 100 obtains meta-information from the external device through wireless communication. The sound information and meta-information obtained by the communication module 2 are both obtained by the obtaining unit 11 of the processing module 1. In addition, the communication between the sound reproduction device 100 and the external device can also be performed through wired communication.

[0062] In addition, in the present embodiment, the sound reproduction device 100 includes the sound processing system 10 having a function as a renderer that generates sound information with sound effects added thereto, but the server may also assume all or part of the functions of the renderer. That is, all or part of the acquisition unit 11, the extraction unit 12, the sound processing unit 13, and the output unit 14 may exist in a server not shown. In this case, the sound signal generated by the sound processing unit 13 in the server or the sound signal synthesized by the sound signals generated by the various processing units is received and reproduced by the sound reproduction device 100 via the communication module 2.

[0063] In the embodiment, the sound information and meta-information are obtained by the sound reproduction device 100 as a bit stream encoded in a format specified by MPEG-H 3D Audio (ISO / IEC23008-3) or the like. As an example, the encoded sound information includes information about a predetermined sound reproduced by the sound reproduction device 100. The predetermined sound here is a sound source object A1 (see Figure 4 In addition, when there are multiple sound source objects A1 in the three-dimensional sound field, the sound reproduction device 100 obtains multiple sound information corresponding to the multiple sound source objects A1.

[0064] Meta-information is, for example, information used in the sound reproduction device 100 to control the sound processing of sound information. Meta-information may also be information used to describe a scene represented by a virtual space (three-dimensional sound field). The scene mentioned here refers to a term that represents the collection of all elements of three-dimensional images and sound events in the virtual space modeled by the sound processing system 10 using meta-information. That is, the meta-information mentioned here includes not only information for controlling sound processing, but also information for controlling image processing. Of course, the meta-information may include information for controlling only one of the sound processing and the image processing, or information used in controlling both.

[0065] The sound reproduction device 100 can also generate a virtual sound effect by performing sound processing on the sound information using the meta-information contained in the bit stream and the additional interactive user U1 position information. In this embodiment, the generation of the initial reflected sound is mainly described in the sound effect, but other sound processing can also be performed using the meta-information. For example, the generation of additional diffraction sound, late reverberation sound, distance attenuation effect, positioning or Doppler effect and other sound effects can be considered. In addition, information for switching on or off all or part of the sound effects can also be added as meta-information.

[0066] In addition, all or part of the meta-information may be obtained from outside the bitstream of the audio information. For example, either the meta-information for controlling the audio or the meta-information for controlling the video may be obtained from outside the bitstream, or both of the meta-information may be obtained from outside the bitstream.

[0067] Furthermore, when the bit stream obtained by sound reproduction device 100 includes meta-information for controlling images, sound reproduction device 100 may have a function of outputting the meta-information that can be used for controlling images to a display device that displays images or a stereoscopic image reproduction device that reproduces stereoscopic images.

[0068] In addition, as an example, the encoded meta-information includes: information related to a three-dimensional sound field (space) including a sound source object A1 that emits sound and obstacles, and information related to the positioning position when the sound image of the sound is positioned at a specified position in the three-dimensional sound field (that is, so that it is perceived as a sound arriving from a specified direction), that is, information related to the specified direction. Here, an obstacle is an object that may affect the sound perceived by the user U1, such as blocking or reflecting the sound from the sound source object A1 until the sound reaches the user U1. In addition to stationary objects, obstacles may also include moving objects such as animals such as humans or machines. In addition, when there are multiple sound source objects A1 in the three-dimensional sound field, other sound source objects A1 may become obstacles for any sound source object A1. In addition, non-sound source objects such as building materials or inanimate objects and sound source objects that emit sound may also become obstacles.

[0069] The meta-information includes information representing the shape of the three-dimensional sound field (space), the shape and position of obstacles in the three-dimensional sound field, the shape and position of the sound source object A1 in the three-dimensional sound field, and the position and orientation of the user U1 in the three-dimensional sound field.

[0070] The three-dimensional sound field can be either a closed space or an open space, but it is assumed here to be a closed space for illustration. In addition, the meta-information includes information indicating the reflectivity of structures such as floors, walls or ceilings that can reflect sound in the three-dimensional sound field and the reflectivity of obstacles present in the three-dimensional sound field. Here, the reflectivity is the energy ratio of reflected sound to incident sound, and is set for each frequency band of sound. Of course, the reflectivity can also be set uniformly regardless of the frequency band of the sound. In the case where the three-dimensional sound field is an open space, for example, parameters such as uniformly set attenuation rate, diffracted sound or initial reflected sound can also be used.

[0071] In the above description, reflectivity is listed as a parameter related to the obstacle or sound source object A1 included in the meta-information, but information other than reflectivity may also be included. For example, information related to the material of the object may also be included as meta-information related to both the sound source object and the non-sound source object. Specifically, the meta-information may also include parameters such as diffusivity, transmittance, or sound absorption.

[0072] As information related to the sound source object, it may also include volume, radiation characteristics (directivity), reproduction conditions, the number and type of sound sources emitted from an object, or information specifying the sound source area in the object. For example, the reproduction conditions may also be set to be a sound that flows continuously or a sound triggered by an event. The sound source area in the object can be set by the relative relationship between the position of the user U1 and the position of the object, or it can be set based on the object. In the case of setting by the relative relationship between the position of the user U1 and the position of the object, the user U1 can perceive that sound A is emitted from the right side of the object and sound B is emitted from the left side when the user U1 is looking at it, based on the side of the object from which the user U1 is looking. In the case of setting based on the object, which sound is emitted from which area of ​​the object can be fixed regardless of the direction in which the user U1 is looking. For example, the user U1 can perceive that when looking at the object from the front, high sound flows from the right side and low sound flows from the left side. In this case, when the user U1 goes around to the back of the object, the user U1 can perceive that the low sound flows from the right side and the high sound flows from the left side when looking from the back.

[0073] Meta-information related to the space may include time until initial reflected sound, reverberation time, ratio of direct sound to diffuse sound, etc. When the ratio of direct sound to diffuse sound is zero, the user U1 can perceive only direct sound.

[0074] In addition, it is assumed that the information indicating the position and orientation of the user U1 is included in the bitstream as metadata for explanation, but the information indicating the position and orientation of the user U1 that changes interactively may not be included in the bitstream. In this case, the information indicating the position and orientation of the user U1 is obtained from information other than the bitstream. For example, if it is the position information of the user U1 in the VR space, it can be obtained from the application that provides VR content. If it is the position information of the user U1 used to prompt sound as AR, the position information is obtained by self-position estimation using, for example, GPS, camera, or LiDAR (Laser Imaging Detection and Ranging) in a portable terminal.

[0075] In the embodiment, the meta-information includes information indicating a parameter that changes with time among parameters for generating the initial reflected sound described later. In addition, this information may not be included in the meta-information.

[0076] The sensor 3 is a device for detecting the position or movement of the head of the user U1. The sensor 3 is composed of, for example, a combination of one or more sensors of various sensors for motion detection such as a gyro sensor or an acceleration sensor. In the embodiment, the sensor 3 is built into the sound reproduction device 100, but it can also be built into an external device such as a stereoscopic image reproduction device that operates according to the movement of the head of the user U1 in the same way as the sound reproduction device 100. In this case, the sensor 3 may not be included in the sound reproduction device 100. In addition, an external camera device or the like can be used as the sensor 3 to capture the movement of the head of the user U1, and the movement of the user U1 can be detected by processing the captured image.

[0077] Sensor 3 is fixed integrally to the housing of sound reproduction device 100, for example, and detects the movement speed of the housing. When user U1 wears sound reproduction device 100 including the housing, it moves integrally with the head of user U1, and as a result, sensor 3 can detect the movement speed of the head of user U1.

[0078] The sensor 3 can detect the amount of rotation about at least one of the three axes orthogonal to each other in the three-dimensional sound field as the amount of movement of the head of the user U1, or can detect the amount of displacement about at least one of the three axes as the displacement direction. In addition, the sensor 3 can detect both the amount of rotation and the amount of displacement as the amount of movement of the head of the user U1.

[0079] The driver 4 has a driving mechanism such as a vibration plate, a magnet, or a voice coil. The driver 4 operates the driving mechanism according to the output sound signal Sig2 output from the output unit 14, and vibrates the vibration plate through the driving mechanism. In this way, the driver 4 generates sound waves through the vibration of the vibration plate corresponding to the output sound signal Sig2, and the sound waves propagate in the air and are transmitted to the ears of the user U1, and the user U1 perceives the sound.

[0080] Below, use Figure 2 The processing module 1 (sound processing system 10 ) will be described in detail.

[0081] The acquisition unit 11 acquires audio information and meta-information. In the embodiment, the meta-information is acquired by the extraction unit 12 included in the acquisition unit 11. When the acquisition unit 11 acquires the encoded audio information, it decodes the acquired audio information and supplies the decoded audio information to the sound processing unit 13.

[0082] In addition, the sound information and the meta information can be stored in one bit stream or in multiple bit streams. Similarly, the sound information and the meta information can be stored in one file or in multiple files.

[0083] In the case where the sound information and meta-information are stored in a plurality of bit streams, respectively, information indicating other associated bit streams may be included in one or a part of the bit streams storing the sound information and meta-information. In addition, information indicating other associated bit streams may be included in the meta-information or control information of each bit stream of the plurality of bit streams storing the sound information and meta-information. In the case where the sound information and meta-information are stored in a plurality of files, respectively, information indicating other associated bit streams or files may be included in one or a part of the files storing the sound information and meta-information. In addition, information indicating other associated bit streams or files may be included in the meta-information or control information of each bit stream of the plurality of bit streams storing the sound information and meta-information.

[0084] Here, the associated bitstreams or files are, for example, bitstreams or files that may be used simultaneously during audio processing. In addition, information indicating other associated bitstreams may be recorded together in the meta-information or control information of one bitstream among multiple bitstreams storing sound information and meta-information, or may be recorded separately in the meta-information or control information of two or more bitstreams among multiple bitstreams storing sound information and meta-information. Similarly, information indicating other associated bitstreams or files may be recorded together in the meta-information or control information of one file among multiple files storing sound information and meta-information, or may be recorded separately in the meta-information or control information of two or more files among multiple files storing sound information and meta-information. In addition, a control file that records information indicating other associated bitstreams or files may be generated separately from multiple files storing sound information and meta-information. In this case, the control file may not store sound information and meta-information.

[0085] Here, the information indicating the other associated bitstreams or files is, for example, an identifier indicating the other bitstream, a file name indicating the other file, a URL (Uniform Resource Locator) or a URI (Uniform Resource Identifier), etc. In this case, the acquisition unit 11 determines or acquires the bitstream or file based on the information indicating the other associated bitstream or file. In addition, the information indicating the other associated bitstream may be included in the meta-information or control information of at least a part of the bitstreams among the multiple bitstreams storing the sound information and meta-information, and the information indicating the other associated files may be included in the meta-information or control information of at least a part of the files among the multiple files storing the sound information and meta-information. Here, the file containing the information indicating the associated bitstream or file is, for example, a control file such as a manifest file for distributing content.

[0086] The extraction unit 12 decodes the encoded meta-information and provides the decoded meta-information to the sound processing unit 13. Here, the extraction unit 12 does not provide the same meta-information to each of the parameter determination unit 131, the initial reflected sound generation processing unit 132, the direction control unit 133, and the volume control unit 134 of the sound processing unit 13, which will be described later, but provides the meta-information required by each processing unit.

[0087] In addition, in the embodiment, the extraction unit 12 also obtains detection information including the amount of rotation or displacement detected by the sensor 3. The extraction unit 12 determines the position and orientation of the user U1 in the three-dimensional sound field (space) based on the obtained detection information. And, the extraction unit 12 updates the meta-information according to the determined position and orientation of the user U1. Therefore, the meta-information provided by the extraction unit 12 to each processing unit is the updated meta-information.

[0088] The sound processing unit 13 performs sound processing to generate a sound signal Sig1 based on the sound information and meta-information. The sound signal Sig1 represents a sound including an initial reflected sound that reaches the user U1 after the direct sound from the sound source object A1 reaches the user U1. As described above, the initial reflected sound is a reflected sound that reaches the user U1 after one or more reflections at a relatively early stage (for example, about several tens of milliseconds from the arrival of the direct sound) after the direct sound reaches the user U1 from the sound source object A1. In the embodiment, as Figure 3 As shown, the sound processing unit 13 includes a parameter determination unit 131 , an initial reflected sound generation processing unit 132 , a direction control unit 133 , and a volume control unit 134 .

[0089] The parameter determination unit 131 determines parameters for generating the initial reflection sound by referring to the sound information and meta-information, for example. The parameters include the pseudo sound source object B1 (refer to Figure 4 The false sound source object B1 is different from the sound source object A1. It is a virtual sound source object that does not exist in the three-dimensional sound field. It is located on a virtual reflection surface that reflects the sound waves from the sound source object A1 in the three-dimensional sound field, and produces sound to the user U1. The sound produced by the false sound source object B1 is the initial reflected sound. The parameters described here include the position (coordinates) of the false sound source object B1 in the three-dimensional sound field, the sound pressure of the sound produced by the false sound source object B1, and the frequency of the sound.

[0090] In the embodiment, the parameter determination unit 131 changes at least a part of the parameter per processing unit time (e.g., 1 / 60 second). In other words, at least a part of the parameter changes over time according to a predetermined condition. Here, the parameter determination unit 131 also changes at least a part of the parameter over time when the sound information and meta-information obtained per processing unit time are the same. That is, the change of the parameter over time described here is a change independent of the change accompanying the change of the acquired sound information and meta-information.

[0091] In the embodiment, at least a part of the parameters, i.e., the parameters that vary with time, is the position of the pseudo sound source object B1. Specifically, the position of the pseudo sound source object B1 varies with time within a specified range based on a reference position. The reference position of the pseudo sound source object B1 is determined based on the relative position of the sound source object A1 and the user U1. The specified conditions will be described in detail in [3-2. First Example] and [3-3. Second Example] described later.

[0092] Figure 4 It is an explanatory diagram of the temporal change of the parameters of the initial reflected sound. Figure 4 (a) represents the positions of the sound source object A1, the pseudo sound source object B1, and the user U1 in the three-dimensional sound field (space) at time t=n (n is a real number). Figure 4 (b) shows the positions of the sound source object A1, the pseudo sound source object B1, and the user U1 in the three-dimensional sound field (space) at time t = n + 1. The difference between time t = n and time t = n + 1 corresponds to the processing unit time. Figure 4 In (a) and (b), the positions of the sound source object A1 and the user U1 do not change.

[0093] like Figure 4 As shown in (b), the position of the pseudo sound source object B1 changes relative to the position of the pseudo sound source object B1 at time t = n (see the dotted circle mark). In this way, in the embodiment, the parameter determination unit 131 determines the position of the pseudo sound source object B1 so that the position of the pseudo sound source object B1 changes with time (here, per processing unit time).

[0094] The initial reflected sound generation processing unit 132 generates the initial reflected sound based on the parameters determined by the parameter determination unit 131. Specifically, the initial reflected sound generation processing unit 132 arranges the pseudo sound source object B1 at the position (coordinates) determined by the parameter determination unit 131 in the three-dimensional sound field (space), and causes the pseudo sound source object B1 to generate the sound of the sound pressure and frequency determined by the parameter determination unit 131, thereby generating the initial reflected sound.

[0095] The direction control unit 133 controls the direction of the initial reflected sound from the pseudo sound source object B1 to the user U1 with reference to the meta-information. Specifically, the direction control unit 133 determines the direction of the sound generated by the pseudo sound source object B1 from the pseudo sound source object B1 to the right ear (or left ear) of the user U1 based on the position of the pseudo sound source object B1 in the three-dimensional sound field (space), the position of the user U1, and the orientation of the user U1.

[0096] The volume control unit 134 controls the volume (sound pressure) of the initial reflected sound reaching the user U1 from the pseudo sound source object B1 with reference to the meta-information. Specifically, the volume control unit 134 determines the volume of the initial reflected sound when the initial reflected sound reaches the user U1 based on the distance between the pseudo sound source object B1 and the user U1 in the three-dimensional sound field (space). For example, the longer the distance, the more the volume control unit 134 reduces the volume of the initial reflected sound, and the shorter the distance, the more the volume control unit 134 increases the volume of the initial reflected sound.

[0097] The output unit 14 outputs the output sound signal Sig2 including the sound signal Sig1 generated by the sound processing unit 13 to the driver 4 .

[0098] [3.Action]

[0099] Hereinafter, the operation of the sound processing system 10 according to the embodiment, that is, the sound processing method will be described.

[0100] [3-1. Basic movements]

[0101] First, use Figure 5 The basic operation of the sound processing system 10 according to the embodiment will be described. Figure 5 1 is a flowchart showing the basic operation of the sound processing system 10 according to the embodiment. Figure 5 The steps S1 to S3 shown in the figure are described as a premise. Figure 5 Illustration of the processing performed by the direction control unit 133 and the processing performed by the volume control unit 134 is omitted.

[0102] First, when the operation of the sound reproduction device 100 is started, the acquisition unit 11 acquires the sound information and meta-information via the communication module 2 (S1). Next, the sound processing unit 13 starts the sound processing based on the acquired sound information and meta-information (S2).

[0103] In the sound processing, the parameter determination unit 131 refers to the sound information and the meta-information to determine the parameters used to generate the initial reflected sound (S21). Here, as described above, at least a part of the parameters used by the parameter determination unit 131 to generate the initial reflected sound varies with time according to a predetermined condition. For example, the parameter determination unit 131 varies at least a part of the parameters per processing unit time. Next, in the sound processing, the initial reflected sound generation processing unit 132 generates the initial reflected sound based on the parameters determined by the parameter determination unit 131 (S22).

[0104] In the sound processing, the direction control unit 133 refers to the meta-information to determine the direction of the initial reflected sound reaching the user U1 from the pseudo sound source object B1. Furthermore, in the sound processing, the volume control unit 134 refers to the meta-information to determine the volume (sound pressure) of the initial reflected sound reaching the user U1 from the pseudo sound source object B1.

[0105] Next, the output unit 14 outputs an output sound signal Sig2 including the sound signal Sig1 generated by the sound processing unit 13 ( S3 ).

[0106] [3-2. First embodiment]

[0107] Below, use Figure 6 A first example of the sound processing system 10 according to the embodiment will be described. Figure 6 1 is a block diagram showing the functional structure of the first embodiment of the sound processing system 10 according to the embodiment. Figure 6 As shown, in the first embodiment, the sound processing unit 13 further includes a random number generating unit 135 .

[0108] The random number generator 135 generates random numbers per processing unit time according to an appropriate random number generation algorithm. Specifically, the random number generator 135 generates random numbers "n1", "n2", and "n3" (all "n1", "n2", and "n3" are real numbers) added to the X-coordinate, Y-coordinate, and Z-coordinate of the false sound source object B1 in the three-dimensional sound field (space) per processing unit time. In the first embodiment, the possible ranges of these random numbers "n1", "n2", and "n3" are approximately ±0.2 (in units of "m"). That is, the possible range of the random numbers generated by the random number generator 135 is not unlimited, but is appropriately set within a range that makes it difficult for the user to feel uncomfortable when the position of the false sound source object B1 changes.

[0109] Furthermore, in the first embodiment, the parameter determination unit 131 changes the position of the pseudo sound source object B1 over time (here, per processing unit time) with reference to the random number generated by the random number generation unit 135. For example, when the reference position of the pseudo sound source object B1 in the three-dimensional sound field (space) is expressed by the following equation (1), the position of the pseudo sound source object B1 determined with reference to the random number is expressed by the following equation (2). In the following equations (1) and (2), "(x, y, z)" represents the coordinates of the pseudo sound source object B1, and "a", "b", and "c" are real numbers.

[0110] [Mathematical formula 1]

[0111] (x,y,z)=(a,b,c)...(1)

[0112] (x,y,z)=(a+n 1 ,b+n 2 ,c+n 3 )...(2)

[0113] Below, use Figure 7 The operation of the first example of the sound processing system 10 according to the embodiment will be described. Figure 7 This is a flowchart showing the operation of the first example of the sound processing system 10 according to the embodiment. Figure 7 The operation shown is performed by the sound processing unit 13. Figure 7 The description is given based on the assumption that steps S101 to S106 are shown.

[0114] First, the random number generator 135 generates a random number (S101). Next, the parameter determination unit 131 determines the parameters for generating the initial reflected sound with reference to the sound information and meta-information (S102). Here, the parameter determination unit 131 determines the position of the pseudo sound source object B1 in the parameters for generating the initial reflected sound with reference to the random number generated by the random number generator 135. Thus, the position of the pseudo sound source object B1 changes over time (here, per processing unit time) according to the random number. Next, the initial reflected sound generation processing unit 132 generates the initial reflected sound based on the parameters determined by the parameter determination unit 131 (S103).

[0115] Next, the direction control unit 133 refers to the meta-information and determines the direction of the initial reflected sound reaching the user U1 from the pseudo sound source object B1 (S104). Furthermore, the volume control unit 134 refers to the meta-information and determines the volume (sound pressure) of the initial reflected sound reaching the user U1 from the pseudo sound source object B1 (S105). Next, the sound processing unit 13 outputs the generated sound signal Sig1 to the output unit 14 (S106).

[0116] Thus, in the first embodiment, the parameter determination unit 131 uses the reference position of the pseudo sound source object B1 as a reference and changes the position of the pseudo sound source object B1 per processing unit time according to the random number generated by the random number generation unit 135. That is, in the first embodiment, the predetermined condition is the random number for determining the position of the pseudo sound source object B1.

[0117] In addition, when the distance between the false sound source object B1 and the user U1 in the three-dimensional sound field (space) is within 1m, for example, and the position of the false sound source object B1 and the user U1 is relatively close, the possible range of the random number can also be narrowed. That is, the possible range of the random number can also be changed according to the position of the false sound source object B1 and the user U1 in the three-dimensional sound field. In other words, the variable range of the position of the false sound source object B1 can also be determined according to the positional relationship between the user U1 and the false sound source object B1. In this case, the possible range of the random number is, for example, ±0.05 to ±0.2.

[0118] In addition, the possible range of random numbers can also be changed according to the reflectivity of obstacles (such as walls) contained in the three-dimensional sound field (space). For example, the lower the reflectivity of the obstacle, the smaller the possible range of random numbers. In addition, the possible range of random numbers can also be changed according to the size or shape of the three-dimensional sound field. In other words, the variable range of the position of the false sound source object B1 can also be determined according to the acoustic characteristics of the three-dimensional sound field (space).

[0119] [3-3. Second embodiment]

[0120] Below, use Figure 8 A second example of the sound processing system 10 according to the embodiment will be described. Figure 8 It is an explanatory diagram of the operation in the second example of the sound processing system 10 according to the embodiment.

[0121] In the second embodiment, the parameter determination unit 131 changes the position of the pseudo sound source object B1 along a predetermined trajectory C1 over time (here, per processing unit time). Specifically, when the reference position of the pseudo sound source object B1 in the three-dimensional sound field (space) is expressed by the above-mentioned equation (1), the position of the pseudo sound source object B1 changes in a manner that satisfies the following equation (3). In the following equation (3), "r" represents the radius of the sphere and is a real number.

[0122] [Mathematical formula 2]

[0123] (x) 2 +(yb) 2 +(zc) 2 =r 2 ...(3)

[0124] Therefore, if Figure 8 As shown, the position of the pseudo sound source object B1 is along a sphere of radius "r" centered at the reference position of the pseudo sound source object B1 (see the dotted circle mark). Figure 8 The circumference (orbit C1) of the sphere (circular in the plan view) changes with time (here, per processing unit time). In the second embodiment, the range of the radius "r" of the sphere is about 0.2 or less (unit: "m"). That is, the range of the orbit C1 is not unlimited, but is appropriately set within a range that does not make the user feel uncomfortable when the position of the false sound source object B1 changes.

[0125] Below, use Fig. 9 The operation of the second example of the sound processing system 10 according to the embodiment will be described. Fig. 9 This is a flowchart showing the operation of the second example of the sound processing system 10 according to the embodiment. Fig. 9 The operation shown is performed by the sound processing unit 13. Fig. 9 The description is based on the assumption that steps S201 to S206 are shown.

[0126] First, the parameter determination unit 131 determines the trajectory C1 of the pseudo sound source object B1 (S201). Next, the parameter determination unit 131 refers to the sound information and meta-information to determine the parameters used to generate the initial reflection sound (S202). Here, the parameter determination unit 131 refers to the trajectory C1 determined in step S201 to determine the position of the pseudo sound source object B1 in the parameters used to generate the initial reflection sound. As a result, the position of the pseudo sound source object B1 changes over time (here, per processing unit time) along the trajectory C1. Next, the initial reflection sound generation processing unit 132 generates the initial reflection sound based on the parameters determined by the parameter determination unit 131 (S203).

[0127] Next, the direction control unit 133 refers to the meta-information and determines the direction of the initial reflected sound reaching the user U1 from the pseudo sound source object B1 (S204). Furthermore, the volume control unit 134 refers to the meta-information and determines the volume (sound pressure) of the initial reflected sound reaching the user U1 from the pseudo sound source object B1 (S205). Next, the sound processing unit 13 outputs the generated sound signal Sig1 to the output unit 14 (S206).

[0128] Thus, in the second embodiment, the parameter determination unit 131 changes the position of the pseudo sound source object B1 per processing unit time along the track C1 based on the reference position of the pseudo sound source object B1. That is, in the second embodiment, the predetermined condition is the track C1 in the three-dimensional sound field (space) for determining the position of the pseudo sound source object B1.

[0129] In addition, when the distance between the false sound source object B1 and the user U1 in the three-dimensional sound field (space) is within 1m, for example, the possible range of the track C1 may be narrowed when the positions of the false sound source object B1 and the user U1 are relatively close. That is, the possible range of the track C1 may be changed according to the positions of the false sound source object B1 and the user U1 in the three-dimensional sound field. In other words, the possible range of the position of the false sound source object B1 may also be determined according to the positional relationship between the user U1 and the false sound source object B1. In this case, the possible range of the track C1 is, for example, 0.05 to 0.2.

[0130] In addition, the possible range of track C1 may be changed according to the reflectivity of obstacles (such as walls) included in the three-dimensional sound field (space). For example, the lower the reflectivity of the obstacle, the smaller the possible range of track C1. In addition, the possible range of track C1 may be changed according to the size or shape of the three-dimensional sound field. In other words, the variable range of the position of the false sound source object B1 may also be determined according to the acoustic characteristics of the three-dimensional sound field (space).

[0131] In addition, the shape of the track C1 is not limited to a spherical shape, and may be other shapes such as a circle or an ellipse. That is, the track C1 may be a three-dimensional track or a two-dimensional track.

[0132] [4. Advantages]

[0133] The advantages of the sound processing system 10 (sound processing method) according to the embodiment will be described below in comparison with the sound processing system of the comparative example. The sound processing system of the comparative example is different from the sound processing system 10 according to the embodiment in that the position of the pseudo sound source object B1 does not change over time but is fixed.

[0134] When the sound processing system of the comparative example is used, since the position of the false sound source object B1 does not change with time, the reflected sound of the same direction and the same sound pressure continues to reach the user U1, and the user U1 may feel uncomfortable.

[0135] In contrast, in the sound processing system 10 (sound processing method) of the embodiment, the position of the false sound source object B1 (i.e., the parameter for generating the initial reflected sound) changes with time, so the direction and sound pressure of the reflected sound reaching the user U1 also change with time, and the user U1 is less likely to feel uncomfortable. In addition, the processing of changing the position of the false sound source object B1 with time is small in computational complexity compared to the processing of simulating the fluctuation of the sound wave from the reflection point in the real space to generate the initial reflected sound.

[0136] Therefore, the sound processing system 10 (sound processing method) according to the embodiment has the advantage that the amount of calculation is reduced and a sound that the user U1 does not easily feel uncomfortable can be easily reproduced.

[0137] (Other embodiments)

[0138] As mentioned above, although embodiment was described, this disclosure is not limited to the said embodiment.

[0139] In the above embodiment, the parameter determination unit 131 may not change the time-varying parameter per processing unit time. For example, the parameter determination unit 131 may change the time-varying parameter per predetermined time (e.g., a time that is an integer multiple of the processing unit time) or at irregular intervals.

[0140] In the above embodiment, the parameter determination unit 131 may change at least a part of the parameters over time according to a predetermined condition other than the random number and the track C1. For example, the parameter determination unit 131 may change at least a part of the parameters over time according to a preset change pattern.

[0141] In the above embodiment, the parameter that changes with time is not limited to the position of the pseudo sound source object B1. For example, the parameter that changes with time may also be the sound pressure of the sound generated by the pseudo sound source object B1 or the frequency of the sound. In addition, the parameter that changes with time is not limited to one, but may be multiple. For example, the parameter that changes with time may also be two or more parameters among the position of the pseudo sound source object B1, the sound pressure of the sound generated by the pseudo sound source object B1, and the frequency of the sound.

[0142] In the above-mentioned embodiment, the sound processing unit 13 may also perform processing other than the processing of generating the initial reflected sound. For example, the sound processing unit 13 may also perform a late reverberation sound generation process of generating a late reverberation sound, a diffracted sound generation process of generating a diffracted sound, a sound signal transmission process, or an additional process of adding an acoustic effect such as the Doppler effect to the sound signal. Here, the late reverberation sound is a reverberation sound that reaches the user at a relatively late stage (for example, about a hundred and several dozen ms from the arrival of the direct sound) after the initial reflected sound reaches the user, after being reflected more times (for example, several dozen times) than the initial reflected sound. The diffracted sound is a sound that reaches the user from the sound source object by bypassing an obstacle when there is an obstacle between the sound source object and the user.

[0143] In the above embodiment, the acquisition unit 11 acquires the audio information and meta-information from the encoded bit stream, but the present invention is not limited to this. For example, the acquisition unit 11 may acquire the audio information and meta-information separately from information other than the bit stream.

[0144] In addition, for example, the sound reproduction device described in the above-mentioned embodiment can be implemented as a single device having all the components, or can be implemented by assigning each function to multiple devices and cooperating with the multiple devices. In the latter case, an information processing device such as a smartphone, a tablet terminal or a PC can also be used as a device equivalent to the processing module.

[0145] In addition, the sound reproduction device of the present disclosure can also be implemented as a sound processing device that is connected to a reproduction device having only a driver and outputs only sound signals to the reproduction device. In this case, the sound processing device can be implemented as hardware having a dedicated circuit or as software for causing a general-purpose processor to perform specific processing.

[0146] Furthermore, in the above-described embodiment, the process executed by a specific processing unit may be executed by another processing unit. Furthermore, the order of a plurality of processes may be changed, or a plurality of processes may be executed in parallel.

[0147] In addition, in the above-mentioned embodiments, each component can also be implemented by executing a software program suitable for each component. Each component can also be implemented by a program execution unit such as a CPU (Central Processing Unit) or a processor reading and executing a software program recorded in a recording medium such as a hard disk or a semiconductor memory.

[0148] In addition, each component may also be implemented by hardware. For example, each component may also be a circuit (or integrated circuit). These circuits may constitute one circuit as a whole, or they may be different circuits. In addition, these circuits may be general circuits or dedicated circuits.

[0149] In addition, the global or specific form of the present disclosure may also be implemented by a device, method, integrated circuit, computer program, or a computer-readable CD-ROM or other recording medium. In addition, the global or specific form of the present disclosure may also be implemented by any combination of a device, method, integrated circuit, computer program, and recording medium.

[0150] For example, the present disclosure may be implemented as a sound processing method executed by a computer, or as a program for causing a computer to execute the sound processing method. The present disclosure may also be implemented as a computer-readable non-transitory recording medium recording such a program.

[0151] In addition, various modifications that can be conceived by those skilled in the art to the embodiments, or embodiments achieved by arbitrarily combining the components and functions of the embodiments without departing from the gist of the present disclosure are also included in the present disclosure.

[0152] Industrial Applicability

[0153] The present disclosure is useful in allowing a user to perceive stereoscopic sound or the like in acoustic reproduction.

[0154] Description of symbols

[0155] 1 Processing module

[0156] 10. Sound Processing System

[0157] 100 Sound reproduction device

[0158] 11 Acquisition Department

[0159] 12 Extraction Department

[0160] 13. Sound Processing Department

[0161] 131 Parameter determination unit

[0162] 132 Initial reflection sound generation processing unit

[0163] 133 Direction Control Unit

[0164] 134 Volume Control

[0165] 135 Random Number Generation Unit

[0166] 14 Output section

[0167] 2 Communication Module

[0168] 3 Sensors

[0169] 4 Drivers

[0170] A1 Sound Source Object

[0171] B1 Fake sound source object

[0172] C1 Track

[0173] Sig1 sound signal

[0174] Sig2 output audio signal

[0175] U1 User

Claims

1. A sound processing method, wherein: acquiring sound information related to a sound including a predetermined sound and meta-information including information related to a space in which the predetermined sound is reproduced, Based on the sound information and the meta-information, an acoustic process is performed to generate a sound signal indicating a sound including an initial reflected sound reaching the user after a direct sound from a sound source object to the user. outputting an output audio signal including the above audio signal, In the above-mentioned sound processing, determining parameters for generating the initial reflected sound, the parameters including the position of a false sound source object generating the initial reflected sound in the space, The initial reflected sound is generated based on the determined parameters. At least a part of the above parameters varies with time according to predetermined conditions.

2. The sound processing method according to claim 1, wherein: The parameter that changes with time is the position of the false sound source object that generates the initial reflected sound in the space.

3. The sound processing method according to claim 2, wherein: The above-mentioned predetermined condition is a random number used to determine the position of the above-mentioned false sound source object.

4. The sound processing method according to claim 2, wherein: The predetermined condition is a trajectory in the space for determining the position of the false sound source object.

5. The sound processing method according to any one of claims 2 to 4, wherein: The variable range of the position of the false sound source object is determined according to the positional relationship between the user and the false sound source object.

6. The sound processing method according to any one of claims 2 to 4, wherein: The variable range of the position of the false sound source object is determined according to the acoustic characteristics of the space. 7 . A program for causing a computer to execute the sound processing method according to claim 1 .

8. A sound processing system, wherein: have: an acquisition unit that acquires sound information related to a sound including a predetermined sound and meta-information including information related to a space in which the predetermined sound is reproduced; an audio processing unit that performs audio processing for generating an audio signal representing a sound including an initial reflected sound that reaches the user after a direct sound from a sound source object to the user, based on the audio information and the meta-information; and an output unit, outputting an output sound signal including the sound signal, The above-mentioned sound processing unit has: a parameter determination unit that determines parameters for generating the initial reflected sound, the parameters including a position of a false sound source object that generates the initial reflected sound in the space; and The initial reflected sound generation processing unit generates the initial reflected sound based on the determined parameters. At least a part of the above parameters varies with time according to predetermined conditions.

Images