Information processing device and method, and program

Abstract

To obtain high realistic sensation with a small computation amount.SOLUTION: An information processing device includes a gain determination unit that determines an attenuation amount based on a positional relationship between a predetermined object and another object and determines a signal gain of the predetermined object based on the attenuation amount. This technology is applicable to a signal processing device.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present technology relates to an information processing device, and more particularly to an information processing device that is capable of obtaining a high sense of realism with a small amount of calculation. [Background technology]

[0002] Conventionally, object audio technology has been used in movies, games, etc., and encoding methods capable of handling object audio have also been developed. Specifically, for example, the international standard MPEG (Moving Picture Experts Group)-H Part 3:3D audio standard is known (for example, see Non-Patent Document 1).

[0003] In this encoding method, in addition to the conventional two-channel stereo method and multi-channel stereo methods such as 5.1 channels, it is possible to treat moving sound sources, etc. as independent audio objects and encode the object's position information as metadata along with the signal data of the audio object.

[0004] This allows playback in various viewing environments with different numbers and arrangements of speakers. It also makes it easy to process the sound of a specific sound source during playback, such as adjusting the volume of the sound of a specific sound source or adding effects to the sound of a specific sound source, which was difficult with conventional encoding methods.

[0005] For example, the standard in Non-Patent Document 1 uses a method called three-dimensional Vector Based Amplitude Panning (VBAP) (hereinafter simply referred to as VBAP) for rendering processing.

[0006] This is a rendering technique commonly known as panning, which involves distributing gain to the three speakers that exist on the surface of a sphere with the user position as the origin and are closest to the audio object, which also exists on the surface of the sphere.

[0007] Besides VBAP, a rendering process using a panning method called Speaker-anchored coordinates panner, which distributes gain to each of the x-axis, y-axis, and z-axis, is also known (see, for example, Non-Patent Document 2). [Prior art documents] [Non-patent literature]

[0008] [Non-Patent Document 1] INTERNATIONAL STANDARD ISO / IEC 23008-3 First edition 2015-10-15 Information technology - High efficiency coding and media delivery in heterogeneous environments - Part 3: 3D audio [Non-Patent Document 2] ETSI TS 103 448 v1.1.1(2016-09) Summary of the Invention [Problem to be solved by the invention]

[0009] However, in the above-mentioned rendering method, the object signals of multiple audio objects are rendered for each individual audio object, and no consideration is given to acoustic changes due to the relative positional relationship between the audio objects, so it is not possible to obtain a high sense of realism during audio playback.

[0010] For example, if a sound is emitted from a second audio object behind a first audio object as seen from the listener's position, the sound from the second audio object will be completely ignored due to the attenuation effects caused by reflection, diffraction and absorption of the sound from the first audio object.

[0011] In the above-mentioned rendering method, since the user position is fixed, it is possible to adjust the level of the object signal in advance, for example, depending on the positional relationship between the user position and a plurality of audio objects.

[0012] This level adjustment makes it possible to express changes in sound depending on the relative positions of audio objects. Therefore, for example, if the attenuation effect caused by reflection, diffraction, and absorption of sound in an audio object is calculated based on the laws of physics, and the level of the object signal of the audio object is adjusted in advance based on the calculation result, a high sense of realism can be achieved.

[0013] However, if the attenuation effects caused by such sound reflection, diffraction, and absorption are calculated based on the laws of physics, the amount of calculations would become large when there are a large number of audio objects, making this unrealistic.

[0014] Furthermore, at a fixed viewpoint where the user position is fixed, it is possible to generate an object signal that takes into account sound reflection, diffraction, etc. by performing level adjustments in advance, but at a free viewpoint where the user position can move, such prior level adjustments become completely meaningless.

[0015] The present technology has been made in view of such circumstances, and makes it possible to obtain a high sense of realism with a small amount of calculation. [Means for solving the problem]

[0016] An information processing device according to one aspect of the present technology includes: attenuation disable information indicating whether or not to attenuate a signal of a specified object; a gain determination unit that determines an amount of attenuation based on a positional relationship between the specified object and other objects and determines a gain of the signal of the specified object based on the amount of attenuation; and a rendering processing unit that performs rendering processing based on the determined gain and the object signal of the specified object.

[0017] An information processing method or program of one aspect of the present technology includes steps of determining an amount of attenuation based on attenuation disable information indicating whether to attenuate a signal of a specified object and a positional relationship between the specified object and other objects, determining a gain of the signal of the specified object based on the amount of attenuation, and performing a rendering process based on the determined gain and the object signal of the specified object.

[0018] In one aspect of the present technology, an amount of attenuation is determined based on attenuation disable information indicating whether or not to attenuate a signal of a specified object and a positional relationship between the specified object and other objects, a gain of the signal of the specified object is determined based on the amount of attenuation, and a rendering process is performed based on the determined gain and the object signal of the specified object. Effect of the Invention

[0019] According to one aspect of the present technology, a high sense of realism can be obtained with a small amount of calculation.

[0020] Note that the effects described herein are not necessarily limited to those described herein, and may be any of the effects described in this disclosure. [Brief description of the drawings]

[0021] [Figure 1] FIG. 1 is a diagram illustrating VBAP. [Diagram 2] FIG. 1 illustrates an example of the configuration of a signal processing device. [Diagram 3] FIG. 1 is a diagram illustrating coordinate transformation. [Figure 4] FIG. 1 is a diagram illustrating coordinate transformation. [Diagram 5] FIG. 2 is a diagram illustrating a coordinate system. [Figure 6] FIG. 13 is a diagram illustrating an attenuation distance and a radius ratio. [Figure 7] FIG. 2 is a diagram illustrating metadata. [Figure 8]FIG. 13 is a diagram illustrating an attenuation table. [Figure 9] FIG. 13 is a diagram illustrating a correction table. [Figure 10] 11 is a flowchart illustrating an audio output process. [Figure 11] FIG. 1 illustrates an example of the configuration of a computer. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0022] Hereinafter, embodiments to which the present technology is applied will be described with reference to the drawings.

[0023] First Embodiment About this technology When rendering audio objects, this technology determines gain information for the audio objects based on the positional relationships of multiple audio objects in a space, making it possible to achieve a sufficiently high sense of realism with a small amount of calculations.

[0024] This technology is not limited to rendering of audio objects, but can be applied to cases where parameters of multiple objects existing in a space are adjusted according to the positional relationship between the objects. For example, this technology can be applied to cases where the amount of adjustment of parameters such as brightness (amount of light) related to the image signal of an object is determined according to the positional relationship between the objects.

[0025] In the following, the description will be continued taking the rendering of an audio object as a specific example, and the audio object will also be simply referred to as an object hereinafter.

[0026] For example, during rendering, a rendering process using a predetermined method such as the above-mentioned VBAP is performed. In VBAP, gain is distributed to the three speakers that are closest to an object that is also on the surface of the sphere, among the speakers that exist on the surface of the sphere with the user's position in space as the origin.

[0027] For example, as shown in FIG. 1, it is assumed that a user U11 who is a listener exists in a three-dimensional space, and three speakers SP1 to SP3 are arranged in front of the user U11.

[0028] Also, the position of the head of the user U11 is set as the origin O, and the speakers SP1 to SP3 are positioned on the surface of a sphere with the origin O as the center.

[0029] Now, suppose that an object exists within an area TR11 surrounded by speakers SP1 to SP3 on the surface of the sphere, and a sound image is to be localized at a position VSP1 of the object.

[0030] In such a case, in VBAP, gain is distributed for the object to the speakers SP1 to SP3 surrounding the position VSP1.

[0031] Specifically, in a three-dimensional coordinate system with the origin O as the reference (origin), the position VSP1 is represented by a three-dimensional vector P with the origin O as the start point and the position VSP1 as the end point.

[0032] Furthermore, if vectors L1 to L3 are three-dimensional vectors whose starting point is the origin O and whose ending points are the positions of each speaker SP1 to SP3, then vector P can be expressed as a linear sum of vectors L1 to L3, as shown in the following equation (1).

[0033]

number

[0034] Here, by calculating the coefficients g1 to g3 by which vectors L1 to L3 are multiplied in equation (1) and setting these coefficients g1 to g3 as the gains of the sounds output from speakers SP1 to SP3, respectively, the sound image can be localized at position VSP1.

[0035] For example, let g be a vector whose elements are coefficients g1 to g3. 123 = [g1, g2, g3], and the vector with vectors L1 to L3 as elements is L 123 = [L1, L2, L3], the above formula (1) can be transformed to obtain the following formula (2).

[0036]

number

[0037] By using the coefficients g1 to g3 obtained by calculating such equation (2) as gains and outputting an object signal, which is a signal of the sound of the object, to each of the speakers SP1 to SP3, it is possible to localize a sound image at position VSP1.

[0038] The positions of the speakers SP1 to SP3 are fixed, and the information indicating the positions of the speakers is known. Therefore, the inverse matrix L 123 -1 can be calculated in advance. Therefore, VBAP can perform rendering with relatively simple calculations, i.e., with a small amount of calculations.

[0039] However, as mentioned above, when there are multiple objects in a space when rendering using VBAP or the like, the changes in sound due to the relative positions of those objects are not taken into consideration at all, making it impossible to achieve a high sense of realism when playing back audio.

[0040] It is also possible to adjust the level of the object signal in advance, but calculating the attenuation effect for level adjustment based on physical laws requires a large amount of calculations and is not realistic. Furthermore, since the user's position changes in the free viewpoint, performing level adjustment in advance becomes completely meaningless.

[0041] Therefore, in this technology, information regarding the attenuation of the object is used to adjust the level of the object signal on the sound playback side, thereby making it possible to obtain a high sense of realism with a small amount of calculation.

[0042] In particular, this technology determines gain information for adjusting the level of object signals based on the relative positional relationship between objects, making it possible to create attenuation effects caused by sound reflection, diffraction, and absorption, i.e., acoustic changes, with a small amount of calculations, thereby achieving a high sense of realism.

[0043] <Configuration example of signal processing device> Next, a configuration example of a signal processing device to which the present technology is applied will be described.

[0044] FIG. 2 is a diagram showing an example of the configuration of an embodiment of a signal processing device to which the present technology is applied.

[0045] The signal processing device 11 shown in FIG. 2 includes a decoding processing unit 21, a coordinate conversion processing unit 22, an object attenuation processing unit 23, and a rendering processing unit 24.

[0046] The decoding processor 21 receives and decodes the transmitted input bitstream, and outputs the resulting object metadata and object signal.

[0047] Here, the object signal is an audio signal for reproducing the sound of an object, and the metadata includes object position information, object outer diameter information, object attenuation information, object attenuation invalid information, and object gain information for each object.

[0048] The object position information is information that indicates the absolute position of an object in a space in which the object exists (hereinafter, also referred to as a listening space).

[0049] For example, the object position information is coordinate information indicating the position of an object, expressed by the x, y, and z coordinates of a three-dimensional Cartesian coordinate system having a predetermined position as the origin, that is, an xyz coordinate system.

[0050] The object outer diameter information is information that indicates the outer diameter of an object. For example, it is assumed here that the object is spherical, and the radius of the sphere is set as the object outer diameter information that indicates the outer diameter of the object.

[0051] In the following description, the object is assumed to be spherical, but the object may have any shape. For example, the object may have a shape having a radius in each of the x-axis, y-axis, and z-axis directions, and information indicating the radius of the object in each of these axial directions may be set as the object outer diameter information.

[0052] Furthermore, outer diameter information for spreading may be used as object outer diameter information. For example, the MPEG-H Part 3:3D audio standard employs a technology called spread as a technology for expanding the size of a sound source, and has a format in which outer diameter information of each object can be recorded in order to expand the size of the sound source. Thus, such outer diameter information for spreading may be used as object outer diameter information.

[0053] The object attenuation information is information about the amount of attenuation of a sound from another object caused by an object. By using the object attenuation information, the amount of attenuation of an object signal of another object in a given object can be obtained according to the positional relationship between the objects.

[0054] The object attenuation invalid information is information indicating whether or not to perform attenuation processing on the sound of an object, that is, on an object signal, that is, whether or not to attenuate the object signal.

[0055] For example, the attenuation process for the object signal is disabled when the value of the object attenuation disable information is 1. In other words, when the value of the object attenuation disable information is 1, the attenuation process for the object signal is not performed.

[0056] For example, if a sound source creator intends that a certain object is important and does not want the sound of that object to have an attenuation effect due to its positional relationship with other objects, the value of the object attenuation invalid information is set to 1. Note that hereinafter, an object whose object attenuation invalid information value is set to 1 will also be referred to as an attenuation invalid object.

[0057] On the other hand, when the value of the object attenuation invalid information is 0, attenuation processing is performed on the object signal according to the positional relationship between the object and other objects. Hereinafter, an object that can be the target of attenuation processing and whose object attenuation invalid information has a value of 0 will also be referred to as an attenuation processing object.

[0058] The object gain information is information indicating a gain for adjusting the level of an object signal, which is determined in advance by a sound source producer. For example, the object gain information is a decibel value indicating the gain.

[0059] When the object signal and metadata of each object are obtained by decoding in the decoding processing unit 21, the decoding processing unit 21 supplies the obtained object signal to the rendering processing unit 24.

[0060] The decoding processing unit 21 also supplies object position information of the metadata obtained by decoding to the coordinate conversion processing unit 22. Furthermore, the decoding processing unit 21 supplies object outer diameter information, object attenuation information, object attenuation invalid information, and object gain information of the metadata obtained by decoding to the object attenuation processing unit 23.

[0061] The coordinate conversion processing unit 22 generates object spherical coordinate position information based on the object position information supplied from the decoding processing unit 21 and user position information supplied from the outside, and supplies the object spherical coordinate position information to the object attenuation processing unit 23. In other words, the coordinate conversion processing unit 22 converts the object position information into object spherical coordinate position information.

[0062] Here, the user position information is information indicating the absolute position of the user who will be the listener within the listening space in which the object exists, i.e., the absolute position of the listening point desired by the user, and is coordinate information represented by the x coordinate, y coordinate, and z coordinate in the xyz coordinate system.

[0063] This user position information is not information contained in the input bit stream, but is information supplied from, for example, an external user interface connected to the signal processing device 11 .

[0064] Moreover, the object spherical coordinate position information is information that indicates the relative position of an object as seen by the user in the listening space, expressed by coordinates in a spherical coordinate system, that is, by spherical coordinates.

[0065] The object attenuation processing unit 23 determines corrected object gain information by appropriately correcting the object gain information based on the object spherical coordinate position information supplied from the coordinate transformation processing unit 22 and the object outer diameter information, object attenuation information, object attenuation invalid information, and object gain information supplied from the decoding processing unit 21.

[0066] In other words, the object attenuation processing unit 23 functions as a gain determination unit that determines corrected object gain information based on object spherical coordinate position information, object outer diameter information, object attenuation information, object attenuation invalid information, and object gain information.

[0067] Here, the gain value indicated by the corrected object gain information is obtained by appropriately correcting the gain value indicated by the object gain information in consideration of the positional relationship of the objects.

[0068] Such corrected object gain information is intended to realize level adjustment of an object signal taking into consideration attenuation caused by reflection, diffraction, and absorption of sound generated by an object due to the positional relationship of the object, that is, changes in sound.

[0069] In the rendering processing unit 24, a process of adjusting the level of the object signal based on the corrected object gain information during rendering is performed as an attenuation process. Such an attenuation process can be said to be a process of attenuating the level of the object signal in response to the reflection, diffraction, and absorption of sound.

[0070] The object attenuation processing unit 23 supplies the object spherical coordinate position information and the corrected object gain information to the rendering processing unit 24 .

[0071] In the signal processing device 11, the coordinate conversion processing unit 22 and the object attenuation processing unit 23 function as an information processing device that determines, for each object, corrected object gain information for adjusting the level of an object signal according to the positional relationship with other objects.

[0072] The rendering processing unit 24 generates an output audio signal based on the object signal supplied from the decoding processing unit 21 and the object spherical coordinate position information and corrected object gain information supplied from the object attenuation processing unit 23, and supplies it to downstream speakers, headphones, a recording unit, etc.

[0073] Specifically, the rendering processor 24 performs panning processing such as VBAP as the rendering processing to generate an output audio signal.

[0074] For example, when VBAP is performed as the panning process, a calculation similar to the above-mentioned formula (2) is performed based on the object spherical coordinate position information and the arrangement information of each speaker, and gain information for each speaker is obtained. Then, the rendering processing unit 24 adjusts the level of the object signal of the channel corresponding to each speaker based on the obtained gain information and the corrected object gain information, thereby generating an output audio signal consisting of signals of each of multiple channels. When there are multiple objects, the signals of the same channel of each of these objects are added together to form a final output audio signal.

[0075] The rendering process performed by the rendering processing unit 24 may be any process, such as VBAP adopted in the MPEG-H Part 3:3D audio standard, or a panning method called Speaker-anchored coordinates panner.

[0076] Furthermore, in the rendering process by VBAP, object spherical coordinate position information, which is position information in a spherical coordinate system, is used, but in the rendering process by the speaker-anchored coordinates panner, position information in an orthogonal coordinate system is used to perform direct rendering. Therefore, when rendering using an orthogonal coordinate system, the coordinate conversion processing unit 22 may be configured to obtain position information in the orthogonal coordinate system indicating the position of each object as seen from the user's position by coordinate conversion.

[0077] <About coordinate transformation and determining corrected object gain information> Next, the coordinate transformation performed in the coordinate transformation processing unit 22 and the processing performed in the object attenuation processing unit 23 will be described in more detail.

[0078] The coordinate conversion processing unit 22 receives the object position information and the user position information, performs coordinate conversion, and outputs object spherical coordinate position information.

[0079] Here, the object position information and user position information that are input for coordinate conversion are expressed in coordinates of a three-dimensional orthogonal coordinate system using x-axis, y-axis, and z-axis as shown in FIG. 3, that is, the xyz coordinate system.

[0080] 3, coordinates indicating the position of user LP11 as viewed from the origin O of the xyz coordinate system are set as user position information. Also, coordinates indicating the position of object OBJ1 as viewed from the origin O of the xyz coordinate system are set as object position information of that object OBJ1, and coordinates indicating the position of object OBJ2 as viewed from the origin O of the xyz coordinate system are set as object position information of that object OBJ2.

[0081] During coordinate transformation, the coordinate transformation processing unit 22 translates all objects in the listening space so that the position of the user LP11 becomes the position of the origin O, as shown in Fig. 4, and then transforms the coordinates of all of these objects in the xyz coordinate system into the coordinates of the spherical coordinate system. Note that in Fig. 4, the same reference numerals are used for the parts corresponding to those in Fig. 3, and the explanation thereof will be omitted as appropriate.

[0082] Specifically, the coordinate conversion processing unit 22 determines a movement vector MV11 that moves the position of the user LP11 to the origin O of the xyz coordinate system based on the user position information. This movement vector MV11 is a vector whose starting point is the position of the user LP11 indicated by the user position information and whose ending point is the position of the origin O.

[0083] Furthermore, coordinate conversion processing unit 22 sets a vector that has the same magnitude (length) and direction as movement vector MV11 and has the position of object OBJ1 as its starting point as movement vector MV12. Then, based on the object position information of object OBJ1, coordinate conversion processing unit 22 moves the position of object OBJ1 by an amount indicated by movement vector MV12.

[0084] Similarly, the coordinate transformation processing unit 22 sets a vector of the same magnitude and direction as the movement vector MV11 and having its starting point at the position of object OBJ2 as a movement vector MV13, and moves the position of object OBJ2 by ​​the amount indicated by the movement vector MV13 based on the object position information of object OBJ2.

[0085] Furthermore, the coordinate conversion processing unit 22 obtains coordinates in a spherical coordinate system indicating the position of the object OBJ1 after movement as viewed from the origin O, and sets the obtained coordinates as the object spherical coordinate position information of the object OBJ1. Similarly, the coordinate conversion processing unit 22 obtains coordinates in a spherical coordinate system indicating the position of the object OBJ2 after movement as viewed from the origin O, and sets the obtained coordinates as the object spherical coordinate position information of the object OBJ2.

[0086] Here, the relationship between the spherical coordinate system and the xyz coordinate system is as shown in Fig. 5. In Fig. 5, the same reference numerals are used for the parts corresponding to those in Fig. 4, and the description thereof will be omitted as appropriate.

[0087] 5, the x-axis, y-axis, and z-axis that pass through the origin O and are perpendicular to each other are the axes of the xyz coordinate system. For example, in the xyz coordinate system, the position of object OBJ1 after it is moved by movement vector MV12 is expressed as (X1, Y1, Z1) using X1, which is the x coordinate, Y1, which is the y coordinate, and Z1, which is the z coordinate.

[0088] In contrast, in the spherical coordinate system, the position of object OBJ1 is expressed using the azimuth angle position_azimuth, the elevation angle position_elevation, and the radius position_radius.

[0089] Now, the line connecting the origin O and the position of the object OBJ1 is defined as line r, and the line obtained by projecting line r onto the xy plane is defined as line L.

[0090] At this time, the angle θ between the x-axis and the line L is set to the azimuth angle position_azimuth indicating the position of the object OBJ1. In addition, the angle φ between the line r and the xy plane is set to the elevation angle position_elevation indicating the position of the object OBJ1, and the length of the line r is set to the radius position_radius indicating the position of the object OBJ1.

[0091] Therefore, the spherical coordinate information of the object, which is composed of the azimuth angle, elevation angle, and radius of the object based on the user's position, i.e., the origin O, becomes the object spherical coordinate position information of the object. In more detail, the object spherical coordinate position information is obtained by, for example, setting the positive direction of the x-axis to the front direction of the user.

[0092] Next, the processing performed in the object attenuation processing unit 23 will be described.

[0093] For simplicity's sake, the following description will be given assuming that only two objects, object OBJ1 and object OBJ2, exist in the listening space.

[0094] Specifically, for example, assume that objects OBJ1 and OBJ2 exist in the listening space, and corrected object gain information for object OBJ1 is to be determined, as shown in Fig. 6. Note that in Fig. 6, parts corresponding to those in Fig. 4 are given the same reference numerals, and their explanation will be omitted as appropriate.

[0095] In the example of FIG. 6, it is assumed that object OBJ1 is an object that is not an attenuation disabled object, that is, an attenuation processing object whose object attenuation disabled information has a value of 0.

[0096] In determining the corrected object gain information of the object OBJ1, first, a vector OP1 indicating the position of the object OBJ1 is obtained.

[0097] This vector OP1 is a vector whose starting point is the origin O and whose ending point is a position O11 indicated by the object spherical coordinate position information of the object OBJ1. A user located at the origin O hears a sound emitted from the object OBJ1 located at the position O11 toward the origin O. More specifically, the position O11 indicates the center position of the object OBJ1.

[0098] Next, an object closer to the origin O than the object OBJ1, that is, an object closer to the origin O, which is the user position, than the object OBJ1 is selected as the attenuated object. The attenuated object is an object that is located between the attenuation processing object and the origin O and therefore can be a factor in attenuating sound from the attenuation processing object.

[0099] 6, object OBJ2 is located at position O12 indicated by the object spherical coordinate position information, and this position O12 is located closer to the origin O than position O11 of object OBJ1. In other words, the magnitude of vector OP2 that starts at the origin O and ends at position O12 is smaller than the magnitude of vector OP1.

[0100] 6, object OBJ2, which is located closer to the origin O than object OBJ1, is selected as the attenuated object for object OBJ1. More specifically, position O12 indicates the center position of object OBJ2.

[0101] The shape of the object OBJ2 is a sphere with a radius OR2 indicated by the object outer diameter information and centered at the position O12, and the object OBJ2 is not a point sound source but an object having a predetermined size.

[0102] Next, for the object OBJ2 which is the attenuated object, a normal vector N2_1 from the object OBJ2, that is, from the position O12 to the vector OP1, is obtained.

[0103] If the intersection point between the vector OP1 and a straight line that passes through the position O12 and is perpendicular to the vector OP1 is defined as the position P2_1, then the vector that starts at the position O12 and ends at the position P2_1 is the normal vector N2_1. In other words, the intersection point between the vector OP1 and the normal vector N2_1 is the position P2_1.

[0104] Furthermore, the normal vector N2_1 is compared with the radius OR2 indicated by the object outer diameter information of the object OBJ2, and it is determined whether the magnitude of the normal vector N2_1 is less than or equal to the radius OR2, which is 1 / 2 the outer diameter of the object OBJ2, which is the attenuated object.

[0105] This determination process is a process for determining whether or not an object OBJ2, which is an attenuated object, is on the path of the sound emitted from the object OBJ1 and proceeding toward the origin O.

[0106] In other words, this determination process can also be said to be a process of determining whether or not position O12, which is the center position of object OBJ2, is located within a predetermined distance from a straight line connecting the origin O, which is the user position, and position O11, which is the center position of object OBJ1.

[0107] Note that the range of the specified distance here is a range determined by the size of object OBJ2, and more specifically, the specified distance is the distance from position O12 to the end of the straight line connecting the origin O and position O11 in object OBJ2, that is, the radius OR2.

[0108] For example, in the example in Fig. 6, the magnitude of the normal vector N2_1 is equal to or smaller than the radius OR2. In other words, the vector OP1 intersects with the object OBJ2. Therefore, the sound emitted from the object OBJ1 toward the origin O is attenuated by being reflected, diffracted, or absorbed by the object OBJ2, and travels toward the origin O.

[0109] Therefore, the object attenuation processing unit 23 determines corrected object gain information for attenuating the level of the object signal of the object OBJ1 according to the relative positional relationship between the objects OBJ1 and OBJ2. In other words, the object gain information is corrected to become corrected object gain information.

[0110] Specifically, the corrected object gain information is determined based on the attenuation distance and radius ratio, which are information indicating the relative positional relationship between the object OBJ1 and the object OBJ2.

[0111] The attenuation distance is the distance between object OBJ1 and object OBJ2.

[0112] In this case, if a vector OP2_1 is defined as a vector that starts at the origin O and ends at a position P2_1, the difference between the magnitude of vector OP1 and the magnitude of vector OP2_1, that is, the distance from position P2_1 to position O11, is the attenuation distance of object OBJ1 for object OBJ2. In other words, |OP1|-|OP2_1| is the attenuation distance.

[0113] In this case, the radius ratio is the ratio between the distance from position O12, which is the center position of object OBJ2, to the straight line connecting the origin O and position O11, and the distance from position O12 to the end of object OBJ2 on the straight line side.

[0114] Here, since the shape of the object OBJ2 is spherical, the radius ratio of the object OBJ2 is the ratio of the magnitude of the normal vector N2_1 to the radius OR2, that is, |N2_1| / OR2.

[0115] The radius ratio is information indicating the amount of deviation of position O12, which is the center position of object OBJ2, from vector OP1, that is, the amount of deviation of position O12 from the straight line connecting the origin O and position O11. Such a radius ratio can be said to be information indicating the positional relationship with object OBJ1, which depends on the size of object OBJ2.

[0116] Note that, although an example will be described here in which a radius ratio is used as information indicating a positional relationship that depends on the size of an object, other information, such as information indicating the distance from a straight line connecting the origin O and position O11 to the position of the end of object OBJ2 on the side of that straight line, may also be used.

[0117] In the object attenuation processing unit 23, a correction value for the object gain information of the object OBJ1 is obtained based on, for example, the attenuation table index and the correction table index as the object attenuation information of the metadata, the attenuation distance, and the radius ratio. Then, the object attenuation processing unit 23 corrects the object gain information of the object OBJ1 using the correction value to obtain corrected object gain information.

[0118] Here, the attenuation table indicated by the attenuation table index and the correction table indicated by the correction table index will be described.

[0119] For example, metadata for a given time frame contained in an input bitstream may be as shown in FIG.

[0120] In the example of FIG. 7, the text “OBJECT 1 POSITION INFORMATION” indicates the object position information of object OBJ1, the text “OBJECT 1 GAIN INFORMATION” indicates the object gain information of object OBJ1, and the text “OBJECT 1 ATTENUATION DISABLE INFORMATION” indicates the object attenuation disable information of object OBJ1.

[0121] In addition, the text "object 2 position information" indicates the object position information of object OBJ2, the text "object 2 gain information" indicates the object gain information of object OBJ2, and the text "object 2 attenuation disable information" indicates the object attenuation disable information of object OBJ2.

[0122] Furthermore, the text "Object 2 Outer Diameter Information" indicates the object outer diameter information of object OBJ2, the text "Object 2 Attenuation Table Index" indicates the attenuation table index of object OBJ2, and the text "Object 2 Correction Table Index" indicates the correction table index of object OBJ2.

[0123] Here, the attenuation table index and the correction table index are the object attenuation information.

[0124] The attenuation table index is an index for identifying an attenuation table that indicates the amount of attenuation of an object signal according to the above-mentioned attenuation distance.

[0125] The amount of sound attenuation caused by the attenuated object varies depending on the distance between the attenuation processing object and the attenuated object. In order to easily obtain an appropriate amount of attenuation according to the attenuation distance with a small amount of calculation, an attenuation table in which the attenuation distance and the amount of attenuation are associated is used.

[0126] For example, since the sound absorption rate and the effects of diffraction and reflection differ depending on the material of the object, multiple attenuation tables are prepared in advance according to the material and shape of the object, the frequency band of the object signal, etc. The attenuation table index is an index indicating one of the multiple attenuation tables, and the sound source producer specifies an appropriate attenuation table index for each object depending on the material of the object, etc.

[0127] The correction table index is an index for identifying a correction table that indicates a correction factor for the amount of attenuation of an object signal according to the radius ratio described above.

[0128] The radius ratio indicates how far the straight line showing the path of sound radiated from the attenuation processing object deviates from the center of the attenuated object.

[0129] Even if the attenuation distance is the same, the actual amount of attenuation varies depending on the deviation of the attenuated object from the path of the sound emitted from the attenuation processing object, that is, the radius ratio.

[0130] For example, in general, when a straight line connecting the origin O and the attenuation processing object passes through an outer part far from the center of the attenuated object, the amount of attenuation is smaller due to the diffraction effect than when the straight line passes through the center of the attenuated object. Therefore, in order to correct the amount of attenuation of the object signal according to the radius ratio, a correction table in which the radius ratio and the correction factor are associated is used.

[0131] As in the case of the attenuation table, the appropriate correction factor according to the radius ratio varies depending on the material of the object, etc., so multiple correction tables are prepared in advance according to the material and shape of the object, the frequency band of the object signal, etc. The correction table index is an index indicating one of the multiple correction tables, and the sound source producer specifies an appropriate correction table index for each object depending on the material of the object, etc.

[0132] In the example shown in FIG. 7, object OBJ1 is an object that is processed as a point sound source without object outer diameter information, and therefore only object position information, object gain information, and object attenuation invalid information are given as metadata for object OBJ1.

[0133] On the other hand, object OBJ2 has object outer diameter information and is an object that attenuates radiated sound from other objects. Therefore, object outer diameter information and object attenuation information are given as metadata of object OBJ2 in addition to object position information, object gain information, and object attenuation invalid information.

[0134] In particular, here, an attenuation table index and a correction table index are given as the object attenuation information, and these attenuation table index and correction table index are used to calculate the correction value of the object gain information.

[0135] For example, an attenuation table indicated by a certain attenuation table index contains information indicating the relationship between the attenuation distance and the amount of attenuation shown in FIG.

[0136] In Fig. 8, the vertical axis indicates the decibel value of the attenuation amount, and the horizontal axis indicates the distance between objects, that is, the attenuation distance. For example, in the example shown in Fig. 6, the distance from position P2_1 to position O11 is the attenuation distance.

[0137] In the example of Figure 8, the smaller the attenuation distance, the larger the attenuation amount, and the smaller the attenuation distance, the larger the change in attenuation amount relative to the change in attenuation distance. From this, it can be seen that the closer the attenuated object is to the attenuation processing object, the larger the attenuation amount of the sound of the attenuation processing object.

[0138] Also, for example, the correction table indicated by a certain correction table index contains information indicating the relationship between the radius ratio and the correction factor shown in FIG.

[0139] 9, the vertical axis indicates the correction rate of the attenuation amount, and the horizontal axis indicates the radius ratio. For example, in the example shown in FIG 6, the radius ratio is the ratio of the magnitude of the normal vector N2_1 to the radius OR2.

[0140] For example, if the radius ratio is 0, sound traveling from the attenuation processing object toward the origin O, i.e., toward the user, will pass through the center of the attenuated object, and if the radius ratio is 1, sound traveling from the attenuation processing object toward the origin O will pass through the boundary of the attenuated object.

[0141] In this example, the larger the radius ratio, the smaller the correction rate, and the larger the radius ratio, the larger the change in the correction rate relative to the change in radius ratio. For example, when the correction rate is 1.0, the attenuation amount obtained from the attenuation table is used as is, and when the correction rate is 0, the attenuation amount obtained from the attenuation table is set to 0, and the attenuation effect is 0. Note that when the radius ratio is greater than 1, the sound traveling from the attenuation processing object toward the origin O does not pass through the area where the attenuated object is located, so attenuation processing is not performed.

[0142] When the attenuation amount and correction factor corresponding to the attenuation distance and radius ratio are obtained based on the attenuation distance and radius ratio, a correction value is obtained based on the attenuation amount and correction factor, and the object gain information is corrected.

[0143] Specifically, the value obtained by multiplying the attenuation by the correction factor, i.e., (correction factor x attenuation amount), is set as the correction value. This correction value is the final attenuation amount obtained by correcting the attenuation amount by the correction factor. Once the correction value is obtained, the object gain information is corrected by adding the correction value to the object gain information. The corrected object gain information obtained in this way, i.e., the sum of the correction value and the object gain information, is set as the corrected object gain information.

[0144] The correction value, which is the product of the correction rate and the attenuation amount, can be said to indicate the attenuation amount of the object signal to achieve a level adjustment corresponding to the attenuation that occurs in the sound of one object in another object, determined based on the positional relationship between the objects.

[0145] Here, an example has been described in which an attenuation table index and a correction table index prepared in advance are included in the metadata as object attenuation information. However, the object attenuation information may be anything as long as it can obtain the amount of attenuation and the correction rate, such as the change point of the broken line corresponding to the attenuation table or the correction table shown in Fig. 8 or Fig. 9 being the object attenuation information.

[0146] Alternatively, for example, a plurality of attenuation functions, which are continuous functions that take attenuation distances as inputs and output attenuation amounts, and a plurality of correction factor functions, which are continuous functions that take radius ratios as inputs and output correction factors, may be prepared, and an index indicating one of the plurality of attenuation functions and an index indicating one of the plurality of correction factor functions may be used as the object attenuation information.Furthermore, a plurality of continuous functions that take attenuation amounts and radius ratios as inputs and output correction values ​​may be prepared in advance, and an index indicating one of the functions may be used as the object attenuation information.

[0147] <Description of Audio Output Processing> Next, a specific operation of the signal processing device 11 will be described. That is, hereinafter, audio output processing by the signal processing device 11 will be described with reference to the flowchart of FIG.

[0148] In step S11, the decoding processor 21 decodes the received input bitstream to obtain metadata and an object signal.

[0149] The decoding processing unit 21 supplies the object position information of the obtained metadata to a coordinate conversion processing unit 22, and supplies the object outer diameter information, object attenuation information, object attenuation invalid information, and object gain information of the obtained metadata to an object attenuation processing unit 23. The decoding processing unit 21 also supplies the obtained object signal to a rendering processing unit 24.

[0150] In step S12, the coordinate transformation processing unit 22 performs coordinate transformation for each object based on the object position information supplied from the decoding processing unit 21 and the user position information supplied from outside, to generate object spherical coordinate position information, and supplies it to the object attenuation processing unit 23.

[0151] In step S13, the object attenuation processing unit 23 selects one attenuation processing object to be processed based on the object attenuation invalidation information supplied from the decoding processing unit 21 and the object spherical coordinate position information supplied from the coordinate transformation processing unit 22, and calculates the position vector of the attenuation processing object.

[0152] For example, the object attenuation processing unit 23 selects one object whose object attenuation invalid information value is 0, and sets the selected object as the attenuation processing object. Then, based on the object spherical coordinate position information of the attenuation processing object, the object attenuation processing unit 23 calculates, as a position vector, a vector whose start point is the origin O, i.e., the user's position, and whose end point is the position of the attenuation processing object.

[0153] Therefore, for example, when the object OBJ1 is selected as the attenuation processing object in the example shown in FIG. 6, the vector OP1 is obtained as the position vector.

[0154] In step S14, based on the object spherical coordinate position information of the attenuation processing object to be processed and other objects, the object attenuation processing unit 23 selects one object whose distance from the origin O is smaller (shorter) than the attenuation processing object to be processed as the attenuated object for that attenuation processing object.

[0155] For example, in the example of FIG. 6, when an object OBJ1 is selected as the attenuation processing object, an object OBJ2 located closer to the origin O than the object OBJ1 is selected as the object to be attenuated.

[0156] In step S15, the object attenuation processing unit 23 determines a normal vector from the center of the attenuated object to the position vector of the attenuation processing object based on the position vector of the attenuation processing object obtained in step S13 and the object spherical coordinate position information of the attenuated object.

[0157] For example, in the example shown in FIG. 6, if the object OBJ1 is selected as the attenuation processing object and the object OBJ2 is selected as the attenuated object, the normal vector N2_1 is calculated.

[0158] In step S16, the object attenuation processing unit 23 determines whether or not the magnitude of the normal vector is equal to or smaller than the radius of the attenuated object, based on the normal vector determined in step S15 and the object outer diameter information of the attenuated object.

[0159] For example, in the example shown in Figure 6, when object OBJ1 is selected as the attenuation processing object and object OBJ2 is selected as the attenuated object, it is determined whether the magnitude of normal vector N2_1 is less than or equal to radius OR2, which is half the outer diameter of object OBJ2.

[0160] If it is determined in step S16 that the magnitude of the normal vector is not less than the radius of the attenuated object, then the attenuated object is not on the path of the sound traveling from the attenuation processing object toward the origin O (user), so steps S17 and S18 are not performed and processing proceeds to step S19.

[0161] On the other hand, if it is determined in step S16 that the magnitude of the normal vector is equal to or smaller than the radius of the attenuated object, the attenuated object is on the path of the sound traveling from the attenuation processing object toward the origin O (user), and the process proceeds to step S17. In this case, the attenuation processing object and the attenuated object are located in approximately the same direction as seen by the user.

[0162] In step S17, the object attenuation processing unit 23 calculates an attenuation distance based on the position vector of the attenuation processing object obtained in step S13 and the normal vector of the attenuated object obtained in step S15. The object attenuation processing unit 23 also calculates a radius ratio based on the object outer diameter information and the normal vector of the attenuated object.

[0163] For example, in the example shown in Fig. 6, if object OBJ1 is selected as the attenuation processing object and object OBJ2 is selected as the attenuated object, the distance from position P2_1 to position O11, i.e. |OP1|-|OP2_1|, is calculated as the attenuation distance. Furthermore, in this case, the ratio |N2_1| / OR2 of the magnitude of normal vector N2_1 to radius OR2 is calculated as the radius ratio.

[0164] In step S18, the object attenuation processing unit 23 determines corrected object gain information of the attenuation processing object based on the object gain information of the attenuation processing object, the object attenuation information of the attenuated object, and the attenuation distance and radius ratio obtained in step S17.

[0165] For example, when the above-mentioned attenuation table index and correction table index are included in the metadata as object attenuation information, the object attenuation processing unit 23 holds a plurality of attenuation tables and correction tables in advance.

[0166] In this case, the object attenuation processing unit 23 reads out the attenuation amount determined for the attenuation distance from the attenuation table indicated by the attenuation table index as the object attenuation information of the attenuated object.

[0167] Furthermore, the object attenuation processing unit 23 reads out a correction factor determined for the radius ratio from the correction table indicated by the correction table index as the object attenuation information of the attenuated object.

[0168] Then, the object attenuation processing unit 23 multiplies the read attenuation amount by a correction factor to obtain a correction value, and adds the correction value to the object gain information of the attenuation processing object to obtain corrected object gain information.

[0169] The process of obtaining corrected object gain information in this manner can be said to be a process of determining a correction value indicating the amount of attenuation of the object signal based on the attenuation distance or radius ratio, i.e., the positional relationship between the objects, and then determining corrected object gain information, which is a gain for adjusting the level of the object signal, based on that correction value.

[0170] Once the corrected object gain information is obtained, the process proceeds to step S19.

[0171] If the processing of step S18 has been performed or if it is determined in step S16 that the magnitude of the normal vector is not less than the radius, then in step S19, the object attenuation processing unit 23 determines whether or not there are any unprocessed attenuated objects for the attenuation processing object to be processed.

[0172] If it is determined in step S19 that there is still an unprocessed attenuated object, the process returns to step S14, and the above-mentioned process is repeated.

[0173] In this case, in the process of step S18, the correction value calculated for the new attenuated object is added to the already calculated corrected object gain information, and the corrected object gain information is updated. Therefore, when there are multiple attenuated objects whose normal vectors are equal to or smaller than the radius of the attenuation processing object, the correction values ​​calculated for the multiple attenuated objects are added to the object gain information to obtain the final corrected object gain information.

[0174] If it is determined in step S19 that there are no unprocessed damped objects, that is, that all damped objects have been processed, the process proceeds to step S20.

[0175] In step S20, the object attenuation processing unit 23 determines whether or not all attenuation processing objects have been processed.

[0176] If it is determined in step S20 that all attenuation processing objects have not yet been processed, the process returns to step S13, and the above-mentioned processes are repeated.

[0177] On the other hand, if it is determined in step S20 that all attenuation processing objects have been processed, the process proceeds to step S21.

[0178] In this case, for an object that has not been subjected to the processes of steps S17 and S18, that is, an object that has not been subjected to the attenuation process, the object attenuation processing unit 23 uses the object gain information of the object as it is as corrected object gain information.

[0179] In addition, the object attenuation processing unit 23 supplies the object coordinate reference position information of all objects supplied from the coordinate conversion processing unit 22 and the corrected object gain information to the rendering processing unit 24.

[0180] In step S21, the rendering processing unit 24 performs rendering processing based on the object signal supplied from the decoding processing unit 21 and the object spherical coordinate position information and corrected object gain information supplied from the object attenuation processing unit 23, and generates an output audio signal.

[0181] When the output audio signal is obtained in this manner, the rendering processing section 24 outputs the obtained output audio signal to the subsequent stage, and the audio output processing ends.

[0182] In this manner, the signal processing device 11 corrects the object gain information in accordance with the positional relationship between objects to obtain corrected object gain information, thereby making it possible to obtain a high sense of realism with a small amount of calculation.

[0183] That is, when multiple objects exist in the listening space in approximately the same direction as seen from the user, the attenuation effect due to the sound absorption, diffraction, reflection, etc. of the objects is not calculated based on the laws of physics, but rather a simple calculation is used to obtain a correction value according to the attenuation distance and radius ratio using a table, which can provide an effect approximately equivalent to that obtained by performing calculations based on the laws of physics. Therefore, even if the user moves freely within the listening space, a highly realistic three-dimensional sound effect can be provided to the user with a small amount of calculation.

[0184] Note that, although we have explained the case of a free viewpoint where the user can move to any position within the listening space, in the case of a fixed viewpoint where the user's position within the listening space is fixed, a high sense of realism can be obtained with a small amount of calculations, just as in the case of a free viewpoint.

[0185] In such a case, the user position indicated by the user position information is always the position of the origin O, so coordinate conversion processing by the coordinate conversion processing unit 22 is not necessary, and the object position information is position information expressed in spherical coordinates. Particularly in this case, the object position information is information indicating the position of the object as viewed from the origin O. In addition, the processing by the object attenuation processing unit 23 may be performed on the client side that receives the content distribution, or on the server side that distributes the content.

[0186] <Modification> In addition, although the above description has been given of the case where the object attenuation invalid information is 0 or 1, the object attenuation invalid information may be any one of a plurality of values ​​of 3 or more. In such a case, for example, the value of the object attenuation invalid information indicates not only whether or not the object is an attenuation invalid object, but also the correction amount of the attenuation amount. Therefore, for example, the correction value calculated from the correction rate and the attenuation amount is further corrected according to the value of the object attenuation invalid information to become the final correction value.

[0187] Furthermore, although an example has been described above in which object attenuation disable information indicating whether or not to disable attenuation processing is defined for each object, it may also be possible to determine whether or not to disable attenuation processing for an area within the listening space.

[0188] For example, if the sound source producer intends that no object attenuation effect should be produced in a particular spatial region within the listening space, then object attenuation disabled region information indicating the spatial region in which no attenuation effect should be produced can be stored in the input bitstream instead of object attenuation disabled information.

[0189] In such a case, the object attenuation processing unit 23 treats an object whose position indicated by the object position information is within the spatial region indicated by the object attenuation invalid region information as an attenuation invalid object. This makes it possible to realize audio playback that reflects the intention of the sound source producer.

[0190] In addition, the positional relationship between the user and the object may also be taken into consideration, for example, an object located in a direction substantially in front of the user may be an attenuation invalid object, and an object located behind the user may be an attenuation processing object. In other words, whether or not an object is to be an attenuation invalid object may be determined based on the positional relationship between the user and the object.

[0191] In addition, although an example has been described above in which the object signal is attenuated depending on the relative positional relationship between the objects, it is also possible to add a reverberation effect to the object signal depending on the relative positional relationship between the objects.

[0192] It has long been known that reverberation is caused by trees in a forest, and Kuttruff modeled forest reverberation by treating trees as spheres and solving a diffusion equation.

[0193] Therefore, for example, when there are a predetermined number of objects or more within a certain space that includes the user position and the position of the object that is the sound source, it is possible to impart a specific reverberation effect to the object signal of each object within that space.

[0194] In this case, the reverberation effect can be achieved by including parametric reverb coefficients for imparting a reverberation effect in the input bitstream and varying the mixing ratio of direct sound and reverberant sound depending on the relative relationship between the user position and the position of the object that is the sound source.

[0195] Example of computer configuration The above-mentioned series of processes can be executed by hardware or software. When the series of processes is executed by software, the program constituting the software is installed in a computer. Here, the computer includes a computer built into dedicated hardware, and a general-purpose personal computer, for example, capable of executing various functions by installing various programs.

[0196] FIG. 11 is a block diagram showing an example of the hardware configuration of a computer that executes the above-mentioned series of processes according to a program.

[0197] In the computer, a CPU (Central Processing Unit) 501, a ROM (Read Only Memory) 502, and a RAM (Random Access Memory) 503 are interconnected via a bus 504.

[0198] An input / output interface 505 is further connected to the bus 504. An input unit 506, an output unit 507, a recording unit 508, a communication unit 509, and a drive 510 are connected to the input / output interface 505.

[0199] The input unit 506 includes a keyboard, a mouse, a microphone, an image sensor, etc. The output unit 507 includes a display, a speaker, etc. The recording unit 508 includes a hard disk, a non-volatile memory, etc. The communication unit 509 includes a network interface, etc. The drive 510 drives a removable recording medium 511 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.

[0200] In a computer configured as described above, the CPU 501 loads, for example, a program recorded in the recording unit 508 into the RAM 503 via the input / output interface 505 and the bus 504, and executes the program, thereby performing the series of processes described above.

[0201] The program executed by the computer (CPU 501) can be provided by being recorded on a removable recording medium 511 such as a package medium, for example. The program can also be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.

[0202] In the computer, the program can be installed in the recording unit 508 via the input / output interface 505 by mounting the removable recording medium 511 in the drive 510. The program can also be received by the communication unit 509 via a wired or wireless transmission medium and installed in the recording unit 508. Alternatively, the program can be installed in the ROM 502 or the recording unit 508 in advance.

[0203] In addition, the program executed by the computer may be a program in which processing is performed chronologically in the order described in this specification, or it may be a program in which processing is performed in parallel or at the required timing, such as when called.

[0204] Furthermore, the embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible without departing from the gist of the present technology.

[0205] For example, the present technology can be configured as cloud computing, in which a single function is shared and processed collaboratively by multiple devices via a network.

[0206] Furthermore, each step described in the above flow chart can be executed by one device, or can be shared and executed by a plurality of devices.

[0207] Furthermore, when a single step includes multiple processes, the multiple processes included in the single step can be executed by a single device, or can be shared and executed by multiple devices.

[0208] Furthermore, the present technology can also be configured as follows.

[0209] (1) a gain determination unit that determines an amount of attenuation based on a positional relationship between a predetermined object and another object, and determines a gain of a signal of the predetermined object based on the amount of attenuation Information processing device. (2) The other object is located closer to the user position than the predetermined object. An information processing device as described in (1). (3) The other object is located within a predetermined distance from a straight line connecting the user position and the predetermined object. An information processing device according to (1) or (2). (4) The range is determined by the size of the other object. (3) An information processing device. (5) The predetermined distance is the distance from the center of the other object to the end of the other object on the straight line side. An information processing device according to (3) or (4). (6) The positional relationship depends on the size of the other object. An information processing device according to any one of (3) to (5). (7) The positional relationship is the amount of deviation of the center of the other object from the straight line. (6) An information processing device. (8) The positional relationship is a ratio between a distance from a center of the other object to the straight line and a distance from the center of the other object to an end of the other object on the straight line side. (6) An information processing device. (9) The gain determination unit determines the amount of attenuation based on the positional relationship and attenuation information of the other object. An information processing device according to any one of (1) to (8). (10) The attenuation information is information for obtaining an attenuation amount of the signal in the other object according to the positional relationship. An information processing device according to (9). (11) The positional relationship is the distance between the other object and the predetermined object. An information processing device according to any one of (1) to (10). (12) The gain determination unit determines the amount of attenuation based on attenuation invalid information indicating whether or not to attenuate the signal of the predetermined object and the positional relationship. An information processing device according to any one of (1) to (11). (13) The signal of the predetermined object is an audio signal. An information processing device according to any one of (1) to (11). (14) An information processing device, An amount of attenuation is determined based on a positional relationship between a predetermined object and another object, and a gain of a signal of the predetermined object is determined based on the amount of attenuation. Information processing methods. (15) An amount of attenuation is determined based on a positional relationship between a predetermined object and another object, and a gain of a signal of the predetermined object is determined based on the amount of attenuation. A program that causes a computer to execute a process including steps. [Explanation of symbols]

[0210] 11 signal processing device, 21 decode processing section, 22 coordinate conversion processing section, 23 object attenuation processing section, 24 rendering processing section

Claims

[Claim 1] a gain determination unit that determines an amount of attenuation based on attenuation information among a plurality of pieces of attenuation information corresponding to information about an object and a positional relationship between a predetermined object and another object, and determines a gain of a signal of the predetermined object based on the amount of attenuation Information processing device.

Images