Information processing method and information processing device

Abstract

To provide an information processing method and an information processing device for achieving sound image localization obtained by taking a physical and spatial shape into consideration.SOLUTION: An information processing method receives settings of a plurality of pieces of physical space information corresponding to each of a plurality of pieces of logical space information, receives a plurality of pieces of first sound image localization information showing positions of sound images to be respectively localized in a plurality of logical spaces by using first coordinates in the plurality of logical spaces, receives the plurality of pieces of first sound image localization information as a group, changes other pieces of the first sound image localization information in accordance with a change in one piece of information of first sound image localization information in the case of receiving the change on the one piece of first sound image localization information in the group, and converts the grouped plurality of pieces of first sound image localization information into a plurality of pieces of second sound image localization information using second coordinates in the respectively corresponding plurality of physical spaces.SELECTED DRAWING: Figure 11

Description

[Technical field]

[0001] An embodiment of the present invention relates to an information processing method and an information processing device. [Background technology]

[0002] The audio mixing console of Patent Document 1 receives the coordinates of a sound image localization point in a rectangular parallelepiped space. The audio mixing console of Patent Document 1 calculates the volume of the sound output from multiple speakers arranged in the space so that the sound image is localized at the received coordinates. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2018-74280 A Summary of the Invention [Problem to be solved by the invention]

[0004] However, the physical space of a concert hall is not limited to a rectangular parallelepiped shape. Therefore, even if a device such as the audio control console of Patent Document 1 receives the coordinates of a sound image localization point in a rectangular parallelepiped space, it may not be possible to localize the sound image at the position intended by the user because the device does not take into account the coordinates of the physical space.

[0005] Therefore, one object of one embodiment of the present invention is to provide an information processing method and an information processing device that realizes sound image localization taking into account the shape of a physical space. [Means for solving the problem]

[0006] An information processing method according to one embodiment of the present invention accepts settings of a plurality of pieces of physical space information respectively corresponding to a plurality of pieces of logical space information, accepts a plurality of pieces of first sound image localization information indicating the positions of sound images to be localized in each of the plurality of logical spaces using first coordinates in the plurality of logical spaces, accepts the plurality of pieces of first sound image localization information as a group, and when a change to one piece of first sound image localization information within the group is accepted, changes are made to the other pieces of first sound image localization information in response to the change to the one piece of first sound image localization information, and converts the plurality of first sound image localization information that have been grouped into a plurality of pieces of second sound image localization information using second coordinates in the plurality of corresponding physical spaces, respectively. Effect of the Invention

[0007] According to one embodiment of the present invention, it is possible to realize sound image localization that takes into account the shape of a physical space. [Brief description of the drawings]

[0008] [Figure 1] 1 is a block diagram showing a configuration of an information processing device 1. FIG. [Diagram 2] FIG. 2 is a diagram showing an example of a setting screen for sound image localization displayed on a display device 15. [Diagram 3] 4 is a flowchart showing the operation of the processor 12. [Figure 4] FIG. 1 is a diagram illustrating a concept of coordinate transformation. [Diagram 5] FIG. 1 is a diagram illustrating a concept of coordinate transformation. [Figure 6] FIG. 13 is a diagram illustrating a modified example of coordinate transformation. [Figure 7] FIG. 1 is a block diagram showing a configuration of an information processing device 1A according to a first modified example. [Figure 8] 1 is a flowchart showing the operation of the information processing device 1A. [Figure 9] FIG. 2 is a diagram showing an example of a setting screen for sound image localization displayed on a display device 15. [Figure 10] 1 is a flowchart showing the operation of the information processing device 1A. [Figure 11]FIG. 2 is a diagram showing an example of a setting screen for sound image localization displayed on a display device 15. [Figure 12] FIG. 4 is a diagram showing an example of playback information. [Figure 13] FIG. 13 is a diagram showing a modified example of the playback information. [Figure 14] FIG. 13 is a diagram showing a modified example of the playback information. [Figure 15] FIG. 13 is a diagram showing an example of a sound image localization setting screen displayed on the display 15 when multiple sound sources 55A and 55AB are arranged in a logical space L1 and sound image localization information is edited. [Figure 16] 13 is a diagram showing an example of a setting screen for sound image localization displayed on the display 15 when editing sound image localization information of a sound source 55A and a sound source 55AB defined as a second group. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] 1 is a block diagram showing the configuration of an information processing device 1. The information processing device 1 includes a communication unit 11, a processor 12, a RAM 13, a flash memory 14, a display device 15, and a user I / F 16.

[0010] The information processing device 1 is a personal computer, a smartphone, a tablet computer, etc. Furthermore, audio equipment such as an audio mixer is also an example of the information processing device.

[0011] The communication unit 11 communicates with other devices such as a server. The communication unit 11 has a wireless communication function such as Bluetooth (registered trademark) or Wi-Fi (registered trademark), and a wired communication function such as USB or LAN. The communication unit 11 acquires spatial information indicating the shape of a physical space such as a concert hall. The spatial information is information indicating two-dimensional or three-dimensional coordinates with a certain position as a reference point (origin). The spatial information is information including two-dimensional or three-dimensional coordinates such as CAD data indicating the shape of a physical space such as a concert hall.

[0012] The processor 12 is composed of a CPU, a DSP, a SoC (System on a Chip), or the like, and corresponds to the processing unit of the present invention. The processor 12 performs various operations by reading out a program from a flash memory 14, which is a storage medium, and temporarily storing the program in the RAM 13. It is not necessary for the program to be stored in the flash memory 14. The processor 12 may download the program from another device, such as a server, when necessary, and temporarily store the program in the RAM 13.

[0013] The display unit 15 is composed of an LCD etc. The display unit 15 displays a setting screen for sound image localization as shown in FIG.

[0014] The user I / F 16 is an example of an operation unit. The user I / F 16 is composed of a mouse, a keyboard, a touch panel, or the like. The user I / F 16 accepts operations by a user. The touch panel may be laminated on the display 15.

[0015] The sound image localization setting screen will be described with reference to Fig. 2 and Fig. 3. Fig. 2 is a diagram showing an example of the sound image localization setting screen displayed on the display 15. Fig. 3 is a flowchart showing the operation of the processor 12. The sound image localization setting screen shown in Fig. 2 is an example of a content editing screen. On the sound image localization setting screen, the user edits the sound image localization position of a sound source included in the content. Note that a sound source means the sound of one or more objects (for example, a moving object such as a helicopter, a speaker, or a musical instrument) in a predetermined content including the sound of, for example, a movie, a concert event, or an attraction.

[0016] The display 15 displays a logical space image 151 in the logical coordinate system and a physical space image 152 in the physical coordinate system. In this example, the display 15 displays the logical space image 151 at the top left of the screen, and the physical space image 152 at the top right of the screen. The display 15 also displays a logical planar image 153 at the bottom left of the screen, and a physical planar image 154 at the bottom right of the screen.

[0017] The logical space image 151 has a rectangular parallelepiped shape, for example. The logical planar image 153 corresponds to a diagram of the logical space image 151 viewed from above. The physical space image 152 has an octagonal prism shape, for example. The physical planar image 154 corresponds to a diagram of the physical space image 152 viewed from above.

[0018] First, the processor 12 receives settings of first space information, which is information corresponding to a logical space, and second space information, which is information corresponding to a physical space such as a concert hall (S11).

[0019] The first spatial information is a logical coordinate. The logical coordinate is, for example, a normalized coordinate of 0 to 1. In this embodiment, the processor 12 accepts the setting of spatial information of a rectangular parallelepiped as the first spatial information, but may also accept various other spatial information such as a pyramid, a prism, a polyhedron, a cylinder, a cone, or a sphere. The processor 12 may also accept information of a two-dimensional space. The two-dimensional space includes, for example, a polygon formed of straight lines, a circle formed of curved lines, or a composite shape formed of straight lines and curved lines.

[0020] The second spatial information is physical coordinates. The physical coordinates are two-dimensional or three-dimensional coordinates included in CAD data or the like that indicate the shape of a physical space such as a concert hall. The processor 12 accepts the setting of the second spatial information by reading information including two-dimensional or three-dimensional coordinates such as CAD data from the flash memory 14, for example.

[0021] Next, the processor 12 generates a logical space image 151, a physical space image 152, a logical plane image 153, and a physical plane image 154, and displays them on the display 15 (S12). In the example of Fig. 2, the logical space image 151 is an image of a cubic elevation, and the logical plane image 153 is an image of a square. The physical space image 152 and the physical plane image 154 are images that imitate real spaces such as concert halls. The processor 12 generates the physical space image 152 and the physical plane image 154 based on information including two-dimensional or three-dimensional coordinates such as CAD data.

[0022] Next, the processor 12 receives speaker arrangement information or sound image localization information (S13). The speaker arrangement information and sound image localization information are each coordinates in a logical coordinate system, and are an example of first sound image localization information.

[0023] The user operates the user I / F 16 to edit speaker arrangement information or sound image localization information in the logical space image 151 or logical planar image 153 shown in Fig. 2. For example, in the example of Fig. 2, the user arranges speaker 501 to be placed in the front left, speaker 502 to be placed in the center, speaker 503 to be placed in the front right, speaker 504 to be placed in the rear left, and speaker 505 to be placed in the rear right in the logical space image 151 and the logical planar image 153. Speaker 501, speaker 502, speaker 503, speaker 504, and speaker 505 are arranged in the middle in the height direction.

[0024] If the position of the top left vertex in the logical planar image 153 is taken as the origin, the coordinates of speaker 501 are (x,y)=(0,0). The coordinates of speaker 503 are (x,y)=(1,0). The coordinates of speaker 502 are (x,y)=(0.5,0). The coordinates of speaker 504 are (x,y)=(0,1). The coordinates of speaker 505 are (x,y)=(1,1).

[0025] 2, the user places the sound image localization position of the sound source 55 to the left of the center (between the left edge and the center) in the logical space image 151 and the logical planar image 153. That is, the coordinates of the sound source 55 are (x, y)=(0.25, 0.5).

[0026] In the example of FIG. 2, the height coordinate of all of the speakers 501 to 505 and the sound source is z=0.5.

[0027] The processor 12 receives speaker layout information or sound source position information by receiving an operation of editing speaker layout information or sound source sound image localization information by a user, for example, as shown in FIG. 2 (S13).

[0028] The processor 12 performs coordinate conversion based on the received speaker arrangement information or sound source position information (S14).

[0029] 4 and 5 are diagrams for explaining the concept of coordinate conversion. The processor 12 converts the speaker arrangement information and sound source position information from the first coordinates of the first spatial information in the logical coordinate system to the second coordinates of the second spatial information in the physical coordinate system. In the example of FIG. 4, there are eight reference points 70A (x1, y1), 70B (x2, y2), 70C (x3, y3), 70D (x4, y4), 70E (x5, y5), 70F (x6, y6), 70G (x7, y7), and 70H (x8, y8) in the physical coordinate system, and eight reference points 70A (0, 0), 70B (0.25, 0), 70C (0.75, 0), 70D (1, 0), 70E (0, 1), 70F (0.25, 1), 70G (0.75, 1), and 70H (1, 1) in the logical coordinate system before conversion. The processor 12 obtains the center of gravity G of the eight reference points in the logical coordinate system before the transformation, and the center of gravity G' of the eight reference points in the physical coordinate system after the transformation, and generates a triangular mesh centered on these centers of gravity. The processor 12 transforms the internal space of the triangle in the logical coordinate system and the internal space of the triangle in the physical coordinate system by a predetermined coordinate transformation. The transformation uses, for example, an affine transformation. The affine transformation is an example of a geometric transformation. The affine transformation expresses the x coordinate (x') and y coordinate (y') after the transformation as functions of the x coordinate (x) and y coordinate (y) before the transformation, respectively. That is, the affine transformation performs coordinate transformation using the formulas x'=ax+by+c and y'=dx+ey+f. The coefficients a to f can be uniquely obtained from the coordinates of the three vertices of the triangle before the transformation and the coordinates of the three vertices of the triangle after the transformation. The processor 12 transforms the first coordinates in the logical coordinate system into the second coordinates of the second spatial information in the physical coordinate system by similarly obtaining the affine transformation coefficients for all triangles. The coefficients a to f may be determined by the least squares method.

[0030] Then, the processor 12 converts the coordinates of the speaker arrangement information and the sound source position information using the calculated coefficients a to f. In Fig. 5, the processor 12 converts the coordinates (x, y) of the sound source 55 in the logical coordinate system into the coordinates (x', y') in the physical coordinate system using the above formula.

[0031] As a result, the coordinates of the speaker arrangement information and the sound source position information are converted into second sound image localization information that matches the shape of the physical space. The processor 12 stores the second sound image localization information in, for example, the flash memory 14. Alternatively, the processor 12 transmits the second sound image localization information to another device such as an audio device via, for example, the communication unit 11. The audio device performs a process of localizing the sound image based on the received second sound image localization information. The localization process is based on an object-based method. The audio device calculates the level balance of sound signals to be output to multiple speakers based on the speaker arrangement information and the position information of each object (sound source) included in the second sound image localization information, so that the sound image of the sound source of each object is localized at a specified position, and performs a panning process to adjust the level of the sound signal. The listener feels the localization in the direction of the speaker that outputs a higher level sound signal. The panning process utilizes such listener's perception and adjusts the level of the sound signal to be output to each speaker according to the distance between the sound source and the speaker. For example, the processor 12 maximizes the level of the sound signal output to the speaker closest to the position of the sound source, and reduces the level of the sound signal output to each speaker according to the distance from the sound source. This allows the listener to perceive the sound image of each object included in the second sound image localization information at the position of the sound source of the object. Therefore, the information processing device 1 of this embodiment can realize sound image localization that takes into account the shape of the physical space.

[0032] The mesh may be a polygonal mesh other than a triangle, or a combination thereof. For example, the processor 12 may generate a quadrilateral mesh as shown in Fig. 6 and perform coordinate transformation. The transformation method is not limited to the affine transformation. For example, the processor 12 may transform the quadrilateral mesh based on the following formula, and transform the coordinates (x, y) of the logical coordinate system of the sound source 55 into the coordinates (x', y') of the physical coordinate system (where x0, y0, x1, y1, x2, y2, x3, y3 are the coordinates of the transformation points, respectively). x'=x0+(x1-x0)x+(x3-x0)y+(x0-x1+x2-x3)xy y'=y0+(y1-y0)x+(y3-y0)y+(y0-y1+y2-y3)xy The transformation method may be other geometric transformation such as isometric mapping, similarity transformation, or projective transformation. For example, projective transformation is expressed by the equations x'=(ax+by+c) / (gx+hy+1) and y'=(dx+ey+f) / (gx+hy+1). The coefficients are calculated in the same manner as the above-mentioned affine transformation. For example, the eight coefficients (a to h) constituting the projective transformation of a quadrangle can be uniquely calculated by eight simultaneous equations. Alternatively, the coefficients may be calculated by, for example, the least squares method.

[0033] Fig. 7 is a block diagram showing the configuration of an information processing device 1A according to Modification 1. Fig. 8 is a flowchart showing the operation of the information processing device 1A. The same configurations, functions, and operations as those of the information processing device 1 are given the same reference numerals, and description thereof will be omitted.

[0034] The information processing device 1A further includes an audio I / F 17. The audio I / F 17 is composed of an analog audio terminal or a digital audio terminal, etc. The processor 12 acquires a sound signal from a sound source, such as a microphone or a musical instrument, via the audio I / F 17. In this way, the processor 12 functions as a sound signal acquisition unit. The sound signal may be acquired from an external device via the communication unit 11. The sound signal may be stored in the flash memory 14.

[0035] The audio I / F 17 is connected to a plurality of speakers 501 to 509 installed in an actual space such as a concert hall.

[0036] The processor 12 includes a DSP. The processor 12 performs predetermined signal processing on the audio signal. The processor 12 outputs the processed audio signal to the multiple speakers 501 to 509 via the audio I / F 17.

[0037] The processor 12 performs a process of localizing the sound image of the sound signal at a position corresponding to the second sound image localization information based on the arrangement information of each speaker in the physical coordinate system and the sound source position information (second sound image localization information) (S15). That is, the processor 12 performs a panning process of calculating the level balance of the sound signals to be output to the multiple speakers 501 to 509 and adjusting the levels of the sound signals so that the sound image of the sound source is localized at a specified position based on the arrangement information of the speakers and the sound source position information included in the second sound image localization information. In this manner, the information processing device may perform the sound image localization process. Note that the information processing device may adjust the output timing of the sound signals to be output to the multiple speakers so that the sound image of each sound source is localized at a specified position.

[0038] The information processing device 1A can also output sound signals of a sound source to each of a plurality of physical spaces corresponding to a plurality of logical spaces. Fig. 9 is a diagram showing an example of a setting screen for sound image localization displayed on the display device 15. Fig. 10 is a flowchart showing the operation of the information processing device 1A. The same configurations, functions, and operations as those of the information processing device 1 are given the same reference numerals, and the description will be omitted.

[0039] The processor 12 receives settings of a plurality of pieces of physical space information corresponding to a plurality of pieces of logical space information, respectively. In the example of Fig. 9, the processor 12 receives three physical spaces Z1, Z2, and Z3 corresponding to three logical spaces L1, L2, and L3, respectively.

[0040] In the example of FIG. 9, physical spaces Z1, Z2, and Z3 are defined by dividing a certain concert hall R1 into three areas. For example, physical space Z1 corresponds to the first floor seats of the concert hall, and physical space Z2 corresponds to the second floor seats of the concert hall. Physical space Z3 corresponds to the entire concert hall. Note that in this example, the multiple physical spaces correspond to multiple areas set in a certain acoustic space (concert hall R1), but the multiple physical spaces may each correspond to a completely different acoustic space.

[0041] A plurality of speakers 501 to 509 are arranged in concert hall R1. Speakers 501 to 509 are arranged along the wall of concert hall R1. For example, speaker 501 is arranged on the front left side of concert hall R1. Speaker 502 is arranged in the front center of concert hall R1. Speaker 503 is arranged on the front right side of concert hall R1. Speakers 504 and 506 are arranged on the left side of the center between the front and rear of concert hall R1. Speakers 505 and 507 are arranged on the right side of the center between the front and rear of concert hall R1. Speaker 508 is arranged on the rear left side of concert hall R1. Speaker 509 is arranged on the rear right side of concert hall R1.

[0042] In the example of FIG. 9, an area Z1 is formed by speakers 501 to 505. An area Z2 is formed by speakers 506 to 509. An area Z3 is formed by all speakers 501 to 509. The processor 12 performs localization processing for a sound source arranged in the area Z1 using the speakers 501 to 505. The processor 12 performs localization processing for a sound source arranged in the area Z2 using the speakers 506 to 509. The processor 12 performs localization processing for a sound source arranged in the area Z3 using the speakers 501 to 509.

[0043] The user can control the positions of the sound source 55A, the sound source 55B, and the sound source 55C in the physical spaces Z1, Z2, and Z3 by editing the positions of the sound source 55A, the sound source 55B, and the sound source 55C arranged in the three logical spaces L1, L2, and L3. In other words, the user can control the positions of the sound source that the user wants listeners in the first floor seats of the concert hall to hear, the positions of the sound source that the user wants listeners in the second floor seats of the concert hall to hear, and the positions of the sound source that the user wants listeners in the entire concert hall to hear, by editing the positions of the sound sources in the three logical spaces L1, L2, and L3.

[0044] Then, the processor 12 receives the first sound image localization information of the multiple sound sources in the multiple logical spaces as a group (S52). In the example of Fig. 9, the processor 12 receives the sound source 55A, the sound source 55B, and the sound source 55C as one group.

[0045] Then, the processor 12 accepts a change to one piece of first sound image localization information in the group (S53), and changes the other pieces of first sound image localization information in the group in response to the change to the accepted piece of first sound image localization information (S54). For example, when the user changes the position of the sound source 55A in the logical space L1, the processor 12 changes the positions of the other sound sources 55B and 55C in the same group. The processor 12 changes the first sound image localization information while maintaining the relative positional relationship between each of the multiple sound images in the same group.

[0046] For example, as shown in FIG. 11, the user changes the coordinates of the sound source 55A in the logical space L1 from (x1, y1)=(0.75, 0.25) to (x1, y1)=(0.25, 0.75). The processor 12 changes the coordinates of the sound source 55B and the sound source 55C while maintaining the relative positional relationship of the sound source 55A, the sound source 55C, and the sound source 55B included in the same group. In this example, the coordinates of the sound source 55A, the sound source 55C, and the sound source 55B are all the same (0.75, 0.25). In this case, the relative position is (0, 0). Therefore, the processor 12 also changes the coordinates of the sound source 55B to (x2, y2)=(0.25, 0.75), and also changes the coordinates of the sound source 55C to (x3, y3)=(0.25, 0.75).

[0047] Even if the first coordinates of the grouped pieces of first sound image localization information are different, the processor 12 maintains the relative positional relationship of the grouped pieces of first sound image localization information and changes the other pieces of first sound image localization information. For example, when the coordinates of the sound source 55A are (x1, y1) = (0.75, 0.75) and the coordinates of the sound source 55B are (x2, y2) = (0.5, 0.5), the relative positions are (x1-x2, y1-y2) = (0.25, 0.25). When the coordinates of the sound source 55C are (x3, y3) = (1, 1), the relative positions are (x1-x3, y1-y3) = (-0.25, -0.25). Therefore, when the user changes the coordinates of sound source 55A in logical space L1 from (x1, y1) = (0.75, 0.75) to (x1, y1) = (0.25, 0.25), processor 12 changes the coordinates of sound source 55B to (x2, y2) = (0, 0) and the coordinates of sound source 55C to (x3, y3) = (0.5, 0.5).

[0048] In addition, when the first coordinates of the grouped multiple sound sources are different, if the position of the other sound source is changed while maintaining the relative positional relationship of the grouped multiple sound sources, the position of the other sound source may be outside the logical space. When the position of the other sound source is outside the logical space, the processor 12 sets at least one of the x coordinate or the y coordinate to 0 or 1. For example, when the coordinates of the sound source 55C after the change are (x3, y3) = (-0.25, -0.25), the processor 12 sets the coordinates of the sound source 55C after the change to (x3, y3) = (0, 0). In other words, the processor 12 changes the coordinates of the sound source to 0 when the coordinates of the sound source after the change are negative values, and changes them to 1 when the coordinates are greater than 1.

[0049] The processor 12 converts the plurality of pieces of first sound image localization information in the group changed as described above into a plurality of pieces of second sound image localization information using second coordinates in the corresponding plurality of physical spaces (S55).

[0050] The processor 12 performs, for example, the above-mentioned affine transformation for each logical space and physical space, and converts the coordinates (x, y) of each sound source in the logical coordinate system into coordinates (x', y') in the physical coordinate system. As a result, each sound source arranged in a plurality of logical spaces is converted into second sound image localization information that matches the shape of each physical space.

[0051] 11, in physical space Z1, the position of sound source 55A moves from the front right to the rear left. In physical space Z2, the position of sound source 55B moves from the front right to the rear left. In physical space Z3, the position of sound source 55C moves from the front right to the rear left.

[0052] In this way, the processor 12 of the present embodiment can collectively control the positions of sound sources in a plurality of physical spaces by collectively converting a plurality of grouped logical coordinates into their respective physical coordinates. This allows the user to collectively control the movement of the sound source for a plurality of physical spaces having different shapes. For example, the user of the information processing device 1A can provide an effect in which the sound source moves from the front right to the rear left for both the listeners in the physical space Z1 (the first floor seats of the concert hall) and the listeners in the physical space Z2 (the second floor seats of the concert hall) by simply performing an operation to move the sound source in the logical space L1 from the front right to the rear left.

[0053] Furthermore, the user of the information processing device 1A may specify which area (physical space) each sound source is to be reproduced in. In this case, the processor 12 accepts settings of reproduction information indicating whether or not a sound signal of which sound source is to be output for each of a plurality of areas.

[0054] FIG. 12 is a diagram showing an example of playback information. As shown in FIG. 12, the playback information is information indicating to which area a sound signal is to be output for each sound source. In other words, the playback information is information indicating which sound source's sound signal is to be output for each area. The processor 12 displays the playback information on the display 15. The user edits the playback information using the user I / F 16. The user specifies the area to which the sound signal is to be output for each sound source. In other words, the user specifies which sound source's sound signal is to be output for each of a plurality of areas.

[0055] In the example of FIG. 12, area Z1 outputs the sound signal of sound source 55A. Area Z2 outputs the sound signal of sound source 55B. Area Z3 outputs the sound signal of sound source 55C. In other words, the sound signal of sound source 55A is output only to area Z1. Sound source 55B is output only to area Z2. Sound source 55C is output to all areas.

[0056] The processor 12 reproduces the sound signals of each sound source based on the reproduction information edited as described above. The processor 12 outputs the sound signal of the sound source 55A to the speakers 501-505. As a result, the sound source 55A can be heard in the area Z1. The processor 12 outputs the sound signal of the sound source 55B to the speakers 506-509. As a result, the sound source 55B can be heard in the area Z2. The processor 12 outputs the sound signal of the sound source 55C to the speakers 501-509. As a result, the sound source 55C can be heard from any position in the area Z3.

[0057] In this way, the information processing device 1A can output sound signals of any sound source to each of a plurality of areas. For example, if R1 shown in FIG. 9 is a building of an attraction in a theme park, the user of the information processing device 1A can reproduce footsteps as the sound source 55C in all areas. Therefore, the attraction user can hear footsteps at any position in the attraction. Also, the user of the information processing device 1A can specify an area for each object in the attraction and reproduce the sound. For example, by using the sound of a helicopter as the sound source 55A, the user of the information processing device 1A can hear the sound of the helicopter only in the area Z1 in the attraction. For example, by using the sound of a car as the sound source 55B, the user of the information processing device 1A can hear the sound of the car only in the area Z2 in the attraction. This allows the attraction user to hear the sound of a different object in each area while hearing the same sound (e.g., footsteps) in all areas in the attraction.

[0058] Fig. 13 is a diagram showing a modified example of the reproduction information. As shown in Fig. 13, the reproduction information may include information indicating to which area a sound signal is to be output for each speaker. In other words, the reproduction information includes speaker designation information that designates a speaker to be used for each of a plurality of areas.

[0059] In the example of FIG. 13, area Z1 uses speakers 501 to 505. Area Z2 uses speakers 506 to 509. Area Z3 uses all speakers 501 to 509. For example, when a user of information processing device 1A specifies speakers 501, 502, 503, 504, 505, 506, and 507 as the speakers to be used in area Z1, the range of area Z1 expands. For example, when a user of information processing device 1A specifies speakers 501 to 509 as the speakers to be used in area Z1, the range of area Z1 expands to the entirety of R1.

[0060] In this way, the user can easily change the position covered by each area by specifying the speaker to be used for each area.

[0061] On the other hand, as shown in Fig. 14, the user may specify speakers 501, 503, 508, and 509 to be used in area Z3, for example. In this case, the processor 12 outputs the sound signal of the sound source specified in area Z3 (sound signal of sound source 55C in the example of Fig. 12) to speakers 501, 503, 508, and 509 at the four corners of R1. In this case, area Z3 is still the entirety of R1. Therefore, in this case, the user of the information processing device 1A can reproduce footstep sound source 55C in all areas, for example, in an attraction at a theme park.

[0062] The description of the present embodiment should be considered as illustrative in all respects and not restrictive. The scope of the present invention is indicated by the claims, not by the above-described embodiments. Furthermore, the scope of the present invention includes the scope equivalent to the claims.

[0063] For example, the number of sound sources arranged in one logical space is not limited to 1. Fig. 15 is a diagram showing an example of a setting screen for sound image localization displayed on the display 15 when multiple sound sources 55A and 55AB are arranged in the logical space L1 and sound image localization information is edited.

[0064] In this example, the user places the sound image localization positions of the sound source 55A and the sound source 55AB in the logical space L1. For example, the coordinates of the sound source 55A are (x1, y1) = (0.25, 0.25). The coordinates of the sound source 55AB are (x2, y2) = (0.25, 0.75).

[0065] The user edits the sound source 55A and the sound source 55AB arranged in the logical space L1. For example, the user changes the sound source 55A and the sound source 55AB arranged in the logical space L1 to different positions. The processor 12 converts the first sound image localization information of the sound source 55A and the sound source 55AB after the change into the second sound image localization information of the physical space Z1.

[0066] Moreover, the processor 12 may define multiple sound sources in one logical space as the same second group. Fig. 16 is a diagram showing an example of a setting screen of the sound image localization displayed on the display 15 when editing the sound image localization information of the sound source 55A and the sound source 55AB defined as the second group.

[0067] In this case, the sound source 55A and the sound source 55AB are defined as the same second group. The user edits either the sound source 55A or the sound source 55AB in the logical space L1. The processor 12 changes the first sound image localization information while maintaining the relative positional relationship of each of the multiple sound images included in the same second group. For example, as shown in FIG. 16, the user changes the coordinates of the sound source 55A arranged in the logical space L1 from (x1, y1)=(0.75, 0.25) to (x1, y1)=(0.25, 0.75). The processor 12 changes the coordinates of the sound source 55AB while maintaining the relative positional relationship of the sound source 55A and the sound source 55AB included in the same second group. The coordinates of the sound source 55AB are (x2, y2)=(0.75, 0.5). In this case, the relative position is (x1-x2, y1-y2)=(0,-0.25). Therefore, the processor 12 changes the coordinates of the sound source 55AB to (x2, y2)=(0.25, 1). The display 15 displays the sound source 55A and the sound source 55AB in the logical space L1 according to the changed coordinates of the sound source 55A and the sound source 55AB.

[0068] Then, the processor 12 converts the sound source position coordinates (first sound image localization information) of the sound source 55A and the sound source 55AB after the change in the logical coordinate system into sound source position information (second sound image localization information) in the physical coordinate system. Alternatively, the processor 12 may convert the coordinates of the sound source 55A and the relative position after the change in the logical coordinate system into the physical coordinate system. In this case, the processor 12 may obtain the position of the sound source 55AB in the physical coordinate system based on the coordinates of the sound source 55A and the coordinates of the relative position in the physical coordinate system. After that, the display 15 changes the positions of the sound source 55A and the sound source 55AB in the physical space Z1 as shown in FIG. 16.

[0069] In the above embodiment, the display and coordinate conversion of the sound source in a two-dimensional space (plane) has been shown. However, the display and coordinate conversion of the sound source in a three-dimensional space may be performed. In addition, the information of the three-dimensional space may include plane coordinates (x, y) and information indicating multiple layers in the height direction. [Explanation of symbols]

[0070] 1, 1A: Information processing device 11: Communications Department 12: Processor 13: RAM 14: Flash memory 15: Display 16: User I / F 17: Audio I / F 501~509: Speaker 55, 55A, 55AB, 55B, 55C: Sound source 151: Logical space image 152: Physical Space Images 153: Logical Plane Image 154: Physical plane image

Claims

1. accepting settings of a plurality of pieces of physical space information corresponding to the plurality of pieces of logical space information, receiving a plurality of first sound image localization information indicating positions of sound images to be localized in the plurality of logical spaces, using first coordinates in the plurality of logical spaces; receiving the plurality of first sound image localization information as a group; when a change in one of the first sound image localization information in the group is received, the other first sound image localization information is changed in response to the change in the one of the first sound image localization information; converting the grouped plurality of pieces of first sound image localization information into a plurality of pieces of second sound image localization information using second coordinates in the corresponding plurality of physical spaces; Information processing methods.

2. The first coordinates of each of the grouped plurality of first sound image localization information are the same. The information processing method according to claim 1 .

3. the first coordinates of each of the plurality of grouped first sound image localization information are different, when a change to one piece of first sound image localization information in the group is received, a relative positional relationship between the plurality of pieces of first sound image localization information that have been grouped is maintained, and the other pieces of first sound image localization information are changed. The information processing method according to claim 1 .

4. At least one of the plurality of logical spaces includes a plurality of first sound image localization information indicating positions of a plurality of sound images, The plurality of first sound image localization information in the one logical space is defined as a second group; When a change to one piece of first sound image localization information in the second group is received, the plurality of pieces of first sound image localization information are changed while maintaining a relative positional relationship between the plurality of sound images included in the second group, converting the plurality of first sound image localization information included in the second group into a plurality of second sound image localization information in one physical space corresponding to the one logical space; The information processing method according to any one of claims 1 to 3.

5. accepting settings of a plurality of pieces of physical space information corresponding to the plurality of pieces of logical space information, receiving a plurality of first sound image localization information indicating positions of sound images to be localized in the plurality of logical spaces, using first coordinates in the plurality of logical spaces; receiving the plurality of first sound image localization information as a group; when a change in one of the first sound image localization information in the group is received, the other first sound image localization information is changed in response to the change in the one of the first sound image localization information; converting the grouped plurality of pieces of first sound image localization information into a plurality of pieces of second sound image localization information using second coordinates in the corresponding plurality of physical spaces; An information processing device having a processing unit.

6. The first coordinates of each of the grouped plurality of first sound image localization information are the same. The information processing device according to claim 5 .

7. the first coordinates of each of the plurality of grouped first sound image localization information are different, when a change to one piece of first sound image localization information in the group is received, a relative positional relationship between the plurality of pieces of first sound image localization information that have been grouped is maintained, and the other pieces of first sound image localization information are changed. The information processing device according to claim 5 .

8. At least one of the plurality of logical spaces includes a plurality of first sound image localization information indicating positions of a plurality of sound images, The plurality of first sound image localization information in the one logical space is defined as a second group; When a change to one piece of first sound image localization information in the second group is received, the plurality of pieces of first sound image localization information are changed while maintaining a relative positional relationship between the plurality of sound images included in the second group, converting the plurality of first sound image localization information included in the second group into a plurality of second sound image localization information in one physical space corresponding to the one logical space; The information processing device according to claim 5 .

Images