Information processing system, information processing device, information processing method, and information processing program

Abstract

This information processing system includes a first information processing device, a second information processing device, an adjustment unit, and a transmission unit. The first information processing device is installed at a first location. The second information processing device is installed at a second location. The adjustment unit adjusts environmental sound generated at the first location on the basis of performance sound generated at the first location or the second location. The transmission unit transmits the performance sound generated at the first location and the environmental sound adjusted by the adjustment unit to the second information processing device.

Description

Information processing system, information processing device, information processing method, and information processing program

[0001] The present invention relates to an information processing system, an information processing device, an information processing method, and an information processing program.

[0002] A system is known that transmits sounds generated at an event venue where a specific event is held to another remote venue. With this system, performers at the remote venue can play along with the sounds transmitted from the event venue, allowing them to perform together with other performers at the event venue. Here, the sounds transmitted from the event venue include not only the performance sounds but also environmental sounds such as crowd noise. Therefore, performers at the remote venue can perform as if they were at the event venue. Furthermore, audience members at the remote venue can listen to the ensemble as if they were at the event venue. In such a system, if the volume of the environmental sounds is excessively loud, the performers or audience members at the remote venue may find the environmental sounds unpleasant.

[0003] Japanese Patent Application Laid-Open No. 2022-081598

[0004] Patent Document 1 describes adjusting the volume of sounds such as shouts, applause, cheers, support, and murmurs based on the number of users participating in an event. However, with the technology described in Patent Document 1, even when the sound is adjusted, the sound may still interfere with the sound of the performance. Therefore, it is difficult to output appropriate sounds without causing discomfort to the performers or the audience.

[0005] An object of the present invention is to provide an information processing system, an information processing device, an information processing method, and an information processing program that are capable of outputting appropriate environmental sounds.

[0006] An information processing system according to one aspect of the present invention includes a first information processing device installed at a first location, a second information processing device installed at a second location, an adjustment unit that adjusts environmental sounds generated at the first location based on performance sounds generated at the first location or the second location, and a transmission unit that transmits the performance sounds generated at the first location and the environmental sounds adjusted by the adjustment unit to the second information processing device.

[0007] An information processing device according to another aspect of the present invention is an information processing device used together with an external information processing device, and includes an adjustment unit that adjusts environmental sounds generated in a first location where the information processing device is installed or a second location where the external information processing device is installed based on performance sounds generated in the first location, and a transmission unit that transmits the performance sounds generated in the first location and the environmental sounds adjusted by the adjustment unit to the external information processing device.

[0008] An information processing method according to yet another aspect of the present invention includes adjusting environmental sounds generated at a first location where a first information processing device is installed or a second location where a second information processing device is installed based on performance sounds generated at the first location, and transmitting the performance sounds generated at the first location and the adjusted environmental sounds to the second information processing device, and is executed by a computer.

[0009] An information processing program according to yet another aspect of the present invention causes a computer to execute a process of adjusting environmental sounds generated at a first location where a first information processing device is installed or a second location where a second information processing device is installed, based on performance sounds generated at the first location, and a process of transmitting the performance sounds generated at the first location and the adjusted environmental sounds to the second information processing device.

[0010] According to the present invention, it is possible to output appropriate environmental sounds.

[0011] Fig. 1 is a schematic diagram showing the configuration of an information processing system according to an embodiment of the present invention. Fig. 2 is a block diagram for explaining the operation of the information processing system. Fig. 3 is a diagram showing an example of adjustment of environmental sound. Fig. 4 is a flowchart showing an example of information processing by the information processing system of Fig. 2.

[0012] (1) Configuration of Information Processing System An information processing system, information processing device, information processing method, and information processing program according to an embodiment of the present invention will be described below with reference to the drawings. Fig. 1 is a schematic diagram showing the configuration of an information processing system according to an embodiment of the present invention. As shown in Fig. 1, the information processing system 1 includes an information processing device 100 including a control device 110, an information processing device 200 including a control device 210, and a main control device 300.

[0013] Each of the control devices 110, 210 and the main control device 300 is realized by, for example, a PC (personal computer) and has a storage unit. The main control device 300 may be realized by a server PC and have a large-capacity storage unit. The main control device 300 is connected to the control devices 110, 210 by wire or wirelessly. The storage units of the control devices 110, 210 and the main control device 300 store information processing programs for causing the information processing system 1 to execute information processing.

[0014] The information processing program may be provided in a form stored in a computer-readable storage medium and installed in the storage units of the control devices 110, 210 and the main control device 300. Alternatively, the information processing program may be stored in the storage unit of the main control device 300 and distributed to the control devices 110, 210, thereby installing the information processing program in the storage unit of the control devices 110, 210.

[0015] The information processing device 100 includes a control device 110, a microphone 120, and one or more imaging devices 130, and is installed at an arbitrary location P1. The location P1 is, for example, an outdoor event square, where a musical instrument 10 is placed. In the example of FIG. 1 , the musical instrument 10 is a grand piano, and a performer 11 is playing the instrument 10. An audience 12 is listening to the performance sound of the performer 11. The microphone 120 collects the performance sound of the performer 11. The imaging device 130 captures an image of the audience 12, thereby generating an image of the audience 12. In the example of FIG. 1 , multiple audience members 12 around the performer 11 are captured by two imaging devices 130.

[0016] In addition to the control device 210, the information processing device 200 includes a speaker unit 220, one or more projection devices 230, and one or more screens 240, and is installed at an arbitrary location P2 different from location P1. Location P2 is, for example, a concert hall, where a musical instrument 20 is placed. In the example of FIG. 1 , the musical instrument 20 is a grand piano, and a performer 21 is playing the musical instrument 20. An audience (not shown) is listening to the performance sound by the performer 21.

[0017] The speaker unit 220 outputs the performance sounds collected by the microphone 120 of the information processing device 100 and environmental sounds at the location P1. The environmental sounds include, for example, crowd noise or conversation sounds. The one or more projection devices 230 correspond to the one or more imaging devices 130 of the information processing device 100, respectively. The one or more screens 240 correspond to the one or more projection devices 230, respectively, and are arranged around the performer 21. Each projection device 230 projects an image of the audience 12 captured by the corresponding imaging device 130 onto the corresponding screen 240.

[0018] According to the information processing system 1 described above, performer 21 at location P2 can play an ensemble with performer 11 at location P1, feeling as if they were at location P1. Furthermore, the audience at location P2 can listen to the ensemble as if they were at location P1. In this example, main control device 300 transmits and receives various information between information processing device 100 and information processing device 200, adjusts environmental sounds at location P1, and so on. Note that main control device 300 may be installed in either location P1 or P2, or may be installed in a location different from locations P1 and P2. The operation of information processing system 1 will be described in detail below.

[0019] (2) Operation of Information Processing System FIG. 2 is a block diagram for explaining the operation of the information processing system 1. As shown in FIG. 2, the control device 110 of the information processing device 100 includes a storage unit 111 and a control unit 112. As described above, the storage unit 111 stores an information processing program. The control unit 112 includes, for example, a CPU (Central Processing Unit). The control unit 112 executes the information processing program stored in the storage unit 111, thereby realizing the functional units of the information processing device 100. At least a portion of the functional units of the information processing device 100 may be realized by hardware such as electronic circuits.

[0020] The information processing device 100 includes, as functional units, a performance sound acquisition unit 101 and an image acquisition unit 102. The performance sound acquisition unit 101 acquires performance sounds collected by a microphone 120. The image acquisition unit 102 acquires images generated by each imaging device 130.

[0021] The main control device 300 includes a memory unit 310 and a control unit 320. As described above, the memory unit 310 stores an information processing program. The memory unit 310 also stores a plurality of predetermined types of environmental sounds. The plurality of types of environmental sounds are sounds that are expected to be generated by the audience 12 at location P1, and differ from one another depending on the number of audience members 12. The control unit 320 includes, for example, a CPU. The control unit 320 executes the information processing program stored in the memory unit 310, thereby realizing the functional units of the main control device 300. At least some of the functional units of the main control device 300 may be realized by hardware such as electronic circuits.

[0022] The main control device 300 includes, as functional units, a performance situation determination unit 301, an image analysis unit 302, an environmental sound acquisition unit 303, an adjustment unit 304, and a transmission unit 305. The performance situation determination unit 301 determines the performance situation based on the specification by the performers 11 and 21 in FIG. 1 . The performance situation includes, as identification information related to the performance sounds, a distinction between whether the performance is performed by an instrument or by singing. When the performance is performed by an instrument, the identification information related to the performance sounds includes an identifier for identifying the instruments 10 and 20. In this example, the identifiers for identifying the instruments 10 and 20 are specified by the performers 11 and 21, respectively, and thus the performance situation is determined to be that the performance is performed by the instruments 10 and 20.

[0023] The performance situation may also include information about the location P1 where the information processing device 100 is installed or the location P2 where the information processing device 200 is installed. In this case, the performers 11 and 21 can specify information about the locations P1 and P2, respectively, to the performance situation identification unit 301. As a result, the location P1 where the information processing device 100 is installed or the location P2 where the information processing device 200 is installed is identified as the performance situation.

[0024] The image analysis unit 302 has a function of recognizing objects included in an image by analyzing the image. The image analysis unit 302 uses this function to identify the number of audience members 12 included in an image acquired by the image acquisition unit 102 of the information processing device 100. When the image acquisition unit 102 acquires multiple images captured by multiple imaging devices 130, the total number of audience members 12 included in the multiple images is identified. The environmental sound acquisition unit 303 acquires, from the storage unit 310, environmental sounds corresponding to the number of audience members 12 identified by the image analysis unit 302, from multiple types of environmental sounds stored in advance.

[0025] The adjustment unit 304 identifies performance sounds occurring at location P1 or location P2 according to the type of instrument identified by the performance situation identification unit 301, etc. Specifically, the frequency domain range and sound pressure range of the performance sounds corresponding to the type of instrument are identified. If there are multiple instruments, the frequency domain range and sound pressure range of the performance sounds for each instrument are identified. If singing is performed, the frequency domain range and sound pressure range of human vocalization are identified. Furthermore, the adjustment unit 304 adjusts the environmental sounds acquired by the environmental sound acquisition unit 303 based on the identified performance sounds. In this example, the sound pressure of the environmental sounds is adjusted based on the sound pressure and frequency of the performance sounds.

[0026] FIG. 3 is a diagram showing an example of adjusting environmental sounds. The horizontal axis of FIG. 3 represents frequency, and the vertical axis of FIG. 3 represents sound pressure. Furthermore, the performance sound is indicated by a dashed dotted line, the environmental sound before adjustment is indicated by a dotted line, and the environmental sound after adjustment is indicated by a solid line. Note that the unit of sound pressure in FIG. 3 is "dB," but it may also be "Pa." As shown in FIG. 3 , in this example, the sound pressure of the environmental sound is adjusted to be smaller than the sound pressure of the performance sound in the frequency range of the performance sound. On the other hand, if the sound pressure of the performance sound is smaller than a predetermined value, the environmental sound does not need to be adjusted.

[0027] In the present embodiment, performance sounds are identified based on identification information related to the performance sounds, such as the type of instrument identified by the performance situation identification unit 301, and the environmental sounds are adjusted based on the identified performance sounds, but the embodiment is not limited to this. Performance sounds actually generated at location P1 are collected by the microphone 120 of the information processing device 100. Therefore, the environmental sounds may be adjusted based on the performance sounds actually generated at location P1. Similarly, if a microphone for collecting performance sounds generated at location P2 is provided in the information processing device 200, the environmental sounds may be adjusted based on the performance sounds actually generated at location P2.

[0028] The transmission unit 305 in Figure 2 transmits to the information processing device 200 the environmental sound adjusted by the adjustment unit 304, the performance sound acquired by the performance sound acquisition unit 101 of the information processing device 100, and the image acquired by the image acquisition unit 102 of the information processing device 100.

[0029] The control device 210 of the information processing device 200 includes a storage unit 211 and a control unit 212. The speaker unit 220 includes two speakers 221 and 222. As described above, the storage unit 211 stores an information processing program. The control unit 212 includes, for example, a CPU. The control unit 212 executes the information processing program stored in the storage unit 211, thereby realizing the functional units of the information processing device 200. At least a portion of the functional units of the information processing device 200 may be realized by hardware such as electronic circuits.

[0030] The information processing device 200 includes, as functional units, a sound receiving unit 201 and an image receiving unit 202. The sound receiving unit 201 receives performance sounds and environmental sounds transmitted by the transmission unit 305 of the main control device 300. The sound receiving unit 201 also outputs the received performance sounds from a speaker 221 of the speaker unit 220. Similarly, the sound receiving unit 201 outputs the received environmental sounds from a speaker 222 of the speaker unit 220. The image receiving unit 202 receives images transmitted by the transmission unit 305 of the main control device 300. The image receiving unit 202 also projects the received images onto a screen 240 from a projection device 230 corresponding to the imaging device 130 that generated the images.

[0031] In the present embodiment, performance sounds generated at location P2 are not output from speaker unit 220, but the embodiment is not limited to this. If a microphone for collecting performance sounds generated at location P2 is provided in information processing device 200, performance sounds generated at location P2 may be output from speaker 221. Furthermore, if speaker unit 220 further includes a speaker different from speakers 221 and 222, performance sounds generated at location P2 may be output from that speaker.

[0032] (3) Information Processing FIG. 4 is a flowchart showing an example of information processing by the information processing system 1 of FIG. 2. First, the performance situation identification unit 301 determines whether a performance situation has been designated by the performer 11, 21 (step S1). If a performance situation has not been designated, the performance situation identification unit 301 waits until a performance situation is designated. If a performance situation has been designated, the performance situation identification unit 301 identifies the designated performance situation (step S2). In this example, the instruments 10, 20 used by the performers 11, 21 are identified. The adjustment unit 304 identifies the performance sounds generated at location P1 or location P2 depending on the types of instruments 10, 20 identified in step S2 (step S3).

[0033] The performance sound acquisition unit 101 acquires performance sounds generated at the location P1 from the microphone 120 (step S4). The image acquisition unit 102 acquires images of the audience 12 captured by the image capture devices 130 (step S5). Steps S4 and S5 may be executed either first or simultaneously. Steps S1 to S3 and steps S4 and S5 may be executed at least partially in parallel.

[0034] Next, the image analysis unit 302 analyzes the image acquired in step S5 to identify the number of audience members 12 included in the image (step S6). The environmental sound acquisition unit 303 acquires environmental sounds corresponding to the number of audience members 12 identified in step S6 from the storage unit 310 (step S7). The adjustment unit 304 adjusts the environmental sounds acquired in step S7 based on the performance sounds identified in step S3 (step S8). The transmission unit 305 transmits the image of the audience members 12 acquired in step S5, the performance sounds acquired in step S4, and the environmental sounds adjusted in step S8 to the information processing device 200 (step S9).

[0035] Next, the image receiving unit 202 projects the image of the audience 12 transmitted in step S9 from the projection device 230 onto the screen 240 (step S10). The sound receiving unit 201 outputs the performance sounds and environmental sounds transmitted in step S9 from the speaker unit 220 (step S11). Steps S10 and S11 may be performed either first or simultaneously.

[0036] (4) Effects of the Embodiment As described above, the information processing system 1 according to the present embodiment includes an information processing device 100 installed at location P1, an information processing device 200 installed at location P2, an adjustment unit 304 that adjusts environmental sounds generated at location P1 based on performance sounds generated at location P1 or location P2, and a transmission unit 305 that transmits the performance sounds generated at location P1 and the environmental sounds adjusted by the adjustment unit 304 to the information processing device 200. With this configuration, the environmental sounds are adjusted based on the performance sounds, thereby reducing the interference of the environmental sounds with the performance sounds. This makes it possible to output appropriate environmental sounds.

[0037] The adjustment unit 304 may adjust the sound pressure of the environmental sound generated at the location P1 based on the sound pressure and frequency of the performance sound generated at the location P1 or the location P2. In this case, appropriate environmental sound can be easily output.

[0038] The adjustment unit 304 may adjust the sound pressure of the environmental sound to be lower than the sound pressure of the performance sound in the frequency range of the performance sound generated at the location P1 or the location P2. In this case, it is possible to more easily output appropriate environmental sound.

[0039] The information processing device 200 may include a speaker 221 that outputs the performance sounds transmitted by the transmission unit 305, and a speaker 222 that outputs the environmental sounds transmitted by the transmission unit 305. In this case, the performance sounds and the environmental sounds are output from separate speakers 221, 222, which further reduces the interference of the environmental sounds with the performance sounds. This allows for more appropriate environmental sounds to be output.

[0040] The adjustment unit 304 does not need to adjust the environmental sound when the sound pressure of the performance sound generated at the location P1 or the location P2 is lower than a predetermined value. In this case, the audience can hear the environmental sound when the performers 11 and 21 are intentionally lowering the sound pressure of the performance sound to emphasize the environmental sound.

[0041] The environmental sound may be a predetermined sound. In this case, the adjustment unit 304 can easily obtain the environmental sound to be adjusted.

[0042] The adjustment unit 304 may identify the performance sound based on the identification information related to the performance sound. In this case, the adjustment unit 304 can easily adjust the environmental sound based on the identified performance sound.

[0043] The information processing device 100 may include an imaging device 130 that generates an image of the audience 12 by capturing an image of the audience 12 at location P1, and the information processing device 200 may include a projection device 230 that projects the image generated by the imaging device 130. In this case, a performer 21 near the projection device 230 of the information processing device 200 can perform with the feeling that the audience 12 captured by the imaging device 130 of the information processing device 100 are around them.

[0044] (5) Other Embodiments (a) In the above embodiment, the environmental sound generated at location P1 is adjusted and the adjusted environmental sound is transmitted to the information processing device 200 installed at location P2, but the embodiment is not limited to this. If the sound pressure of the performance sound is greater than the sound pressure of the environmental sound, the audience will hardly find the environmental sound unpleasant. Therefore, in this case, the environmental sound generated at location P1 may be transmitted to the information processing device 200 without being adjusted.

[0045] (b) In the above embodiment, the environmental sound acquisition unit 303 acquires environmental sounds according to the number of audience members 12, but the embodiment is not limited to this. The storage unit 310 may store multiple types of environmental sounds that differ depending on the location, such as an outdoor event plaza or a concert hall. In this case, the environmental sound acquisition unit 303 may acquire, from the storage unit 310, environmental sounds that correspond to the location P1 identified by the performance situation identification unit 301.

[0046] (c) In the above embodiment, the environmental sound acquisition unit 303 acquires predetermined environmental sounds, but the embodiment is not limited to this. If the microphone 120 collects not only performance sounds but also environmental sounds, the environmental sound acquisition unit 303 may acquire the environmental sounds collected by the microphone 120. In this case, the adjustment unit 304 can adjust the dynamically changing environmental sounds. Furthermore, a microphone that also collects environmental sounds may be different from the microphone 120 that collects performance sounds.

[0047] (d) In the above embodiment, the information processing device 200 includes the screen 240, but the embodiment is not limited to this. If a wall surface provided in the location P2 can be used as a screen, the information processing device 200 does not need to include the screen 240. Furthermore, if an image is not used to acquire environmental sound, the information processing device 100 does not need to include the imaging device 130. In this case, the information processing device 200 does not need to include the projection device 230, and does not need to include the screen 240.

[0048] On the other hand, the number of people in the audience 12 included in the image generated by the imaging device 130 can be identified by the image analysis unit 302. Therefore, if the information processing device 100 includes the imaging device 130, the adjustment unit 304 may adjust the environmental sound based on the number of people in the audience 12 included in the image generated by the imaging device 130. For example, the sound pressure of the environmental sound may be adjusted to be lower as the number of people in the audience 12 decreases. In this case, the environmental sound can be adjusted more appropriately.

[0049] (e) In the above embodiment, the environmental sound generated at location P1 is adjusted, and the adjusted environmental sound and the performance sound generated at location P1 are transmitted to the information processing device 200, but the embodiment is not limited to this. If the information processing device 100 is provided with a speaker unit and a microphone, the environmental sound generated at location P2 may be adjusted, and the adjusted environmental sound and the performance sound generated at location P2 may be transmitted to the information processing device 100. In other words, the adjusted environmental sound and the performance sound may be transmitted and received bidirectionally between the information processing device 100 and the information processing device 200.

[0050] (f) In the above embodiment, main control device 300 is provided separately from information processing devices 100 and 200, but the embodiment is not limited to this. Main control device 300 may be provided as part of information processing device 100. Alternatively, main control device 300 may be provided as part of information processing device 200.

[0051] For example, when main control device 300 is provided as part of information processing device 100, memory unit 310 and memory unit 111 may be realized by the same memory unit, and control unit 320 and control unit 112 may be realized by the same control unit. Therefore, the functional units of main control device 300 may be provided in information processing device 100. Such information processing device 100 may be distributed as an information processing device used together with information processing device 200, which is an external information processing device, separately from information processing device 200.

[0052] The information processing device 100 includes an adjustment unit 304 that adjusts environmental sounds generated at location P1 based on performance sounds generated at location P1 where the information processing device 100 is installed or location P2 where the information processing device 200 is installed, and a transmission unit 305 that transmits the performance sounds generated at location P1 and the environmental sounds adjusted by the adjustment unit 304 to the information processing device 200. Therefore, the information processing device 100 transmits the environmental sounds adjusted based on the performance sounds to the information processing device 200. This allows the information processing device 200 to output appropriate environmental sounds.

[0053] (6) Summary of the embodiments (Section 1) The information processing system according to Section 1 includes a first information processing device installed at a first location, a second information processing device installed at a second location, an adjustment unit that adjusts environmental sounds generated at the first location based on performance sounds generated at the first location or the second location, and a transmission unit that transmits the performance sounds generated at the first location and the environmental sounds adjusted by the adjustment unit to the second information processing device.

[0054] In this information processing system, the environmental sound is adjusted based on the performance sound, so that the environmental sound does not interfere with the performance sound, thereby making it possible to output appropriate environmental sound.

[0055] (Clause 2) In the information processing system described in paragraph 1, the adjustment unit may adjust the sound pressure of the environmental sound generated in the first location based on the sound pressure and frequency of the performance sound generated in the first location or the second location.

[0056] In this case, appropriate environmental sounds can be easily output.

[0057] (Clause 3) In the information processing system described in clause 2, the adjustment unit may adjust the sound pressure of the environmental sound to be smaller than the sound pressure of the performance sound in the frequency range of the performance sound generated at the first location or the second location.

[0058] In this case, appropriate environmental sounds can be output more easily.

[0059] (4) In the information processing system described in any one of paragraphs 1 to 3, the second information processing device may include a first speaker that outputs the performance sound transmitted by the transmission unit, and a second speaker that outputs the environmental sound transmitted by the transmission unit.

[0060] In this case, the performance sound and the environmental sound are output from separate speakers, which further reduces the interference of the environmental sound with the performance sound, thereby enabling more appropriate environmental sound to be output.

[0061] (Clause 5) In the information processing system described in any one of clauses 1 to 4, the adjustment unit may not adjust the environmental sound if the sound pressure of the performance sound generated in the first location or the second location is smaller than a predetermined value.

[0062] In this case, the audience can hear the environmental sounds when the performer intentionally reduces the sound pressure of the performance sound to accentuate the environmental sounds.

[0063] (6) In the information processing system described in any one of paragraphs 1 to 5, the environmental sound may be a predetermined sound.

[0064] In this case, the environmental sound to be adjusted can be easily obtained.

[0065] (Clause 7) In the information processing system described in any one of clauses 1 to 6, the first information processing device may include a microphone that collects generated environmental sounds, and the adjustment unit may adjust the environmental sounds collected by the microphone.

[0066] In this case, the adjustment unit can adjust the dynamically changing environmental sound.

[0067] (Item 8) In the information processing system described in any one of Items 1 to 7, the adjustment unit may identify the performance sound based on identification information relating to the performance sound.

[0068] In this case, the adjustment unit can easily adjust the environmental sound based on the identified performance sound.

[0069] (Clause 9) In the information processing system described in any one of clauses 1 to 8, the first information processing device may include an imaging device that generates an image, and the adjustment unit may adjust the environmental sound based on the number of audience members included in the image generated by the imaging device.

[0070] In this case, the environmental sound can be adjusted more appropriately.

[0071] (Item 10) In the information processing system described in item 9, the second information processing device may include a projection device that projects an image generated by the imaging device.

[0072] In this case, a performer near the projection device of the second information processing device can perform with the feeling that the audience, imaged by the imaging device of the first information processing device, is present around them.

[0073] (Clause 11) The information processing device according to clause 11 is an information processing device used together with an external information processing device, and may include an adjustment unit that adjusts environmental sounds generated in a first location where the information processing device is installed or a second location where the external information processing device is installed, based on performance sounds generated in the first location, and a transmission unit that transmits the performance sounds generated in the first location and the environmental sounds adjusted by the adjustment unit to the external information processing device.

[0074] In this information processing device, the environmental sound adjusted based on the performance sound is transmitted to the external information processing device, thereby enabling the external information processing device to output appropriate environmental sound.

[0075] (Clause 12) The information processing method according to Clause 12 is executed by a computer and includes adjusting environmental sounds generated in a first location where a first information processing device is installed or a second location where a second information processing device is installed based on performance sounds generated in the first location, and transmitting the performance sounds generated in the first location and the adjusted environmental sounds to the second information processing device.

[0076] According to this information processing method, the environmental sound is adjusted based on the performance sound, so that the environmental sound is less likely to interfere with the performance sound, thereby making it possible to output appropriate environmental sound.

[0077] (Clause 13) The information processing program according to clause 13 causes a computer to execute the following processes: adjusting environmental sounds generated in a first location where a first information processing device is installed or a second location where a second information processing device is installed, based on performance sounds generated in the first location; and transmitting the performance sounds generated in the first location and the adjusted environmental sounds to the second information processing device.

[0078] According to this information processing program, the environmental sound is adjusted based on the performance sound, so that the environmental sound is less likely to interfere with the performance sound, thereby making it possible to output appropriate environmental sound.

Claims

1. An information processing system comprising: a first information processing device installed at a first location; a second information processing device installed at a second location; an adjustment unit that adjusts environmental sounds generated at the first location based on performance sounds generated at the first location or the second location; and a transmission unit that transmits the performance sounds generated at the first location and the environmental sounds adjusted by the adjustment unit to the second information processing device.

2. An information processing system as described in claim 1, wherein the adjustment unit adjusts the sound pressure of the environmental sound generated in the first location based on the sound pressure and frequency of the performance sound generated in the first location or the second location.

3. An information processing system according to claim 2, wherein said adjustment unit adjusts the sound pressure of the environmental sound to be smaller than the sound pressure of the performance sound in the frequency range of the performance sound generated in said first location or said second location.

4. An information processing system according to any one of claims 1 to 3, wherein the second information processing device includes a first speaker that outputs the performance sound transmitted by the transmission unit, and a second speaker that outputs the environmental sound transmitted by the transmission unit.

5. An information processing system as described in any one of claims 1 to 3, wherein the adjustment unit does not adjust the environmental sound when the sound pressure of the performance sound generated in the first location or the second location is smaller than a predetermined value.

6. An information processing system according to any one of claims 1 to 3, wherein the environmental sound is a predetermined sound.

7. An information processing system according to any one of claims 1 to 3, wherein the first information processing device includes a microphone that collects generated environmental sounds, and the adjustment unit adjusts the environmental sounds collected by the microphone.

8. An information processing system according to any one of claims 1 to 3, wherein the adjustment section identifies the performance sound based on identification information relating to the performance sound.

9. An information processing system according to any one of claims 1 to 3, wherein the first information processing device includes an imaging device that generates an image, and the adjustment unit adjusts the environmental sound based on the number of audience members included in the image generated by the imaging device.

10. An information processing system according to claim 9, wherein said second information processing device includes a projection device that projects an image generated by said imaging device.

11. An information processing device for use together with an external information processing device, comprising: an adjustment unit that adjusts environmental sounds generated in a first location where the information processing device is installed or a second location where the external information processing device is installed based on performance sounds generated in the first location or a second location where the external information processing device is installed; and a transmission unit that transmits the performance sounds generated in the first location and the environmental sounds adjusted by the adjustment unit to the external information processing device.

12. An information processing method executed by a computer, comprising: adjusting environmental sound generated in a first location where a first information processing device is installed or a second location where a second information processing device is installed based on performance sound generated in the first location; and transmitting the performance sound generated in the first location and the adjusted environmental sound to the second information processing device.

13. An information processing program that causes a computer to execute the following processes: a process of adjusting environmental sound generated in a first location where a first information processing device is installed or a second location where a second information processing device is installed, based on performance sounds generated in the first location, and a process of transmitting the performance sounds generated in the first location and the adjusted environmental sound to the second information processing device.

Images