Distribution system, sound output method, and program

Abstract

Provided is a distribution system which distributes information for outputting a performance sound, wherein the distribution system comprises a device control unit which outputs, to a first speaker provided in a viewing place of a distribution destination, a sound signal among a first sound signal and a second sound signal according to a combination of the type of the performance sound and the specification pertaining to the sound in an acoustic apparatus provided in the viewing place on the basis of the first sound signal and the second sound signal pertaining to the performance sound, metadata that indicates the type of the performance sound of each of the first sound signal and the second sound signal, and sound environment data that indicates the specification.

Description

Technical Field

[0001] The present invention relates to a distribution system, a sound output method, and a program.

Background Art

[0002] There is a system for live-distributing a video obtained by photographing a singing or playing performance (for example, Patent Document 1). In this system, performers such as singers and players perform at different performance locations. Cameras are provided at each performance location. The center synthesizes the videos obtained from each camera and distributes them to the receiving terminal as distribution videos.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, the audio devices provided at the viewing locations of the distribution destinations are of various types, such as full-scale audio equipment and smartphones. The characteristics of the sound that can be output are different between full-scale audio equipment and smartphones. For this reason, it is desirable to be able to output sounds according to the audio devices at each distribution destination.

[0005] The present invention has been made in view of such circumstances, and an object thereof is to output a sound according to the audio device provided at the viewing location of the distribution destination.

Means for Solving the Problems

[0006] One aspect of the present invention is a distribution system that distributes information for outputting performance sounds, comprising: a device control unit that outputs, to a first speaker provided at a viewing location, one of the first sound signal and the second sound signal corresponding to a combination of the type and the characteristics based on the first sound signal and the second sound signal related to the performance sound, metadata indicating the type of the performance sound of each of the first sound signal and the second sound signal, and sound environment data indicating characteristics related to sound in an acoustic device provided at the viewing location of the distribution destination. , the metadata is changed according to the progress of the performance, and the device control unit causes the sound signal to be output to the first speaker based on the latest metadata It is a distribution system.

[0007] Another aspect of the present invention is a sound output method executed by a computer used in a distribution system that distributes information for outputting performance sounds, which outputs, to a first speaker provided at a viewing location, one of the first sound signal and the second sound signal corresponding to a combination of the type and the characteristics based on the first sound signal and the second sound signal related to the performance sound, metadata indicating the type of the performance sound of each of the first sound signal and the second sound signal, and sound environment data indicating characteristics related to sound in an acoustic device provided at the viewing location of the distribution destination. , the metadata is changed according to the progress of the performance, and causes the sound signal to be output to the first speaker based on the latest metadata It is a sound output method.

[0008] Another aspect of the present invention is a program for causing a computer used in a distribution system that distributes information for outputting performance sounds to output, to a first speaker provided at a viewing location, one of the first sound signal and the second sound signal corresponding to a combination of the type and the characteristics based on the first sound signal and the second sound signal related to the performance sound, metadata indicating the type of the performance sound of each of the first sound signal and the second sound signal, and sound environment data indicating characteristics related to sound in an acoustic device provided at the viewing location of the distribution destination. , the metadata is changed according to the progress of the performance, and causes the sound signal to be output to the first speaker based on the latest metadata It is a program.

Advantages of the Invention

[0009] It is possible to output sound according to the acoustic device provided at the viewing location of the distribution destination.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

MODE FOR CARRYING OUT THE INVENTION

[0011] Hereinafter, the distribution system 1 according to the embodiment will be described with reference to the drawings.

[0012] FIG. 1 is a schematic diagram showing the outline of the distribution system 1 according to the embodiment. The distribution system 1 is a system that distributes a live performance by a performer to a plurality of viewers in real time. As shown in FIG. 1, in the distribution system 1, video and sound related to the performance by the performer E1 are distributed to the viewers L (viewers L1 and L2) via the communication network NW. The viewers L1 and L2 receive and view the performance, for example, by using a smartphone, a mobile terminal, a tablet, or a PC (Personal Computer).

[0013] FIG. 2 is a block diagram showing an example of the configuration of the distribution system 1 according to the embodiment. The distribution system 1 includes, for example, a plurality of viewer systems 100 (viewer systems 100-1 to 100-N, where N is an arbitrary natural number), a communication network NW, and a distribution server 20.

[0014] The distribution server 20 distributes various signals indicating images, sounds, etc. related to performances. The distribution server 20 is a computer, for example, a server device, a cloud server, a PC, etc.

[0015] The viewer system 100 is a system in which the viewer terminal 10 and a plurality of speakers (speakers 15 to 17) are connected. The viewer terminal 10 receives information distributed from the distribution server 20. The viewer terminal 10 is a computer, for example, a smartphone, a PC, a tablet terminal, etc. The viewer system 100 is used by each viewer one by one. For example, the viewer system 100-1 is used by a certain viewer, and the viewer system 100-2 is used by another viewer. The speakers provided in the viewer system 100 are different for each viewer system 100. For this reason, the characteristics of the sound that can be output are different for each viewer system 100.

[0016] The communication network NW communicably connects each of the plurality of viewer systems 100 and the distribution server 20. The communication network NW is, for example, a wide area line network, that is, a WAN (Wide Area Network), the Internet, or a combination thereof.

[0017] Next, the configuration of the distribution server 20 will be described. The distribution server 20 includes, for example, a communication unit 21, a storage unit 22, and a control unit 23. The communication unit 21 communicates with each of the viewer terminals 10 via the communication network NW.

[0018] The storage unit 22 is composed of, for example, storage media such as HDD, flash memory, (Electrically Erasable Programmable Read Only Memory), RAM (Random Access read / write Memory), ROM (Read Only Memory), or a combination thereof. The storage unit 22 stores programs for executing various processes of the distribution server 20 and temporary data used when performing various processes. The storage unit 22 stores, for example, metadata 220. The metadata will be described in detail later.

[0019] The control unit 23 is realized by causing the CPU (Central Processing Unit) included in the distribution server 20 as hardware to execute a program. The control unit 23 includes, for example, an acquisition unit 230, a processing unit 231, and a distribution unit 232.

[0020] The acquisition unit 230 acquires a sound signal obtained from a microphone (hereinafter referred to as a mic). Here, the mic is used at a live venue, picks up the sound at the live venue (for example, performance sound), and outputs a sound signal corresponding to the picked-up sound. The performance sound is, for example, the sound of various musical instruments (including vocals) used in the performance. The sound signal output from the mic is transmitted to the distribution server 20 via a communication device or the like. The mic may have any one of the functions of a sound sensor that picks up the performance sound output from a musical instrument, an input device that inputs the sound signal output from an electronic musical instrument, and a microphone that picks up the singing sound of a performer. For example, when a performer sings while playing a musical instrument, a plurality of mics can be used, such as a mic and a mic that picks up the sound of the musical instrument. When a performer plays one musical instrument, the performance sound of one musical instrument is included in one sound signal. When a performer plays a plurality of musical instruments and the sound is collected by one mic, the sounds of a plurality of musical instruments are included in one sound signal.

[0021] In addition, a camera is provided at the live venue. The camera captures the performer and outputs captured data. The captured data is, for example, video data. The captured data is transmitted to the distribution server 20 via a communication device or the like. The acquisition unit 230 of the distribution server 20 can also acquire this captured data.

[0022] The acquisition unit 230 outputs the sound signal to the processing unit 231.

[0023] The processing unit 231 acquires the sound signal from the acquisition unit 230 and performs various processing operations on the acquired sound signal. Here, the processing operations are, for example, operations such as adding metadata to the sound signal and synthesis processing. The synthesis processing is a process of synthesizing a plurality of sound signals to generate one sound signal.

[0024] Here, the metadata will be described. The metadata is information indicating the type of the sound signal. The type of the sound signal is the type of sound collected during the performance. The type of the sound signal may be any type as long as it can identify what kind of sound it is. For example, it may be the type of the sound itself, such as vocal sound, guitar sound, bass sound, or the sound emitted by the audience, or it may be the type representing the role of the sound signal. The role of the sound signal means, for example, when a plurality of sound signals are included, which of the sound signals is the main sound and which is the sub - sound.

[0025] The main sound is a sound designated as the main sound in the performance sound. For example, when a sound signal of the type "vocal" is designated as the main sound, the sound signal of the type "vocal" is used as the main sound. When a sound signal of the type "guitar" is designated as the main sound, the sound signal of the type "guitar" is used as the main sound.

[0026] The sub - sound is a sound designated as the sub - sound in the performance sound. The sub - sound is set for a sound signal different from the sound signal designated as the main sound. It may accept the designation as the sub - sound, or may be set as the sub - sound for a sound signal that has not been designated as the main sound.

[0027] When the processing unit 231 adds metadata to an audio signal, it adds the type as metadata according to the information indicating what kind of sound the microphone that collected the audio signal has collected. For example, when it is predetermined which microphone collects which musical instrument, the correspondence between the type of the musical instrument and the microphone is specified by an administrator or the like. The processing unit 231 identifies the type of the audio signal output from the microphone based on the specified correspondence, and adds the identified type as the metadata of the audio signal. The processing unit 231 associates the added metadata with the audio signal and stores it in the storage unit 22 as metadata 220.

[0028] Alternatively, when the processing unit 231 adds metadata to an audio signal, it can also add, as metadata, data according to metadata specification information that designates the role of the audio signal by an administrator or the like.

[0029] For example, an administrator operates a terminal device (such as a smartphone) owned by the administrator to input metadata specification information. The metadata specification information is information that designates a main sound or a sub - sound for an audio signal included in the performance sound. The terminal device transmits the input metadata specification information to the distribution server 20.

[0030] The processing unit 231 acquires the metadata specification information via the acquisition unit 230. Based on the acquired information, the processing unit 231 stores, in the storage unit 22 so as to include in the metadata 220, information associating which of the audio signals related to the performance sound to be distributed is designated as the main sound and which is designated as the sub - sound.

[0031] The processing unit 231 outputs each of the generated audio signals to the distribution unit 232.

[0032] The distribution unit 232 distributes the audio signal and its metadata to the viewer terminal 10. If there is video data captured by a camera, the distribution unit 232 also distributes the captured data.

[0033] Next, the viewer terminal 10 of the viewer system 100 will be described. The viewer terminal 10 includes, for example, a communication unit 11, a storage unit 12, a control unit 13, and a display unit 14.

[0034] The communication unit 11 communicates with the distribution server 20. The storage unit 12 is composed of a storage medium such as an HDD (Hard Disk Drive), a flash memory, an EEPROM (Electrically Erasable Programmable Read Only Memory), a RAM (Random Access read / write Memory), a ROM (Read Only Memory), or a combination thereof. The storage unit 12 stores programs for executing various processes of the viewer terminal 10 and temporary data used when performing various processes.

[0035] The storage unit 12 stores, for example, sound environment data 120 and registration data 121. The sound environment data 120 is information indicating characteristics related to the sound in the audio equipment provided at the viewing location. The characteristics related to the sound are information indicating the quality of the sound that can be viewed at the viewing location by the audio equipment. For example, when the audio equipment is a speaker, the characteristics related to the sound are information indicating the quality of the sound output by the speaker, such as, for example, the playback frequency band, the directivity angle, the rated output, etc. The sound environment data 120 may not be the characteristics related to the sound itself, but may be information that can grasp the characteristics related to the sound. For example, the sound environment data 120 may use identification information of the audio equipment, such as the model name or serial number. In this case, the viewer terminal 10 may acquire the characteristics related to the sound of the audio equipment from an external server or the like based on the identification information of the audio equipment indicated in the sound environment data 120. Such sound environment data 120 is pre-registered according to a registration operation input from the viewer to the viewer terminal 10 regarding the audio equipment or the like owned by the viewer.

[0036] When registering such an audio device owned by the viewer himself / herself, information indicating the arrangement of the audio device may be registered. In this case, the acoustic environment data includes information indicating what kind of audio device is arranged at what position in the viewing location.

[0037] The registration data 121 is information indicating the sound that the viewer wishes to view. For example, the viewer operates the viewer terminal 10 to input information indicating the sound signal that the viewer wishes to view. The viewer terminal 10 acquires the input information and stores the acquired information in the storage unit 12 as the registration data 121.

[0038] The control unit 13 controls each of the communication unit 11, the storage unit 12, and the display unit 14. The control unit 13 includes, for example, an acquisition unit 130 and a device control unit 132.

[0039] The acquisition unit 130 acquires various information. For example, the acquisition unit 130 acquires the distributed sound signal and its metadata via the communication unit 11. The acquisition unit 130 outputs the acquired sound signal and metadata to the device control unit 132. In addition, the acquisition unit 130 acquires the operation content from the viewer via an input device such as a touch panel provided on the viewer terminal 10.

[0040] Based on the first sound signal, the second sound signal, and the metadata acquired from the distribution server 20 and the acoustic environment data 120, the device control unit 132 outputs either the first sound signal or the second sound signal corresponding to the combination of the type and characteristics to the first speaker provided at the viewing location.

[0041] <Case 1> The device control unit 132 refers to the acoustic environment data 120 and acquires the characteristics of the sound that can be output by the speaker provided at the viewing location. The device control unit 132 specifies the sound range of the sound that can be output by the speaker from the characteristics of the sound.

[0042] Further, the device control unit 132 specifies the pitch range of the sound included in the sound signal based on the type of sound indicated in the metadata of the sound signal. For example, the device control unit 132 specifies the pitch range of the sound included in the sound signal based on the correspondence between musical instruments and the pitch ranges that the musical instruments can output. The data representing the correspondence may be stored, for example, in the storage unit 12 as correspondence data, or may be stored in the storage unit 22 of the distribution server 20. The device control unit 132 can specify the pitch range of the sound included in the sound signal by using the correspondence data stored in either the storage unit 12 or the storage unit 22.

[0043] The device control unit 132 specifies a speaker that can output a pitch range equal to or wider than the pitch range of the sound included in the sound signal.

[0044] <Case 2> The device control unit 132 refers to the sound environment data 120 and acquires the number of speakers provided at the viewing location. When a plurality of speakers are provided at the viewing location, the device control unit 132 specifies the speaker to which the sound signal is to be output according to the sound characteristics of each speaker.

[0045] For example, consider a case where two speakers, a first speaker and a second speaker, are provided at the viewing location. The first speaker is a device capable of outputting sound in a relatively wide band, such as a loudspeaker. The second speaker is a device capable of outputting sound in a relatively narrow band, such as a speaker built into a smartphone. In this case, the device control unit 132 uses the sound environment data 120 to determine that the first speaker is a speaker that outputs sound in a wider pitch range and specifies it as the speaker that outputs the main sound. The device control unit 132 uses the sound environment data 120 to determine that the second speaker is a speaker that outputs sound in a pitch range narrower than that of the first speaker and specifies it as the speaker that outputs the sub sound. Thereby, the device control unit 132 can cause the first speaker to output the main sound and the second speaker to output the sub sound.

[0046] <Case 3> The device control unit 132 refers to the registered data 121 and acquires the type of sound specified by the viewer. The device control unit 132 identifies the speaker to which the sound signal is to be output according to the type of sound specified by the viewer.

[0047] For example, similar to the above, consider the case where two speakers, a first speaker and a second speaker, are provided at the viewing location. The device control unit 132 uses the sound environment data 120 to determine that the first speaker is the speaker that outputs sound in a wider sound range, and identifies it as the speaker that outputs the sound specified by the viewer. The device control unit 132 uses the sound environment data 120 to determine that the second speaker is the speaker that outputs sound in a narrower sound range than the first speaker, and identifies it as the speaker that outputs sounds other than the sound specified by the viewer.

[0048] <Other cases> The device control unit 132 may identify the speaker to which the sound signal is to be output according to the arrangement of the speakers provided at the viewing location. The arrangement of the speakers is determined based on, for example, the sound environment data 120. For example, if it is a speaker built into a smartphone, it is presumed to be at a position relatively close to the viewer. On the other hand, if it is a room-mounted speaker, it is presumed to be at a position far from the viewer.

[0049] Generally, the closer the distance from the viewer to the speaker, the less need to consider the influence of the space through which the sound propagates, and it is considered that the sound output from the speaker can be propagated to the viewer's ear without deterioration. Based on such an idea, the device control unit 132, for example, identifies the speaker at a position close to the viewer as the speaker that outputs the main sound or the sound specified by the viewer.

[0050] Note that the volume of the sound output to each speaker may be determined according to the arrangement of the speakers provided at the viewing location. For example, the device control unit 132 outputs sound with a relatively small volume to the speaker at a position close to the viewer. On the other hand, the device control unit 132 outputs sound with a relatively large volume to the speaker at a position far from the viewer.

[0051] The display unit 14 includes a display device such as a liquid crystal display, and displays an image such as a video related to a live performance in accordance with the control of the control unit 13.

[0052] The speakers 15 to 17 output sound according to the sound signal output from the viewer terminal 10. The speakers 15 to 17 are connectable to the viewer terminal 10. The speakers 15 to 17 are, for example, loudspeakers provided in the viewing space or speakers built in the viewer terminal 10.

[0053] The sound environment data 120 will be described with reference to FIG. 3. FIG. 3 is a diagram showing an example of the sound environment data 120 according to the embodiment. As shown in FIG. 3, the sound environment data 120 has items such as, for example, speaker number, quality, and type, and information corresponding to each item is stored. The speaker number is identification information such as a number that uniquely identifies a speaker. The quality is information indicating the quality of the speaker specified by the speaker number. The type is information indicating the type of the speaker.

[0054] In the example of this figure, it is shown that two speakers, a high-quality loudspeaker and a speaker built in a low-quality smartphone, are provided at the viewing location of the viewer.

[0055] The registered data 121 will be described with reference to FIG. 4. FIG. 4 is a diagram showing an example of the registered data 121 according to the embodiment. As shown in FIG. 4, the registered data 121 has items such as, for example, priority and sound signal type, and information corresponding to each item is stored. The priority indicates the priority of the type of sound that the viewer wishes to view. In the example of this figure, the priorities are set in the order of guitar and vocal as the types of sound that the viewer wants to view.

[0056] The metadata 220 will be described with reference to FIG. 5. FIG. 5 is a diagram showing an example of the metadata 220 according to the embodiment. As shown in FIG. 5, the metadata 220 has items such as, for example, a playback time, a sound signal, and a type, and data corresponding to each item is stored. The playback time is information indicating the elapsed time based on the start time in the performance sound related to the live performance. The sound signal is a sound signal played at the playback time, and is, for example, identification information for identifying each of a plurality of sound signals. The type is information indicating the type of the sound signal.

[0057] FIG. 6 is a sequence diagram for explaining the flow of processing performed by the distribution system 1 according to the embodiment. Here, it is assumed that video related to a live performance, sound signals, etc. are distributed by the distribution server 20, and a plurality of viewers are viewing the distributed live performance via their respective viewer terminals 10. Also, here, it is assumed that the metadata is distributed intermittently.

[0058] The distribution server 20 distributes the metadata to each of the viewer terminals 10 (viewer terminals 10-1 to 10-N) (step S1). Each of the viewer terminals 10 receives the metadata and performs sound processing based on the received metadata (steps S2 to S4). The flow of the sound processing will be described in detail later. When the metadata is changed, the distribution server 20 distributes the changed metadata to each of the viewer terminals 10 (step S5). Each of the viewer terminals 10 receives the changed metadata and performs sound processing based on the changed metadata (steps S6 to S8).

[0059] FIG. 7 is a flowchart for explaining the above-described audio processing flow. The viewer terminal 10 acquires metadata (step S10). The viewer terminal 10 acquires an audio signal (step S11). The viewer terminal 10 specifies an audio signal to be output to the speaker using the audio signal, the metadata, and the audio environment data 120 (step S12). The viewer terminal 10 adjusts the volume as necessary using the audio environment data 120 (step S13). The viewer terminal 10 outputs the audio signal with the adjusted volume to the speaker (step S14). Thereby, sound corresponding to the audio signal is output from the speaker.

[0060] The viewer terminal 10 determines whether it is the update timing of the metadata (step S15). For example, the viewer terminal 10 determines that it is the update timing when silence continues for a predetermined time in the distributed audio signal. When the viewer terminal 10 determines that it is the update timing, it returns to step S10 and changes the metadata to the latest metadata. On the other hand, when the viewer terminal 10 does not determine that it is the update timing, it returns to step S11.

[0061] As described above, the distribution system 1 of the embodiment is a system in which the distribution server 20 distributes information for outputting performance sounds. The distribution system 1 includes a device control unit 132. The device control unit 132 outputs any one of a plurality of audio signals (first audio signal and second audio signal) related to the performance sound, metadata indicating the type of each performance sound of the plurality of audio signals, and a combination of the type of performance sound and the characteristics of the audio equipment to a speaker (first speaker) provided at the viewing location.

[0062] Thereby, in the distribution system 1 of the embodiment, it is possible to output sound corresponding to the speaker provided at the viewing location. That is, even when the speakers provided at each viewing location are individually different and the characteristics of the sound that can be output are different, it is possible to output sound corresponding to the speaker provided at the viewing location.

[0063] In addition, in the distribution system 1 of the embodiment, the metadata may include information indicating the main sound and the sub - sound in the performance sound. The sound environment data 120 may include information indicating the sound range that the speakers provided at the viewing location can output. When two sound output devices are provided at the viewing location, the device control unit 132 refers to the metadata and outputs a sound signal with the metadata indicating the main sound set to the higher - quality speaker (for example, the first speaker when the sound range that the first speaker can output is wider than that of the second speaker), and outputs a sound signal with the metadata indicating the sub - sound set to the lower - quality speaker (for example, the second speaker). Thereby, in the distribution system 1 of the embodiment, when identifying the speaker for outputting sound, the intention designated as the main sound or the sub - sound can be reflected and the sound can be output.

[0064] In addition, in the distribution system 1 of the embodiment, the metadata may include information indicating the priority corresponding to the type of performance sound registered by the viewer. The device control unit 132 outputs either the first sound signal or the second sound signal to the first speaker according to the priority indicated by the metadata. Thereby, in the distribution system 1 of the embodiment, the sound reflecting the wish registered by the viewer can be output.

[0065] In addition, in the distribution system 1 of the embodiment, when silence continues for a predetermined time, the metadata may be updated. Thereby, in the distribution system 1 of the embodiment, compared with the case of constantly updating the metadata, the frequency of updating the metadata can be suppressed and the processing load can be reduced. And since the metadata can be updated to the latest metadata at the time when the metadata is likely to be changed, it is possible to output an appropriate sound according to the progress of the performance sound.

[0066] In the above-described embodiment, the case where the viewer terminal 10 specifies the sound to be output to the speaker provided at the viewing location has been described as an example. However, the present invention is not limited to this. The distribution server 20 may specify the sound signal to be output to the speakers provided at each viewing location according to the sound environment data of each viewer.

[0067] In this case, the storage unit 22 of the distribution server 20 stores the sound environment data 120 and the registration data 121 for each viewer. Further, the distribution server 20 includes a functional unit corresponding to the device control unit 132. The distribution server 20 specifies the sound signal to be output to the speakers provided at each viewing location based on the sound environment data 120 and the registration data 121 of the viewer. The distribution server 20 distributes the specified sound signal to the viewer terminal 10. In the sound signal distributed to the viewer terminal 10, for example, a control signal indicating the speaker to which the sound is to be output is associated as metadata.

[0068] Also, the sound to be output to the speaker may be a sound obtained by separating the sound source from the sound signal. For example, when a single distributed sound signal includes sounds of a plurality of types of musical instruments, the sound signal may be separated into sound signals for each musical instrument by separating the sound source for each type of musical instrument, and the generated sound signals for each musical instrument may be output to the speaker.

[0069] In the above-described embodiment, the case where the sound related to the live performance is output from the speaker has been described as an example, but the present invention is not limited to this. The present system can also be applied when outputting performance sounds different from the live performance. Further, the present invention is not limited to the case of outputting the performance sound distributed in real time, and the present system can also be applied when outputting the performance sound on demand.

[0070] Further, a program for realizing the functions of the processing units (control unit 13 and control unit 23) in FIG. 1 may be recorded on a computer-readable recording medium, and the program recorded on this recording medium may be read into a computer system and executed to perform construction management. Here, the "computer system" shall include hardware such as an OS and peripheral devices.

[0071] Also, the "computer system" shall include a homepage providing environment (or display environment) if the WWW system is being used. Also, the "computer-readable recording medium" refers to portable media such as flexible disks, magneto-optical disks, ROMs, CD-ROMs, and storage devices such as hard disks built into a computer system. Further, the "computer-readable recording medium" shall include those that hold a program for a certain period of time, such as volatile memories inside a computer system serving as a server or a client. Also, the above program may be for realizing a part of the aforementioned functions, or may be such that the aforementioned functions can be realized in combination with a program already recorded in the computer system. Also, the above program may be stored in a predetermined server and distributed (downloaded, etc.) via a communication line in response to requests from other devices.

[0072] As described above, the embodiments of the present invention have been described in detail with reference to the drawings. However, the specific configuration is not limited to this embodiment, and designs and the like within the scope not departing from the gist of the present invention are also included.

Description of Reference Numerals

[0073] 1... Distribution system, 10... Viewer terminal, 11... Communication unit, 12... Storage unit, 13... Control unit, 14... Display unit, 15 - 17... Speakers, 20... Distribution server, 130... Acquisition unit, 132... Device control unit

Claims

1. A distribution system that distributes information for outputting performance sounds, Based on the first sound signal and the second sound signal related to the performance sound, the metadata indicating the type of the performance sound for each of the first sound signal and the second sound signal, and the sound environment data indicating the characteristics related to the sound in the sound equipment provided at the viewing location of the distribution destination, an apparatus control unit that outputs either the first sound signal or the second sound signal to a first speaker provided at the viewing location according to the combination of the type and the characteristics, comprising, the metadata is changed according to the progress of the performance, and the apparatus control unit outputs a sound signal to the first speaker based on the latest metadata, A distribution system.

2. The metadata includes information that can grasp which of the sound signal as the main sound and the sound signal as the sub sound in the performance sound, The sound environment data includes information indicating the sound range that the speaker provided at the viewing location can output, When a second speaker is further provided at the viewing location, the apparatus control unit refers to the metadata and outputs a sound signal with the metadata indicating the main sound to the speaker with the wider outputtable sound range among the first speaker and the second speaker, and outputs a sound signal with the metadata indicating the sub sound to the other speaker, The distribution system according to claim 1.

3. The metadata includes information indicating the priority corresponding to the type registered by the viewer, The apparatus control unit outputs either the first sound signal or the second sound signal to the first speaker according to the priority indicated by the metadata, The distribution system according to claim 1.

4. The metadata is changed when the type is changed according to the progress of the performance, When the silence in the performance sound continues for a predetermined time or more, the device control unit outputs a sound signal corresponding to the combination of the type and the characteristics to the first speaker based on the latest metadata at the time when the silence has continued for a predetermined time or more. The distribution system according to any one of claims 1 to 3.

5. A sound output method executed by a computer used in a distribution system that distributes information for outputting a performance sound, Based on the first sound signal and the second sound signal related to the performance sound, the metadata indicating the type of the performance sound of each of the first sound signal and the second sound signal, and the sound environment data indicating the specifications related to the sound in the audio device provided at the viewing location of the distribution destination, output one of the first sound signal and the second sound signal corresponding to the combination of the type and the specifications to the first speaker provided at the viewing location. The metadata is changed according to the progress of the performance, and a sound signal is output to the first speaker based on the latest metadata. Sound output method.

6. In a computer used in a distribution system that distributes information for outputting a performance sound, Based on the first sound signal and the second sound signal related to the performance sound, the metadata indicating the type of the performance sound of each of the first sound signal and the second sound signal, and the sound environment data indicating the specifications related to the sound in the audio device provided at the viewing location of the distribution destination, output one of the first sound signal and the second sound signal corresponding to the combination of the type and the specifications to the first speaker provided at the viewing location. The metadata is changed according to the progress of the performance, and a sound signal is output to the first speaker based on the latest metadata. Program.

Images