Audio distribution device, audio distribution system, audio distribution method, and program

Abstract

This invention provides an audio distribution device that can deliver the broadcaster's voice to listeners in real time during events such as trips. [Solution] The audio distribution device 40 includes a communication unit 41 that communicates with a first information terminal 20 used by a first user and a second information terminal 30 used by a second user participating in a live event; an acquisition unit 44 that communicates with the first information terminal 20 using the communication unit 41 during the live event to acquire audio information indicating the audio of the first user related to the live event acquired by the first information terminal 20; and a distribution unit 45 that communicates with the second information terminal 30 using the communication unit 41 during the live event to distribute the acquired audio information to the second information terminal 30. The audio distribution device 40 does not have a function to distribute audio information indicating the audio acquired by the second information terminal 30 to the first information terminal 20.

Description

Technical Field

[0001] The present invention relates to an audio distribution device, an audio distribution system, an audio distribution method, and a program.

Background Art

[0002] In an event such as a trip, a service is provided in which terminals are lent to participants and guide voices are output from the terminals. In relation to such a service, Patent Document 1 discloses a guide service method that can completely respond to the needs of different trips for each customer without increasing the number of attendants or local guides, and can also provide one-on-one correspondence for each customer.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The present invention provides an audio distribution device or the like that can distribute the voice of a distributor to a listener in real time during the holding of an event such as a trip.

Means for Solving the Problems

[0005] An audio distribution device according to one aspect of the present invention comprises a communication unit that communicates with a first information terminal used by a first user and a second information terminal used by a second user participating in a live event via a wide-area communication network; an acquisition unit that, by communicating with the first information terminal using the communication unit during the live event, acquires audio information indicating the first user's voice related to the live event acquired by the first information terminal; and a distribution unit that, by communicating with the second information terminal using the communication unit during the live event, distributes the acquired audio information to the second information terminal, but does not have a function to distribute audio information indicating the voice acquired by the second information terminal to the first information terminal.

[0006] An audio distribution system according to one aspect of the present invention comprises the audio distribution device and the first information terminal, the first information terminal switching between a first mode of transmitting the audio information to the audio distribution device and a second mode of transmitting the audio information to the second information terminal via a local communication network.

[0007] An audio distribution system according to one aspect of the present invention comprises the audio distribution device and the second information terminal, wherein the second information terminal accesses the audio distribution device by photographing a predetermined code with a camera provided in the second information terminal, or by manually entering a predetermined URL.

[0008] An audio distribution method according to one aspect of the present invention is an audio distribution method performed by a computer, wherein the computer can communicate with a first information terminal used by a first user and a second information terminal used by a second user participating in a live event via a wide-area communication network, and the audio distribution method includes the steps of: acquiring audio information indicating the audio of the first user related to the live event acquired by the first information terminal by communicating with the first information terminal during the live event; and distributing the acquired audio information to the second information terminal by communicating with the second information terminal during the live event.

[0009] A program according to one aspect of the present invention is a program for causing the computer to execute the audio distribution method. [Effects of the Invention]

[0010] According to the audio distribution device of the present invention, the audio of the broadcaster can be distributed to listeners in real time during events such as travel. [Brief explanation of the drawing]

[0011] [Figure 1] Figure 1 is a block diagram showing the configuration of an audio distribution system according to an embodiment. [Figure 2] Figure 2 is a sequence diagram showing an example of the operation of distributing audio information. [Figure 3] Figure 3 shows an example of a screen for broadcasters. [Figure 4] Figure 4 shows an example of a display screen for a two-dimensional code. [Figure 5] Figure 5 shows an example of a screen for listeners. [Figure 6] Figure 6 is a sequence diagram showing an example of a notification process indicating that audio is muted. [Figure 7] Figure 7 shows an example of a screen for listeners when the device is muted. [Figure 8] Figure 8 is a sequence diagram showing an example of a notification process for a silent state. [Figure 9] Figure 9 is a sequence diagram showing an example of the operation of sending reaction information. [Figure 10] Figure 10 is a sequence diagram showing an example of the distribution operation of translated audio information. [Modes for carrying out the invention]

[0012] Hereinafter, embodiments will be specifically described with reference to the drawings. Note that all the embodiments described below show comprehensive or specific examples. The numerical values, shapes, materials, components, arrangement positions and connection forms of the components, steps, order of steps, etc. shown in the following embodiments are merely examples and are not intended to limit the present invention. In addition, among the components in the following embodiments, the components not described in the independent claims are described as optional components.

[0013] Note that each figure is a schematic diagram and is not necessarily drawn precisely. Also, in each figure, the same reference numerals are given to substantially the same configurations, and redundant descriptions may be omitted or simplified.

[0014] (Embodiment) [Configuration] First, the configuration of the voice distribution system according to the embodiment will be described. FIG. 1 is a block diagram showing the configuration of the voice distribution system according to the embodiment.

[0015] The voice distribution system 10 is a system that can distribute the voice (voice information) of a distributor to listeners during a live event such as travel, sports watching, or theater (hereinafter simply referred to as an event). The distributor is, for example, an expert such as a tour guide, a sports commentator, a sports analyst, or an announcer, and the listeners are general users. The voice distribution system 10 does not distribute pre-recorded fixed voices, but distributes the voice emitted by the distributor to the listeners in real time in a situation where the listeners and the distributor are participating in the same event.

[0016] In the voice distribution system 10, the listener listens to the voice of the distributor using a second information terminal 30 such as a smartphone that the listener owns. As a result, the operator holding the event has the advantage of not needing to prepare equipment for the listeners.

[0017] The voice distribution system 10 specifically includes a first information terminal 20, a second information terminal 30, a voice distribution device 40, and a management terminal 50. The voice distribution system 10 may include a plurality of second information terminals 30. In this case, the voice acquired by one first information terminal 20 can be simultaneously distributed to a plurality of second information terminals 30 (for example, about several to 30 second information terminals 30). Hereinafter, for simplicity of explanation, an example of distributing the voice acquired by one first information terminal 20 to one second information terminal 30 will be described.

[0018] The first information terminal 20 is an information terminal used by the distributor, mainly acquires the voice of the distributor, and transmits the voice information of the acquired voice to the voice distribution device 40. The first information terminal 20 is, for example, a portable information terminal such as a smartphone or a tablet terminal, but may also be a personal computer or the like. The first information terminal 20 includes an operation reception unit 21, a display unit 22, an information processing unit 23, a storage unit 24, a communication unit 25, a short-range communication unit 26, and a microphone 27.

[0019] The operation reception unit 21 receives the operation of the distributor. The operation reception unit 21 is, for example, an input device such as a touch panel, and receives a tap operation or the like of the distributor. The operation reception unit 21 may be an input device such as a mouse or a keyboard. In this case, the operation reception unit 21 receives a click operation or the like of the distributor.

[0020] The display unit 22 displays an image. The display unit 22 is realized by, for example, a display panel such as a liquid crystal panel or an organic EL (Electro Luminescence) panel.

[0021] The information processing unit 23 acquires the broadcaster's voice and performs information processing to transmit the acquired voice information to the voice distribution device 40. The information processing unit 23 is implemented by, for example, a microcomputer, but may also be implemented by a processor. The functions of the information processing unit 23 are realized, for example, by the microcomputer or processor constituting the information processing unit 23 executing a computer program stored in the storage unit 24.

[0022] The memory unit 24 is a storage device that stores computer programs executed by the information processing unit 23. The memory unit 24 is implemented by, for example, semiconductor memory, but may also be implemented by an HDD (Hard Disk Drive). The computer programs stored in the memory unit 24 include an application program (a dedicated application program for the voice distribution system 10; hereinafter also simply referred to as the dedicated app) for acquiring the voice of the broadcaster and transmitting the voice information of the acquired voice to the voice distribution device.

[0023] The communication unit 25 is a communication circuit (communication module) for the first information terminal 20 to communicate with the voice distribution device 40 via a wide-area communication network 60 such as the Internet. The communication unit 25 is, for example, a wireless communication circuit that performs wireless communication. The communication standard for the communication performed by the communication unit 25 is not particularly limited.

[0024] The short-range communication unit 26 is a communication circuit (communication module) for the first information terminal 20 to communicate with the second information terminal 30 via a local communication network. The short-range communication unit 26 is, for example, a wireless communication circuit that performs short-range wireless communication. The communication standard used by the short-range communication unit 26 is, but is not particularly limited, BLE (Bluetooth® Low Energy) or Wi-Fi®.

[0025] Microphone 27 acquires the broadcaster's voice. Specifically, microphone 27 is a MEMS (Micro Electro Mechanical Systems) microphone built into the first information terminal 20, but it may also be a microphone (such as a headset) connected to the external input terminal of the first information terminal 20.

[0026] The second information terminal 30 is an information terminal used by the listener to receive the broadcaster's audio. The second information terminal 30 is an information terminal personally owned by the listener. The second information terminal 30 is a portable information terminal such as a smartphone or tablet. The second information terminal 30 comprises an operation reception unit 31, a display unit 32, an information processing unit 33, a storage unit 34, a communication unit 35, a short-range communication unit 36, a sound output unit 37, and a camera 38.

[0027] The operation reception unit 31 receives input from the listener. The operation reception unit 31 is, for example, an input device such as a touch panel, and receives tap operations from the listener. Alternatively, the operation reception unit 31 may be another input device such as a touch panel, in which case it receives tap operations from the administrator.

[0028] The display unit 32 displays an image. The display unit 32 is implemented by a display panel such as a liquid crystal panel or an organic EL panel.

[0029] The information processing unit 33 performs information processing for playing back the audio (audio information) distributed by the audio distribution device 40. The information processing unit 33 is implemented by, for example, a microcomputer, but may also be implemented by a processor. The functions of the information processing unit 33 are realized, for example, by the microcomputer or processor constituting the information processing unit 33 executing a computer program stored in the storage unit 34.

[0030] The memory unit 34 is a storage device that stores computer programs and the like executed by the information processing unit 33. The memory unit 34 is implemented, for example, by semiconductor memory.

[0031] The communication unit 35 is a communication circuit (communication module) for the second information terminal 30 to communicate with the voice distribution device 40 via the wide-area communication network 60. The communication unit 35 is, for example, a wireless communication circuit for wireless communication, but it may also be a wired communication circuit for wired communication. There are no particular limitations on the communication standards used for communication by the communication unit 35.

[0032] The short-range communication unit 36 ​​is a communication circuit (communication module) for the second information terminal 30 to communicate with the first information terminal 20 via a local communication network. The short-range communication unit 36 ​​is, for example, a wireless communication circuit that performs short-range wireless communication. The communication standard used by the short-range communication unit 36 ​​is, but is not particularly limited, BLE (Bluetooth® Low Energy) or Wi-Fi®.

[0033] The sound output unit 37 outputs sound based on the audio information distributed by the audio distribution device 40. The sound output unit 37 is, for example, the built-in speaker of the second information terminal 30, but may also be an earphone (headphone) connected to an external output terminal, or an earphone (headphone) connected to the short-range communication unit 36.

[0034] Camera 38 captures still images and videos. Camera 38 is a built-in camera of the second information terminal 30, implemented, for example, by an image sensor and an optical system.

[0035] The voice distribution device 40 receives voice information from the first information terminal 20 and distributes the received voice information to the second information terminal 30. The voice distribution device 40 is implemented, for example, by a server device (cloud server). The voice distribution device 40 comprises a communication unit 41, an information processing unit 42, and a storage unit 43.

[0036] The communication unit 41 is a communication circuit (communication module) for the voice distribution device 40 to communicate with the first information terminal 20, the second information terminal 30, and the management terminal 50 via the wide-area communication network 60. The communication unit 41 is, for example, a wired communication circuit for wired communication, but it may also be a wireless communication circuit for wireless communication. There are no particular limitations on the communication standards for the communication performed by the communication unit 41.

[0037] The information processing unit 42 receives voice information from the first information terminal 20 and performs information processing to distribute the received voice information to the second information terminal 30. The information processing unit 42 is implemented by, for example, a microcomputer, but may also be implemented by a processor. The information processing unit 42 includes, as functional components, an acquisition unit 44, a distribution unit 45, a notification unit 46, and a translation unit 47. The functions of the acquisition unit 44, the distribution unit 45, the notification unit 46, and the translation unit 47 are realized, for example, by the microcomputer or processor constituting the information processing unit 42 executing a computer program stored in the storage unit 43.

[0038] The memory unit 43 is a storage device that stores computer programs and the like executed by the information processing unit 42. The memory unit 43 is implemented by, for example, an HDD, but may also be implemented by a semiconductor memory.

[0039] The management terminal 50 is an information terminal used by the administrator, and primarily acquires the voice of the broadcaster and transmits the acquired voice information to the voice distribution device 40. The management terminal 50 is a portable information terminal such as a smartphone or tablet, but it may also be a stationary information terminal such as a personal computer. Although not shown in the figures, the management terminal 50 is equipped with an operation reception unit, a display unit, an information processing unit, a storage unit, and a communication unit, similar to the first information terminal 20.

[0040] [Voice information distribution operation] Next, we will explain the operation of the voice distribution system 10 for distributing voice information. Figure 2 is a sequence diagram showing an example of the operation of distributing voice information.

[0041] The broadcaster and listener are participating in the same event (such as a tour) and are located relatively close to each other (in the same space or location). The broadcaster performs a predetermined operation on the first information terminal 20 running a dedicated application, and the operation reception unit 21 receives the predetermined operation (S11). The information processing unit 23 displays a two-dimensional code such as a QR code (registered trademark) on the display unit 22 in response to the received predetermined operation (for example, tapping an icon displayed on the broadcaster's screen) (S12). Figure 3 shows an example of the broadcaster's screen displayed on the first information terminal 20 running the dedicated application, and Figure 4 shows an example of the two-dimensional code display screen.

[0042] The listener performs a shooting operation on the second information terminal 30, which is running a browser, to capture a two-dimensional code using the camera 38, and the operation reception unit 31 accepts the shooting operation (S13). The information processing unit 33, in response to the accepted shooting operation, uses the camera 38 to capture the two-dimensional code (S14) and uses the communication unit 35 to access the URL indicated by the two-dimensional code (i.e., the audio distribution device 40).

[0043] As a result, the listener screen is displayed on the display unit 32 (S15). Figure 5 shows an example of the listener screen. The listener screen is an image displayed on the display unit 32 of the second information terminal 30, which functions as a user interface for receiving audio information. The second information terminal 30 can also access the above URL by taking a picture of a two-dimensional code printed on a document distributed to the listener. The second information terminal 30 can also access the audio distribution device 40 based on the listener's manual input of the above URL (including URLs separately distributed via email, etc.). The method of taking a picture of a two-dimensional code may also be used when the first information terminal 20 accesses the audio distribution device 40 and displays the distributor screen (Figure 3) on the display unit 22.

[0044] In step S15, the voice distribution device 40 is in a state where it can communicate with both the first information terminal 20 and the second information terminal 30, and is in a state where it can distribute voice information acquired from the first information terminal 20 to the second information terminal 30.

[0045] When the broadcaster's voice is acquired by the microphone 27 of the first information terminal 20 (S16), the information processing unit 23 transmits the voice information of the acquired voice to the voice distribution device 40 using the communication unit 25 (S17).

[0046] The communication unit 41 of the audio distribution device 40 receives audio information, and the acquisition unit 44 acquires the audio information (S18). The voice of the broadcaster indicated by the audio information is an audio related to an event, such as a tourist guide or sports commentary. In other words, in step S18, the acquisition unit 44 communicates with the first information terminal 20 using the communication unit 41 during the event, thereby acquiring audio information indicating the broadcaster's event-related audio acquired by the first information terminal 20.

[0047] The distribution unit 45 distributes the acquired audio information to the second information terminal 30 using the communication unit 41 (S19). In other words, in step S19, the distribution unit 45 distributes the acquired audio information to the second information terminal 30 by communicating with the second information terminal 30 using the communication unit 41 during the event.

[0048] The communication unit 35 of the second information terminal 30 receives voice information. The information processing unit 33 outputs (plays back) the voice indicated by the received voice information using the sound output unit 37 (S20).

[0049] In this way, the audio distribution system 10 can distribute the voice of the broadcaster acquired by the first information terminal 20 to the second information terminal 30 in real time. Here, "real time" is not strictly accurate, and there may be a delay of 0.1 seconds to several seconds.

[0050] In the audio distribution system 10, listeners receive the broadcaster's audio using a second information terminal 30, such as a smartphone, that they own. This has the advantage that event organizers do not need to prepare equipment for listeners. In addition, listeners can start receiving audio simply by running a browser on their second information terminal 30 and scanning a QR code, eliminating the need to download an application program or take other troublesome steps.

[0051] [Notification behavior when audio is muted] Next, we will explain the process of notifying listeners that the broadcaster has muted their audio. Figure 6 is a sequence diagram showing an example of the notification process for muted audio.

[0052] If the broadcaster wants to stop outputting audio information to the audio broadcasting device 40, they perform a mute operation, and the operation reception unit 21 of the first information terminal 20 receives the mute operation (S21). The mute operation is, for example, a tap operation on the mute button 22a on the broadcaster's screen (Figure 3).

[0053] The information processing unit 23 changes the display of the mute button 22a in response to the received mute operation (S22). The information processing unit 23 also stops transmitting audio information (S23). When a mute operation (a predetermined operation) is performed on the first information terminal 20 in this way, the transmission of audio information from the first information terminal 20 to the audio distribution device 40 is stopped.

[0054] Next, the information processing unit 23 transmits mute notification information indicating that the first information terminal 20 is muted to the voice distribution device 40 using the communication unit 25 (S24).

[0055] The communication unit 41 of the audio distribution device 40 receives mute notification information. The notification unit 46 transmits the received mute notification information to the second information terminal 30 using the communication unit 41 (S25). In other words, when the transmission of audio information is stopped, the notification unit 46 communicates with the second information terminal 30 using the communication unit 41 to notify the second information terminal 30 that it is muted.

[0056] The communication unit 35 of the second information terminal 30 receives mute notification information. The information processing unit 33 changes the display mode of the listener screen (Figure 5) based on the received mute notification information (S26). Figure 7 shows an example of the listener screen when muted. When muted, the word "LIVE" is changed to "MUTE", and the background color of the text and images is changed to gray. In addition, background music may be output from the sound output unit 37 while the muted listener screen is displayed.

[0057] In this way, the audio distribution system 10 can notify the second information terminal 30 (listener) that the first information terminal 20 is muted.

[0058] [Notification behavior when there is no sound] Next, we will describe the operation of notifying the listener that there is virtually no sound input to the microphone 27 of the first information terminal 20, resulting in a silent state. Figure 8 is a sequence diagram showing an example of the operation of notifying that there is a silent state.

[0059] The communication unit 41 of the voice distribution device 40 receives voice information from the first information terminal 20 (S31), and the acquisition unit 44 acquires the voice information (S32). When the notification unit 46 determines that the voice level of the voice indicated by the voice information is lower than a predetermined value (S33), it transmits silence notification information to the second information terminal 30 using the communication unit 41 to notify that there is silence (S34). In other words, when the notification unit 46 determines that the voice level of the voice indicated by the acquired voice information is lower than a predetermined value, it notifies the second information terminal 30 that there is silence.

[0060] The communication unit 35 of the second information terminal 30 receives silent notification information. Based on the received silent notification information, the information processing unit 33 displays on the listener screen (Figure 5) that it is silent (S35).

[0061] In this way, the audio distribution system 10 can notify the second information terminal 30 (listener) that there is virtually no sound input to the microphone 27 of the first information terminal 20.

[0062] [Sending reaction information to voice] In the voice distribution system 10, voice information is distributed only from the first information terminal 20 to the second information terminal 30, and not from the second information terminal 30 to the first information terminal 20. In other words, the voice distribution device 40 does not distribute voice information indicating voice acquired by the second information terminal 30 to the first information terminal 20.

[0063] However, listeners can react to the broadcaster's audio by performing a predetermined operation on the listener screen (Figure 5) (sending reaction information to the first information terminal 20). The operation of sending reaction information will be explained below. Figure 9 is a sequence diagram showing an example of the operation of sending reaction information.

[0064] When the listener's screen (Figure 5) is displayed, the listener performs a reaction operation, and the operation reception unit 31 of the second information terminal 30 receives the reaction operation (S41). The reaction operation is, for example, a tap on the "Like" button 32a on the listener's screen (Figure 5).

[0065] The information processing unit 33 increments the number assigned to the "Like" button 32a (+1) in response to the received reaction operation (S42). The information processing unit 33 also transmits the reaction information to the voice distribution device 40 using the communication unit 35 (S43).

[0066] The communication unit 41 of the audio distribution device 40 receives reaction information. The acquisition unit 44 acquires the received reaction information (S44). In other words, the acquisition unit 44 acquires listener reaction information to the distribution of audio information by communicating with the second information terminal 30 using the communication unit 41 during the event.

[0067] Next, the distribution unit 45 transmits the received reaction information to the first information terminal 20 using the communication unit 41 (S45). In other words, the distribution unit 45 transmits the acquired reaction information to the first information terminal 20 by communicating with the first information terminal 20 using the communication unit 41 during the event.

[0068] The communication unit 35 of the second information terminal 30 receives reaction information. Based on the received reaction information, the information processing unit 33 counts up the number indicating the number of likes displayed in a predetermined area 22b of the broadcaster's screen (Figure 3) (S46).

[0069] In this way, listeners can react to the broadcaster's audio by performing predetermined operations on the listener screen (Figure 5).

[0070] In addition, listeners can send messages as reaction information to the broadcaster by tapping the message button 32b and entering a message (text). Tapping the message button 32b and entering a message is just one example of a reaction operation. When a message is sent, a badge is added to the message button 22c on the broadcaster's screen (Figure 3), and the broadcaster can confirm the message by tapping the message button 22c.

[0071] Please note that broadcasters cannot react to listeners (e.g., reply to messages).

[0072] [Audio Translation] The audio distribution system 10 can also translate audio information and distribute it to listeners. Figure 10 is a sequence diagram showing an example of the distribution operation of translated audio information (hereinafter also referred to as translated audio information). The translation function can be switched on and off by the listener's operation on the second information terminal 30.

[0073] When the broadcaster's voice is acquired by the microphone 27 of the first information terminal 20 (S51), the information processing unit 23 transmits the voice information of the acquired voice to the voice distribution device 40 using the communication unit 25 (S52).

[0074] The communication unit 41 of the audio distribution device 40 receives audio information, and the acquisition unit 44 acquires the audio information (S53). The translation unit 47 translates the audio indicated by the acquired audio information from the first language to the second language and generates translated audio information indicating the translated audio (S54). The language of the second language (the language to which the translation will be made) is set in advance, for example, by an operation on the listener's second information terminal 30.

[0075] In step S54, the translation unit 47 may generate the translated audio information by requesting translation from a device other than the audio distribution device 40. The translation unit 47 may also generate the translated audio information by sending audio information to a translation server (a cloud server specializing in audio translation) or a generation AI server (not shown) using the communication unit 41, and receiving the translated audio information from the translation server or generation AI server.

[0076] The distribution unit 45 distributes the acquired translated audio information to the second information terminal 30 using the communication unit 41 (S55). In other words, in step S55, the distribution unit 45 distributes the generated translated audio information to the second information terminal 30 by communicating with the second information terminal 30 using the communication unit 41 during the event.

[0077] The communication unit 35 of the second information terminal 30 receives the translated audio information. The information processing unit 33 outputs (plays back) the translated audio indicated by the received translated audio information using the sound output unit 37 (S56).

[0078] In this way, the audio distribution system 10 can translate audio information and distribute it to listeners. Furthermore, the text displayed on the listener's screen (Figure 5) can also be changed to a different language.

[0079] [Switching network] The first information terminal 20 may switch between a first mode in which it transmits voice information to the voice distribution device 40 using the communication unit 25, and a second mode in which it transmits voice information to the second information terminal 30 using the short-range communication unit 26. In other words, the first information terminal 20 may switch between a first mode in which it distributes voice information to the second information terminal 30 via the wide-area communication network 60, and a second mode in which it distributes voice information to the second information terminal 30 via the local communication network.

[0080] For example, the information processing unit 23 of the first information terminal 20 may determine that the communication state with the voice distribution device 40 has deteriorated if the voice distribution device 40's response to the voice information is interrupted while the first information is being distributed in first mode, and may switch from first mode to second mode.

[0081] Furthermore, the information processing unit 23 of the first information terminal 20 may attempt to communicate with the voice distribution device 40 when distributing voice information in second mode. If the communication is successful, it may determine that the communication status with the voice distribution device 40 has improved and switch from second mode to first mode.

[0082] With this type of switching, the first information terminal 20 can continue distributing voice information by distributing it via the local communication network when it moves to a location where it cannot connect to the wide-area communication network 60, such as a cave or mountainous area during a tour.

[0083] The switching of the communication network (switching between the first mode and the second mode) may be performed manually based on the operator's actions to the first information terminal 20.

[0084] [Customizing the listener screen] The administrator can customize (edit or design) the listener screen (Figure 5) using the management terminal 50. The administrator customizes the listener screen by operating the management terminal 50 and performs operations to reflect the customizations on the listener screen. Upon receiving such operations, the management terminal 50 transmits customization instruction information to the audio distribution device 40.

[0085] The acquisition unit 44 of the audio distribution device 40 communicates with the management terminal 50 using the communication unit 41 to acquire customization instruction information from the management terminal 50, and reflects the customization content on the listener screen based on the acquired customization instruction information. As a result, the display unit 32 of the second information terminal 30 displays an image customized based on the customization instruction information.

[0086] This customization feature allows administrators to customize the viewer screen (Figure 5) according to their business type (providing travel services, managing sports teams, and event management). Administrators can also customize the broadcaster screen (Figure 3).

[0087] [Archive function] The broadcaster's screen displayed on the first information terminal 20 is equipped with a recording button 22d. When a broadcaster taps the recording button 22d, audio information is recorded in the storage unit 43 of the audio broadcasting device 40. The administrator can download the recorded audio information using the management terminal 50. For example, the administrator can provide the recorded audio information to other broadcasters with less experience to provide them with training.

[0088] Furthermore, the information processing unit 42 of the audio distribution device 40 records the changes in the number of listeners and the changes in the number of "likes" over time as log information in the storage unit 43 from the start of audio information distribution until the end of distribution. The recording of log information is performed automatically and no special operation is required.

[0089] The administrator can access log information using the management terminal 50 to understand the changes in the number of listeners and the number of likes over time.

[0090] [Effects, etc.] The following describes examples of inventions that can be obtained from the disclosures in this specification, and explains the effects and other benefits that can be obtained from these examples.

[0091] Invention 1 is an audio distribution device 40 comprising: a communication unit 41 that communicates with a first information terminal 20 used by a first user and a second information terminal 30 used by a second user participating in a live event via a wide-area communication network 60; an acquisition unit 44 that acquires audio information indicating the audio of the first user related to the live event acquired by the first information terminal 20 by communicating with the first information terminal 20 using the communication unit 41 during the live event; and a distribution unit 45 that distributes the acquired audio information to the second information terminal 30 by communicating with the second information terminal 30 using the communication unit 41 during the live event. The distributor in the above embodiment is an example of a first user, and the listener in the above embodiment is an example of a second user.

[0092] Such an audio distribution device 40 can distribute the audio of a first user to a second user in real time during events such as travel.

[0093] Invention 2 is an audio distribution device 40 of Invention 1, wherein when a predetermined operation is performed on the first information terminal 20, the transmission of audio information from the first information terminal 20 to the communication unit 41 is stopped.

[0094] Such an audio distribution device 40 can stop transmitting audio information from the first information terminal 20 to the communication unit 41.

[0095] Invention 3 is an audio distribution device 40 of Invention 2, further comprising a notification unit 46 that notifies the second information terminal 30 that it is muted by communicating with the second information terminal 30 using a communication unit 41 when the transmission of audio information is stopped.

[0096] Such an audio distribution device 40 can notify the second information terminal 30 that the first information terminal 20 is muted.

[0097] Invention 4 is an audio distribution device 40 according to any of Inventions 1 to 3, further comprising a notification unit 46 that notifies the second information terminal 30 that there is silence when it is determined that the audio level of the audio indicated by the acquired audio information is lower than a predetermined value.

[0098] Such an audio distribution device 40 can notify the second information terminal 30 that the first information terminal 20 is silent.

[0099] Invention 5 is an audio distribution device 40 according to any of Inventions 1 to 4, wherein the communication unit 41 further communicates with a management terminal 50 used by an administrator via a wide-area communication network 60, and the acquisition unit 44 further communicates with the management terminal 50 using the communication unit 41 to acquire customization instruction information from the management terminal 50 for customizing the image displayed on the display unit 32 of a second information terminal 30 which functions as a user interface for receiving audio distribution, and the display unit 32 displays an image customized based on the customization instruction information. The listener screen in the above embodiment is an example of such an image.

[0100] Such an audio distribution device 40 allows for customization of the viewer's screen.

[0101] Invention 6 is an audio distribution device 40 according to any of Inventions 1 to 5, wherein the audio distribution device 40 does not distribute audio information indicating voice acquired by the second information terminal 30 to the first information terminal 20.

[0102] By restricting audio distribution to one direction, such an audio distribution device 40 can reduce the amount of information required for communication and minimize communication delays compared to cases where audio distribution is bidirectional.

[0103] Invention 7 is an audio distribution device 40 according to any of Inventions 1 to 6, wherein the acquisition unit 44 further acquires reaction information of a second user to the distribution of audio information by communicating with a second information terminal 30 using a communication unit 41 during the live event, and the distribution unit 45 further transmits the acquired reaction information to the first information terminal 20 by communicating with a first information terminal 20 using a communication unit 41 during the live event.

[0104] Such an audio distribution device 40 can convey the reaction of a second user to the first user.

[0105] Invention 8 is an audio distribution device 40 according to any of Inventions 1 to 7, further comprising a translation unit 47 that translates the audio indicated by the acquired audio information from a first language to a second language and generates translated information indicating the translated information, and a distribution unit 45 that communicates with a second information terminal 30 using a communication unit 41 during the live event and distributes the generated translated information to the second information terminal 30.

[0106] Such an audio distribution device 40 can translate the voice of the first user and distribute it to the second user.

[0107] Invention 9 is an audio distribution device 40 according to any of Inventions 1 to 8, wherein the audio distribution device 40 can set the distribution range of audio information by a management terminal 50 used by an administrator.

[0108] Such an audio distribution device 40 can distribute audio information only to listeners gathered at the event venue.

[0109] Invention 10 is a voice distribution system 10 comprising a voice distribution device 40 according to any of Inventions 1 to 9 and a first information terminal 20, wherein the first information terminal 20 switches between a first mode in which voice information is transmitted to the voice distribution device 40 and a second mode in which voice information is transmitted to a second information terminal 30 via a local communication network.

[0110] Such an audio distribution device 40 can switch the communication network used for distributing audio information.

[0111] Invention 11 is an audio distribution system 10 of Invention 9, wherein the first information terminal 20 switches between a first mode and a second mode based on the communication status between the first information terminal 20 and the audio distribution device 40.

[0112] Such an audio distribution device 40 can switch the communication network used for distributing audio information based on the communication status between the first information terminal 20 and the audio distribution device 40.

[0113] Invention 12 is an audio distribution system 10 of Invention 9, wherein the first information terminal 20 switches between a first mode and a second mode based on an operation by a first user on the first information terminal 20.

[0114] Such an audio distribution device 40 can switch the communication network used for distributing audio information based on the operation of the first user.

[0115] Invention 13 is an audio distribution system 10 comprising an audio distribution device 40 described in any one of claims 1 to 9 and a second information terminal 30, wherein the second information terminal 30 accesses the audio distribution device 40 by capturing a predetermined code with a camera 38 provided on the second information terminal 30, or by manually entering a predetermined URL.

[0116] Such an audio distribution device 40 can easily link the first information terminal 20, which is the source of the audio information, with the second information terminal 30, which is the destination of the audio information, by reading a predetermined code or manually entering a predetermined URL.

[0117] Invention 14 is a voice distribution method performed by a computer, wherein the computer can communicate with a first information terminal 20 used by a first user and a second information terminal 30 used by a second user participating in a live event via a wide-area communication network 60, and the voice distribution method includes the steps of: acquiring voice information indicating the audio of the first user's live event acquired by the first information terminal 20 by communicating with the first information terminal 20 during the live event; and distributing the acquired voice information to the second information terminal 30 by communicating with the second information terminal 30 during the live event.

[0118] This type of audio distribution method allows for the real-time transmission of the first user's audio to a second user during events such as travel.

[0119] Invention 15 is a program for causing a computer to execute the audio distribution method of Invention 14.

[0120] Such a program allows a computer to deliver the voice of a first user to a second user in real time during events such as travel.

[0121] (Other embodiments) Although embodiments have been described above, the present invention is not limited to the embodiments described above.

[0122] For example, in the above embodiment, it was explained that audio information is delivered when the broadcaster and listener are participating in the same event and are located at a relatively close distance (same space or location). However, the broadcaster may be located in a remote location and may not be directly participating in the event, but rather participating indirectly.

[0123] Furthermore, if the listener moves a certain distance away from the broadcaster, the location of the broadcaster's first information terminal may be notified to the listener's second information terminal. For example, during a travel event, if a passenger who is the listener moves too far away from the guide who is the broadcaster, this can be used to return to the broadcaster's (guide's) location. The location of the first information terminal is measured by a location measurement unit, such as a GPS (Global Positioning System) module, installed in the first information terminal, and notified to the second information terminal via the audio broadcasting device.

[0124] Furthermore, the broadcaster's first information terminal may be configured to detect the location of the listener's second information terminal (and notify the first information terminal of the second information terminal's location). For example, this would make it easy to locate a listener (passenger) who has gotten lost during a travel event.

[0125] Furthermore, the distribution of audio information by the broadcaster may be restricted by distance. For example, the administrator can specify the location of the event venue (the place to broadcast) on a map displayed on the management terminal (by placing a pin, for example), and configure the audio broadcasting device so that audio information is distributed only to second information terminals located within a radius of Xm from the specified location. The audio broadcasting device 40 distributes audio information to the second information terminal, provided that the second information terminal is located within the configured area. In this case, the broadcaster can only broadcast to listeners gathered at the event venue.

[0126] Furthermore, banners such as advertisements may be displayed on the display section of the listener's streaming device. In addition, these advertisements may be displayed on the viewing screen, or multiple advertisements may be displayed sequentially as the listener interacts with the viewing screen. Clicking on a displayed advertisement will transition to the advertisement-related page on the web, allowing for web browsing while listening. This allows for the provision of information of interest to the listener, in addition to the audio information of the event. Moreover, if advertisements related to the event the listener is attending are displayed, the listener's interest will increase, and the profitability of the advertisements will improve.

[0127] Furthermore, although the audio distribution system was implemented by multiple devices in the above embodiment, it may also be implemented as a single device. When the system is implemented by multiple devices, the components of the system may be distributed among the multiple devices in any way.

[0128] Furthermore, the method of communication between devices in the above embodiment is not particularly limited. In addition, relay devices (such as wireless routers) not shown may be involved in the communication between devices.

[0129] Furthermore, in the above embodiment, the processing performed by a specific processing unit may be performed by another processing unit. Also, the order of multiple processing units may be changed, or multiple processing units may be executed in parallel.

[0130] Furthermore, in the above embodiment, each component may be realized by executing a software program suitable for each component. Each component may also be realized by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory.

[0131] Furthermore, each component may be implemented by hardware. For example, each component may be a circuit (or integrated circuit). These circuits may form a single circuit as a whole, or they may be separate circuits. Also, each of these circuits may be a general-purpose circuit or a dedicated circuit.

[0132] Furthermore, general or specific embodiments of the present invention may be implemented as a system, apparatus, method, integrated circuit, computer program, or recording medium such as a computer-readable CD-ROM. Alternatively, they may be implemented as any combination of a system, apparatus, method, integrated circuit, computer program, and recording medium.

[0133] For example, the present invention may be implemented as a first information terminal, a second information terminal, an audio distribution device, or an audio distribution system. The present invention may be implemented as a method executed by a computer. The present invention may be implemented as a program (computer program product) for causing a computer to execute such a method. The present invention may be implemented as a computer-readable non-temporary recording medium on which such a program is recorded.

[0134] Furthermore, the present invention also includes forms obtained by applying various modifications to each embodiment that a person skilled in the art could conceive, or forms realized by arbitrarily combining the components and functions of each embodiment without departing from the spirit of the present invention. [Explanation of symbols]

[0135] 10. Audio distribution system 20 First Information Terminal 21, 31 Operation reception section 22, 32 Display section 22a Mute button 22b Predetermined area 22c Message Button 22d Recording button 23, 33, 42 Information Processing Unit 24, 34, 43 storage section 25, 35, 41 Communications Department 26, 36 Near Field Communication Department 27 Microphone 30. Second Information Terminal 32a Like button 32b Message button 37 Sound output part 38 Cameras 40 Audio distribution device 44 Acquisition Department 45 Distribution Department 46 Notification Department 47 Translation Department 50 Management terminals 60 Wide-area telecommunications networks

Claims

1. A communication unit that communicates with the first information terminal used by the first user and the second information terminal used by the second user participating in the live event via a wide-area communication network, An acquisition unit that, during the live event, communicates with the first information terminal using the communication unit to acquire audio information indicating the audio of the first user regarding the live event acquired by the first information terminal, The system includes a distribution unit that communicates with the second information terminal using the communication unit during the live event and distributes the acquired voice information to the second information terminal, It does not have a function to distribute audio information indicating voice acquired by the second information terminal to the first information terminal. Audio distribution device.

2. When a predetermined operation is performed on the first information terminal, the transmission of the voice information from the first information terminal to the communication unit is stopped. The audio distribution device according to claim 1.

3. Furthermore, the system includes a notification unit that communicates with the second information terminal using the communication unit when the transmission of the voice information is stopped, thereby notifying the second information terminal that it is in a muted state. The audio distribution device according to claim 2.

4. Furthermore, the system includes a notification unit that notifies the second information terminal that there is silence when it is determined that the audio level of the audio indicated by the acquired audio information is lower than a predetermined value. The audio distribution device according to claim 1.

5. The aforementioned communication unit further communicates with the management terminal used by the administrator via the aforementioned wide-area communication network. The acquisition unit further communicates with the management terminal using the communication unit to acquire customization instruction information from the management terminal for customizing the image displayed on the display unit of the second information terminal, which functions as a user interface for receiving the voice information distribution. The display unit displays an image customized based on the customization instruction information. The audio distribution device according to claim 1.

6. The acquisition unit further acquires the reaction information of the second user to the distribution of the voice information by communicating with the second information terminal using the communication unit during the live event. The distribution unit further communicates with the first information terminal using the communication unit during the live event, thereby transmitting the acquired reaction information to the first information terminal. The audio distribution device according to claim 1.

7. Furthermore, the system includes a translation unit that translates the audio information obtained from the first language into a second language and generates translated information that shows the translated information. The distribution unit communicates with the second information terminal using the communication unit during the live event, thereby distributing the generated translated information to the second information terminal. The audio distribution device according to claim 1.

8. The aforementioned audio distribution device allows the administrator to set the distribution range of the audio information using a management terminal. The audio distribution device according to claim 1.

9. A voice distribution device according to any one of claims 1 to 8, The first information terminal is provided, The first information terminal switches between a first mode in which it transmits the voice information to the voice distribution device and a second mode in which it transmits the voice information to the second information terminal via a local communication network. Audio distribution system.

10. The first information terminal switches between the first mode and the second mode based on the communication status between the first information terminal and the voice distribution device. The audio distribution system according to claim 9.

11. The first information terminal switches between the first mode and the second mode based on the operation of the first user on the first information terminal. The audio distribution system according to claim 9.

12. A voice distribution device according to any one of claims 1 to 8, The system includes the aforementioned second information terminal, The second information terminal accesses the audio distribution device by photographing a predetermined code with the camera provided on the second information terminal, or by manually entering a predetermined URL. Audio distribution system.

13. A method of audio distribution performed by a computer, The aforementioned computer can communicate with a first information terminal used by a first user and a second information terminal used by a second user participating in a live event, via a wide-area communication network. The aforementioned audio distribution method is The steps include: communicating with the first information terminal during the live event to obtain audio information indicating the audio of the first user regarding the live event acquired by the first information terminal; The step includes communicating with the second information terminal during the live event and distributing the acquired audio information to the second information terminal. Audio distribution method.

14. A program for causing the computer to execute the audio distribution method described in claim 13.

15. A communication unit that communicates with the first information terminal used by the first user and the second information terminal used by the second user participating in the live event via a wide-area communication network, During the live event, the acquisition unit communicates with the first information terminal using the communication unit, thereby acquiring audio information indicating the audio of the first user related to the live event acquired by the first information terminal, while not acquiring audio information from the second information terminal. The system includes a distribution unit that communicates with the second information terminal using the communication unit during the live event and distributes the acquired voice information to the second information terminal. Audio distribution device.

16. The first information terminal is used by the first user, and the second information terminal is used by the second user participating in the live event. A voice distribution system comprising a first information terminal and a voice distribution device capable of communicating with the second information terminal, The first information terminal is equipped with a microphone for acquiring the voice of the first user, The audio distribution device performs a process of acquiring audio information indicating the voice acquired by the microphone from the first information terminal and distributing it to the second information terminal. The second information terminal does not have a microphone for acquiring sound. Audio distribution system.

Images