Voice distribution device, voice distribution system, voice distribution method, and program

Abstract

This voice distribution device (40) comprises: a communication unit (41) that communicates with a first information terminal (20) used by a first user, and with a second information terminal (30) used by a second user participating in a live event, via a wide-area communication network (60); an acquisition unit (44) that communicates with the first information terminal (20) using a communication unit (41) while the live event is held, thereby acquiring voice information that indicates voice relating to the live event of the first user and is acquired by the first information terminal (20); and a distribution unit (45) that communicates with the second information terminal (30) using the communication unit (41) while the live event is held, thereby distributing the acquired voice information to the second information terminal (30).

Description

Voice distribution device, voice distribution system, voice distribution method, and program

[0001] The present invention relates to a voice distribution device, a voice distribution system, a voice distribution method, and a program.

[0002] In events such as travel, a service is provided in which terminals are lent to participants and guide voices are output from the terminals. In relation to such a service, Patent Document 1 discloses a guide service method that can fully respond to the needs of different travels for each customer without increasing the number of attendants or local guides, and can also provide one-on-one correspondence for each customer.

[0003] Japanese Patent Application Laid-Open No. 2002-83086

[0004] The present invention provides a voice distribution device or the like that can distribute the voice of a distributor to a listener in real time during the holding of an event such as travel.

[0005] A voice distribution device according to an aspect of the present invention includes a communication unit that communicates with a first information terminal used by a first user and a second information terminal used by a second user participating in a live event through a wide area communication network, and communicates with the first information terminal using the communication unit during the holding of the live event, and an acquisition unit that acquires voice information indicating the voice of the first user regarding the live event acquired by the first information terminal, and a distribution unit that distributes the acquired voice information to the second information terminal by communicating with the second information terminal using the communication unit during the holding of the live event.

[0006] A voice distribution system according to an aspect of the present invention includes the voice distribution device and the first information terminal, and the first information terminal switches between a first mode of transmitting the voice information to the voice distribution device and a second mode of transmitting the voice information to the second information terminal via a local communication network.

[0007] An audio distribution system according to one aspect of the present invention comprises the audio distribution device and the second information terminal, wherein the second information terminal accesses the audio distribution device by photographing a predetermined code with a camera provided in the second information terminal, or by manually entering a predetermined URL.

[0008] An audio distribution method according to one aspect of the present invention is an audio distribution method performed by a computer, wherein the computer can communicate with a first information terminal used by a first user and a second information terminal used by a second user participating in a live event via a wide-area communication network, and the audio distribution method includes the steps of: acquiring audio information indicating the audio of the first user related to the live event acquired by the first information terminal by communicating with the first information terminal during the live event; and distributing the acquired audio information to the second information terminal by communicating with the second information terminal during the live event.

[0009] A program according to one aspect of the present invention is a program for causing the computer to execute the audio distribution method.

[0010] According to the audio distribution device of the present invention, the audio of the broadcaster can be distributed to listeners in real time during events such as travel.

[0011] Figure 1 is a block diagram showing the configuration of an audio distribution system according to an embodiment. Figure 2 is a sequence diagram showing an example of the audio information distribution operation. Figure 3 is a diagram showing an example of the screen for the distributor. Figure 4 is a diagram showing an example of the screen for displaying a two-dimensional code. Figure 5 is a diagram showing an example of the screen for the listener. Figure 6 is a sequence diagram showing an example of the notification operation that the audio is muted. Figure 7 is a diagram showing an example of the screen for the listener while muted. Figure 8 is a sequence diagram showing an example of the notification operation that there is no sound. Figure 9 is a sequence diagram showing an example of the transmission operation of reaction information. Figure 10 is a sequence diagram showing an example of the distribution operation of translated audio information.

[0012] The embodiments will be described in detail below with reference to the drawings. Note that the embodiments described below are all comprehensive or specific examples. The numerical values, shapes, materials, components, arrangement positions and connection configurations of components, steps, and the order of steps shown in the following embodiments are examples only and are not intended to limit the present invention. Furthermore, components in the following embodiments that are not described in an independent claim will be described as optional components.

[0013] Please note that each figure is a schematic diagram and not necessarily a strictly accurate representation. Furthermore, in each figure, substantially identical components are denoted by the same reference numerals, and redundant explanations may be omitted or simplified.

[0014] (Embodiment) [Configuration] First, the configuration of the audio distribution system according to the embodiment will be described. Figure 1 is a block diagram showing the configuration of the audio distribution system according to the embodiment.

[0015] The audio distribution system 10 is a system that can distribute the audio (audio information) of a broadcaster to listeners during live events such as travel, sports events, or theatrical performances (hereinafter simply referred to as "events"). The broadcaster is a professional such as a tour guide, sports commentator, sports analyst, or announcer, and the listener is a general user. Rather than distributing pre-recorded, fixed audio, the audio distribution system 10 distributes the audio spoken by the broadcaster to the listener in real time, while the listener and broadcaster are participating in the same event.

[0016] In the audio distribution system 10, listeners receive the broadcaster's audio using a second information terminal 30, such as a smartphone, that they own. This has the advantage that event organizers do not need to prepare equipment for listeners.

[0017] The voice distribution system 10 specifically comprises a first information terminal 20, a second information terminal 30, a voice distribution device 40, and a management terminal 50. The voice distribution system 10 may have multiple second information terminals 30, in which case voice acquired by one first information terminal 20 can be simultaneously distributed to multiple second information terminals 30 (for example, several to about 30 second information terminals 30). For the sake of simplicity, the following will describe an example in which voice acquired by one first information terminal 20 is distributed to one second information terminal 30.

[0018] The first information terminal 20 is an information terminal used by the broadcaster, and primarily acquires the broadcaster's voice and transmits the acquired voice information to the voice broadcasting device 40. The first information terminal 20 is, for example, a portable information terminal such as a smartphone or tablet, but it may also be a personal computer. The first information terminal 20 includes an operation reception unit 21, a display unit 22, an information processing unit 23, a storage unit 24, a communication unit 25, a short-range communication unit 26, and a microphone 27.

[0019] The operation reception unit 21 receives input from the broadcaster. The operation reception unit 21 is, for example, an input device such as a touch panel, and receives tap operations from the broadcaster. The operation reception unit 21 may also be an input device such as a mouse or keyboard. In this case, the operation reception unit 21 receives click operations from the broadcaster.

[0020] The display unit 22 displays an image. The display unit 22 is implemented by a display panel such as a liquid crystal panel or an organic EL (Electroluminescence) panel.

[0021] The information processing unit 23 acquires the broadcaster's voice and performs information processing to transmit the acquired voice information to the voice distribution device 40. The information processing unit 23 is implemented by, for example, a microcomputer, but may also be implemented by a processor. The functions of the information processing unit 23 are realized, for example, by the microcomputer or processor constituting the information processing unit 23 executing a computer program stored in the storage unit 24.

[0022] The storage unit 24 is a storage device that stores computer programs executed by the information processing unit 23. The storage unit 24 is implemented by, for example, semiconductor memory, but may also be implemented by an HDD (Hard Disk Drive). The computer programs stored in the storage unit 24 include an application program (a dedicated application program for the voice distribution system 10; hereinafter also simply referred to as the dedicated app) for acquiring the voice of the broadcaster and transmitting the voice information of the acquired voice to the voice distribution device.

[0023] The communication unit 25 is a communication circuit (communication module) for the first information terminal 20 to communicate with the voice distribution device 40 via a wide-area communication network 60 such as the Internet. The communication unit 25 is, for example, a wireless communication circuit that performs wireless communication. The communication standard for the communication performed by the communication unit 25 is not particularly limited.

[0024] The short-range communication unit 26 is a communication circuit (communication module) for the first information terminal 20 to communicate with the second information terminal 30 via a local communication network. The short-range communication unit 26 is, for example, a wireless communication circuit that performs short-range wireless communication. The communication standard used by the short-range communication unit 26 is, but is not particularly limited, BLE (Bluetooth® Low Energy) or Wi-Fi®.

[0025] Microphone 27 acquires the broadcaster's voice. Specifically, microphone 27 is a MEMS (Micro Electro Mechanical Systems) microphone built into the first information terminal 20, but it may also be a microphone (such as a headset) connected to the external input terminal of the first information terminal 20.

[0026] The second information terminal 30 is an information terminal used by the listener to receive the broadcaster's audio. The second information terminal 30 is an information terminal personally owned by the listener. The second information terminal 30 is a portable information terminal such as a smartphone or tablet. The second information terminal 30 comprises an operation reception unit 31, a display unit 32, an information processing unit 33, a storage unit 34, a communication unit 35, a short-range communication unit 36, a sound output unit 37, and a camera 38.

[0027] The operation reception unit 31 receives input from the listener. The operation reception unit 31 is, for example, an input device such as a touch panel, and receives tap operations from the listener. Alternatively, the operation reception unit 31 may be another input device such as a touch panel, in which case it receives tap operations from the administrator.

[0028] The display unit 32 displays an image. The display unit 32 is implemented by a display panel such as a liquid crystal panel or an organic EL panel.

[0029] The information processing unit 33 performs information processing for playing back the audio (audio information) distributed by the audio distribution device 40. The information processing unit 33 is implemented by, for example, a microcomputer, but may also be implemented by a processor. The functions of the information processing unit 33 are realized, for example, by the microcomputer or processor constituting the information processing unit 33 executing a computer program stored in the storage unit 34.

[0030] The memory unit 34 is a storage device that stores computer programs and the like executed by the information processing unit 33. The memory unit 34 is implemented, for example, by semiconductor memory.

[0031] The communication unit 35 is a communication circuit (communication module) for the second information terminal 30 to communicate with the voice distribution device 40 via the wide-area communication network 60. The communication unit 35 is, for example, a wireless communication circuit for wireless communication, but it may also be a wired communication circuit for wired communication. There are no particular limitations on the communication standards used by the communication unit 35.

[0032] The short-range communication unit 36 ​​is a communication circuit (communication module) for the second information terminal 30 to communicate with the first information terminal 20 via a local communication network. The short-range communication unit 36 ​​is, for example, a wireless communication circuit that performs short-range wireless communication. The communication standard used by the short-range communication unit 36 ​​is, but is not particularly limited, BLE (Bluetooth® Low Energy) or Wi-Fi®.

[0033] The sound output unit 37 outputs sound based on the audio information distributed by the audio distribution device 40. The sound output unit 37 is, for example, the built-in speaker of the second information terminal 30, but it may also be an earphone (headphone) connected to an external output terminal, or an earphone (headphone) connected to the short-range communication unit 36.

[0034] Camera 38 captures still images and videos. Camera 38 is a built-in camera of the second information terminal 30, implemented, for example, by an image sensor and an optical system.

[0035] The voice distribution device 40 receives voice information from the first information terminal 20 and distributes the received voice information to the second information terminal 30. The voice distribution device 40 is implemented, for example, by a server device (cloud server). The voice distribution device 40 comprises a communication unit 41, an information processing unit 42, and a storage unit 43.

[0036] The communication unit 41 is a communication circuit (communication module) for the voice distribution device 40 to communicate with the first information terminal 20, the second information terminal 30, and the management terminal 50 via the wide-area communication network 60. The communication unit 41 is, for example, a wired communication circuit for wired communication, but it may also be a wireless communication circuit for wireless communication. There are no particular limitations on the communication standards used by the communication unit 41.

[0037] The information processing unit 42 receives voice information from the first information terminal 20 and performs information processing to distribute the received voice information to the second information terminal 30. The information processing unit 42 is implemented by, for example, a microcomputer, but may also be implemented by a processor. The information processing unit 42 includes, as functional components, an acquisition unit 44, a distribution unit 45, a notification unit 46, and a translation unit 47. The functions of the acquisition unit 44, the distribution unit 45, the notification unit 46, and the translation unit 47 are realized, for example, by the microcomputer or processor constituting the information processing unit 42 executing a computer program stored in the storage unit 43.

[0038] The memory unit 43 is a storage device that stores computer programs and the like executed by the information processing unit 42. The memory unit 43 is implemented by, for example, an HDD, but may also be implemented by a semiconductor memory.

[0039] The management terminal 50 is an information terminal used by the administrator, and primarily acquires the voice of the broadcaster and transmits the acquired voice information to the voice distribution device 40. The management terminal 50 is a portable information terminal such as a smartphone or tablet, but it may also be a stationary information terminal such as a personal computer. Although not shown in the figures, the management terminal 50 includes an operation reception unit, a display unit, an information processing unit, a storage unit, and a communication unit, similar to the first information terminal 20.

[0040] [Voice Information Distribution Operation] Next, the voice information distribution operation by the voice distribution system 10 will be described. Figure 2 is a sequence diagram showing an example of the voice information distribution operation.

[0041] The distributor and the listener are participating in the same event (such as a tour) and are located at a relatively close distance (the same space or location). The distributor performs a predetermined operation on the first information terminal 20 running the dedicated application, and the operation reception unit 21 receives the predetermined operation (S11). The information processing unit 23 displays a two-dimensional code such as a QR code (registered trademark) on the display unit 22 according to the received predetermined operation (for example, an operation of tapping an icon displayed on the distributor screen) (S12). FIG. 3 is a diagram showing an example of a distributor screen displayed on the first information terminal 20 running the dedicated application, and FIG. 4 is a diagram showing an example of a display screen of the two-dimensional code.

[0042] The listener performs a shooting operation for shooting the two-dimensional code with the camera 38 on the second information terminal 30 running the browser, and the operation reception unit 31 receives the shooting operation (S13). The information processing unit 33 shoots the two-dimensional code using the camera 38 according to the received shooting operation (S14), and accesses the URL indicated by the two-dimensional code (that is, the audio distribution device 40) using the communication unit 35.

[0043] As a result, a listener screen is displayed on the display unit 32 (S15). FIG. 5 is a diagram showing an example of the listener screen. The listener screen is an image displayed on the display unit 32 provided in the second information terminal 30, which functions as a user interface for receiving the distribution of audio information. Note that the second information terminal 30 can also access the above URL by shooting a two-dimensional code printed on paper or the like distributed to the listener. The second information terminal 30 can also access the audio distribution device 40 based on a manual input operation of the above URL (including a URL separately distributed by email or the like) of the listener. Note that when the first information terminal 20 accesses the audio distribution device 40 and displays the distributor screen (FIG. 3) on the display unit 22, a method of shooting a two-dimensional code may also be adopted.

[0044] In step S15, the audio distribution device 40 is in a state where it can communicate with each of the first information terminal 20 and the second information terminal 30, and is in a state where it can distribute the audio information acquired from the first information terminal 20 to the second information terminal 30.

[0045] When the microphone 27 of the first information terminal 20 acquires the voice of the distributor (S16), the information processing unit 23 transmits the voice information of the acquired voice to the voice distribution device 40 using the communication unit 25 (S17).

[0046] The communication unit 41 of the voice distribution device 40 receives the voice information, and the acquisition unit 44 acquires the voice information (S18). The voice of the distributor indicated by the voice information is a voice related to an event such as a sightseeing guide or a sports broadcast. That is, in step S18, the acquisition unit 44 communicates with the first information terminal 20 using the communication unit 41 during the event to acquire the voice information indicating the voice of the distributor related to the event acquired by the first information terminal 20.

[0047] The distribution unit 45 distributes the acquired voice information to the second information terminal 30 using the communication unit 41 (S19). That is, in step S19, the distribution unit 45 communicates with the second information terminal 30 using the communication unit 41 during the event to distribute the acquired voice information to the second information terminal 30.

[0048] The communication unit 35 of the second information terminal 30 receives the voice information. The information processing unit 33 outputs (plays back) the voice indicated by the received voice information using the sound output unit 37 (S20).

[0049] In this way, the voice distribution system 10 can distribute the voice of the distributor acquired by the first information terminal 20 to the second information terminal 30 in real time. Here, the real time is not in a strict sense, and a delay of about 0.1 second to several seconds may occur.

[0050] In the voice distribution system 10, the listener listens to the voice of the distributor using the second information terminal 30 such as a smartphone owned by the listener. As a result, the operator who holds the event has the advantage of not having to prepare equipment for the listener. In addition, the listener can start listening to the voice simply by running a browser on the second information terminal 30 and taking a picture of the two-dimensional code, which has the advantage of not taking the trouble of downloading an application program.

[0051] [Notification of muted audio] Next, we will explain the process by which the broadcaster notifies the listener that the audio has been muted. Figure 6 is a sequence diagram showing an example of the notification process for muted audio.

[0052] If the broadcaster wants to stop outputting audio information to the audio broadcasting device 40, they perform a mute operation, and the operation reception unit 21 of the first information terminal 20 receives the mute operation (S21). The mute operation is, for example, a tap operation on the mute button 22a on the broadcaster's screen (Figure 3).

[0053] The information processing unit 23 changes the display mode of the mute button 22a in response to the received mute operation (S22). The information processing unit 23 also stops the transmission of audio information (S23). When a mute operation (a predetermined operation) is performed on the first information terminal 20 in this way, the transmission of audio information from the first information terminal 20 to the audio distribution device 40 is stopped.

[0054] Next, the information processing unit 23 transmits mute notification information indicating that the first information terminal 20 is muted to the voice distribution device 40 using the communication unit 25 (S24).

[0055] The communication unit 41 of the audio distribution device 40 receives mute notification information. The notification unit 46 transmits the received mute notification information to the second information terminal 30 using the communication unit 41 (S25). In other words, when the transmission of audio information is stopped, the notification unit 46 communicates with the second information terminal 30 using the communication unit 41 to notify the second information terminal 30 that it is muted.

[0056] The communication unit 35 of the second information terminal 30 receives mute notification information. Based on the received mute notification information, the information processing unit 33 changes the display mode of the listener screen (Figure 5) (S26). Figure 7 shows an example of the listener screen when muted. When muted, the listener screen changes such as changing the word "LIVE" to "MUTE" and changing the background color of the text and images to gray. While the muted listener screen is displayed, background music may be output from the sound output unit 37.

[0057] In this way, the audio distribution system 10 can notify the second information terminal 30 (listener) that the first information terminal 20 is muted.

[0058] [Notification of Silence] Next, we will explain the operation of notifying the listener that there is no sound input to the microphone 27 of the first information terminal 20, resulting in a state of silence. Figure 8 is a sequence diagram showing an example of the notification operation for silence.

[0059] The communication unit 41 of the voice distribution device 40 receives voice information from the first information terminal 20 (S31), and the acquisition unit 44 acquires the voice information (S32). When the notification unit 46 determines that the voice level of the voice indicated by the voice information is lower than a predetermined value (S33), it transmits silence notification information to the second information terminal 30 using the communication unit 41 to notify that there is silence (S34). In other words, when the notification unit 46 determines that the voice level of the voice indicated by the acquired voice information is lower than a predetermined value, it notifies the second information terminal 30 that there is silence.

[0060] The communication unit 35 of the second information terminal 30 receives silent notification information. Based on the received silent notification information, the information processing unit 33 displays on the listener screen (Figure 5) that it is silent (S35).

[0061] In this way, the audio distribution system 10 can notify the second information terminal 30 (listener) that there is virtually no sound input to the microphone 27 of the first information terminal 20.

[0062] [Transmission of reaction information to voice] In the voice distribution system 10, voice information is distributed only from the first information terminal 20 to the second information terminal 30, and not from the second information terminal 30 to the first information terminal 20. In other words, the voice distribution device 40 does not distribute voice information indicating voice acquired by the second information terminal 30 to the first information terminal 20.

[0063] However, listeners can react to the broadcaster's audio by performing a predetermined operation on the listener screen (Figure 5) (sending reaction information to the first information terminal 20). The operation of sending reaction information will be explained below. Figure 9 is a sequence diagram showing an example of the operation of sending reaction information.

[0064] When the listener's screen (Figure 5) is displayed, the listener performs a reaction operation, and the operation reception unit 31 of the second information terminal 30 receives the reaction operation (S41). The reaction operation is, for example, a tap on the "Like" button 32a on the listener's screen (Figure 5).

[0065] The information processing unit 33 increments the number assigned to the "Like" button 32a (+1) in response to the received reaction operation (S42). The information processing unit 33 also transmits the reaction information to the voice distribution device 40 using the communication unit 35 (S43).

[0066] The communication unit 41 of the audio distribution device 40 receives reaction information. The acquisition unit 44 acquires the received reaction information (S44). In other words, the acquisition unit 44 acquires listener reaction information to the distribution of audio information by communicating with the second information terminal 30 using the communication unit 41 during the event.

[0067] Next, the distribution unit 45 transmits the received reaction information to the first information terminal 20 using the communication unit 41 (S45). In other words, the distribution unit 45 transmits the acquired reaction information to the first information terminal 20 by communicating with the first information terminal 20 using the communication unit 41 during the event.

[0068] The communication unit 35 of the second information terminal 30 receives reaction information. Based on the received reaction information, the information processing unit 33 counts up the number indicating the number of likes displayed in a predetermined area 22b of the broadcaster's screen (Figure 3) (S46).

[0069] In this way, listeners can react to the broadcaster's audio by performing predetermined operations on the listener screen (Figure 5).

[0070] In addition, listeners can send messages as reaction information to the broadcaster by tapping the message button 32b and entering a message (text). Tapping the message button 32b and entering a message is just one example of a reaction operation. When a message is sent, a badge is added to the message button 22c on the broadcaster's screen (Figure 3), and the broadcaster can confirm the message by tapping the message button 22c.

[0071] Please note that broadcasters cannot react to listeners (e.g., reply to messages).

[0072] [Voice Translation] The voice distribution system 10 can also translate voice information and distribute it to listeners. Figure 10 is a sequence diagram showing an example of the distribution operation of translated voice information (hereinafter also referred to as translated voice information). The translation function can be switched on and off by the listener's operation on the second information terminal 30.

[0073] When the broadcaster's voice is acquired by the microphone 27 of the first information terminal 20 (S51), the information processing unit 23 transmits the acquired voice information to the voice distribution device 40 using the communication unit 25 (S52).

[0074] The communication unit 41 of the audio distribution device 40 receives audio information, and the acquisition unit 44 acquires the audio information (S53). The translation unit 47 translates the audio indicated by the acquired audio information from the first language to the second language and generates translated audio information indicating the translated audio (S54). The language of the second language (the language to which the translation will take place) is set in advance, for example, by an operation on the listener's second information terminal 30.

[0075] In step S54, the translation unit 47 may generate the translated audio information by requesting translation from a device other than the audio distribution device 40. The translation unit 47 may also generate the translated audio information by using the communication unit 41 to send audio information to a translation server (a cloud server specializing in audio translation) or a generation AI server (not shown), and receiving the translated audio information from the translation server or generation AI server.

[0076] The distribution unit 45 distributes the acquired translated audio information to the second information terminal 30 using the communication unit 41 (S55). In other words, in step S55, the distribution unit 45 distributes the generated translated audio information to the second information terminal 30 by communicating with the second information terminal 30 using the communication unit 41 during the event.

[0077] The communication unit 35 of the second information terminal 30 receives the translated audio information. The information processing unit 33 outputs (plays back) the translated audio indicated by the received translated audio information using the sound output unit 37 (S56).

[0078] In this way, the audio distribution system 10 can translate audio information and distribute it to listeners. Furthermore, the text displayed on the listener's screen (Figure 5) can also be changed to a different language.

[0079] [Switching of Communication Networks] The first information terminal 20 may switch between a first mode in which it transmits voice information to the voice distribution device 40 using the communication unit 25, and a second mode in which it transmits voice information to the second information terminal 30 using the short-range communication unit 26. In other words, the first information terminal 20 may switch between a first mode in which it distributes voice information to the second information terminal 30 via the wide-area communication network 60, and a second mode in which it distributes voice information to the second information terminal 30 via the local communication network.

[0080] For example, the information processing unit 23 of the first information terminal 20 may determine that the communication state with the voice distribution device 40 has deteriorated if the voice distribution device 40's response to the voice information is interrupted while the first information is being distributed in the first mode, and may switch from the first mode to the second mode.

[0081] Furthermore, the information processing unit 23 of the first information terminal 20 may attempt to communicate with the voice distribution device 40 when distributing voice information in the second mode. If the communication is successful, it may determine that the communication status with the voice distribution device 40 has improved and switch from the second mode to the first mode.

[0082] With this type of switching, the first information terminal 20 can continue distributing voice information by distributing it via the local communication network when it moves to a location where it cannot connect to the wide-area communication network 60, such as a cave or mountainous area during a tour.

[0083] The switching of the communication network (switching between the first mode and the second mode) may be performed manually based on the operator's actions to the first information terminal 20.

[0084] [Customizing the Listener Screen] The administrator can customize (edit or design) the listener screen (Figure 5) using the management terminal 50. The administrator customizes the listener screen by operating the management terminal 50 and performs operations to reflect the customizations on the listener screen. Upon receiving the operation, the management terminal 50 transmits the customization instruction information to the audio distribution device 40.

[0085] The acquisition unit 44 of the audio distribution device 40 communicates with the management terminal 50 using the communication unit 41 to acquire customization instruction information from the management terminal 50, and reflects the customization content on the listener screen based on the acquired customization instruction information. As a result, the display unit 32 of the second information terminal 30 displays an image customized based on the customization instruction information.

[0086] This customization feature allows administrators to customize the viewer screen (Figure 5) according to their business type (provision of travel services, management of sports teams, and event management). Administrators can also customize the broadcaster screen (Figure 3).

[0087] [Archive Function] The broadcaster's screen displayed on the first information terminal 20 is provided with a recording button 22d. When a broadcaster taps the recording button 22d, the audio information is recorded in the storage unit 43 of the audio broadcasting device 40. The administrator can download the recorded audio information using the management terminal 50. For example, the administrator can provide the recorded audio information to other broadcasters with less experience to provide them with training.

[0088] Furthermore, the information processing unit 42 of the audio distribution device 40 records the changes in the number of listeners over time and the changes in the number of "likes" over time as log information in the storage unit 43 from the time the distribution of audio information starts until the distribution ends. The recording of log information is performed automatically and no special operation is required.

[0089] The administrator can access log information using the management terminal 50 to understand the changes in the number of listeners and the changes in the number of likes over time.

[0090] [Effects, etc.] The following describes examples of inventions that can be obtained from the disclosures of this specification, and explains the effects, etc. that can be obtained from the examples of inventions.

[0091] Invention 1 is an audio distribution device 40 comprising: a communication unit 41 that communicates with a first information terminal 20 used by a first user and a second information terminal 30 used by a second user participating in a live event via a wide-area communication network 60; an acquisition unit 44 that acquires audio information indicating the audio of the first user related to the live event acquired by the first information terminal 20 by communicating with the first information terminal 20 using the communication unit 41 during the live event; and a distribution unit 45 that distributes the acquired audio information to the second information terminal 30 by communicating with the second information terminal 30 using the communication unit 41 during the live event. The distributor in the above embodiment is an example of a first user, and the listener in the above embodiment is an example of a second user.

[0092] Such an audio distribution device 40 can distribute the audio of a first user to a second user in real time during events such as travel.

[0093] Invention 2 is an audio distribution device 40 of Invention 1, wherein when a predetermined operation is performed on the first information terminal 20, the transmission of audio information from the first information terminal 20 to the communication unit 41 is stopped.

[0094] Such an audio distribution device 40 can stop transmitting audio information from the first information terminal 20 to the communication unit 41.

[0095] Invention 3 is an audio distribution device 40 of Invention 2, further comprising a notification unit 46 that notifies the second information terminal 30 that it is muted by communicating with the second information terminal 30 using a communication unit 41 when the transmission of audio information is stopped.

[0096] Such an audio distribution device 40 can notify the second information terminal 30 that the first information terminal 20 is muted.

[0097] Invention 4 is an audio distribution device 40 according to any of Inventions 1 to 3, further comprising a notification unit 46 that notifies the second information terminal 30 that there is silence when it is determined that the audio level of the audio indicated by the acquired audio information is lower than a predetermined value.

[0098] Such an audio distribution device 40 can notify the second information terminal 30 that the first information terminal 20 is silent.

[0099] Invention 5 is an audio distribution device 40 according to any of Inventions 1 to 4, wherein the communication unit 41 further communicates with a management terminal 50 used by an administrator via a wide-area communication network 60, and the acquisition unit 44 further communicates with the management terminal 50 using the communication unit 41 to acquire customization instruction information from the management terminal 50 for customizing the image displayed on the display unit 32 of a second information terminal 30 which functions as a user interface for receiving audio distribution, and the display unit 32 displays an image customized based on the customization instruction information. The listener screen in the above embodiment is an example of such an image.

[0100] Such an audio distribution device 40 allows for customization of the viewer's screen.

[0101] Invention 6 is an audio distribution device 40 according to any of Inventions 1 to 5, wherein the audio distribution device 40 does not distribute audio information indicating voice acquired by the second information terminal 30 to the first information terminal 20.

[0102] By restricting audio distribution to one direction, such an audio distribution device 40 can reduce the amount of information required for communication and minimize communication delays compared to cases where audio distribution is bidirectional.

[0103] Invention 7 is an audio distribution device 40 according to any of Inventions 1 to 6, wherein the acquisition unit 44 further acquires reaction information of a second user to the distribution of audio information by communicating with a second information terminal 30 using a communication unit 41 during the live event, and the distribution unit 45 further transmits the acquired reaction information to the first information terminal 20 by communicating with a first information terminal 20 using a communication unit 41 during the live event.

[0104] Such an audio distribution device 40 can convey the reaction of a second user to the first user.

[0105] Invention 8 is an audio distribution device 40 according to any of Inventions 1 to 7, further comprising a translation unit 47 that translates the audio indicated by the acquired audio information from a first language to a second language and generates translated information indicating the translated information, and a distribution unit 45 that communicates with a second information terminal 30 using a communication unit 41 during the live event and distributes the generated translated information to the second information terminal 30.

[0106] Such an audio distribution device 40 can translate the voice of the first user and distribute it to the second user.

[0107] Invention 9 is an audio distribution device 40 according to any of Inventions 1 to 8, wherein the audio distribution device 40 can set the distribution range of audio information using a management terminal 50 used by an administrator.

[0108] Such an audio distribution device 40 can distribute audio information only to listeners gathered at the event venue.

[0109] Invention 10 is a voice distribution system 10 comprising a voice distribution device 40 according to any of Inventions 1 to 9 and a first information terminal 20, wherein the first information terminal 20 switches between a first mode in which voice information is transmitted to the voice distribution device 40 and a second mode in which voice information is transmitted to a second information terminal 30 via a local communication network.

[0110] Such an audio distribution device 40 can switch the communication network used for distributing audio information.

[0111] Invention 11 is an audio distribution system 10 of Invention 9, wherein the first information terminal 20 switches between a first mode and a second mode based on the communication status between the first information terminal 20 and the audio distribution device 40.

[0112] Such an audio distribution device 40 can switch the communication network used for distributing audio information based on the communication status between the first information terminal 20 and the audio distribution device 40.

[0113] Invention 12 is an audio distribution system 10 of Invention 9, wherein the first information terminal 20 switches between a first mode and a second mode based on the operation of a first user to the first information terminal 20.

[0114] Such an audio distribution device 40 can switch the communication network used for distributing audio information based on the operation of the first user.

[0115] Invention 13 is an audio distribution system 10 comprising an audio distribution device 40 described in any one of claims 1 to 9 and a second information terminal 30, wherein the second information terminal 30 accesses the audio distribution device 40 by photographing a predetermined code with a camera 38 provided on the second information terminal 30, or by manually entering a predetermined URL.

[0116] Such an audio distribution device 40 can easily link a first information terminal 20, which is the source of the audio information, with a second information terminal 30, which is the destination of the audio information, by reading a predetermined code or manually entering a predetermined URL.

[0117] Invention 14 is a voice distribution method performed by a computer, wherein the computer can communicate with a first information terminal 20 used by a first user and a second information terminal 30 used by a second user participating in a live event via a wide-area communication network 60, and the voice distribution method includes the steps of: acquiring voice information indicating the audio of the first user's live event acquired by the first information terminal 20 by communicating with the first information terminal 20 during the live event; and distributing the acquired voice information to the second information terminal 30 by communicating with the second information terminal 30 during the live event.

[0118] This type of audio distribution method allows for the real-time transmission of the first user's audio to a second user during events such as travel.

[0119] Invention 15 is a program for causing a computer to execute the audio distribution method of Invention 14.

[0120] With such a program, a computer can deliver the voice of a first user to a second user in real time during events such as travel.

[0121] (Other Embodiments) Although embodiments have been described above, the present invention is not limited to the embodiments described above.

[0122] For example, in the above embodiment, it was explained that audio information is delivered when the broadcaster and listener are participating in the same event and are located at a relatively close distance (same space or location). However, the broadcaster may be located in a remote location and may not be directly participating in the event, but rather participating indirectly.

[0123] Furthermore, if the listener moves a certain distance away from the broadcaster, the location of the broadcaster's first information terminal may be notified to the listener's second information terminal. For example, during a travel event, if a passenger who is the listener moves too far away from the guide who is the broadcaster, this can be used to return to the broadcaster's (guide's) location. The location of the first information terminal is measured by a location measurement unit, such as a GPS (Global Positioning System) module installed in the first information terminal, and notified to the second information terminal via the audio broadcasting device.

[0124] Furthermore, the broadcaster's first information terminal may be configured to detect the location of the listener's second information terminal (and notify the first information terminal of the second information terminal's location). For example, this would make it easy to locate a listener (passenger) who has gotten lost during a travel event.

[0125] Furthermore, the distribution of audio information by the broadcaster may be restricted by distance. For example, the administrator can specify the location of the event venue (the place to broadcast) on a map displayed on the management terminal (by placing a pin, for example), and configure the audio broadcasting device so that audio information is distributed only to second information terminals located within a radius of Xm from the specified location. The audio broadcasting device 40 distributes audio information to the second information terminal, provided that the second information terminal is located within the configured area. In this case, the broadcaster can only broadcast to listeners gathered at the event venue.

[0126] Furthermore, banners such as advertisements may be displayed on the display section of the listener's streaming device. In addition, these advertisements may be displayed on the viewing screen, or multiple advertisements may be displayed sequentially as the listener interacts with the viewing screen. Clicking on a displayed advertisement will transition to the advertisement-related page on the web, allowing the listener to browse the web while listening. This allows for the provision of information of interest to the listener, in addition to the audio information of the event. Moreover, if advertisements related to the event the listener is attending are displayed, the listener's interest will increase, and the profitability of the advertisements will improve.

[0127] Furthermore, although the audio distribution system was implemented by multiple devices in the above embodiment, it may also be implemented as a single device. When the system is implemented by multiple devices, the components of the system may be distributed among the multiple devices in any way.

[0128] Furthermore, the method of communication between devices in the above embodiment is not particularly limited. In addition, relay devices (such as wireless routers) not shown may be involved in the communication between devices.

[0129] Furthermore, in the above embodiment, the processing performed by a specific processing unit may be performed by another processing unit. Also, the order of multiple processing units may be changed, or multiple processing units may be executed in parallel.

[0130] Furthermore, in the above embodiment, each component may be realized by executing a software program suitable for each component. Each component may also be realized by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory.

[0131] Furthermore, each component may be implemented by hardware. For example, each component may be a circuit (or integrated circuit). These circuits may form a single circuit as a whole, or they may be separate circuits. Also, each of these circuits may be a general-purpose circuit or a dedicated circuit.

[0132] Furthermore, general or specific embodiments of the present invention may be implemented as a system, apparatus, method, integrated circuit, computer program, or recording medium such as a computer-readable CD-ROM. Alternatively, they may be implemented as any combination of a system, apparatus, method, integrated circuit, computer program, and recording medium.

[0133] For example, the present invention may be implemented as a first information terminal, a second information terminal, an audio distribution device, or an audio distribution system. The present invention may be implemented as a method executed by a computer. The present invention may be implemented as a program (computer program product) for causing a computer to execute such a method. The present invention may be implemented as a computer-readable non-temporary recording medium on which such a program is recorded.

[0134] Furthermore, the present invention also includes forms obtained by applying various modifications to each embodiment that a person skilled in the art could conceive, or forms realized by arbitrarily combining the components and functions of each embodiment without departing from the spirit of the present invention.

[0135] 10 Voice distribution system 20 First information terminal 21, 31 Operation reception unit 22, 32 Display unit 22a Mute button 22b Designated area 22c Message button 22d Record button 23, 33, 42 Information processing unit 24, 34, 43 Storage unit 25, 35, 41 Communication unit 26, 36 Short-range communication unit 27 Microphone 30 Second information terminal 32a Like button 32b Message button 37 Sound output unit 38 Camera 40 Voice distribution device 44 Acquisition unit 45 Distribution unit 46 Notification unit 47 Translation unit 50 Management terminal 60 Wide-area communication network

Claims

1. A voice distribution device comprising: a communication unit that communicates with a first information terminal used by a first user and a second information terminal used by a second user participating in a live event via a wide-area communication network; an acquisition unit that acquires voice information indicating the first user's voice related to the live event acquired by the first information terminal by communicating with the first information terminal using the communication unit during the live event; and a distribution unit that distributes the acquired voice information to the second information terminal by communicating with the second information terminal using the communication unit during the live event.

2. The voice distribution device according to claim 1, wherein when a predetermined operation is performed on the first information terminal, the transmission of the voice information from the first information terminal to the communication unit is stopped.

3. The voice distribution device according to claim 2, further comprising a notification unit that notifies the second information terminal that it is muted by communicating with the second information terminal using the communication unit when the transmission of the voice information is stopped.

4. The audio distribution device according to claim 1, further comprising a notification unit that notifies the second information terminal that there is silence when it is determined that the audio level of the audio indicated by the acquired audio information is lower than a predetermined value.

5. The audio distribution device according to claim 1, wherein the communication unit further communicates with a management terminal used by an administrator via the wide-area communication network, and the acquisition unit further communicates with the management terminal using the communication unit to acquire customization instruction information from the management terminal for customizing the image displayed on the display unit of the second information terminal which functions as a user interface for receiving the distribution of the audio information, and the display unit displays an image customized based on the customization instruction information.

6. The voice distribution device according to claim 1, wherein the voice distribution device does not distribute voice information indicating voice acquired by the second information terminal to the first information terminal.

7. The voice distribution device according to claim 1, wherein the acquisition unit further acquires reaction information of the second user to the distribution of voice information by communicating with the second information terminal using the communication unit during the live event, and the distribution unit further transmits the acquired reaction information to the first information terminal by communicating with the first information terminal using the communication unit during the live event.

8. The audio distribution device according to claim 1, further comprising a translation unit that translates the audio indicated by the acquired audio information from a first language to a second language and generates translated information indicating the translated information, wherein the distribution unit communicates with the second information terminal using the communication unit during the live event and distributes the generated translated information to the second information terminal.

9. The voice distribution device according to claim 1, wherein the voice distribution device is capable of setting the distribution range of the voice information using a management terminal used by an administrator.

10. A voice distribution system comprising a voice distribution device according to any one of claims 1 to 9 and a first information terminal, wherein the first information terminal switches between a first mode of transmitting the voice information to the voice distribution device and a second mode of transmitting the voice information to a second information terminal via a local communication network.

11. The voice distribution system according to claim 10, wherein the first information terminal switches between the first mode and the second mode based on the communication status between the first information terminal and the voice distribution device.

12. The voice distribution system according to claim 10, wherein the first information terminal switches between the first mode and the second mode based on the operation of the first user to the first information terminal.

13. An audio distribution system comprising an audio distribution device according to any one of claims 1 to 9 and a second information terminal, wherein the second information terminal accesses the audio distribution device by photographing a predetermined code with a camera provided on the second information terminal, or by manually entering a predetermined URL.

14. A method for distributing audio by a computer, wherein the computer can communicate with a first information terminal used by a first user and a second information terminal used by a second user participating in a live event via a wide-area communication network, and the method for distributing audio by communicating with the first information terminal during the live event, thereby acquiring audio information indicating audio of the first user related to the live event acquired by the first information terminal, and distributing the acquired audio information to the second information terminal during the live event.

15. A program for causing the computer to execute the audio distribution method described in claim 14.

Images