Control system operation method, control system and program

Abstract

To encourage users to visit the venue where the event is held.SOLUTION: A control system is provided with a determination unit 412 that determines whether a terminal device is located at the venue where the event is held, and a distribution unit 413 for distributing an event-related content Ca to the terminal device in parallel with the progress of the event if the result of the determination is affirmative.SELECTED DRAWING: Figure 4

Description

Technical Field

[0004] ,

[0006] , , , ,

[0005] , , , , , ,

[0001] The present disclosure relates to a technology for delivering content to a terminal device.

Background Art

[0002] For example, a technology for delivering content that records various events such as sports events or music events to a terminal device in parallel with the progress of the event has been conventionally proposed. For example, Patent Document 1 discloses a technology for delivering digital data including video and audio to a terminal device.

Prior Art Documents

Patent Documents

[0003] [[ID=2,]]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] With the spread of technology for delivering content of an event to a terminal device located remotely from the venue where the event is held, the number of users actually visiting the venue may decrease. In view of the above circumstances, one aspect of the present disclosure aims to promote the visit of users at the venue where the event is held.

Means for Solving the Problems

[0005] In order to solve the above problems, an operation method of a control system according to one aspect of the present disclosure determines whether a terminal device is located at a venue where an event is held, and when the result of the determination is affirmative, delivers first content related to the event to the terminal device in parallel with the progress of the event.

[0006] A control system according to one aspect of the present disclosure comprises a determination unit that determines whether or not a terminal device is located at the venue where an event is being held, and a distribution unit that, if the result of the determination is affirmative, distributes first content related to the event to the terminal device in parallel with the progress of the event.

[0007] A program according to one aspect of the present disclosure causes a computer system to function as a determination unit that determines whether or not a terminal device is located at the venue where an event is being held, and a distribution unit that, if the result of the determination is affirmative, distributes first content related to the event to the terminal device in parallel with the progress of the event. [Brief explanation of the drawing]

[0008] [Figure 1] This is a block diagram illustrating the configuration of an information system according to the first embodiment. [Figure 2] This is a block diagram illustrating the configuration of the recording system. [Figure 3] This is a block diagram illustrating the configuration of a control system. [Figure 4] This is a block diagram illustrating the functional configuration of a control system. [Figure 5] This is a flowchart illustrating the steps of the control process. [Figure 6] This is a flowchart illustrating the steps of the generation process. [Figure 7] This is a flowchart illustrating the steps of the generation process in the second embodiment. [Figure 8] This is a flowchart illustrating the steps of the generation process in the third embodiment. [Figure 9] This is a block diagram illustrating the functional configuration of the control system in the fourth embodiment. [Modes for carrying out the invention]

[0009] A: First Embodiment Figure 1 is a block diagram illustrating the configuration of an information system 100 according to the first embodiment. The information system 100 is a computer system that provides content C(Ca,Cb) to a terminal device 50 and a playback device 60. The information system 100 communicates with each of the terminal device 50 and playback device 60 via a communication network 200, such as the Internet. In reality, the information system 100 communicates with multiple terminal devices 50 and multiple playback devices 60, but for convenience, the following explanation will focus on one terminal device 50 and one playback device 60.

[0010] User Ua in Figure 1 uses a terminal device 50. The terminal device 50 is a portable information device such as a mobile phone, smartphone, tablet, or personal computer. The terminal device 50 communicates with the communication network 200, for example, wirelessly. User Ua can bring the terminal device 50 to the venue 300. The venue 300 is a facility where various events are held. In the first embodiment, the venue 300 is a stadium or gymnasium where an event in which multiple participants compete in a specific sport (hereinafter referred to as "competition event") is held. User Ua, who has come to the venue 300, watches the competition event within the venue 300.

[0011] The terminal device 50 is equipped with a playback device 51. The playback device 51 is a video device that plays back content Ca. Content Ca includes audio (hereinafter referred to as "commentary audio") that explains the situation of the competition event held in the venue 300. The playback device 51 of the first embodiment is equipped with a display device 52 that displays video and a sound emitter 53 that reproduces sound. The commentary audio represented by content Ca is emitted by the sound emitter 53. Note that content Ca is an example of "first content".

[0012] In Figure 1, user Ub uses the playback device 60 outside the venue 300. For example, user Ub is located at a location far from the venue 300 (e.g., their home or a foreign country). The playback device 60 plays content Cb. Content Cb is video and audio representing the situation of a competition event held inside the venue 300. Specifically, the playback device 60 comprises a display device 61 that displays the video of content Cb and a sound output device 62 that plays the sound of content Cb. For example, a television receiver can be used as the playback device 60. Alternatively, an information device such as a smartphone or tablet terminal may be used as the playback device 60. A large video display (public viewing) that can be viewed by many users Ub may also be used as the playback device 60. Note that content Cb may also be information consisting only of audio (e.g., a radio program). Content Cb is an example of "second content".

[0013] As can be understood from the above explanation, User Ua is a spectator who directly watches the competition event inside venue 300, while User Ub is a viewer who watches the competition event outside venue 300 through content Cb played by playback device 60.

[0014] The information system 100 comprises a recording system 10, a recording system 20, a distribution system 30, and a control system 40. The recording system 10 and the recording system 20 are installed within the venue 300. Any two or more elements of the information system 100 may be configured as a single unit. For example, the recording system 20 may be configured as part of the recording system 10. For example, the distribution system 30 and the control system 40 may be configured as separate devices. Also, any one or more elements of the information system 100 may be excluded from the elements of the information system 100. For example, the information system 100 may consist of the recording system 20 and the control system 40.

[0015] The recording system 10 generates recording data X by recording the competition event. Recording data X includes video data X1 and audio data X2. Video data X1 is data representing video images captured within the venue 300. For example, video data X1 represents video images of the competition at the event. Audio data X2 is data representing sound captured within the venue 300. For example, audio data X2 represents various sounds such as voices spoken by participants or judges in the competition event, sounds produced by competition actions, and cheers from spectators in the venue 300. Specifically, the recording system 10 comprises an imaging device that generates video data X1 and a sound capture device that generates audio data X2 (not shown). Recording by the recording system 10 is performed in parallel with the progress of the competition event. Recording data X is transmitted to the distribution system 30.

[0016] The recording system 20 is sound equipment installed in the broadcasting room within the venue 300. The recording system 20 of the first embodiment generates audio data Y. Audio data Y is recording data recorded in parallel with the progress of the competition event. The audio data Y of the first embodiment represents commentary spoken by commentator Uc. Commentator Uc is located in the broadcasting room within the venue 300 from which the competition event can be viewed, and provides oral commentary on the situation of the competition event in parallel with its progress. In other words, the audio data Y of the first embodiment represents audio related to the competition event. The audio data Y is transmitted to the distribution system 30 and the control system 40. Note that the audio represented by audio data Y is not limited to the commentary audio exemplified above. For example, the recording system 20 may generate audio data Y representing guidance audio for guiding visitors within the venue 300, or audio data Y representing broadcast audio for informing visitors in the venue 300 of an emergency such as an earthquake.

[0017] FIG. 2 is a block diagram illustrating the configuration of the recording system 20. As illustrated in FIG. 2, the recording system 20 includes a sound collection device 21, an acoustic device 22, and a communication device 23. The sound collection device 21 is a microphone that generates an acoustic signal Y0 by collecting ambient sound. The acoustic device 22 is a mixer that generates voice data Y by adjusting the acoustic characteristics of the acoustic signal Y0. The communication device 23 transmits the voice data Y to the distribution system 30 and the control system 40.

[0018] The distribution system 30 in FIG. 1 distributes content Cb corresponding to the recorded data X and the voice data Y to the playback device 60. For the distribution of content Cb by the distribution system 30, technologies such as streaming distribution are used. Specifically, the distribution system 30 generates the sound of content Cb by mixing the sound represented by the acoustic data X2 of the recorded data X and the sound represented by the voice data Y, and generates content Cb including the video data X1 of the recorded data X and the acoustic data of the mixed sound. The method by which the distribution system 30 distributes content Cb to the playback device 60 is arbitrary. For example, in addition to Internet broadcasting using the communication network 200, television broadcasting such as terrestrial broadcasting or satellite broadcasting is used for the distribution of content Cb.

[0019] The distribution system 30 distributes (i.e., live-distributes) content Cb in parallel with the progress of the competition event. The playback device 60 plays back the content Cb received from the distribution system 30 in parallel with the progress of the competition event. The user Ub can grasp the situation of the competition event by watching the content Cb played back by the playback device 60. Specifically, the user Ub watches the video and sound represented by the recorded data X and listens to the commentary voice represented by the voice data Y.

[0020] The control system 40 distributes content Ca related to the competition event to the terminal device 50. For the distribution of content Ca by the control system 40, technologies such as streaming distribution are used. Content Ca corresponds to audio data Y. In the first embodiment, the control system 40 distributes audio data Y as content Ca to the terminal device 50. The control system 40 distributes content Ca to the terminal device 50 in parallel with the progress of the competition event. The terminal device 50 plays the content Ca received from the control system 40 in parallel with the progress of the competition event. Specifically, the commentary audio represented by content Ca is emitted from the sound emitter 53. Therefore, user Ua can listen to the commentary audio of commentator Uc while watching the competition event in the venue 300. As can be understood from the above explanation, in the first embodiment, audio data Y is used for both the generation of content Ca and the generation of content Cb. Therefore, the load of generating content C is reduced compared to a configuration in which content Ca and content Cb are generated individually.

[0021] Incidentally, there is a difference in delivery delay between the distribution of content Ca by the control system 40 and the distribution of content Cb by the distribution system 30. The delivery delay is the delay in the playback of content C(Ca,Cb) relative to the progress of the competition event. The delivery delay is the length of time from when commentator Uc starts speaking commentary audio during the competition event until when terminal device 50 or playback device 60 starts playing the commentary audio.

[0022] For the distribution of content Cb by the distribution system 30, it is required to maintain a high level of playback quality. Therefore, it is a priority to avoid problems such as interruption of distribution or a decrease in distribution speed by ensuring a sufficient buffer for temporarily storing content Cb. On the other hand, for the distribution of content Ca by the control system 40, distribution speed takes precedence over playback quality. Also, while content Cb includes video in addition to audio, content Ca consists only of commentary audio. Due to the circumstances illustrated above, in the first embodiment, the distribution delay of content Ca to the terminal device 50 is smaller than the distribution delay of content Cb to the playback device 60.

[0023] As described above, the distribution of content Cb by the distribution system 30 is accompanied by a relatively large distribution delay. Therefore, when content Cb is distributed to the terminal device 50 in the venue 300, content Cb is played with a delay relative to the progress of the competition event that the user Ua is actually watching. In contrast to the above case, in the first embodiment, content Ca is distributed to the terminal device 50 with a distribution delay smaller than that of content Cb. Therefore, the terminal device 50 can play content Ca in an environment with a smaller distribution delay compared to when the terminal device 50 in the venue 300 plays content Cb. In other words, the user Ua in the venue 300 can listen to the commentary audio without an excessive delay relative to the progress of the competition event. Furthermore, since the audio data Y in content Cb is delayed to the same extent as the recorded data X, the delay of the commentary audio in content Cb does not pose a particular problem for the user Ub.

[0024] Figure 3 is a block diagram illustrating the configuration of the control system 40. The control system 40 comprises a control device 41, a storage device 42, and a communication device 43. The control system 40 can be implemented as a single device or as multiple devices configured separately from each other.

[0025] The control device 41 consists of one or more processors that control each element of the control system 40. For example, the control device 41 consists of one or more types of processors such as a CPU (Central Processing Unit), SPU (Sound Processing Unit), DSP (Digital Signal Processor), FPGA (Field Programmable Gate Array), or ASIC (Application Specific Integrated Circuit).

[0026] The storage device 42 is one or more memories that store programs executed by the control device 41 and various data used by the control device 41. The storage device 42 is composed of known recording media such as magnetic recording media or semiconductor recording media. The storage device 42 may be composed of a combination of multiple types of recording media. Alternatively, a portable recording media that can be attached to and detached from the control system 40, or a recording media that the control system 40 can write to and read via the communication network 200 (e.g., cloud storage), may be used as the storage device 42.

[0027] The communication device 43 communicates with the recording system 20 and the terminal device 50 via the communication network 200 under the control of the control device 41. Specifically, the communication device 43 receives audio data Y transmitted from the recording system 20. The communication device 43 also distributes content Ca corresponding to the audio data Y to the terminal device 50.

[0028] Figure 4 is a block diagram illustrating the functional configuration of the control system 40. As illustrated in Figure 4, the control device 41 executes a program stored in the storage device 42 to realize multiple functions (generation unit 411, determination unit 412, and distribution unit 413) for distributing content Ca corresponding to audio data Y to the terminal device 50.

[0029] The generation unit 411 generates content Ca corresponding to the audio data Y. In the first embodiment, the generation unit 411 receives the audio data Y transmitted from the recording system 20 via the communication device 43 and stores the audio data Y as content Ca in the storage device 42.

[0030] The determination unit 412 determines whether the terminal device 50 is located at the venue 300 where the competition event is being held. As illustrated in Figure 4, the determination unit 412 receives a distribution request R transmitted from the terminal device 50 via the communication device 43. The distribution request R is transmitted from the terminal device 50 to the control system 40 in response to instructions from the user Ua. The distribution request R includes location information representing the location of the terminal device 50 and identification information for identifying the terminal device 50. The terminal device 50 generates location information using, for example, a GPS (Global Positioning System) or an IP (Internet Protocol) address. The storage device 42 also stores a predetermined range on the map that includes the venue 300 (hereinafter referred to as the "reference range"). The determination unit 412 determines whether the terminal device 50 is located at the venue 300 depending on whether the location of the terminal device 50 indicated by the location information is included in the reference range.

[0031] The distribution unit 413 distributes content Ca to the terminal device 50 via the communication device 43. As described above, the distribution of content Ca is performed in parallel with the progress of the competition event. As explained above, content Ca corresponding to the recorded audio data Y is distributed to the terminal device 50 in parallel with the progress of the competition event. Therefore, content Ca that appropriately reflects the progress of the competition event can be distributed to the terminal device 50.

[0032] In the first embodiment, the distribution unit 413 distributes content Ca to the terminal device 50 if the determination result by the determination unit 412 is positive. That is, the distribution unit 413 distributes content Ca only to terminal devices 50 located within the venue 300, and does not distribute content Ca to terminal devices 50 located outside the venue 300.

[0033] Figure 5 is a flowchart illustrating the detailed procedure of the process performed by the control device 41 (hereinafter referred to as "control process"). The control process is initiated by instructions from the organizers of the competition event and continues in parallel with the progress of the competition event. The recording system 20 sequentially transmits audio data Y to the control system 40 in parallel with the control process.

[0034] When the control process is started, the generation unit 411 executes the process of generating content Ca (hereinafter referred to as the "generation process") (S1). Figure 6 is a flowchart illustrating the procedure of the generation process Qa in the first embodiment.

[0035] When the generation process Qa is started, the generation unit 411 acquires audio data Y (Qa1). Specifically, the generation unit 411 receives the audio data Y transmitted from the recording system 20 via the communication device 43. Then, the generation unit 411 generates content Ca corresponding to the audio data Y (Qa2). Specifically, the generation unit 411 stores the audio data Y as content Ca in the storage device 42.

[0036] When generation process Qa is executed, the determination unit 412 determines whether the communication device 43 has received the distribution request R transmitted from the terminal device 50, as illustrated in Figure 5 (S2). If the distribution request R is received (S2: YES), the determination unit 412 determines whether the terminal device 50 that sent the distribution request R is located within the venue 300 (S3). Specifically, if the location information in the distribution request R indicates a location within the reference range, the determination unit 412 determines that the terminal device 50 is located within the venue 300. On the other hand, if the location information indicates a location outside the reference range, the determination unit 412 determines that the terminal device 50 is not located within the venue 300.

[0037] If the determination unit 412 determines that terminal device 50 is located within the venue 300 (S3: YES), the distribution unit 413 registers terminal device 50, the source of the distribution request R, as the distribution destination for content Ca (S4). For example, the distribution unit 413 stores the identification information contained in the distribution request R in the storage device 42. On the other hand, if the determination unit 412 determines that terminal device 50 is not located within the venue 300 (S3: NO), terminal device 50, the source of the distribution request R, is not registered as the distribution destination for content Ca. Also, if the distribution request R is not received (S2: NO), the determination by the determination unit 412 (S3) and the addition of the distribution destination (S4) are not performed.

[0038] The distribution unit 413 distributes the content Ca from the communication device 43 to each terminal device 50 registered as a distribution destination (S5). As can be understood from the above explanation, the content Ca is distributed to terminal devices 50 for which the determination result by the determination unit 412 is positive (S3: YES), and the content Ca is not distributed to terminal devices 50 for which the determination result is negative (S3: N0). In other words, the content Ca is distributed to terminal devices 50 inside the venue 300, and not to terminal devices 50 outside the venue 300.

[0039] The control device 41 determines whether a predetermined termination condition has been met (S6). For example, if the organizer of the competition event instructs the termination of the control process, the control device 41 determines that the termination condition has been met. Alternatively, the termination condition may be the arrival of the time when the event ends. If the termination condition is not met (S6: NO), the control device 41 proceeds to step S1. That is, the distribution of content Ca limited to terminal devices 50 located within the venue 300 is repeated. If the termination condition is met (S6: YES), the control device 41 terminates the control process. Alternatively, the control device 41 may terminate the control process when the terminal device 50 receives a termination instruction from user Ua.

[0040] As described above, in the first embodiment, content Ca related to the competition event is distributed exclusively to terminal devices 50 located at the venue 300 of the competition event. Users Ua within the venue 300 can view content Ca while watching the progress of the competition event. Therefore, it is possible to encourage a large number of users Ua to come to the venue 300.

[0041] B: Second Embodiment A second embodiment will now be described. For elements whose function is the same as in the first embodiment in each of the embodiments described below, the same reference numerals as in the first embodiment will be used, and detailed descriptions of each will be omitted as appropriate.

[0042] In the first embodiment, an example was given in which audio data Y representing explanatory audio is delivered to the terminal device 50 as content Ca. In the second embodiment, a string of characters (hereinafter referred to as "spoken string") Y1 corresponding to the explanatory audio is delivered to the terminal device 50 as content Ca.

[0043] Figure 7 is a flowchart illustrating the steps of the generation process Qb in the second embodiment, in which the control device 41 generates content Ca. In the second embodiment, the generation process Qa in Figure 6 is replaced by the generation process Qb in Figure 7.

[0044] When the generation process Qb is started, the generation unit 411 acquires audio data Y in the same manner as in the first embodiment (Qb1). The generation unit 411 generates a speech string Y1 by speech recognition of the audio data Y (Qb2). The speech string Y1 is a string representing the content of the explanatory audio. For speech recognition of the audio data Y, any known speech recognition method using an acoustic model such as HMM (Hidden Markov Model) and a language model that indicates linguistic constraints can be arbitrarily employed. The generation unit 411 stores the speech string Y1 as content Ca in the storage device 42 (Qb3).

[0045] As described above, the content Ca in the second embodiment is the utterance string Y1 identified by speech recognition of the audio data Y. The operation (S2-S6) of distributing the content Ca to the terminal device 50, provided that the terminal device 50 is located within the venue 300, is the same as in the first embodiment. The display device 52 of the terminal device 50 displays the utterance string Y1 of the content Ca received from the control system 40. That is, user Ua can see the utterance string Y1 corresponding to the commentator Uc's commentary while watching the competition event within the venue 300.

[0046] The same effects as in the first embodiment are achieved in the second embodiment. In the second embodiment, the speech string Y1 corresponding to the commentary audio is displayed on the terminal device 50, so that, for example, a user who has difficulty listening to the commentary audio (for example, a person with a hearing impairment) can check the content of the commentary audio regarding the sporting event.

[0047] C: Third Embodiment In the second embodiment, a spoken string Y1 representing the explanatory audio is delivered to the terminal device 50 as content Ca. The spoken string Y1 is expressed in the same language as the explanatory audio (hereinafter referred to as the "first language"). In the third embodiment, a string Y2 obtained by translating the spoken string Y1 from the first language to the second language (hereinafter referred to as the "translated string") is delivered to the terminal device 50 as content Ca. The second language is a different language from the first language.

[0048] Figure 8 is a flowchart illustrating the steps of the generation process Qc in the third embodiment, in which the control device 41 generates content Ca. In the third embodiment, the generation process Qa in Figure 6 is replaced by the generation process Qc in Figure 8.

[0049] When the generation process Qc is started, the generation unit 411 acquires voice data Y in the same manner as in the first embodiment (Qc1). The generation unit 411 generates a spoken string Y1 by speech recognition of the voice data Y, in the same manner as in the second embodiment (Qc2). The generation unit 411 also generates a translated string Y2 in the second language by machine translation of the spoken string Y1 in the first language (Qc3). The second language is selected for each terminal device 50 in accordance with instructions from the user Ua to the terminal device 50.

[0050] Any known technique may be used for machine translation of the utterance string Y1. For example, rule-based machine translation, which converts word order and words by referring to the results of syntactic analysis of the utterance string Y1 and linguistic rules, or statistical machine translation, which converts the utterance string Y1 to the translated string Y2 using a statistical model that represents the statistical trends of the language, can be used to generate the translated string Y2. The generation unit 411 stores the translated string Y2 as content Ca in the storage device 42 (Qc4).

[0051] As described above, the content Ca in the third embodiment is a translated string Y2 generated by speech recognition and machine translation of audio data Y. The operation (S2-S6) for distributing the content Ca to the terminal device 50, provided that the terminal device 50 is located within the venue 300, is the same as in the first embodiment. The display device 52 of the terminal device 50 displays the translated string Y2 of the content Ca received from the control system 40. That is, user Ua can view the translated string Y2, which expresses the commentary audio in a second language, while watching the competition event within the venue 300.

[0052] The same effects as in the first embodiment are achieved in the third embodiment. In the third embodiment, the translated string Y2 in the second language corresponding to the commentary audio is displayed on the terminal device 50, so that, for example, a user who has difficulty understanding the first language (for example, a foreigner) can check the content of the commentary audio regarding the sporting event.

[0053] D: Fourth Embodiment In the first embodiment, content Ca corresponding to audio data Y transmitted by the recording system 20 was delivered to the terminal device 50. In the fourth embodiment, content Ca corresponding to any of the multiple audio data Y recorded at different locations within the venue 300 is selectively delivered to the terminal device 50.

[0054] Figure 9 is a block diagram illustrating the functional configuration of the control system 40 in the fourth embodiment. The generation unit 411 of the fourth embodiment acquires multiple audio data Y recorded at different locations within the venue 300 (Qa1). The multiple audio data Y include, for example, audio data Y generated by the recording system 20, as well as audio data Y generated by each terminal device 50 within the venue 300. Specifically, similar to the first embodiment, audio data Y generated by the recording system 20 is transmitted to the control system 40, and audio data Y generated by each terminal device 50 through sound collection using a sound collection device (not shown) is transmitted to the control system 40 (generation unit 411) for each terminal device 50. from The transmitted audio data Y is, for example, the voice spoken by user Ua using terminal device 50. Represents Each of the multiple audio data Ys is transmitted to the control system 40 along with information representing the location L where the audio of the audio data Y was recorded (hereinafter referred to as the "recording location").

[0055] Furthermore, the generation unit 411 generates multiple content Ca corresponding to different audio data Y (Qa2). Each content Ca corresponding to the audio data Y is stored in the storage device 42 in association with the recording position L of the audio data Y.

[0056] In the fourth embodiment, the distribution unit 413 selectively transmits one of the multiple content Ca stored in the storage device 42 to the terminal device 50. For example, in the fourth embodiment, the distribution request R transmitted from the terminal device 50 includes the location information and identification information of the terminal device 50, as well as a desired location within the venue 300 (hereinafter referred to as the "target location"). The target location is, for example, a location specified by the user Ua of the terminal device 50. The distribution unit 413 distributes the content Ca corresponding to the recording location L closest to the target location from among the multiple content Ca stored in the storage device 42 to the requesting terminal device 50 (S5). As can be understood from the above description, the distribution unit 413 in the fourth embodiment distributes the content Ca corresponding to one of the multiple audio data Y recorded at different locations within the venue 300 to the terminal device 50. The basic operation of the control system 40, such as the operation of distributing content Ca to the terminal device 50 on the condition that the terminal device 50 is located within the venue 300, is the same as in the first embodiment.

[0057] The same effects as in the first embodiment are achieved in the fourth embodiment. Furthermore, in the fourth embodiment, since content Ca corresponding to any of the multiple audio data Y is delivered to the terminal device 50, a wider variety of content Ca can be delivered to the terminal device 50 compared to the configuration in which content Ca corresponding to only one audio data Y is delivered to the terminal device 50.

[0058] In the above description, we assumed a configuration in which each of the multiple audio data Y is distributed to the terminal device 50 as content Ca. However, the relationship between the audio data Y and content Ca is not limited to the examples above. For example, the configuration of the second embodiment, in which the utterance string Y1 generated from the audio data Y is used as content Ca, and the configuration of the third embodiment, in which the translated string Y2 generated from the audio data Y is used as content Ca, are similarly applicable to the fourth embodiment.

[0059] E: Variation The following are examples of specific modifications that may be added to each of the embodiments exemplified above. Multiple embodiments selected from the following examples may be merged as appropriate, provided they do not contradict each other.

[0060] (1) In each of the above-described embodiments, the location information of the terminal device 50 was used to determine whether or not the terminal device 50 is located within the venue 300. However, the method for determining whether or not the terminal device 50 is located within the venue 300 (hereinafter referred to as "location determination") is not limited to the above examples. Specific examples of location determination are given below.

[0061] [Aspect 1] Information that the terminal device 50 can receive only within the venue 300 (hereinafter referred to as "venue information") is used for location determination. For example, consider a situation where venue information is transmitted to the terminal device 50 via short-range wireless communication from a transmitter installed within the venue 300. The range from which venue information is transmitted is limited to within the venue 300. In this situation, the determination unit 412 determines that the terminal device 50 is located in the venue 300 when the control system 40 receives venue information from the terminal device 50. Examples of short-range wireless communication include wireless communication such as Bluetooth® or WiFi®, or acoustic communication that uses sound waves emitted from a sound-emitting device (transmitter) as a transmission medium.

[0062] [Aspect 2] Venue information obtainable by reading an image pattern is used for location determination. The image pattern is an optically readable image such as a QR code (registered trademark) or a barcode. The image pattern is displayed exclusively within the venue 300. That is, terminal devices 50 located outside the venue 300 cannot read the image pattern. In this situation, the determination unit 412 determines that the terminal device 50 is located in the venue 300 when the control system 40 receives venue information obtained by the terminal device 50 by reading the image pattern from the terminal device 50.

[0063] [Aspect 3] An electronic ticket held in the terminal device 50 for user Ua to enter venue 300 is used for location determination. The electronic ticket includes entry information indicating whether or not user Ua has entered venue 300. In the above situation, the determination unit 412 determines that the terminal device 50 is located in venue 300 when the control system 40 receives the entry information from the terminal device 50.

[0064] In addition to the examples above, it is also possible to determine whether or not the terminal device 50 is located in the venue 300 by using various authentication methods, such as facial recognition using the user Ua's facial image or authentication using a pre-registered password.

[0065] (2) Any of the multiple content Ca generated using the audio data Y in common may be selectively delivered to the terminal device 50. For example, the delivery unit 413 delivers one or more of the following content Ca to the terminal device 50: content Ca containing audio data Y, content Ca representing the speech string Y1 corresponding to the audio data Y, and content Ca representing the translated string Y2 corresponding to the audio data Y. The content Ca to be delivered from among the multiple content Ca is selected, for example, in response to instructions from the user Ua to the terminal device 50.

[0066] (3) The relationship between the audio data Y and the content Ca is not limited to the examples in each of the embodiments described above. For example, in the third embodiment, the voice that reads the translated string Y2 may be generated by speech synthesis, and the generation unit 411 may generate the content Ca representing the voice. The sound output device 53 of the terminal device 50 plays the content Ca. For example, the speech synthesis to which the translated string Y2 is applied may use a segment-connection type speech synthesis that connects multiple speech segments, or a statistical model type speech synthesis that uses a statistical model such as a deep neural network or HMM (Hidden Markov Model). The content Ca in each of the embodiments described above and in this modified example are examples of content Ca corresponding to the audio data Y.

[0067] (4) In the second embodiment, the translated string Y2 was generated by speech recognition and machine translation of the audio data Y, but the method for generating the translated string Y2 is not limited to the above examples. For example, the translated string Y2 may be generated by an editor manually editing the string generated by machine translation of the utterance string Y1. Alternatively, a translator listening to the audio of the audio data Y may manually input the translated string Y2. Alternatively, a translator listening to the audio of the audio data Y may pronounce the voice of the translated text and distribute the audio data containing the voice as content Ca to the terminal device 50. Alternatively, the translated string Y2 may be generated by performing speech recognition processing on the audio data of the voice pronounced by the translator.

[0068] While the above focused on the translated string Y2, a similar form can be assumed for the spoken string Y1. For example, the spoken string Y1 may be generated by an editor manually editing the string generated by speech recognition on the audio data Y. Alternatively, a worker listening to the audio data Y may manually input the spoken string Y1. As described above, content Ca generated through manual operation by a translator or worker can also be included in the concept of "first content" in this disclosure.

[0069] (5) In the above-described configurations, examples were given in which the audio data Y recorded by the recording system 20 is used for the generation of content Ca and content Cb. However, the audio data Y does not have to be used for the generation of content Cb by the distribution system 30. In other words, it is not necessary for the audio data Y generated by the recording system 20 to be transmitted to the distribution system 30.

[0070] (6) In the above-described forms, examples were given in which content Ca is generated from audio data Y. However, the data used to generate content Ca is not limited to audio data Y representing commentary audio. For example, video data representing images captured within the venue 300 by an imaging device may be used to generate content Ca. For example, video data is distributed to the terminal device 50 as content Ca. Alternatively, content Ca containing both audio data Y and video data may be generated. The data used to generate content Ca is comprehensively represented as recorded data recorded in parallel with the progress of the competition event. Typical examples of recorded data are audio data Y and video data.

[0071] (7) The functions of the control system 40 exemplified above are realized through the cooperation of one or more processors constituting the control device 41 and the program stored in the storage device 42, as described above. The program exemplified above can be provided in a form stored on a computer-readable recording medium and installed on the computer. The recording medium is, for example, a non-transitory recording medium, such as an optical recording medium like a CD-ROM, but also includes any known form of recording medium such as a semiconductor recording medium or a magnetic recording medium. Note that a non-transitory recording medium includes any recording medium except for transient propagation signals (transitory, propagating signals), and volatile recording media are not excluded. Furthermore, in a configuration in which a distribution device distributes a program via a communication network, the recording medium in which the distribution device stores the program corresponds to the non-transitory recording medium described above.

[0072] F: Note From the forms exemplified above, the following configuration can be understood, for example.

[0073] The operation method of a control system according to one aspect of this disclosure (Aspect 1) involves determining whether a terminal device is located at the venue where the event is being held, and if the determination is positive, distributing first content related to the event to the terminal device in parallel with the progress of the event. In this aspect, the first content related to the event is distributed only to terminal devices located at the event venue. Users located within the venue can view the first content related to the event while watching the progress of the event within the venue. Therefore, it is possible to encourage users to attend the venue.

[0074] An "event" refers to various types of performances that are open to the public. For example, the concept of an "event" encompasses a variety of activities held for a specific purpose, such as competitive events where multiple athletes (teams) compete in a particular sport, performance events where singers or dancers perform (e.g., concerts or live shows), exhibition events where various goods are displayed, educational events where schools or cram schools provide lessons to students, or lecture events where experts or knowledgeable speakers give lectures on various topics. A typical example of an event is an entertainment event.

[0075] A "venue" is any facility where an event takes place. Specifically, the concept of a "venue" encompasses a variety of indoor and outdoor locations, such as a stadium for competitive events, an acoustic hall or outdoor live venue for demonstration events (e.g., concerts or live performances), an exhibition hall for exhibition events, an educational facility for educational events, or a lecture hall for lecture events.

[0076] "First Content" refers to information (digital content) provided to the user's terminal device, and includes, for example, at least one of video and audio. A typical example of First Content is audio content that provides commentary or explanation of an event.

[0077] The operation method according to a specific example of Embodiment 1 (Embodiment 2) further acquires recorded data recorded in parallel with the progress of the event, and in the distribution of the first content, distributes the first content corresponding to the recorded data to the terminal device. According to the above embodiment, the first content corresponding to the recorded data recorded in parallel with the progress of the event is distributed to the terminal device. Therefore, the first content that appropriately reflects the progress of the event can be distributed to the terminal device.

[0078] "Recorded data" refers to data representing video or audio recorded in parallel with the progress of an event. "First content corresponding to recorded data" refers to content generated using the recorded data. Specifically, this could involve the first content being generated through various processes on the recorded data, or the recorded data being used as the first content.

[0079] In a specific example of Embodiment 2 (Embodiment 3), the recorded data is transmitted to a distribution system that distributes the second content corresponding to the recorded data to a playback device in parallel with the progress of the event. In the above embodiment, the recorded data corresponding to the first content is also used for the second content distributed to the playback device by the distribution system. Therefore, the load for generating the second content is reduced.

[0080] "Second content" refers to information (digital content) provided to the playback device, and includes, for example, at least one of video and audio. A typical example of second content is video content recording an event. "Second content corresponding to recorded data" refers to, for example, content generated using the recorded data. Specifically, this can take the form of generating second content through various processing of the recorded data, or the form of using the recorded data as second content. For example, if the recorded data is audio data representing commentary or explanation of an event, the "second content" is content created by combining video data representing video recording of the event with the said audio data.

[0081] A "playback device" is any device capable of playing back second content. For example, information devices such as smartphones, tablet devices, or personal computers, as well as video equipment such as television sets, are all included in the concept of a "playback device."

[0082] In the specific example of Embodiment 3 (Embodiment 4), the delivery delay of the first content to the terminal device is smaller than the delivery delay of the second content to the playback device. When a terminal device in the venue plays the second content, the delivery delay of the second content to the event becomes an issue. In the above embodiments, the first content is delivered to the terminal device with a delivery delay smaller than the delivery delay of the second content. Therefore, the terminal device can play the first content in an environment with less delivery delay compared to when the terminal device in the venue plays the second content. In other words, users of the venue can view the first content without excessive delay to the progress of the event they are watching.

[0083] "Delivery delay" refers to the delay in the playback of content related to an event. In other words, a concrete example of "delivery delay" is the length of time from when a specific event occurs in the event until when that event is actually played back in the content.

[0084] In any specific example of Embodiments 2 to 4 (Embodiment 5), the recorded data is audio data representing the audio related to the event. According to the above embodiments, the first content corresponding to the audio related to the event can be distributed to the terminal device at the venue.

[0085] "Event-related audio" refers to audio such as live commentary or explanation of the event. Audio data of speeches made by attendees in the venue in parallel with the event's progress will also be used as "recorded data."

[0086] In a specific example of Embodiment 5 (Embodiment 6), a string is generated by speech recognition of the audio data, and the first content represents the string. According to the above embodiments, since the string corresponding to the audio related to the event is displayed on the terminal device, users who have difficulty hearing audio (for example, people with hearing impairments) can confirm the content of the audio related to the event.

[0087] In a specific example of Embodiment 5 (Embodiment 7), a first string in a first language is generated by speech recognition of the audio data, a second string in a second language different from the first language is generated by machine translation of the first string, and the first content represents the second string. According to the above embodiment, since the second language string, which is a translation of the audio related to the event, is displayed on the terminal device, users who have difficulty understanding the first language (for example, foreigners) can check the content of the audio related to the event.

[0088] The operation method according to a specific example of Embodiment 1 (Embodiment 8) further acquires multiple recording data recorded at different locations in the venue in parallel with the progress of the event, and in the distribution of the first content, distributes the first content corresponding to any of the multiple recording data to the terminal device. According to the above embodiment, since the first content corresponding to any of the multiple recording data is distributed to the terminal device, a wider variety of first content can be distributed to the terminal device compared to the form in which the first content corresponding to only one recording data is distributed to the terminal device.

[0089] The source of the "multiple recorded data" is arbitrary. For example, recorded data generated by a recording system installed at the venue may be used. The recorded data recorded by the recording system may be audio data representing sounds related to the event (for example, audio commentary or explanation of the event). Alternatively, recorded data recorded by terminal devices within the venue may be used. The recorded data recorded by terminal devices may be audio data representing sounds spoken by users watching the event at the venue.

[0090] A control system according to one aspect of the present disclosure (Aspect 9) comprises a determination unit that determines whether or not a terminal device is located at the venue where an event is being held, and a distribution unit that, if the result of the determination is affirmative, distributes first content related to the event to the terminal device in parallel with the progress of the event.

[0091] A program according to one aspect of the present disclosure (Aspect 10) causes a computer system to function as a determination unit that determines whether or not a terminal device is located at the venue where the event is being held, and a distribution unit that, if the result of the determination is affirmative, distributes first content related to the event to the terminal device in parallel with the progress of the event. [Explanation of symbols]

[0092] 100...Information system, 200...Communication network, 300...Venue, 10...Recording system, 20...Recording system, 21...Sound collection device, 22...Acoustic device, 23...Communication device, 30...Distribution system, 40...Control system, 41...Control device, 411...Generation unit, 412...Determination unit, 413...Distribution unit, 42...Storage device, 43...Communication device, 50...Terminal device, 51...Playback device, 52...Display device, 53...Sound emission device, 60...Playback device, 61...Display device, 62...Sound emission device.

Claims

1. Determine whether or not a terminal device is located at the venue where the event is being held. If it is determined that the terminal device is located at the venue, the terminal device is registered as the destination for the first content related to the event. If it is determined that the terminal device is not located at the venue, the terminal device will not be registered as the distribution destination. In parallel with the progress of the event, the first content, which is generated in parallel with the progress of the event, is distributed to the terminal device registered as the distribution destination. The operation method of the control system.

2. The first content is content corresponding to video or audio recorded in parallel with the progress of the event. A method for operating the control system of claim 1.

3. Further audio data representing the audio related to the aforementioned event is obtained, The first content is content corresponding to the audio data. A method for operating the control system of claim 1.

4. The first content represents a string of characters corresponding to the audio data. A method for operating the control system of claim 3.

5. The first content represents a second string obtained by translating a first string in a first language corresponding to the audio data into a second language. A method for operating the control system of claim 3.

6. The first content represents a second audio, which is a translation of the first audio in the first language corresponding to the audio data into the second language. A method for operating the control system of claim 3.

7. This represents audio related to the event, and acquires audio data recorded in parallel with the progress of the event. Determine whether or not a terminal device is located at the venue where the aforementioned event is to be held. If it is determined that the terminal device is located at the venue, in parallel with the progress of the event, a first content representing a second string obtained by translating a first string in the first language corresponding to the audio data into a second language is delivered to the terminal device. The operation method of the control system.

8. This represents audio related to the event, and acquires audio data recorded in parallel with the progress of the event. Determine whether or not a terminal device is located at the venue where the aforementioned event is to be held. If it is determined that the terminal device is located at the venue, the first content, which represents a second audio obtained by translating the first audio in the first language corresponding to the audio data into a second language, is delivered to the terminal device in parallel with the progress of the event. The operation method of the control system.

9. A second content, which is content related to the aforementioned event and is different from the first content, is distributed to the playback device. A method for operating a control system according to any one of claims 1 to 8.

10. The delivery delay of the first content to the terminal device is smaller than the delivery delay of the second content to the playback device. A method for operating the control system of claim 9.

11. The first content corresponds to audio data representing audio related to the event, The second content includes recording data recorded in parallel with the progress of the event and the audio data. A method for operating the control system of claim 9 or claim 10.

12. The recorded data includes video data representing images captured at the event and audio data representing sounds captured at the event. The second content includes the video data and mixed sound data obtained by mixing the sound represented by the sound data and the sound represented by the audio data. A method for operating the control system of claim 11.

13. In parallel with the progress of the aforementioned event, multiple recording data were acquired from different locations within the aforementioned venue. The first content is content that corresponds to any of the multiple recorded data. A method for operating a control system according to any one of claims 1 to 12.

14. A determination unit that determines whether or not a terminal device is located at the venue where the event is being held, If it is determined that the terminal device is located at the venue, the terminal device is registered as the destination for the first content related to the event. If it is determined that the terminal device is not located at the venue, the terminal device will not be registered as the distribution destination. In parallel with the progress of the event, a distribution unit distributes the first content, which is generated in parallel with the progress of the event, to the terminal device registered as the distribution destination. A control system equipped with the following features.

15. An acquisition unit that represents audio related to the event and acquires audio data recorded in parallel with the progress of the event, A determination unit that determines whether or not a terminal device is located at the venue where the aforementioned event is held, If the terminal device is determined to be located at the venue, the distribution unit distributes to the terminal device, in parallel with the progress of the event, a first content that represents a second string obtained by translating a first string in the first language corresponding to the audio data into a second language. A control system equipped with the following features.

16. An acquisition unit that represents audio related to the event and acquires audio data recorded in parallel with the progress of the event, A determination unit that determines whether or not a terminal device is located at the venue where the aforementioned event is held, If the terminal device is determined to be located at the venue, the distribution unit distributes to the terminal device, in parallel with the progress of the event, a first content representing a second audio, which is a translation of the first audio in the first language corresponding to the audio data into a second language. A control system equipped with the following features.

17. A determination unit that determines whether or not a terminal device is located at the venue where the event is being held, and If it is determined that the terminal device is located at the venue, the terminal device is registered as the destination for the first content related to the event. If it is determined that the terminal device is not located at the venue, the terminal device will not be registered as the distribution destination. A distribution unit distributes the first content, which is generated in parallel with the progress of the event, to the terminal device registered as the distribution destination, in parallel with the progress of the event. A program that makes a computer system function.

18. An acquisition unit that represents audio related to an event and acquires audio data recorded in parallel with the progress of the event. A determination unit that determines whether or not a terminal device is located at the venue where the event is being held, and If the distribution unit determines that the terminal device is located at the venue, it will distribute to the terminal device, in parallel with the progress of the event, a first content that represents a second string obtained by translating a first string in the first language corresponding to the audio data into a second language. A program that makes a computer system function.

19. An acquisition unit that represents audio related to an event and acquires audio data recorded in parallel with the progress of the event. A determination unit that determines whether or not a terminal device is located at the venue where the event is being held, and If the distribution unit determines that the terminal device is located at the venue, it will distribute to the terminal device, in parallel with the progress of the event, first content representing a second audio, which is a translation of the first audio in the first language corresponding to the audio data into the second language. A program that makes a computer system function.

Images