Video distribution system, computer program used therefor, and control method

Abstract

To provide a video distribution system capable of reflecting the reaction of a viewer who has watched a shot video of an event in the event as a production by a production device.SOLUTION: A video distribution system 1 is connected to a user terminal device 4 and a speaker SP installed in an event facility EF via a network NT, and a capture video is distributed to the user terminal device 4 such that a video screen 50 including the captured image as the capturing result obtained by capturing an event held at the event facility EF is displayed on a monitor 46 provided in the user terminal device 4. Further, in the video distribution system 1, when each viewer who watches the captured video posts a comment to support the event to the video screen 50 via the user terminal device 4, the posted comment is converted into a voice performance to be performed by the speaker SP. Then, the video distribution system 1 controls the speaker SP such that the voice performance is added to the event.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to a video distribution system that is connected via a network to a user terminal device used by each user and to performance equipment installed at an event facility to add performance effects, and distributes filmed video to the user terminal device so that a video screen including the filmed video as a result of filming an event held at the event facility is displayed on a display device installed in the user terminal device. [Background technology]

[0002] There is a video distribution system that is connected via a network to user terminal devices used by users and to performance equipment installed at an event facility to add performance effects, and distributes filmed video to the user terminal devices so that a video screen including the filmed video of an event held at the event facility is displayed on a display device installed in the user terminal device. For example, a server that distributes content such as live broadcast videos as such filmed video is known (see, for example, Patent Document 1). Other prior art documents related to the present invention include Patent Document 2 and Non-Patent Document 1. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6430059 [Patent Document 2] Patent No. 6382468 [Non-patent literature]

[0004] [Non-Patent Document 1] "Nippon Ham Fighters' cheering song resonated in the empty Sapporo Dome! Fan recordings played at the opportunity", [online], March 14, 2020, Sponichi Annex, [March 26, 2020], Internet, <URL:https : / / WWW.sponichi.co.jp / baseball / 2020 / 03 / 14 / kiji / 20200314s00001173044000c.html > Summary of the Invention [Problem to be solved by the invention]

[0005] In the server of Patent Document 1, audience members of a live broadcast video may select an item and pay a fee, causing the selected item to be superimposed on the live broadcast video. However, this server is not configured so that the selection of an item affects the content of the live broadcast video. More specifically, for example, if the results of filming an event at an event facility are used as a live broadcast video, the selection of an item does not affect the control of the performance equipment installed at the event facility. In other words, audience reactions to the live broadcast video are not linked (related) to the performance effects achieved through the performance equipment at the event. On the other hand, the selection of an item (audience reaction) that requires payment of a fee tends to increase in accordance with the audience's excitement (satisfaction). As a result, even if audience members of the live broadcast video are satisfied with the event and become excited through the selection of an item, that excitement is not reflected in the actual event.

[0006] Furthermore, in the video distribution system of Patent Document 2, videos including animations of character objects generated based on the movements of actors are distributed. In this system, actors perform in studio units, but there is no audience in these studio units. Meanwhile, in the studio units, a screen onto which the videos distributed to client devices are projected may be placed in front of the actors. In this case, the actors may be able to check the reactions of viewers of the videos through the screen. In this case, the actors may be able to reflect such reactions in their own performances. However, depending on the content of the performance or the actors, there may be no time to check such reactions. Whether or not the viewers' reactions are reflected in the performance (video content) is left to the actors' discretion, and they are not directly reflected.

[0007] Meanwhile, in recent years, some sporting events, such as professional baseball and sumo wrestling, have been held without spectators. In such cases, even if the event is broadcast on television, the only audio available is the commentary on home runs and the players' voices, potentially creating an impression of lack of excitement. At the very least, the atmosphere is likely to be different from normal (when spectators are present). To create a more normal atmosphere, Non-Patent Document 1 introduces an approach in which multiple speakers are placed in the top row of the outfield seats at the stadium, and a theme song for a chance is played when a player steps up to bat in scoring position. However, this approach only plays the theme song in pre-set situations, such as when the player is in scoring position, and again does not reflect the reaction of television viewers. As a result, the presentation may be monotonous.

[0008] Therefore, an object of the present invention is to provide a video distribution system etc. that can reflect the reactions of viewers who watch the filmed video of an event in the event as a performance effect using performance equipment. [Means for solving the problem]

[0009] The video distribution system of the present invention is a video distribution system that is connected via a network to user terminal devices used by each user and to performance equipment installed at an event facility to add performance effects, and distributes the filmed video to the user terminal devices so that a video screen including the filmed video of an event held at the event facility is displayed on a display device installed on the user terminal devices.When each viewer as a user watching the filmed video performs a cheering action to add a cheering effect to the event on the video screen via the user terminal devices, the system is equipped with a performance conversion means that converts the cheering action into an event performance to be performed by the performance equipment, and a device control means that controls the performance equipment so that the event performance is added to the event as the performance.

[0010] On the other hand, the computer program of the present invention is configured to cause a computer connected to the user terminal device and the performance equipment via the network to function as each means of the video distribution system described above.

[0011] Furthermore, the control method of the present invention causes a computer incorporated in a video distribution system that is connected via a network to user terminal devices used by each user and to performance equipment installed at an event facility to add performance effects, and that distributes the filmed video to the user terminal devices so that a video screen including the filmed video of an event held at the event facility is displayed on a display device installed in the user terminal devices, to execute a performance conversion procedure for converting, when each viewer as a user watching the filmed video performs a cheering action to add a cheering effect to the event on the video screen via the user terminal device, the cheering action into an event performance to be performed by the performance equipment, and an equipment control procedure for controlling the performance equipment so that the event performance is added to the event as the performance. [Brief explanation of the drawings]

[0012] [Figure 1]1 is a diagram showing a schematic configuration of a video distribution system according to an embodiment of the present invention. [Figure 2] 1 is a diagram showing a schematic configuration of a video distribution system according to a first embodiment. [Figure 3] FIG. 2 is a functional block diagram showing the main parts of a control system of the video distribution system according to the first embodiment. [Figure 4] FIG. 2 is a diagram showing an example of the flow of a rendering service according to the first embodiment. [Figure 5] FIG. 2 is a diagram showing an example of the configuration of device data. [Figure 6] FIG. 4 is a diagram showing an example of the configuration of performance data. [Figure 7] 10 is a flowchart showing an example of a procedure for performance control processing. [Figure 8] 10 is a flowchart showing an example of a procedure for post-performance processing. [Figure 9] FIG. 10 is a diagram showing a schematic configuration of a video distribution system according to a second embodiment. [Figure 10] FIG. 10 is a functional block diagram showing the main parts of a control system of a video distribution system according to a second embodiment. [Figure 11] FIG. 10 is a diagram showing an example of the flow of a rendering service according to the second embodiment. [Figure 12] 10 is a flowchart showing an example of a procedure for effect adjustment processing. DETAILED DESCRIPTION OF THE INVENTION

[0013] An example of a video distribution system according to an embodiment of the present invention will be described below. First, with reference to FIG. 1, the overall configuration of the video distribution system according to an embodiment of the present invention will be described. The video distribution system 1 is a system for distributing video (images) showing the status of an event held at an event facility EF to users of user terminal devices 4. Specifically, the video distribution system 1 includes a center server 2 as a server device and performance equipment EA connected to the center server 2 via a predetermined network NT. The center server 2 is configured as a single logical server device by combining server units 2A, 2B, etc. as multiple computer devices. However, the center server 2 may also be configured by a single server unit. Alternatively, the center server 2 may be configured logically using cloud computing.

[0014] The network NT may be configured as appropriate as long as it can connect the rendering equipment EA to the center server 2. As an example, the network NT is configured by the Internet as a WAN and a LAN that connects the center server 2 and the rendering equipment EA to the Internet. Note that various computer devices may be interposed between the rendering equipment EA and the LAN as appropriate. In this case, such computer devices and the rendering equipment EA may be configured as one local system, and such local system may be connected to the center server 2 via the network NT.

[0015] The performance equipment EA is a device for realizing various performances. The performance equipment EA may be configured as appropriate as long as it can realize such performances. As an example, the performance equipment EA is configured as a network device (so-called IoT device) connectable to a network NT. The performance equipment EA may be an output device that realizes various performances or an input device used for such performances, and may include various devices as appropriate. In the example of FIG. 1, a speaker SP and a camera CA are shown as examples of the performance equipment EA. The speaker SP is a well-known audio output device that performs auditory performances by playing (outputting) various sounds. The camera CA is a well-known device that captures video. Such performance equipment EA may be installed in various facilities as appropriate, but in the example of FIG. 1, it is installed in an event facility (venue) EF. The event facility EF is a facility where various events are held.

[0016] A user terminal device 4 may be connected to the video distribution system 1 via the network NT. The user terminal device 4 is a computer device that can be connected to a network and is provided for the user's personal use. By implementing various computer software, the user terminal device 4 can allow the user to enjoy various services provided by the center server 2. For example, the user terminal device 4 functions as a display terminal that can display various videos by executing a predetermined application (software). Any appropriate computer device may be used as the user terminal device 4. In the example of FIG. 1, user terminal devices such as a mobile terminal device 4A such as a mobile phone (including a smartphone), a portable tablet terminal device 4B, and a notebook-type (or stationary) personal computer 4C are shown. These are appropriately connected to the network NT via, for example, an access point AP. Note that other computer devices that can be connected to a network and are provided for the user's personal use, such as a stationary home game console or a portable game console, may also be appropriately used as the user terminal device 4.

[0017] The center server 2 provides various equipment services to the performance equipment EA. The performance equipment EA may be controlled by an event organizer at the event facility EF via a local system, or may be controlled by the center server 2 directly or indirectly via the local system. In other words, the performance equipment EA may be connected to a local system (e.g., a system including an appropriate computer device such as a speaker control device for controlling the speakers SP) and controlled by the local system. In this case, the center server 2 outputs a control signal (which may be an appropriate signal that allows the local system to cause the performance equipment EA to perform a performance) to the local system to control the performance equipment EA (both the local system and the performance equipment EA may be prepared by the operator of the event facility EF, who may be different from the operator of the video distribution system 1) (the control signal may be an appropriate signal that allows the local system to cause the performance equipment EA to perform a performance; for example, if the local system records the types of performances to be realized by the performance equipment EA and the specific controls for achieving them, the control signal may be a signal indicating the execution of any of those types). The actual control of the performance equipment EA may then be performed indirectly via the local system (which ultimately functions as a relay device) that receives the control instruction. In this way, the effect device EA may be controlled as appropriate, but when it is controlled indirectly or directly by the center server 2, the device services include services for controlling the effect device EA. Specifically, as services for controlling such effect device EA, the device services include a camera control service for controlling the shooting conditions of the camera CA (shooting direction, shooting range, angle of view, shooting time, etc.) when the shooting results of the camera CA are used in a video distribution system, and a video recording service for acquiring the shooting results and recording them as video data. Similarly, the device services include a rendering service for causing the speaker SP to play (output) various sounds for effect. Details of the rendering services will be described later.

[0018] Similarly, the center server 2 provides various Web services to users of the user terminal devices 4 via the network NT. For example, the Web services include a video distribution service, a video-related service, and a billing service. The video distribution service distributes video of the event situation to the user terminal devices 4. Such video may include various types of video as appropriate, and as an example, video (video) corresponding to the results of shooting by the camera CA (including appropriately edited video). The video distribution service may be configured to distribute video data for displaying the video of the event situation to the user terminal devices 4 as appropriate, and as an example, is configured to distribute the video data as needed using packet communication. Furthermore, such video of the event situation may be recorded video of the situation of a past event, but may also be distributed as live video (almost real-time) that distributes the current play situation, for example. In other words, the situation of the event at the event facility EF is streamed to the user terminal devices 4 as needed in almost real time through the video distribution service.

[0019] The video-related service is a service related to the video of the event situation distributed through the video distribution service. The video-related service may include various services related to the video of the event situation as appropriate, and one example is an event support service. The event support service is a service that allows users (hereinafter sometimes referred to as viewers) of user terminal devices 4 who watch the event situation (live video) via the video distribution service to support the event. Such support may be realized as appropriate, and one example is realized by allowing viewers of the live video (event situation) to express their feelings (impressions) about the event situation. Furthermore, such expression may be realized as appropriate, and one example is realized by at least one of tipping, purchasing an item, or posting a comment. As a result, the event support service functions as a service that realizes at least one of tipping, purchasing an item, or posting a comment.

[0020] Comment posting is a function that allows each viewer to post their own comment. Comment posting may be implemented as appropriate, and may be implemented through a screen separate from the screen (hereinafter sometimes referred to as the video screen) that is displayed on the user terminal device 4 to display video showing the status of the event, but as an example, it is implemented through the video screen. Furthermore, posting a comment produces the effect of displaying the comment. This display (the comment) may be shared with other viewers as appropriate through a screen separate from the video screen, but as an example, it is shared with other viewers through the video screen. In other words, comment posting has the function of displaying each viewer's comment (text information expressing various emotions) on the video screen. This comment posting may be either paid (in exchange for payment) or free of charge (without payment).

[0021] On the other hand, tipping is a function that enables viewers to provide value to event performers (such as athletes or artists). While various virtual currencies (including limited-scope currencies such as in-game currencies and local currencies) may be used as such value, money is often used. Item purchase is a function that purchases event-related items (provided in exchange for a specified price). While various items may be used as such items, items related to the event performers are often used. In such cases, the purchase of items plays a similar role to tipping. Both tipping and item purchases may be realized through a screen separate from the video screen, similar to the posting of comments, and may be realized as appropriate. For example, they are realized through the video screen. Furthermore, both tipping and item purchases may produce various effects, such as tallying the amount of tipping (or purchase) or displaying an indication of the occurrence of tipping (or purchase). Such effects do not have to be shared with other viewers, and may be realized as appropriate. For example, they are shared through the video screen, similar to comments. In other words, when a user gives a tip, purchases an item, or posts a comment, an appropriate effect (hereinafter, sometimes referred to as a cheering effect) occurs, and the cheering effect is added to the video screen and shared with other viewers. As a result, the cheering service also has the function of adding such a cheering effect to the video screen. In this case, the act of giving a tip, purchasing an item, or posting a comment functions as a cheering act of the present invention.

[0022] The cheering effect may be the same regardless of the content of the tip, but as an example, it may differ (change) depending on the content of the tip. Specifically, the cheering effect may be luxurious or modest depending on the amount of the tip (which may be from one viewer or the total amount including other viewers, and may also be a one-time amount or the cumulative amount over a predetermined period of time). Similarly, the cheering effect changes depending on the amount or type of item purchased. Furthermore, when posting a comment, the cheering effect changes depending on the content of the comment, such as whether it contains a predetermined keyword, the number of characters, or the number of comments including other viewers over a predetermined period of time (in other words, the number of viewers who posted comments).

[0023] The billing service is a service for collecting various fees (compensation) from each user of the user terminal device 4 through well-known payment processing. Such fees include various compensations according to the content of the Web service, such as a video distribution service or a video-related service, and, as an example, include tips for an event support service or compensation for purchasing an item (including compensation for posting a comment if posting a comment is paid). In other words, compensation (fees) required for the event support service are collected through the billing service. Note that the Web service may also include, for example, a data distribution service that distributes various data or software (including updates to data, etc.) to each user terminal device 4, an ID assignment service that assigns a user ID for identifying each user, or an authentication service that receives user identification information from the user terminal device 4 and authenticates the user.

[0024] Next, differences in the configuration of the video distribution system 1 depending on the event will be explained. Various events accompanied by performances by the performance equipment EA may be held at the event facility EF as appropriate, and the configuration of the performance equipment EA may differ depending on the type of event, which may result in differences in the configuration of the video distribution system 1. Below, using two types of events held at the event facility EF as examples, the configuration of the video distribution system 1 in two forms corresponding to each of these events will be explained for each form. Note that components common to the above-mentioned video distribution system 1 will be assigned the same reference numerals in the following drawings, and explanations will be omitted.

[0025] (First form) A video distribution system 1A according to a first embodiment will be described with reference to FIGS. 2 to 8. FIG. 2 is a diagram showing a schematic configuration of the video distribution system 1A according to the first embodiment. The video distribution system 1A according to the first embodiment corresponds to an example of the configuration of the video distribution system 1 when a sports-related event is held at an event facility EF. While various sports-related events may be held as such an event, the example of FIG. 2 shows the configuration of the video distribution system 1A when a baseball event (a sport in which players play using a real ball, etc.) (hereinafter, sometimes referred to as a baseball event) is held at the event facility EF. In this case, as shown in FIG. 2, a baseball stadium is used as the event facility EF, and performance equipment EA is installed in such a stadium. Furthermore, the performance equipment EA may include any number of various devices for producing (enhancing) the baseball event, but the example of FIG. 2 shows multiple speakers SP and one camera CA.

[0026] Next, the main components of the control system of the video distribution system 1A according to the first embodiment will be described with reference to FIG. 3. The center server 2 is provided with a control unit 21 and a storage unit 22 as storage means. The control unit 21 is configured as a computer that combines a CPU, an example of a processor that executes various arithmetic processes and operational control according to a predetermined computer program, with internal memory and other peripheral devices required for its operation. Various types of performance equipment EA can be connected to the control unit 21, and the example in FIG. 3 shows a camera CA and a speaker SP. Other input devices, such as a keyboard, and output devices, such as a monitor, can also be connected to the control unit 21 as needed. However, these devices are not shown in the figure.

[0027] The storage unit 22 is an external storage device realized by a storage unit including a non-volatile storage medium (computer-readable storage medium) such as a hard disk array. The storage unit 22 may be configured to store all data in a single storage unit, or may be configured to store data in a distributed manner across multiple storage units. The storage unit 22 stores a server program PG1 as an example of a computer program that causes the control unit 21 to execute various processes necessary to provide various services to users. The storage unit 22 also stores server data 23 necessary for providing various services. The server data 23 includes various data necessary for providing device services or Web services. In the example of FIG. 3, video data VD, device data DD, and performance data ED are shown as types of such various data.

[0028] The video data VD is well-known video data for displaying video of the event situation on the user terminal device 4. The video of the event situation includes, for example, video captured by an appropriate number of cameras CA, and in the case of a game event (an event using game machines) described below, video of game screens displayed by an appropriate number of game machines (including appropriate combinations of these, and appropriately processed video). Therefore, the video data VD may be configured as video data for displaying these various types of video. In the example of FIG. 3, the video data VD is configured as video data for displaying video of the event captured by the camera CA (including appropriately processed video; hereinafter, sometimes referred to as "captured video"). The device data DD is data for managing the performance equipment EA installed in the event facility EF. The performance data ED is data for realizing performances using the performance equipment EA. Details of the device data DD and the performance data ED will be described later. The server data 23 may also include various other data for realizing various services. For example, such data may include ID management data for managing various IDs such as user IDs. However, illustration of these data is omitted.

[0029] The control unit 21 is provided with a device service management unit 26 and a Web service management unit 27 as logical devices realized by a combination of the control unit 21's hardware resources and the server program PG1 as a software resource. The device service management unit 26 executes various processes for realizing the above-mentioned device services for the rendering device EA. Specifically, the device service management unit 26 executes, for example, a rendering control process and a post-rendering process as one type of process for realizing the above-mentioned rendering service. The detailed procedures of the rendering control process and the post-rendering process will be described later.

[0030] Meanwhile, the Web service management unit 27 executes various processes for realizing Web services such as the video distribution service, video-related service, or billing service described above for the user terminal device 4. For example, the Web service management unit 27 executes a well-known process for realizing streaming distribution of game video as a process for realizing the video distribution service. The Web service management unit 27 also executes a well-known billing process (including cooperation with other billing systems) as a process for realizing the billing service. Similarly, the Web service management unit 27 executes appropriate processes according to the content of the service provided as a process for realizing the video-related service, including a process for realizing a support service. Specifically, the Web service management unit 27 executes processes for realizing, for example, tipping, purchasing items, posting comments, or the like as a process for realizing such a support service. Such processes may be well-known processes and may be implemented as appropriate.

[0031] The user terminal device 4 is provided with a control unit 41 as a computer and a storage unit 42 as storage means. The control unit 41 is configured as a computer that combines a CPU as an example of a processor that executes various processes according to a predetermined computer program with an internal memory and other peripheral devices required for its operation.

[0032] The storage unit 42 is an external storage device realized by a storage unit including a nonvolatile storage medium (computer-readable storage medium) such as a hard disk or a semiconductor storage device. The storage unit 42 stores a terminal program PG2 as an example of a computer program that causes the control unit 41 to execute various processes necessary to provide various services to the user. The storage unit 42 also stores terminal data TD necessary for enjoying Web services such as displaying captured video. The terminal data TD includes various types of data, and the example in FIG. 3 shows video data VD as one type of data. The video data VD is provided by the center server 2 so as to include a portion necessary as part of a video distribution service (or data distribution service) or a video-related service. The terminal data TD may also include, for example, ID management data appropriately provided by the center server 2. Similarly, the terminal data TD may include, for example, image data for displaying various images related to the distribution of captured video, or audio data for playing various sounds such as background music. However, these are not shown in the figure.

[0033] The control unit 41 is configured with various logical devices by combining its hardware resources and the terminal program PG2 as software resources. These logical devices execute various processes necessary for enjoying Web services. The example in FIG. 3 shows the associated logical devices, a video control unit 43 and a data management unit 44. The video control unit 43 is a logical device that performs various processes for displaying various images (including videos). These processes include processes for displaying captured videos (videos) (processing for enjoying video distribution services), displaying various images related to the captured videos to enjoy video-related services, and processing for enjoying billing services related to these. For example, the video control unit 43, in cooperation with the Web service management unit 27 of the center server 2 or independently, executes processes for realizing tips, purchasing items, and posting comments as processes for realizing support services included in video-related services. Meanwhile, the data management unit 44 is a logical device that performs various processes related to the management of terminal data TD recorded in the storage unit 42. Such processing includes processing for acquiring the video data VD from the center server 2. In addition, processing for updating various data such as the video data VD, or processing for providing (transmitting) the updated data to the center server 2 may also be included as necessary.

[0034] The user terminal device 4 may be provided with various output devices and input devices as appropriate depending on the type of user terminal device, such as the mobile terminal device 4A. In the example of FIG. 3, a monitor 46, a speaker 47, and a touch panel TP are shown as such output devices. The monitor 46 and the speaker 47 are well-known display devices for displaying various images, such as game videos, and a well-known audio playback device for playing audio, respectively. The monitor 46 displays various screens (images) related to services provided by the user terminal device 4, including the above-mentioned video screens, including web services. The touch panel TP is a well-known input device (detection device) that detects the position of a user's touch operation and outputs a signal corresponding to that position. Appropriate touch operations (service actions) for using video distribution services, video-related services, or billable services are input through touch operations on the touch panel TP. The touch panel TP is disposed on and covers the monitor 46 so as to detect such touch operations across the entire display surface of the monitor 46.

[0035] Next, the details of the production service will be described with reference to FIG. 4. The production of the production device EA may be provided independently of the cheering service, but as an example, it is provided in conjunction with the cheering service. The example of FIG. 4 shows an example of the flow of the production service in such a case. The example of FIG. 4 also shows a case where a service for posting comments is provided as an example of such a cheering service. In other words, the example of FIG. 4 shows an example of the flow of the production service when the production device EA is produced in conjunction with the posting of a comment (cheering service). In this case, as shown in FIG. 4, the cheering service includes four steps F1 to F4, and the production service includes two steps F5 and F6. As a result, the production service, i.e., the production by the production device EA for a baseball event at a stadium, is realized through these six steps F1 to F6.

[0036] Specifically, first, the photographed image captured by camera CA is transmitted to center server 2 (F1). When the photographed image is transmitted from camera CA, center server 2 distributes the photographed image based on the photographed image to user terminal device 4 (F2). User terminal device 4 may provide the photographed image to the user as appropriate, for example, through video screen 50. For this reason, various objects photographed by camera CA are displayed as photographed images on video screen 50 as appropriate, and in the example of FIG. 4, a stadium image EFI corresponding to stadium (event facility) EF is displayed. Furthermore, when posting a comment is provided as a support service, video screen 50 includes post button 51. Post button 51 functions as a position (area) where a touch operation should be performed when posting a comment. When a touch operation is performed on post button 51, video screen 50 changes to comment input mode (not shown). The comment input mode may be provided as appropriate depending on the comment input method, etc. Any appropriate method may be used as a comment input method, such as selecting from a plurality of pre-prepared candidates, but if, for example, free input is used, allowing the user to input any characters, a well-known keyboard image for inputting such characters is displayed, and video screen 50 changes to a comment input mode including such a keyboard image. In this example, a touch operation on post button 51 or a touch operation on a keyboard image or the like in the comment input mode functions as a post operation of the present invention.

[0037] When a comment is input (posted) in the comment input mode, the user terminal device 4 transmits the input result (comment) to the center server 2 (F3). The center server 2 then distributes the received comment (input result) to the user terminal devices 4 of all viewers watching the same captured video (the user who posted the comment and other users) so that the comment is displayed on the video screen 50 (F4). The display of the comment may be implemented as appropriate, and may be implemented on the side of each user terminal device 4 or on the side of the center server 2. In other words, the center server 2 may distribute the video screen 50 with the comment, or each user terminal device 4 that receives information about the comment may add the comment to the video screen 50. In either case, when the comment is posted, the posting is reflected on the video screen 50. Furthermore, the comment may be reflected only on the video screen 50 of the viewer who posted the comment (hereinafter, may be referred to as the poster), or conversely, only on the video screen 50 of viewers other than the poster, or may be limited to the video screen 50 of an appropriate portion of all viewers watching the same filmed video, but as an example, the comment is reflected on the video screen 50 of all viewers without such limitations. In other words, the posting of a comment (support) by one viewer is reflected as a display of the comment (support effect) not only on the video screen 50 of the poster, but also on the video screens 50 of the other viewers.

[0038] As an example, the cheering service is provided in this manner, but since the posted comments are displayed as attachments to the captured video on the video screen 50, the video distribution service and the cheering service (posting of comments) are provided in parallel, and F1 and F2 function as procedures for the video distribution service. In this case, the video distribution service may function as part of the cheering service, or conversely, the cheering service may function as part of the video distribution service. Alternatively, the video distribution service and the cheering service may be understood as independent services.

[0039] On the other hand, when the center server 2 receives a comment posted from the user terminal device 4, it converts the comment into a performance via the performance equipment EA in the stadium EF (F5). This conversion may be achieved by various methods, but as an example, it is achieved through performance data ED. Details of the performance data ED will be described later. As an example, the performance data ED is configured to associate a cheering act, such as posting a comment, with a performance to be realized via the performance equipment EA in response to the act (hereinafter, sometimes referred to as an event performance). Such event performance may be set to change depending on the content (including the degree, such as the number) of the cheering act. Specifically, for example, when a comment is posted as a cheering act, the comment and the event performance may be associated so that the event performance changes depending on, for example, the comment (number of characters, predetermined keywords, etc.). Similarly, when the number of comments (in other words, viewers) posted over a predetermined period is tallied, the comment and the event performance may be associated so that the event performance changes depending on the number. In this way, the event performance may be set as appropriate, but as an example, the same performance (however, multiple performances may be prepared depending on the time or situation) is set regardless of the content of the comment. In other words, regardless of the content of the comment, when the comment is posted, the comment is uniformly converted into a predetermined event effect.

[0040] Various types of event effects may be prepared as appropriate, and the same effects may be prepared regardless of the content of the event. As an example, effects are prepared according to the content of the event. Specifically, event effects are used that appropriately categorize the various cheers performed at each event, such as a soccer event using a typology of soccer cheers, or a sumo event using a typology of sumo cheers. For this reason, in the example of FIG. 4, an effect that categorizes cheers often performed in baseball is prepared as the event effect. For example, at baseball events, cheers from the audience such as "Wow!" or "Oh!" are often heard as cheers. For this reason, these cheers may be prepared as appropriate as event effects, and in the example of FIG. 4, an audio effect that imitates a "Wow!" cheer is prepared as the event effect. As a result, one comment post is converted into an audio effect that imitates a "Wow!" cheer.

[0041] Furthermore, after converting the comments into an event effect (audio effect), the center server 2 controls the effect device EA so that the event effect is actually realized through the effect device EA at the event facility EF (F6). The effect device EA that executes this event effect does not need to change (it may be uniformly the same) regardless of the content of the comment (cheering) or the situation of the baseball game (game), but, as an example, it changes depending on the content of the comment (cheer). Such a change may occur in the content of the event effect, such as changing a cheer of "Wow!" to "Go for it!". In the example of FIG. 4, this is realized by the effect device EA that should execute the event effect, i.e., by changing the speakers SP that are the target of the effect (control), such as all speakers SP in the event facility EF or only some of the speakers SP. Specifically, in the example of FIG. 4, only the speaker SP installed on the third base side, rather than all speakers SP in the event facility EF, is controlled to execute the audio effect that mimics a cheer of "Wow!" In other words, only some of the speakers SP execute the event effect depending on the content of the comment, etc.

[0042] The speaker SP to be used for the effect may be determined as appropriate. For example, when the content of the comment is supportive of the visiting team (generally the team on third base), or when the comment is posted when the visiting team is at bat (generally batting first) (the time of batting may be specified as appropriate, for example, by an event organizer or the like, and the information on the batting team may be appropriately input and specified based on that information), the effect device EA installed on the third base side is controlled as the target for executing the effect in situations where the effect on the third base side should be enhanced. The same is true when the comment is posted when the home team (generally the team on first base) is at bat, and the effect on the first base side should be enhanced. On the other hand, when the entire event facility EF should be excited, for example, when a comment is posted about a home run, all speakers SP installed in the event facility EF are used to add the event effect. In this way, when multiple speakers SP are installed in the event facility EF (generally in different locations), those speakers SP (effect devices EA) are used to add the event effect in appropriate units, such as all or some of them.

[0043] Event effects corresponding to comment posts (acts of support) may be added all at once after counting over a predetermined period, or, as an example, they are added for each comment posted. Furthermore, such effects may be added without any restrictions, or, as an example, they are added with appropriate restrictions. Specifically, if the time to add an effect coincides with a time when the baseball event is actually exciting, such as the moment a home run or hit occurs (a predetermined time that is set in advance) (this may be a time when the baseball event should be exciting. Whether or not this time falls within this time may be determined as appropriate, but, as an example, the event organizer provides information for determining whether or not the current time falls within this time), the time to add the effect is shifted. In other words, the addition of event effects is limited during the time when the baseball event is actually exciting (hereinafter, sometimes referred to as the time limit).

[0044] Event effects corresponding to comments posted within a time limit (which may be a time when the baseball event is actually at its peak, or may be any other appropriate time when adding effects should be avoided) may be added as appropriate after the time limit has elapsed. For example, after the time limit has elapsed, the same number of audio effects corresponding to the number of posts within that time may be added, or, as an example, the audio effects corresponding to those posts are consolidated into one. For this reason, the number of posts within the time limit is tallied, and a single audio effect is added that varies depending on the total number. Audio effects may vary (change) as appropriate depending on the total number (number of comments posted). For example, the audio effects (sounds simulating cheers) change to become more lively as the number of posts (total number) within the time limit increases. Such effects may be performed by a portion of the speakers SP as appropriate, or, as an example, are performed through all speakers SP in the event facility EF. For example, through this procedure, effects (effect services) from the speakers SP (effect devices EA) in the stadium EF are realized in conjunction with the posting of comments (cheering services). In this example, the time limit functions as the predetermined time in the present invention.

[0045] Note that, when a time limit is set, the number of time limits may be any appropriate number. For example, multiple time limits may be set for one event. Furthermore, when two or more time limits are set at relatively short intervals (for example, when multiple time limits are set for one home run at short intervals), the interval between the two time limits (hereinafter, "interval time") and the duration of the audio effect added during that interval may be set appropriately. For example, the interval time and the audio effect duration may be the same or different. Furthermore, when the interval time and the audio effect duration are different, the audio effect duration may be shorter or longer than the interval time. For example, when the audio effect duration is longer than the interval time, the audio effect volume may gradually decrease as the next time limit arrives. In this case, a more natural (less unnatural) audio effect can be achieved compared to when the audio effect ends with the arrival of the next time limit (when the interval time and the audio effect duration are the same). Furthermore, such a change in volume can also create a lingering impression of the audio effect. The audio effect duration may be set to be longer than the end of the next time limit. In this case, it is possible to add overlapping sound effects corresponding to the previous time limit (a lingering effect in which the volume gradually decreases) and sound effects corresponding to the current time limit (a sound effect with maximum volume), thereby realizing an effect that is closer to the cheers that occur at a real event.

[0046] Furthermore, the interval time may be omitted. That is, the time limits may be set continuously without an interval time. In this case, the audio effect corresponding to the tally result for one time limit may be added at any appropriate time, including the subsequent time limit. Specifically, the audio effect corresponding to the tally result for one time limit may be added, for example, for the next time limit. That is, the time limit may be configured to limit the audio effect that individually reflects each comment (not the audio effect corresponding to the tally for a predetermined time, but the normal audio effect that reflects each comment individually as described above), while allowing the audio effect corresponding to the tally result for the corresponding time limit (an example of a special audio effect that differs from the normal audio effect). As a result, the time limit may function simply as a tally period for reflecting the audio effect corresponding to multiple comments. Furthermore, the time limit and the audio effect duration may be set appropriately, not limited to when two or more time limits are set at relatively short intervals. Similarly, the volume change (including the case where it does not change) during the audio effect duration may also be set appropriately.

[0047] Next, the device data DD and the rendering data ED will be described in detail. Fig. 5 is a diagram showing an example of the configuration of the device data DD. The example in Fig. 5 shows device data DD in the case where the rendering device EA to be controlled changes depending on the content of the comment. In this case, as shown in Fig. 5, the device data DD includes a device record DDR that manages the position of each rendering device EA. Furthermore, to realize such management, the device record DDR includes information such as a "device ID," "type," and "position."

[0048] The "device ID" is information indicating a unique device ID for each rendering device EA to identify each rendering device EA. A unique device ID is assigned to each physical device. Therefore, for example, two speakers SP are each assigned two different device IDs. The "type" is information indicating the type of the rendering device EA. The rendering devices EA are distinguished by type information, for example, as a speaker SP or a camera CA. Therefore, for example, type information differs between a speaker SP and a camera CA, but the same type information is assigned between two speakers SP. The "position" is information indicating the location where each rendering device EA is located in the event facility EF. The position of each rendering device EA may be set appropriately depending on the range of the rendering target, for example, the first base side, the third base side, etc. (In the second embodiment described below, it may also be set to indicate the unit of each game machine so that each player can be identified). The device record DDR records these pieces of information so that they are mutually associated. Note that the device data DD is not limited to these pieces of information and may manage appropriate information depending on, for example, control requests. Alternatively, some of this information may be omitted as appropriate.

[0049] Fig. 6 is a diagram showing an example of the configuration of the effect data ED. As shown in Fig. 6, the effect data ED includes an effect record EDR that manages the conditions for each event effect realized by the effect device EA. In order to realize such management, the effect record EDR includes information such as a "effect ID," "effect," "condition," and "target."

[0050] The "effect ID" is information indicating a unique effect ID for each effect to identify each effect. The "effect" is information indicating an effect to be realized via the effect device EA. Specifically, for example, if a speaker SP is used as the effect device EA and an audio effect is added as an event effect, the "effect" describes information indicating the type of cheer, such as "Wow!", that each speaker SP should play as the audio effect. Furthermore, audio effects other than a uniform audio effect (such as "Wow") may be prepared, such as audio effects according to the number of comments within the time limit mentioned above. In such cases, the "effect" also describes information indicating the audio effect according to the number of comments. Specifically, for example, if an audio effect that plays "clap clap" (an onomatopoeia representing applause) is prepared as an effect with three different volume levels (types) according to the number of comments, the "effect" describes information indicating "clap clap" and information indicating its volume.

[0051] On the other hand, the "condition" is information indicating the conditions under which each event effect is applied (realized). Each event effect may be realized appropriately according to various conditions. For example, if the same event effect is realized uniformly in response to the posting of a comment, information indicating that a comment has been posted is described in the "condition." Also, if an effect is realized according to the number of comments within a time limit, information indicating the number of comments is described as a condition in the "condition." Specifically, for example, the above-mentioned three levels of "clap clap" sound effects with different volume levels are associated with conditions indicating the number of comments, such as when the number of comments is 100 or less, when it is 101 to 200, or when it is 201 or more, via the "condition" information. Also, if the effect changes depending on the content of the comments, such various contents (conditions) are described in the "condition."

[0052] "Target" is information indicating the target (control target) rendering device EA for executing each effect. "Target" is used when the target rendering device EA changes depending on the effect (in other words, it may be omitted when the target rendering device EA does not change, such as when all or some of the target rendering devices EA are uniformly controlled). "Target" may contain appropriate information indicating the target rendering device EA, such as a device ID. For example, if all of the rendering devices EA are targets, information indicating all is written, and if some of the rendering devices EA are targets, information indicating some is written. Furthermore, appropriate information indicating some may be used depending on the request for the control unit. For example, information indicating the cheering range corresponding to the cheering team in the comment (such as the third base side when the visiting team is cheered on) or the batting team at the time of the comment is written. The rendering record EDR records these pieces of information so that they are mutually associated. Note that the rendering data ED is not limited to these pieces of information. For example, appropriate information may be managed depending on the request for the effect to be managed (including when rendering devices EA other than speakers SP are used). Alternatively, some of this information may be omitted as appropriate.

[0053] Next, the performance control process and the post-performance process will be described with reference to Figs. 7 and 8. The performance control process and the post-performance process are both processes for controlling the performance device EA to execute an event performance based on cheering actions on the captured video. More specifically, the performance control process is a process for controlling the performance device EA based on cheering actions outside the time limit when a time limit is set. The example of Fig. 7 shows an example of the performance control process for realizing control of the speaker SP (performance device EA) in the example of Fig. 2 in such a case. In this case, the device service management unit 26 starts the performance control process of Fig. 7 every time a comment is posted (a cheering action is performed) outside the time limit, and first obtains the input result (posted comment) entered via the user terminal device 4 (step S101).

[0054] Next, the device service management unit 26 converts the input result (posted comment) acquired in step S101 into an event effect (step S102). This conversion is realized based on the effect data ED. Specifically, the device service management unit 26 references the "condition" and "effect" information in the effect data ED to determine the event effect that corresponds to the condition that a comment is present. The device service management unit 26 then identifies the determined event effect as the object of conversion. In other words, the device service management unit 26 converts the posted comment into the identified event effect. Note that if the effect changes depending on the content of the comment, such various contents (conditions) are described in the "condition," and therefore the device service management unit 26 may reference these conditions in step S102 and identify an event effect that matches the conditions.

[0055] Next, the device service management unit 26 identifies the speaker SP to be controlled, i.e., the speaker SP on which the event effect converted in step S102 should be executed (step S103). This identification is achieved based on the "target" information in the effect data ED and the device data DD as follows: The device service management unit 26 first references the "target" information in the effect data ED and determines the conditions for identifying the control target on which the event effect converted in step S102 should be executed. For example, if the control target changes depending on the supported team in the comment, information indicating the support range of the supported team, etc., is described in the "target." Therefore, the device service management unit 26 identifies the supported team based on the content of the comment. Then, the device service management unit 26 further references the "position" information in the device data DD and identifies each speaker SP located in the range (first base side, etc.) corresponding to the identified supported team as the control target. Similarly, if the control target changes depending on when the comment is posted, information such as the batting team at the time of the comment is described as a condition in the "target." In this case, the device service management unit 26 determines the time when the comment was posted, and refers to the "position" information in the device data DD to identify each speaker SP that is located on the attacking side at the time when the comment was posted as a control target.

[0056] Next, the device service management unit 26 controls the speaker SP identified in step S103 so as to realize the event effects converted in step S102 (step S104). That is, the device service management unit 26 realizes the event effects converted in step S102 through the speaker SP identified in step S103. Then, after such control, the device service management unit 26 ends the current effect control process. As a result, the cheering action (posting of a comment) for the filmed video is converted into an effect by the speaker SP, and this effect is realized by the speaker SP actually installed in the event facility EF. Furthermore, this effect is realized through the speaker SP associated with the cheering action at the event facility EF. That is, as viewers of the filmed video cheer, event effects according to the content of the cheering are added to the event at the event facility EF through the speaker SP.

[0057] On the other hand, the post-performance processing is processing for controlling the performance device EA based on the cheering action performed within a time limit when a time limit is set. The example of Fig. 8 shows an example of the post-performance processing for realizing the control of the speaker SP (performance device EA) in the example of Fig. 2. Furthermore, the performance based on the cheering action (posting of a comment) within the time limit may be added at an appropriate time after the time limit has elapsed, but the example of Fig. 8 shows a case where it is added at a predetermined time after the time limit has elapsed. In this case, the device service management unit 26 starts the post-performance processing of Fig. 8 every time a predetermined time after the time limit has elapsed arrives, and first obtains the input result (posted comment) input via the user terminal device 4 within the most recent time limit (step S201).

[0058] Next, the device service management unit 26 counts (aggregates) the number of comments entered within the most recent time limit based on the input result acquired in step S201 (step S202). This counting may be performed appropriately, and may be performed for each type of event effect if the type differs depending on the content of the cheering action, for example, but if a uniform event effect is added to the posting of a comment regardless of its content, the counting is simply performed to obtain the cumulative number of comments within the time limit.

[0059] Next, the device service management unit 26 converts the comments posted within the time limit (cheerful actions) into an event effect based on the results of acquisition in step S201 and the counting results in step S202 (step S203). This conversion is realized based on the effect data ED, similar to the conversion in step S102 in the example of FIG. 7. Specifically, the device service management unit 26 references the "condition" and "effect" information in the effect data ED to determine an event effect that has the number of comments counted in step S201 as its condition. The device service management unit 26 then specifies the determined event effect as the object of conversion. In other words, the device service management unit 26 converts all comments posted within the time limit into the specified single event effect so as to aggregate them into one.

[0060] Next, the device service management unit 26 identifies the speaker SP to be controlled, that is, the speaker SP that should execute the event rendering converted in step S203 (step S204). Similar to the identification in step S103 in the example of FIG. 7, this identification is achieved as follows based on the "target" information in the rendering data ED and the device data DD. The device service management unit 26 first references the "target" information in the rendering data ED and determines the conditions for identifying the control target that should execute the event rendering converted in step S203. This determination is similar to step S103 in the example of FIG. 7, except that if, for example, information indicating all is entered in the "target" field, the device service management unit 26 references the device data DD and identifies all speakers SP installed in the event facility EF as the control targets.

[0061] Next, the device service management unit 26 controls the speaker SP identified in step S204 so that the event performance converted in step S203 is realized (step S205). That is, the device service management unit 26 realizes the event performance converted in step S203 through the speaker SP identified in step S204. Then, after such control, the device service management unit 26 ends the current post-performance processing. As a result, the number of comments posted within the time limit (number of cheering actions) is counted, and event performance corresponding to the number of posts is realized by the speakers SP (e.g., all speakers SP) actually installed in the event facility EF.

[0062] As described above, according to the first embodiment, cheering behaviors of viewers watching filmed footage of an event are converted into event effects, and the effect device EA is controlled to add the converted event effects to the event. More specifically, comments posted by viewers on the video screen 50 are converted into audio effects that mimic cheers like "Wow!", and the speaker SP is controlled to play the audio effects. That is, the video screen 50 including filmed footage of a baseball event is displayed on the user terminal device 4, and comments posted to add comments to the video screen 50 are accepted. The posted comments are converted into audio effects by the speaker SP, and the audio effects are actually added to the baseball event. This allows viewers' reactions to the filmed footage, such as posting comments, to be reflected in the baseball event as audio effects by the speaker SP installed in the stadium EF. Specifically, viewers' excitement, such as posting comments in response to tense moments or the success of a favorite player, can be reflected in the actual baseball event through audio effects. As a result, a baseball event can be realized that is more realistic for the players playing the baseball (or the viewers watching the baseball event) than when such audio effects are not added.

[0063] Furthermore, when the event effects change in response to cheering behaviors, specific cheering behaviors can be encouraged through such changes in the event effects. For example, in the example of FIG. 4, a uniform audio effect is added as an event effect outside the time limit, but during the time limit, an event effect is added according to the cumulative number of comments during that time, so that the more the cumulative number, the more lively the event effect becomes. In this case, such changes in the event effects can encourage an increase in the number of comments posted during the time limit. As a result, for example, if the time limit is set for a home run, the posting of comments for that home run can be further encouraged, and the event effects for subsequent home runs can be made more lively.

[0064] Furthermore, in baseball events, sound effects that mimic cheers such as "Wow!" are used as event effects corresponding to the posted comments, but such sound effects change depending on the type of event. For example, in the case of soccer, sound effects that mimic soccer cheers are used as event effects. Generally, effective effects tend to differ depending on the type of event, and if different sound effects that match the cheers at that event are used depending on the type of event, this tendency can be reflected and more effective event effects can be achieved.

[0065] In the first embodiment, the device service management unit 26 of the center server 2 functions as the performance conversion means and device control means of the present invention by executing the performance control process of Fig. 7 or the post-performance process of Fig. 8. Specifically, the device service management unit 26 of the center server 2 functions as the performance conversion means by executing the process of step S102 of Fig. 7 or the process of step S203 of Fig. 8. Furthermore, the device service management unit 26 of the center server 2 functions as the device control means by executing the process of step S104 of Fig. 7 or the process of step S205 of Fig. 8.

[0066] (Second form) A video distribution system 1B according to a second embodiment will be described with reference to Figs. 9 to 12. Fig. 9 is a diagram showing a schematic configuration of the video distribution system 1B according to the second embodiment. The video distribution system 1B according to the second embodiment corresponds to an example of the configuration of the video distribution system 1 when an event using a game provided by a game machine 3 (hereinafter, sometimes referred to as a game event) is held as a type of event. In this case, as shown in Fig. 9, the game machines 3 installed in the event facility EF are connected to the center server 2 via a network NT.

[0067] The game machine 3 is a device that provides games. The game machine 3 may be a variety of computer devices (including user terminal devices 4) for personal use, such as a stationary or portable game machine (including a tablet or smartphone) or a stationary or notebook-type personal computer. However, in the example of FIG. 9, an arcade game machine is used. Arcade game machines are computer devices installed in various facilities, such as stores, primarily for the purpose of generating revenue by having many users repeatedly play games. For this reason, the game machine 3 is configured as a commercial (business-use) game machine (a game machine that provides games for a fee) that allows users to play games within a range corresponding to a predetermined play fee in exchange for the payment of the play fee. When the game machine 3 is installed in an event facility EF, it may provide games in exchange for a predetermined play fee, just as when it is installed in a store or the like. However, in the example of FIG. 9, games are provided free of charge for events.

[0068] The game machine 3 may provide appropriate games for game events, such as action games, simulation games, role-playing games, timing games (music games), or sports games. The game machine 3 may provide these games for single (solo) play or for multiplayer play. In the case of multiplayer play, the games may be provided as competitive or cooperative games (including cases where the opponent or the cooperator is a computer) in appropriate formats such as one-on-one, one-on-many (team), or many-on-many (the number of players may be the same or different). For this reason, an appropriate number of game machines 3 may be installed at the event venue EF depending on the type of game. In the example of FIG. 9, two or more game machines 3 are installed at the event venue EF. These two game machines 3 each provide a competitive game in which two users P (hereinafter, sometimes referred to as players P) playing the game via the two game machines 3 compete one-on-one.

[0069] A game event may be configured as a competition in which results are competed for in an appropriate format, such as a tournament or league match, or may simply be configured as a gathering where players show off their skills. A game event may also be an event without spectators or an event with spectators. While a game event may be configured as appropriate depending on the type of game, etc., in the example of FIG. 9, it is configured as an event with spectators, with spectators PA present to watch two players P playing against each other on a stage via two game machines 3.

[0070] At the event venue EF, various effects may be executed to produce (liven up) the game event, and the effect equipment EA may include various devices for realizing such various effects, and in the example of Fig. 9, it includes a light unit LU, a speaker SP, a smoke device SU, a monitor MO, and a camera CA. In other words, at the event venue EF, these light unit LU, speaker SP, smoke device SU, monitor MO, and camera CA are installed as effect equipment EA (although the example of Fig. 9 shows one of each device, these are not limited to one, and any appropriate number may be installed).

[0071] The light unit LU is a well-known lighting device that produces various visual effects using illumination (light), such as lighting, blinking, extinguishing, or appropriate coloring. The smoke device SU is a well-known device that produces visual effects by generating an appropriate amount of smoke. The monitor MO is a well-known display device that displays various images (including images for effects or various information). For example, the monitor MO may appropriately display images for effects, such as images captured by the camera CA or game screens provided by each game machine 3.

[0072] Furthermore, as described above, the device services may include various services as appropriate, but in the case of the video distribution system 1B according to the second embodiment, they include an information acquisition service. The information acquisition service is a service for acquiring information (including replay data and image data) about the playing status of each player P from each game machine 3. For example, if information about the playing record of each player P is managed as part of the server data 23 in the center server 2 via various data such as play data, the device services may also include a data update service for reflecting the information about the playing status in such data.

[0073] Fig. 10 is a functional block diagram showing the main parts of a control system of a video distribution system 1B according to the second embodiment. In the video distribution system 1B according to the second embodiment, a game machine 3 is added to the devices connected to the center server 2, compared to the video distribution system 1B according to the first embodiment (the example of Fig. 2). As shown in Fig. 10, such a game machine 3 is provided with a control unit 31 as a computer and a storage unit 32 as storage means. The control unit 31 is configured as a computer that combines a CPU as an example of a processor that executes various arithmetic processes and operational controls according to a predetermined computer program, with an internal memory and other peripheral devices required for its operation.

[0074] The control unit 31 is provided with a game control unit 33 and a data management unit 34 as logical devices realized by combining the hardware resources of the control unit 31 and the game program PG3 as software resources. The game control unit 33 executes various processes necessary for providing the game (including various processes necessary for receiving device services). Similarly, the data management unit 34 executes various processes for managing data stored in the storage unit 32 (including various processes necessary for receiving device services). Such processes include, for example, processes for generating or transmitting image data for displaying a game screen.

[0075] The storage unit 32 is an external storage device realized by a storage unit including a non-volatile storage medium (computer-readable storage medium) such as a hard disk or semiconductor storage device. The storage unit 32 stores various data along with the game program PG3 described above, and the example in FIG. 10 shows game data GD. The game data GD is data that is referenced as needed to allow the user to play the game in accordance with the game program PG3. The game data GD may include various types of data, such as audio data for playing game sounds, image data for displaying game screens, the above-mentioned play data, or ID management data, as appropriate.

[0076] The game machine 3 may be appropriately equipped with various output devices and input devices necessary for an arcade game machine and connected to the control unit 31. In the example of FIG. 10, a monitor 36 and a speaker 37 are provided as output devices, and an input device IP is provided as an input device. The monitor 36 and the speaker 37 are well-known display devices that display various images related to the game, such as game screens, and a well-known audio output (playback) device that plays audio, respectively. The input device IP is a device through which the player P inputs various play actions to be performed in order to play the game. Various input devices, such as push button switches or touch panels, may be appropriately adopted as the input device IP depending on the type of game, etc. As described above, the effect equipment EA of the second embodiment includes a light unit LU, a smoke device SU, a monitor MO, etc., which are also connected to the center server 2. However, in the example of FIG. 10, these are omitted from the illustration, and only a camera CA and a speaker SP are shown as the effect equipment EA.

[0077] Next, the details of the rendering service according to the second embodiment will be described with reference to FIG. 11. FIG. 11 shows an example of the flow of the rendering service according to the second embodiment. Similarly to the first embodiment, the example of FIG. 11 shows a case where the rendering of the rendering device EA is linked to the cheering service, and a service for posting a comment is provided as an example of the cheering service. On the other hand, in the rendering service according to the second embodiment, the status of the game machine 3 is reflected in the rendering linked to the cheering act (posting a comment). Therefore, as shown in FIG. 11, the rendering service according to the second embodiment has an additional step F5A compared to the rendering service according to the first embodiment (example of FIG. 4). As a result, the rendering service according to the second embodiment includes three steps F5A, F5B, and F6.

[0078] Specifically, the support service includes steps F1 to F4, similar to the example in FIG. 4. These steps may be implemented in the same manner as in the example in FIG. 4. On the other hand, in the production service according to the second embodiment, information is transmitted from the game device 3 (F5A), a step not included in the example in FIG. 4. This transmission may be performed periodically or triggered by various actions (processes), such as posting a comment (F3). In the example in FIG. 11, the transmission of a comment to the video screen 50 (F4) is triggered, and the game device 3 transmits the information in response to a request from the center server 2 accompanying (or after) the transmission. The event production corresponding to the comment posting may appropriately reflect various situations in the game device 3 depending on the circumstances of the production, and as an example, the game play situation is reflected. Therefore, triggered by the comment transmission, the game device 3 transmits information about the game play situation at the time of the comment transmission to the center server 2.

[0079] When the center server 2 acquires information about the play situation from the game machine 3, it converts the posted comment into a performance (not only the speaker SP but also the light unit LU, the smoke device SU, or the monitor MO, etc., may be used as appropriate) through the performance equipment EA at the event facility EF (F5B). This conversion is realized in the same manner as the procedure F5 in the example of FIG. 4. However, the play situation may be appropriately reflected in this conversion. For example, if a baseball game equivalent to the baseball game in the first mode is provided, information about the play situation may be used (reflected) to determine when an attack is occurring. Furthermore, the content of the event performance may be reflected in the form of audio performance (or a display on the monitor MO), such as "Nice hit!" immediately after a hit or "Nice home run!" immediately after a home run. In other words, the event performance may change (vary) depending on the play situation of the game. In this case, the "performance" in the performance data ED describes information indicating cheers corresponding to "Nice hit!" or "Nice home run!" (if performance equipment EA such as the monitor MO is used for performance, such performance may include such cheers). In addition, the "condition" of the effect data ED describes information indicating the conditions for a hit or a home run. In either case, when the play situation is reflected in the conversion of the effect, the center server 2 converts the comment post into an event effect based on the play situation.

[0080] After converting the event effects into the event effects, the center server 2 controls the effect devices EA in the same manner as in the procedure F6 in the example of FIG. 4 so that the event effects are actually realized through the effect devices EA at the event facility EF (F6). However, this control may appropriately reflect the play situation. Specifically, for example, the batting team is determined based on the play situation, and the effect devices EA to be controlled are identified. In other words, the effect devices EA to be controlled are appropriately changed depending on the play situation. Furthermore, for example, when a baseball game equivalent to the baseball game in the first embodiment is provided, information on the play situation may be used (reflected) to determine the time limit. Specifically, the center server 2 may refer to information on the play situation and determine whether comments were posted during the exciting time (time limit) when a hit or the like occurred. Furthermore, the center server 2 may count the number of comments during the time limit and add them together as a single effect, as in the example of FIG. 4, or may add each comment during the time limit by adjusting its timing individually. For example, when an event organizer sets a time limit, the time limit may not only be the exact moment of excitement, such as immediately after a hit, but also a certain period before or after that. On the other hand, when the time limit is determined based on the play situation, it is highly likely that the time limit will be set more accurately than if it were set by the event organizer, such as only immediately after a hit. For this reason, in the second form, unlike the first form, the center server 2 may individually adjust the timing of the effect corresponding to each comment post, rather than aggregating all the comments posted during the time limit into one and adding it to the added time.

[0081] Next, the effect adjustment process will be described with reference to FIG. 12 . The effect adjustment process is a process executed instead of the effect control process shown in FIG. 7 and the post-effect process shown in FIG. 8 when the timing of the event effect corresponding to each comment posted within the time limit is individually adjusted. More specifically, when a time limit is set, the effect adjustment process is a process for individually adjusting the timing of the effect corresponding to each comment posted within the time limit and for realizing the effect corresponding to each comment posted outside the time limit as needed. Note that, for example, when each comment posted within the time limit is added as a single event effect at a predetermined time, the effect control process shown in FIG. 7 and the post-effect process shown in FIG. 8 may also be executed in the second embodiment. In this case, information on the game play status may be referenced as appropriate, for example, to determine the time limit. Alternatively, the information may be referenced in the conversion in step S102 or the control in step S103 in FIG. 7 .

[0082] The device service management unit 26 starts the effect adjustment process of FIG. 12 each time a comment is posted. First, the device service management unit 26 acquires the input result (posted comment) input via the user terminal device 4 (step S301). Next, the device service management unit 26 acquires the game play status from the game machine 3 (step S302). Upon acquiring the play status, the device service management unit 26 converts the posted comment into an event effect based on the play status information and the input result acquired in step S301 (step S303). This conversion is realized, for example, in the same manner as the conversion in step S102 in the example of FIG. 7. However, in this conversion, the device service management unit 26 may refer to information about the game play status as appropriate. Specifically, for example, if the event effect differs depending on the game play status, the device service management unit 26 converts the event effect into an event effect according to the play status while referring to the "effect" and "condition" information in the effect data ED.

[0083] Next, the device service management unit 26 determines whether the adjustment condition is satisfied (step S304). The adjustment condition may be satisfied as appropriate, but if the adjustment is realized within the time limit, it is satisfied when the comment posting time falls within the time limit. For this reason, the device service management unit 26 refers to the play situation information acquired in step S302 and determines whether the comment posting time falls within the time limit (the exciting period when a hit or the like occurs). If the comment posting time falls within the time limit (if the adjustment condition is satisfied), the device service management unit 26 adjusts the timing of the event presentation corresponding to the comment posting (presentation timing) (step S305). Specifically, the device service management unit 26 adjusts the presentation timing to a predetermined time after the time limit has elapsed (for example, immediately afterward), rather than the comment posting time (which may be slightly delayed due to various processes or the communication environment of the network NT, etc., but the posting timing takes these delays into consideration). In addition, when a plurality of comments are posted within the time limit, the performance timing of each comment is shifted in order from a predetermined time so that the performance corresponding to each comment is executed in order after the time limit has elapsed according to the posting time.

[0084] On the other hand, if the comment posting time does not correspond to the time limit (the adjustment condition is not satisfied), or after adjusting the performance time in step S305, the device service management unit 26 identifies the control target (step S306). This identification is realized, for example, in the same manner as the identification in step S103 in the example of FIG. 7. However, in this identification, the device service management unit 26 may refer to the play situation as appropriate. Specifically, for example, if the control target changes depending on the comment posting time, the device service management unit 26 determines the conditions of the "target" at the time of attack, etc., while referring to information about the play situation.

[0085] Next, the device service management unit 26 controls each speaker SP (step S307). This control is realized in the same manner as the control in step S104 in the example of FIG. 7, for example. As a result, as in the example of FIG. 7, the posting of each comment is converted into an effect, and the effect is actually realized through speakers SP, etc. at the event facility EF. Furthermore, if comments are posted within a time limit, the timing of the event effect corresponding to each comment is adjusted, and after the time limit has passed, the event effect corresponding to each comment is gradually added to the event at the event facility EF through speakers SP, etc.

[0086] As described above, according to the second embodiment, as in the first embodiment, cheering actions of viewers watching the filmed video of the event are converted into event effects, and the effect devices EA are controlled so that the converted event effects are added to the event. Therefore, the same effects as in the first embodiment can be obtained, but in the second embodiment, information on the game play situation is further referenced to convert the event effects or identify the effect device EA to be controlled. As a result, the game play situation on the game machine 3 can be reflected in the event effects. This makes it possible to realize more detailed and accurate event effects.

[0087] In the second embodiment, the device service management unit 26 of the center server 2 functions as the performance conversion means and device control means of the present invention by executing the performance adjustment process of Fig. 12. Specifically, the device service management unit 26 functions as the performance conversion means by executing step S303 of Fig. 12. Furthermore, the device service management unit 26 functions as the device control means of the present invention by executing the process of step S305 and the process of step S307 of Fig. 12.

[0088] The present invention is not limited to the above-described embodiment, and may be embodied in an embodiment with appropriate modifications or changes. For example, all or part of the role (various processes, etc.) of the center server 2 in the above-described embodiment may be appropriately performed by another system (or device), such as a local system, a game machine 3 (in the second embodiment), or a user terminal device 4. In other words, the video distribution system of the present invention may include various other systems as appropriate. On the other hand, only the center server 2 may function as the video distribution system of the present invention, or only other appropriate systems, such as a local system, a game machine 3 (in the second embodiment), or a user terminal device 4, may function as the video distribution system of the present invention.

[0089] Various aspects of the present invention derived from the above-described embodiments and modifications will be described below. In the following description, corresponding components shown in the accompanying drawings will be written in parentheses to facilitate understanding of each aspect of the present invention, but the present invention is not limited to the illustrated forms.

[0090] The video distribution system of the present invention is a video distribution system (1) that is connected via a network (NT) to user terminal devices (4) used by each user and to performance equipment (EA) installed in an event facility (EF) to add performance effects, and distributes the captured video to the user terminal devices so that a video screen (50) including the captured video as the result of filming an event held at the event facility is displayed on a display device (46) installed in the user terminal devices, and is equipped with performance conversion means (26) that, when each viewer as a user watching the captured video performs a cheering action to add a cheering effect to the event on the video screen via the user terminal devices, converts the cheering action into an event performance to be performed by the performance equipment, and device control means (26) that controls the performance equipment so that the event performance is added to the event as the performance.

[0091] According to the present invention, cheering actions by viewers watching filmed video of an event are converted into event effects, and the effect-generating equipment is controlled so that the converted event effects are added to the event as effects. In other words, a video screen including filmed video of the event is displayed on a user terminal device, and cheering actions for adding cheering effects to the video screen are accepted. The cheering actions are converted into event effects by the effect-generating equipment, and the event effects are actually added to the event. This allows viewers' reactions to the filmed video, such as cheering actions, to be reflected in the event as effects by the effect-generating equipment installed at the event facility. Specifically, for example, viewers' excitement can be reflected in the actual event through the event effects. As a result, a more realistic event can be realized than when such event effects are not added.

[0092] The event effects may be uniformly the same regardless of the content (conditions) of the cheering acts, such as the timing, number, and type, or may change depending on these contents. For example, in one aspect of the video distribution system of the present invention, the effect conversion means may convert the cheering acts into the event effects so that the event effects change depending on the cheering acts of each viewer. In this case, cheering acts of a specific content can be promoted through the change in the event effects. For example, in this aspect, the effect conversion means may convert the cheering acts into the event effects so that, when multiple viewers each perform the cheering acts in a predetermined period of time, the event effects change depending on the number of cheering acts in the predetermined period of time. In this case, the change in the event effects can promote an increase in the number of cheering acts in the predetermined period of time.

[0093] As cheering acts, various actions that produce various effects on the video screen may be appropriately executed via the user terminal device. For example, cheering acts may include purchasing an item, donating various values ​​(which may be values ​​equivalent to real currency or virtual values ​​used in a game, etc.) (so-called tipping), posting various comments on the video screen, and the like. These various actions may then be appropriately converted into event effects. Specifically, for example, in one aspect of the video distribution system of the present invention, when a posting operation of posting a comment to be displayed as the cheering effect on the video screen is input as the cheering act, the effect conversion means may convert the posting of the comment into the event effect.

[0094] As described above, the event effects may be uniform or variable, but even if they are uniform, they may be uniform regardless of the event or may be uniform for each event. In other words, the event effects may or may not change for each event. For example, in one aspect of the video distribution system of the present invention, the effect conversion means may convert the cheering behavior into the event effect so that the event effect differs depending on the event. Generally, effective effects tend to differ depending on the type of event, and in this case, such tendency can be reflected to achieve more effective event effects.

[0095] The performance equipment may include various devices (apparatuses) for realizing the performance. For example, the performance equipment may appropriately include a display device, a light, a smoke device, etc. that add visual effects. The performance equipment may also include an audio output device that adds auditory effects. Appropriate performances may then be realized through these various performance equipment. Specifically, for example, in one aspect of the video distribution system of the present invention, the performance conversion means may include an audio output device (SP) that outputs audio to the performance equipment, and when the performance includes an audio performance through the audio, the performance conversion means may convert the cheering behavior into the event performance so that the audio cheering for the event is included in the event performance as the audio performance that varies depending on the event.

[0096] Various events may be held at an event facility from time to time. For example, various sporting events such as baseball, sumo, soccer, and rugby may be held at an event facility. Similarly, various live events such as concerts may be held at an event facility. Alternatively, game events using game machines may be held at an event facility. Furthermore, when various devices, such as game machines for game events, are installed at an event facility, information about those devices may or may not be reflected in the event presentation. Specifically, for example, in one aspect of the video distribution system of the present invention, a game machine (3) that provides a game is installed at the event facility, and a game event using the game is held as the event. When the game machine is connected via a network (NT), the device control means may control the presentation device to adjust the timing of the event presentation depending on the status of the game. Furthermore, for example, in one aspect of the video distribution system of the present invention, a game machine (3) that provides a game is installed in the event facility, a game event using the game is held as the event, and when the game machine is connected via a network (NT), the effect conversion means may convert the cheering behavior into the event effect so that the event effect varies depending on the status of the game. In these cases, the status of the game on the game machine can be reflected in the event effect.

[0097] If multiple production devices are installed in an event facility, the event production may be performed by all of the production devices or by a suitable portion of the production devices. Furthermore, these target production devices (the target production devices that perform the event production, such as all of the production devices when the event production is performed by all of the production devices, or only a portion of the production devices when the event production is performed by only a portion of the production devices) may be fixed or variable. If the target production devices are variable (changeable), the differences between the production devices may be considered part of the event production, or the differences between the production devices may be considered as elements separate from the event production. For example, in one aspect of the video distribution system of the present invention, if the production devices include multiple production devices installed in different locations in the event facility, the device control means may change the production device that is to perform the event production among the multiple production devices according to the status of the game.

[0098] On the other hand, the computer program of the present invention is configured to cause the user terminal device and a computer (21) connected to the performance equipment via the network to function as each means of the above-mentioned video distribution system.

[0099] Furthermore, the control method of the present invention causes a computer (26) incorporated in a video distribution system (1) that is connected via a network (NT) to user terminal devices (4) used by each user and to effecting equipment (EA) installed at an event facility (EF) to add effects, and that distributes filmed video of an event held at the event facility to the user terminal devices so that a video screen (50) including the filmed video of the event filmed is displayed on a display device (46) installed in the user terminal devices, to execute a effect conversion procedure for converting a cheering action performed by each viewer as a user watching the filmed video into an event effect to be executed by the effecting equipment, when the viewer performs a cheering action to add a cheering effect to the event on the video screen via the user terminal device, and a device control procedure for controlling the effecting equipment so that the event effect is added to the event as the effect. Execution of these computer programs or control methods makes it possible to realize the video distribution system of the present invention. [Explanation of symbols]

[0100] 1. Video distribution system 2. Central server 3. Game consoles 4. User terminal equipment 21 Control unit (computer) 26 Equipment service management unit (performance conversion means, equipment control means) 46 monitors 50 Video Screen EA production equipment EF Event Facilities NT Network SP Speaker (audio output device) PG1 Server program (computer program)

Claims

1. The system is connected via a network to user terminal devices used by each user and to performance equipment installed at the event facility to add performance effects, A video distribution system that distributes a video screen including a captured video of a game event held at the event facility, in which the game is used, to the user terminal device, a performance conversion means for converting, when each viewer as a user viewing the captured video performs an action to generate various effects on the video screen via the user terminal device, the action to generate the various effects into an event performance to be executed by the performance device; a device control means for controlling the effect device so that the event effect is reflected in the game event as the effect; The effect conversion means converts the actions that produce the various effects into the event effects so that the event effects differ depending on the situation of the game.

2. A system connected via a network to user terminal devices used by each user and to performance equipment installed at an event facility to add performance effects, A video distribution system that distributes a video screen including a captured video of a game event held at the event facility, in which the game is used, to the user terminal device, a performance conversion means for converting, when each viewer as a user viewing the captured video performs an action to generate various effects on the video screen via the user terminal device, the action to generate the various effects into an event performance to be executed by the performance device; a device control means for controlling the effect device so that the event effect is reflected in the game event as the effect; The device control means controls the effect device to adjust the timing of the event effect according to the status of the game.

3. A computer program configured to cause the user terminal device and a computer connected to the performance equipment via the network to function as each means of the video distribution system described in claim 1 or 2.

4. A system connected via a network to a user terminal device used by each user and to production equipment installed at an event facility to add production effects, a computer incorporated in a video distribution system that distributes a video screen including a captured video of a game event held at the event facility, the game event using a game, to the user terminal device; a performance conversion procedure for converting, when each viewer as a user viewing the captured video performs an action to generate various effects on the video screen via the user terminal device, the action to generate the various effects into an event performance to be executed by the performance device; a device control procedure for controlling the effect device so that the event effect is reflected in the game event as the effect; The effect conversion procedure is a control method for converting actions that produce the various effects into the event effects so that the event effects differ depending on the situation of the game.

5. A system connected via a network to a user terminal device used by each user and to production equipment installed at an event facility to add production effects, a computer incorporated in a video distribution system that distributes a video screen including a captured video of a game event held at the event facility, the game event using a game, to the user terminal device; a performance conversion procedure for converting, when each viewer as a user viewing the captured video performs an action to generate various effects on the video screen via the user terminal device, the action to generate the various effects into an event performance to be executed by the performance device; a device control procedure for controlling the effect device so that the event effect is reflected in the game event as the effect; The device control procedure is a control method for controlling the effect device so as to adjust the timing of the event effect according to the situation of the game.

Images