Moving image distribution system, moving image distribution method, and program

Abstract

To obtain a sense of presence in live viewing, video distribution, and the like, as if a user is in a live venue (site).SOLUTION: A moving image distribution system 1 distributes an event moving image to a spectator, and comprises: an imaging device 100 that captures a moving image of an event venue; a behavior detection device 200 that detects a behavior of a user who views the moving image of an event at a location different from the event venue; and a server 300 that generates display information according to the behavior of the user detected by the behavior detection device 200, generates an image in which display information is added to the moving image of the event venue in real time; and displays the image on a screen disposed at a location different from the event venue.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a video distribution system, a video distribution method, and a program. [Background technology]

[0002] Live streaming services for content such as videos are known to allow viewers to post comments and for streamers to respond to those comments, aiming to provide an interactive viewing experience. In recent years, live content streaming services that incorporate a tipping function have also been proposed.

[0003] For example, in an information providing system that provides a sharing service for content such as videos, a technology has been disclosed that provides a function equivalent to giving gifts or presents to content performers (see, for example, Patent Document 1).

[0004] This type of technology can provide incentives for streamers to create content by implementing a tipping function. In addition, by superimposing the viewer's name (nickname) and comments on the content in addition to an icon corresponding to the amount paid by the viewer, the tipping function also contributes to the creation of two-way communication, such as streamers thanking viewers who have made tips, and other viewers responding to large tips. Furthermore, spectators who have donated can show the streamer and other spectators how much they have donated. In other words, the tipping function also has the aspect of stimulating the audience's desire for self-expression. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2012-120098 Summary of the Invention [Problem to be solved by the invention]

[0006] However, with the technology described in Patent Document 1, even if it is possible to foster two-way communication between the poster and the distributor as described above, there is a problem in that it is a completely different technology that cannot meet the expectations of users who want to feel as if they are at a live concert venue, for example, in live viewing or video distribution.

[0007] Therefore, the present invention has been made in consideration of the above-mentioned problems, and aims to provide a video distribution system, a video distribution method, and a program that enable users to experience a sense of realism as if they were actually at the live venue (site) during live viewing, video distribution, etc. [Means for solving the problem]

[0008] Form 1: One or more embodiments of the present invention propose a video distribution system for distributing video of an event to spectators, comprising: an imaging device for capturing video of the event venue; a behavior detection device for detecting the behavior of users viewing the video of the event at a location separate from the event venue; and a server for generating display information according to the user behavior detected by the behavior detection device, generating an image in real time by adding the display information to the video of the event venue, and displaying the image on a screen located at a location separate from the event venue.

[0009] Mode 2: One or more embodiments of the present invention propose a video image distribution system characterized in that the display information is information relating to a virtual value.

[0010] Mode 3: One or more embodiments of the present invention propose a video image distribution system characterized in that the display information is information related to a cheering message.

[0011] Mode 4: One or more embodiments of the present invention propose a video image distribution system in which the behavior detection device is a smartphone equipped with a motion sensor.

[0012] Form 5: One or more embodiments of the present invention propose a video distribution system for distributing video of an event to spectators, comprising: an imaging device for capturing video of the event venue; a behavior detection device for detecting the behavior of users viewing the video of the event at a location separate from the event venue; and a server for generating display information according to the user behavior detected by the behavior detection device, generating an image in real time by adding the display information to the video of the event venue, and displaying the image on a display unit of the behavior detection device.

[0013] Form 6: One or more embodiments of the present invention propose a video distribution system for distributing video of an event to spectators, comprising: an imaging device for capturing video of the event venue; a behavior detection device for detecting the behavior of users viewing the video of the event at a location separate from the event venue; a server for receiving video data from the imaging device via a network; and an image processing device for generating display information according to the user behavior detected by the behavior detection device, and for generating image information by adding the display information to the video generated from the video data of the event venue received by the server in real time, and displaying the image information on a screen located at a location separate from the event venue.

[0014] Mode 7: One or more embodiments of the present invention propose a video image distribution system in which the behavior detection device is AR glasses equipped with a motion sensor.

[0015] Mode 8: One or more embodiments of the present invention propose a video image distribution system characterized in that the behavior detection device is VR glasses equipped with a motion sensor.

[0016] Mode 9: One or more embodiments of the present invention propose a video distribution system characterized in that the video is a live video.

[0017] Form 10: One or more embodiments of the present invention propose a video distribution method in a video distribution system including an imaging device, a behavior detection device, and a server, which distributes video of an event to spectators, the video distribution method comprising: a first step in which the imaging device captures video of the event venue; a second step in which the server acquires video of the event venue; a third step in which the behavior detection device detects the behavior of a user watching the video of the event at a location separate from the event venue; and a fourth step in which the server generates display information according to the user's behavior detected by the behavior detection device, generates an image by adding the display information to the video of the event venue, and projects the image on a screen located at a location separate from the event venue.

[0018] Form 11: One or more embodiments of the present invention propose a program for causing a computer to execute a video distribution method in a video distribution system including an imaging device, a behavior detection device, and a server, which distributes video of an event to spectators, the program causing a computer to execute the following steps: a first step in which the imaging device captures video of the event venue; a second step in which the server acquires video of the event venue; a third step in which the behavior detection device detects the behavior of a user watching the video of the event at a location separate from the event venue; and a fourth step in which the server generates display information according to the user's behavior detected by the behavior detection device, generates an image by adding the display information to the video of the event venue, and projects the image on a screen located at a location separate from the event venue. [Effects of the Invention]

[0019] According to one or more embodiments of the present invention, in live viewing, video distribution, etc., users can experience a sense of realism as if they were actually at the live venue (site). [Brief explanation of the drawings]

[0020] [Figure 1] 1 is a diagram showing a configuration of a video distribution system according to a first embodiment of the present invention. [Figure 2] 1 is a configuration diagram of a behavior detection device according to a first embodiment of the present invention. [Figure 3] FIG. 2 is a diagram illustrating a configuration of a server according to the first embodiment of the present invention. [Figure 4] 2 is a diagram showing a database stored in a storage unit of the behavior detection device according to the first embodiment of the present invention. FIG. [Figure 5] 1A and 1B are diagrams illustrating display images according to the first embodiment of the present invention. [Figure 6] FIG. 2 is a diagram showing the processing of the video distribution system according to the first embodiment of the present invention. [Figure 7] FIG. 10 is a diagram showing the configuration of a video distribution system according to a second embodiment of the present invention. [Figure 8] FIG. 10 is a diagram illustrating a configuration of a behavior detection device according to a second embodiment of the present invention. [Figure 9] FIG. 10 is a diagram illustrating a configuration of a server according to a second embodiment of the present invention. [Figure 10] FIG. 10 is a diagram showing the processing of a video distribution system according to a second embodiment of the present invention. [Figure 11] FIG. 10 is a diagram showing the configuration of a video distribution system according to a third embodiment of the present invention. [Figure 12] FIG. 10 is a configuration diagram of an image generating device according to a third embodiment of the present invention. [Figure 13] FIG. 10 is a diagram showing the processing of a video distribution system according to the third embodiment of the present invention. DETAILED DESCRIPTION OF THE INVENTION

[0021] Hereinafter, an embodiment of the present invention will be described with reference to FIGS.

[0022] First Embodiment Hereinafter, a video distribution system 1 according to this embodiment will be described with reference to FIGS.

[0023] <Configuration of video image distribution system 1> As shown in FIG. 1, a video distribution system 1 according to this embodiment includes an imaging device 100, a behavior detection device 200, and a server 300.

[0024] The imaging device 100 is a camera or the like that is installed at an event venue and captures moving images of the event venue. The moving images captured by the imaging device 100 are displayed on a screen 1 set up in the event venue. The moving image data captured by the imaging device 100 is transmitted to a server 300 (described later) via, for example, the Internet.

[0025] The behavior detection device 200 detects the behavior of a user who is viewing a video of an event at a location (viewing venue) separate from the event venue. In this embodiment, a smartphone equipped with a motion sensor will be exemplified as the behavior detection device 200 and will be described below. The behavior detection result of the behavior detection device 200 is transmitted to a server 300 (described later) via, for example, the Internet network.

[0026] The server 300 generates display information according to the user behavior detected by the behavior detection device 200. The server 300 generates an image in real time by adding the generated display information to the moving image of the event venue input from the imaging device 100, and displays the image on a screen 2 located in a location (viewing venue) separate from the event venue.

[0027] <Configuration of behavior detection device 200> As shown in FIG. 2, the behavior detection device 200 according to this embodiment includes a communication unit 210, a motion sensor unit 220, and a control unit 230.

[0028] The communication unit 210 transmits, for example, sensing data of the motion sensor unit 220 (described later) to the server 300 via, for example, the Internet network.

[0029] The motion sensor unit 220 is a sensor used to detect, for example, the movement, position, vibration, etc. of the smartphone, and examples thereof include an acceleration sensor, a gyro sensor, and a magnetic sensor. The sensing data of the motion sensor unit 220 is transmitted to the server 300 via the Internet network.

[0030] The control unit 230 controls the overall processing of the behavior detection device 200 in accordance with a control program stored in, for example, a ROM (Read Only Memory) or the like. In this embodiment, the control unit 230 executes, for example, communication control processing in the communication unit 210, operation of the motion sensor unit 220, and processing for acquiring sensing data.

[0031] <Configuration of Server 300> The configuration of the server 300 in the video distribution system 1 according to this embodiment will be described with reference to FIGS.

[0032] As shown in FIG. 3, the server 300 according to this embodiment includes a communication unit 310, a storage unit 320, a display image generation unit 330, and a control unit 340.

[0033] The communication unit 310 receives from the imaging device 100 moving image data captured at the event venue. The video data received by the communication unit 310 is output to the control unit 340, which will be described later. The communication unit 310 receives the sensing data from the behavior detection device 200 . The sensing data received by the communication unit 310 is output to the control unit 340, which will be described later. The communication unit 310 transmits to the screen 2 an image in which a display image generated by a display image generation unit 330 (described later) is added to a moving image of the event venue.

[0034] The storage unit 320 is configured by, for example, a RAM (Random Access Memory) or the like, and in this embodiment stores a database in which behavior modes obtained from sensing data are associated with display image types. The storage unit 320 also stores display images corresponding to the display image types. Furthermore, the storage unit 320 temporarily stores the moving image data received from the imaging device 100 via the communication unit 310 . Specifically, as shown in FIG. 4, for example, when the movement or change in position of the behavior detection device 200 is "up and down," a "tip" is associated as the display image type; when it is "left and right," a "cheer message" is associated as the display image type; when it is "right rotation," a "cheer message" is associated as the display image type; and when it is "left rotation," a "cheering call" is associated as the display image type.

[0035] The display image generating unit 330 generates a display image by superimposing, on the moving image data received by the communication unit 310, display data of a display image type linked to a behavior mode from the sensing data using the control unit 340 described below. The display image generated by the display image generation unit 330 is transmitted to the screen 2 via the communication unit 310, and the display image is displayed on the screen 2. For example, as shown in FIG. 5, when the movement or change in position of the behavior detection device 200 is "up and down," the display image generation unit 330 generates moving image data in which an illustrated image with a "￥" mark attached is superimposed on the moving image data captured by the imaging device 100 at the event venue as a corresponding image when the movement or change in position of the behavior detection device 200 is "up and down."

[0036] The control unit 340 controls the entire server 300 based on a control program stored in a ROM (Read Only Memory) or the like. Specifically, the control unit 340 realizes real-time video display by executing transmission and reception processing by the communication unit 310, information writing processing and information reading processing by the memory unit 320, display image generation processing by the display image generation unit 330, etc.

[0037] <Processing of video image distribution system 1> The process of the video distribution system 1 according to this embodiment will be described with reference to FIG.

[0038] As shown in FIG. 6, the imaging device 100 captures a moving image of the event venue (step S110). The moving image data captured by the imaging device 100 is displayed on a screen 1 at the event venue and is also transmitted to a server 300 .

[0039] The communication unit 310 of the server 300 receives the moving image data from the imaging device 100 . The control unit 340 of the server 300 temporarily stores the video data received by the communication unit 310 in the storage unit 320 (step S120).

[0040] The communication unit 310 of the server 300 receives the sensing data from the behavior detection device 200 . The control unit 340 of the server 300 identifies a corresponding image from the sensing data received from the behavior detection device 200 by the communication unit 310, reads the corresponding image data from the storage unit 320, and outputs it to the display image generation unit 330 (step S130).

[0041] The display image generation unit 330 of the server 300 generates display image data by superimposing the corresponding image data output from the control unit 340 on the moving image data of the event venue that the control unit 340 reads from the storage unit 320, and outputs the display image data to the control unit 340. The control unit 340 transmits the input display image data to the screen 2 via the communication unit 310, and ends the process (step S140).

[0042] <Actions and Effects> As described above, the video distribution system 1 of this embodiment comprises an imaging device 100 that captures video of an event venue, a behavior detection device 200 that detects the behavior of users watching the video of the event at a location separate from the event venue, and a server 300 that generates display information according to the user behavior detected by the behavior detection device 200, generates an image in real time by adding the display information to the video of the event venue, and displays it on a screen 2 located at a location separate from the event venue. That is, the imaging device 100 captures moving images of an event venue, and the behavior detection device 200 detects the behavior of a user viewing the moving images of the event at a location separate from the event venue. The server 300 then generates display information according to the user's behavior detected by the behavior detection device 200, and generates an image in real time in which the display information is added to a moving image of the event venue, and displays the image on a screen 2 located at a location separate from the event venue. Therefore, when viewing live or streaming video, users can experience the same sense of presence as if they were actually at the live venue (site).

[0043] In the video distribution system 1 according to this embodiment, the display information is information relating to virtual value. That is, a display image having some kind of virtual value is added to a moving image of the event venue and displayed on a screen 2 located at a different location from the event venue. That is, a display image relating to the virtual value intended by the user is added to a moving image of the event venue and is displayed on a screen 2 located at a location separate from the event venue. Therefore, when viewing live or streaming video, users can experience the same sense of presence as if they were actually at the live venue (site).

[0044] In the video distribution system 1 according to this embodiment, the display information is information about a cheering message. That is, the display image of the support message is added to the moving image of the event venue and is displayed on a screen 2 located in a different location from the event venue. That is, a display image relating to the support message intended by the user is added to a moving image of the event venue and displayed on a screen located at a different location from the event venue. Therefore, when viewing live or streaming video, users can experience the same sense of presence as if they were actually at the live venue (site).

[0045] In the video distribution system 1 according to this embodiment, the behavior detection device is a smartphone equipped with a motion sensor. In other words, by moving the user's smartphone, which the user carries with them at all times, for example, in time with the rhythm of the music or the atmosphere of the event venue, display images relating to virtual values ​​or display images relating to support messages are added to the moving images of the event venue and displayed on Screen 2 located in a different location from the event venue. Therefore, when viewing live or streaming video, users can experience the same sense of presence as if they were actually at the live venue (site).

[0046] <Second embodiment> Hereinafter, a video distribution system 1A according to this embodiment will be described with reference to FIGS.

[0047] <Configuration of video image distribution system 1A> As shown in FIG. 7, the video distribution system 1 according to this embodiment includes an imaging device 100, a behavior detection device 200A, and a server 300A. In the following, components that are given the same reference numerals as those in the first embodiment have the same functions, and therefore detailed descriptions thereof will be omitted.

[0048] Behavior detection device 200A detects the behavior of a user who is viewing a video of an event at a location separate from the event venue. In this embodiment, AR glasses or VR glasses equipped with a motion sensor will be exemplified as the behavior detection device 200A and will be described below. The behavior detection result of the behavior detection device 200A is transmitted to a server 300 (described later) via, for example, the Internet network.

[0049] The server 300A generates display information according to the user behavior detected by the behavior detection device 200A. The server 300A generates an image in real time by adding the generated display information to the moving image of the event venue input from the imaging device 100, and displays the image on the display unit of the behavior detection device 200A.

[0050] <Configuration of behavior detection device 200A> As shown in FIG. 8, the behavior detection device 200A according to this embodiment includes a communication unit 210, a motion sensor unit 220, a control unit 230A, and a display unit 240.

[0051] The control unit 230A controls the overall processing of the behavior detection device 200A in accordance with a control program stored in, for example, a ROM (Read Only Memory) or the like. In this embodiment, the control unit 230A executes, for example, communication control processing in the communication unit 210, operation of the motion sensor unit 220, acquisition processing of sensing data, processing of displaying moving images on the display unit 240, and the like.

[0052] The display unit 240 is a display provided inside the AR glasses or VR glasses. The display unit 240 displays the display image generated by the server 300A.

[0053] <Configuration of server 300A> The configuration of the server 300A in the video distribution system 1A according to this embodiment will be described with reference to FIG.

[0054] As shown in FIG. 9, the server 300A according to this embodiment includes a communication unit 310, a storage unit 320, a display image generation unit 330, and a control unit 340A.

[0055] The control unit 340A controls the entire server 300A based on a control program stored in a ROM (Read Only Memory) or the like. Specifically, the control unit 340A realizes real-time moving image display by executing transmission and reception processing of the communication unit 310, information writing processing and information reading processing of the memory unit 320, display image generation processing of the display image generation unit 330, etc.

[0056] <Processing of video image distribution system 1A> The process of the video distribution system 1A according to this embodiment will be described with reference to FIG.

[0057] As shown in FIG. 10, the imaging device 100 captures a moving image of the event venue (step S110). The moving image data captured by the imaging device 100 is displayed on a screen 1 at the event venue and is also transmitted to a server 300 .

[0058] The communication unit 310 of the server 300A receives the moving image data from the imaging device 100. The control unit 340A of the server 300A temporarily stores the video data received by the communication unit 310 in the storage unit 320 (step S120).

[0059] The communication unit 310 of the server 300A receives the sensing data from the behavior detection device 200A. The control unit 340A of the server 300A identifies a corresponding image from the sensing data received from the behavior detection device 200A by the communication unit 310, reads the corresponding image data from the storage unit 320, and outputs it to the display image generation unit 330 (step S130).

[0060] The display image generating unit 330 of the server 300A generates display image data by superimposing the corresponding image data output from the control unit 340A on the moving image data read out from the storage unit 320 by the control unit 340A, and outputs the display image data to the control unit 340 (step S140).

[0061] The control unit 340A transmits the input display image data to the behavior detection device 200A via the communication unit 310, and the behavior detection device 200A displays the received display image on the display unit 240, and ends the process (step S210).

[0062] <Actions and Effects> As described above, the video distribution system 1A of this embodiment comprises an imaging device 100 that captures video of an event venue, a behavior detection device 200A that detects the behavior of users watching video of the event at a location separate from the event venue, and a server 300A that generates display information according to the user behavior detected by the behavior detection device 200A, generates an image in which the display information is added to the video of the event venue in real time, and displays the image on the display unit 240 of the behavior detection device 200A. That is, the imaging device 100 captures moving images of the event venue, and the behavior detection device 200A as AR glasses or VR glasses detects the behavior of a user viewing the moving images of the event in a location separate from the event venue. The server 300 then generates display information according to the user behavior detected by the behavior detection device 200A, generates an image in real time in which the display information is added to a moving image of the event venue, and displays the image on the display unit 240 of the behavior detection device 200A. Therefore, in live viewing and video distribution, users can feel as if they are actually at the live venue (on-site) by moving their bodies in response to the music and atmosphere playing at the event venue.

[0063] <Third embodiment> Hereinafter, a video distribution system 1B according to this embodiment will be described with reference to FIGS.

[0064] <Configuration of video image distribution system 1B> As shown in FIG. 11, a video distribution system 1B according to this embodiment includes an imaging device 100, a behavior detection device 200, a server 300C, and an image processing device 400. Note that components with the same reference numerals as those in the first and second embodiments have similar functions, and therefore detailed descriptions thereof will be omitted.

[0065] <Configuration of Server 300B> The server 300B receives the moving image data from the imaging device 100 via the network. The server 300B transmits the received video data to the image processing device 400, which will be described later.

[0066] <Configuration of image processing device 400> As shown in FIG. 12, the image processing device 400 according to this embodiment includes a communication unit 410, a storage unit 420, a display image generation unit 430, and a control unit 440.

[0067] The communication unit 410 receives moving image data captured by the imaging device 100 at the event venue from the server 300B. The video data received by the communication unit 410 is output to the control unit 440, which will be described later. The communication unit 410 receives sensing data from the behavior detection device 200 . The sensing data received by the communication unit 410 is output to the control unit 440, which will be described later. The communication unit 410 transmits to the screen 2 image information in which a display image generated by a display image generation unit 430 (described later) is added to moving image information of the event venue.

[0068] The storage unit 420 is configured by, for example, a RAM (Random Access Memory) or the like, and in this embodiment stores a database in which behavior modes obtained from sensing data are associated with display image types. Storage unit 420 also stores display images corresponding to the display image types. Furthermore, the storage unit 420 temporarily stores the moving image data received from the imaging device 100 via the communication unit 410 .

[0069] The display image generating unit 430 generates display image information by superimposing, on the moving image data received by the communication unit 410, display data of a display image type linked to a behavior mode from the sensing data using the control unit 440 described later. The display image generated by the display image generation unit 430 is transmitted to the screen 2 via the communication unit 410, and the display image is displayed on the screen 2. The image processing device 400 is, for example, a personal computer (PC), and a special application program is downloaded to this PC. This application program processes a huge amount of data sent from the server 300B at high speed using a high performance graphics board and CPU.

[0070] The control unit 440 controls the entire image processing device 400 based on a control program stored in a ROM (Read Only Memory) or the like. Specifically, the control unit 440 realizes real-time video display by executing the transmission and reception processing of the communication unit 410, the writing and reading of information to and from the memory unit 420, and the display image information generation processing of the display image generation unit 430.

[0071] <Processing of video image distribution system 1B> The process of the video distribution system 1B according to this embodiment will be described with reference to FIG.

[0072] As shown in FIG. 13, the imaging device 100 captures a moving image of the event venue (step S310). The moving image data captured by the imaging device 100 is displayed on the screen 1 at the event venue and is also transmitted to the server 300B.

[0073] The communication unit 410 receives moving image data from the imaging device 100 via the server 300B. Control unit 440 temporarily stores the video data received by communication unit 410 in storage unit 420 (step S320).

[0074] The communication unit 410 receives the sensing data from the behavior detection device 200 . The control unit 440 identifies a corresponding image from the sensing data received from the behavior detection device 200 by the communication unit 410, reads out the corresponding image data from the storage unit 420, and outputs it to the display image generation unit 430 (step S330).

[0075] The display image generating unit 430 generates display image data by superimposing the corresponding image data output from the control unit 440 onto the moving image data of the event venue that the control unit 440 reads from the storage unit 420, and outputs the display image data to the control unit 440. The control unit 440 transmits the input display image data to the screen 2 via the communication unit 410, and ends the process (step S340).

[0076] <Actions and Effects> As described above, the video distribution system 1B of this embodiment comprises an imaging device 100 that captures video of an event venue, a behavior detection device 200 that detects the behavior of users viewing the video of the event at a location separate from the event venue, a server 300B that receives video data from the imaging device 100 via a network, and an image processing device 400 that generates display information according to the user behavior detected by the behavior detection device 200, and adds the display information in real time to video generated from the video data of the event venue received by the server 300B to generate image information and display it on a screen 2 located at a location separate from the event venue. That is, the imaging device 100 captures moving images of an event venue, and the behavior detection device 200 detects the behavior of a user viewing the moving images of the event at a location separate from the event venue. The image processing device 400 then generates display information according to the user's behavior detected by the behavior detection device 200, and in real time generates image information by adding the display information to a moving image generated from the moving image data of the event venue received by the server 300B, and displays the image information on a screen 2 located at a location separate from the event venue. Therefore, when viewing live or streaming video, users can experience the same sense of presence as if they were actually at the live venue (site). Furthermore, the image processing device 400 is, for example, a personal computer (PC), and a special application program is downloaded to this PC, which uses a high-performance graphic board and a CPU to process at high speed the huge amount of data transmitted from the server 300B. By using the image processing device 400, in which a special application program is downloaded to the PC, which uses a high-performance graphic board and a CPU to process at high speed the huge amount of data transmitted from the server 300B, stable drawing becomes possible without depending on the network communication environment, etc.

[0077] <Application example 1> In the first embodiment, the behavior detection device 200 is exemplified as a smartphone, and the storage unit 320 of the server 300 stores a database in which behavior modes obtained from sensing data are associated with display image types. However, an application program specific to this smartphone may be downloaded so that the user can freely customize the relationship between the behavior mode obtained from the sensing data and the type of image to be displayed. By doing so, the user can recognize that the tipping, cheering message, support message, or interjection displayed on screen 2 was displayed as a result of the user's own behavior. Therefore, in live viewing and video distribution, users can move their bodies in response to the music and atmosphere playing at the event venue, giving them a stronger sense of realism as if they were actually at the live venue (on site).

[0078] <Application example 2> In the first embodiment, the behavior detection device 200 is exemplified as a device carried by a user, such as a smartphone, and in the second embodiment, the behavior detection device 200A is exemplified as a device worn by a user, such as AR glasses or VR glasses. However, the behavior detection device 200 or the behavior detection device 200A may be a microphone installed in a location separate from the event venue. In other words, the voices of people gathered at a location other than the event venue may be collected, and this voice may be converted into textual display image data in server 300, 300A. Moving image data may then be displayed on screen 2 in which display image data obtained by converting sound data picked up by a microphone into text is superimposed on moving image data captured at the event venue by imaging device 100. By doing this, users can experience a sense of realism as if they were actually at the live venue (site) during live viewing or video distribution.

[0079] <Application example 3> In the first embodiment, the behavior detection device 200 is exemplified as a device carried by a user, such as a smartphone, and in the second embodiment, the behavior detection device 200A is exemplified as a device worn by a user, such as AR glasses or VR glasses. However, the behavior detection device 200 or the behavior detection device 200A may be a sensor that uses laser light, such as a LIDAR, that is installed at a location separate from the event venue. In other words, the behavior of people gathered at a location other than the event venue may be detected, for example, by a sensor using laser light such as LIDAR, and display image data corresponding to the detected behavior may be generated, and moving image data in which the generated display image data is superimposed on moving image data captured at the event venue by the imaging device 100 may be displayed on the screen 2. By doing this, users can experience a sense of realism as if they were actually at the live venue (site) during live viewing or video distribution. Furthermore, by using a sensor using laser light such as LIDAR as the behavior detection devices 200 and 200A, behavior can be accurately detected even in a darkened space.

[0080] <Application example 3> In the first embodiment, the behavior detection device 200 is exemplified as a device carried by a user, such as a smartphone, and in the second embodiment, the behavior detection device 200A is exemplified as a device worn by a user, such as AR glasses or VR glasses. However, the behavior detection device 200 or the behavior detection device 200A may be a motion tracker installed at a location separate from the event venue. In other words, the movements of people gathered at a location other than the event venue can be captured, a series of movements can be detected as behavior, display image data corresponding to the detected behavior can be generated, and moving image data in which the generated display image data is superimposed on moving image data captured at the event venue by imaging device 100 can be displayed on screen 2. By doing this, users can experience a sense of realism as if they were actually at the live venue (site) during live viewing or video distribution.

[0081] The video distribution systems 1, 1A, and 1B of the present invention can be realized by recording the processing of the servers 300, 300A, and image processing device 400 on a recording medium readable by a computer system, and having the servers 300, 300A, and image processing device 400 read and execute the programs recorded on this recording medium. The computer system here includes hardware such as an OS and peripheral devices.

[0082] Furthermore, if a WWW (World Wide Web) system is used, the "computer system" also includes the homepage provision environment (or display environment). The above program may be transmitted from a computer system that stores the program in a storage device or the like to another computer system via a transmission medium or by transmission waves in the transmission medium. Here, the "transmission medium" that transmits the program refers to a medium that has the function of transmitting information, such as a network (communication network) like the Internet or a communication line (communication line) like a telephone line.

[0083] The program may also be a program for implementing some of the above-mentioned functions, or may be a so-called differential file (differential program) that can implement the above-mentioned functions in combination with a program already stored in the computer system.

[0084] The above describes an embodiment of the present invention in detail with reference to the drawings, but the specific configuration is not limited to this embodiment, and includes designs within the scope of the gist of the present invention. [Explanation of symbols]

[0085] 1. Video distribution system 1A: Video distribution system 1B: Video distribution system 100: Imaging device 200;Behavior detection device 200A;Motion detection device 210;Communications Department 220: Motion sensor unit 230;Control section 230A; Control section 240;Display section 300; Server 300A; Server 300B; Server 310;Communications Department 320;Memory part 330: Display image generation unit 340; Control section 340A; Control section 400; Image processing device 410;Communications Department 420;Memory section 430: Display image generation unit 440;Control section

Claims

1. A video distribution system that distributes video images of an event to spectators, an imaging device that captures moving images of the event venue; a behavior detection device that detects the behavior of a user viewing a video of the event at a location separate from the event venue; a server that generates display information according to the user's behavior detected by the behavior detection device, generates image information by adding the display information to a moving image of the event venue in real time, and displays the image information on a screen located at a location separate from the event venue; A video distribution system comprising:

2. 2. The video image distribution system according to claim 1, wherein the display information is information relating to a virtual value.

3. 2. The video image distribution system according to claim 1, wherein the display information is information relating to a cheering message.

4. 2. The video distribution system according to claim 1, wherein the behavior detection device is a smartphone equipped with a motion sensor.

5. A video distribution system that distributes video images of an event to spectators, an imaging device that captures moving images of the event venue; a behavior detection device that detects the behavior of a user viewing a video of the event at a location separate from the event venue; a server that generates display information according to the user's behavior detected by the behavior detection device, generates image information in real time by adding the display information to a moving image of the event venue, and displays the image information on a display unit of the behavior detection device; A video distribution system comprising:

6. A video distribution system that distributes video images of an event to spectators, an imaging device that captures moving images of the event venue; a behavior detection device that detects the behavior of a user viewing a video of the event at a location separate from the event venue; a server that receives moving image data from an imaging device via a network; an image processing device that generates display information according to the user's behavior detected by the behavior detection device, generates image information by adding the display information to the moving image generated from the moving image data of the event venue received by the server in real time, and displays the image information on a screen located at a location separate from the event venue; A video distribution system comprising:

7. 7. The video image distribution system according to claim 1, wherein the behavior detection device is an AR glass equipped with a motion sensor.

8. 7. The video image distribution system according to claim 1, wherein the behavior detection device is a pair of VR glasses equipped with a motion sensor.

9. 7. The video image distribution system according to claim 1, wherein the video image is a live video image.

10. A video distribution method in a video distribution system that distributes video of an event to spectators, the video distribution method including an imaging device, a behavior detection device, and a server, comprising: a first step of capturing a moving image of an event venue by the imaging device; a second step of the server acquiring a video image of the event venue; a third step of detecting, by the behavior detection device, the behavior of a user viewing a video of the event at a location separate from the event venue; a fourth step in which the server generates display information according to the user's behavior detected by the behavior detection device, generates an image by adding the display information to a moving image of the event venue, and projects the image on a screen located at a location separate from the event venue; A video distribution method comprising:

11. A program for causing a computer to execute a video image distribution method in a video image distribution system including an imaging device, a behavior detection device, and a server, for distributing video images of an event to spectators, the program comprising: a first step of capturing a moving image of an event venue by the imaging device; a second step of the server acquiring a video image of the event venue; a third step of detecting, by the behavior detection device, the behavior of a user viewing a video of the event at a location separate from the event venue; a fourth step in which the server generates display information according to the user's behavior detected by the behavior detection device, generates an image by adding the display information to a moving image of the event venue, and projects the image on a screen located at a location separate from the event venue; A program that causes a computer to execute the following.

Images