Live streaming distribution system and method

Abstract

[Problem] To provide a livestreaming distribution system that makes it possible to enliven events and makes it easy to collect money. [Solution] Provided is a livestreaming distribution system 5 comprising: a stage 1; a large display 3 installed over the stage 1; a video processing unit 20 for simultaneously recording a performer 2, performing on the stage 1, and the display 3 over the stage 1, and transferring the recorded video to an online video streaming server for streaming distribution of the same to viewers; a user response-receiving unit 25 for receiving viewer responses including message input and / or tipping from viewers of the recorded video during the streaming distribution of the recorded video; and a background display control unit 26 for displaying the viewer responses in a prescribed format on the display over the stage such that the viewer responses are displayed in the video that is being streaming-distributed, in accordance with the attributes of or amounts tipped by the viewers.

Description

[Technical Field]

[0001] The present invention relates to a live streaming distribution system and method. [Background technology]

[0002] Currently, due to the impact of the COVID-19 pandemic, it is becoming difficult to hold events, including live concerts with audiences around the world.

[0003] For this reason, events that would normally be held in front of an audience are now being held without an audience or with only a small number of spectators and streamed live over the internet. These no-audience live events are either filmed in an empty concert hall or theater and streamed "live" online, or pre-recorded footage is streamed at a later date.

[0004] However, such live performances without an audience can be difficult to get the audience excited. In other words, since there are only a small number of spectators or no spectators at the actual venue, the excitement that is unique to live performances cannot be expected.

[0005] Additionally, with online live streaming, there is no commitment to attend the live venue, making it difficult to attract an audience, especially if they are willing to pay. Summary of the Invention [Problem to be solved by the invention]

[0006] The present invention has been made in consideration of the above-described circumstances, and its object is to provide a live streaming distribution system that can liven up an event and make it easy to collect fees. [Means for solving the problem]

[0007] In order to achieve the above object, the present invention provides the following system.

[0008] (1) Stage and The display on the stage, a video transfer means for simultaneously recording the performers performing on the stage and the display on the stage, and transferring the recorded video to a video streaming server on the Internet for streaming distribution to viewers; A viewer response receiving means for receiving viewer responses including message input and / or tipping from viewers of the photographed video during streaming distribution of the photographed video; A viewer response display means for displaying the viewer response on the display on the stage in a predetermined format so that it is displayed in the video being streamed, according to the attributes of the viewer and / or the amount of tipping; A live streaming distribution system comprising:

[0009] (2) In the distribution system of (1) above moreover, a viewer response display setting means for providing an interface for allowing a promoter to set a display method for the viewer responses on the display on the stage, and for allowing a promoter to set a format for displaying the viewer responses on the display on the stage during live streaming distribution of the captured video; Further having A system characterized by:

[0010] (3) In the system of (2), The viewer response display setting means includes means for saving a format for displaying the viewer responses on the on-stage display as one or more templates, and means for calling up one of the saved templates in response to an instruction from the promoter, applying it to the viewer responses, and displaying the viewer responses on the on-stage display. A system characterized by:

[0011] (4) In the distribution system of (2), The response is displayed on the display in the following format: Contains message occurrence patterns A distribution system characterized by:

[0012] (5) In the distribution system of (2), The response is displayed on the display in the following format: Contains the location of the message A distribution system characterized by:

[0013] ( 6 ) In the distribution system of (2), The viewer response display setting means Viewer responses are displayed on the screen in different patterns depending on the amount of the viewer's tip. A distribution system characterized by:

[0014] ( 7 ) In the distribution system of (2), The viewer response display setting means Displaying viewer responses on the display in different display patterns depending on the viewer's attributes A distribution system characterized by:

[0015] ( 8 ) In the distribution system of (2), The viewer attributes include the purchase amount for the concert and the membership level. A distribution system characterized by:

[0016] ( 9 ) Stage and The display on the stage, a video camera for simultaneously capturing images of the performers performing on the stage and the display on the stage; 1. A computer-implemented live streaming distribution method for a theater having: a video transfer step in which a computer simultaneously captures images of the performers performing on the stage and the display on the stage, and transfers the captured images to a video streaming server on the Internet for streaming distribution to viewers; a viewer response receiving step in which the computer receives viewer responses including message input and / or tipping from viewers of the photographed video during streaming distribution of the photographed video; a viewer response display step in which a computer displays the viewer response on the display on the stage in a predetermined format so that the viewer response is displayed in the video being streamed, according to the viewer's attributes and / or the amount of tipping; A live streaming distribution method comprising:

[0017] ( 10 ) The above ( 9 ) distribution method moreover, a viewer response display setting step in which the computer provides an interface for allowing the promoter to set a display method for the viewer responses on the display on the stage, and allows the promoter to set a format for displaying the viewer responses on the display on the stage during the live streaming distribution of the captured video; A system comprising:

[0018] ( 11 ) The above ( 10 ) in the method The viewer response display setting step includes a step of causing a computer to save a format for displaying the viewer responses on the onstage display as one or more templates, and a step of calling up one of the saved templates in response to an instruction from the promoter, applying it to the viewer responses, and displaying the viewer responses on the onstage display. A method characterized by:

[0019] The configuration, operation, and effects of the present invention other than those described above are described in the following detailed description of the invention and drawings so that they can be understood by those skilled in the art. [Brief explanation of the drawings]

[0020] [Figure 1] FIG. 1 is a schematic diagram showing the overall configuration of a system according to an embodiment of the present invention.

[0021] [Figure 2] FIG. 2 is a schematic diagram showing the configuration of a theater streaming distribution system.

[0022] [Figure 3] FIG. 3 is a schematic diagram showing the configuration of a video distribution server.

[0023] [Figure 4] FIG. 4 is a schematic diagram showing the exhibitor interface.

[0024] [Figure 5] FIG. 5 is a schematic diagram showing the viewer interface.

[0025] [Figure 6] FIG. 6 is a schematic diagram showing the viewer interface.

[0026] [Figure 7] FIG. 7 is a schematic diagram showing the video viewing interface.

[0027] [Figure 8] FIG. 8 is a schematic diagram showing an interface for setting the display format of messages and the like for promoters.

[0028] [Figure 9] FIG. 9 is a schematic diagram showing an interface for setting the display format of messages etc. for promoters.

[0029] [Figure 10]FIG. 10 is a schematic diagram showing an interface for setting the display format of messages, etc. for promoters.

[0030] [Figure 11] FIG. 11 is a schematic diagram showing an interface for setting the display format of messages, etc. for promoters.

[0031] [Figure 12] FIG. 12 is a schematic diagram showing an interface for setting a display format for messages and the like for promoters.

[0032] [Figure 13] FIG. 13 is a schematic diagram showing an interface for setting a display format for messages and the like for promoters.

[0033] [Figure 14] FIG. 14 is a schematic diagram showing another example of a stage and background display. DETAILED DESCRIPTION OF THE INVENTION

[0034] An embodiment of the present invention will be described in detail below with reference to the drawings.

[0035] FIG. 1 is a diagram showing the overall configuration of this system.

[0036] (Stage and Background) Reference numeral 1 denotes a stage on which a performer 2 performs. This stage 1 may be installed in a theater such as a concert hall or live music venue, as well as in a film studio or an outdoor concert venue.

[0037] In this invention, a large display 3 is installed in the background of the stage 1, and messages from online viewers, as shown at 4 in the figure, are displayed on this display 3. Note that the large display 3 may be an LED display itself, or may be a type that projects messages onto a large screen using a projector.

[0038] (Theater Streaming Distribution System) The system of this embodiment also includes a theater streaming distribution system 5 installed in a theater, and a video distribution server 7 connected to this system 5 via the Internet 6.

[0039] The theater streaming distribution system 5 is connected to a video camera 8 that simultaneously captures the stage 1 and the large display 3 that serves as the background, and transfers the captured video to the smartphone 9 of the viewer 4 via the Internet 6 and the video distribution server 7 so that it can be displayed on the smartphone 9 of the viewer 4. Furthermore, messages and the like (viewer responses) input by the viewer 4 via the smartphone 9 are displayed on the large display 3.

[0040] FIG. 2 is a schematic diagram showing the configuration of this theater streaming distribution system 5.

[0041] This system 5 is configured such that a CPU 12, a RAM 13, and an input / output unit 14 are connected to a bus 15, to which a program storage unit 16 and a data storage unit 17 are connected.

[0042] The input / output unit 14 is connected to the video camera 8 and large display 3, as well as to an operation display / input device 18 (keyboard, mouse, etc.) for operating the system 5.

[0043] The program storage unit 16 stores a moving image processing unit 20 and a user response display processing unit 21, excluding components not related to the embodiment of the present invention, such as an OS.

[0044] The video processing unit 20 has a camera control unit 22 for controlling the video camera 8, and a video transfer unit 23 for transferring the controlled images to the video distribution server.

[0045] The user response display processing unit 21 has a user response receiving unit 25 (viewer response receiving means of this invention) that receives user responses from the video distribution server 7, and a background display control unit 26 (viewer response display means of this invention) that projects the user responses onto the large display 3.

[0046] The data storage unit 17 also stores a moving image processing setting 29 and a user message display pattern setting 30 .

[0047] The program storage unit 16 and the data storage unit 17 are actually storage media such as a hard disk or an SSD. The components 20 to 26 are actually computer software programs as instruction groups written in a specific programming language. These instruction groups are called by the CPU 12, expanded on the RAM 13, and executed as appropriate to configure the components 20 to 26.

[0048] (Video distribution server) 3 is a schematic diagram showing the configuration of the video distribution server 7. Like the theater streaming distribution system 5 (FIG. 2), this video distribution server 7 also has a CPU, RAM, and input / output units, but these are not shown in FIG.

[0049] This video distribution server 7 has a program storage unit 35, an exhibitor login processing unit 36, a viewer login processing unit 37, a concert information processing unit 38, a video streaming playback unit 39, a viewer response input / display unit 40, a tip processing unit 41, and a viewer response information transfer unit 42.

[0050] The data storage unit 44 stores exhibitor data 46, viewer data 47, concert data 48, and theater data 49.

[0051] These components are also called by a CPU (not shown), expanded on RAM, and executed as appropriate to fulfill the respective constituent elements of the present invention.

[0052] (Connection between the theater streaming distribution system 5 and the video distribution server 7) The detailed configuration of the theater streaming distribution system 5 and the video distribution server 7 will be explained below in detail by explaining their operation.

[0053] First, the exhibitor connects the theater streaming distribution system 5 to a video distribution server 7 via the Internet 6 (FIG. 1).

[0054] The video distribution server 7 in this embodiment is configured to be able to connect to multiple different theater streaming distribution systems 5, and the exhibitor login processing unit 32 (Figure 3) is configured to authenticate connections from theater streaming distribution systems 5 installed in different theaters.

[0055] That is, the exhibitor login processing unit 36 authenticates which exhibitor's account is using the system and which theater is connecting based on the registered exhibitor and theater data 46, 49.

[0056] (Interface for producers) 4 shows the promoter interface 51 after the promoter has logged in, which displays a list 52 of concerts that have already been registered and a registration button 53 for registering a new concert. By pressing the new registration button 53 from this interface 51, a new concert can be registered, and by selecting a specific concert from the list 52, a concert that has already been registered can be edited.

[0057] Concert registration is essentially a reservation for the distribution of concert footage, and involves registering concert data including the date and time, including the length of distribution, the theater, and the name and content of the concert, which are registered as concert data 48 in the data storage unit 44.

[0058] (Viewer Interface) On the other hand, logins from viewers are processed by a viewer login processing unit 37 shown in Fig. 3. This viewer login processing unit 37 refers to viewer data 47 stored in a data storage unit 44 to authenticate the viewer.

[0059] FIG. 5 shows a viewer interface 55 that is displayed on the viewer's terminal after the viewer logs in.

[0060] A list 56 of concerts for which the viewer has purchased tickets is displayed on this viewer interface 55. In this state, the viewer can select any concert to view that concert.

[0061] In addition, by pressing a ticket reservation / purchase button 57 on this interface 55, a ticket reservation / purchase interface 58 shown in FIG. 6 can be accessed.

[0062] This interface 58 displays a list 59 of concerts that can be reserved or purchased, and tickets can be reserved or purchased by selecting a specific concert from this list 59 and pressing a reservation / purchase button 60.

[0063] In this embodiment, the concert is live-streamed, and the video of the concert is streamed in real time at a specific date and time designated by the promoter. Note that this real-time stream may also be recorded and made available for re-streaming at a later date.

[0064] Note that the distribution of concert information may be free, i.e., 0 yen. Also, concert viewing may be possible without a reservation.

[0065] (Image capture and streaming) Just before the date and time of the live distribution of the concert, the promoter starts up the theater streaming distribution system 5 installed in the theater (FIG. 1) and logs in to the video distribution server 7.

[0066] Next, the exhibitor activates the camera 8, and the camera control unit 22 of the theater streaming distribution system 5 (FIG. 2) imports the video captured by the camera 8 into this system 5. The video captured by the camera control unit 22 is displayed on the operation display 18 (FIG. 2), making it possible to check the capture range of the imaging camera.

[0067] Here, the camera control unit 22 can control not only the physical operations such as the angle and zoom of the camera 8, but also the white balance and exposure amount. The camera control unit 22 is operated by a driver provided by the manufacturer of the camera depending on the model of the camera.

[0068] In addition, multiple cameras may be installed, and in this case, the system 5 may have the function of selecting (switching) one of the images captured by the multiple cameras and transferring it to the video distribution server 7.

[0069] Next, the video transfer unit 23 transfers the video to the video distribution server 7, allowing viewers to view the video.

[0070] (Viewer's viewing screen) FIG. 7 shows a video viewing interface 62 displayed on the smartphone 9 of the viewer 4.

[0071] The interface 62 of FIG. 7 is displayed after the viewer logs in to the video distribution server 7 and selects a specific concert in FIG.

[0072] As shown in this example, a video display section 63 is provided on the interface 62, and an image of the performer 2 on the stage 1 captured by the camera 8 and the large display 3 behind him are displayed together.

[0073] In addition, this interface 62 displays a user response display processing unit 64 and a message / tipping input unit 65 below the video display unit 63. When a viewer inputs only a message, only a tip amount, or both into this message / tipping input unit 65 and presses a send button 66, the message is displayed in the message display unit 64, and the tip amount 67 is displayed above this message display unit 64.

[0074] This process is performed by the viewer response input / display unit 40 and the tipping processing unit 41 shown in Fig. 3. When a tip is made, the tipping processing unit 41 performs a settlement process.

[0075] (Viewer Response Forwarded) Each time the viewer response (message and tip) is input, it is transferred in real time to the theater streaming distribution system 5 by the viewer response information transfer unit 42 (FIG. 3).

[0076] The viewer responses are received by the user response display processing unit 21 shown in Figure 2, which processes the received message and tip information appropriately and displays them on the large display 3 via the background display control unit 26.

[0077] (Message display settings) FIG. 8 shows an interface 70 provided by the background display control unit 26 for controlling the display of messages aimed at promoters.

[0078] This interface is provided with a template setting section 71 for selecting a template for defining how a plurality of messages are to be displayed in relation to the performers, a message display mode setting section 72 for setting the display mode of each message, and a template selection section 73 for selecting the set template.

[0079] That is, in this embodiment, as shown in FIG. 8, a template can be registered (viewer message display setting 30) for each song played at a concert, and by pressing selection button 71a, the selected template can be applied to the video currently being distributed.

[0080] Each of the above templates can be set and registered in the template setting section 71.

[0081] As shown in FIG. 9, the template setting section 71 has a template selection section 74, a font and color selection section 75, and a preset template setting section .

[0082] In the template selection section 74, a message position 77, a message movement 78, and a tip display position 79 can be set.

[0083] 10 and 11 show how to set the message position 77 and the message movement 78.

[0084] First, as shown in Figure 10, the message position can be selected from "Top," "Full," "Mountain shape," "Right," and "Left" (81-85), taking into consideration the position of the performer on stage. In each template, the message will not be displayed in the areas shaded in black, but will be displayed in other areas.

[0085] In this example, "Top" 81 is selected.

[0086] Next, as shown in FIG. 11, the message movement 78 allows the selection of "right to left," "left to right," "top to bottom," and "bottom to top" (87-90).

[0087] In this example, "Right to Left" 88 is selected.

[0088] The tip display position 79 can also be set, but this is to allow the position above or below to be set in relation to the display position of the message, and its display is omitted.

[0089] In addition, the font and color selection 75 allows the font 100, color 101, and character overlap degree 102 of the characters to be selected in a drop-down list. In this example, the font 100 is set to "Gothic" and the color 101 is set to "Automatic." When set to "Automatic," the text will be displayed in various colors determined by the system. Although not shown here, the character overlap degree 102 can be selected from "no overlap," "small overlap," "medium overlap," and "large overlap."

[0090] Once you have set the template, font, color, and overlap as described above, you can name and register the interface as shown in Figure 12, as shown at 92. In this example, the template is registered as "Template for Song 1." In other words, the template for Song 1 is set so that the message is displayed in the upper half and moves from left to right.

[0091] (Message display settings) Furthermore, "message display mode" 72 sets how each message is displayed depending on the viewer's attributes and tip amount.

[0092] FIG. 12 shows an example of this setting.

[0093] In this example, the size of the message to be displayed and whether or not an icon is present can be set depending on whether the user is a fan club member or not, and whether or not the tip amount is above a certain amount. Note that the factors that determine the display format of this message are not limited to whether or not the user is a fan club member or the amount of the tip, but may also be other factors.

[0094] In this embodiment, the font display mode is applicable regardless of the type of template.

[0095] (Live streaming operations) The promoter completes the template settings and message display format settings using the above-mentioned procedure before the concert is held. These template settings and message display format settings are stored in the viewer message display settings 30. Furthermore, these template settings may be set for each concert, or may be set as a common template that can be applied to different concerts by the promoter.

[0096] Then, when the concert date and time arrives, the promoter starts up the theater streaming distribution system 5, camera 8, and large display 3, and selects a template at the right time while looking at the promoter interface shown in Fig. 8. This causes the background display control unit 26 to switch the display pattern and mode of the message to be displayed on the large display by referring to the viewer message display setting 30.

[0097] The basic functions of the large display 3 are controlled via a driver provided by the manufacturer of the large display, which is installed in the system 5.

[0098] With this configuration, videos of live events can be distributed via a video distribution server, and messages entered by viewers can be received from the video distribution server and projected in a predetermined format onto a large display 3 behind the theater stage.

[0099] This allows a message displayed in a predetermined format on a large display to be distributed as a moving image together with the performer.

[0100] In this embodiment, the theater streaming distribution system 5 and the video distribution server 7 are installed in different locations, but they may be installed in the same location (theater). In the latter case, the theater streaming distribution system 5 and the video distribution server 7 may be installed on the same computer.

[0101] Furthermore, in the above embodiment, the viewer message setting 30 is provided in the distribution system 5, but it may also be provided on the distribution server 7 side.

[0102] Furthermore, the promoter interface provided by the system 5 is displayed on the operation display / input device 18, but this is not limited to this. For example, the promoter's portable terminal may be connected online and the interface may be displayed on that terminal.

[0103] Furthermore, in the above embodiment, the theater streaming distribution system is installed in a theater, but this is not limiting, and it may be installed in a stadium, for example.

[0104] In this case, it is preferable to use a very large stage and a horizontally long background display, as shown in Fig. 14. When using such a background display, it may be divided into multiple sections 105 to 107, one of which may display a message from the audience, and the other sections may display a different background image or video. [Explanation of symbols]

[0105] 1...Stage 2...Performer 3. Large display 4... Viewers 5. Theater streaming distribution system 6. Internet 7...Video distribution server 8...Video camera 9. Smartphone 12...CPU 13...RAM 14…Input / output section 15...Bus 16...Program storage section 17...Data storage section 18...Operation display 20...Video processing section 21...User response display processing unit 22...Camera control unit 23...Video transfer section 25...User response receiving section 26...Background display control unit 29...Video processing settings 32...Entertainer login processing section 35...Program storage section 36... Exhibitor login processing section 37...Viewer login processing section 38...Concert Information Processing Department 39...Video streaming playback section 40...Audience response input and display unit 41...Coin processing section 42...Viewer response information transfer unit 44...Data storage section 46...Entertainment data 47... Viewer data 48...Concert data 49...Theater data 51...Exhibitor Interface 55...Viewer Interface 55...Interface 58...Ticket reservation and purchase interface 62...Video viewing interface 64...User response display processing unit

Claims

1. The stage and a background display installed behind the performers performing on the stage; a video transfer means for simultaneously recording the performers performing on the stage and the background display, and transferring the recorded video to a video streaming server on the Internet for streaming distribution to viewers; a viewer response receiving means for receiving viewer responses, including message inputs and tips, from viewers of the captured video during streaming distribution of the captured video; a viewer response display means for displaying the viewer response on the background display in a predetermined format so as to be displayed in the video being streamed, according to the attributes of the viewer and / or the amount of tipping; A live streaming distribution system comprising:

2. 2. The live streaming distribution system according to claim 1, The viewer response receiving means receives the viewer response from the video streaming server. A live streaming distribution system.

3. In the live streaming distribution system according to claim 1, moreover, a viewer response display setting means for providing an interface for allowing a promoter to set a display method for the viewer responses on the background display, and for allowing a promoter to set a format for displaying the viewer responses on the background display during live streaming distribution of the shot video; Further having A live streaming distribution system.

4. 4. The live streaming distribution system according to claim 3, The viewer response display setting means includes means for saving a format for displaying the viewer responses on the background display as one or more templates, and means for calling one of the saved templates in response to an instruction from an exhibitor and applying it to the viewer responses to display the viewer responses on the background display. A live streaming distribution system.

5. 4. The live streaming distribution system according to claim 3, The format of displaying the viewer responses on the background display is: Contains message occurrence patterns A live streaming distribution system.

6. 4. The live streaming distribution system according to claim 3, The format of displaying the viewer responses on the background display is: Contains the location of the message A live streaming distribution system.

7. 4. The distribution system according to claim 3, The viewer response display setting means Viewer responses are displayed on the screen in different patterns depending on the amount of the viewer's tip. A live streaming distribution system.

8. 4. The live streaming distribution system according to claim 3, The viewer response display setting means The viewer responses are displayed on the background display in different display patterns according to the viewer's attributes. A live streaming distribution system.

9. 4. The live streaming distribution system according to claim 3, The viewer attributes include the purchase amount of the live concert and the membership level. A live streaming distribution system.

10. Stage and A background display installed behind the performers on stage, a video camera that simultaneously captures the performers performing on the stage and the background display; 1. A computer-implemented live streaming distribution method for a theater having: a video transfer step in which the computer transfers the video captured by the video camera to a video streaming server on the Internet for streaming distribution to viewers; a viewer response receiving step in which a computer receives viewer responses including message inputs and tips from viewers of the photographed video during streaming distribution of the photographed video; a viewer response display step in which the computer displays the viewer response on the background display in a predetermined format so as to be displayed in the video being streamed, according to the attributes of the viewer and / or the amount of tipping; A live streaming distribution method comprising:

11. The live streaming distribution method according to claim 10, moreover, a viewer response display setting step in which the computer provides an interface to the exhibitor to set a display method for the viewer responses on the background display, and allows the exhibitor to set a format for displaying the viewer responses on the background display during live streaming of the shot video; A live streaming distribution method comprising:

12. The live streaming distribution method according to claim 11, The viewer response display setting step includes a step of causing a computer to save a format for displaying the viewer responses on the background display as one or more templates, and a step of calling up one of the saved templates in response to an instruction from an exhibitor, applying it to the viewer responses, and displaying the viewer responses on the background display. A live streaming distribution method characterized by:

Images