Video distribution system, control method, and program

Abstract

To enable a viewer to easily grasp an important scene in a period during live streaming in which the viewer was unable to view.SOLUTION: A video delivery system for delivering by streaming a gameplay live video to a plurality of terminals connected to a network: generates a live video on the basis of a gameplay video that is played by a game device; acquires information related to the play state of the game being played by the game device; generates weight information in which time information corresponding to a time from the start of the live video and weights based on the play state of the game are associated; generates a digest video for a period of live video that is designated by time designation information, on the basis of time designation information and weight information associated with first user information to identify each of a plurality of users; and delivers the live video to the plurality of terminals and delivers the digest video to a first terminal among the plurality of terminals that is identified by the first user information.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a video distribution system, a control method, and a program. [Background technology]

[0002] Patent document 1 discloses a technology for a video distribution system that streams (live-distributes) live video of sports matches and the like, in which the video from the start of streaming to the current point in time while streaming distribution is ongoing is divided into multiple chapters, representative frames are extracted for each of the multiple chapters, and a digest video including the representative frames is created, thereby distributing the digest video selected by the user from a menu screen for selecting the representative frame.

[0003] In recent years, in addition to live broadcasts of sports matches, live broadcasts of e-sports tournaments and gameplay on user devices have also become common. Many viewers are actively chatting and exchanging comments while watching these live broadcasts. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Publication No. 2013-192062 Summary of the Invention [Problem to be solved by the invention]

[0005] In the above-mentioned live streaming, viewers who start watching midway through the live streaming, rather than from the beginning (beginning), desire to know the content (development) of the live streaming from the start to the beginning of the viewing. Also, viewers who watch the live streaming from the beginning but are forced to miss a period of time and then resume viewing later desire to know the content (development) of the period they were unable to watch. Furthermore, in order to share the excitement (excitement) among many viewers, it is desirable to understand not only the current game situation but also important scenes from the start of the game up to the present time. Thus, viewers who are unable to watch a portion of the live streaming desire to be able to easily understand important scenes from that period.

[0006] For example, the technology disclosed in Patent Document 1 creates a digest video including representative frames of chapters divided from the start of streaming to the current time. However, not all representative frames are necessarily important scenes. Therefore, when selecting representative frames from the menu screen, it is difficult to know which scenes are important. Furthermore, for viewers who are unable to watch for a period of time, the options include the already-viewed period, making it difficult to know which option to select to watch a digest video of the unviewed period.

[0007] One of the objectives of some aspects of the present invention is to provide a video distribution system, control method, and program that allows viewers who are unable to watch a live broadcast for a period of time to easily grasp important scenes from that period.

[0008] Another aspect of the present invention aims to provide a video distribution system, a control method, and a program that enable the effects described in the embodiments described below to be achieved. [Means for solving the problem]

[0009] In order to solve the above-mentioned problems, one aspect of the present invention is a video distribution system that streams live video of game play on a game device to a plurality of terminals connected to a network, the video distribution system comprising: a live video generation unit that generates the live video based on game play video of the game played on the game device; an acquisition unit that acquires information regarding the play status of the game played on the game device; a weight information generation unit that generates weight information that associates time information corresponding to the time from the start of the live video with a weighting based on the play status of the game; a memory unit that stores user information that identifies each of a plurality of users; a digest generation unit that generates a digest video of the live video for a period specified by the time designation information associated with first user information of the user information, based on the weight information and the time designation information; and a distribution unit that streams the live video to the plurality of terminals and streams the digest video to a first terminal among the plurality of terminals that is identified by the first user information.

[0010] Another aspect of the present invention is a control method in a video distribution system that streams live video of game play on a game device to a plurality of terminals connected to a network, the control method including the steps of: a live video generation unit generating the live video based on video of game play being played on the game device; an acquisition unit acquiring information related to the play status of the game being played on the game device; a weight information generation unit generating weight information that associates time information corresponding to the time from the start of the live video with a weighting based on the play status of the game; a digest generation unit generating digest video of the live video for a period specified by the time designation information based on the weight information and time designation information associated with first user information among user information identifying each of a plurality of users stored in a memory unit; a distribution unit streaming the live video to a plurality of the terminals; and a distribution unit streaming the digest video to a first terminal among the plurality of terminals that is identified by the first user information.

[0011] Another aspect of the present invention is a program for causing a computer in a video distribution system that streams live video of game play on a game device to a plurality of terminals connected to a network to execute the following steps: generating the live video based on game play video of the game being played on the game device; acquiring information regarding the play status of the game being played on the game device; generating weight information that associates time information corresponding to the time from the start of the live video with a weighting based on the play status of the game; generating a digest video of the live video for a period specified by the time designation information based on the weight information and time designation information associated with first user information among user information that identifies each of a plurality of users stored in a storage unit; streaming the live video to a plurality of the terminals; and streaming the digest video to a first terminal among the plurality of terminals that is identified by the first user information. [Brief explanation of the drawings]

[0012] [Figure 1] 1 is a schematic block diagram showing an example of the configuration of a video distribution system according to an embodiment. [Figure 2] FIG. 2 is a diagram showing an example of a display screen of the viewing terminal according to the embodiment. [Figure 3] FIG. 1 is a block diagram showing an example of a schematic configuration of a computer according to an embodiment. [Figure 4] FIG. 2 is a block diagram showing an example of the functional configuration of a moving image generation server according to the embodiment. [Figure 5] FIG. 10 is a diagram showing an example of setting evaluation points according to the embodiment. [Figure 6] FIG. 10 is a diagram showing an example of evaluation point information according to the embodiment. [Figure 7] FIG. 2 is a block diagram showing an example of the functional configuration of a video distribution server according to the embodiment. [Figure 8] FIG. 4 is a diagram showing a first example of time designation information according to the embodiment. [Figure 9] FIG. 10 is a diagram showing a second example of time designation information according to the embodiment. [Figure 10] FIG. 10 is a diagram showing a third example of time designation information according to the embodiment. [Figure 11] FIG. 4 is a diagram showing an example of unviewed chapters and evaluation points according to the embodiment. [Figure 12] FIG. 10 is a diagram showing an example of evaluation point information regarding unviewed time according to the embodiment. [Figure 13] 10A and 10B are diagrams showing an example of selecting chapters to be included in a digest video according to the embodiment; [Figure 14] 10 is a flowchart showing an example of a video distribution process according to the embodiment. [Figure 15] 10A and 10B are diagrams showing modified examples of chapters of unviewed time of live streaming and evaluation points according to the embodiment. [Figure 16] FIG. 16 is a diagram showing an example of evaluation point information regarding the unviewed time shown in FIG. 15. [Figure 17] 10A and 10B are diagrams showing a modified example of the selection of chapters to be included in the digest video according to the embodiment. [Figure 18] 10A and 10B are diagrams showing modified examples of the display screen of the viewing terminal when a digest video without audio is played back according to the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. [System configuration and overview] First, the configuration and overview of the video distribution system according to this embodiment will be described. 1 is a schematic block diagram showing an example of the configuration of a video distribution system according to this embodiment. The video distribution system 1 is a system that performs live distribution (streaming distribution) of e-sports (electronic sports) tournaments and live distribution of games played by users on game consoles, etc. For example, the video distribution system 1 is configured to include a game console 10, a video and audio operation device 20, a video generation server 30, a video distribution server 40, and multiple viewing terminals 50 (50A, 50B, 50C, ...).

[0014] The game machine 10 and the moving image generating server 30, and the video and audio operating device 20 and the moving image generating server 30 are connected to each other by an HDMI (registered trademark) cable, a broadcast cable, etc. The moving image generating server 30, the moving image distribution server 40, and the plurality of viewing terminals 50 are communicatively connected to a network NW.

[0015] The network NW is a communication network that is composed of, for example, the Internet, a mobile phone network, a VPN (Virtual Private Network), a dedicated communication line network, a WAN (Wide Area Network), a LAN (Local Area Network), a PSTN (Public Switched Telephone Network), or a combination of these.

[0016] The game machine 10 is a game device for playing a live-streamed game, and may be a dedicated game machine or a personal computer. A controller 11A operated by player A and a controller 11B operated by player B are connected to the game machine 10. For example, the game machine 10 is capable of playing a competitive baseball game. Player A selects team A, and player B selects team B, allowing a baseball game to be played in which team A and team B compete against each other based on the operations of each player.

[0017] Here, a competitive baseball game will be described as an example of a game played using the game machine 10, but the present invention is not limited to this and any type of game can be applied. The number of players playing the game is not limited to two, but may be one or three or more. The number of controllers connected to the game machine 10 is also not limited to two, but may be changed depending on the number of players.

[0018] The audio and video operation device 20 is a computer device for commentating, explaining, or operating the audio and video of a game played using the game machine 10. For example, a microphone 21, a camera 22, and an operation panel 23 are connected to the audio and video operation device 20. The microphone 21 is a microphone that inputs the voice of a commentator or an analyst, the voice of the game venue, etc. The camera 22 is an imaging device that captures images of the commentator or an analyst and the game venue, etc. The operation panel 23 is an operation unit that allows an operator or the like to operate the audio and video that are live-streamed. The operation panel 23 may be configured with mechanical controls, or may be configured with a touch panel that operates on a display screen, etc.

[0019] The audiovisual operation device 20 may be connected to a microphone 21, a camera 22, an operation panel 23, etc., or may have a configuration in which the microphone 21, the camera 22, and the operation panel 23, etc. are built in. Either the commentator or the commentator, or both, may also serve as the operator. Alternatively, only either the commentator or the commentator may be used, or one person may serve as both the commentator and the commentator. Alternatively, the operator may be a director, etc.

[0020] The game machine 10 outputs gameplay video and audio of the game being played on the game machine 10, and information about the game play status, to the video image generation server 30. The video and audio operation device 20 outputs video and audio of a commentator or analyst to the video image generation server 30.

[0021] The moving image generation server 30 acquires game play video and audio output from the game machine 10, and information about the game play status. The moving image generation server 30 also acquires video and audio of the commentator or commentator output from the video and audio operation device 20. The moving image generation server 30 then generates live video of the game by combining the game play video and audio with the video and audio of the commentator or commentator, and transmits the generated live video to the moving image distribution server 40 via the network NW. Hereinafter, "transmission from the moving image generation server 30 to the moving image distribution server 40 via the network NW" will be simply referred to as "transmission from the moving image generation server 30 to the moving image distribution server 40."

[0022] The video generation server 30 also generates weight information that associates time information (hereinafter referred to as "playback time") corresponding to the time from the start of the live video (start of distribution) with a weight based on the game play situation. The playback time may be expressed as the elapsed time from the start time, where the start time of the live distribution is set to "0," or the start time of the live distribution and the time after the start time may be expressed in standard time (e.g., Japan Standard Time). The weight information is also expressed as evaluation point information that indicates an evaluation point weighted based on the game play situation, for example. By assigning a high evaluation point when the game play situation is exciting (e.g., when a hit is made or a point is scored) and a low evaluation point when the game play situation is not exciting, it is possible to identify the video of the exciting moments in the live distribution. The video generation server 30 associates the generated evaluation point information (an example of weight information) with the live video and transmits it to the video distribution server 40 via the network NW.

[0023] The video distribution server 40 receives and stores the live video transmitted from the video generation server 30, and distributes (live distributes) the received live video by streaming via the network NW to multiple viewing terminals 50. Hereinafter, "the video distribution server 40 distributes to the viewing terminals 50 via the network NW" will be simply referred to as "the video distribution server 40 distributes to the viewing terminals 50."

[0024] The viewing terminal 50 displays live video distributed from the video distribution server 40. Furthermore, if a viewer starts watching the live distribution partway through rather than from the start (beginning) of the live distribution, the viewing terminal 50 can display a digest video of the unviewed time from the start of the live distribution until the viewer starts watching.

[0025] FIG. 2 is a diagram showing an example of a display screen of the viewing terminal 50 according to this embodiment. The entire screen area G11 of the illustrated display screen G10 displays live video streamed from the video distribution server 40. The display screen G10 also displays a "digest playback button B10" as a control for playing back digest video. When a viewer touches the digest playback button B10 to view a digest video stream during live streaming, the viewing terminal 50 transmits a signal (hereinafter referred to as a "distribution request") to the video distribution server 40 requesting the delivery of the digest video stream. In response to this delivery request, the video distribution server 40 generates a digest video stream for the unviewed portion of the video stream by the viewer and delivers the digest video stream (digest delivery) to the viewing terminal 50 of the viewer.

[0026] Specifically, the video distribution server 40 stores user information identifying each of a plurality of viewers, and by acquiring the viewing start time of each viewer, associates and stores the user information with the viewing start time. This allows the video distribution server 40 to identify the unviewed time of each viewer of the live video being distributed. The viewing start time is information (hereinafter referred to as "time designation information") for specifying the playback time of the digest video requested by the viewer (i.e., the unviewed time) within the playback time of the live video. The time designation information associated with the user information may be any information that can identify the unviewed time, and may be one or more of the viewing start time, viewing end time, unviewed time, and viewing time.

[0027] When the video distribution server 40 receives a digest video distribution request from one of the viewing terminals 50, it generates a digest video of the unviewed time specified by the time designation information associated with the user information included in the distribution request (i.e., the user information of the requesting viewing terminal 50).The video distribution server 40 then streams the generated digest video to the requesting viewing terminal 50.

[0028] For example, as shown in Fig. 2, when a digest video is distributed from the video distribution server 40, the viewing terminal 50 displays the digest video in a sub-screen screen area SG10 that is smaller than the screen area G11 in which the live video is displayed. Note that the example of the display screen for the live video and digest video shown in Fig. 2 is just an example, and the size and position of the screen area in which each video is displayed are not limited to this example.

[0029] In addition, the video distribution server 40 stores the evaluation point information transmitted from the video generation server 30 in association with the live video, and by using the evaluation point information when generating a digest video, it is possible to generate a digest video that preferentially includes footage of the most exciting moments in the live distribution.

[0030] The configuration of each part of the video distribution system 1 according to this embodiment will be described in detail below. [Hardware configuration] First, a description will be given of the hardware configuration of each unit of the video distribution system 1 according to this embodiment. Fig. 3 is a block diagram showing an example of the schematic configuration of a computer according to this embodiment. For example, each of the game machine 10, video and audio operation device 20, video generation server 30, video distribution server 40, and viewing terminal 50 shown in FIG. 1 includes some or all of the components included in the computer 100 shown in the figure.

[0031] The computer 100 has a hardware configuration including a CPU (Central Processing Unit) 101, a RAM (Random Access Memory) 102, a ROM (Read Only Memory) 103, a storage device 104, a communication unit 105, an input unit 106, and an output unit 107.

[0032] The CPU 101 is a processor that executes various processes by executing programs stored in the ROM 103 or the storage device 104 .

[0033] The RAM 102 is used as a reading area for the programs executed by the CPU 101, or as a working area for writing data used in processing by the programs.

[0034] The ROM 103 is configured with an electrically rewritable nonvolatile memory such as an EEPROM (Electrically Erasable Programmable Read Only Memory) or a flash ROM. For example, the ROM 103 stores at least a part of a system program, a program for executing various processes, and the like.

[0035] The storage device 104 includes a hard disk drive (HDD), a solid state drive (SSD), etc. For example, the storage device 104 may store at least a portion of a system program, a program for executing various processes, etc. The storage device 104 also stores data required for various processes, data to be acquired, etc.

[0036] The communication unit 105 is connected to a network NW via a wireless LAN (Local Area Network) or a wired LAN to perform data communication with other devices and apparatuses. The communication unit 105 may also be provided with an interface such as a short-range wireless communication interface like Bluetooth (registered trademark) or a Universal Serial Bus (USB) to perform data communication with peripheral devices.

[0037] The input unit 106 includes input devices such as a keyboard, a touchpad, a touch panel, and a microphone. The game console 10 includes an interface as the input unit 106, which connects to the controllers 11A and 11B. The controllers 11A and 11B may be built into the game console 10. The audiovisual operation device 20 includes an interface as the input unit 106, which connects to the microphone 21, the camera 22, the operation panel 23, and the like. The audiovisual operation device 20 may include the microphone 21, the camera 22, the operation panel 23, and the like.

[0038] The output unit 107 includes a display unit such as a liquid crystal display or an organic EL display, and an output device such as a speaker. Note that the output unit 107 (for example, a display unit or a speaker) may be connected as an external output device.

[0039] Next, the functional configurations of the video generation server 30 and the video distribution server 40 included in the video distribution system 1 will be described. [Video generation server functional configuration] First, the functional configuration of the video generation server 30 will be described. FIG. 4 is a block diagram showing an example of the functional configuration of the moving image generating server 30 according to this embodiment.

[0040] The video generation server 30 has a functional configuration realized by executing a program stored in the video generation server 30, which includes a video and audio acquisition unit 31, a live video generation unit 32, a play status acquisition unit 33, an evaluation point information generation unit 34, and a transmission unit 35.

[0041] The video and audio acquisition unit 31 acquires game play video and audio output from the game machine 10. The video and audio acquisition unit 31 also acquires video and audio of a commentator or analyst output from the video and audio operation device 20.

[0042] The live video generation unit 32 generates live video of game play based on game play video of the game played on the game machine 10. For example, the live video generation unit 32 generates live video of the game by combining game play video and audio with video and audio of a commentator or analyst.

[0043] The play status acquisition unit 33 acquires information about the play status of a game being played on the game machine 10. The information about the game play status includes information about events that occur during the progress of the game. For example, in the case of a baseball game, the information about the game play status includes, as event information, details of events that occur as the baseball game progresses, such as hits, home runs, runs scored, and comebacks.

[0044] The evaluation point information generation unit 34 generates evaluation point information based on information about the game play situation acquired by the play situation acquisition unit 33. Specifically, the evaluation point information generation unit 34 generates evaluation point information that associates a playback time corresponding to the time from the start of live streaming of the game with an evaluation point weighted based on the game play situation. For example, in the case of a baseball game, evaluation points are set in advance according to the game play situation (hits, home runs, runs, comebacks, etc.). The more exciting or interesting a scene is, the higher the evaluation point value is set.

[0045] (Example of evaluation score information) FIG. 5 is a diagram illustrating an example of how evaluation points are set according to this embodiment. In the illustrated example of how evaluation points are set, evaluation points are set for each event that occurs during the game as a game play situation. For example, a first base hit is given an evaluation point of "1 point," a second base hit an evaluation point of "2 points," a triple base hit an evaluation point of "2 points," and a solo home run an evaluation point of "3 points." Thus, higher evaluation points are set for doubles and triples than for first base hits, and even higher evaluation points are set for solo home runs. Furthermore, even for home runs, a grand slam is given a higher evaluation point than a solo home run. For example, the evaluation point information generation unit 34 generates evaluation point information that associates the playback time of the live video with the evaluation points shown in FIG. 5.

[0046] The game play status may be any status that corresponds to the progress of the game, and can be set arbitrarily depending on the type of game, etc. For example, in the case of a soccer game, the game play status includes the contents of events that occur as the soccer game progresses, such as kick-off, shot, goal, player substitution, free kick, and penalty kick.

[0047] FIG. 6 is a diagram showing an example of evaluation point information according to this embodiment. For example, the evaluation point information divides the playback time of the live video into chapters, and associates the playback time and evaluation points for each chapter in chronological order from the start of the live broadcast. The evaluation points associated with each chapter are the cumulative evaluation points based on the gameplay status (occurring events) within each chapter. For example, as shown in FIG. 6(A), if the chapters are divided in the order of "00:00" (0 minutes 0 seconds) when the live broadcast starts, "00:20" (0 minutes 20 seconds), "01:00" (1 minute 0 seconds), and so on, evaluation point information is generated that associates the playback time and evaluation points for each chapter, as shown in FIG. 6(B).

[0048] In the example of rating point information shown in the figure, chapter "#00" has a playback time of "00:00:00 to 00:19:99" and a rating point of "0 points." Chapter "#01" has a playback time of "00:20:00 to 00:59:99" and a rating point of "2 points." Chapter "#02" has a playback time of "01:00:00 to 02:59:99" and a rating point of "1 point." Chapter "#03" has a playback time of "03:00:00 to 05:29:99" and a rating point of "8 points." Note that the playback times associated with the rating point information shown in this figure are expressed in decimal seconds, so "00:20:00" indicates 0 minutes 20 seconds (0 minutes 20 seconds 00), but the decimal points will be omitted as appropriate in the following explanation.

[0049] In this way, the evaluation point information generation unit 34 calculates the evaluation points for each chapter as time passes from the start of the live distribution, and sequentially generates and updates evaluation point information that associates the playback time and evaluation point for each chapter. This evaluation point information is generated based on the game play status, and is therefore common information for all viewers.

[0050] Note that chapters can be set arbitrarily. For example, in the case of a baseball game, a chapter may be set for each pitch that the pitcher throws to the batter, or for each individual batter. Note that a chapter may be set to 15 seconds before and after the occurrence of an event that earns evaluation points. Chapters may also be set at preset intervals (e.g., 30 seconds).

[0051] Note that the playback time associated with the evaluation score in the evaluation score information is not limited to the playback time for each chapter, and may be associated with the playback time in any format. For example, the playback time of an event that has occurred may be associated with the evaluation score of that event without dividing it into chapters.

[0052] The transmission unit 35 transmits the live video generated by the live video generation unit 32 by streaming to the video distribution server 40. The transmission unit 35 also transmits the evaluation point information generated by the evaluation point information generation unit 34 to the video distribution server 40 in association with the live video.

[0053] [Video distribution server functional configuration] Next, the functional configuration of the video distribution server 40 will be described. FIG. 7 is a block diagram showing an example of the functional configuration of the video distribution server 40 according to this embodiment.

[0054] The video distribution server 40 has functional configurations that are realized by executing programs stored in the video distribution server 40, including a live video acquisition unit 41, a live video storage unit 42, an evaluation point information acquisition unit 43, an evaluation point information storage unit 44, a user information acquisition unit 45, a user information storage unit 46, a digest generation unit 47, and a distribution unit 48.

[0055] The live video acquisition unit 41 receives the live video transmitted from the moving image generation server 30 and stores it in the live video storage unit 42. The distribution unit 48 distributes the received live video to a plurality of viewing terminals 50 by streaming.

[0056] The evaluation point information acquisition unit 43 receives the evaluation point information transmitted from the video generation server 30 in association with the live video, and stores the received evaluation point information in the evaluation point information storage unit 44 .

[0057] The user information acquisition unit 45 acquires user information identifying each viewer (user) watching live video on multiple viewing terminals 50 and stores the information in the user information storage unit 46. This user information corresponds to, for example, user information at the time of user registration for an application that plays live video on the viewing terminal 50. When user registration is performed on the viewing terminal 50, the user information acquisition unit 45 acquires the user information from the viewing terminal 50. Note that when user registration is performed on a device other than the viewing terminal 50 (for example, a personal computer), the user information acquisition unit 45 acquires the user information from the device on which the user registration is performed.

[0058] Furthermore, the time at which a viewer starts viewing the live broadcast on the viewing terminal 50 differs for each viewer. Therefore, when viewing of the live video starts on the viewing terminal 50, the user information acquisition unit 45 acquires the viewing start time from the viewing terminal 50, and associates the user information of the viewer of the viewing terminal 50 with the viewing start time, and stores this in the user information storage unit 46 as time designation information.

[0059] (Example of time specification information) FIG. 8 is a diagram showing a first example of time designation information according to this embodiment. In the example of time designation information shown in the figure, user information (account ID), identification information for identifying the live video to be viewed (viewed video ID), a viewing start time, and an unviewed time are associated with each other, for example. The viewing start time of a viewer who has been watching the live broadcast from the beginning is, for example, "00:00." The viewing start time of a viewer who has started watching the live broadcast halfway through is a time after "00:00," and the time from the live broadcast start time to the viewing start time is set as the unviewed time. In the example shown in the figure, the viewer's viewing start time is "05:40," so the unviewed time is set as "00:00 to 05:40." The viewing start time and the unviewed time may be stored in standard time (such as Japan Standard Time).

[0060] Note that if a viewer starts watching a live stream on the viewing terminal 50 but stops watching midway through the stream, the time from when the viewer stops watching until when the viewer resumes watching also counts as the unwatched time. Therefore, the user information acquisition unit 45 may acquire not only the viewing start time from the viewing terminal 50 but also the viewing end time, and determine the unwatched time based on the viewing start time and the viewing end time. An example of time designation information including the unwatched time from when the viewer stopped watching midway through the stream until when the viewer resumes watching is shown in FIG. 9.

[0061] 9 is a diagram showing a second example of time designation information according to this embodiment. In the example of time designation information shown in the figure, user information (account ID), identification information for identifying the live video to be viewed (viewed video ID), viewing start time, viewing end time, and unviewed time are associated with each other, for example. The time from the viewing end time "11:10" to the viewing start time "12:50" is also set as unviewed time.

[0062] The time designation information may be managed collectively as unviewed time, including the viewing start time and viewing end time. Fig. 10 is a diagram showing a third example of time designation information according to this embodiment. In the example of time designation information shown in the figure, as an example, user information (account ID), identification information for identifying the live video to be viewed (viewed video ID), and unviewed time are associated with each other.

[0063] When the digest generation unit 47 receives a request for distribution of a digest video transmitted from the viewing terminal 50, it generates a digest video based on the time designation information and evaluation point information associated with the user information of the viewer of the viewing terminal 50. This digest video is a digest video of the unviewed time designated by the time designation information from the live video being distributed (live video stored in the live video storage unit 42).

[0064] For example, the digest generation unit 47 determines, based on the evaluation point information, one or more periods and playback order of the live video of the unviewed time specified by the time designation information to be played as digest video, and generates a digest list indicating the periods and playback order to be played as digest video.

[0065] The length of the digest video is generated so as to fit within a predetermined time (for example, 3 minutes). If the digest video is too long, it is undesirable because it takes time to grasp important scenes from the unviewed portion of the video. This predetermined time may be set in advance, or the viewer may be able to select from options such as "1 minute," "3 minutes," or "5 minutes" displayed on the display unit of the viewing terminal 50.

[0066] (Generating a digest list) An example of a method for generating a digest list will be described with reference to Figures 11 to 13. Here, the length of the digest video to be generated is assumed to be 3 minutes (or less). Figure 11 is a diagram showing an example of unviewed chapters and evaluation points according to this embodiment. This diagram shows an example of unviewed chapters from the start of the live broadcast at "00:00" to the start of viewing at "05:40" in chronological order, along with the duration (number of seconds) and evaluation points for each chapter, assuming that viewing begins 5 minutes and 40 seconds after the start of the live broadcast.

[0067] The ratings for the unwatched chapters "#00," "#01," "#02," "#03," "#04," and "#05" are "0 points," "2 points," "1 point," "8 points," "4 points," and "5 points," respectively. Note that the 5 minutes and 40 seconds when viewing began was the middle of chapter "#06," but the rating of "6 points," based on the play situation from the start of chapter "#06" until before viewing began (05:39:99), will be provisionally considered the rating for chapter "#06."

[0068] FIG. 12 is a diagram showing an example of rating point information for the unviewed time of the live broadcast shown in FIG. 11. As described with reference to FIG. 6, the playback time and rating points for each chapter are associated with each other in chronological order from the start of the live broadcast and stored as rating point information. In this diagram, only the rating point information for the unviewed time is shown. Note that the time (in seconds) of each chapter is shown to make the length of each chapter easier to understand, but it does not have to be included in the rating point information.

[0069] The digest generation unit 47 selects chapters to be included in the digest video in descending order of evaluation score so that the total time (number of seconds) of the chapters falls within 180 seconds (3 minutes). 13 is a diagram showing an example of chapter selection to be included in a digest video according to the present embodiment. As shown in (A) of FIG. 13, when chapters are arranged in descending order of evaluation score, the total time for chapters "#03" (evaluation score: 8 points), "#06" (evaluation score: 6 points), "#05" (evaluation score: 5 points), and "#04" (evaluation score: 4 points) is 160 seconds. If the next highest evaluation score chapter "#01" (evaluation score: 2 points) is included, the total time becomes 200 seconds. Since the total time would exceed 180 seconds if chapter "#01" were included, digest generation unit 47 selects chapters "#03," "#06," "#05," and "#04" as chapters to be included in the digest video so that the total time does not exceed 180 seconds, resulting in a 160-second digest video.

[0070] If the selected chapters are arranged in chronological order from the start of the live broadcast, the order will be chapters "#03," "#04," "#05," and "#06," as shown in (B) of Fig. 13. The digest generation unit 47 generates a digest list in which the chapters are played in the order of "#03," "#04," "#05," and "#06."

[0071] The digest generation unit 47 may generate a digest list in which chapters are played in descending order of evaluation points, rather than rearranging the playback order of the chapters in the order of live distribution. This allows the digest video to be generated so that the most exciting scenes are played first.

[0072] Furthermore, the digest generating unit 47 may add, for example, 20 seconds of video from chapter "#01" so that the length of the digest video becomes 180 seconds (3 minutes).

[0073] The distribution unit 48 streams digest video, which is obtained by playing back live video in accordance with the digest list generated by the digest generation unit 47, to the viewing terminal 50 that sent the distribution request. For example, while streaming live video to multiple viewing terminals 50, the distribution unit 48 receives a digest video distribution request from one of the viewing terminals 50, and streams the digest video to the requesting viewing terminal 50 that made the digest video distribution request.

[0074] (Digest video from the intermission) In the above, a configuration has been described in which digest video of unviewed time is distributed from the video distribution server 40 in response to a distribution request from the viewing terminal 50, and can be viewed on the viewing terminal 50. However, digest video may also be distributed during intermissions. Intermissions are the time between matches of a live-streamed game, during which players (e.g., athletes participating in an e-sports match) are replaced, filming sets are switched, and so on. Furthermore, digest video may also be distributed during intermissions when game play is interrupted due to some kind of trouble. Such digest video distributed during intermissions is hereinafter referred to as "intermission digest video."

[0075] The intermission digest video is generated from video extracted from the gameplay video before the intermission based on evaluation point information, and is distributed, for example, to all viewers' viewing terminals 50. Therefore, the intermission digest video has the same content for all viewers, for example.

[0076] However, a digest video of three minutes (or less) length extracted from the live video of the unviewed time may be distributed as an intermission digest video to the viewing terminal 50 of a viewer who started viewing partway through the live distribution (a viewer who is determined to have unviewed time based on the user information). The content of the digest video of the unviewed time is basically the same as the content of the digest video generated in response to the distribution request from the viewing terminal 50 described above, but it may be different.

[0077] If the intermission time does not end in 3 minutes, the intermission digest video is repeatedly (looped) played on the viewing terminal 50. The generated intermission digest video is distributed to viewers who have been watching from the start of the live distribution (viewers who are determined to have no unviewed time based on the user information), regardless of the unviewed time.

[0078] For example, when an operator (or a commentator, commentator, etc.) operates an "intermission time button" (not shown) provided on the operation panel 23 of the video and audio control device 20, an intermission signal is output from the video and audio control device 20. This intermission signal is a signal that instructs the distribution of an intermission digest video. The intermission signal output from the video and audio control device 20 is transmitted to the video distribution server 40. The intermission signal may also be transmitted to the video distribution server 40 via the video generation server 30. The video distribution server 40 generates an intermission digest video in response to the intermission signal from the video and audio control device 20 and distributes it by streaming.

[0079] [Video distribution processing operation] Next, the operation of the video distribution process by the video distribution system 1 will be described. FIG. 14 is a flowchart showing an example of a video distribution process according to this embodiment.

[0080] The illustrated flowchart shows the relative states of the operations of the game machine 10, the audio and video control device 20, the video generation server 30, the video distribution server 40, and the viewing terminal 50. It is assumed that the game machine 10, the audio and video control device 20, the video generation server 30, the video distribution server 40, and the viewing terminal 50 all execute processes in synchronization (for example, one cycle is 1 / 60 seconds) repeatedly (in a loop).

[0081] The game machine 10 repeatedly (loops) executes the processes of steps S100 to S105 while a game (for example, a match) is in progress. For example, the game machine 10 outputs gameplay video and audio of a game being played on the game machine 10 to the moving image generation server 30 (step S101). The game machine 10 also outputs information related to the game play status to the moving image generation server 30 (step S103). The game machine 10 repeatedly executes the processes of steps S101 and S103 while a game (for example, a match) is in progress.

[0082] The video and audio operation device 20 repeatedly (loops) executes the processes of steps S200 to S207. For example, the video and audio operation device 20 transmits an image from a camera 22 capturing a commentator or an analyst and an audio input from a microphone 21 to the video generation server 30 (step S201).

[0083] The video and audio operation device 20 also determines whether it is an intermission time (step S203). For example, the video and audio operation device 20 detects an operation on an intermission time button (not shown) on the operation panel 23, and determines that it is an intermission time when it detects that the operation has been performed. If it determines that it is an intermission time (step S203: YES), the video and audio operation device 20 outputs an intermission signal (step S205). On the other hand, if it determines that it is not an intermission time (step S203: NO), the video and audio operation device 20 does not output an intermission signal. The video and audio operation device 20 repeatedly executes the processes of steps S201, S203, and S205.

[0084] The intermission signal output from the video and audio operation device 20 is transmitted to the video distribution server 40. Note that the intermission signal may be transmitted to the video distribution server 40 via the video generation server 30.

[0085] The moving image generation server 30 repeatedly (loops) executes the processes of steps S300 to S307. For example, the moving image generation server 30 generates live video of the game by combining the gameplay video and audio output from the game machine 10 in step S101 with the commentator's video and audio output from the video and audio operation device 20 in step S201 (step S301). Then, the moving image generation server 30 transmits the generated live video to the moving image distribution server 40 by streaming (live streaming output) (step S303).

[0086] The video generation server 30 also acquires information about the game play status output from the game machine 10, generates evaluation point information that associates the playback time of the live video of the game with an evaluation point based on the game play status, and transmits the evaluation point information to the video distribution server 40 (step S305). The video generation server 30 repeatedly executes the processes of steps S301, S303, and S305.

[0087] The video distribution server 40 repeatedly (loops) executes the processes of steps S400 to S420. For example, the video distribution server 40 receives and stores live video (live streaming) transmitted by streaming from the video generation server 30 in step S303 (step S401). The video distribution server 40 also receives and stores evaluation point information transmitted from the video generation server 30 in step S305 (step S403).

[0088] Meanwhile, the viewing terminal 50 repeatedly (loops) executes the processing of steps S500 to S513 as the viewer watches the live stream. Note that while only one viewing terminal 50 is shown in this diagram, in actual processing, multiple viewing terminals 50 communicate with the video distribution server 40. For example, when a viewer starts watching live video through live streaming, the viewing terminal 50 sends a live streaming request to the video distribution server 40 (step S501). Note that this live streaming request is sent from the viewing terminal 50 to the video distribution server 40 not only at the start of the live streaming, but also repeatedly while the viewer is watching the live streaming on the viewing terminal 50. In other words, the live streaming request can be considered a signal indicating that the viewer is currently watching the live streaming.

[0089] When the video distribution server 40 receives a live streaming request from the viewing terminal 50, it updates the user information corresponding to the viewer of the viewing terminal 50 that received the request (step S405). For example, the video distribution server 40 associates the user information with the viewing start time and stores the information as time designation information. As mentioned above, the time designation information may also include the unviewed time.

[0090] Furthermore, the video distribution server 40 determines whether it is an intermission time based on whether it has received an intermission signal output from the video and audio operation device 20 (step S407). If it has received an intermission signal, the video distribution server 40 determines that it is an intermission time (step S407: YES), and generates a digest list for the intermission digest video based on the evaluation score information of the play video before the intermission (step S409). Then, the video distribution server 40 distributes the intermission digest video to multiple viewing terminals 50 by streaming (step S411). When the viewing terminal 50 receives the intermission digest video distributed by streaming from the video distribution server 40, it plays and displays the received intermission digest video (step S503).

[0091] On the other hand, if the video distribution server 40 does not acquire an intermission signal, it determines that it is not an intermission time (step S407: NO), and distributes the live video by streaming to the plurality of viewing terminals 50 (step S413). When the viewing terminal 50 receives the live video distributed by streaming from the video distribution server 40, it plays back and displays the received live video (step S505).

[0092] During the live distribution, the viewing terminal 50 determines whether or not a touch operation has been performed on, for example, the digest playback button B10 (see FIG. 2) (step S507). If the viewing terminal 50 determines that a touch operation has been performed on the digest playback button B10 (step S507: YES), it transmits a digest video distribution request to the video distribution server 40 (step S509).

[0093] The video distribution server 40 determines whether or not a digest video distribution request has been received (step S415). If it determines that a digest video distribution request has been received (step S415: YES), the video distribution server 40 identifies the unviewed time by referring to the user information of the viewer of the viewing terminal 50 that sent the digest video distribution request, and generates a digest list of the unviewed time based on the evaluation point information (step S417). Then, the video distribution server 40 streams the digest video of the unviewed time to the viewing terminal 50 that sent the digest video distribution request in accordance with the generated digest list (step S419). When the viewing terminal 50 receives the digest video streamed from the video distribution server 40, it plays and displays the received digest video (step S511).

[0094] The video distribution server 40 repeatedly executes the processes of steps S401, S403, S405, S407, S409, S411, S413, S415, S417, and S419. The audio-visual terminal 50 repeatedly executes the processes of steps S501, S503, S505, S507, S509, and S511.

[0095] In the above process, the digest video (digest list) is generated when a digest video distribution request is sent from the viewing terminal 50 to the video distribution server 40 in step S509, but the digest video (digest list) may be generated before the digest video distribution request is sent. For example, if a viewer starts watching a live broadcast midway through, the unviewed time can be identified in response to the live broadcast request sent from the viewing terminal 50 to the video distribution server 40 in step S501. Therefore, the digest video (digest list) may be generated in advance between the time the live broadcast request is sent and the time the digest video distribution request is sent.

[0096] In the above process, an example has been described in which an intermission signal is output from the video and audio operation device 20 in response to the operation of a commentator, analyst, or operator. However, an intermission signal may also be output from the game machine 10 in response to the progress of the game. For example, the game machine 10 may output an intermission signal indicating that it is an intermission time between matches at the end of game play (at the end of a match) in response to the progress of the game. Alternatively, the game machine 10 may continue to output the intermission signal until the start of the next match and end output of the intermission signal immediately before the start of the next match. When the video distribution server 40 acquires the intermission signal from the game machine 10, it distributes an intermission digest video by streaming.

[0097] For example, the digest generation unit 45 generates a digest list of the intermission digest video at the timing when the intermission signal is acquired from the game console 10. The distribution unit 46 distributes, by streaming, to a plurality of viewing terminals 50, the intermission digest video in which the live video is played back in accordance with the digest list generated by the digest generation unit 45 in response to the timing when the intermission signal is acquired from the game console 10.

[0098] Summary of the embodiment As described above, the video distribution system 1 according to this embodiment distributes live video of game play on a game console 10 (an example of a game device) via streaming to multiple viewing terminals 50 (an example of a terminal) connected to a network NW. The video distribution system 1 includes a live video generation unit 32, a play status acquisition unit 33 (an example of an acquisition unit), an evaluation point information generation unit 34 (an example of a weighting information generation unit), a user information storage unit 46 (an example of a storage unit), a digest generation unit 47, and a distribution unit 48. The live video generation unit 32 generates live video based on video of game play on the game console 10. The play status acquisition unit 33 acquires information related to the play status of the game played on the game console 10. The evaluation point information generation unit 34 generates evaluation point information (an example of weighting information) that associates a playback time (an example of time information) corresponding to the time from the start of the live video with an evaluation point (an example of weighting) based on the play status of the game. The user information storage unit 46 stores user information identifying each of multiple viewers (users). The digest generation unit 47 generates a digest video of the live video for a period (e.g., an unviewed period) specified by the time specification information based on the time specification information and the evaluation point information associated with the first user information of the user information. The distribution unit 48 distributes the live video by streaming to the plurality of viewing terminals 50, and also distributes the digest video by streaming to the viewing terminal 50 (an example of a first terminal) specified by the first user information among the plurality of viewing terminals 50.

[0099] As a result, during live distribution of gameplay, video distribution system 1 generates and distributes a digest video of the live video for a period (e.g., unviewed time) designated by the viewer (user) based on the game play status for each viewer, allowing viewers who were unable to view the live distribution for a period to easily grasp important scenes from that period in a short amount of time. Therefore, even if a viewer was unable to view the live distribution for a period, they can easily grasp important scenes from that period and share the excitement with other viewers.

[0100] For example, the digest generation unit 47 determines, based on the evaluation point information, one or more periods of live video footage to be played back as digest video and the order of playback of those periods from the live video footage within a period (e.g., an unviewed period) specified by the time designation information, and generates a digest list indicating the periods and the order of playback of those periods as digest video footage. The distribution unit 48 distributes, by streaming, digest video footage of the live video footage played back in accordance with the digest list generated by the digest generation unit 47.

[0101] As a result, when generating digest video, the video distribution system 1 determines one or more periods of the live video to be played as digest video and the playback order based on the game play status, so that viewers can easily grasp important scenes by watching the digest video.

[0102] In addition, if the distribution unit 48 receives a request (an example of a request) for distribution of a digest video from a viewing terminal 50 identified by the above-mentioned first user information while streaming live video to multiple viewing terminals 50, the distribution unit 48 streams the digest video to that viewing terminal 50.

[0103] This allows the video distribution system 1 to allow viewers to view digest video at any time during live distribution of gameplay, and allows viewers who were unable to view a portion of the live distribution to easily grasp important scenes from that period.

[0104] The video distribution system 1 further includes a video and audio operation device 20 (an example of a video and audio operation unit) for operating commentary, explanation, or video and audio for game play on the game machine 10. When the distribution unit 48 receives a signal (for example, an intermission signal) from the video and audio operation device 20 in response to operation by a commentator, an analyst, or an operator, instructing distribution of an intermission digest video (an example of a digest video), the distribution unit 48 distributes the intermission digest video by streaming.

[0105] This allows the video distribution system 1 to distribute a digest video of what has happened up to that point to all viewers watching the live video at any timing desired by the live video provider. For example, by distributing a digest video of what has happened up to that point during an intermission, the video distribution system 1 can prevent viewers from stopping watching the live broadcast during the intermission.

[0106] In addition, the distribution unit 48 may stream an intermission digest video (an example of a digest video) based on a signal obtained from the game console 10 according to the progress of the game (for example, an intermission signal transmitted from the game console 10 at the end of the game (end of the match)).

[0107] This allows the video distribution system 1 to automatically distribute intermission digest videos according to the progress of the game, eliminating the need for operation by a commentator, analyst, or operator, and providing excellent convenience.

[0108] The information about the game play status also includes information about events that occur during the progress of the game.

[0109] This allows the video distribution system 1 to distribute digest video including important scenes based on events that occur during the game (for example, a hit, a home run, a run, a comeback, etc.).

[0110] Moreover, the above evaluation point information is common to a plurality of viewers (users).

[0111] As a result, even if a viewer is unable to view a period of live distribution during the period, the video distribution system 1 allows the viewer to view a digest video including scenes prioritized according to evaluation point information common to multiple viewers for that period, allowing the viewer to grasp important scenes during that period in the same way as other viewers and share the excitement with other viewers.

[0112] The time designation information associated with the user information is information corresponding to the unviewed time during which the viewer identified by the user information has not viewed the live video.

[0113] This allows the video distribution system 1 to distribute digest video of the unviewed portion of the live gameplay to viewers who were unable to view the live stream. This allows viewers to easily grasp important scenes from the unviewed portion in a short amount of time.

[0114] Furthermore, the viewing terminal 50 displays the live video distributed from the distribution unit 48 in the screen area G11 of the display unit, and when a digest video is distributed from the distribution unit 48, the digest video is displayed in the screen area SG10 of the sub-screen which is smaller than the screen area G11 in which the live video is displayed.

[0115] This makes the video distribution system 1 convenient because viewers can view digest video in addition to live video during live distribution.

[0116] Furthermore, a control method for a video distribution system 1 according to the present embodiment, which distributes by streaming live video of game play on a game machine 10 (an example of a game device) to a plurality of viewing terminals 50 (an example of a terminal) connected to a network NW, includes a step in which a live video generation unit 32 generates live video based on video of the game being played on the game machine 10, a play status acquisition unit 33 (an example of an acquisition unit) acquires information on the play status of the game being played on the game machine 10, and a step in which an evaluation point information generation unit 34 (an example of a weight information generation unit) associates a playback time (an example of time information) corresponding to the time from the start of the live video with an evaluation point (an example of weighting) based on the play status of the game. a step in which a digest generation unit 47 generates a digest video of a period (e.g., unviewed time) of the live video specified by the time designation information based on time designation information and evaluation point information associated with first user information among the user information identifying each of the multiple viewers (users) stored in a user information storage unit 46 (an example of a storage unit); a step in which a distribution unit 48 streams the live video to the multiple viewing terminals 50; and a step in which the distribution unit 48 streams the digest video to a viewing terminal 50 (an example of a first terminal) among the multiple viewing terminals 50 that is identified by the first user information.

[0117] As a result, the control method in video distribution system 1 generates and distributes a digest video of the live video for a period (e.g., unviewed time) designated by the viewer (user) during live distribution of game play for each viewer based on the game play status, so that a viewer who was unable to view a portion of the live distribution can easily grasp important scenes from that period in a short amount of time. Therefore, even if a viewer was unable to view a portion of the live distribution, they can easily grasp important scenes from that period and share the excitement with other viewers.

[0118] Furthermore, the program according to this embodiment causes a computer in a video distribution system 1 that streams live video of game play on a game console 10 (an example of a game device) to a plurality of viewing terminals 50 (an example of a terminal) connected to a network NW to execute the following steps: generating live video based on video of the game being played on the game console 10; acquiring information about the play status of the game being played on the game console 10; generating evaluation point information (an example of weighting information) that associates a playback time (an example of time information) corresponding to the time from the start of the live video with an evaluation point (an example of weighting) based on the play status of the game; generating digest video of a period of the live video specified by the time designation information (e.g., an unviewed time) based on time designation information and evaluation point information associated with first user information among the user information that identifies each of a plurality of viewers (users) stored in a user information storage unit 46 (an example of a storage unit); streaming the live video to the plurality of viewing terminals 50; and streaming the digest video to a viewing terminal 50 (an example of a first terminal) among the plurality of viewing terminals 50 that is identified by the first user information.

[0119] As a result, during the live distribution of gameplay, the program generates and distributes a digest video of the live video for a period (e.g., unviewed time) designated by the viewer (user) based on the game play status for each viewer, allowing viewers who were unable to view the live distribution for a period to easily grasp important scenes from that period in a short amount of time. Therefore, even if a viewer was unable to view the live distribution for a period of time, they can easily grasp important scenes from that period and share the excitement with other viewers.

[0120] Although the embodiments of the present invention have been described above in detail with reference to the drawings, the specific configurations are not limited to the above-described embodiments, and the present invention also includes designs that do not deviate from the gist of the present invention. For example, the above-described configurations can be combined in any manner.

[0121] [Variations] (1) Generating evaluation points based on live commentary and commentary In the above embodiment, an example has been described in which evaluation point information is generated based on information about the game play status on the game machine 10. However, evaluation point information may also be generated based on other information. For example, the video and audio control device 20 may detect the level of excitement based on the volume of the voice uttered by the commentator or analyst input to the microphone 21, and generate evaluation point information by associating an evaluation score based on the level of excitement with the playback time of the live video. Alternatively, the audio of the commentator or analyst may be converted into text and the content of the text may be analyzed to detect the level of excitement, and evaluation point information may be generated by associating an evaluation score based on the level of excitement with the playback time of the live video. Furthermore, the level of excitement may be detected based on the volume and content of the voice uttered by the commentator or analyst, and evaluation point information may be generated by associating an evaluation score based on the level of excitement with the playback time of the live video.

[0122] That is, the video distribution system 1 further includes a video and audio operation device 20 (an example of a video and audio operation unit) for performing operations related to commentary, commentary, or video and audio regarding game play on the game machine 10. The information related to the game play status includes information related to commentary or commentary regarding the game play status.

[0123] This allows the video distribution system 1 to distribute digest video that includes important scenes when the commentary or commentary on the game play situation is exciting.

[0124] (2) Generating a digest list when there is unwatched time during a live broadcast 9 and 10 in the above embodiment, if a viewer starts watching a live stream on the viewing terminal 50 and then stops watching midway through the stream, the time from when the viewer stops watching until when the viewer resumes watching will also be counted as unwatched time. While an example of generating a digest list from the start of the live stream to the start of watching has been described with reference to Figures 11 to 13, here we will describe an example of generating a digest list when there is unwatched time during the live stream as well.

[0125] 15 is a diagram showing a modified example of unviewed chapters and evaluation scores for live streaming according to this embodiment. The illustrated example shows a case where a viewer starts viewing 5 minutes and 40 seconds after the start of the live streaming, and there are two unviewed periods between stopping and resuming viewing of the live streaming, i.e., three unviewed periods. For example, unviewed period 1 is "00:00-05:40," unviewed period 2 is "07:20-08:40," and unviewed period 3 is "11:00-12:50." The diagram shows an example of the chapters, duration (in seconds) for each unviewed period, and evaluation scores in chronological order.

[0126] Please note that the time when viewing begins, stops, or resumes may fall within the middle of a chapter. In such cases, the evaluation score up to or from the middle of the chapter will be provisionally considered to be the evaluation score for that chapter.

[0127] Fig. 16 is a diagram showing an example of rating point information for the unviewed time of the live broadcast shown in Fig. 15. As in Fig. 12, only the rating point information for the unviewed time is shown, and the time (number of seconds) of each chapter is shown so that the length of each chapter can be easily understood. The time (number of seconds) of each chapter does not need to be included as rating point information.

[0128] The rating points for chapters "#00", "#01", "#02", "#03", "#04", "#05", and "#06" in unwatched time 1 are "0 points", "2 points", "1 point", "8 points", "4 points", "5 points", and "4 points", respectively. The rating points for chapters "#11" and "#12" in unwatched time 2 are "6 points" and "1 point", respectively. The rating points for chapters "#20", "#21", and "#22" in unwatched time 3 are "7 points", "2 points", and "1 point", respectively.

[0129] The digest generation unit 47 selects chapters to be included in the digest video in descending order of evaluation score so that the total time (number of seconds) of the chapters falls within 180 seconds (3 minutes). 17 is a diagram showing a modified example of the selection of chapters to be included in the digest video according to the present embodiment. As shown in (A) of FIG. 17, when the chapters are arranged in descending order of evaluation score, the total time for chapters "#03" (evaluation score: 8 points), "#20" (evaluation score: 7 points), "#11" (evaluation score: 6 points), and "#06" (evaluation score: 6 points) is 170 seconds. If the next highest evaluation score, chapter "#05" (evaluation score: 5 points), is included, the total time becomes 210 seconds. Since the total time exceeds 180 seconds if chapter "#05" is included, the digest generation unit 47 selects chapters "#03," "#20," "#11," and "#06" as chapters to be included in the digest video so that the total time does not exceed 180 seconds, resulting in a 170-second digest video.

[0130] If the selected chapters are arranged in chronological order from the start of the live broadcast, the order will be chapters "#03," "#06," "#11," and "#20," as shown in (B) of Fig. 17. The digest generation unit 47 generates a digest list in which the chapters are played in the order of "#03," "#06," "#11," and "#20."

[0131] The digest generation unit 47 may generate a digest list in which chapters are played in descending order of evaluation points, rather than rearranging the playback order of the chapters in the order of live distribution. This allows the digest video to be generated so that the most exciting scenes are played first.

[0132] Furthermore, the digest generating unit 47 may add, for example, 10 seconds of video from chapter "#05" so that the length of the digest video becomes 180 seconds (3 minutes).

[0133] (3) Play a digest video from the start of the live broadcast In the above embodiment, a configuration has been described in which a viewer touches the digest playback button B10 when they want to watch a digest video, or a digest video is played during an intermission. However, the present invention is not limited to this. When a viewer starts watching a live broadcast midway through, a digest video of the unwatched portion of the live broadcast may be played first, and when the viewer catches up with the live broadcast, the digest video may be switched to playing the live video.

[0134] For example, when the distribution unit 48 receives a request to view live video (e.g., a request for live streaming) from the viewing terminal 50 identified by the first user information, it streams a digest video to the viewing terminal 50 before starting to stream the live video, and then streams the live video after the digest video has been streamed.

[0135] This allows the video distribution system 1 to automatically switch to live streaming after a viewer who starts watching partway through a live stream has quickly grasped important scenes from the unwatched time up until the start of viewing. Therefore, even if a viewer starts watching partway through a live stream, they can quickly grasp important scenes from before they started watching and then continue watching the live stream, allowing them to share in the excitement with other viewers.

[0136] (4) Playback of digest video without audio and display of subtitles When the viewing terminal 50 plays back digest video in the screen area SG10 of the sub-screen while playing back live video, it can be confusing if the audio of the live video and the audio of the digest video are mixed together. For this reason, the viewing terminal 50 may play back the digest video without audio. In this case, the viewing terminal 50 may analyze the audio of the commentator or analyst in scenes with high evaluation scores, convert it into text, and display captions to express the excitement of the digest video.

[0137] 18 is a diagram showing a modified example of the display screen of the viewing terminal 50 when playing back digest video without audio according to this embodiment. In the illustrated example, similar to the example of FIG. 2, the viewing terminal 50 display screen G10 displays live video in screen area G11, and displays digest video in screen area SG10 of the sub-screen. Also, in screen area SG10 of the sub-screen, the audio uttered by the commentator is displayed as captions (in the illustration, "Home run!"). This makes it easier to hear the audio of the live video, and the content of exciting scenes in the digest video can also be recognized through the captions.

[0138] (5) Other variations In the above embodiment, the configuration in which the video generation server 30 generates the evaluation point information has been described, but the video distribution server 40 may also generate the evaluation point information. Also, the game console 10 may also generate the evaluation point information. Also, in the above embodiment, the configuration in which the video distribution server 40 generates the digest video has been described, but the video generation server 30 may also generate the digest video.

[0139] Furthermore, a program for implementing the functions of the game console 10, audiovisual control device 20, video generation server 30, video distribution server 40, or viewing terminal 50 may be recorded on a computer-readable recording medium. The program recorded on the recording medium may be loaded into a computer system and executed to perform part or all of the processing of the game console 10, audiovisual control device 20, video generation server 30, video distribution server 40, or viewing terminal 50. Here, "loading a program recorded on a recording medium into a computer system and executing it" includes installing the program on a computer system. The term "computer system" here includes hardware such as an operating system and peripheral devices. The term "computer system" may also include multiple computers connected via a network, including the Internet, a wide area network (WAN), a local area network (LAN), a dedicated line, or other communication line. The term "computer-readable recording medium" refers to portable media such as a flexible disk, optical magnetic disk, ROM, or CD-ROM, as well as storage devices such as a hard disk built into a computer system. In this case, the recording medium storing the program may be a non-transitory recording medium such as a CD-ROM. The term "recording medium" also includes internal or external recording media accessible from a distribution server for distributing the program. The program code stored on the distribution server's recording medium may be different from the program code in a format executable by a terminal device. In other words, the format in which the program is stored on the distribution server is not important as long as it can be downloaded from the distribution server and installed in a format executable by a terminal device. The program may be divided into multiple parts, downloaded at different times, and then combined on a terminal device, or each of the divided programs may be distributed by a different distribution server. Furthermore, the term "computer-readable recording medium" also includes a medium that stores a program for a certain period of time, such as volatile memory (RAM) within a computer system that serves as a server or client when a program is transmitted over a network. The program may also be for implementing part of the functions described above.Furthermore, the above-mentioned functions may be realized in combination with a program already recorded in the computer system, that is, a so-called differential file (differential program).

[0140] Furthermore, some or all of the functions of the above-described game machine 10, audiovisual control device 20, video generation server 30, video distribution server 40, or viewing terminal 50 may be realized as an integrated circuit such as an LSI (Large Scale Integration). Each of the above-described functions may be individually implemented as a processor, or some or all of the functions may be integrated into a processor. Furthermore, the integrated circuit implementation method is not limited to LSI, and may be implemented using a dedicated circuit or a general-purpose processor. Furthermore, if an integrated circuit implementation technology that can replace LSI emerges due to advances in semiconductor technology, an integrated circuit based on that technology may be used.

[0141] Furthermore, the game console 10 may be provided with a part or all of the configuration of the above-described moving image generation server 30. Furthermore, the game console 10 may be provided with a part or all of the configuration of the video and audio operation device 20. Furthermore, the game console 10, the video and audio operation device 20, and the moving image generation server 30 may be configured as a single computer device or as a separate device distributed across multiple computers.

[0142] Furthermore, the moving image generation server 30 and the moving image distribution server 40 may be configured as being distributed across multiple computer devices, or may be configured as an integrated virtual server (moving image generation and distribution server) on the cloud.

[0143] [Note] From the above description, the present invention can be understood, for example, as follows: It should be noted that, to facilitate understanding of the present invention, reference numerals in the accompanying drawings are conveniently placed in parentheses, but this does not mean that the present invention is limited to the illustrated embodiments.

[0144] (Supplementary Note 1) A video distribution system (1) according to one aspect of the present invention is a video distribution system that distributes live video of game play on a game device (10) by streaming to a plurality of terminals (50) connected to a network (NW), and includes a live video generation unit (32) that generates the live video based on game play video of the game played on the game device, an acquisition unit (33) that acquires information on the play status of the game played on the game device, and weight information (e.g., , evaluation point information), a storage unit (46) that stores user information that identifies each of a plurality of users (e.g., viewers), a digest generation unit (48) that generates a digest video of the live video for a period (e.g., unviewed time) specified by the time designation information based on the weight information and time designation information associated with first user information of the user information, and a distribution unit (48) that streams the live video to a plurality of terminals and streams the digest video to a first terminal among the plurality of terminals that is specified by the first user information.

[0145] According to the configuration of Supplementary Note 1, during live streaming of gameplay, the video distribution system generates and distributes digest video of live video for a period (e.g., unviewed time) designated by the user (viewer) for each user based on the game play status, so that a user who was unable to view a portion of the live streaming can easily grasp important scenes from that period in a short amount of time. Therefore, even if a user was unable to view a portion of the live streaming, they can easily grasp important scenes from that period and share the excitement with other users.

[0146] (Supplementary Note 2) Another aspect of the present invention is a video distribution system as described in Supplementary Note 1, wherein the digest generation unit determines, based on the weight information, one or more periods and an order of playback of the live video within a period (e.g., an unviewed time) specified by the time designation information to be played back as the digest video, and generates a digest list indicating the periods and the order of playback of the digest video, and the distribution unit streams the digest video of the live video played back in accordance with the digest list generated by the digest generation unit.

[0147] According to the configuration of Appendix 2, when generating digest video, the video distribution system determines one or more periods of the live video to be played as digest video and the order of playback based on the game play status, so that the user can easily grasp important scenes by watching the digest video.

[0148] (Appendix 3) Another aspect of the present invention is a video distribution system as described in Appendix 1, wherein when the distribution unit receives a request for the digest video from the first terminal while streaming the live video to the multiple terminals, the distribution unit streams the digest video to the first terminal.

[0149] According to the configuration of Appendix 3, the video distribution system allows users to view digest footage at any time during live streaming of gameplay, allowing users who were unable to view a portion of the live streaming to easily grasp important scenes from that period.

[0150] (Supplementary Note 4) Furthermore, one aspect of the present invention is the video distribution system according to Supplementary Note 1, The game device further includes a video and audio operation unit (20) for performing operations related to commentary, explanation, or video and audio regarding game play on the game device, and when the distribution unit receives a signal (e.g., an intermission signal) from the video and audio operation unit instructing distribution of the digest video in response to operation by a commentator, an analyst, or an operator, the distribution unit distributes the digest video by streaming.

[0151] According to the configuration of Supplementary Note 4, the video distribution system can distribute a digest video of what has happened up to that point to all users who are watching the live video at any timing desired by the live video provider. For example, by distributing a digest video of what has happened up to that point during an intermission, the video distribution system 1 can prevent users from stopping watching the live broadcast during the intermission.

[0152] (Appendix 5) Another aspect of the present invention is a video distribution system as described in Appendix 1, wherein the distribution unit distributes the digest video by streaming based on a signal (e.g., a signal indicating the end of the game (end of the match), an intermission signal, etc.) obtained from the game device depending on the progress of the game.

[0153] According to the configuration of Appendix 5, the video distribution system can automatically distribute digest video according to the progress of the game, eliminating the need for operation by a commentator, analyst, or operator, making it highly convenient.

[0154] (Appendix 6) Another aspect of the present invention is a video distribution system as described in Appendix 1, wherein when the distribution unit receives a request to view the live video (e.g., a live distribution request) from the first terminal, the distribution unit streams the digest video before starting distribution of the live video to the first terminal, and streams the live video after distribution of the digest video.

[0155] According to the configuration of Supplementary Note 6, the video distribution system allows a user who starts watching a live broadcast partway through to quickly grasp important scenes from the unwatched time before starting to watch, and then automatically switches to live streaming. Therefore, even if a user starts watching a live broadcast partway through, the user can quickly grasp important scenes from before starting to watch and then continue watching the live broadcast, and can share the excitement with other users.

[0156] (Supplementary Note 7) Another aspect of the present invention is the video distribution system described in Supplementary Note 1, wherein the information relating to the game play status includes information relating to events that occurred during the progress of the game.

[0157] According to the configuration of Supplementary Note 7, the video distribution system can distribute digest video including important scenes based on events that occur during the game (e.g., hits, home runs, runs scored, comebacks, etc.).

[0158] (Appendix 8) Furthermore, one aspect of the present invention is a video distribution system as described in Appendix 1, further comprising a video and audio operation unit for performing commentary, explanation, or video and audio operations regarding game play on the game device, and the information regarding the game play status includes information regarding commentary or explanation regarding the game play status.

[0159] According to the configuration of Supplementary Note 8, the video distribution system can distribute digest video including important scenes when the commentary or explanation of the game play situation becomes exciting.

[0160] (Supplementary Note 9) Furthermore, one aspect of the present invention is the video distribution system according to Supplementary Note 1, wherein the weight information is common to a plurality of the users (for example, viewers).

[0161] According to the configuration of Appendix 9, even if a user is unable to watch a live broadcast for a certain period of time, the video distribution system allows the user to view a digest video containing scenes prioritized for that period according to evaluation point information common to multiple users, thereby enabling the user to understand the important scenes for that period in the same way as other users and share the excitement with other users.

[0162] (Supplementary Note 10) In addition, one aspect of the present invention is a video distribution system according to Supplementary Note 1, wherein the time designation information associated with the user information is used when a user (e.g., a viewer) identified by the user information is not viewing the live video. stomach This information corresponds to the unviewed time.

[0163] According to the configuration of Supplementary Note 10, the video distribution system can distribute a digest video of the unviewed portion of the live broadcast of gameplay to users who were unable to view the live broadcast. This allows users to easily grasp important scenes from the unviewed portion in a short amount of time.

[0164] (Appendix 11) Another aspect of the present invention is a video distribution system as described in Appendix 1, wherein the terminal displays the live video distributed from the distribution unit in a screen area (G11) of a display unit, and when the digest video is distributed from the distribution unit, displays the digest video in a screen area (SG10) smaller than the screen area (G11) in which the live video is displayed.

[0165] According to the configuration of Supplementary Note 11, the video distribution system is convenient because it allows users to view digest video in addition to live video during live distribution.

[0166] (Supplementary Note 12) Furthermore, a control method in a video distribution system (1) according to one aspect of the present invention is a control method in a video distribution system that streams live video of game play on a game device (10) to a plurality of terminals (50) connected to a network (NW), the control method including: a step (S301) in which a live video generation unit (32) generates the live video based on video of the game being played on the game device; a step (S305) in which an acquisition unit (33) acquires information on the play status of the game being played on the game device; and a step (S306) in which a weight information generation unit (34) associates time information (e.g., playback time) corresponding to the time from the start of the live video with a weight (e.g., evaluation points) based on the play status of the game. The method includes a step (S305) of generating weight information (e.g., evaluation point information) associated with the first user information among the user information identifying each of the multiple users (e.g., viewers) stored in the storage unit (46), a step (S417) of a digest generation unit (48) generating a digest video of the live video for a period (e.g., unviewed time) specified by the time designation information based on the weight information and time designation information associated with the first user information among the user information identifying each of the multiple users (e.g., viewers) stored in the storage unit (46), a step (S413) of a distribution unit (48) streaming the live video to the multiple terminals, and a step (S419) of a distribution unit (48) streaming the digest video to a first terminal among the multiple terminals identified by the first user information.

[0167] According to the configuration of Supplementary Note 12, the control method in the video distribution system generates and distributes a digest video of the live video for a period (e.g., unviewed time) designated by the user (viewer) during live distribution of game play for each user based on the game play status, so that a user who was unable to view the live distribution for a period of time can easily grasp important scenes from that period in a short time. Therefore, even if a user was unable to view the live distribution for a period of time, the user can easily grasp important scenes from that period and share the excitement with other users.

[0168] (Supplementary Note 13) Furthermore, a program according to one aspect of the present invention provides a computer in a video distribution system (1) that distributes live video of game play on a game device (10) by streaming to a plurality of terminals (50) connected to a network (NW), the computer including: a step (S301) of generating the live video based on the video of the game being played on the game device; a step (S305) of acquiring information on the play status of the game being played on the game device; and a step (S306) of acquiring weight information ( The control unit (46) executes the steps of: generating (S305) a digest video of a period (e.g., unviewed time) of the live video designated by the time designation information based on the weight information and time designation information associated with first user information among the user information identifying each of the multiple users (e.g., viewers) stored in the storage unit (46); distributing (S413) the live video by streaming to the multiple terminals; and distributing (S419) the digest video by streaming to a first terminal among the multiple terminals identified by the first user information.

[0169] According to the configuration of Supplementary Note 13, during live streaming of gameplay, the program generates and distributes digest video of the live video for a period (e.g., unviewed time) designated by the user (viewer) for each user based on the game play status, so that a user who was unable to view the live streaming for a period of time can easily grasp important scenes from that period in a short time. Thus, even if a user was unable to view the live streaming for a period of time, the user can easily grasp important scenes from that period and share the excitement with other users. [Explanation of symbols]

[0170] 1 Video distribution system, 10 Game console, 20 Video and audio operation device, 30 Video generation server, 31 Video and audio acquisition unit, 32 Live video generation unit, 33 Play status acquisition unit, 34 Evaluation point information generation unit, 35 Transmission unit, 40 Video distribution server, 41 Live video acquisition unit, 42 Live video storage unit, 43 Evaluation point information acquisition unit, 44 Evaluation point information storage unit, 45 User information acquisition unit, 46 User information storage unit, 47 Digest generation unit, 48 Distribution unit, 50 Viewing terminal, 100 Computer, 101 CPU, 102 RAM, 103 ROM, 104 Storage device, 105 Communication unit, 106 Input unit, 107 Output unit

Claims

1. A video distribution system that streams live video of game play on a game device to multiple terminals connected to a network, comprising: a live video generation unit that generates the live video based on gameplay video of a game played on the game device; an audiovisual operation unit for performing commentary, explanation, or operations related to audiovisual content of game play on the game device; an acquisition unit that acquires information about a commentary or commentary on a game play situation based on the voice of a commentator or analyst input via the audio and video operation unit as information about the game play situation being played on the game device; a weight information generation unit that detects a degree of excitement based on the voice of the commentator or interpreter, and generates weight information that associates an evaluation score weighted based on the degree of excitement with time information corresponding to a time from the start of the live video; a storage unit that stores user information that identifies each of a plurality of users; a digest generation unit that generates a digest video of the live video for a period designated by the time designation information based on time designation information and the weight information associated with first user information of the user information; a distribution unit that distributes the live video to the plurality of terminals by streaming and distributes the digest video to a first terminal identified by the first user information among the plurality of terminals by streaming; A video distribution system comprising:

2. 1. A control method for a video distribution system that distributes live video of game play on a game device by streaming to multiple terminals connected to a network, comprising: a live video generation unit generating the live video based on a game play video of a game being played on the game device; an acquisition unit acquiring information relating to a commentary or commentary on the game play status as information relating to the play status of the game played on the game device, based on a voice uttered by a commentator or an analyst inputted into an audio / video operation unit for performing operations relating to commentary, commentary, or audio / video of the game play on the game device; a weighting information generating unit detecting a degree of excitement based on the voice of the commentator or interpreter, and generating weighting information that associates an evaluation score weighted based on the degree of excitement with time information corresponding to a time from the start of the live video; a digest generation unit generating a digest video of the live video for a period designated by the time designation information based on the weight information and time designation information associated with first user information among user information identifying each of a plurality of users stored in a storage unit; a distribution unit streaming the live video to the plurality of terminals; the distribution unit streaming the digest video to a first terminal identified by the first user information among the plurality of terminals; A control method comprising:

3. A computer in a video distribution system that streams live video of game play on a game device to multiple terminals connected to a network, generating the live video based on a gameplay video of a game played on the game device; acquiring information relating to a commentary or commentary on the game play status as information relating to the game play status of the game being played on the game device, based on a voice uttered by a commentator or an analyst input through an audio / video operation unit for performing operations relating to commentary or commentary on the game play on the game device, or audio / video; a step of detecting a degree of excitement based on the voice of the commentator or interpreter, and generating weighting information that associates an evaluation score weighted based on the degree of excitement with time information corresponding to a time from the start of the live video; generating a digest video of the live video for a period designated by the time designation information based on the weight information and time designation information associated with first user information among user information identifying each of a plurality of users stored in a storage unit; streaming the live video to the plurality of terminals; distributing the digest video by streaming to a first terminal identified by the first user information among the plurality of terminals; A program to execute.

4. A video distribution system that streams live video of game play on a game device to multiple terminals connected to a network, comprising: a live video generation unit that generates the live video based on gameplay video of a game played on the game device; an acquisition unit that acquires information about a play status of the game being played on the game device from the game device; a weight information generation unit that generates weight information that associates time information corresponding to a time from the start of the live video with an evaluation score weighted based on information about the game play situation; a storage unit that stores user information that identifies each of a plurality of users; a digest generation unit that generates a digest video of the live video for a period designated by the time designation information based on time designation information and the weight information associated with first user information of the user information; a distribution unit that distributes the live video to the plurality of terminals by streaming and distributes the digest video to a first terminal identified by the first user information among the plurality of terminals by streaming; A video distribution system comprising:

5. 1. A control method for a video distribution system that distributes live video of game play on a game device by streaming to multiple terminals connected to a network, comprising: a live video generation unit generating the live video based on a game play video of a game being played on the game device; an acquisition unit acquiring information relating to a playing status of the game being played on the game device from the game device; a weight information generating unit generating weight information that associates time information corresponding to a time from the start of the live video with an evaluation score weighted based on information related to a play situation of the game; a digest generation unit generating a digest video of the live video for a period designated by the time designation information based on the weight information and time designation information associated with first user information among user information identifying each of a plurality of users stored in a storage unit; a distribution unit streaming the live video to the plurality of terminals; the distribution unit streaming the digest video to a first terminal identified by the first user information among the plurality of terminals; A control method comprising:

6. A computer in a video distribution system that streams live video of game play on a game device to multiple terminals connected to a network, generating the live video based on a gameplay video of a game played on the game device; acquiring, from the game device, information relating to a playing status of the game being played on the game device; generating weight information that associates time information corresponding to a time from the start of the live video with evaluation points weighted based on information about the game play situation; generating a digest video of the live video for a period designated by the time designation information based on the weight information and time designation information associated with first user information among user information identifying each of a plurality of users stored in a storage unit; streaming the live video to the plurality of terminals; distributing the digest video by streaming to a first terminal identified by the first user information among the plurality of terminals; A program to execute.

Images