Computer program, server device, terminal device, and method

Abstract

To cause a viewing user to have a feeling that he / she is participating in a game.SOLUTION: A computer program distributes a first moving image including an animation of a first avatar object of a distribution user generated on the basis of motion data on the distribution user's motion, and a second moving image on a game generated on the basis of operation data on the distribution user's operation using a received Web page to a terminal device of a viewing user through a communication line, receives gift information indicating that a gift is imparted to the distribution user generated by an operation of the viewing user viewing the second moving image from the terminal device of the viewing user through the communication line, and distributes the second moving image including a game object including an avatar object of a specific viewing user selected from a plurality of viewing users who have generated the gift information in a first period which is set on the basis of the gift information and in which a game is executed to the terminal device of the viewing user in a second period generated after the first period.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The technology disclosed in this application relates to a computer program, a server device, a terminal device, and a method used for distributing video related to a game from a terminal device of a distributor user to a terminal device of a viewing user. [Background technology]

[0002] A service called Mirrativ (Non-Patent Document 1) is known as a service used for distributing video related to games from a terminal device of a distributor user to a terminal device of a viewer user.

[0003] In this service, a broadcasting user can use a terminal device to broadcast a video including an animation of an avatar generated based on motion data related to the broadcasting user's motion, and a video related to a game generated based on operation data related to the broadcasting user's operation, to the terminal devices of multiple viewing users. Note that the above-mentioned Non-Patent Document 1 is incorporated herein in its entirety by reference. [Prior art documents] [Patent documents]

[0004] [Non-Patent Document 1] "Mirrativ", [online], August 16, 2019, Mirrativ, Inc., [Retrieved August 26, 2019], Internet (https: / / apps.apple.com / jp / app / mirrativ-mirrativ-smartphone-easy-game-distribution / id1028944599) Summary of the Invention [Problem to be solved by the invention]

[0005] In the above service, each viewing user can exchange comments with the broadcasting user, and can also give gifts to the broadcasting user. However, the comments and gifts sent by each viewing user to the broadcasting user in this way do not affect elements, such as game objects or parameters, used in the game played and broadcast by the broadcasting user. Therefore, when viewing a video related to a game broadcast by the broadcasting user, it is difficult for each viewing user to get the feeling that they are participating in the game.

[0006] Therefore, the technology disclosed in this application provides a computer program, a terminal device, a server device, and a method that can give viewing users the feeling that they are participating in a game. [Means for solving the problem]

[0007] A computer program according to one embodiment causes the processor to function as follows: "When executed by at least one processor, the computer program causes the processor to: deliver, via a communication line, a first video including an animation of a first avatar object of a broadcasting user, which is generated based on motion data regarding the motion of the broadcasting user, and a second video related to a game, which is generated using a received webpage based on operation data regarding the operation of the broadcasting user, to a terminal device of a viewing user; receive, via the communication line, gift information indicating that a gift will be given to the broadcasting user, which is generated by the operation of the viewing user watching the second video, from the terminal device of the viewing user; and deliver, during a second period occurring after the first period, the second video including a game object including an avatar object of a specific viewing user selected from among a plurality of viewing users who generated the gift information and which is set based on the gift information, to the terminal device of the viewing user via the communication line during a second period occurring after the first period." A terminal device according to one embodiment "has at least one processor, which distributes a first video including an animation of a first avatar object of a broadcasting user generated based on motion data related to the motion of the broadcasting user, and a second video related to a game generated based on operation data related to the operation of the broadcasting user using a received webpage, to a terminal device of a viewing user via a communication line, receives gift information indicating that a gift will be given to the broadcasting user generated by the operation of the viewing user watching the second video from the terminal device of the viewing user via the communication line, and distributes the second video including a game object including an avatar object of a specific viewing user selected from among a plurality of viewing users who generated the gift information during a first period during which the game is executed, which is set based on the gift information, to the terminal device of the viewing user via the communication line during a second period occurring after the first period." A method according to one embodiment is "a method executed by at least one processor that executes computer-readable instructions, comprising the steps of: distributing, via a communication line, to a terminal device of a viewing user, a first video including an animation of a first avatar object of the broadcasting user that is generated based on motion data related to the motion of the broadcasting user, and a second video related to a game that is generated using a received webpage based on operation data related to the operation of the broadcasting user; receiving, via the communication line, from the terminal device of the viewing user, gift information indicating that a gift will be given to the broadcasting user that is generated by the operation of the viewing user who watches the second video; and distributing, during a second period occurring after the first period, the second video including a game object that includes an avatar object of a specific viewing user selected from among a plurality of viewing users who generated the gift information during a first period during which the game is executed that is set based on the gift information, to the terminal device of the viewing user via the communication line." A computer program according to another embodiment causes the processor to function as follows: "When executed by at least one processor, the computer program causes the processor to function as follows: to distribute, to a terminal device of a viewing user via a communication line, a first video including an animation of a first avatar object of the broadcasting user, which is generated based on motion data related to the motion of the broadcasting user, and a second video related to a game, which is generated by the terminal device of the broadcasting user using a received webpage based on operation data related to the operation of the broadcasting user; to receive, from the terminal device of the viewing user via the communication line, gift information indicating that a gift will be given to the broadcasting user, which is generated by the operation of the viewing user watching the second video; and to distribute, to the terminal device of the viewing user via the communication line, the second video, which includes a game object that is set based on the gift information and includes an avatar object of a specific viewing user selected from among a plurality of viewing users who generated the gift information during a first period in which the game is executed, and which was distributed by the terminal device of the broadcasting user during a second period occurring after the first period." A server device according to one embodiment "has at least one processor, which distributes, to a terminal device of a viewing user via a communication line, a first video including an animation of a first avatar object of the broadcast user generated based on motion data related to the motion of the broadcast user, and a second video related to a game generated by the terminal device of the broadcast user based on operation data related to the operation of the broadcast user using a received webpage, receives gift information indicating that a gift will be given to the broadcast user generated by the operation of the viewing user watching the second video from the terminal device of the viewing user via the communication line, and distributes the second video, which includes a game object set based on the gift information and including an avatar object of a specific viewing user selected from among a plurality of viewing users who generated the gift information during a first period in which the game is executed, and which was distributed by the terminal device of the broadcast user during a second period occurring after the first period, to the terminal device of the viewing user via the communication line." Another method is "a method executed by at least one processor that executes computer-readable instructions, comprising the steps of: delivering, to a terminal device of a viewing user via a communication line, a first video including an animation of a first avatar object of the broadcasting user generated based on motion data related to the motion of the broadcasting user, and a second video related to a game generated by the terminal device of the broadcasting user based on operation data related to the operation of the broadcasting user using a received webpage; receiving, via the communication line, gift information from the terminal device of the viewing user, which is generated by the operation of the viewing user watching the second video and indicates that a gift will be given to the broadcasting user; and delivering, to the terminal device of the viewing user via the communication line, the second video including a game object set based on the gift information and including an avatar object of a specific viewing user selected from among a plurality of viewing users who generated the gift information during a first period during which the game is executed, and which was delivered by the terminal device of the broadcasting user during a second period occurring after the first period." A server device according to another embodiment includes "at least one processor, the processor being configured to transmit, via a communication line to a terminal device of a broadcast user, a first video including an animation of a first avatar object of the broadcast user, which is generated based on motion data related to the motion of the broadcast user, and a second video related to a game, which is generated based on operation data related to the operation of the broadcast user using the received web page, to a terminal device of the broadcast user, the first video including an animation of a first avatar object of the broadcast user, and the second video related to the game, which is generated based on operation data related to the operation of the broadcast user using the received web page, to the terminal device of the viewing user, the computer program being configured to cause the terminal device of the broadcast user to receive, via the communication line, gift information indicating that a gift will be given to the broadcast user, which has been generated by the operation of the viewing user who watches the second video, from the terminal device of the viewing user, and to broadcast, during a second period occurring after the first period, the second video including a game object including an avatar object of a specific viewing user selected from among a plurality of viewing users who generated the gift information during a first period during which the game is executed, which is set based on the gift information." A method according to another aspect is "a method executed by at least one processor that executes computer-readable instructions, comprising the steps of: transmitting a web page including a computer program to a terminal device of a broadcast user configured to broadcast, via a communication line, a first video including an animation of a first avatar object of the broadcast user generated based on motion data related to the motion of the broadcast user, and a second video related to a game generated based on operation data related to the operation of the broadcast user using the received web page to a terminal device of the viewing user, wherein the computer program receives, via the communication line, gift information from the terminal device of the viewing user indicating that a gift will be given to the broadcast user, the gift information being generated by the operation of the viewing user watching the second video, and broadcasting, during a second period occurring after the first period, the second video including a game object including an avatar object of a specific viewing user selected from among a plurality of viewing users who generated the gift information during a first period during which the game is executed, the second video being set based on the gift information." [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a block diagram showing an example of a configuration of a video distribution system 1 according to an embodiment. [Diagram 2] FIG. 2 is a block diagram illustrating an example of a hardware configuration of the terminal device 10 (server device 20) illustrated in FIG. [Diagram 3] FIG. 3 is a block diagram illustrating an example of functions of the terminal device 10 illustrated in FIG. [Figure 4] FIG. 4 is a block diagram illustrating an example of the functions of the server device 20 illustrated in FIG. [Figure 5A] FIG. 5A is a flow diagram showing an example of the operation performed in the video distribution system 1 shown in FIG. [Figure 5B]FIG. 5B is a flow diagram showing an example of the operation performed in the video distribution system 1 shown in FIG. [Figure 6] FIG. 6 is a schematic diagram showing an example of the first moving image displayed on the display unit of terminal device 10A shown in FIG. [Figure 7] FIG. 7 is a schematic diagram showing an example of the second moving image displayed on the display unit of terminal device 10A shown in FIG. [Figure 8] FIG. 8 is a schematic diagram showing another example of the second moving image displayed on the display unit of terminal device 10A shown in FIG. [Figure 9] FIG. 9 is a schematic diagram showing yet another example of the second moving image displayed on the display unit of terminal device 10A shown in FIG. [Figure 10] FIG. 10 is a schematic diagram showing yet another example of the second moving image displayed on the display unit of terminal device 10A shown in FIG. [Figure 11] FIG. 11 is a flow diagram showing a method for selecting an avatar object of a viewing user to be displayed in a game executed on the terminal device 10 shown in FIG. [Figure 12A] FIG. 12A is a diagram showing an example of the first ranking information generated and displayed by the moving image distribution system 1 shown in FIG. [Figure 12B] FIG. 12B is a diagram showing another example of the first ranking information generated and displayed by the moving image distribution system 1 shown in FIG. [Figure 12C] FIG. 12C is a diagram showing yet another example of the first ranking information generated and displayed by the moving image distribution system 1 shown in FIG. [Figure 13A] FIG. 13A is a diagram showing an example of second ranking information generated and displayed by the moving image distribution system 1 shown in FIG. [Figure 13B] FIG. 13B is a diagram showing another example of the second ranking information generated and displayed by the moving image distribution system 1 shown in FIG. [Figure 13C] FIG. 13C is a diagram showing yet another example of the second ranking information generated and displayed by the moving image distribution system 1 shown in FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Various embodiments of the present invention will be described below with reference to the accompanying drawings. Note that common components in the drawings are given the same reference numerals. Also, please note that components shown in one drawing may be omitted in another drawing for convenience of explanation. Furthermore, please note that the attached drawings are not necessarily drawn to scale.

[0010] 1. Video distribution system configuration The video distribution system disclosed in the present application, in brief, enables a user who is distributing (hereinafter referred to as the "distributing user") to use his / her terminal device to distribute, via a communication line, a first video including an animation of a first avatar object generated based on motion data related to the broadcasting user's motion, and a second video related to a game generated based on operation data related to the broadcasting user's operation.

[0011] Fig. 1 is a block diagram showing an example of a configuration of a video distribution system according to an embodiment. As shown in Fig. 1, the video distribution system 1 can include a plurality of terminal devices 10 connected to a communication line (not shown), and one or more server devices 20 connected to the communication line. Each terminal device 10 is connected to one or more server devices 20 via the communication line (not shown).

[0012] 1-1. Terminal device 10 The multiple terminal devices 10 may include one or more terminal devices 10 of broadcasting users (terminal device 10A in this example) and one or more terminal devices 10 of viewing users (terminal devices 10B to 10D in this example). Each terminal device 10 has a common configuration, and can function as either a terminal device for broadcasting moving images (terminal device 10 of a broadcasting user) or a terminal device for viewing moving images (terminal device 10 of a viewing user).

[0013] When each terminal device 10 operates as a terminal device for distributing moving images (terminal device of a broadcasting user), it executes an installed video distribution application to acquire motion data related to the motion of the broadcasting user, and transmits a first moving image including an animation of a virtual character (first avatar object) changed according to the acquired data to the server device 20 (distribution server system 20A) via a communication line. Such a first moving image is distributed by the server device 20 (distribution server system 20A) via a communication line to a terminal device for receiving moving images (terminal device of a viewing user) 10 that executes an installed video viewing application.

[0014] Furthermore, when each terminal device 10 operates as a broadcast user's terminal device, it can receive a web page (HTML document) from the server device 20 (web server device 20B) and execute a game program included in the web page by executing a browser function incorporated in the installed video broadcasting application and / or by executing an installed web browser application. By executing this game program, each terminal device 10 can generate a second video in which at least one game object is operated based on operation data related to the broadcast user's operation. The game objects include a game object including a virtual character (second avatar object) of the broadcast user that operates based on the operation data.

[0015] Furthermore, when each terminal device 10 operates as a terminal device of a distribution user, it can transmit the second moving image thus generated to the server device 20 (distribution server system 20A) via a communication line by executing the above-mentioned video distribution application. Such a second moving image is also distributed by the server device 20 (distribution server system 20A) via a communication line to a terminal device (terminal device of a viewing user) 10 for receiving moving images, which executes an installed video viewing application.

[0016] Furthermore, when each terminal device 10 operates as a terminal device of a broadcasting user, it can execute the above-mentioned video distribution application to receive, via the server device 20 (distribution server system 20A), gift information indicating that a gift will be granted to this broadcasting user, and / or comment information indicating that a comment will be sent to this broadcasting user, from the terminal device 10 of a viewing user watching the second video (distributed by the terminal device 10 of this broadcasting user)

[0017] On the other hand, when each terminal device 10 operates as a terminal device for viewing videos (terminal device of a viewing user), it can receive the first video and / or the second video distributed by the terminal device 10 of the distribution user via the server device 20 (distribution server system 20A) by executing an installed video viewing application.

[0018] Furthermore, when each terminal device 10 operates as a terminal device of a viewing user, it can execute a video viewing application to transmit gift information indicating that a gift will be given to the broadcast user and / or comment information indicating that a comment will be sent to the broadcast user to the terminal device of the broadcast user via the server device 20 (distribution server system).

[0019] The above-mentioned video distribution application and video viewing application may be installed and executed on each terminal device 10 as a single integrated application, or as separate applications.

[0020] Each terminal device 10 is any terminal device capable of performing such operations, and may include, but is not limited to, a smartphone, a tablet, a mobile phone (feature phone), and / or a personal computer.

[0021] 1-2. Server device 20 FIG. 1 illustrates, as one or more server devices 20, a distribution server system 20A and a web server device 20B as an example.

[0022] The distribution server system 20A can distribute the first video and / or the second video transmitted by each terminal device (terminal device of each broadcast user) 10 to each terminal device (terminal device of each viewing user) 10. Furthermore, the distribution server system 20A can transmit gift information indicating that a gift will be given to a certain broadcast user and / or comment information indicating that a comment will be sent to a certain broadcast user, transmitted by each terminal device (terminal device of each viewing user) 10, to the terminal device 10 of that broadcast user.

[0023] In order to perform such operations, in one embodiment, the distribution server system 20A may include a distribution server device 20a, a database (DB) server device 20b, and a game API server device 20c, which are connected to each other via communication lines (including wireless lines and / or wired lines not shown).

[0024] The distribution server device 20a can distribute the first moving image and / or the second moving image transmitted by the terminal device 10 of each distribution user to each terminal device 10. Furthermore, the distribution server device 20a can store gift information and / or comment information transmitted by the terminal device 10 of each viewing user in the DB server device 20b.

[0025] The DB server device 20b stores the gift information and / or comment information received from the distribution server device 20a, and can read out and transmit the gift information and / or comment information inquired about by the game API server device 20c to the game API server device 20c.

[0026] When the game API server device 20c receives an inquiry about gift information and / or comment information from each broadcast user's terminal device 10, it can read the gift information and / or comment information for that broadcast user's terminal device 10 from the DB server device 20b and transmit it to that broadcast user's terminal device 10.

[0027] 1, for the purpose of distributing the load, the distribution server system 20A is shown to have three server devices, namely, a distribution server device 20a, a DB server device 20b, and a game API server device 20c. However, at least one of these three server devices may be integrated with one of the remaining server devices.

[0028] Next, the web server device 20B can transmit a web page (HTML, for example, a document created according to HTML5) incorporating a game program to the terminal device 10 of each broadcast user that has accessed it. This game program is received, decoded, and executed by the terminal device 10, causing the terminal device 10 to execute various operations related to the distribution of videos, including an operation of executing a game, an operation of transmitting a game screen generated in association with the execution of the game to the distribution server system 20A (distribution server device 20a), and an operation of acquiring gift information and / or comment information transmitted to this broadcast user from the distribution server system 20A (game API server device 20c).

[0029] 1-3.Communication lines The communication lines (not shown) may include, without being limited to, a mobile phone network, a wireless LAN, a landline telephone network, the Internet, an intranet, and / or an Ethernet (registered trademark), etc.

[0030] 2. Hardware configuration of each device Next, an example of the hardware configuration of each of the terminal device 10 and the server device 20 will be described.

[0031] 2-1. Hardware configuration of terminal device 10 An example of the hardware configuration of each terminal device 10 will be described with reference to Fig. 2. Fig. 2 is a block diagram showing a schematic example of the hardware configuration of the terminal device 10 (server device 20) shown in Fig. 1 (note that in Fig. 2, the reference symbols in parentheses are those described in relation to the server device 20, as described later).

[0032] 2, each terminal device 10 can mainly include a central processing unit 11, a main memory device 12, an input / output interface device 13, an input device 14, an auxiliary memory device 15, and an output device 16. These devices are connected to each other by a data bus and / or a control bus.

[0033] The central processing unit 11 is referred to as a "CPU" and performs calculations on instructions and data stored in the main memory device 12 and stores the results of the calculations in the main memory device 12. Furthermore, the central processing unit 11 can control an input device 14, an auxiliary memory device 15, an output device 16, etc. via an input / output interface device 13. The terminal device 10 can include one or more such central processing units 11.

[0034] The main memory device 12 is referred to as a "memory" and stores instructions and data received from the input device 14, the auxiliary memory device 15, and the communication line 30 (such as the server device 20) via the input / output interface device 13, as well as the results of calculations by the central processing unit 11. The main memory device 12 may include, but is not limited to, a RAM (random access memory), a ROM (read only memory), and / or a flash memory.

[0035] The auxiliary storage device 15 is a storage device having a larger capacity than the main storage device 12. It stores instructions and data (computer programs) constituting the above-mentioned specific applications (video distribution applications, video viewing applications, etc.) and web browser applications, etc., and can transmit these instructions and data (computer programs) to the main storage device 12 via the input / output interface device 13 under the control of the central processing unit 11. The auxiliary storage device 15 can include, but is not limited to, a magnetic disk device and / or an optical disk device, etc.

[0036] The input device 14 is a device that inputs data from the outside, and includes, but is not limited to, a touch panel, a button, a keyboard, a mouse, and / or a sensor, etc. The sensor may include, but is not limited to, one or more cameras, etc. and / or one or more microphones, etc., as described below.

[0037] The output device 16 may include, but is not limited to, a display device, a touch panel, and / or a printer device.

[0038] In such a hardware configuration, the central processing unit 11 sequentially loads instructions and data (computer programs) constituting a specific application stored in the auxiliary storage device 15 into the main storage device 12, and performs calculations on the loaded instructions and data, thereby controlling the output device 16 via the input / output interface device 13, and also transmitting and receiving various information to and from other devices (such as a server device 20 and other terminal devices 10, etc.) via the input / output interface device 13 and communication line 30.

[0039] As a result, by executing a specific installed application, the terminal device 10 can perform operations necessary to distribute a first video and / or a second video, operations necessary to receive gift information and / or comment information sent to the terminal device 10 by another terminal device 10, operations necessary to receive the first video and / or the second video distributed by another terminal device 10, and / or operations necessary to send gift information and / or comment information to another terminal device 10 (including various operations described in detail later).

[0040] Note that the terminal device 10 may include, instead of the central processing unit 11 or in addition to the central processing unit 11, one or more microprocessors and / or a graphics processing unit (GPU).

[0041] 2-2. Hardware configuration of server device 20 An example of the hardware configuration of each server device 20 will also be described with reference to Fig. 2. The hardware configuration of each server device 20 (distribution server device 20a, DB server device 20b, game API server device 20c, and web server device 20B) may be the same as the hardware configuration of each terminal device 10 described above. Therefore, reference characters for the components of each server device 20 are shown in parentheses in Fig. 2.

[0042] 2, each server device 20 can mainly include a central processing unit 21, a main memory device 22, an input / output interface device 23, an input device 24, an auxiliary memory device 25, and an output device 26. These devices are connected to each other by a data bus and / or a control bus.

[0043] The central processing unit 21, main memory device 22, input / output interface device 23, input device 24, auxiliary memory device 25 and output device 26 can be approximately the same as the central processing unit 11, main memory device 12, input / output interface device 13, input device 14, auxiliary memory device 15 and output device 16 included in each of the above-mentioned terminal devices 10, respectively.

[0044] In such a hardware configuration, the central processing unit 21 sequentially loads instructions and data (computer programs) constituting a specific application stored in the auxiliary storage device 25 into the main storage device 22, and by performing operations on the loaded instructions and data, it is possible to control the output device 26 via the input / output interface device 23, or to transmit and receive various information to and from other devices (such as each terminal device 10) via the input / output interface device 23 and communication line 30.

[0045] As a result, the server device 20 can perform operations necessary to distribute the first video and / or the second video transmitted by each broadcast user's terminal device 10 to each viewing user's terminal device 10, and operations necessary to transmit gift information and / or comment information transmitted by each viewing user's terminal device 10 to a certain broadcast user's terminal device 10 to that broadcast user's terminal device 10 (including various operations described in detail later).

[0046] Note that the server device 20 may include, instead of the central processing unit 21 or in addition to the central processing unit 21, one or more microprocessors and / or a graphics processing unit (GPU).

[0047] 3. Functions of each device Next, an example of the functions of the terminal device 10 and the server device 20 will be described. 3-1. Functions of terminal device 10 An example of the functions of the terminal device 10 will be described with reference to Fig. 3. Fig. 3 is a block diagram that illustrates an example of the functions of the terminal device 10 illustrated in Fig. 1.

[0048] As shown in FIG. 3, the terminal device 10 may mainly include a first video generation unit 100, a second video generation unit 110, a communication unit 120, a display unit 130, a memory unit 140, a user interface unit 150, a gift processing unit 160, and a ranking processing unit 170.

[0049] (1) First moving image generator 100 The first moving image generating unit 100 can generate a first moving image including an animation of a first avatar object of a broadcast user based on motion data related to the motion of the broadcast user. To achieve this, the first moving image generating unit 100 can include, for example, an acquisition unit 102 (not shown) and a processing unit 104 (not shown).

[0050] The acquisition unit 102 may include one or more first sensors 102a (not shown) that acquire data related to the broadcast user's face, and one or more second sensors 102b (not shown) that acquire audio data related to speaking and / or singing uttered by the broadcast user.

[0051] In a preferred embodiment, the first sensor 102a may include an RGB camera for capturing visible light and a near-infrared camera for capturing near-infrared light. For example, such a camera may be included in the True Depth camera of the iPhone X. The second sensor 102b may include a microphone for recording audio.

[0052] First, regarding the first sensor 102a, the acquisition unit 102 captures the face of the broadcasting user using the first sensor 102a arranged close to the face of the broadcasting user. This allows the acquisition unit 102 to generate data (e.g., an MPEG file) in which the image acquired by the RGB camera is associated with a time code (a code indicating the time of acquisition) and recorded over a unit time. Furthermore, the acquisition unit 102 can generate data (e.g., a TSV file [a file in a format in which a plurality of data are recorded with data separated by tabs]) in which a predetermined number (e.g., 51) of numerical values ​​(e.g., floating-point numerical values) indicating depths acquired by the near-infrared camera are associated with the time code and recorded over a unit time.

[0053] Concerning the near-infrared camera, specifically, a dot projector emits an infrared laser forming a dot pattern onto the face of the performer, and the near-infrared camera captures the infrared dots projected onto and reflected from the face of the performer, and generates an image of the infrared dots thus captured. The acquisition unit 102 can compare an image of a dot pattern emitted by a dot projector registered in advance with an image captured by the near-infrared camera, and calculate the depth of each point (each feature point) (e.g., each of 51 points / feature points) (distance between each point / feature point and the near-infrared camera) using the positional deviation of each point (each feature point) in both images. The acquisition unit 102 can generate data in which the numerical value indicating the depth thus calculated is associated with a time code as described above and recorded over a unit time.

[0054] Next, regarding the second sensor 102b, the acquisition unit 102 acquires audio related to speech and / or singing uttered by the broadcast user using the second sensor 102b arranged close to the broadcast user. This allows the acquisition unit 100 to generate data (e.g., an MPEG file) recorded over a unit time in association with a time code. In one embodiment, the acquisition unit 102 can acquire audio data related to speech and / or singing uttered by the broadcast user using the second sensor 102b at the same time as acquiring data related to the face of the broadcast user using the first sensor 102a. In this case, the acquisition unit 102 can generate data (e.g., an MPEG file) recorded over a unit time in association with the same time code, including an image acquired by the RGB camera and audio data related to speech and / or singing uttered by the broadcast user using the second sensor 102b.

[0055] The acquisition unit 102 can output to the processing unit 104 the data generated in this manner relating to the face of the broadcast user (MPEG files, TSV files, etc.) and / or audio data relating to the speech and / or singing uttered by the broadcast user (MPEG files, etc.).

[0056] Here, the case where the first sensor 102a includes an RGB camera and an infrared camera has been described, but the first sensor 102a may include, for example, any of (A) a camera that detects infrared rays emitted by an infrared laser and reflected on the face of the performer, (B) a plurality of RGB cameras that capture visible light, and (C) a single camera that captures visible light. In the case of (A) above, the acquisition unit 102 can calculate the depth for each feature point in the face of the broadcast user by a method similar to that described above. In the case of (B) above, the acquisition unit 102 can calculate the depth for each feature point in the face of the broadcast user using a plurality of images captured by a plurality of RGB cameras. In the case of (C) above, the acquisition unit 102 can calculate the depth for each feature point in the face of the broadcast user from an image captured by a single camera by using deep learning or the like. In the above case of (C), the acquisition unit 102 may calculate the depth of each feature point in the performer's face by performing an analysis process (such as image processing) on ​​an image captured by a single camera.

[0057] The processing unit 104 can generate a moving image including an animation of a virtual character (a first avatar object of the broadcasting user) based on the data related to the face of the broadcasting user from the acquisition unit 102. Regarding the moving image of the virtual character itself, the processing unit 104 can generate the moving image of the virtual character by causing a rendering unit (not shown) to perform rendering using various information (e.g., geometry information, bone information, texture information, shader information, blend shape information, etc.) stored in a character data storage unit (not shown).

[0058] Furthermore, the processing unit 104 can use data regarding the face of the broadcast user from the acquisition unit 102 (data regarding the depth of each feature point on the performer's face) to generate a video in which the facial expression of the first avatar object is changed (for example, a video in which the facial expression of the first avatar object changes in synchronization with the movement of the performer's mouth and both eyes, i.e., a video in which the facial expression of the first avatar object changes in lip-sync and eye-tracking to the performer's face) using various well-known techniques.

[0059] It should be noted that any other known technology may be used to generate a first video including animation of a first avatar object of a broadcast user based on motion data relating to the broadcast user's motion.

[0060] (2) Second moving image generator 110 Second moving image generating unit 110 can generate a second moving image related to the game based on operation data related to the distributor user's operation, using the web page received from web server device 20B.

[0061] Specifically, second video generation unit 110 executes a game program embedded in a web page received from web server device 20B, thereby rendering a second video (game video) relating to a game in which a game object (own game object) including a second avatar object of the broadcasting user operates, based on operation data indicating an operation of the broadcasting user input by user interface unit 150. In this second video, various game objects including, for example, an enemy character that attacks the own game object, a wingman character that supports the own game object, and the like, operate in accordance with the game program.

[0062] (3) Communications Department 120 The communication unit 120 can communicate various information required for distribution and / or viewing of videos between the distribution server system 20A and the web server device 20B. For example, the communication unit 120 can access the web server device 20B and receive a web page (HTML document) including a game program required for executing a game. Furthermore, when the terminal device 10 operates as the terminal device of the broadcasting user, the communication unit 120 can transmit the first video and / or the second video to the distribution server system 20A and receive gift information and / or comment information transmitted to the broadcasting user from the distribution server system 20A. Furthermore, when the terminal device 10 operates as the terminal device of the viewing user, the communication unit 120 can receive the first video and / or the second video transmitted by the terminal device 10 of the broadcasting user from the distribution server system 20A and transmit gift information and / or comment information to the broadcasting user to the distribution server system 20A.

[0063] (4) Display section 130 The display unit 130 can display various information required for distribution and / or viewing of videos. For example, the display unit 130 can display the first video and / or the second video to be distributed, and / or the first video and / or the second video received, etc.

[0064] (5) Storage section 140 The storage unit 140 can store various information required for distribution and / or viewing of moving images.

[0065] (6) User interface unit 150 The user interface unit 150 can input various information required for distribution and / or viewing of a video through user operations. For example, the user interface unit 150 can input operation data indicating the content of the operation of the distributor user when playing a game from the distributor user and output the data to the second video generation unit 110.

[0066] (7) Gift Processing Unit 160 The gift processing unit 160 can process gift information transmitted and received in relation to the distribution and / or viewing of a video. For example, when the terminal device 10 operates as the terminal device 10 of a broadcasting user, the gift processing unit 160 can process gift information sent to this broadcasting user. Also, when the terminal device 10 operates as the terminal device 10 of a viewing user, the gift processing unit 160 can process gift information sent by this viewing user.

[0067] (8) Ranking processing unit 170 The ranking processing unit 170 can acquire (generate and / or receive) first ranking information indicating a ranking for each broadcast user who has received the gift information, and / or second ranking information indicating a ranking for each viewing user who has transmitted the gift information. Details of the first ranking information and the second ranking information will be described later in Section "6".

[0068] 3-2. Functions of the server device 20 An example of the functions of the server device 20 will be described with reference to Fig. 4. Fig. 4 is a block diagram illustrating an example of the functions of the server device 20 shown in Fig. 1. As shown in FIG. 4, the server device 20 may mainly include a communication unit 200, a storage unit 210, a gift processing unit 220, and a ranking processing unit 230.

[0069] The communication unit 200 can communicate various information required for distribution and / or viewing of videos between the terminal device 10 of the broadcasting user and / or the terminal device 10 of the viewing user. For example, when the server device 20 operates as a distribution server system 20A, it can receive the first video and / or the second video from the terminal device 10 of each broadcasting user and distribute it to the terminal device 10 of each viewing user. When the server device 20 operates as a web server device 20B, it can transmit a web page incorporating a game program to the terminal device 10 of each broadcasting user that has accessed it.

[0070] The storage unit 210 can store various information required for distribution and / or viewing of moving images.

[0071] The gift processing unit 220 can process gift information sent from each viewing user to each broadcast user.

[0072] The ranking processing unit 230 can acquire (generate and / or receive) first ranking information indicating a ranking for each broadcast user who has received the gift information, and / or second ranking information indicating a ranking for each viewing user who has transmitted the gift information. Details of the first ranking information and the second ranking information will be described later in Section "6".

[0073] When the server device 20 operates as the web server device 20B, the gift processing unit 220 and the ranking processing unit 330 may be omitted.

[0074] 4. Overall operation of video distribution system 1 Next, the overall operation of the video distribution system 1 having the above configuration will be described with reference to Figures 5A and 5B. Figures 5A and 5B are flow diagrams showing an example of the operation performed in the video distribution system 1 shown in Figure 1.

[0075] First, referring to FIG. 5A, in step (hereinafter referred to as “ST”) 302, in accordance with the operation of a broadcast user (here, broadcast user A), terminal device 10 (here, terminal device 10A) launches and executes a video broadcasting application.

[0076] Next, in ST304, terminal device 10A generates a first video including an animation of broadcast user A's first avatar object based on motion data relating to the motion of broadcast user A. As a result, as exemplified in Fig. 6, first video 404 including an animation of broadcast user A's first avatar object 402 is displayed on display unit 130 of terminal device 10A.

[0077] Returning to FIG. 5A, the terminal device 10A further transmits the generated first moving image 404 to the distribution server device 20a of the distribution server system 20A. The distribution server device 20a distributes the first moving image received from the terminal device 10A to the terminal device 10 of each viewing user executing a moving image viewing application. As a result, the first moving image 404 as exemplified in FIG. 6 is also displayed on the display unit 130 of the terminal device 10 of each viewing user.

[0078] Next, in ST306, when distributor user A taps icon 406 (see FIG. 6) called "game" displayed on display unit 130 of terminal device 10A, terminal device 10A executes a browser function installed in the video distribution application. As a result, in ST308, terminal device 10A can receive an HTML5 document incorporating a game program by accessing web server device 20B while executing the video distribution application (i.e., having distributed first video 404 to terminal devices 10 of each viewing user).

[0079] Next, in ST310, the terminal device 10A executes the game program embedded in the received HTML5 document, thereby generating a video related to the game (a second video).

[0080] Fig. 7 is a schematic diagram showing an example of a second video displayed on the display unit of terminal device 10A shown in Fig. 1. As exemplified in Fig. 7, in second video 500, broadcast user A's own game object 504 including second avatar object 502 can move based on operation data related to an operation performed on user interface unit 150 by broadcast user A. As a result, for example, broadcast user A's own game object 504 can move according to broadcast user A's operation to attack game object 506, which is an enemy character.

[0081] The second avatar object 502 of broadcast user A may be generated using the first avatar object 402 of the first broadcast user A. For example, the second avatar object 502 may be completely or substantially identical to the first avatar object 402, may be a modified, reduced, and / or enlarged version of at least a portion of the first avatar object 402, or may be a part of the first avatar object 402.

[0082] In this second video 500, comment information sent from at least one viewing user to broadcast user A may be displayed in a portion of the area (chat area) (for example, upper area 508 as illustrated in FIG. 7). The comment information may include any comment information, such as a comment 510 from viewing user X to support broadcast user A, or a comment 512 from viewing user Y to indicate that he has given gift G1 to broadcast user A.

[0083] Returning to FIG. 5A, in ST312, terminal device 10A transmits the second moving image (game screen) generated in ST310 to distribution server device 20a of distribution server system 20A. Distribution server device 20a distributes the second moving image received from terminal device 10A to terminal device 10 of each viewing user executing a moving image viewing application. As a result, the second moving image 500 as illustrated in FIG. 7 (for example, overlaid on the first moving image as illustrated in FIG. 6, hiding most of the first moving image) can also be displayed on display unit 130 of terminal device 10 of each viewing user.

[0084] Next, in ST314, consider a case where a viewing user (here, viewing user B) viewing the second video 500 transmitted by terminal device 10A gives gift G2 to broadcast user A. Viewing user B can operate terminal device 10B to select gift B from a plurality of gifts prepared and select a command to give it to broadcast user A. As a result, terminal device 10B transmits gift information indicating that gift G2 will be given to broadcast user A to distribution server device 20a of distribution server system 20A. This gift information can include, for example, receiver identification information that identifies the receiver of the gift (broadcast user A), gift identification information that identifies the gift, and sender identification information that identifies the sender of the gift (viewing user B).

[0085] When the viewing user B operates the terminal device 10B to give a gift, the viewing user B can also send a comment along with the gift. In this case, the gift information that the terminal device 10B sends to the distribution server device 20a can include comment information in addition to the recipient identification information, the gift identification information, and the sender identification information.

[0086] In ST316, the distribution server device 20a can store the gift information received from the terminal device 10B in the DB server device 20b. For example, the DB server device 20b can store, as the gift information, number identification information for identifying which gift has been given, the gift identification information, and the sender identification information (and further comment information) in association with the recipient identification information.

[0087] In ST318, while broadcast user A's terminal device 10A is playing the game, it can inquire of the game API server device 20c at each predetermined time interval whether new gift information has arrived for broadcast user A. For example, if terminal device 10A has received one piece of gift information (e.g., gift information from viewing user Y illustrated in FIG. 7) from the game API server device 20c since starting the game, it can inquire of the game API server device 20c whether there is a second or subsequent piece of gift information.

[0088] In ST320, in response to an inquiry from the terminal device 10A, the game API server device 20c requests the second and subsequent gift information for the broadcast user A from the DB server device 20b. When the DB server device 20b is able to search for the second and subsequent number identification information as the number identification information stored in association with the broadcast user A (recipient identification information), the DB server device 20b transmits the gift identification information and sender identification information (and further comment information) corresponding to each of the second and subsequent number identification information as the second gift information to the game API server device 20c. Here, the DB server device 20b assumes that it has only been able to search for the second number identification information, and transmits the gift identification information and sender identification information (and further comment information) corresponding to this second number identification information to the game API server device 20c as the second gift information. In response to this, the game API server device 20c transmits the second gift information to the terminal device 10A of the broadcast user A.

[0089] Next, referring to FIG. 5B, in ST322, the terminal device 10A that has received the second gift information can execute a game based on this second gift information. The terminal device 10A can display, on the game screen (second moving image), a game object set based on a sender (here, the viewing user B) identified by the sender identification information included in the gift information and / or a gift (here, the gift G2) uniquely identified by the gift identification information included in the gift information. For example, the terminal device 10A can display, on the second moving image, a game object (enemy character and / or ally character) including an avatar object of the viewing user B, and can also display, on the second moving image, a game object of the user (a game object including the second avatar object of the broadcasting user A) whose hit points have been increased based on the gift G2. Each terminal device 10 stores an avatar object (image) of the user (viewing user) in association with each sender identification information, and stores the gift (image) in association with each gift identification information, thereby generating and displaying a second moving image including the avatar object of each viewing user and / or each gift. A specific method for generating the second moving image based on the gift information will be described later in Section "5".

[0090] Terminal device 10A can also display comment information included in the gift information on the game screen (second video). For example, as illustrated in FIG. 7, if viewing user B selects to send a comment when giving gift G2 to broadcast user A in ST314, terminal device 10A can display comment information such as "It's gift G2" on the second video. In this way, the viewing user's comment displayed on the second video may correspond to the gift information sent by that viewing user to that broadcast user.

[0091] Furthermore, since the terminal device 10A has received two pieces of gift information from the game API server device 20c so far (the terminal device 10A identifies how many pieces of gift information have been received so far while the game is being played), in the next time period, it can inquire of the game API server device 20c about whether there is a third or subsequent piece of gift information.

[0092] Next, returning to FIG. 5B, in ST324, terminal device 10A distributes a second video including game objects set based on the gift information in this manner to terminal device 10 of each viewing user via distribution server system 20A in a manner similar to ST312.

[0093] Next, in ST326, if terminal device 10A continues the game, it can repeat the above-mentioned processing from ST308 onwards. On the other hand, if terminal device 10A ends the game, the processing proceeds to ST328.

[0094] In ST328, terminal device 10A can distribute the ranking information to terminal device 10 of each viewing user via distribution server device 20a of distribution server system 20. Instead of ST328 or after ST328, in ST330, distribution server device 20a can distribute the ranking information to terminal device 10 of each viewing user. At least one of ST328 and ST330 may be executed, or both ST328 and ST330 may be omitted. Details of the ranking information will be described later in section "6".

[0095] 5.Generating a second video (game screen) based on gift information Next, a specific method for generating the second moving image based on the gift information mentioned in relation to ST322 above will be described.

[0096] 5-1. Creating game objects that attack or support your own game object (part 1) Fig. 8 is a schematic diagram showing another example of the second moving image displayed on the display unit of terminal device 10A shown in Fig. 1. In the second moving image 600 shown in Fig. 8, a user's own game object 504 including a second avatar object 502 of broadcast user A is displayed, similar to the example shown in Fig. 7.

[0097] First, a viewing user (here, viewing user 10C) viewing the second video 600 distributed by the terminal device 10A of the broadcasting user A can use the terminal device 10 (here, terminal device 10C) to transmit gift information to the broadcasting user A. In this case, the terminal device 10A receives the gift information transmitted by the terminal device 10C from the game API server device 20c by the method described above in relation to ST318 and ST320. In response to this, the terminal device 10A can generate a game object 604 including the avatar object 602 of the viewing user C as a game object set based on the received gift information, and display it in the second video 600. This game object 604 can be set as an enemy character (which may be a common minor character that appears frequently, or a so-called boss character that appears at the end of a scene, face, scenario, or stage) that attacks the user's own game object 504.

[0098] Next, another viewing user (here, viewing user 10D) viewing the second video 600 can use his / her terminal device 10 (here, terminal device 10D) to transmit gift information to broadcast user A. In this case, terminal device 10A receives the gift information transmitted by terminal device 10D from game API server device 20c by the method described above in relation to ST318 and ST320. In response to this, terminal device 10A can generate a game object 608 including an avatar object 606 of viewing user D as a game object set based on the received gift information, and display it in the second video 600. This game object 608 can be set as an ally character (wingman) that supports the player's own game object 504 and attacks the game object 604.

[0099] Furthermore, another viewing user (here, viewing user 10E) viewing the second video 600 can use his / her terminal device 10 (here, terminal device 10E) to transmit gift information to broadcast user A. In this case, terminal device 10A receives the gift information transmitted by terminal device 10E from game API server device 20c by the method described above in relation to ST318 and ST320. In response to this, terminal device 10A can generate a game object 612 including an avatar object 610 of viewing user E as a game object set based on the received gift information, and display it in the second video 600. This game object 612 can be set as an ally character (a missile that flies toward game object 604 and reduces the strength of game object 604) that supports the player's game object 504 and attacks game object 604.

[0100] The second video 600 (game screen) thus generated by the terminal device 10A is distributed to the terminal device 10 of each viewing user via the distribution server device 20c, as described in relation to ST324 above. As a result, the second video 600 exemplified in Fig. 9 can be similarly displayed on the terminal device 10 of each viewing user.

[0101] In one embodiment, the operations of the game objects 604, 608, and 612 thus set based on the gift information can be automatically controlled by the game program executed by the terminal device 10A.

[0102] At least one parameter of each of the game objects 604, 608, and 612 may be set based on the gift information. The parameter may include the attack power, defense power, stamina, mobility, equipment, and / or items of the corresponding game object.

[0103] Furthermore, this parameter may be set based on gift information. Specifically, for example, when the viewing user C uses the terminal device 10C to give a gift to the broadcasting user A, the viewing user C can select a desired gift from among a plurality of gifts prepared. For each of the plurality of gifts, points (gift points) corresponding to the gift are set and displayed. In one embodiment, the gift points corresponding to a certain gift can be the purchase amount of the gift. In another embodiment, each viewing user can obtain points (also referred to as "my points") every time they view a second video (which may be the first video) distributed by the broadcasting user. Each viewing user can select a desired free gift from a plurality of free gifts prepared, and acquire the desired free gift by consuming their owned my points. Therefore, in this case, the gift points corresponding to a certain gift can be the number of my points consumed when acquiring the gift.

[0104] The terminal device 10A of the broadcasting user A, which receives the gift information from the viewing user C, can read the gift points corresponding to the gift identification information included in the gift information from the memory unit 140, and set the above-mentioned parameters of the game object 604 based on the read gift points (for example, proportional to the gift points).

[0105] In this way, when each viewing user viewing the second video 600 transmits gift information to the broadcasting user, a game object including the viewing user's avatar object is displayed in the second video 600 viewed by the broadcasting user and each viewing user as a game object that can affect the viewing user's own game object (a game object including the broadcasting user's avatar object). As a result, each viewing user can influence the success or failure of the game played by the broadcasting user by transmitting gift information to the broadcasting user, and can thus feel that they are participating in the game. Furthermore, each viewing user can select a gift with higher gift points (e.g., price) as a gift to be given to the broadcasting user, and the game object set based on the higher gift points will affect the viewing user's own game object (have a greater impact on the success or failure of the game). As a result, each viewing user can feel even more strongly that they are participating in the game.

[0106] Furthermore, generally, when a game program is installed in the terminal device 10 or when the game program is incorporated in a video distribution application installed in the terminal device 10, in order to execute a new game, the terminal device 10 needs to install a new game program or a video distribution application incorporating the new game program. In this case, from the viewpoint of the game program creator, since it is necessary to prepare game programs corresponding to each of a plurality of OSs, there is a problem that the number of steps required for creating the game program increases. Meanwhile, from the viewpoint of the user, since it is necessary to download a new game program and / or update an existing game program in order to obtain a new game, there is a problem that it requires communication load, communication cost, time and effort.

[0107] In contrast, in the technology disclosed in the present application, the terminal device 10 of the distribution user does not execute a game program installed in the terminal device 10 in order to execute a game, but calls a browser function incorporated in a video distribution application, receives a web page (HTML document, particularly HTML5 document) from the web server device 20B using the browser function, and executes the game program incorporated in the web page. This allows the terminal device 10 of the distribution user to easily execute a new game. Therefore, when providing a new game, the creator of the game program only needs to incorporate a new game program into the web page (HTML document, particularly HTML5 document) transmitted by the web server device 20B, thereby reducing the number of steps required to create a new game program. In addition, the user does not need to download a new game program in order to receive the provision of a new game, thereby reducing communication load, communication costs, time, and effort.

[0108] 5-2. Creating a game object that changes parameters related to your own game object Fig. 9 is a schematic diagram showing yet another example of the second moving image displayed on the display unit of terminal device 10A shown in Fig. 1. In the second moving image 700 shown in Fig. 9, a user's own game object 504 including a second avatar object 502 of broadcast user A is displayed, similar to the example shown in Fig. 7.

[0109] First, a viewing user (here, viewing user 10C) viewing the second video 700 distributed by the terminal device 10A of the broadcasting user A can use the terminal device 10 (here, terminal device 10C) to transmit gift information to the broadcasting user A. In this case, the terminal device 10A receives the gift information transmitted by the terminal device 10C from the game API server device 20c by the method described above in relation to ST318 and ST320 above. In response to this, the terminal device 10A can generate and display in the second video 700 a game object that gives points (ranking points) based on the gift information to the broadcasting user A by interacting with its own game object 504, and / or a game object that gives parameters based on the gift information to its own game object 504 by interacting with its own game object 504, as a game object set based on the received gift information.

[0110] Specifically, in the first example, broadcast user A operates his / her own game object 504 to cause his / her own game object 504 to interact with a game object 702 showing, for example, the characters "Good job" (for example, by touching the game object 702 or by touching a missile launched at the game object 702, etc.), thereby broadcast user A can obtain ranking points set based on the gift information corresponding to this game object 702. In this case, terminal device 10A can read out from storage unit 140 ranking points corresponding to the gift identification information included in the received gift information, and grant the read ranking points (or ranking points obtained by further increasing or decreasing these ranking points) to broadcast user A.

[0111] In a second example, the broadcast user A operates the own game object 504 to cause the own game object 504 to interact with, for example, a diamond-shaped game object 704 (for example, by contacting the game object 702 or contacting a missile fired at the game object 702, etc.), so that the own game object 504 can have parameters set based on the gift information corresponding to this game object 704. In this case, the terminal device 10A can read out the gift points corresponding to the gift identification information from the storage unit 140, and set at least one parameter of the own game object 504 based on the read out gift points (for example, in proportion to the gift points). The parameters may include the attack power, defense power, vitality, mobility, equipment, and / or items of the own game object 504. As a result, by manipulating his / her own game object 504 and having it interact with game object 704, broadcast user A can increase (or decrease) parameters of his / her own game object 504 such as attack power, defense power, stamina and / or mobility, and can provide his / her own game object 504 with new equipment (weapons and / or armor) and / or items (or eliminate equipment and / or items possessed by his / her own game object 504).

[0112] In the above first example, instead of the configuration in which broadcast user A obtains ranking points by having his / her own game object 504 interact with game object 702 once, it is also possible to adopt a configuration in which broadcast user A obtains ranking points only after his / her own game object 504 has interacted with game object 702 a predetermined number of times (threshold value). Similarly, in the above second example, instead of the configuration in which broadcast user A obtains ranking points by having his / her own game object 504 interact with game object 702 once, it is also possible to adopt a configuration in which broadcast user A obtains ranking points only after his / her own game object 504 has interacted with game object 702 a predetermined number of times (threshold value).

[0113] For example, in the second example, the terminal device 10A may increment the count value by one each time the terminal device 10A interacts with the game object 704 displayed in the second video based on the gift information received from the terminal device 10 of any one of the multiple viewing users, and may change (increase or decrease) the parameters of the game object 504, such as the attack power, defense power, stamina, and / or mobility, and / or may give (or remove) equipment and / or items, only when the count value exceeds a threshold value. In this case, the terminal device 10A may light up the count values ​​(here, count values ​​1 to 5) shown on the gauge 706 one by one each time the terminal device 10A interacts with the game object 704 displayed in the second video based on the gift information received from the terminal device 10 of any one of the viewing users, and may change the parameters of the game object 504 when the count value exceeds a threshold value (here, 4) (when the count value becomes 5).

[0114] In this way, the method of displaying a count value and threshold value (displaying the numbers 1 to 5 indicates that the threshold value is 4) based on the received gift information in the second video 700 and changing the parameters of the user's game object 504 when the count value exceeds the threshold value can also be applied to the first example above, in which ranking points are awarded to broadcast user A based on the received gift information when the count value based on the received gift information exceeds the threshold value.

[0115] The second video 700 (game screen) thus generated by the terminal device 10A is distributed to the terminal device of each viewing user via the distribution server device 20c, as described in relation to ST324 above. As a result, the second video 700 exemplified in Fig. 9 can be displayed in the same manner on the terminal device of each viewing user.

[0116] The game objects 702, 704, etc. displayed in the second video may be generated by any characters, symbols, images, and / or combinations thereof. The game objects 702, 704, etc. displayed in the second video may include avatar objects of the viewing users who have sent the corresponding gifts. Furthermore, the game objects 702, 704, etc. may be stationary or moving in the second video.

[0117] Furthermore, when ranking points are granted to a broadcasting user based on gift information received from any viewing user, and / or when parameters of the broadcasting user's game object are changed based on gift information received from any viewing user, the ranking point value and / or parameter value may be changed based on the progress of the game being broadcast by the broadcasting user at the time when the gift information is generated or transmitted by the terminal device 10 of the viewing user (or the gift information may be received by the terminal device 10 of the broadcasting user). For example, the ranking point value and / or parameter value may be smaller the closer the broadcasting game is to the beginning at the time when the gift information is generated or transmitted, and may be larger the closer the broadcasting game is to the end at the time when the gift information is generated or transmitted. In this way, the better the broadcasting user is at the game (i.e., the longer the broadcasting user can play the game without making mistakes), the larger the ranking points and / or the larger the parameters granted to the broadcasting user's game object. Also, the greater the number of viewing users who watch the game and transmit gifts (i.e., the greater the total number of fans of the broadcasting user), the greater the ranking points and / or the larger the parameters granted to the broadcasting user's game object. This allows the broadcasting user and each viewing user to enjoy the game even more.

[0118] In this way, when each viewing user viewing the second video 700 transmits gift information to the broadcasting user, the viewing user can change the parameters of his / her own game object or give ranking points to the broadcasting user based on the gift information. As a result, each viewing user can influence the success or failure of the game played by the broadcasting user and / or support the broadcasting user by transmitting gift information to the broadcasting user, and thus can feel that they are participating in the game. Furthermore, each viewing user can instantly change the count value displayed in the second video by transmitting gift information to the broadcasting user, so that each viewing user (especially a viewing user who has generated a count value exceeding a threshold value; in the example shown in FIG. 9, a viewing user who has generated a count value 5 exceeding threshold value 4) can feel even more strongly that they are participating in the game.

[0119] 5-3. Displaying multiple game objects When multiple viewing users transmit gift information to give broadcast user A the same game object 702 (or game object 704) as illustrated in Fig. 7, normally a number of game objects 702 (704) corresponding to the total number of these viewing users will be displayed in the second video 700. In this way, when the total number of multiple viewing users transmitting gift information is large, a large number of game objects 702 (704) are simultaneously displayed in the second video 700, which may impede the progress of the game.

[0120] Therefore, when the terminal device 10A of the distribution user A receives gift information from multiple viewing users regarding the same game object 702 (704), it can integrate these multiple identical game objects in various manners according to the total number of these multiple identical game objects and display them in the second video.

[0121] Fig. 10 is a schematic diagram showing yet another example of the second moving image displayed on the display unit of the terminal device 10A shown in Fig. 1. Here, for convenience, the total number of the same game objects is referred to as the "total number of objects."

[0122] First, as a first mode, a mode in which a certain representative game object overlaps the "total number of objects" can be used. As illustrated in Fig. 10, for example, when the target game object 802 has a diamond shape and five identical game objects 802 are displayed (the total number of objects is 5), the five identical game objects 802 are displayed in a mode in which a certain representative object 804 overlaps the total number of objects (here, 5). Here, as an example, the representative object 804 is identical to each of the game objects 802, but it may be a transformed version (enlarged, reduced, rotated, inverted, or excerpted, etc.) of the game object 802, or may be a representation of the game object 802 by characters and / or symbols, etc.

[0123] As a second mode, a mode of representation by a combination of a certain representative game object and a character indicating the total number of objects can be used. As exemplified in Fig. 10, for example, when the target game object 806 has a diamond shape and 98 identical game objects 806 are displayed (the total number of objects is 98), the 98 identical game objects 806 are represented by a combination of a certain representative object 808 and a character indicating the total number of objects (here, 98) (such as "98" or "x98"). Here, as an example, the representative object 808 is the same as each of the game objects 806, but it may be a game object 806 that has been transformed (enlarged, reduced, rotated, inverted, or excerpted, etc.), or the game object 806 may be represented by characters and / or symbols, etc.

[0124] As a third aspect, a representative game object may be expressed with a density according to the total number of objects. For example, the density of the color given to the representative game object may be set higher (or lower) in proportion to the total number of objects. In this aspect, the representative object may be the same as the target game object, but may also be a transformed (enlarged, reduced, rotated, inverted, excerpted, etc.) version of the target game object, or may be a representation of the target game object using characters and / or symbols, etc.

[0125] As a fourth aspect, a representative game object may be expressed with a size according to the total number of objects. For example, the size of the representative game object may be set to be larger in proportion to the total number of objects (or smaller in inverse proportion). In this aspect, the representative object may be the same as the target game object, or may be a transformed (enlarged, reduced, rotated, inverted, excerpted, etc.) version of the target game object.

[0126] The above-mentioned first to fourth aspects are applicable to the case where a plurality of identical game objects are displayed in the second moving image, and the identical game objects may include, but are not limited to, game objects 604, 608, and 612 illustrated in Fig. 8, and game objects 702 and 704 illustrated in Fig. 9. Furthermore, the above-mentioned first to fourth aspects can be used in combination with each other.

[0127] In this way, when each viewing user who watches the second video sends gift information to the broadcasting user, a game object including the viewing user's avatar object is displayed as a game object that can affect the viewing user's own game object in the second video watched by the broadcasting user and each viewing user. As a result, each viewing user can affect the success or failure of the game played by the broadcasting user by sending gift information to the broadcasting user, and can feel that they are participating in the game. Furthermore, when each viewing user who watches the second video sends gift information to the broadcasting user, they can change the parameters of their own game object or give ranking points to the broadcasting user based on the gift information. As a result, each viewing user can affect the success or failure of the game played by the broadcasting user and / or support the broadcasting user by sending gift information to the broadcasting user, and can feel that they are participating in the game.

[0128] Furthermore, when multiple viewing users send the same gift to the broadcasting user, the terminal device 10 of the broadcasting user can integrate the multiple identical game objects in a manner according to the total number of these game objects and display them in the second video. This allows the terminal device 10 to reliably show in the second video the fact that multiple identical gifts have been given to the broadcasting user (i.e., the fact that each viewing user has given a gift to the broadcasting user), while at least partially preventing a situation in which progress in the broadcasted game is interrupted.

[0129] By displaying a plurality of game objects in a manner according to the total number of these game objects, it is possible to reduce the size of the display unit occupied by these plurality of objects and the amount of calculation required to draw and process these plurality of objects. In general, the resolution (screen size) of the display unit of the user's terminal device 10 and the calculation capacity of the user's terminal device 10 are limited, and are further limited in the order of personal computers, smartphones, and feature phones. Therefore, displaying a plurality of game objects in a manner according to the total number of these game objects is particularly important for terminal devices 10 having such limited resolution and calculation capacity.

[0130] 5-4. Creating game objects that attack or support your own game object (part 2) FIG. 11 is a flow diagram showing a method for selecting an avatar object of a viewing user to be displayed in a game executed on the terminal device 10 shown in FIG.

[0131] First, in ST900, a game is started by terminal device 10A of broadcast user A by the method as described with reference to Figures 5A and 5B, and a moving image (second moving image) related to this game is broadcast by terminal device 10A via broadcast server device 20a to terminal devices 10 of each viewing user. Here, as an example, it is assumed that a shooting game such as that illustrated in Figures 7 to 10 is executed and broadcast.

[0132] Next, in ST902, in order to determine an avatar object of a viewing user to appear as a boss character (or part of a boss character) in ST912 described below, terminal device 10A begins accumulating information on a plurality of candidate viewing users. Specifically, terminal device 10A generates a list of viewing users who have sent gift information to broadcast user A, based on the gift information received from the game API server device 20c for each predetermined time period. Generation of this list may continue until the processing in ST906 begins.

[0133] Next, in ST904, terminal device 10A executes a battle (weak battle) between its own game object 504 (see FIG. 7, etc.) and a weak character (a trivial character having a relatively weak attack power and stamina and a simple behavior pattern) during the game. Even during this ST904, the list of viewing users mentioned in ST902 continues to be generated.

[0134] Next, in ST906, terminal device 10A randomly selects one viewing user from the list of viewing users generated up to this point. A game object including an avatar object of the one viewing user selected here (here, viewing user X) will be displayed as a boss character in ST912, which will be described later.

[0135] Next, in ST908, terminal apparatus 10A resets (deletes) the list of viewing users that has been generated so far. After that, in ST910, terminal apparatus 10A starts accumulating information on a plurality of new candidate viewing users (generates a new list of viewing users) in the same manner as in ST902 described above. Generation of this list may continue until the process in ST916 starts.

[0136] Next, in ST912, terminal device 10A executes a battle (boss X battle) between its own game object 504 and a boss character (an important character with very strong attack power and stamina, and a complex behavior pattern) during the game. Here, terminal device 10A can use as the boss character a game object including an avatar object of one viewing user X selected in ST906 described above. Even during this ST912, the list of viewing users mentioned in ST910 continues to be generated.

[0137] After the boss X battle is over (the game object including the avatar object of the viewing user X is defeated by the own game object 504), in ST914, the terminal device 10A executes a battle (weak battle) between the own game object 504 and the weak characters during the game. In this weak battle, the terminal device 10A can use the game object including the avatar object of one viewing user X selected in the above-mentioned ST906 as a wingman character (a game object that supports the own game object 504 and attacks the weak characters) instead of a boss character. Even during this ST914, the list of viewing users mentioned in ST910 continues to be generated.

[0138] Next, in ST916, terminal device 10A randomly selects one viewing user from the list of viewing users generated up to this point. A game object including an avatar object of the one viewing user selected here (here, viewing user Y) will be displayed as a boss character in ST922, which will be described later.

[0139] Next, in ST918, terminal apparatus 10A resets (deletes) the list of viewing users that has been generated so far. After that, in ST920, terminal apparatus 10A starts accumulating information on a plurality of new candidate viewing users (generates a new list of viewing users) in the same manner as in ST902 and ST910 described above. Generation of this list may continue until the process in ST926 starts.

[0140] Next, in ST922, terminal device 10A executes a battle between its own game object 504 and a boss character (a battle against boss Y) during the game. Here, terminal device 10A can use a game object including an avatar object of one viewing user Y selected in ST916 described above as the boss character. Even during this ST922, the list of viewing users mentioned in ST920 continues to be generated.

[0141] After the battle with boss Y is over (the game object including the avatar object of viewing user Y is defeated by the own game object 504), in ST924, the terminal device 10A executes a battle between the own game object 504 and a minor character (a minor battle) during the game. In this minor battle, the terminal device 10A can use the game object including the avatar object of one viewing user Y selected in ST916 described above as a wingman character rather than a boss character. Even during this ST924, the list of viewing users mentioned in ST920 continues to be generated.

[0142] Next, in ST926, terminal device 10A randomly selects one viewing user from the list of viewing users generated up to this point. A game object including an avatar object of the one viewing user selected here (here, viewing user Z) will be displayed as a boss character in the next boss battle (not shown).

[0143] Next, in ST928, terminal apparatus 10A resets (deletes) the list of viewing users that has been generated so far. After that, terminal apparatus 10A can repeat the same processes as those described above in relation to ST910 to ST918 (or ST920 to ST928).

[0144] To summarize briefly, terminal device 10A first selects a specific viewing user (viewing user X) from among a plurality of viewing users who generated (transmitted) gift information during the "first period" during which the game is executed (ST906). Next, terminal device 10A can display a game object including an avatar object of the specific viewing user (viewing user X) in the second video during a "second period" that occurs after the "first period". During this "second period", terminal device 10A can display a game object including an avatar object of the specific viewing user (viewing user X) as a boss character (ST912).

[0145] Next, in a "third period" occurring after the "second period", terminal device 10A can display a game object including an avatar object of a specific viewing user (viewing user X) as a wingman character (ST914).

[0146] Next, the terminal device 10A selects a specific viewing user (viewing user Y) from among a plurality of viewing users who have generated (transmitted) gift information during the period from after the end of the "first period" to the "third period" (ST916). Next, the terminal device 10A can display a game object including an avatar object of the specific viewing user (viewing user Y) in the second video during a "fourth period" that occurs after the "third period". During this "fourth period", the terminal device 10A can display a game object including an avatar object of the specific viewing user (viewing user Y) as a boss character (ST922). Furthermore, the terminal device 10A can display a game object including an avatar object of the specific viewing user (viewing user X) as a wingman character (ST922).

[0147] Next, in a "fifth period" occurring after the "fourth period", terminal device 10A can display a game object including an avatar object of a specific viewing user (viewing user Y) as a wingman character (ST924).

[0148] In addition, in each of ST906, ST916 and / or ST926 illustrated in FIG. 11, the selection (lottery) of a specific viewing user from among a plurality of viewing users may be performed based on information indicating the activity, as exemplified below, stored for each of the plurality of viewing users. (1) Information indicating the type of gifting (whether a paid / free gift was given to the broadcasting user) (for example, if a paid gift is given, more points will be awarded than if a free gift is given, which may increase the chances of winning) (2) The importance and / or rarity of the gift given to the broadcasting user (information indicating the purchase amount and / or points consumed (consumed my points) (for example, if a gift of higher importance and / or rarity is given, more points will be awarded than if a gift of lower importance and / or rarity is given, which may increase the probability of winning) (3) Information indicating the number of times (total number) a gift has been given to a broadcast user (for example, the more gifts a user gives, the higher the points awarded, which may increase the chance of winning). (4) Information indicating the number of comments entered (sent) to the broadcasting user (for example, the more comments entered, the higher the points awarded, which may increase the chance of winning) (5) Information indicating the number of “Likes” entered (sent) to the broadcasting user (for example, the more “Likes” entered, the higher the points awarded, which may increase the chance of winning) (6) Information indicating whether or not you are following a broadcaster (for example, if you follow a broadcaster, you may be awarded more points, which may increase your chances of winning) (7) Information indicating the number of broadcast users you follow (for example, the more broadcast users you follow, the more points you will be awarded, which may increase your chances of winning) (8) Information indicating the time and / or number of times the first video and / or the second video distributed by the distribution user were viewed (for example, the longer the viewing time, the higher the points awarded, which may increase the probability of winning) (9) Information indicating the number of times and / or duration that the first video and / or the second video have been streamed together with the streaming user (for example, the more times the first video and / or the second video have been streamed, the higher the points awarded, which may increase the chances of winning). In addition, the "distribution user" in the "information indicating activity" exemplified in (1) to (9) above stored for each viewing user may include, but is not limited to, (i) a distribution user who is currently distributing a second video to the viewing user and has received gift information from the viewing user, (ii) a distribution user who has previously distributed a second video to the viewing user, and / or (iii) a distribution user who has not yet distributed a second video to the viewing user.

[0149] Specifically, for example, in one lottery, for each of a plurality of viewing users watching the second video, total points may be calculated using information indicating the activity stored for that viewing user, and the viewing user with the highest total points may be given priority as the specific viewing user (if N specific viewing users are selected in one lottery, the N viewing users with the highest total points may be given priority as the specific viewing users).

[0150] It is possible to calculate points by any method from the information indicating the activities corresponding to each of the above (1) to (7).

[0151] In addition, the targeted activities may include activities performed during the period in which the second video illustrated in FIG. 11 was distributed, and / or activities performed during a period other than the period in which the second video illustrated in FIG. 11 was distributed.

[0152] In addition, in the example shown in FIG. 11, a game object including an avatar object of a viewing user who has won the lottery is displayed as a boss character and then as a wingman character, but in another example, a game object including an avatar object of a viewing user who has won the lottery may be displayed as a wingman character and then as a boss character.

[0153] Furthermore, in the example shown in FIG. 11, "only one" specific viewing user is selected in ST906 (or ST916, etc.), and a game object including an avatar object of the specific viewing user so selected is displayed in ST912 and ST914 (ST922 and ST924, etc.), but the number of specific viewing users selected may be more than one.

[0154] In this way, the terminal device 10A can select a specific viewing user from among a plurality of viewing users who have transmitted gift information during a certain period during the game, and display a game object including the avatar object of the specific viewing user as a game object that supports or attacks the user's own game object during the next period that occurs after the selected period. This allows the viewing user selected as the specific viewing user to feel like he or she is participating in the game he or she is watching, as a game character including his or her own avatar object is used as a boss character and / or wingman character that can affect the outcome of the game.

[0155] Furthermore, games that feature boss characters or wingman characters that behave according to default settings generally tend to be monotonous, but the technology disclosed in the present application selects a specific viewing user from among multiple viewing users, and causes a game object including an avatar object of the selected specific viewing user to appear in the second video as a boss character and / or wingman character, etc. This increases the variety of the game, preventing the game from becoming monotonous.

[0156] Furthermore, since the terminal device 10A selects a specific viewing user from among a plurality of viewing users who are actually viewing the second video (game screen) during a certain period of time, the viewing user who is viewing the second video is more likely to be selected as a specific viewing user sooner or later. This makes it easier for the viewing user who is viewing the second video to become absorbed in watching the game without getting bored.

[0157] In the example shown in FIG. 11, for ease of explanation, the names "first period" to "fifth period" are used, but other periods may occur between each period (for example, between the first period and the second period, between the second period and the third period, etc.).

[0158] 6. Generation, display and distribution of ranking information A specific example of the ranking information described in relation to ST328 and ST330 in FIG. 5B will be described.

[0159] First, the video distribution system 1 disclosed in the present application can generate ranking information (first ranking information) regarding the total value of points calculated for each distribution user based on gift information received from each viewing user, and transmit it to the terminal device 10 of each user (each distribution user and / or each viewing user).

[0160] This first ranking information may be generated for a certain game (e.g., a game sold or provided as a software application) (the total of a plurality of levels, stages, scenes, scenarios, and missions of a certain game) distributed by each distribution user. Such first ranking information may be displayed on each terminal device 10 as a table such as that shown in FIG. 12A.

[0161] In addition, this first ranking information may be generated for a certain unit game (e.g., one level, one stage, one scene, one scenario, one mission, etc.) included in a certain game distributed by each distribution user. Such first ranking information may be displayed on each terminal device 10 as a table such as that shown in FIG. 12B.

[0162] Furthermore, this first ranking information may be generated for all games (the total of multiple types of games) distributed by each distributor user during a unit period (e.g., an event period, a period of one day, one week, one month, etc.). Such first ranking information may be displayed on each terminal device 10 as a table such as that shown in FIG. 12C.

[0163] Such first ranking information can be calculated, for example, by the ranking processing unit 170 of the terminal device 10 or the ranking processing unit 230 of the server device 20 in the following manner.

[0164] When broadcast user A receives gift information from viewing user B who is watching a game (or unit game) broadcast by broadcast user A, the ranking processing unit 170 (230) can obtain gift points or ranking points stored in association with the gift identification information included in the gift information. Thus, the ranking processing unit 170 (230) can obtain the total value of gift points and / or ranking points for broadcast user A by using the gift information received from each viewing user who is watching a game (or unit game) broadcast by broadcast user A. Note that, as described above, which viewing user sent the target gift information is identified by the sender identification information included in the gift information. The "broadcast user name" exemplified in FIG. 12A to FIG. 12C can be identified from the user information stored in the storage unit in association with the sender identification information.

[0165] The ranking processing unit 170 (230) can similarly obtain the total value of the gift points and / or ranking points for each of the other broadcast users. After this, the ranking processing unit 170 (230) can obtain the first ranking information as shown in Figures 12A and 12B by arranging the total value of the gift points and / or ranking points for each broadcast user in descending order.

[0166] Furthermore, the ranking processing unit 170 (230) can obtain first ranking information such as that illustrated in FIG. 12C by performing processing similar to that described above, limiting the games (or unit games) distributed by each distribution user during a unit period (e.g., an event period, and periods such as one day, one week, and one month).

[0167] Since gift information transmitted to a certain broadcast user's terminal device 10 is also stored in the DB server device 20b, such first ranking information can be generated by either the ranking processing unit 170 of the broadcast user's terminal device 10 or the ranking processing unit 230 of the server device 20. However, as explained in section "5-2", when the value of ranking points granted to the broadcast user changes according to the progress of the game being broadcast by the broadcast user, such changed value of ranking points is usually only recognizable by the broadcast user's terminal device 10, so such changed value of ranking points needs to be notified from the broadcast user's terminal device 10 to the DB server device 20b via, for example, the game API server device 20c.

[0168] The first ranking information thus obtained may be distributed from the distribution user's terminal device 10 to each terminal device 10 via the distribution server system 20 (the distribution server device 20a), or may be distributed from the distribution server system 20 to each terminal device 10 regardless of the operation of the distribution user's terminal device 10.

[0169] Secondly, the video distribution system 1 disclosed in the present application can generate ranking information (second ranking information) regarding the total point value calculated for each viewing user based on the gift information sent to a certain distribution user, and transmit it to the terminal device 10 of each user (each distribution user and / or each viewing user).

[0170] This second ranking information (also called support ranking information) may be generated for a certain game (for example, a game sold or provided as a software application) distributed by a certain distributor user. Such second ranking information may be displayed on each terminal device 10 as a table such as that shown in FIG. 13A.

[0171] This second ranking information may also be generated for a certain unit game (e.g., one or more levels, one or more stages, one or more scenes, one or more scenarios, one or more missions, etc.) included in a certain game distributed by a certain distributor user. Such second ranking information may be displayed on each terminal device 10 as a table such as that shown in FIG. 13B.

[0172] Furthermore, this second ranking information may be generated for all games distributed by any distributor user in a unit period (e.g., a period of one day, one week, one month, etc.) Such second ranking information may be displayed on each terminal device 10 as a table such as that shown in FIG.

[0173] Such second ranking information can be calculated, for example, by the ranking processing unit 170 of the terminal device 10 or the ranking processing unit 230 of the server device 20 in the following manner.

[0174] When broadcast user A receives gift information from viewing user B, who is viewing a game (or unit game) broadcast by broadcast user A, the ranking processing unit 170 (230) can acquire the sender identification information and gift identification information included in the gift information, and can further acquire the gift points or ranking points stored in association with the gift identification information. In this way, the ranking processing unit 170 (230) can acquire the total value of gift points and / or ranking points for viewing user B by using all the gift information received from viewing user B through the game (or unit game). The ranking processing unit 170 (230) can similarly acquire the total value of gift points and / or ranking points for other viewing users.

[0175] After this, the ranking processing unit 170 (230) can obtain second ranking information such as that illustrated in Figures 13A and 13B by arranging the total values ​​of gift points and / or ranking points for each viewing user in descending order.

[0176] Furthermore, the ranking processing unit 170 (230) can obtain second ranking information such as that illustrated in FIG. 13C by performing the same processing as described above, but limiting it to the games (or unit games) distributed by each distribution user in a unit period.

[0177] Since the gift information transmitted to a certain broadcast user's terminal device 10 is also stored in DB server device 20b, the second ranking information as illustrated in Figures 13A and 13B can be obtained by either the ranking processing unit 170 of the broadcast user's terminal device 10 or the ranking processing unit 230 of the server device 20. However, since gift information transmitted from each viewing user's terminal device to "other" broadcast users' terminal devices 10 is not automatically transferred to a certain broadcast user's terminal device 10, in order for the certain broadcast user's terminal device 10 to generate the second ranking information as illustrated in Figure 13C, the certain broadcast user's terminal device 10 needs to request the gift information transmitted to each broadcast user from DB server device 20b via, for example, game API server device 20c.

[0178] The second ranking information thus obtained may be distributed from the terminal device 10 of the distribution user to each terminal device 10 via the distribution server system 20 (the distribution server device 20a), or may be distributed from the distribution server system 20 to each terminal device 10 regardless of the operation of the terminal device 10 of the distribution user.

[0179] In the example shown in Figures 12A to 12C, the total value of the gift points and / or ranking points acquired by each distribution user is compared to generate the first ranking information, but instead of or in addition to this, the total value of the number of times each distribution user has received gift information from each viewing user may be compared and displayed. Similarly, in the example shown in Figures 13A to 13C, the total value of the gift points and / or ranking points calculated from the gift information received from each viewing user is compared to generate the second ranking information, but instead of or in addition to this, the total value of the number of times gift information has been received from each viewing user may be compared and displayed.

[0180] When the generation, display, and distribution of the ranking information described in this section "6" is performed by the terminal device 10 of the broadcast user, this terminal device 10 can perform the above-mentioned operations required for the generation, display, and distribution of the ranking information (first ranking information and / or second ranking information 9) in accordance with the game program embedded in the web page received from the web server device 20B.

[0181] In this way, in the first ranking information, if each viewing user who watches the second video (video related to a game) distributed by a certain distribution user sends more gift information to the distribution user, the possibility that the distribution user will be ranked higher and become more famous increases. Therefore, it is possible to improve the motivation of the viewing user to support the distribution user. Also, in the second ranking information, if each viewing user who watches the second video (video related to a game) distributed by a certain distribution user sends more gift information to the distribution user, the possibility that the viewing user himself will be ranked higher increases, so the viewing user's own popularity can be increased. Therefore, each viewing user who watches the second video distributed by a certain distribution user can get the feeling that he or she is indirectly participating in the game by sending gift information to the distribution user.

[0182] Furthermore, in either the first ranking or the second ranking case, each user can use their terminal device 10 to view a ranking screen (a screen displaying the first ranking information and / or the second ranking information) listing a plurality of distribution users and / or a plurality of viewing users. There is a possibility that among these plurality of distribution users and / or plurality of viewing users there may be users that each user does not recognize (e.g., does not follow). This allows each user to get to know new users via this ranking screen, thereby revitalizing the entire community.

[0183] The ranking screen may include detailed information about each of the listed broadcast users and / or viewing users (for example, various information including, but not limited to, name, nickname, age, gender, residential area, information indicating the first and second videos broadcast and viewed to date, hobbies, appealing messages, URLs for homepages and SNS, etc.). Furthermore, the ranking screen may include a button (UI) for following each of the listed broadcast users and / or viewing users, a button (UI) for sending a direct message or starting a chat with each of the listed broadcast users and / or viewing users, and / or a button (UI) for jumping to the homepage or SNS of each of the broadcast users and / or viewing users.

[0184] 7. Variations In the various embodiments described above, a case has been described in which the broadcasting user's terminal device 10 receives an HTML (particularly HTML5) document incorporating a game program from the web server device 20B in order to generate a video relating to a game (a second video). However, instead of receiving an HTML document incorporating a game program from the web server device 20B, the broadcasting user's terminal device 10 can also generate a second video including a screen relating to a game by executing an installed video distribution application and receiving necessary information from a data server device (not shown) (or any server device (not shown) included in the distribution server system 20A).

[0185] In the various embodiments described above, the terminal device 10 of the distribution user may be a smartphone or the like used by a general user, or may be a dedicated terminal device installed in a studio, etc. In this case, at least one of the server devices among the distribution server device 20a, DB server device 20b, and game API server device 20c (and further the web server device 20B) included in the distribution server system 20A may be installed together with the dedicated terminal device in the studio, etc.

[0186] In the above-mentioned various embodiments, a shooting game has been described as an example of a game to be distributed as the second video. However, the technology disclosed in the present application is also applicable to the distribution of any game in which some game object is displayed, such as a role-playing game, an action game, a simulation game, a training game, and a puzzle game.

[0187] In the various embodiments described above, a case has been described in which the broadcast user's terminal device 10 generates a first video including an animation of the broadcast user's first avatar object based on motion data related to the broadcast user's motion and audio data related to the broadcast user's voice, and transmits this first video to the distribution server device 20a. However, the broadcast user's terminal device 10 may transmit motion data related to the broadcast user's motion and audio data related to the broadcast user's voice to the distribution server device 20a, and the distribution server device 20a may generate a first video based on this motion data and audio data and transmit it to each viewing user's terminal device 10. Alternatively, the broadcast user's terminal device 10 may transmit motion data related to the broadcast user's motion and audio data related to the broadcast user's voice to a separately provided server device, and this separate server device may generate a first video based on the motion data and audio data and return it to the broadcast user's terminal device 10, and the broadcast user's terminal device 10 may transmit the received first video to the distribution server device 20a. Furthermore, the terminal device 10 of the broadcasting user may transmit motion data relating to the broadcasting user's motion and audio data relating to the broadcasting user's audio to the terminal device 10 of each viewing user via the distribution server device 20a or the separately provided server device described above, and the terminal device 10 of each viewing user may generate (render) and display the first video based on the received motion data and audio data.

[0188] In either of the above cases, the generation of the first moving image based on the motion data and audio data transmitted by the terminal device 10 of the broadcasting user may be shared among at least two of the broadcasting server device 20a, the separate server device, and each viewing user's terminal device 10. In either case, the device responsible for generating the first moving image may receive and store information (such as an image) about the avatar object to be operated from, for example, the broadcasting server device 20a, etc.

[0189] Furthermore, in either case, the gift information and / or comment information transmitted by the terminal device 10 of each viewing user can be transmitted by any method to the device responsible for generating the first moving image among the distribution server device 20a, the separate server device, and the terminal device 10 of each viewing user. As a result, the device responsible for generating the first moving image can execute processing based on the received gift information (e.g., displaying a gift object in the first moving image) and / or execute processing based on the received comment information (e.g., displaying a comment in the first moving image). In either case, the device responsible for generating the first moving image can receive and store information (e.g., images) corresponding to various gifts used from, for example, the distribution server device 20a, etc.

[0190] In the various embodiments described above, a case has been described in which comment information is incorporated into gift information and transmitted from the viewing user's terminal device 10 to the broadcasting user's terminal device 10 via the distribution server system 20A. However, the comment information may be transmitted separately from the gift information to the broadcasting user's terminal device 10. In this case, a configuration equivalent to the above-mentioned DB server device 20b and game API server device 20c used to transmit gift information can be provided separately for transmitting comment information.

[0191] The various embodiments described above can be used in combination with each other unless a contradiction or inconvenience occurs.

[0192] 8. Notes The computer program according to the first aspect can cause the processor to "function as follows: when executed by at least one processor, to distribute, via a communication line, a first video including an animation of a first avatar object of a broadcasting user generated based on motion data related to the motion of the broadcasting user, and a second video related to a game generated based on operation data related to the operation of the broadcasting user using a received webpage, to a terminal device of a viewing user; receive, via the communication line, gift information indicating that a gift will be given to the broadcasting user, which is generated by the operation of the viewing user watching the second video, from the terminal device of the viewing user; and distribute, during a second period occurring after the first period, the second video including a game object including an avatar object of a specific viewing user selected from among a plurality of viewing users who generated the gift information and which is set based on the gift information during a first period during which the game is executed, to the terminal device of the viewing user via the communication line."

[0193] The computer program of the second aspect may, in the first aspect above, "display the game object in the second video as an enemy character attacking the streaming user's own game object, which includes a second avatar object of the streaming user, during the second period."

[0194] A computer program according to a third aspect may, in the second aspect above, "cause the game object to be displayed in the second video as an object attacking an enemy character in a third period occurring after the second period."

[0195] The computer program of the fourth aspect may, in the third aspect above, "display a game object including an avatar object of a specific viewing user selected from among a plurality of viewing users who generated the gift information between the end of the first period and the third period in the second video during a fourth period occurring after the third period."

[0196] The computer program of the fifth aspect may be such that in the fourth aspect above, "the game object is displayed in the second video as an enemy character that attacks the player's own game object during the fourth period."

[0197] The computer program of the sixth aspect may, in the fifth aspect above, "cause the game object to be displayed in the second video as an object attacking an enemy character in a fifth period that occurs after the fourth period."

[0198] The computer program of the seventh aspect may, in any of the first to sixth aspects, "selection of the specific viewing user from among the plurality of viewing users is performed based on information indicating activity stored for each viewing user included in the plurality of viewing users."

[0199] The computer program of the eighth aspect may be such that in the seventh aspect above, "the information indicating activity stored for each viewing user is selected from a group including information indicating the type of gift given by the viewing user to the broadcast user, information indicating the importance and / or rarity of the gift given by the viewing user to the broadcast user, information indicating the number of times the viewing user has given a gift to the broadcast user, information indicating the number of times the viewing user has entered information for the broadcast user, information indicating whether the viewing user is following the broadcast user, information indicating the number of broadcast users followed by the viewing user, information indicating the time and / or number of times the viewing user watched the first video and / or second video broadcast by the broadcast user, and the number and / or time the viewing user co-starred with the broadcast user to broadcast the first video and / or second video."

[0200] The computer program according to the ninth aspect may be such that "the web page is generated in accordance with HTML5" in any one of the first to eighth aspects.

[0201] The computer program according to the tenth aspect can be configured in any one of the first to ninth aspects, wherein "the communication line includes the Internet."

[0202] The computer program of the eleventh aspect may include, in any one of the first to tenth aspects, "the processor being a central processing unit (CPU), a microprocessor, or a graphics processing unit (GPU)."

[0203] The terminal device of the twelfth aspect can include "at least one processor, which distributes a first video including an animation of a first avatar object of the broadcasting user generated based on motion data related to the motion of the broadcasting user, and a second video related to a game generated based on operation data related to the operation of the broadcasting user using a received webpage, to a terminal device of a viewing user via a communication line, receives gift information indicating that a gift will be granted to the broadcasting user generated by the operation of the viewing user watching the second video from the terminal device of the viewing user via the communication line, and distributes the second video including a game object including an avatar object of a specific viewing user selected from among a plurality of viewing users who generated the gift information during a first period during which the game is executed, which is set based on the gift information, to the terminal device of the viewing user via the communication line during a second period occurring after the first period."

[0204] The terminal device according to the thirteenth aspect can be configured as in the twelfth aspect, wherein "the communication line includes the Internet."

[0205] The terminal device of the 14th aspect can be the terminal device of the 12th aspect or the 13th aspect, wherein "the processor includes a central processing unit (CPU), a microprocessor, or a graphics processing unit (GPU)."

[0206] The method according to the fifteenth aspect can be "a method executed by at least one processor that executes computer-readable instructions, comprising the steps of: distributing, via a communication line, to a terminal device of a viewing user, a first video including an animation of a first avatar object of the broadcasting user that is generated based on motion data related to the motion of the broadcasting user, and a second video related to a game that is generated based on operation data related to the operation of the broadcasting user using a received webpage; receiving, via the communication line, from the terminal device of the viewing user, gift information indicating that a gift will be given to the broadcasting user that is generated by the operation of the viewing user who watches the second video; and distributing, during a second period occurring after the first period, the second video including a game object that includes an avatar object of a specific viewing user selected from among a plurality of viewing users who generated the gift information during a first period during which the game is executed that is set based on the gift information, to the terminal device of the viewing user via the communication line."

[0207] The method according to the sixteenth aspect can be the method according to the fifteenth aspect, wherein "the communication line includes the Internet."

[0208] The method of the 17th aspect may be the same as in the 15th or 16th aspect, wherein "the processor includes a central processing unit (CPU), a microprocessor, or a graphics processing unit (GPU)."

[0209] The computer program of the 18th aspect can cause the processor to "function as follows: when executed by at least one processor, to distribute, to a terminal device of a viewing user via a communication line, a first video including an animation of a first avatar object of the broadcast user, which is generated based on motion data related to the motion of the broadcast user, and a second video related to a game, which is generated by the terminal device of the broadcast user based on operation data related to the operation of the broadcast user using a received webpage; receive, from the terminal device of the viewing user via the communication line, gift information indicating that a gift will be given to the broadcast user, which is generated by the operation of the viewing user watching the second video; and distribute, to the terminal device of the viewing user via the communication line, the second video, which includes a game object that is set based on the gift information and includes an avatar object of a specific viewing user selected from among a plurality of viewing users who generated the gift information during a first period in which the game is executed, and which was distributed by the terminal device of the broadcast user during a second period occurring after the first period."

[0210] The computer program according to the 19th aspect can be the computer program according to the 18th aspect, wherein "the communication line includes the Internet".

[0211] The computer program of the 20th aspect may be the same as in the 18th or 19th aspect, wherein "the processor includes a central processing unit (CPU), a microprocessor, or a graphics processing unit (GPU)."

[0212] The server device according to the 21st aspect can include "at least one processor, which distributes a first video including an animation of a first avatar object of the broadcast user generated based on motion data related to the motion of the broadcast user, and a second video related to a game generated by the broadcast user's terminal device based on operation data related to the broadcast user's operation using a received webpage, to a viewing user's terminal device via a communication line, receives gift information indicating that a gift will be granted to the broadcast user generated by the viewing user's operation of watching the second video, from the viewing user's terminal device via the communication line, and distributes the second video, which includes a game object set based on the gift information and including an avatar object of a specific viewing user selected from among a plurality of viewing users who generated the gift information during a first period in which the game is executed, and which was distributed by the broadcast user's terminal device during a second period occurring after the first period, to the viewing user's terminal device via the communication line."

[0213] The server device according to the twenty-second aspect can be the server device according to the twenty-first aspect, wherein "the communication line includes the Internet."

[0214] The server device of the 23rd aspect can be the server device of the 21st aspect or the 22nd aspect, wherein "the processor includes a central processing unit (CPU), a microprocessor, or a graphics processing unit (GPU)."

[0215] The method according to the 24th aspect can be "a method executed by at least one processor that executes computer-readable instructions, comprising the steps of: delivering, to a terminal device of a viewing user via a communication line, a first video including an animation of a first avatar object of the broadcast user that is generated based on motion data related to the motion of the broadcast user, and a second video related to a game that is generated by the terminal device of the broadcast user based on operation data related to the operation of the broadcast user using a received webpage; receiving, via the communication line, gift information from the terminal device of the viewing user, which is generated by the operation of the viewing user watching the second video and indicates that a gift will be given to the broadcast user; and delivering, to the terminal device of the viewing user via the communication line, the second video that includes a game object that is set based on the gift information and includes an avatar object of a specific viewing user selected from among a plurality of viewing users who generated the gift information during a first period during which the game is executed, and that was delivered by the terminal device of the broadcast user during a second period that occurs after the first period."

[0216] The method according to the 25th aspect can be the 24th aspect described above, wherein "the communication line includes the Internet."

[0217] The method of the 26th aspect may be the same as in the 24th aspect or the 25th aspect, wherein "the processor includes a central processing unit (CPU), a microprocessor, or a graphics processing unit (GPU)."

[0218] The server device according to the 27th aspect can be configured to "have at least one processor, wherein the processor transmits a web page including a computer program to a terminal device of a broadcast user via a communication line, the terminal device being configured to broadcast a first video including an animation of a first avatar object of the broadcast user generated based on motion data related to the motion of the broadcast user, and a second video related to a game generated based on operation data related to the operation of the broadcast user using the received web page, to a terminal device of the broadcast user via a communication line, the computer program causing the terminal device of the broadcast user to function as follows: receive, from the terminal device of the viewing user via the communication line, gift information indicating that a gift will be given to the broadcast user, which has been generated by the operation of the viewing user watching the second video, and broadcast, during a second period occurring after the first period, the second video which is set based on the gift information and includes a game object including an avatar object of a specific viewing user selected from among a plurality of viewing users who generated the gift information during a first period during which the game is executed."

[0219] The server device according to the 28th aspect can be the server device according to the 27th aspect, wherein "the communication line includes the Internet".

[0220] The server device of the 29th aspect can be the server device of the 27th aspect or the 28th aspect, wherein "the processor includes a central processing unit (CPU), a microprocessor, or a graphics processing unit (GPU)."

[0221] The method according to the 30th aspect can be described as "a method executed by at least one processor that executes computer-readable instructions, comprising the steps of: transmitting a web page including a computer program to a terminal device of a broadcast user configured to broadcast, via a communication line, a first video including an animation of a first avatar object of the broadcast user generated based on motion data related to the motion of the broadcast user, and a second video related to a game generated based on operation data related to the operation of the broadcast user using the received web page to a terminal device of the viewing user, wherein the computer program causes the terminal device of the broadcast user to receive, via the communication line, gift information from the terminal device of the viewing user indicating that a gift will be given to the broadcast user, the gift information being generated by the operation of the viewing user watching the second video, and broadcasting, during a second period occurring after the first period, the second video including a game object including an avatar object of a specific viewing user selected from among a plurality of viewing users who generated the gift information during a first period during which the game is executed, the second video being set based on the gift information."

[0222] The method according to the 31st aspect can be the 30th aspect described above, wherein "the communication line includes the Internet."

[0223] The method according to the 32nd aspect may be the same as in the 30th or 31st aspects, wherein "the processor includes a central processing unit (CPU), a microprocessor, or a graphics processing unit (GPU)." [Additional Notes] The claims as originally filed in the original application of this application are appended hereto. [1] When executed by at least one processor, a first video including an animation of a first avatar object of the broadcasting user, which is generated based on motion data relating to the broadcasting user's motion, and a second video relating to a game, which is generated based on operation data relating to the broadcasting user's operation using the received webpage, are broadcast to a terminal device of a viewing user via a communication line; receiving gift information indicating that a gift will be given to the distributor user, the gift information being generated by an operation of the viewing user viewing the second video, from a terminal device of the viewing user via a communication line; A computer program that causes the processor to function to deliver the second video, which includes a game object including an avatar object of a specific viewing user selected from a plurality of viewing users who generated the gift information during a first period set based on the gift information and during which the game is executed, to a terminal device of the viewing user via a communication line during a second period that occurs after the first period. [Explanation of symbols]

[0224] 1. Video distribution system 10 Terminal Equipment 10A Distribution user's terminal device 10B, 10C, 10D Viewing user's terminal device 20 Server device 20A Distribution Server System 20a Distribution server device 20b Database (DB) server device 20c Game API server device 29B Web server device

Claims

1. When executed by at least one processor, distributing a video relating to a game generated based on operation data relating to an operation of a certain user to a terminal device of another user via a communication line; receiving information indicating an activity generated by an operation of the other user from a terminal device of the other user via a communication line; based on the number of display requests for the same object among the object display requests for the video, which are included in the information indicating the activity, integrating the same object in a predetermined manner and displaying the integrated object as the video, and distributing the video to the terminal device of the other user via a communication line; 23. A computer program product comprising: a computer program product configured to cause the at least one processor to function in a manner such that

2. 2. The computer program product according to claim 1, wherein the integrated object affects the outcome of the game by interacting with the game object of the certain user.

3. The computer program product according to claim 2 , wherein influencing the outcome of the game includes the integrated object influencing a user's own object.

4. 3. The computer program product according to claim 2, wherein influencing the outcome of the game includes changing a parameter of the user's own object based on a parameter possessed by the integrated object.

5. 5. The computer program according to claim 4, wherein the parameters of the integrated object are the sum of the parameters of each object before integration.

6. 3. The computer program product according to claim 2, wherein influencing the outcome of the game includes changing parameters of the user's own object based on parameters of the integrated object and the progress of the game.

7. The computer program product according to claim 1 , wherein the integrated object is displayed in a manner in which the same object is overlapped a total number of times equal to the total number of display requests.

8. 2. The computer program product according to claim 1, wherein the integrated object is displayed in a form in which a representative object is combined with characters indicating the total number of the display requests.

9. 2. The computer program product according to claim 1, wherein the integrated object is displayed in a manner in which a representative object is expressed with a density corresponding to a total number of the display requests.

10. 2. The computer program product according to claim 1, wherein the integrated object is displayed in a manner in which a representative object is expressed with a size according to a total number of the display requests.

11. The computer program product according to claim 1 , wherein each object displayed in the video in response to the display request includes an avatar object of another user who has transmitted the display request.

12. An information processing system comprising at least one processor, The at least one processor: distributing a video relating to a game generated based on operation data relating to an operation of a certain user to a terminal device of another user via a communication line; receiving information indicating an activity generated by an operation of the other user from a terminal device of the other user via a communication line; An information processing system that distributes the video in which the same object is integrated in a predetermined manner and displayed as an integrated object based on the number of requests to display the same object among requests to display objects in the video included in the information indicating the activity to the terminal device of the other user via a communication line.

13. 1. A method performed by at least one processor executing computer readable instructions, comprising: a step of transmitting a web page including a computer program via a communication line to a terminal device of a certain user that is configured to distribute a video relating to a game generated based on operation data relating to an operation of the certain user to terminal devices of other users via a communication line; The computer program comprising: The terminal device of the certain user, receiving information indicating an activity generated by an operation of the other user from a terminal device of the other user via a communication line; based on the number of requests for displaying the same object among requests for displaying the object in the video, which are included in the information indicating the activity, the number of requests for displaying the same object being integrated in a predetermined manner and the video being displayed as an integrated object, the video being delivered to the terminal device of the other user via a communication line; A method comprising:

Images