Video distribution system, video distribution method, and video distribution program

The video distribution system addresses the challenge of passive co-starring by using log data to select compatible co-stars, improving the quality and engagement of co-starring videos through proactive partner selection.

JP7579538B2Active Publication Date: 2024-11-08GLEE HOLDINGS CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
JP2024018051
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2024-02-08
Publication Date
2024-11-08
Estimated Expiration
2039-08-29

AI Technical Summary

Technical Problem

Conventional video distribution systems face challenges in allowing host users to actively select appropriate co-stars, as the process is typically passive and relies on receiving co-starring requests from viewing users, making it difficult for host users to find suitable partners.

Method used

A video distribution system that utilizes log information to select co-starring partners based on viewing user overlap, co-starring history, and user attributes, enabling host users to proactively invite users with appropriate overlap and compatibility for co-starring.

Benefits of technology

Facilitates easy selection of appropriate co-stars by host users, enhancing the quality and engagement of co-starring videos through user compatibility and overlap analysis.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007579538000001
    Figure 0007579538000001
  • Figure 0007579538000002
    Figure 0007579538000002
  • Figure 0007579538000003
    Figure 0007579538000003
Patent Text Reader

Abstract

To provide a moving image distribution system capable of easily selecting an appropriate collaboration partner of a host user, a moving image distribution method, and a moving image distribution program.SOLUTION: In a moving image distribution system 1, a server device comprises one or more computer processors, and a storage for storing log information relating to a utilization history of each of a plurality of users of the moving image distribution system. One or more computer processors execute computer readable instructions, thereby selecting one or more invitation users to be transmission destinations of an invitation from among a plurality of collaboration candidate users based on the log information of a first user and a plurality of collaboration candidate users of the users other than the first user among the plurality of users. A collaboration moving image in which the first user and a second user collaborate is generated in response to receiving a collaboration application applying for the collaboration with the first user from the second user among the one or more invitation users, and the collaboration moving image is distributed.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The invention disclosed in this specification relates to a video distribution system, a video distribution method, and a video distribution program. [Background technology]

[0002] Various video distribution services have been known for some time. In recent years, a video distribution system that generates animation of a character object based on the movement of a distribution user and live-distributes a video including the animation of the character object has been attracting attention. Such a video distribution system is disclosed, for example, in JP2015-184689A (Patent Document 1) and "Yusuke Hasegawa, The Dawn of a New Era of Virtual Idols PROJECT MariA, CG WORLD, Japan, Born Digital Co., Ltd., November 10, 2017, Vol. 231, pp. 74-79" (Non-Patent Document 1).

[0003] "Virtual Cast" provided by Dwango Co., Ltd. is known as a video distribution service that distributes videos including character objects generated based on the movements of broadcasting users. In Virtual Cast, a character object of a broadcasting user participates in a video distributed by another broadcasting user, and the two broadcasting users can virtually appear together in the video through their respective character objects. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2015-184689 A [Non-patent literature]

[0005] [Non-Patent Document 1] Yusuke Hasegawa, The Dawn of a New Era of Virtual Idols PROJECT MariA, CG WORLD, Japan, Born Digital Co., Ltd., November 10, 2017, Vol. 231, pp. 74-79 [Non-Patent Document 2] Dwango Co., Ltd., "About [Virtual Cast] Toko", [online], [Retrieved July 1, 2019], Internet〈URL:https: / / qa.nicovideo.jp / faq / show / 10740?category_id=718&site_domain=default〉 Summary of the Invention [Problem to be solved by the invention]

[0006] In a conventional video distribution system that allows users to virtually perform together, a user who watches a video sends a co-starring application to a distributor user who is distributing the video, and a user who will perform with the host user is selected based on the co-starring application. In other words, when a viewing user who watches a video distributed by a host user makes a co-starring application to perform with the host user, a guest user who will perform with the host user is selected from among the viewing users who made the co-starring application. In this way, in a conventional video distribution system, the process for performing together is started in response to a co-starring application from a viewing user. For the host user, it is a passive mechanism in which a co-starring can only occur after a co-starring application from a viewing user is received.

[0007] In order to promote the use of the co-starring function in a video distribution system, a new video distribution system is desired that allows a host user to proactively start co-starring with other users. In order for a host user to start the process for co-starring, the co-starring partner must be specified. The co-starring partner must be appropriately selected to maintain the quality of the host user's video. However, a method for a distributor user to appropriately find a co-starring partner from among the many users who use the video distribution system is not known.

[0008] As described above, in conventional video distribution systems that allow users to virtually appear together, there is a problem in that it is difficult for a distributor user, who is to become a host user, to appear together with an appropriate person.

[0009] An object of the present invention is to provide a technical improvement that solves or alleviates at least some of the problems of the prior art described above. One of the more specific objects of the present invention is to provide a new video distribution system, video distribution method, and video distribution program that allow a host user to easily select an appropriate co-starring partner. Other objects of the present invention will become apparent by referring to this specification as a whole. [Means for solving the problem]

[0010] One aspect of the present invention relates to a video distribution system for distributing videos. The video distribution system includes one or more computer processors and a storage for storing log information on a usage history of the video distribution system for each of a plurality of users of the video distribution system. In one embodiment, the one or more computer processors execute computer-readable instructions to select one or more invited users to whom an invitation is to be sent from among the plurality of co-starring candidate users based on the log information of a first user among the plurality of users and a plurality of co-starring candidate users other than the first user, generate a co-starring video in which the first user and the second user co-star in response to receiving a co-starring application from a second user among the one or more invited users to apply to co-star with the first user, and distribute the co-starring video.

[0011] In one aspect of the present invention, the log information for each of the plurality of users includes viewing user information regarding viewing users who viewed videos of each of the plurality of users.

[0012] In one embodiment of the present invention, the video distribution system calculates the overlap of viewing users between the first user and each of the multiple potential co-starring users based on the viewing user information, and selects the one or more inviting users based on the overlap.

[0013] The video distribution system according to one aspect of the present invention selects, as the one or more inviting users, users among the plurality of potential co-starring users whose overlap degree is smaller than a first threshold value.

[0014] In one embodiment of the present invention, the video distribution system calculates the number of overlapping viewing users between the first user and each of the multiple potential co-starring users based on the viewing user information, and selects the one or more inviting users based on the number of overlapping viewing users.

[0015] A video distribution system according to one aspect of the present invention selects, as the one or more inviting users, users from among the plurality of potential co-starring users whose overlapping number is smaller than a second threshold value.

[0016] In one aspect of the present invention, the log information of each of the plurality of users includes co-starring frequency information indicating the number of times the user has co-starred with other users.

[0017] In one embodiment of the present invention, the video distribution system calculates the difference in the number of times that the first user has co-starred with each of the multiple candidate co-starring users based on the number of times of co-starring information, and selects the one or more invited users based on the difference in the number of times of co-starring.

[0018] The video distribution system according to one aspect of the present invention selects, as the one or more inviting users, users among the plurality of candidate co-starring users, whose difference in the number of co-starring appearances is greater than a third threshold value.

[0019] A video distribution system according to one aspect of the present invention selects, as the one or more inviting users, users among the plurality of candidate co-starring users who have a smaller number of co-starring appearances than the first user.

[0020] A video distribution system according to one aspect of the present invention selects, as the one or more invited users, users from among the plurality of candidate co-starring users who have performed together more frequently than the first user.

[0021] In one aspect of the present invention, the storage stores attribute information of each of the multiple users, and one or more inviting users are selected from among the multiple candidate co-starring users based further on the attribute information of the first user and each of the multiple candidate co-starring users.

[0022] In one aspect of the present invention, the storage stores social information indicating relationships of each of the multiple users with other users, and the one or more inviting users are selected from among the multiple candidate co-starring users based further on the social information of the first user and each of the multiple candidate co-starring users.

[0023] One aspect of the present invention relates to a video distribution method executed by one or more computer processors executing computer-readable instructions. In one embodiment, the video distribution method includes a step of storing log information on a usage history of a video distribution system for each of a plurality of users of the video distribution system, a step of selecting one or more inviting users to be an invitation recipient from among the plurality of co-starring candidate users based on the log information of a first user among the plurality of users and each of a plurality of co-starring candidate users other than the first user, a step of generating a co-starring video in which the first user and the second user appear together in response to receiving a co-starring application from a second user among the one or more inviting users to apply to appear together with the first user, and a step of distributing the co-starring video.

[0024] One aspect of the present invention relates to a video distribution program. In one embodiment, the video distribution program causes one or more computer processors to execute the steps of: storing log information on a usage history of a video distribution system for each of a plurality of users of the video distribution system, selecting one or more invited users to whom an invitation is to be sent from among the plurality of co-starring candidate users based on the log information of a first user among the plurality of users and a plurality of co-starring candidate users other than the first user, generating a co-starring video in which the first user and the second user appear together in response to receiving a co-starring application from a second user among the one or more invited users to apply to appear together with the first user, and distributing the co-starring video. Effect of the Invention

[0025] According to an embodiment of the present invention, it is possible to provide a novel video distribution system, a video distribution method, and a video distribution program that enable a host user to easily select an appropriate co-star partner. [Brief description of the drawings]

[0026] [Figure 1] 1 is a block diagram showing a video distribution system according to an embodiment. [Diagram 2] 2 is a schematic diagram showing a broadcaster user who broadcasts a video distributed in the video distribution system of FIG. 1 and a broadcaster user device used by the broadcaster user. FIG. [Diagram 3] 2 is a diagram illustrating user information stored in the video distribution system of FIG. 1. [Figure 4] 2 is a diagram illustrating co-starring video information stored in the video distribution system of FIG. 1. FIG. [Diagram 5] FIG. 2 is a diagram showing an example of a display screen displayed on an audience user device 10 in one embodiment. [Figure 6a] FIG. 13 is a diagram showing an example of a display screen displayed on a broadcast user device 20a in one embodiment. [Figure 6b]FIG. 13 is a diagram showing an example of a display screen displayed on a broadcast user device 20b in one embodiment. [Figure 7] FIG. 13 is a diagram illustrating a setting window displayed on a broadcast user device 20b. [Figure 8] FIG. 13 is a diagram showing an example of how the invitation is displayed on a broadcast user device 20a that has received the invitation. [Figure 9] FIG. 2 is a diagram showing an example of a display screen of a co-starring video displayed on a viewer user device 10 in one embodiment. [Figure 10a] FIG. 13 is a diagram showing an example of a display screen of a co-starring video displayed on a broadcast user device 20a in one embodiment. [Figure 10b] FIG. 13 is a diagram showing an example of a display screen of a co-starring video displayed on a broadcast user device 20b in one embodiment. [Figure 11] FIG. 11 is a flow diagram showing a flow of a video distribution process according to an embodiment. [Figure 12] FIG. 11 is a flow diagram showing the flow of a process of inviting someone to a joint performance in one embodiment. [Figure 13] 1 is a flow diagram showing a process flow for distributing a co-starring video in one embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0027] Various embodiments of the present invention will now be described with reference to the accompanying drawings, in which the same reference numerals are used to designate the same or similar components throughout the drawings.

[0028] A video distribution system according to an embodiment will be described with reference to FIG. 1 and FIG. 2. FIG. 1 is a block diagram showing a video distribution system 1 according to an embodiment, and FIG. 2 is a schematic diagram showing users Ua and Ub who distribute videos in the video distribution system 1 and broadcast user devices 20a and 20b used by the users Ua and Ub. The broadcast user device 20a has a function for distributing a video including a character object generated based on the movement of the user Ua in the video distribution system 1, and the broadcast user device 20b has a function for distributing a video including a character object generated based on the movement of the user Ub in the video distribution system 1. As will be described in detail later, the video distribution system 1 can generate a video including character objects of two or more broadcast users and distribute the video. In other words, in the video distribution system 1, two or more broadcast users can virtually appear together in a video through their respective character objects. In this way, when two or more broadcast users virtually appear together in a video through their respective character objects, the video is called a co-starring video.

[0029] Both user Ua and user Ub are broadcast users who broadcast videos including character objects generated based on movements, and are also viewing users who watch videos of other broadcast users. For this reason, broadcast user devices 20a and 20b may have a function to watch videos broadcast in the video broadcasting system 1.

[0030] User Ua and user Ub can send invitations to other viewing users to invite them to their videos. For example, when a video including a character object generated based on the movement of user Ub is being distributed, user Ub can send an invitation to user Ua to invite user Ub to the video. User Ua can make a co-starring application to apply to co-star with user Ub based on this invitation. If this co-starring application is approved, a co-starring video including the character object of user Ub and the character object of user Ua is generated and the co-starring video is distributed. When user Ua participates in a video distributed by user Ub at the invitation from user Ub and user Ub and user Ua co-star, user Ub who sent the invitation is called a "host user", and user Ua who co-stars with user Ub in response to this invitation may be called a "guest user". The concepts of host user and guest user are relative. For example, conversely to the above example, when user Ub co-stars in a video of user Ua based on an invitation sent by user Ua to user Ub, user Ua becomes the host user and user Ub becomes the guest user. In this specification, for convenience of explanation, it is assumed that an invitation is sent from user Ub to user Ua. In other words, it is assumed that user Ub is the host user and user Ua is the guest user. However, the explanation of user Ua in this specification may be extended to an explanation of guest users in general as much as possible. Similarly, the explanation of user Ub in this specification may be extended to an explanation of host users in general as much as possible. For example, even if a description is given of distribution user Ua in this specification, the description may be understood as an explanation of guest users in general, and a description of distribution user Ub may be understood as an explanation of host users in general.

[0031] It is assumed that the video distribution system 1 will be used by a large number of users. The users of the video distribution system 1 include distribution users who distribute videos and viewing users who view the distributed videos. The users of the video distribution system 1 are divided into distribution users and viewing users depending on the manner in which the video distribution system 1 is used, but they may also be both. In other words, a distribution user who distributes videos using the video distribution system 1 can view videos distributed by other distribution users using the video distribution system 1, and therefore can be both a distribution user and a viewing user.

[0032] Since the video distribution system 1 is used by many users, in the above example, it is not easy for the broadcast user Ub to find a suitable co-star partner. In other words, when deciding which of the many broadcast users of the video distribution system 1 to send an invitation to, there are too many candidate broadcast users, so it is not easy to decide the destination of the invitation. Therefore, the video distribution system 1 according to one embodiment of the present invention has a function to support the broadcast user Ub in selecting a co-star partner. In the following, first, an overview of the architecture of the video distribution system 1 and the devices constituting the video distribution system 1 will be described, and then the function of each device will be described. In the description of the functions of each device, the function related to the selection of a co-star partner will be described.

[0033] The video distribution system 1 includes a viewing user device 10, broadcasting user devices 20a and 20b, a server device 60, and a storage 70. The viewing user device 10, the broadcasting user devices 20a and 20b, the server device 60, and the storage 70 are connected to each other via a network 50 so as to be able to communicate with each other. The server device 60 is configured to distribute videos including animations of character objects of the broadcasting user Ua and the broadcasting user Ub, as described below. The server device 60 may be configured to distribute videos other than videos including animations of character objects. In addition to the video distribution service, the server device 60 may provide a social networking service for users to interact with each other, or a platform function for the service.

[0034] In the video distribution system 1, videos are distributed from the server device 60 to the viewing user device 10 and the broadcasting user devices 20a and 20b. The distributed videos are displayed on the display of the viewing user device 10. The viewing users, who are the users of the viewing user device 10, can view the distributed videos on the viewing user device 10. The broadcasting users Ua and Ub can perform while checking the videos being distributed by viewing the distributed videos. Furthermore, the broadcasting users Ua and Ub can view videos including character objects of other users on the broadcasting user devices 20a and 20b. For the sake of simplicity, only one broadcasting user device 10 is shown in FIG. 1, but the video distribution system 1 may include multiple broadcasting user devices. Furthermore, although only two broadcasting user devices are shown in FIG. 1, the video distribution system 1 may include three or more broadcasting user devices. As described above, the broadcasting users Ua and Ub are also viewing users. Therefore, when they are not distributing their own videos, they can view videos distributed by other broadcasting users on the broadcasting user devices 20a and 20b.

[0035] In the illustrated embodiment, the broadcast user device 20a includes a computer processor 21a, a communication I / F 22a, a display 23a, a camera 24a, and a microphone 25a. Similarly, the broadcast user device 20b includes a computer processor 21b, a communication I / F 22b, a display 23b, a camera 24b, and a microphone 25b. Since the broadcast user device 20a and the broadcast user device 20b have similar configurations and functions, when there is no need to particularly distinguish between them, they may be collectively referred to as the broadcast user device 20, and their components may also be referred to as the computer processor 21, etc.

[0036] The computer processor 21 is an arithmetic device that loads an operating system and various programs that realize various functions from a storage into a memory and executes instructions included in the loaded programs. The computer processor 21 is, for example, a CPU, an MPU, a DSP, a GPU, various other arithmetic devices, or a combination of these. The computer processor 21 may be realized by an integrated circuit such as an ASIC, a PLD, an FPGA, or an MCU. Although the computer processor 21 is illustrated in FIG. 1 as a single component, the computer processor 21 may be a collection of multiple physically separate computer processors.

[0037] The communication I / F 22 is implemented as hardware, firmware, or communication software such as a TCP / IP driver or a PPP driver, or a combination of these. The broadcast user device 20 can transmit and receive data to and from other devices via the communication I / F 22.

[0038] The display 23 has a display panel and a touch panel. The touch panel is configured to be able to detect a touch operation (contact operation) by the player. The touch panel can detect various touch operations by the player, such as tapping, double tapping, dragging, etc. The touch panel may be configured to include a capacitance-type proximity sensor and to be able to detect a non-contact operation by the player.

[0039] The camera 24 continuously captures images of the faces of the broadcast users Ua and Ub, and acquires imaging data of the faces of the broadcast users Ua and Ub. The imaging data of the faces of the broadcast users Ua and Ub captured by the camera 24 is transmitted to the server device 60 via the communication I / F 22. The camera 24 may be a 3D camera capable of detecting the depth of a person's face. The camera 24 may capture images of parts of the broadcast users Ua and Ub other than their faces, such as hands, legs, fingers, or other parts, to acquire imaging data.

[0040] The microphone 25 is a sound collection device configured to convert input voice into voice data. The microphone 25 is configured to acquire voice input of the broadcast users Ua and Ub. The voice input of the broadcast users Ua and Ub acquired by the microphone 25 is converted into voice data, and this voice data is transmitted to the server device 60 via the communication I / F 22.

[0041] The viewing user equipment 10 may include components similar to those of the broadcasting user equipment 20. For example, the viewing user equipment 10 may include a computer processor, a communication I / F, a display, and a camera. The viewing user equipment 10 may perform functions similar to those of the broadcasting user equipment 20 by downloading and installing certain application software.

[0042] The viewing user device 10 and the broadcasting user device 20 are information processing devices such as smartphones. The viewing user device 10 and the broadcasting user device 20 may be, in addition to smartphones, mobile phones, tablet terminals, personal computers, e-book readers, wearable computers, game consoles, and various other information processing devices capable of playing videos. In addition to the above components, each of the viewing user device 10 and the broadcasting user device 20 may be equipped with a sensor unit equipped with various sensors such as a gyro sensor, and a storage device for storing various information.

[0043] Next, a description will be given of the server device 60. In the illustrated embodiment, the server device 60 includes a computer processor 61, a communication I / F 62, and a storage 63.

[0044] The computer processor 61 is an arithmetic device that loads an operating system and various programs that realize various functions from the storage 63 or other storages into memory and executes instructions included in the loaded programs. The computer processor 61 is, for example, a CPU, an MPU, a DSP, a GPU, various other arithmetic devices, or a combination of these. The computer processor 61 may be realized by an integrated circuit such as an ASIC, a PLD, an FPGA, or an MCU. Although the computer processor 61 is illustrated in FIG. 1 as a single component, the computer processor 61 may be a collection of multiple physically separate computer processors.

[0045] The communication I / F 62 is implemented as hardware, firmware, or communication software such as a TCP / IP driver or a PPP driver, or a combination of these. The server device 60 can transmit and receive data to and from other devices via the communication I / F 62.

[0046] The storage 63 is a storage device accessed by the computer processor 61. The storage 63 is, for example, a magnetic disk, an optical disk, a semiconductor memory, or any other storage device capable of storing data. Various programs can be stored in the storage 63. At least a portion of the programs and various data that can be stored in the storage 63 may be stored in a storage (for example, the storage 70) that is physically separate from the server device 60.

[0047] In this specification, the programs or instructions included in the programs described as being executed by the computer processor 21 or the computer processor 61 may each be executed by a single computer processor or may be distributed and executed by multiple computer processors. Furthermore, the programs or instructions included in the programs executed by the computer processor 21 or the computer processor 61 may each be executed by multiple virtual computer processors.

[0048] Next, a description will be given of data stored in the storage 63. In the illustrated embodiment, the storage 63 stores model data 63a, object data 63b, user information 63c, co-starring video information 63d, and various other data required for generating and distributing a distribution video.

[0049] The model data 63a is model data for generating animation of a character. The model data 63a may be three-dimensional model data for generating three-dimensional animation, or may be two-dimensional model data for generating two-dimensional model data. The model data 63a includes, for example, rig data (sometimes called "skeleton data") indicating the skeleton of the character's face and parts other than the face, and surface data indicating the shape and texture of the character's surface. The surface data is sometimes called skin data. The model data 63a may include a plurality of model data that are different from each other. The plurality of model data may have different rig data from each other, or may have the same rig data. The plurality of model data may have different surface data from each other, or may have the same surface data.

[0050] The object data 63b includes asset data for constructing a virtual space that constitutes a video. The object data 63b includes data for drawing the background of the virtual space that constitutes the video, data for drawing various objects displayed in the video, and data for drawing various objects other than these that are displayed in the video. The object data 63b may include object position information that indicates the position of the object in the virtual space.

[0051] An example of user information 63c is shown in FIG. 3. As shown in the figure, various data related to a user who uses the video distribution system 1 is stored as user information 63c in association with the account information of the user. The user information 63c of a certain user may include user evaluation information indicating an evaluation of the user, video evaluation information indicating an evaluation of a video distributed by the user, viewer number information indicating the number of viewers of a video distributed by the user or being distributed, viewing user information regarding users who viewed a video distributed by the user or being distributed, co-starring number information indicating the number of times the user has co-starred with other users, attribute information indicating the profile of the user, and social information indicating a relationship between the user and other users. The user information 63c may include information other than the above.

[0052] The user's account information is, for example, user identification information (user ID) that identifies the user. The user ID is assigned to the user when the user first registers for use of the video distribution system 1.

[0053] The user evaluation information associated with the user's account information is information indicating evaluations of the user by other users. The user evaluation information is, for example, a user evaluation point expressed by a natural number. A user of the video distribution system 1 can distribute a video including his / her own character object via the server device 60. A user's user evaluation point may be updated based on feedback from a viewing user for a video distributed by the user. For example, feedback from a viewing user includes selection of a "Like" button displayed on the viewing screen, selection of a "Boo" button indicating a negative evaluation, gifting of an item displayed on the viewing screen, sending of a comment from the viewing screen, and various other feedback. It is assumed that the "Like" button is selected when a viewer has a favorable impression of the viewed video or the distribution user distributing the viewed video. The "Like" button may be displayed on the viewing screen as an icon including characters such as "Like" or "Like" indicating favorable impressions. It is assumed that the "Boo" button is selected when a viewer has a negative impression, such as antipathy, of the viewed video or the distribution user distributing the viewed video. The "Boo" button may be displayed on the viewing screen as an icon including characters such as "not good" or "dislike" indicating dislike. In this specification, the button and icon for indicating like may be called the "like button" and the "like icon", respectively, and the button and icon for indicating dislike may be called the "dislike button" and the "dislike icon", respectively. The evaluation points may include the number of selections of the like button, the number of selections of the dislike button, the number of giftings (or the gifting amount), the number of comments, or other parameters related to feedback from the viewing user. For example, when positive feedback or negative feedback is provided from the viewing user, the user evaluation points may be increased. The user evaluation points may be a number or amount of positive feedback from the viewing user evaluated as a number of points, or a number or amount of negative feedback from the viewing user evaluated as a number of points.Furthermore, the user evaluation points may be increased or decreased depending on the number of positive feedbacks and the number of negative feedbacks. More specifically, the user evaluation points may be increased when positive feedback is given and decreased when negative feedback is given, or vice versa. The user evaluation points of a certain user may be updated by a trigger other than feedback on a video distributed by the user. For example, when a certain user interacts with other users using a social networking service provided by the server device 60, the user evaluation points may be updated based on the activity using the social networking service.

[0054] The video evaluation information associated with the user's account information is information indicating evaluations from other users of a video distributed by the user. The video evaluation information is, for example, a video evaluation point expressed as a natural number. A user's video evaluation point may be updated based on feedback from a viewing user on a video distributed by the user. When a viewing user who viewed a video provides positive feedback or negative feedback on a video distributed by a user, the user's video evaluation point may be increased. When feedback is provided on a video distributed by a user, both the user evaluation point and the video evaluation point may be updated.

[0055] The viewer number information associated with the user's account information indicates the number of viewing users who have viewed or are currently viewing a video distributed by the user. The viewer number information of a certain user may be the cumulative number of viewing users who have viewed a video distributed by the user. For example, if a certain user has distributed a video 10 times, the viewer number information may be the total number of viewing users in each of the 10 distributions. A new viewing user may start viewing a video while it is being distributed, or a user who was viewing may stop viewing it halfway through. For this reason, the number of viewing users of a certain video may vary depending on the time point from the start of viewing the video. The number of viewing users may be logged at regular time intervals, and the average of the viewing users may be calculated based on this log, and this calculated average may be used as the number of viewing users of the video. For example, for a 10-minute video, the number of viewers may be recorded a total of 10 times at 1-minute intervals, and the average of the 10 recorded numbers of viewers may be used as the number of viewing users of the video. In another embodiment, the number of viewing users who were viewing the video at the end of the video distribution may be used as the number of viewing users. The information on the number of viewers of a video may be information other than the above that correlates with the number of users viewing the video.

[0056] The viewing user information associated with the user's account information is information about viewing users who have viewed or are currently viewing a video distributed by the user. The viewing user information of a certain user may include the user ID of a viewing user who has viewed or is currently viewing a video distributed by the user. The viewing user information of a certain user may also include viewer number information indicating the number of viewing users who have viewed or are currently viewing a video distributed by the user. The viewer number information of a certain user may be the cumulative number of viewing users who have viewed a video distributed by the user using the video distribution system 1. For example, if a certain user has distributed a video 10 times, the viewer number information may be the total number of viewing users in each of the 10 distributions. A new viewing user may start viewing a video during the distribution of the video, or a user who has been viewing the video may stop viewing the video halfway through. For this reason, the number of viewing users of a certain video may vary depending on the point in time from the start of viewing the video. The number of viewing users may be logged at regular time intervals, the average of the viewing users may be calculated based on the log, and the calculated average may be the number of viewing users of the video. For example, for a 10-minute video, the number of viewers may be recorded a total of 10 times at 1-minute intervals, and the average of the 10 recorded numbers of viewers may be regarded as the number of viewing users of the video. In another embodiment, the number of viewing users may be the number of viewing users who were watching the video when the distribution of the video ended. The information on the number of viewers of a video may be information other than the above that is correlated with the number of viewing users of the video.

[0057] The number of times of co-starring information associated with the user's account information indicates the number of times the user has co-starred with other broadcast users. The number of times of co-starring information may be the total number of times the user has co-starred with other broadcast users as a guest user and the number of times the user has co-starred with other broadcast users as a host user. The number of times of co-starring may be the number of times the user has co-starred with other broadcast users as a host user. The number of times of co-starring may be the number of times the user has co-starred with other broadcast users as a guest user.

[0058] The attribute information associated with the user's account information indicates the profile of the user. The attribute information of a certain user may include the user's nickname, gender, age, place of residence, alma mater, affiliation, and other information indicating the user's attributes.

[0059] The social information associated with the account information of a user is information indicating the relationship between the user and other users. The social information of a certain user includes, for example, friend information that identifies users registered as friends by the user and information indicating the relationship between the user and other users other than the friend information. In the case where the server device 60 provides an SNS (social network service) function, the friend information of a certain user may be the user ID of another user registered as a friend of the user in the SNS provided by the server device 60. The friend information of a certain user may be the user ID of another user registered as a friend of the user in an SNS provided by a device other than the server device 60.

[0060] As described above, the user information 63c includes information regarding the usage history of the video distribution system 1 by the user. In this specification, the information in the user information 63c regarding the usage history of the video distribution system 1 is referred to as "log information." In the example shown in Fig. 3, the viewing user information and the number of times of co-starring information in the user information 63c are included in the log information. In addition to the viewing user information and the number of times of co-starring information, information regarding the usage history of the video distribution system 1 by the user may be included in the log information.

[0061] An example of the co-starring video information is shown in Fig. 4. As shown in the figure, various data related to the co-starring video are stored as the co-starring video information 63d in association with co-starring video identification information that identifies the co-starring video. The co-starring video information 63d of a certain co-starring video may include host user evaluation information indicating an evaluation of the host user in the co-starring video, guest user evaluation information indicating an evaluation of the guest user in the co-starring video, and co-starring time information indicating the elapsed time from the start of the co-starring of the co-starring video.

[0062] The host user evaluation information indicates an evaluation of the host user in the co-starring video. The host user evaluation information of a certain host user is, for example, a host user evaluation point expressed as a natural number.

[0063] The guest user evaluation information indicates an evaluation of a guest user. The guest user evaluation information of a certain guest user is, for example, a guest user evaluation point expressed as a natural number.

[0064] The joint appearance time information indicates the amount of time that has elapsed since the start of the joint appearance between the guest user and the host user.

[0065] Next, the functions realized by the computer processors 21a and 21b will be described in more detail. The computer processor 21a functions as a face motion data generating unit 21a1, an invitation presenting unit 21a2, and a co-starring request unit 21a3 by executing computer-readable instructions included in the distribution program. Similarly, the computer processor 21b functions as a face motion data generating unit 21b1 and an invitation request unit 21b2 by executing computer-readable instructions included in the distribution program. At least a part of the functions realized by the computer processors 21a and 21b may be realized by a computer processor other than the computer processors 21a and 21b of the video distribution system 1. At least a part of the functions realized by the computer processors 21a and 21b may be realized by, for example, a computer processor 61 mounted on the server device 60.

[0066] The facial motion data generating unit 21a1 generates facial motion data that is a digital representation of the facial movement of the broadcast user Ua based on the imaging data of the camera 24a. Similarly, the facial motion data generating unit 21b1 generates facial motion data that is a digital representation of the facial movement of the broadcast user Ub based on the imaging data of the camera 24b. The facial motion data is generated as time passes. The facial motion data may be generated at predetermined sampling time intervals. In this way, the facial motion data generated by the facial motion data generating unit 21a1 can digitally represent the facial movement (changes in facial expression) of the broadcast user Ua in a time series, and the facial motion data generated by the facial motion data generating unit 21b1 can digitally represent the facial movement (changes in facial expression) of the broadcast user Ub in a time series. The facial motion data generated by the facial motion data generating units 21a1 and 21b1 is transmitted to the server device 60 via the communication I / Fs 22a and 22b.

[0067] In the broadcast user device 20, in addition to the facial motion data generated by the facial motion data generating unit 21a1, body motion data may be generated which is a digital representation of the position and orientation of each part of the body of the broadcast user Ua, Ub other than the face. The broadcast user device 20 may transmit the body motion data to the server device 60 in addition to the facial motion data. In order to generate the body motion data, the broadcast users Ua, Ub may wear a motion sensor. The broadcast user device 20 may be configured to be able to generate the body motion data based on the detection information of the motion sensor worn by the broadcast users Ua, Ub. The body motion data may be generated at predetermined sampling time intervals. In this way, the body motion data represents the body movements of the broadcast users Ua, Ub in a time series as digital data. The generation of the body motion data based on the detection information of the motion sensor worn by the broadcast users Ua, Ub may be performed, for example, in a photography studio. The photography studio may be equipped with a base station, a tracking sensor, and a display. The base station may be a multi-axis laser emitter. The motion sensor attached to the broadcasting users Ua and Ub may be, for example, a Vive Tracker provided by HTC CORPORATION. The base station provided in the photography studio may be, for example, a base station provided by HTC CORPORATION. A supporter computer may be installed in a room separate from the photography studio. The display of the photography studio may be configured to display information received from the support computer. The server device 60 may be installed in the same room as the room in which the supporter computer is installed. The room in which the supporter computer is installed and the photography studio may be separated by a glass window. In this case, the operator of the supporter computer (sometimes referred to as a "supporter" in this specification) can visually recognize the broadcasting users Ua and Ub. The supporter computer may be configured to be able to change the settings of various devices provided in the photography studio in response to the operation of the supporter.The supporter computer can, for example, set the scanning interval by the base station, set the tracking sensor, and change various settings of various other devices. The supporter can input a message to the supporter computer and display the input message on the display of the photography studio.

[0068] In the broadcast user device 20b, the invitation request unit 21b2 requests the server device 60 to send an invitation in response to an operation of the broadcast user Ub. As will be described later, when the server device 60 receives a request to send an invitation from the broadcast user device 20b, it selects an inviting user to whom the invitation will be sent from among the users of the video distribution system 1. The invitation is sent from the server device 60 to the broadcast user device of the inviting user. The method of selecting the inviting user will be described later, but it is assumed that the broadcast user Ua who uses the broadcast user device 20a is included in the inviting users. The server device 60 may transmit host user information regarding the broadcast user Ub who requested the transmission of the invitation in association with the invitation from the broadcast user Ub. The invitation may be included in the distributed video, or may be transmitted separately from the distributed video.

[0069] In the broadcast user device 20a, when an invitation from another broadcast user is received from the server device 60, the invitation presenting unit 21a2 presents the invitation to the broadcast user Ua. The invitation is, for example, an invitation inviting the user Ua to a video being broadcast by the user Ub. The invitation presenting unit 21a2 may present host user information related to the broadcast user who requested the transmission of the invitation together with the invitation. The invitation presenting unit 21a2 may display the contents of the invitation and the host user information related to the broadcast user who sent the invitation on the display 23a.

[0070] Based on an operation of the broadcast user Ua on the broadcast user device 20a, the co-starring application unit 21a3 transmits a co-starring application to the server device 60 to request a co-starring with the other broadcast user. As will be described later, the broadcast user device 20a may display an operation button for making a co-starring application in response to receiving an invitation, or may display an operation button for making a co-starring application regardless of whether an invitation has been received or not.

[0071] In this specification, it is assumed that a broadcast user Ub using the broadcast user device 20b makes a request to send an invitation, and the server device 60 transmits the invitation from the broadcast user Ub to the broadcast user Ua using the broadcast user device 20a, so the invitation request unit 21b2 is described as a function executed by the computer processor 21b of the broadcast user device 20b. It is also assumed that the broadcast user Ua sends an invitation, so the broadcast user device 20a may execute a function similar to the invitation request unit 21b2. Similarly, it is also assumed that the broadcast user Ub receives an invitation, so the broadcast user device 20b may execute a function similar to the invitation presenting unit 21a2 and the co-starring application unit 21a3.

[0072] The broadcast user device 20 may execute the broadcast program and / or other programs on a computer processor to realize functions other than the facial motion data generator 21a1. For example, the broadcast user device 20 may execute a viewing program for viewing videos to realize a function of playing received videos. The broadcast program and the viewing program may be packaged in one application software, or may be provided as separate application software.

[0073] The viewing user device 10 may be configured to provide the same functions as the broadcasting user device 20. For example, the viewing user device 10 may realize a function of playing received videos by executing a viewing program for video viewing, or may realize a function similar to that of the face motion data generator 21a1 by executing a broadcasting program.

[0074] Next, a more detailed description will be given of the functions realized by the computer processor 61. The computer processor 61 executes computer-readable instructions included in the distribution program to function as an animation generation unit 61a, a video generation unit 61b, a video distribution unit 61c, an invited user selection unit 61d, an invitation processing unit 61e, a co-starring application processing unit 61f, and a co-starring end processing unit 61g.

[0075] The animation generation unit 61a is configured to generate animation of a character object by applying face motion data generated by the face motion data generation unit 21a of the broadcast user device 20a or the face motion data generation unit 21b1 of the broadcast user device 20b to predetermined model data included in the model data 63a. The animation generation unit 61a can generate animation of the character object so that the facial expression of the character object changes based on the face motion data. Specifically, the animation generation unit 61a can generate animation of a character object that moves in synchronization with the facial movement of the broadcast user Ua based on the facial motion data related to the broadcast user Ua. Similarly, the animation generation unit 61a can generate animation of a character object that moves in synchronization with the facial movement of the broadcast user Ub based on the facial motion data related to the broadcast user Ub.

[0076] When body motion data regarding broadcast users Ua, Ub is provided from the broadcast user device 20, the animation generation unit 61a can generate animation of a character object that moves in synchronization with the body and facial movements of the broadcast users Ua, Ub based on the body motion data and facial motion data regarding the broadcast users Ua, Ub.

[0077] When distributing video of broadcast user Ua, the video generation unit 61b can generate a background image showing the background using object data 63b, and generate a video including this background image and an animation of a character object corresponding to broadcast user Ua. The video generation unit 61b can synthesize the generated video with the voice of broadcast user Ua, which is generated based on the voice data received from the broadcast user device 20a. Similarly, when distributing video of broadcast user Ub, the video generation unit 61b can generate a background image showing the background using object data 63b, and generate a video including this background image and an animation of a character object corresponding to broadcast user Ub. The video generation unit 61b can synthesize the generated video with the voice of broadcast user Ua, which is generated based on the voice data received from the broadcast user device 20b. In the video generated by video generation unit 61b, character objects corresponding to broadcast users Ua, Ub are displayed superimposed on a background image. In this way, video generation unit 61b can generate animation of a character object that moves in sync with the facial movements of broadcast user Ua or broadcast user Ub, and generate a video for distribution in which the voice of broadcast user Ua or broadcast user Ub is synthesized with this animation.

[0078] The video distribution unit 61c distributes the video generated by the video generation unit 61b. This video is distributed to the viewing user device 10 and other viewing user devices via the network 50. The generated video is also distributed to the broadcasting user devices 20a and 20b. The received video is played in the viewing user device 10 and the broadcasting user devices 20a and 20b. The video distribution unit 61c may monitor at least one of the video distribution time and the number of broadcasts for each broadcasting user. The video distribution unit 61c may update the distribution time and the number of broadcasts in the user information based on the monitoring results.

[0079] Display examples of a video distributed from the video distribution unit 61c are shown in Fig. 5 and Fig. 6a to Fig. 6b. In these figures, it is assumed that the broadcast user Ub uses the broadcast user device 20b to distribute a video including his / her own character object, and that the video is being played on the viewing user device 10 and the broadcast user devices 20a and 20b. In Fig. 6a, it is assumed that the broadcast user Ua is not performing video distribution, and is watching a video distributed by another broadcast user, broadcast user Ub. For this reason, in the explanation of Fig. 5 and Fig. 6a to Fig. 6b, the broadcast user Ua may also be referred to as a viewing user. Fig. 5 shows a display example of a video being played on the viewing user device 10, Fig. 6a shows a display example of a video being played on the broadcast user device 20a, and Fig. 6b shows a display example of a video being played on the broadcast user device 20b.

[0080] 5, an image 30 including a moving image distributed from a server device 60 is displayed on the display of the viewing user device 10. The image 30 displayed on the viewing user device 10 includes a character object 31 of the broadcasting user Ub generated by an animation generation unit 61a, a gift button 32, a rating button 33, a comment button 34, and a comment display area 35.

[0081] As shown in FIG. 6a, an image 40a including a video distributed from the server device 60 is displayed on the display 23a of the broadcast user device 20a. This image 40a includes a character object 31 of the broadcast user Ub, a gift button 32, a rating button 33, a comment button 34, and a comment display area 35, similar to the image 30. In addition, the image 40a may include a co-starring request button 36. The co-starring request button 36 is an operation button for sending a co-starring request to request a co-starring with the broadcast user Ub in a video distributed by the broadcast user Ub. The broadcast user Ua can send a co-starring request to request a co-starring with the broadcast user Ub from the broadcast user device 20a to the server device 60 by selecting the co-starring request button 36 on the broadcast user device 20a. The broadcast user device 20a can display the image 40a of the distributed video by, for example, executing application software including a viewing program.

[0082] 5, the image 30 displayed on the viewing user device 10 may not include the request to perform together button 36. For example, when application software including a distribution program has not been downloaded or installed in the viewing user device 10, and when application software including a distribution program has not been started in the viewing user device 10, the image 30 is generated so as not to include the request to perform together button 36. In another embodiment, the request to perform together button 36 may also be displayed in the image 30 of the viewing user device 10. For example, when application software including a distribution program has been downloaded or installed in the viewing user device 10, or when application software including a distribution program has been started in the viewing user device 10, the image 30 is generated so as to include the request to perform together button 36.

[0083] As described above, the character object 31 is generated by applying the facial motion data of the broadcast user Ub to the model data included in the model data 63a, and therefore its facial expression changes in synchronization with the facial movements of the broadcast user Ub. When body motion data is provided from the broadcast user device 20, the character object 31 can be controlled so that parts of the character object 31 other than its face also change in synchronization with the body movements of the broadcast user Ub.

[0084] The gift button 32 is displayed superimposed on the image 30 so as to be selectable by an operation on the viewing user device 10. The gift button 32 can be selected, for example, by a tap operation on an area of ​​the touch panel of the viewing user device 10 where the gift button 32 is displayed. In one embodiment, when the gift button 32 is selected, a window for selecting a gift to be gifted to the broadcasting user (here, broadcasting user Ub) who is broadcasting the video being viewed is displayed superimposed on the image 30. The viewing user can purchase a gift to be gifted from the gifts displayed in the window. In another embodiment, in response to the selection of the gift button 32, a window including a list of purchased gifts is displayed superimposed on the image 30. In this case, the viewing user can select a gift to be gifted from the gifts displayed in the window. When the gift button 32 is selected on the viewing user device 10, gifting information may be transmitted to the server device 60. This gifting information may include gift identification information (gift ID) that identifies the gift to be gifted. In this way, a viewing user who is viewing a video can provide (gift) a desired gift to the distributor user who is distributing the video by selecting the gift button 32.

[0085] The rating button 33 is displayed superimposed on the image 30 so as to be selectable by a viewing user using the viewing user device 10. The rating button 33 can be selected, for example, by a tap operation on an area of ​​the touch panel of the viewing user device 10 where the rating button 33 is displayed. When the rating button 33 is selected by a viewing user viewing a video, rating update information indicating that a positive rating has been given to the broadcasting user (broadcasting user Ub in the illustrated example) who broadcasts the video or a positive rating has been given to the broadcasting video being broadcast may be transmitted to the server device 60. The server device 60 can update the user information based on the rating update information from the viewing user. For example, based on the rating update information from the viewing user, at least one of the user rating information and video rating information included in the user information may be updated. For example, when the rating button 33 included in the image 30 shown in FIG. 5 is selected by the viewing user, at least one of the user rating information and video rating information of the broadcasting user Ub who broadcasts the video displayed on the viewing user device 10 may be updated. When the rating button 33 is selected, rating information indicating that a negative rating has been given to the video may be transmitted to the server device 60. Evaluation information indicating a positive evaluation of a video may be called positive evaluation information, and evaluation information indicating a negative evaluation of a video may be called negative evaluation information. When the server device 60 receives positive evaluation information, the server device 60 may increase at least one of the user evaluation information and the video evaluation information. When the server device 60 receives negative evaluation information, the server device 60 may decrease at least one of the user evaluation information and the video evaluation information.

[0086] The comment button 34 is displayed superimposed on the image 30 so as to be selectable by the user. When the comment button 34 is selected, for example, by a tap operation, a comment input window for inputting a comment is displayed superimposed on the image 30. The viewing user can input a comment via the input mechanism of the viewing user device 10 or the broadcasting user device 20a. The input comment is transmitted from the viewing user device 10 and the broadcasting user device 20a to the server device 60. The server device 60 accepts comments from the viewing user device 10, the broadcasting user device 20a, and other user devices, and displays the comments in a comment display area 35 in the image 30. In the comment display area 35, comments posted by each user are displayed, for example, in chronological order. The comment display area 35 occupies a part of the area of ​​the image 30. There is an upper limit to the number of comments that can be displayed in the comment display area 35. In the illustrated example, up to three comments can be displayed in the comment display area 35. When comments are posted that exceed the upper limit set in the comment display area 35, the comments are deleted from the comment display area 35 in order of oldest posted comments. Therefore, the more frequently comments are received, the shorter the display time of each comment in the comment area 35. In one embodiment, a scroll bar is provided on the image 30, and comments that have been deleted from the comment display area 35 can be viewed by operating the scroll bar to scroll through the comments.

[0087] As shown in FIG. 6b, an image 40b distributed from the server device 60 is displayed on the display of the broadcast user device 20b. The image 40b displayed on the broadcast user device 20b includes a character object 31 corresponding to the broadcast user Ub, display command buttons 42a to 42c for displaying gifts received from viewing users in the video, and a comment display area 35. The image 40b displayed on the broadcast user device 20b includes the same background image, character object image, and comment as the images 30 and 40a. On the other hand, the image 40b differs from the images 30 and 40a in that it does not include the gift button 32, the rating button 33, the comment button 34, and the co-starring request button 36, but includes the display command buttons 42a to 42c. The display command buttons 42a to 42c are displayed on the image 40, for example, in response to receiving a gift from a viewing user. In the illustrated embodiment, three display command buttons 42a to 42c are displayed on the image 40. Each of the display instruction buttons 42a-42c is displayed on the image 40 so as to be selectable by the broadcast user. When any of the display instruction buttons 42a-42c is selected, for example, by a tap operation, an operation is performed to display the gift corresponding to the selected display instruction button. In this way, the display instruction buttons 42a-42c are display instruction objects for issuing an instruction to display the gift in the video being broadcast.

[0088] The invited user selection unit 61d selects, for the broadcast user Ub, an invited user to be invited to a video of the broadcast user Ub from among the co-starring candidate users among all users of the video distribution system 1. The invited user is the recipient of an invitation to co-star with the broadcast user Ub.

[0089] The co-starring candidate users may be all or some of the users of the video distribution system 1. The users of the video distribution system 1 have user accounts for the video distribution system 1. The users of the video distribution system 1 use the viewing user device 10 to perform at least one of video distribution and viewing. Some of the users of the video distribution system 1 can only view videos. If the viewing user device 10 used by a user of the video distribution system 1 does not have a function for acquiring motion data for video distribution (for example, a function corresponding to the face motion data generating units 21a1 and 21b1), the user can only view videos in the video distribution system 1. If the viewing user device 10 used by a user of the video distribution system 1 has a function for video distribution, the user can both view and distribute videos in the video distribution system 1. The co-starring candidate users may be, for example, users who can distribute videos among all users of the video distribution system 1. In other words, users who can only view videos among all users of the video distribution system 1 may be excluded from the co-starring candidate users. A viewer user device 10 that does not have a function for video distribution can have the function for video distribution by installing a program for realizing the function required for video distribution. Therefore, a user who can only view may be added to the potential co-starring users. When a user who only views receives an invitation, he or she can apply to co-star after installing the function for video distribution.

[0090] The co-star candidate user may be selected from all users of the video distribution system 1 according to a predetermined screening criterion. As described above, the screening criterion may be whether or not the user is capable of video distribution. In addition, the screening criterion may be whether or not the user is active in the video distribution system 1. Whether or not a user of the video distribution system 1 is active may be evaluated by various indices other than the number of video views, the frequency of video views, the video viewing time, the number of video distributions, the frequency of video distribution, the video distribution time, the number of logins to the video distribution system 1, the frequency of logins to the video distribution system 1, the number of messages sent within the video distribution system 1, and the like. The invited user selection unit 61d may select a user who is active in the video distribution system 1 from all users of the video distribution system 1, and set the user as a co-star candidate user. As a screening criterion for selecting a co-star candidate user, various criteria other than the criteria specifically described in this specification may be applied.

[0091] The invited user selection unit 61d selects one or more invited users from among the co-starring candidate users. The invited user selection unit 61d can select the invited users by using a part or all of the user information 63c. In one embodiment, the invited user selection unit 61d selects one or more invited users from among the co-starring candidate users based on the log information of the distribution user Ub and the log information of each of the co-starring candidate users in the user information 63c.

[0092] In one embodiment of the present invention, the invited user selection unit 61d can use the viewing user information to select an invited user to whom an invitation from the broadcast user Ub is to be sent. Specifically, the invited user selection unit 61d obtains the degree of overlap of the viewing users between the broadcast user Ub and each of the co-star candidate users by comparing the user ID included in the viewing user information of the broadcast user Ub with the user ID included in the viewing user information of each of the co-star candidate users, and selects an invited user based on this overlap. For example, the degree of overlap of the viewing users between the broadcast user Ub and the co-star candidate user A, one of the co-star candidate users, is represented by the degree of overlap between the user ID of the viewing user stored as the viewing user information in association with the user ID of the broadcast user Ub in the user information 63c, and the user ID of the viewing user stored as the viewing user information in association with the user ID of the co-star candidate user A in the user information 63c. More specifically, in the user information 63c, when the user IDs of 1000 viewing users are stored in association with the user ID of the distribution user Ub, and the user IDs of 400 viewing users among them are stored as viewing user information in association with the user ID of the co-star candidate user A, the overlap is 40% (100×(400 / 1000)=40%). Another example is given. In the user information 63c, when the user IDs of 1000 viewing users are stored in association with the user ID of the distribution user Ub, and the user IDs of 50 viewing users among them are stored as viewing user information in association with the user ID of the co-star candidate user B, the overlap is 5% (100×(50 / 1000)=5%). The overlap of viewing users between the distribution user Ub and other co-star candidate users is calculated in the same manner. The invited user selection unit 61d calculates the overlap of viewing users between the distribution user Ub and all co-star candidate users.

[0093] In one embodiment of the present invention, the invited user selection unit 61d obtains the overlapping degree of the viewing user between the distribution user Ub and each of the co-star candidate users as described above, and can determine as an invited user a user among the co-star candidate users whose overlapping degree of the viewing user between the distribution user Ub and the co-star candidate user is smaller than a predetermined threshold. In this specification, the threshold regarding the overlapping degree of the viewing user may be referred to as a "first threshold". The first threshold is, for example, 10%. The first threshold can be changed as appropriate. When the first threshold is 10%, the overlapping degree of the viewing user between the distribution user Ub and the co-star candidate user A is 40%, so the co-star candidate user A is not selected as an invited user, and the overlapping degree of the viewing user between the distribution user Ub and the co-star candidate user B is 5%, so the co-star candidate user B is selected as an invited user. Similarly, for the other co-star candidate users, the overlapping degree of the viewing user between each co-star candidate user and the distribution user Ub is compared with the first threshold to determine whether each co-star candidate user is selected as an invited user. If a co-starring candidate user who has a viewing user overlap degree between the distributor user Ub and the distributor user Ub that is smaller than the first threshold value appears together with the distributor user Ub, the users with a small viewing user overlap degree will appear together.

[0094] The invited user selection unit 61d may select invited users based on the number of overlapping viewing users between the distribution user Ub and each of the co-star candidate users instead of or in addition to the number of overlapping viewing users. The invited user selection unit 61d obtains the number of overlapping viewing users between the distribution user Ub and each of the co-star candidate users by comparing the user ID included in the viewing user information of the distribution user Ub with the user ID included in the viewing user information of each of the co-star candidate users, and selects invited users based on this number of overlapping viewing users. The invited user selection unit 61d obtains the number of overlapping viewing users between the distribution user Ub and each of the co-star candidate users as described above, and can determine as invited users those users among the co-star candidate users whose number of overlapping viewing users between the distribution user Ub and the distribution user Ub is smaller than a predetermined threshold. In this specification, the threshold for the number of overlapping viewing users may be referred to as a "second threshold". The second threshold may be, for example, 100 people. The second threshold may be changed as appropriate. The invited user selection unit 61d can determine, as an invited user, a user for whom at least one of the overlap degree and overlap number of viewing users between the broadcast user Ub is smaller than a predetermined threshold.

[0095] In this way, among the co-starring candidate users, a user who has a smaller overlapping degree or number of viewing users with the distribution user Ub than a predetermined threshold is selected as an invited user. As a result, for the distribution user Ub and the distribution user selected as the invited user (for the distribution user Ub and the co-starring candidate user B in the above example), it becomes possible to reach a viewing user group that could not be reached before the co-starring. For example, in the above example, when the distribution user Ub and the co-starring candidate user B co-star, the co-starring candidate user B will appear in a video distributed by the distribution user Ub, so the co-starring candidate user B can have an opportunity to reach viewing users who watch the videos of the distribution user Ub. For the distribution user Ub, by having the co-starring candidate user B appear in his / her video, it is expected that viewing users who often watch the videos of the co-starring candidate user B will watch the video of the distribution user Ub in which the co-starring candidate user B and the distribution user Ub co-star. In order to encourage viewing users who have viewed videos of co-star candidate user B to view a co-starring video in which distributing user Ub and co-star candidate user B co-star, a notification may be sent to viewing users who have viewed videos of co-star candidate user B informing them that co-star candidate user B will appear in a video of another distributing user (here, distributing user Ub). In this way, by selecting a user who has a low overlap or overlap number with distributing user Ub as an inviting user, there is an advantage that both the distributing user Ub and the invited co-starring candidate user (inviting user) can reach an audience that could not be reached before.

[0096] In another embodiment of the present invention, the invited user selection unit 61d can determine as an invited user a user among the co-star candidate users whose overlapping degree of viewing users with the distribution user Ub is greater than a predetermined threshold. If a co-starring candidate user whose overlapping degree of viewing users with the distribution user Ub is greater than a first threshold will co-star with the distribution user Ub, the users with a high overlapping degree of viewing users will co-star with each other. In this way, by selecting a user with a high overlapping degree or overlapping degree between the distribution user Ub and the co-starring candidate user (invited user) as an invited user, it is advantageous for both the distribution user Ub and the invited co-starring candidate user (invited user) to be able to co-star with someone who has a high commonality of audience members. A co-starring candidate user with a low overlapping degree or overlapping degree between the distribution user Ub and the distribution user Ub may not be well-received by a viewing user who is watching a video of the distribution user Ub. By selecting a user with a high overlapping degree or overlapping degree between the distribution user Ub and the viewing user as an invited user, the distribution user Ub can co-star with someone who is easily accepted by his or her viewing user.

[0097] In another embodiment of the present invention, the invited user selection unit 61d can determine, as an invited user, a user among the co-star candidate users whose overlapping degree of viewing users with the distribution user Ub is within a predetermined range. In other words, the invited user selection unit 61d can determine, as an invited user, a user among the co-star candidate users whose overlapping degree of viewing users with the distribution user Ub is between a lower threshold and an upper threshold. By appropriately setting the lower threshold and the upper threshold, it is possible to avoid determining only users with a moderate overlap in viewing users as invited users, or co-starring only with people whose audience overlap is very small.

[0098] In another embodiment of the present invention, the invited user selection unit 61d can use the co-starring count information to select an invited user to whom an invitation from the broadcast user Ub is to be sent. Specifically, the invited user selection unit 61d obtains a difference between the number of co-starring appearances of the broadcast user Ub and the number of co-starring appearances of each of the co-starring candidate users, and selects an invited user based on this difference in the number of co-starring appearances. For example, the difference between the number of co-starring appearances of the broadcast user Ub and the number of co-starring appearances of the co-starring candidate user A, which is one of the co-starring candidate users, is the difference between the number of co-starring appearances stored as the co-starring count information in association with the user ID of the broadcast user Ub in the user information 63c and the number of co-starring appearances stored as the co-starring count information in association with the user ID of the co-starring candidate user A in the user information 63c.

[0099] In one embodiment of the present invention, the invited user selection unit 61d obtains the difference in the number of times of co-starring between the distribution user Ub and each of the co-starring candidate users as described above, and can determine as an invited user a user among the co-starring candidate users whose difference in the number of times of co-starring with the distribution user Ub is greater than a predetermined threshold. In this specification, the threshold regarding the number of times of co-starring may be referred to as a "third threshold." The third threshold is, for example, 10 times. The third threshold can be changed as appropriate. When the third threshold is 10 times, a co-starring candidate user whose difference in the number of times of co-starring with the distribution user Ub is greater than 10 times is selected as an invited user. If a co-starring candidate user who has a large difference in the number of times of co-starring with the distribution user Ub and the distribution user Ub co-stars, the users who have a large difference in the number of times of co-starring will co-star.

[0100] In this way, among the co-starring candidate users, a user with a large difference in the number of co-starring appearances with respect to the distribution user Ub is selected as the invited user. If the number of co-starring appearances with the distribution user Ub is greater than the number of co-starring appearances with the invited user, the invited user will receive an invitation from a user who is skilled in co-starring in videos, and will be more likely to apply for co-starring in response to the invitation. Conversely, if the number of co-starring appearances with the invited user is greater than the number of co-starring appearances with the distribution user Ub, the distribution user Ub can co-star with a user who is skilled in co-starring in videos.

[0101] In another embodiment of the present invention, the invited user selection unit 61d can use attribute information to select an invited user to whom an invitation from the broadcast user Ub is to be sent. Specifically, the invited user selection unit 61d can compare the attribute information of the broadcast user Ub with the attribute information of each of the co-star candidate users and select an invited user based on the comparison result. For example, a co-star candidate user having at least a part of the information registered as attribute information in common can be selected as an invited user. In this way, by selecting an invited user based on attribute information, a co-star candidate user having a profile with high commonality with the broadcast user Ub can be selected as an invited user. This allows users with high commonality in terms of profile to appear together in a video. By users with high commonality in terms of profile appearing together, it is expected that the conversation between the co-stars in the video will progress smoothly. Conversely, a co-star candidate user having a profile with low commonality with the broadcast user Ub can also be selected as an invited user. This allows users with low commonality in terms of profile to appear together in a video. By users with low commonality in terms of profile appearing together, it is expected that the co-stars will have unexpected and tense exchanges.

[0102] In another embodiment of the present invention, the invited user selection unit 61d can use social information to select an invited user to whom an invitation from the broadcast user Ub is to be sent. Specifically, the invited user selection unit 61d can compare the social information of the broadcast user Ub with the social information of each of the co-star candidate users and select an invited user based on the comparison result. For example, the invited user selection unit 61d can select a co-star candidate user who has a common friend with the broadcast user Ub as an invited user based on the friend information in the social information. The invited user selection unit 61d can select a co-star candidate user who has a predetermined number or more (e.g., 10 or more) of common friends with the broadcast user Ub as an invited user. Conversely, the invited user selection unit 61d can select a co-star candidate user who does not have a common friend with the broadcast user Ub as an invited user. The invited user selection unit 61d can select a co-star candidate user who has a predetermined number of common friends with the broadcast user Ub (e.g., 3 people) or less as an invited user.

[0103] As described above, the invited user selection unit 61d can select an invited user to whom an invitation from the broadcast user Ub is to be sent, using at least one of the viewing user information, the number of times of co-starring information, the attribute information, and the social information. The invited user selection unit 61d can select an invited user by appropriately combining the viewing user information, the number of times of co-starring information, the attribute information, and the social information. For example, the invited user selection unit 61d can use both the viewing user information and the number of times of co-starring information to select as an invited user a co-starring candidate user whose overlapping degree of the viewing users is smaller than a first threshold value and whose difference in the number of times of co-starring is larger than a third threshold value.

[0104] The invited user selection unit 61d may select an invited user when the broadcasting user Ub starts broadcasting a video, or may select an invited user in response to receiving an invitation request from the invitation processing request unit 21b2 of the broadcasting user device 20b.

[0105] The invitation processing unit 61e transmits an invitation to one or more broadcast user devices included in the video distribution system 1 to the inviting user selected by the invited user selection unit 61d based on the invitation request from the invitation request unit 21b2. As described above, this invitation is a notification for inviting other broadcast users to a video distributed by the broadcast user Ub. The invitation request transmitted from the broadcast user device 20b will be further described with reference to FIG. 7. FIG. 7 is a diagram illustrating a window for setting an invitation request displayed on the broadcast user device 20b. On the broadcast user device 20b, a setting window 41 is displayed before or after the start of video distribution. The setting window 41 may be displayed in response to a user operation, or may be displayed at a predetermined timing before or after the start of video distribution without a user operation.

[0106] In the illustrated embodiment, the setting window 41 includes a switch 41a, a stepper 41b, and a password setting area 41c. The switch 41a is a switch for switching whether or not an invitation is to be sent. The switch 41a is switched on or off in response to a user's operation. When the switch 41a is turned on, a setting is changed so that an invitation request is sent to the server device 60. When the switch 41a is turned off, the invitation request is not sent to the server device 60. For example, the invitation request is sent to the server device 60 when the window 41 is closed after the switch 41a is turned on.

[0107] The stepper 41b is an operation unit for increasing or decreasing a numerical value inputted according to a user's operation. In the illustrated embodiment, the stepper 41b can increase or decrease the number of people who can appear together in a video to be distributed or a video currently being distributed. In the example of FIG. 7, 10 people are set as the number of people who can appear together. When "-" is selected in the stepper 41b, the set number decreases from 10 to, for example, 9, and when "+" is selected in the stepper 41b, the set number increases from 10 to, for example, 11. In one embodiment, the number of people who can appear together may mean the upper limit number of users who can appear together at the same time in a video to be distributed. In this embodiment, if the number of people who can appear together is set to 10, 10 users can appear together at the same time in the video through their characters. In another embodiment, the number of people who can appear together at the same time is set to a number smaller than the set upper limit number of the number of people who can appear together (for example, 2 people). In this case, the upper limit number of the number of people who can appear together means the upper limit number of users who can appear together within the distribution time. For example, if the number of people who can appear together in a video at the same time is set to two and the upper limit of the number of people is set to ten, an appearance order is set for the ten guest users, and the guest users appear together with the host user one by one according to this appearance order. The invited user selection unit 61d may increase or decrease the number of invited users to be selected according to the set upper limit of the number of people to appear together. More specifically, the invited user selection unit 61d may adjust the first threshold, the second threshold, the third threshold, and other parameters that affect the number of invited users to be selected according to the set upper limit of the number of people to appear together.

[0108] In the password setting area 41c, a co-starring password to be provided to a guest user who wishes to perform together is set. This co-starring password is, for example, a four-digit numeric string. The broadcast user Ub can perform together only with a specific broadcast user among the broadcast users who use the distribution system 1 by notifying the specific broadcast user of the co-starring password. In other words, the broadcast user Ub can avoid performing together with a broadcast user to whom the co-starring password has not been notified. When notifying only a specific broadcast user of the co-starring password, the broadcast user Ub can specify the specific broadcast user by inputting the user ID of the broadcast user to be notified. There is no particular restriction on the method of specifying the specific broadcast user to whom the co-starring password is to be notified. When password input is not required when applying for co-starring, the password setting area 41c is omitted.

[0109] The invitation request unit 21b2 generates an invitation request based on the settings determined through the setting window 41 and other input interfaces as necessary, and transmits the invitation request to the server device 60. The invitation request also includes the user ID of the broadcast user Ub. The invitation request may include the number of co-stars, a co-star password, and other information required for making the invitation.

[0110] The invitation processing unit 61e generates an invitation based on the invitation request from the invitation request unit 21b2, and transmits the generated invitation to the broadcast user equipment of the invited user selected by the invited user selection unit 61d. If the invitation request includes a co-starring password, the invitation processing unit 61e may notify the invited user of the co-starring password.

[0111] When the invitation processing unit 61e receives an invitation request from the broadcast user Ub, it references the user information 63c stored in the storage 63 and generates host user information for the broadcast user Ub. In one embodiment, the host user information for the broadcast user (broadcast user Ub) who made the invitation request is at least a part of the user evaluation information, video evaluation information, and viewer count information stored in association with the user account information of the broadcast user (broadcast user Ub) in the user information 63c, or is generated based on these pieces of information. In other words, the host user information for the broadcast user who made the invitation request may be at least one of the user evaluation information, video evaluation information, and viewer count information stored in association with the user account information of the broadcast user, or may be a score generated based on these pieces of information. It is preferable that the host user information is an index that can be referenced by the broadcast user who received the invitation to determine whether or not to apply to perform together with the broadcast user Ub, and is preferably an index that represents the profile of the broadcast user Ub as a host user, for example.

[0112] The invitation processing unit 61e can transmit the host user information of the broadcast user Ub to the broadcast user Ua and other broadcast users in association with an invitation to invite the broadcast user Ub to perform together. This allows the broadcast user who receives an invitation from the broadcast user Ub to access the host user information of the broadcast user Ub. In other words, the host user information of the broadcast user Ub is associated with the invitation so that it can be presented to the broadcast user who receives the invitation from the broadcast user Ub. In one embodiment, the host user information is transmitted to the broadcast user as part of the invitation. The host user information may be transmitted to the broadcast user together with the invitation. In another embodiment, the host user information is stored in the server device 60, and the invitation may include a link to the host user information stored in the server device 60.

[0113] Next, referring to FIG. 8, the process in the broadcast user device of the inviting user will be described. In this specification, it is assumed that the broadcast user Ua is selected as the inviting user by the invited user selection unit 61d. FIG. 8 shows an example of the display of an invitation in the broadcast user device 20a of the broadcast user Ua who has received an invitation from the broadcast user Ub. When the invitation presentation unit 21a2 of the broadcast user device 20a receives the invitation from the broadcast user Ub, it displays a window 37 on the display 23a of the broadcast user device 20a as shown in the figure. The window 37 includes a character string "Invited by Ub" indicating that the invitation has been received. This allows the broadcast user Ua to know that the invitation from the broadcast user Ub has been received. In addition to the character string, the window 37 includes a display area 37a, a co-starring application button 37b, and a co-starring decline button 37c.

[0114] The invitation presenter 21a2 displays the host user information of the broadcast user Ub in the display area 37a. As described above, the host user information in one embodiment is an index that represents the profile of the broadcast user Ub as a host user. The host user information may be, for example, viewer number information. If the number of viewers of the video broadcast by the broadcast user Ub is large, the broadcast user Ua may be able to acquire many viewers by performing together with the broadcast user Ub. The host user information may be user evaluation information. High user evaluation information of the broadcast user Ub means that the broadcast user Ub has acquired a high reputation from other users. Therefore, if the user evaluation information of the broadcast user Ub is high, the broadcast user Ua may be able to acquire a high reputation by performing together with the broadcast user Ub. The host user information may be video evaluation information. High video evaluation information of the broadcast user Ub means that the video broadcast by the broadcast user Ub has acquired a high reputation. Therefore, if the video evaluation information of the broadcast user Ub is high, the broadcast user Ua may be able to acquire a high reputation by appearing in the video of the broadcast user Ub.

[0115] The host user information may be a score calculated by a predetermined algorithm based on some or all of the viewer count information, user evaluation information, and video evaluation information. For example, since many broadcast users are considered to aim to acquire more viewing users, the viewer count information may be considered more important to guest users than other information included in the user information. Therefore, a weighted average is calculated for the viewer count information, user evaluation information, and video evaluation information, with more weight given to the viewer count information, and the score represented by this weighted average can be used as the host user information. The method of calculating the score indicating the host user information is not limited to the one explicitly described in this specification.

[0116] As described above, the viewer count information, user evaluation information, and video evaluation information of broadcast user Ub, as well as the score calculated based on this information, can be indicators of broadcast user Ub's profile as a host user or his / her attractiveness as a co-starring partner. By displaying such host user information in display area 37a, it is possible to convey to the inviting user, broadcast user Ua, information that can be referenced when deciding whether or not to co-star with broadcast user Ub who sent the invitation. Broadcast user Ua can decide whether or not to co-star with broadcast user Ub based on the host user information.

[0117] The co-starring application button 37b included in the window 37 is an operation button for transmitting a co-starring application to apply to co-star with the broadcast user Ub in a video that the broadcast user Ub is distributing. The co-starring application is transmitted to the server device 60 by selecting the co-starring application button 37b, and the transmitted co-starring application is accepted by the server device 60. The server device 60 can accept not only the co-starring application from the broadcast user Ua, but also co-starring applications from various broadcast users. If neither the co-starring application button 37b nor the co-starring decline button 37c is selected within a predetermined time after the window 37 is displayed, the window 37 may be erased from the screen. As described above, the video 40a displayed on the broadcast user device 20a may display the co-starring application button 36. Therefore, the window 37 may not include the co-starring application button 37b. If the window 37 does not include the co-starring application button 37b, the broadcast user Ua can select the co-starring application button 36 when applying to co-star with the broadcast user Ub.

[0118] In the illustrated embodiment, the co-starring application button 36 is displayed before the window 37 is displayed. In this case, even before receiving an invitation, the broadcast user Ua can apply to perform with the broadcast user Ub by selecting the co-starring application button 36. In this way, when accepting a co-starring application from a broadcast user who has not received an invitation, an excessive number of co-starring applications may be made. In particular, when the broadcast user Ub is a popular broadcast user, a very large number of co-starring applications may be made. Therefore, in another embodiment of the present invention, the co-starring application button 36 may be displayed only on the broadcast user device of the broadcast user who received the invitation after receiving the invitation. When an invitation is received, the co-starring application button 37b is displayed in the window 37, but the co-starring application button 36 may be displayed in the image 40a after the window 37 disappears from the image. This allows a co-starring application to be accepted only from an invited user who has received an invitation.

[0119] In one embodiment of the present invention, the co-starring application button 36 may be displayed on the image 40a regardless of whether an invitation has been received. In this case, when the co-starring application button 36 is selected, input of a co-starring password may be requested, and a co-starring request may be sent to the server device 60 only if the co-starring password is authenticated. The broadcasting user Ub can control the number of co-starring applications by notifying the co-starring password only to users who approve the co-starring application. The co-starring password may be notified to the user through a messaging function used within the video distribution system 1, a messaging function other than the video distribution system 1 (for example, LINE provided by LINE Corporation), and a channel other than these. In this way, the co-starring password may be sent to a user watching a video distributed by the related user Ub or to other users without being associated with an invitation from the broadcasting user Ub.

[0120] When a co-starring application is received from a certain user (for example, a broadcast user Ua), the co-starring application processing unit 61f determines whether or not to permit the co-starring application of the user. The co-starring application processing unit 61f may determine whether or not to permit the broadcast user Ua and the broadcast user Ub to co-star based on at least a part of the user information of the broadcast user Ua who made the co-starring application. For example, if the user evaluation points of the broadcast user Ua who made the co-starring application are greater than a predetermined threshold, the broadcast user Ua may be permitted to co-star with the broadcast user Ub, and if the user evaluation points are equal to or less than the threshold, the broadcast user Ua may be denied to co-star with the broadcast user Ub. There are no particular limitations on this determination criterion. The invited user selection unit 61d is configured to select a user who is desirable as a co-starring partner of the broadcast user Ub as an invited user, but even if a user who is not desirable as a co-starring partner is selected as an invited user, the co-starring application processing unit 61f determines whether or not to permit co-starring, thereby making it possible to avoid co-starring with an undesirable co-starring partner.

[0121] When the co-starring application from the broadcast user Ua is permitted, the co-starring application processing unit 61f generates a co-starring video in which the broadcast user Ua and the broadcast user Ub appear together based on the co-starring application. In order to generate the co-starring video, the co-starring application processing unit 61f acquires face motion data and voice data of the broadcast user Ua from the broadcast user Ua. The face motion data of the broadcast user Ua may be transmitted from the broadcast user device 20a to the server device 60 together with the co-starring application, or may be transmitted from the broadcast user device 20a to the server device 60 in response to a request from the server device 60 after the co-starring application is permitted. When the body movements of the broadcast user Ua are also expressed as animation, the body motion data may be provided to the server device 60 together with the face motion data of the broadcast user Ua. When the co-starring application processing unit 61f cannot acquire face motion data from the broadcast user Ua, it may acquire only voice data from the broadcast user Ua. For example, if the broadcast user device 20a used by the broadcast user Ua does not have the function of the facial motion data generation unit 21a1 or other functions for video distribution, if the function is disabled, or in other cases, the co-starring request processing unit 61f may acquire audio data from the broadcast user Ua without acquiring facial motion data (and body motion data).

[0122] In one embodiment, the co-starring application processing unit 61f generates a co-starring video by adding animation of the character object of the broadcast user Ua to a video being distributed including the character object 31 of the broadcast user Ub based on the facial motion data of the broadcast user Ua. The animation of the character object of the broadcast user Ua may be generated in the animation generation unit 61a based on the facial motion data of the broadcast user Ua. The animation of the character object of the broadcast user Ua may be generated by applying the facial motion data of the broadcast user Ua to the model data for the broadcast user Ua included in the model data 63a. For example, the co-starring application processing unit 61f can generate a co-starring video including the character object of the broadcast user Ua and the character object 31 of the broadcast user Ub by generating a layer including animation of the character object of the broadcast user Ua and superimposing this layer on a video including the character object 31 of the broadcast user Ub. By generating a co-starring video including the character object of the broadcast user Ua and the character object 31 of the broadcast user Ub, even if the broadcast user Ua and the broadcast user Ub are using the video distribution system 1 from points distant from each other, they can virtually appear together in the co-starring video. When the co-starring application processing unit 61f acquires voice data but not face motion data (and body motion data) from the broadcast user Ua, it can generate a co-starring video including the character object 31 of the broadcast user Ub and the voice of the broadcast user Ua by superimposing a voice generated based on the voice data acquired from the broadcast user Ua on a video including the character object 31 of the broadcast user Ub. Even when model data for the broadcast user Ua is not set as the model data 63a, the co-starring application processing unit 61f can generate a co-starring video including the character object 31 of the broadcast user Ub and the voice of the broadcast user Ua by superimposing a voice generated based on the voice data acquired from the broadcast user Ua on a video including the character object 31 of the broadcast user Ub. In this way, the broadcast user Ua can co-star with the broadcast user Ub using his or her own voice.

[0123] When face motion data cannot be obtained from the broadcast user Ua, the co-starring application processing unit 61f distributes a co-starring video including the voice of the broadcast user Ua and the character object 31 of the broadcast user Ub, and then generates a character object of the broadcast user Ua based on the face motion data of the broadcast user Ua at the timing when the face motion data is obtained from the broadcast user Ua, thereby generating a co-starring video including the character object of the broadcast user Ua and the character object 31 of the broadcast user Ub. In this way, the co-starring application processing unit 61f can switch a co-starring video including the voice of the broadcast user Ua and the character object 31 of the broadcast user Ub to a co-starring video including the character object of the broadcast user Ua and the character object 31 of the broadcast user Ub. Conversely, the co-starring application processing unit 61f can switch a co-starring video including the character object of the broadcast user Ua and the character object 31 of the broadcast user Ub to a co-starring video including the voice of the broadcast user Ua and the character object 31 of the broadcast user Ub. In this way, it may be possible to alternate between a co-starring video in which audio co-starring takes place (sometimes referred to as an "audio co-starring video") and a co-starring video in which character objects co-star (sometimes referred to as a "character co-starring video").

[0124] The generated co-starring video is distributed by the video distribution unit 61c. The co-starring video may be created by the broadcast user device 20a. When the co-starring video is generated by the broadcast user device 20a, the co-starring video is transmitted from the broadcast user device 20a to the server device 60 and distributed by the video distribution unit 61c of the server device 60.

[0125] 9 and 10a to 10b show display examples of the co-starring video distributed from the video distribution unit 61c. In these figures, it is assumed that a co-starring application from the distribution user Ua to the distribution user Ub has been approved, and therefore a co-starring video including the character object 131 of the distribution user Ua and the character object 31 of the distribution user Ub is being distributed.

[0126] As shown in FIG. 9, a co-starring video image 230 distributed from the server device 60 is displayed on the display of the viewing user device 10. The co-starring video image 230 displayed on the viewing user device 10 includes a character object 131 of the broadcasting user Ua in addition to a character object 31 of the broadcasting user Ub. The character object 131 of the broadcasting user Ua is generated in the animation generation unit 61a or the co-starring application processing unit 61f, as described above. The co-starring video image 230 includes a gift button 32, a rating button 33, a comment button 34, and a comment button 35, as in the original distribution image shown in FIG. 5. and a comment display area 35. In addition to these, the image 230 of the co-starring video may include guest rating buttons 133a and 133b. The guest rating button 133a is a button for transmitting positive rating information indicating a positive rating of the guest user (in the illustrated example, the broadcasting user Ua is the guest user) to the server device 60, and the guest rating button 133b is a button for transmitting negative rating information indicating a negative rating of the guest user to the server device 60. When the guest rating button 133a is selected by a viewing user who is watching a video, guest rating information indicating that a positive rating has been made to the guest user is transmitted to the server device 60, and when the guest rating button 133b is selected, guest rating information indicating that a positive rating has been made to the guest user may be transmitted to the server device 60. Although not illustrated, one or more host rating buttons for rating the host user may be displayed together with the co-starring video. When the host rating button is selected by a viewing user who is watching a video, host rating information indicating that a positive or negative rating has been made to the host user (broadcasting user Ub) may be transmitted to the server device 60.

[0127] The image 230 of the co-starring video is a horizontally long image as shown in the figure. The co-starring application processing unit 61f or the video distribution unit 61c may distribute the co-starring video as a horizontally long video. As a result, the image 230 of the co-starring video is displayed as a horizontally long image on the viewing user device 10. In one embodiment, even if the original video (image) is vertically long as shown in FIG. 5, the co-starring video is converted to a horizontally long image and distributed. Since the co-starring video includes character objects of two broadcast users, the horizontally long image makes it easier to display the character objects of two people without overlapping. For example, in the co-starring video, the left half from the viewpoint of the viewing user may be an area assigned to the character object of the original broadcast user (host user), and the right half may be an area assigned to the character object of the broadcast user (guest user) who applied to co-star. The allocation of areas to each broadcast user may be determined arbitrarily so that the character objects do not overlap with each other.

[0128] As shown in Fig. 10a, a co-starring video image 330 distributed from the server device 60 is displayed on the broadcasting user device 20a of the broadcasting user Ua. The co-starring video image 330 displayed on this broadcasting user device 20a contains the same background image, character object image, and comment as the co-starring video image 230 displayed on the viewing user device 10. On the other hand, the co-starring video image 330 differs from the image 230 in that it does not include the gift button 32, the rating button 33, the comment button 34, or the co-starring application button 36, but includes display instruction buttons 42a to 42c.

[0129] As shown in FIG. 10b, the display of the broadcast user device 20b displays an image 430 of the co-starring video broadcast from the server device 60. The image 430 of the co-starring video displayed on the broadcast user device 20b includes the same background image, character objects 31, 131, comment 35, and display instruction buttons 42a to 42c as the image 330 displayed on the broadcast user device 20a of the broadcast user Ua, who is the co-starring partner. On the other hand, the image 430 displays an end co-starring button 45 for ending the co-starring. In one embodiment, the end co-starring button 45 may be displayed not only on the image 430 of the co-starring video on the broadcast user device 20b of the broadcast user Ub who received the co-starring request, but also on the image 330 of the co-starring video on the broadcast user device 20b of the broadcast user Ua who made the co-starring request. When the end co-starring button 45 is selected, a process is performed to end the co-starring with the broadcast user Ua in the co-starring video. For example, in response to the end co-starring button 45 being selected on the broadcast user device 20b, a co-starring end instruction is transmitted from the broadcast user device 20b to the server device 60. The broadcast user Ub can set the broadcast user Ua, who is a guest user, as a broadcast user prohibited from appearing while playing the co-starring video. For example, when the broadcast user Ua performs undesirable actions or behavior in the co-starring video, the broadcast user Ua can be set as a broadcast user prohibited from appearing. Setting the broadcast user Ua as a broadcast user prohibited from appearing may be performed by recording the user ID of the broadcast user Ub in the appearance prohibition information of the user information of the broadcast user Ua. For example, when the server device 60 receives a co-starring end instruction from the broadcast user device 20b, the server device 60 can automatically register the broadcast user Ua as a broadcast user prohibited from appearing in the user information of the broadcast user Ub. The broadcast user Ub may set the broadcast user Ua as a broadcast user prohibited from appearing other than when playing the co-starring video. For example, the broadcast user Ua may be set as a broadcast user prohibited from appearing in response to confirming that the broadcast user Ua has posted an undesirable message in the messaging service provided by the video distribution system 1.Conversely to the above example, when the broadcast user Ub behaves or speaks in an undesirable manner, the host user may be set as a co-starring prohibited user in response to the selection of the co-starring end button 45 on the broadcast user device 20a.

[0130] A warning button (not shown) for giving a warning to the guest user may be displayed in the image 430 of the co-starring video on the broadcast user device 20b of the broadcast user Ub, who is the host user. This warning button may be displayed in the image 330 of the co-starring video on the broadcast user device 20a of the guest user Ua. Unlike the co-starring end button 45, the warning button does not immediately end the co-starring, but is assumed to be selected when the guest user takes an undesirable action for the host user, or when the host user takes an undesirable action by the guest user. When the warning button is selected on the broadcast user device of the host user (e.g., the broadcast user device 20b of the broadcast user Ub), a warning instruction is transmitted from the broadcast user device 20b to the server device 60. When the warning button is selected on the broadcast user device of the host user, warning information indicating that a warning has been issued by the host user may be displayed on the image 330 of the co-starring video displayed on the broadcast user device of the guest user (e.g., the broadcast user device 20a of the broadcast user Ua). The warning information may be displayed on the image 230 on the viewing user device 10. The co-starring video including the warning information may be generated in the server device 60. By displaying the warning information on the image 230 of the viewing user, it is possible to show the viewing user that the host user is responding to the undesirable behavior of the guest user. The server device 60 may count the number of times a warning instruction is issued from a certain host user to a certain guest user, and perform processing to end the co-starring between the host user and the guest user when the number of warning instructions reaches a predetermined number (e.g., three times). The processing to end the co-starring based on the warning instructions issued a predetermined number of times or more may be the same processing as the processing to end the co-starring based on the above-mentioned co-starring end instruction.

[0131] The co-starring application processing unit 61f may issue a video ID for identifying the created co-starring video. The co-starring video information on the co-starring video may be stored in the storage 63 in association with the video ID. As described above, the co-starring time information of the co-starring video may be updated in association with the video ID of the co-starring video being distributed. The video distribution unit 61c may monitor the distribution time of the co-starring video and update the information based on the monitoring result.

[0132] The guest user evaluation information in the co-starring video information may be updated based on positive evaluation information indicating a positive evaluation of the guest user, the broadcast user Ua, from the viewing user device 10 and negative evaluation information indicating a negative evaluation of the broadcast user Ua. For example, the server device 60 may increase the guest user evaluation points when it receives positive evaluation information indicating a positive evaluation of the broadcast user Ua from the viewing user device 10, and may decrease the guest user evaluation points when it receives negative evaluation information indicating a negative evaluation of the broadcast user Ua. If a viewing user stops watching a co-starring video midway, the viewing user may not be satisfied with the co-starring video. Therefore, if a viewing user stops watching a co-starring video midway, the guest user evaluation points of the guest user may be decreased as a result of a negative evaluation of the guest user. At least one of the positive evaluation information and the negative evaluation information may be updated to decrease over time. For example, even if a broadcast user Ua has positive evaluation information of 100 points at a certain time, the positive evaluation information may be updated to approach zero over time. If the negative evaluation information for a certain user exceeds a predetermined value, the user may be prohibited from co-starring with other users. For example, processing may be performed so that the co-starring request button 36 is not displayed in images displayed on the broadcast user device of a user whose negative evaluation information exceeds a predetermined value.

[0133] When a co-starring end condition for ending the co-starring between the guest user Ua and the host user Ub is met, the co-starring end processing unit 61g performs processing to end the co-starring between the guest user Ua and the host user Ub. In one embodiment, when the co-starring end processing unit 61g receives a co-starring end instruction from the host user device 20b of the host user Ub, it determines that the co-starring end condition is met and performs processing to end the distribution of the co-starring video. For example, when the co-starring end processing unit 61g receives a co-starring end instruction, it stops generating the animation of the character object 131 of the broadcast user Ua and generates a video that does not include the character object 131 of the broadcast user Ua and includes the character object 31 of the broadcast user Ub. In other words, it excludes the character object 131 of the guest user Ua from the video to be distributed. By excluding the character object 131 of the guest user Ua, the co-starring between the broadcast user Ua and the broadcast user Ub ends. After the co-starring ends, the distribution of the video including the character object 31 but not the character object 131 may continue. The video distributed after the co-starring ends may be generated as a vertically long video as shown in FIG. 5. That is, the orientation of the video may be changed in response to the end of the co-starring. In one embodiment, the orientation of the video may be changed from landscape to portrait in response to the end of the co-starring. In another embodiment, the distribution of the video by the distribution user Ub, who is the host user, may be ended in response to the end of the co-starring. In one embodiment, if a co-starring application from another user has already been received when the co-starring with the distribution user Ub ends, the co-starring application processing unit 61f may determine whether or not the other user can co-star based on the co-starring application.

[0134] In one embodiment, the co-starring end processing unit 61g determines whether the character object 131 of the broadcast user Ua, who is a guest user, is in a non-active state, and when it is determined that the character object 131 is in a non-active state, it determines that the co-starring end condition is satisfied. In one embodiment, whether the character object 131 of the broadcast user Ua is in a non-active state is determined based on at least one of face motion data, body motion data, and voice data received from the broadcast user device 20a of the broadcast user Ua. Since the face motion data, body motion data, and voice data are all data indicating the movement of the broadcast user, they may be collectively referred to as "motion data" in this specification. Whether the character object 131 of the broadcast user Ua is in a non-active state is determined based on the motion data, that is, based on at least one of the face motion data, body motion data, and voice data. For example, if there is no input of face motion data from the broadcast user device 20a of the broadcast user Ua for a certain period of time, the facial expression of the character object 131 of the broadcast user Ua in the co-starring video will not move for that certain period of time, so that the character object 131 may be determined to be in a non-active state. When there is no input of body motion data from the broadcast user device 20a of the broadcast user Ua for a certain period of time, the body movement of the character object 131 of the broadcast user Ua in the co-starring video becomes stationary for the certain period of time, and therefore the character object 131 may be determined to be in an inactive state. When there is no input of voice data from the broadcast user device 20a of the broadcast user Ua for a certain period of time, the character object 131 of the broadcast user Ua becomes silent for the certain period of time in the co-starring video, and therefore the character object 131 may be determined to be in an inactive state.

[0135] In one embodiment, the co-starring end processing unit 61g ends the co-starring by excluding the character object 131 of the broadcast user Ua, who is a guest user, from the video in accordance with the co-starring video information of the co-starring video being distributed. For example, when the guest user evaluation information is a guest user evaluation point, the co-starring end processing unit 61g can end the co-starring with the broadcast user Ua by excluding the character object 131 of the broadcast user Ua from the video when the guest user evaluation point becomes smaller than a predetermined threshold value. The more negative evaluation information is received from the viewing user about the broadcast user Ua, who is a guest user, the smaller the guest user evaluation point becomes. Therefore, by determining whether or not to end the co-starring with the broadcast user Ua based on the guest user evaluation point, it is possible to avoid long-term co-starring with a user who is poorly rated by the viewing user.

[0136] Next, a video distribution process according to one aspect will be described with reference to Fig. 11. Fig. 11 is a flow diagram showing the flow of the video distribution process in one embodiment. In the video distribution process described with reference to Fig. 11, it is assumed that a video of the broadcast user Ub is distributed from the server device 60. In other words, it is assumed that a video generated based on face motion data of the broadcast user Ub acquired using the broadcast user device 20b is distributed from the server device 60.

[0137] First, in step S11, face motion data, which is a digital representation of the facial movement (expression) of the broadcast user Ub, is generated. The generation of the face motion data is performed, for example, by the face motion data generator 121b of the broadcast user device 20b. In the broadcast user device 20b, voice data may be generated based on voice input from the broadcast users Ua and Ub. The generated face motion data and voice data are transmitted to the server device 60.

[0138] Next, in step S12, the facial motion data from the broadcast user device 20b is applied to the model data for the broadcast user Ub, thereby generating an animation of the character object 31 that moves in synchronization with the facial movement of the broadcast user Ub. The generation of this animation is performed, for example, by the animation generation unit 61a described above.

[0139] Next, in step S13, a moving image including an animation of the character object 31 of the broadcast user Ub is generated. The voice of the broadcast user Ub may be synthesized into this moving image. The animation of the character object 31 is displayed superimposed on a background image. The generation of this moving image is performed, for example, by the above-mentioned moving image generating unit 61b.

[0140] Next, the process proceeds to step S14, where the video generated in step S13 is distributed. This video is distributed to the viewer user device 10, other viewer user devices, and distributor user devices via the network 50. When the distributed video is played on the viewer user device 10, for example, an image of the video as shown in FIG. 5 is displayed on the viewer user device 10. The video is continuously distributed for a predetermined distribution period. The distribution period of the video can be set to, for example, 30 seconds, 1 minute, 5 minutes, 10 minutes, 30 minutes, 60 minutes, 120 minutes, or any other time. The video is distributed, for example, by the above-mentioned video distribution unit 61c.

[0141] Next, the process proceeds to step S15, where it is determined whether or not a termination condition for ending the distribution of the video has been met. The termination condition may be, for example, that the end time of the distribution has been reached, that the broadcast user Ub has performed an operation to end the distribution on the broadcast user device 20b, or other conditions. If the termination condition has not been met, the processes of steps S11 to S14 are repeatedly executed, and the distribution of the video including animation synchronized with the movements of the broadcast user Ub, or the co-starring video if the co-starring with the broadcast user Ua is continuing, is continued. If it is determined that the termination condition has been met for the video, the distribution process of the video is terminated.

[0142] Next, referring to Fig. 12, a process of presenting an invitation to an inviting user in one embodiment will be described. Fig. 12 is a flow diagram showing a process flow in which a broadcast user who is broadcasting a video invites another broadcast user to co-star in the video in one embodiment. In the broadcast process of a co-starring video described with reference to Fig. 12, it is assumed that a broadcast user Ub invites a broadcast user Ua who is watching a video including a character object of the broadcast user Ub to co-star. The invitation process to co-star may be performed in parallel with the broadcast process of the video shown in Fig. 11, or may be performed before the start of the broadcast process of the video shown in Fig. 11.

[0143] First, in step S21, before or during the start of distribution of a video including a character object of broadcast user Ub, an invitation request is transmitted to server device 60. The invitation request is transmitted from broadcast user device 20b to server device 60 in response to an operation by broadcast user Ub. The process of transmitting the invitation request is performed, for example, by invitation request unit 21b2.

[0144] Next, in step S22, one or more invited users are selected. The invited users are selected from among the co-star candidate users based on the log information of the distribution user Ub and the log information of each of the co-star candidate users. The invited users may be selected using at least one of the viewing user information, the number of times of co-starring information, attribute information, and social information. The invited users are selected, for example, by the invited user selection unit 61d described above. Step S22 for selecting the invited users may be performed before step S21.

[0145] Next, in step S23, an invitation to co-star in a video of broadcast user Ub is transmitted to one or more broadcast user devices including the broadcast user device 20a of broadcast user Ua. Furthermore, in association with this invitation, host user information of broadcast user Ub is transmitted. The host user information of broadcast user Ub is generated based on an invitation request from broadcast user Ub. As described above, the host user information is generated by referring to at least one of the user information 63c and the co-starring video information 63d stored in the storage 63. The host user information generation process is performed, for example, by the invitation processing unit 61e described above. The invitation and host user information transmission process is performed, for example, by the invitation processing unit 61e described above.

[0146] Next, in step S24, the invitation is received by the broadcast user device 20a of the broadcast user Ua. The broadcast user device 20a displays the character string "Invited by Ub," indicating that the invitation was received from the broadcast user Ub, and the host user information of the broadcast user Ub. As described above, the host user information is information generated based on the user information 63c, and is preferably an index representing the attractiveness of the broadcast user Ub as a co-starring partner. The display of the host user information is performed, for example, by the invitation presenter 21a2 described above. The broadcast user Ua can decide whether or not to make a co-starring application based on the host user information of the broadcast user Ub displayed on the broadcast user device 20a. The broadcast user Ua can make a co-starring application by selecting the co-starring application button 37b displayed on the broadcast user device 20a together with the host user information.

[0147] When a co-starring application is made, a co-starring video distribution process is then performed. The co-starring video distribution process in one embodiment will be described with reference to FIG. 13. FIG. 13 is a flow diagram showing the flow of a process for distributing a co-starring video in one embodiment. In the co-starring video distribution process described with reference to FIG. 13, it is assumed that a co-starring application is made to the broadcast user Ub by the broadcast user Ua who is watching a video including the character object of the broadcast user Ub. The co-starring video distribution process is performed in parallel with the video distribution process shown in FIG. 11.

[0148] First, in step S31, it is determined whether or not a co-starring request has been made from a user other than the broadcast user Ub during the broadcast of a video including a character object of the broadcast user Ub. The co-starring request is made, for example, from the broadcast user Ua. As described above, the broadcast user Ua can make a co-starring request by selecting the co-starring request button 37b displayed on the broadcast user device 20a after receiving the invitation. The co-starring request may also be made by selecting the co-starring request button 36. When a co-starring request has been made by the broadcast user Ua, the process proceeds to step S32. A co-starring request may also be made from one or more broadcast users other than the broadcast user Ua.

[0149] In step S32, guest users who will appear in the video of the distribution user Ub are selected from among the users who have applied to appear together. The guest users selected may be one or more. If an upper limit is set on the number of people who can appear together, guest users are selected until this upper limit is reached.

[0150] In step S32, if broadcast user Ua is selected as the guest user, the process proceeds to step S33. In step S33, animation of broadcast user Ua's character object 131 is generated based on the face motion data of broadcast user Ua. Then, a co-starring video is generated by adding animation of broadcast user Ua's character object 131 to the video being distributed (video including broadcast user Ub's character object 31). The process in step S33 is performed, for example, by the above-mentioned co-starring application processing unit 61f.

[0151] Next, the process proceeds to step S34. In step S34, the co-starring video generated in step S33 is distributed. This co-starring video is distributed to the viewing user device 10 and other viewing user devices and broadcasting user devices via the network 50. The co-starring video includes, for example, an animation of the character object 131 of the broadcasting user Ua and an animation of the character object 31 of the broadcasting user Ub, as shown in Figs. 9 and 10a to 10b.

[0152] Next, the process proceeds to step S35. In step S35, it is determined whether the co-starring end condition is satisfied. For example, when the character object 131 of the guest user, broadcast user Ua, is in a non-active state, when the guest user evaluation point becomes equal to or less than a predetermined threshold, when a co-starring end instruction is received from the host user, broadcast user Ub, when a co-starring end instruction is received from the guest user, broadcast user Ua, when a predetermined time or more has passed since the start of distribution of the co-starring video, or when a condition for ending the co-starring other than these is satisfied, it is determined that the co-starring end condition is satisfied. When the co-starring end condition is satisfied, the process proceeds to step S36.

[0153] In step S36, processing is performed to end the distribution of the co-starring video. For example, the character object 131 of the broadcast user Ua, who is a guest user, is removed from the co-starring video, thereby ending the co-starring between the broadcast user Ua and the broadcast user Ub. Even if the co-starring ends, the video may be continuously distributed. The video distributed after the co-starring ends does not include the character object 131 of the broadcast user Ua. The above-mentioned determination of the co-starring end condition and the co-starring end processing are performed, for example, by the co-starring end processing unit 61g.

[0154] Next, an example of the effect of the above embodiment will be described. According to the above embodiment, the broadcast user Ub who will be the host user and one or more invited users who will be candidates for co-starring partners are selected, and an invitation to perform together with the broadcast user Ub is sent to the selected invited user, so that the host user can actively start the process for performing together. The invited user is selected based on the log information of the broadcast user Ub and the log information of the candidate users for performing together. Therefore, the invited user can be selected based on the usage history of the video distribution system 1. This makes it possible to invite a user who is appropriate as a co-starring partner from the aspect of the usage history of the video distribution system 1 to perform together.

[0155] According to the above embodiment, the invited users are selected based on the viewing user information of the distribution user Ub and the viewing user information of the co-starring candidate users, so the invited users are selected taking into consideration the differences in the viewing user demographics of each user.

[0156] According to the above embodiment, a co-starring candidate user having a small overlapping degree or overlap number of viewers in relation to the distribution user Ub is selected as an invited user. This can promote co-starring between users who have different viewing users. For the distribution user Ub, this provides an opportunity to reach a viewing user demographic that could not be reached before the co-starring.

[0157] According to the above embodiment, the invited user is selected based on the information on the number of times of co-starring of the distribution user Ub and the information on the number of times of co-starring of the candidate user, so that the invited user is selected taking into consideration the difference in the number of times of co-starring of each user. In one embodiment, the co-starring candidate user with a large difference in the number of times of co-starring in relation to the distribution user Ub is selected as the invited user. If the number of times of co-starring of the distribution user Ub is greater than the number of times of co-starring of the invited user, the invited invited user will receive an invitation from a host user who is skilled in the distribution of co-starring videos. This makes it easier for the invited user to apply for co-starring in response to the invitation, even if the invited user is not skilled in using the co-starring function. This promotes the use of the co-starring function in the video distribution system 1. If the number of times of co-starring of the distribution user Ub is less than the number of times of co-starring of the invited user, the distribution user Ub can send an invitation to the invited user who is skilled in the distribution of co-starring videos. This promotes the use of the co-starring function in the video distribution system 1.

[0158] According to the above embodiment, it is possible to select an appropriate invited user as a co-starring partner by taking into consideration the similarities or differences between the profiles of the broadcast user Ub and the co-starring candidate user. For example, it is possible to select a co-starring candidate user who has many profile items in common with the broadcast user Ub as the invited user.

[0159] According to the embodiment described above, it is possible to select an appropriate invited user as a co-starring partner by taking into consideration the similarities or differences in social information between the broadcast user Ub and the co-starring candidate user. For example, it is possible to select a co-starring candidate user who has many common friends with the broadcast user Ub as the invited user.

[0160] In the video distribution system 1 according to the embodiment described above, the broadcast users Ua and Ub can distribute videos including character objects that move according to their facial expressions using a broadcast user device 20 equipped with a camera such as a smartphone. In this way, in the video distribution system 1, the equipment for the broadcast users Ua and Ub to distribute videos is simplified, and a platform that is easy for the broadcast users Ua and Ub to participate in is realized.

[0161] In the processing procedures described in this specification, particularly in the processing procedures described using flow diagrams, it is possible to omit some of the steps that make up the processing procedures, to add steps that are not explicitly stated as steps that make up the processing procedures, and / or to change the order of the steps, and processing procedures in which such omissions, additions, or changes in order have been made are also included within the scope of the present invention as long as they do not deviate from the spirit of the present invention.

[0162] At least a part of the functions realized by the computer processor 61 may be realized by a computer processor other than the computer processor 61 of the video distribution system 1. At least a part of the functions realized by the computer processor 61 may be realized, for example, by the computer processor 21 of the broadcasting user device 20, or by a computer processor of the viewing user device 10. Specifically, some or all of the functions of the animation generation unit 61a and the video generation unit 61b may be executed in the broadcasting user device 20. For example, a video generated in the broadcasting user device 20 may be transmitted to the server device 60 and distributed from the server device 60 to the viewing user device 10.

[0163] When a broadcast user Ua who is watching a video including a character object 31 of broadcast user Ub makes a request to co-star with broadcast user Ub, the animation of the character object 131 of the broadcast user Ua who made the request to co-star may be generated by any of the server device 60, the broadcast user device 20a of the broadcast user Ua, the broadcast user device 20b of the broadcast user Ub, or the viewing user device 10. Furthermore, the generation of a co-starring video including the generated character object 131 of the broadcast user Ua and the broadcast video and character object 31 of the broadcast user Ub may be performed by any of the server device 60, the broadcast user device 20a of the broadcast user Ua, the broadcast user device 20b of the broadcast user Ub, or the viewing user device 10. The co-starring video may be generated by sharing among the server device 60, the broadcast user device 20a, the broadcast user device 20b, the viewing user device 10, and devices other than these. In one example, when animation of the character object 131 of broadcast user Ua is generated in the broadcast user device 20b of broadcast user Ub, facial motion data and voice data of broadcast user Ua are transmitted from the broadcast user device 20a of broadcast user Ua to the broadcast user device 20b of broadcast user Ub. When a gift object is included in the co-starring video, data for displaying the gift object may be transmitted from the broadcast user device 20a or the server device 60 to the broadcast user device 20b. In the broadcast user device 20b, animation of the character object 131 is generated by applying the facial motion data and voice data of broadcast user Ua received from the broadcast user device 20a to model data for broadcast user Ua. This model data for broadcast user Ua may be transmitted from the server device 60 to the broadcast user device 20a. In another example, when animation of the character object 131 of the broadcast user Ua is generated in the viewing user device 10, facial motion data and voice data of the broadcast user Ua are transmitted from the broadcast user device 20a of the broadcast user Ua to the viewing user device 10, and facial motion data and voice data of the broadcast user Ub are transmitted from the broadcast user device 20b of the broadcast user Ub to the viewing user device 10.In the viewing user device 10, animation of the character object 131 may be generated by applying the facial motion data and voice data of the broadcast user Ua received from the broadcast user device 20a to the model data for the broadcast user Ua, and animation of the character object 31 may be generated by applying the facial motion data and voice data of the broadcast user Ub received from the broadcast user device 20b to the model data for the broadcast user Ub. This model data for the broadcast user Ua and the model data for the broadcast user Ub may be transmitted from the server device 60 to the viewing user device 10. When a gift object is included in the co-starring video, data for displaying the gift object may be transmitted from the broadcast user device 20a, the broadcast user device 20b, or the server device 60 to the viewing user device 10. In this way, animation of the broadcast user's character object and / or co-starring video including animation of the character object may be generated by any device included in the video distribution system 1. Animation of the character object may be generated by a device not explicitly shown in FIG. 1. To the device generating the animation of the character object, facial motion data and voice data of broadcast user Ua are transmitted from broadcast user device 20a of broadcast user Ua, and facial motion data and voice data of broadcast user Ub are transmitted from broadcast user device 20b of broadcast user Ub. Body motion may be transmitted in addition to facial motion.

[0164] A co-starring video may include character objects of three or more broadcast users. In other words, three or more broadcast users may virtually appear together in a video using their respective character objects. An upper limit may be set for the number of broadcast users who can appear together. When the upper limit is reached in the number of broadcast users who can appear together, a process may be performed in which the co-starring request button 36 is not displayed in the image of the video the broadcast user is watching (e.g., image 40a), or a process may be performed in which the co-starring request button 36 is not selectable in the image of the video the broadcast user is watching (disable process).

[0165] The inventions described in the claims of the original application of this application are set forth below. [1] A video distribution system for distributing videos, comprising: one or more computer processors; a storage that stores log information regarding a usage history of the video distribution system for each of a plurality of users of the video distribution system; Equipped with The one or more computer processors execute the computer readable instructions to: selecting one or more inviting users from among the plurality of co-starring candidate users based on the log information of each of a first user among the plurality of users and a plurality of co-starring candidate users other than the first user; sending an invitation to the one or more invited users; generating a co-starring video in which the first user and the second user appear together in response to receiving a co-starring application from a second user among the one or more invited users to request a co-starring with the first user; Distribute the above-mentioned collaboration video; Video distribution system. [2] The log information of each of the plurality of users includes viewing user information regarding a viewing user who viewed each of the videos of the plurality of users. [1] A video distribution system according to the present invention. [3] determining an overlapping degree of the viewing users between the first user and each of the plurality of co-starring candidate users based on the viewing user information; selecting the one or more invited users based on the overlap degree; [2] A video distribution system according to the present invention. [4] selecting, from among the plurality of co-starring candidate users, a user whose overlap degree is smaller than a first threshold value as the one or more inviting users; [3] A video distribution system according to the present invention. [5] calculating an overlapping number of the viewing users between the first user and each of the plurality of co-starring candidate users based on the viewing user information; selecting the one or more invited users based on the overlap number; [2] A video distribution system according to the present invention. [6] selecting, from among the plurality of co-starring candidate users, a user whose overlapping number is smaller than a second threshold, as the one or more inviting users; [5] A video distribution system according to the present invention. [7] The log information of each of the plurality of users includes co-starring frequency information indicating the number of times the user has co-starred with another user. A video distribution system according to any one of claims [1] to [6]. [8] calculating a difference in the number of times of co-starring between the first user and each of the plurality of co-starring candidate users based on the information on the number of times of co-starring; selecting the one or more inviting users based on the difference in the number of times of co-starring; [7] A video distribution system according to the present invention. [9] selecting, from among the plurality of co-starring candidate users, a user with a difference in the number of co-starring counts that is greater than a third threshold, as the one or more invited users; [8] A video distribution system according to the present invention.

[10] selecting, from among the plurality of candidate co-starring users, a user having a smaller number of co-starring times than the first user as the one or more invited users; [8] or [9]. A video distribution system according to the present invention.

[11] selecting, from among the plurality of candidate co-starring users, a user with a greater number of co-starring times than the first user as the one or more invited users; [8] or [9]. A video distribution system according to the present invention.

[12] the storage stores attribute information of each of the plurality of users; The one or more inviting users are selected from the plurality of co-starring candidate users further based on the attribute information of the first user and each of the plurality of co-starring candidate users. A video distribution system according to any one of claims [1] to

[11] .

[13] The storage stores social information indicating relationships of each of the plurality of users with other users; The one or more inviting users are selected from the plurality of co-starring candidate users further based on the social information of the first user and each of the plurality of co-starring candidate users. A video distribution system according to any one of claims [1] to

[12] .

[14] 1. A method for streaming video that is executed by one or more computer processors executing computer-readable instructions, comprising: storing log information regarding a usage history of the video distribution system for each of a plurality of users of the video distribution system; selecting one or more invited users from among the plurality of co-starring candidate users based on the log information of each of a first user among the plurality of users and a plurality of co-starring candidate users other than the first user; sending an invitation to the one or more invited users; generating a co-starring video in which the first user and the second user appear together in response to receiving a co-starring application from a second user among the one or more invited users to request a co-starring with the first user; A step of distributing the co-starring video; A video distribution method comprising:

[15] one or more computer processors, storing log information regarding a usage history of the video distribution system for each of a plurality of users of the video distribution system; selecting one or more invited users from among the plurality of co-starring candidate users based on the log information of each of a first user among the plurality of users and a plurality of co-starring candidate users other than the first user; sending an invitation to the one or more invited users; generating a co-starring video in which the first user and the second user appear together in response to receiving a co-starring application from a second user among the one or more invited users to request a co-starring with the first user; A step of distributing the co-starring video; A video distribution program that executes the following. [Explanation of symbols]

[0166] 1. Video distribution system 10 Viewing User Device 20a, 20b Distribution user device 21a1, 21b1 Facial motion data generation unit 21a2 Invitation presentation section 21a3 Joint Application Section 21b2 Invitation request section 60 Server equipment 61a Animation Generation Section 61b Video Generation Unit 61c Video Distribution Department 61d Invited User Selection Division 61e Invitation Processing Unit 61f Joint Applicant Processing Unit 61g Collaboration end processing section 63 Storage

Claims

1. A video distribution system for distributing videos, comprising: one or more computer processors; a storage that stores log information regarding a usage history of the video distribution system for each of a plurality of users of the video distribution system; Equipped with The one or more computer processors execute the computer readable instructions to: selecting one or more inviting users to which an invitation will be sent from among the plurality of co-starring candidate users based on the log information of each of a first user among the plurality of users and a plurality of co-starring candidate users other than the first user; generating a co-starring video in which the first user and the second user appear together in response to receiving a co-starring application from a second user among the one or more invited users to request a co-starring with the first user; Distribute the above-mentioned collaboration video; Video distribution system.

2. The one or more inviting users are selected based on a comparison between the log information of the first user and the log information of each of the plurality of potential co-starring users. The video distribution system according to claim 1 .

3. the plurality of potential co-star users are selected from among the plurality of users based on the level of activity of each of the plurality of users in the video distribution system; 3. The video distribution system according to claim 1 or 2.

4. The log information of each of the plurality of users includes viewing user information regarding a viewing user who viewed each of the videos of the plurality of users. The video distribution system according to claim 2 or 3.

5. determining an overlapping degree of the viewing users between the first user and each of the plurality of co-starring candidate users based on the viewing user information; selecting the one or more invited users based on the overlap degree; The video distribution system according to claim 4.

6. selecting, from among the plurality of co-starring candidate users, a user whose overlap degree is smaller than a first threshold value as the one or more inviting users; The video distribution system according to claim 5 .

7. calculating an overlapping number of the viewing users between the first user and each of the plurality of co-starring candidate users based on the viewing user information; selecting the one or more invited users based on the overlap number; The video distribution system according to claim 4.

8. selecting, from among the plurality of co-starring candidate users, a user whose overlapping number is smaller than a second threshold, as the one or more inviting users; The video distribution system according to claim 7.

9. The log information of each of the plurality of users includes co-starring frequency information indicating the number of times the user has co-starred with another user. The video distribution system according to claim 2 or 3.

10. determining a difference in the number of times of co-starring between the first user and each of the plurality of co-starring candidate users based on the information on the number of times of co-starring; selecting the one or more inviting users based on the difference in the number of times of co-starring; The video distribution system according to claim 9.

11. selecting, from among the plurality of co-starring candidate users, a user with a difference in the number of co-starring counts that is greater than a third threshold, as the one or more invited users; The video distribution system according to claim 10.

12. selecting, from among the plurality of candidate co-starring users, a user having a smaller number of co-starring times than the first user as the one or more invited users; The video distribution system according to claim 10 or 11.

13. selecting, from among the plurality of candidate co-starring users, a user with a greater number of co-starring times than the first user as the one or more invited users; The video distribution system according to claim 10 or 11.

14. the storage stores attribute information of each of the plurality of users; The one or more inviting users are selected from the plurality of co-starring candidate users further based on the attribute information of the first user and each of the plurality of co-starring candidate users. The video distribution system according to claim 2 or 3.

15. The storage stores social information indicating relationships of each of the plurality of users with other users; The one or more inviting users are selected from the plurality of co-starring candidate users based further on the social information of the first user and each of the plurality of co-starring candidate users. The video distribution system according to claim 2 or 3.

16. selecting the one or more inviting users in response to receiving a transmission request for requesting transmission of the invitation from the first user; 3. The video distribution system according to claim 1 or 2.

17. the invitation is included in the video and sent to the one or more invited users; 3. The video distribution system according to claim 1 or 2.

18. 1. A method for streaming video that is executed by one or more computer processors executing computer-readable instructions, comprising: storing log information regarding a usage history of the video distribution system for each of a plurality of users of the video distribution system; selecting one or more inviting users to whom an invitation will be sent from among the plurality of co-starring candidate users based on the log information of each of a first user among the plurality of users and a plurality of co-starring candidate users other than the first user; generating a co-starring video in which the first user and the second user appear together in response to receiving a co-starring application from a second user among the one or more invited users to request a co-starring with the first user; A step of distributing the co-starring video; A video distribution method comprising:

19. one or more computer processors, storing log information regarding a usage history of the video distribution system for each of a plurality of users of the video distribution system; selecting one or more inviting users to whom an invitation will be sent from among the plurality of co-starring candidate users based on the log information of each of a first user among the plurality of users and a plurality of co-starring candidate users other than the first user; generating a co-starring video in which the first user and the second user appear together in response to receiving a co-starring application from a second user among the one or more invited users to request a co-starring with the first user; A step of distributing the co-starring video; A video distribution program that executes the following.

Citation Information

Patent Citations

  • Event management system and method

    JP2007241929A

  • Information processing apparatus, information processing method, program, and information processing system

    JP2014006842A

  • Moving image generation device and program

    JP2015184689A

  • Recommending additional users to events using social networking systems

    JP2015531107A

  • JPP6550522B