A system, a method and a program for distributing moving images including animations of character objects generated based on the movements of actors

Abstract

To provide a video distribution server which prevents a browsing user who requests the display of an ornament object on an ornament object selection screen from being identified, a video distribution system, a video distribution method and a video distribution program.SOLUTION: In a video distribution system 1, a server device 20 comprising a computer processor 21 distributes a video including the animation of a character object generated based on the motion of an actor. The computer processor 21 receives a display request which requests the display of an ornament object on the video during the distribution of the video from a browsing user, and generates an ornament object selection screen in response to receiving the display request. A video distribution server generates the ornament object selection screen including a display element for selecting the ornament object while not including user identification information capable of identifying the browsing user.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The disclosure in this specification relates to a video distribution system, a video distribution method, and a video distribution program that distribute videos including animations of character objects generated based on the movements of actors. [Background technology]

[0002] Conventionally, a video distribution system has been known that generates animation of a character object based on the movement of an actor and distributes a video including the animation of the character object. Such a video distribution system is disclosed in, for example, Japanese Patent Application Laid-Open No. 2015-184689 (Patent Document 1).

[0003] There is also known a content distribution system that displays a gift object corresponding to an item purchased by a viewing user on a display screen in response to a request from the viewing user who is viewing content. For example, in a video distribution system disclosed in JP2012-120098A (Patent Document 2), a viewing user can purchase a gift item and provide the purchased gift item as a gift to a performer (content distributor). In the same publication, it is considered desirable that the gift object be displayed in the background area of ​​the distribution screen so as not to interfere with the video. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2015-184689 A [Patent Document 2] JP 2012-120098 A Summary of the Invention [Problem to be solved by the invention]

[0005] Displaying gift objects overlapping with videos may lead to a deterioration in the viewing experience of the viewing user. For example, if the main part of a video is hidden by a gift object, the viewer may feel that the viewing of the video is interrupted. In particular, when a large number of gift objects are displayed overlapping with the video, this problem may become serious. For this reason, in the above-mentioned Patent Document 2, the gift objects are not displayed in the content display area where the video is displayed, but are displayed in the background area outside the content display area.

[0006] The object of the present disclosure is to provide a technical improvement that solves or alleviates at least a part of the problems of the prior art described above. A more specific object of the present disclosure is to provide a video distribution system, a video distribution method, and a video distribution program that can display a gift object in an overlapping manner with a video without degrading the viewing experience of a viewing user. [Means for solving the problem]

[0007] A video distribution system according to one embodiment is a video distribution system that distributes videos including animations of character objects generated based on movements of actors, and includes one or more computer processors, which execute computer-readable instructions to cause a decorative object for which a first display request has been made by a viewing user watching the video to be displayed in association with a part of the character object that is determined based on attachment position information set for the decorative object, when the decorative object is selected by someone other than the viewing user.

[0008] In one aspect, the selection of the decorative object is made by someone other than the viewing user.

[0009] In one embodiment, the decorative object is selected by a supporter who supports the distribution of the video.

[0010] In one aspect, the selection of the decorative object is made by the actor.

[0011] In one aspect, the one or more computer processors display the first object in the video in response to receiving a second display request from a viewing user watching the video, the second display requesting the display of a first object different from the decorative object.

[0012] In one aspect, the second display request includes a display position designation parameter that designates a display position of the first object, and the first object is displayed in the video at a position designated by the display position designation parameter.

[0013] In one aspect, a movement direction parameter that specifies a movement direction of the first object is included, and the first object is displayed in the video so as to move in a direction specified by the movement direction parameter.

[0014] In one embodiment, the second display request includes trajectory parameters that specify a trajectory of the first object, and the first object is displayed in the video moving along the trajectory specified by the trajectory parameters.

[0015] In one aspect, an object display prohibition period is set within a distribution period of the video, and the first object and the decorative object are displayed on the video at a timing other than the object display prohibition period during the distribution period of the video.

[0016] In one aspect, when the second display request is accepted during the object display prohibition period, the first object is displayed in the video after the object display prohibition period has elapsed.

[0017] In one aspect, the one or more computer processors accept a purchase request from the viewing user to purchase the decorative object, perform a payment process in response to the purchase request, and cancel the payment process if the decorative object is not selected by the end of distribution of the video.

[0018] In one aspect, the one or more computer processors accept a purchase request from the viewing user to purchase the decorative object, perform a payment process in response to the purchase request, and, if the decorative object is not selected by the end of distribution of the video, award points to the viewing user.

[0019] In one aspect, the one or more computer processors accept a purchase request from the viewing user to purchase the decorative object, add the decorative object to a holding list which is a list of objects owned by the viewing user in response to the purchase request, remove the decorative object from the holding list in response to accepting the first display request from the viewing user requesting to display the decorative object, and add the decorative object to the holding list if the decorative object is not selected by the end of distribution of the video.

[0020] In one aspect, the one or more computer processors provide the viewing user with purchasing information for purchasing a gift object purchasable in association with the video, the gift object including the decorative object, the gift object including a unique gift object purchasable only in the video and a common gift object purchasable in videos other than the video.

[0021] One aspect relates to a video distribution method for distributing a video including an animation of a character object generated based on a movement of an actor by executing computer-readable instructions by one or more computer processors, the video distribution method comprising: receiving a first display request for requesting display of a decorative object from a viewing user who views the video; and, when the decorative object is selected by a user other than the viewing user, displaying the decorative object in the video in association with a body part of the character object that is determined based on mounting position information set for the decorative object.

[0022] One aspect relates to a video distribution program for distributing a video including an animation of a character object generated based on a movement of an actor, the distribution program causing one or more computer processors to execute the steps of: accepting a first display request for requesting display of a decorative object from a viewing user who is viewing the video; and, when the decorative object is selected by a user other than the viewing user, displaying the decorative object in the video in association with a body part of the character object that is determined based on attachment position information set for the decorative object. Effect of the Invention

[0023] According to an embodiment of the present invention, a gift object can be displayed overlapping with a video without degrading the viewing experience of a viewing user. [Brief description of the drawings]

[0024] [Figure 1] 1 is a block diagram showing a video distribution system according to an embodiment. [Diagram 2] FIG. 2 is a schematic diagram showing the facilities of a studio for producing videos to be distributed by the video distribution system of FIG. 1. [Diagram 3] 2 is a diagram illustrating a possession list stored in the video distribution system of FIG. 1. FIG. [Figure 4]2 is a diagram illustrating a candidate list stored in the video distribution system of FIG. 1. FIG. [Diagram 5] 5 is a diagram showing an example of a moving image displayed on the client device 10a in one embodiment, which includes animation of a character object. [Figure 6] 6 is a diagram showing an example of a video displayed on the client device 10a in one embodiment, in which a normal object is included. [Figure 7] 7 is a diagram showing an example of a video displayed on the client device 10a in one embodiment, in which a decorative object is included. [Figure 8] 13 is a schematic diagram showing an example of a decorative object selection screen for selecting a desired decorative object from among decorative objects included in a candidate list. FIG. [Figure 9] FIG. 11 is a flow diagram showing a flow of a video distribution process in one embodiment. [Figure 10] FIG. 11 is a flowchart showing a process for displaying a normal object in an embodiment. [Figure 11] FIG. 11 is a flow diagram showing a process for displaying a decorative object in an embodiment. [Figure 12] 2 is a diagram for explaining an object display prohibition period set in a moving image distributed in the moving image distribution system of FIG. 1. FIG. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0025] Various embodiments of the present invention will now be described with reference to the accompanying drawings, in which the same reference numerals are used to designate the same or similar components throughout the drawings.

[0026] A video distribution system according to an embodiment will be described with reference to Fig. 1 to Fig. 4. Fig. 1 is a block diagram showing a video distribution system 1 according to an embodiment, Fig. 2 is a schematic diagram showing the equipment of a studio where videos to be distributed by the video distribution system 1 are produced, and Fig. 3 and Fig. 4 are diagrams for explaining information stored in the video distribution system 1.

[0027] The video distribution system 1 includes client devices 10a to 10c, a server device 20, a studio unit 30, and a storage 60. The client devices 10a to 10c, the server device 20, and the storage 60 are connected to each other via a network 50 so as to be able to communicate with each other. The server device 20 is configured to distribute video including character animation, as described below. The characters included in the video may be motion-controlled in a virtual space.

[0028] This video may be distributed from server device 20 to each of client devices 10a to 10c. A first viewing user who is a user of client device 10a, a second viewing user who is a user of client device 10b, and a third viewing user who is a user of client device 10c can view the distributed video on each client device. Video distribution system 1 may include fewer than three client devices, or may include more than three client devices.

[0029] The client devices 10a to 10c are information processing devices such as smartphones. The client devices 10a to 10c may be, other than smartphones, mobile phones, tablet terminals, personal computers, e-book readers, wearable computers, game consoles, and various other information processing devices capable of playing videos. Each of the client devices 10a to 10c may include a computer processor, a memory, a communication I / F, a display, a sensor unit including various sensors such as a gyro sensor, a sound collecting device such as a microphone, and a storage device for storing various information.

[0030] In the illustrated embodiment, the server device 20 includes a computer processor 21, a communication I / F 22, and a storage 23.

[0031] The computer processor 21 is an arithmetic device that loads an operating system and various programs that realize various functions from the storage 23 or other storages into memory and executes instructions included in the loaded programs. The computer processor 21 is, for example, a CPU, an MPU, a DSP, a GPU, various other arithmetic devices, or a combination of these. The computer processor 21 may be realized by an integrated circuit such as an ASIC, a PLD, an FPGA, or an MCU. Although the computer processor 21 is illustrated as a single component in FIG. 1, the computer processor 21 may be a collection of multiple physically separate computer processors. In this specification, a program described as being executed by the computer processor 21 or instructions included in the program may be executed by a single computer processor, or may be executed in a distributed manner by multiple computer processors. In addition, a program executed by the computer processor 21 or instructions included in the program may be executed by multiple virtual computer processors.

[0032] The communication I / F 22 is implemented as hardware, firmware, or communication software such as a TCP / IP driver or a PPP driver, or a combination of these. The server device 20 can transmit and receive data to and from other devices via the communication I / F 22.

[0033] The storage 23 is a storage device accessed by the computer processor 21. The storage 23 is, for example, a magnetic disk, an optical disk, a semiconductor memory, or any other storage device capable of storing data. Various programs can be stored in the storage 23. At least a portion of the programs and various data that can be stored in the storage 23 may be stored in a storage (for example, the storage 60) that is physically separate from the server device 20.

[0034] 2. As shown in the figure, actors A1 and A2 are performing in the studio room R. The studio unit 30 is configured to detect the movements and facial expressions of the actors A1 and A2 and output the detected information to the server device 20.

[0035] Both the actor A1 and the actor A2 are subjects whose movements and expressions are captured by a group of sensors (described later) provided in the studio unit 30. The actor A1 and the actor A2 are, for example, performing humans, animals, or moving objects. The actor A1 and the actor A2 may be, for example, robots capable of independent movement. The number of actors in the studio room R may be one, or may be three or more.

[0036] The studio unit 30 has six motion sensors 31a to 31f attached to the actor A1, a controller 33a held in the left hand of the actor A1, a controller 33b held in the right hand of the actor A1, and a camera 37a attached to the head of the actor A1 via a mounting 37b. The studio unit 30 also has six motion sensors 32a to 32f attached to the actor A2, a controller 34a held in the left hand of the actor A2, a controller 34b held in the right hand of the actor A2, and a camera 38a attached to the head of the actor A2 via a mounting 38b. Each of the mountings 37b and 38b may be equipped with a microphone for acquiring voice data. The microphone can acquire the speech of the actor A1 and the actor A2 as voice data. The microphones may be wearable microphones attached to the actors A1 and A2 via mounting fixtures 37b and 38b, or may be stationary microphones installed on the floor, wall, or ceiling of the studio room R. In addition to the above components, the studio unit 30 has a base station 35a, a base station 35b, a tracking sensor 36a, a tracking sensor 36b, and a display 39. A supporter computer 40 is installed in an adjacent room separated from the studio room R by a glass window. The server device 20 may be installed in the same room as the room in which the supporter computer 40 is installed.

[0037] The motion sensors 31a to 31f and the motion sensors 32a to 32f detect their own positions and orientations in cooperation with the base stations 35a and 35b. In one embodiment, the base stations 35a and 35b are multi-axis laser emitters. The base station 35a emits a flashing light for synchronization, and then scans the laser light, for example, around a vertical axis. The base station 35b scans the laser light, for example, around a horizontal axis. The motion sensors 31a to 31f and the motion sensors 32a to 32f may each include a plurality of optical sensors that detect the incidence of the flashing light and the laser light from the base stations 35a and 35b. The motion sensors 31a to 31f and the motion sensors 32a to 32f may each detect their own positions and orientations based on the time difference between the incidence timing of the flashing light and the incidence timing of the laser light, the light reception time at each optical sensor, the incidence angle of the laser light detected by each optical sensor, and other information as necessary. The motion sensors 31a to 31f and the motion sensors 32a to 32f may be, for example, Vive Trackers provided by HTC CORPORATION. The base station 35a and the base station 35b may be, for example, base stations provided by HTC CORPORATION.

[0038] Detection information indicating the position and orientation of each of the motion sensors 31a to 31f and 32a to 32f calculated in each of the motion sensors is transmitted to the server device 20. This detection information may be wirelessly transmitted from each of the motion sensors 31a to 31f and 32a to 32f to the server device 20. Since the base station 35a and the base station 35b emit blinking light and perform laser light scanning at regular intervals, the detection information of each motion sensor is updated at each interval.

[0039] In the illustrated embodiment, the actor A1 wears six motion sensors 31a to 31f. The motion sensors 31a, 31b, 31c, 31d, 31e, and 31f are respectively worn on the left wrist, right wrist, left instep, right instep, waist, and top of the head of the actor A1. The motion sensors 31a to 31f may be worn on the actor A1 via a wearing tool. The actor A2 wears six motion sensors 32a to 32f. The motion sensors 32a to 32f may be worn in the same positions as the motion sensors 31a to 31f with respect to the actor A2. The motion sensors 31a to 31f and the motion sensors 32a to 32f shown in FIG. 2 are examples. The motion sensors 31a to 31f may be worn on various parts of the actor A1, and the motion sensors 32a to 32f may be worn on various parts of the actor A2. The number of motion sensors attached to the actor A1 and the actor A2 may be 5 or less or 7 or more. In this way, by detecting the positions and orientations of the motion sensors 31a to 31f and the motion sensors 32a to 32f attached to the respective parts of the body of the actor A1 and the actor A2, the body movements of the actor A1 and the actor A2 can be detected.

[0040] In one embodiment, a number of infrared LEDs may be mounted on each of the multiple motion sensors attached to actor A1 and actor A2, and the position and orientation of each of the motion sensors may be detected by detecting light from the infrared LEDs with an infrared camera installed on the floor or wall of studio room R. Visible light LEDs may be used instead of infrared LEDs, and the position and orientation of each of the motion sensors may be detected by detecting light from the visible light LEDs with a visible light camera. In this way, a light emitting unit (e.g., an infrared LED or a visible light LED) may be provided on each of the multiple motion sensors attached to the actors, and the position and orientation of each of the motion sensors may be detected by detecting light from the light emitting unit with a light receiving unit (e.g., an infrared camera or a visible light camera) installed in studio room R.

[0041] In one embodiment, a plurality of reflective markers can be used instead of the motion sensors 31a to 31f and the motion sensors 32a to 32f. The reflective markers are attached to the actors A1 and A2, respectively, with adhesive tape or the like. The actors A1 and A2 to which the reflective markers are attached are photographed to generate photographic data, and the photographic data is subjected to image processing, whereby the positions and orientations of the reflective markers can be detected.

[0042] The controllers 33a and 33b output control signals corresponding to the operation of the actor A1 to the server device 20. Similarly, the controllers 34a and 34b output control signals corresponding to the operation of the actor A2 to the server device 20.

[0043] The tracking sensor 36a and the tracking sensor 36b generate tracking information for determining setting information of a virtual camera for constructing a virtual space included in a video. The tracking information of the tracking sensor 36a and the tracking sensor 36b is calculated as a position in each three-dimensional orthogonal coordinate system and an angle around each axis. The position and orientation of the tracking sensor 36a can be changed according to an operation of an operator. The tracking sensor 36a transmits tracking information indicating its position and orientation to the tracking information server device 20. Similarly, the position and orientation of the tracking sensor 36b are set according to an operation of an operator. The tracking sensor 36b transmits tracking information indicating its position and orientation to the tracking information server device 20.

[0044] As described above, the camera 37a is attached to the head of the actor A1. For example, the camera 37a is arranged so as to be able to capture an image of the face of the actor A1. The camera 37a continuously captures an image of the face of the actor A1 to obtain image data of the face of the actor A1. Similarly, the camera 38a is attached to the head of the actor A2. The camera 38a is arranged so as to be able to capture an image of the face of the actor A2, continuously captures an image of the face of the actor A2 to obtain image data of the face of the actor A2. The camera 37a transmits image data of the face of the actor A1 to the server device 20, and the camera 38a transmits image data of the face of the actor A1 to the server device 20. The camera 37a and the camera 38a may be 3D cameras capable of detecting the depth of a person's face.

[0045] The display 39 is configured to display information received from the support computer 40. Information transmitted from the support computer 40 to the display 39 may include, for example, text information, image information, and various other types of information. The display 39 is disposed in a position viewable by the actor A1 and the actor A2.

[0046] In the illustrated embodiment, the supporter computer 40 is installed in a room next to the studio room R. The room in which the supporter computer 40 is installed is separated from the studio room R by a glass window, so that the operator of the supporter computer 40 (sometimes referred to as a "supporter" in this specification) can see the actors A1 and A2. In the illustrated embodiment, supporters B1 and B2 are present in the room as operators of the supporter computer 40.

[0047] The supporter computer 40 may be configured to change the settings of the components of the studio unit 30 in response to the operations of the supporter B1 and the supporter B2. The supporter computer 40 can, for example, set the scanning intervals of the base stations 35a and 35b, set the positions or orientations of the tracking sensors 36a and 36b, and change various settings of various other devices. At least one of the supporter B1 and the supporter B2 can input a message to the supporter computer 40 and display the input message on the display 39.

[0048] The components and functions of the studio unit 30 shown in Fig. 2 are exemplary. The studio unit 30 applicable to the present invention may include various components not shown. For example, the studio unit 30 may include a projector. The projector can project a video onto a screen S to be distributed to the client device 10a or other client devices.

[0049] Next, in one aspect, a description will be given of information stored in the storage 23. In the illustrated embodiment, the storage 23 stores model data 23a, object data 23b, a possession list 23c, a candidate list 23d, and various other information required for generating and distributing a distribution video other than the above.

[0050] The model data 23a is model data for generating animation of a character. The model data 23a may be three-dimensional model data for generating three-dimensional animation, or may be two-dimensional model data for generating two-dimensional model data. The model data 23a includes, for example, rig data (sometimes called "skeleton data") indicating the skeleton of a character, and surface data indicating the shape and texture of the surface of the character. The model data 23a may include a plurality of model data different from each other. The plurality of model data may have different rig data from each other, or may have the same rig data. The plurality of model data may have different surface data from each other, or may have the same surface data. In the illustrated embodiment, in order to generate a character object corresponding to the actor A1 and a character object corresponding to the actor A2, the model data 23a has at least two kinds of model data different from each other. The model data for the character object corresponding to the actor A1 and the model data for the character object corresponding to the actor A2 may have, for example, the same rig data but different surface data.

[0051] The object data 23b includes asset data for constructing a virtual space constituting a video. The object data 23b includes data for drawing the background of the virtual space constituting the video, data for drawing various objects displayed in the video, and data for drawing various objects other than these displayed in the video. The object data 23a may include object position information indicating the position of an object in the virtual space.

[0052] In addition to the above, the object data 23b may include gift objects that are displayed in the video based on a display request from the viewing user of the client device 10a to 10c. The gift objects may include effect objects, normal objects, and decorative objects. The viewing user may purchase a desired gift object.

[0053] An effect object is an object that affects the overall impression of the viewing screen of a distributed video, for example, an object that resembles confetti. The object that resembles confetti may be displayed over the entire viewing screen, thereby changing the overall impression of the viewing screen before and after the display. An effect object may be displayed so as to overlap with a character object, but differs from a decorative object in that it is not displayed in association with a specific part of the character object.

[0054] A normal object is an object that is a digital gift from a viewing user to an actor (e.g., actor A1 or actor A2), and is, for example, an object that resembles a stuffed animal or a bouquet of flowers. In one embodiment, a normal object is displayed on a video display screen so as not to come into contact with a character object. In one embodiment, a normal object is displayed on a video display screen so as not to overlap with a character object. A normal object may be displayed so as to overlap with an object other than a character object in a virtual space. A normal object may be displayed so as to overlap with a character object, but is different from a decorative object in that a display associated with a specific part of the character object is not performed. In one embodiment, when a normal object is displayed so as to overlap with a character object, the normal object is displayed so as to overlap with a part of the character object other than the head, including the face, and not to overlap with the head of the character object.

[0055] A decorative object is an object that is displayed on a display screen in association with a specific part of a character object. In one aspect, a decorative object that is displayed on a display screen in association with a specific part of a character object is displayed on the display screen so as to be in contact with the specific part of the character object. In one aspect, a decorative object that is displayed on a display screen in association with a specific part of a character object is displayed on the display screen so as to cover a part or all of the specific part of the character object. The specific part may be specified by three-dimensional position information indicating a position in a three-dimensional coordinate space, or may be associated with position information in a three-dimensional coordinate space. For example, in the case of a character's head, the specific part may be defined in units of the front left side, front right side, rear left side, rear right side, center front side, center rear side, left eye, right eye, left ear, right ear, and all of the hair of the head.

[0056] The decorative object is, for example, an accessory (headband, necklace, earring, etc.), clothing (T-shirt, etc.) that is worn by a character object, a costume, and other objects that can be worn by a character object. The object data 23b corresponding to the decorative object may include wearing position information indicating which part of the character object the decorative object is associated with. The wearing position information of a certain decorative object can indicate which part of the character object the decorative object is worn on. For example, if the decorative object is a headband, the wearing position information of the decorative object may indicate that the decorative object is worn on the "head" of the character object. If the wearing position information on the decorative object is specified as a position in a three-dimensional coordinate space, the wearing position information may be associated with multiple positions in the three-dimensional coordinate space. For example, the wearing position information indicating the position on which a decorative object indicating a "headband" is worn may be associated with two parts of the character object, the "left rear of the head" and the "right rear of the head". In other words, the decorative object indicating a "headband" may be worn on both the "left rear of the head" and the "right rear of the head". In the case where the decorative object is a T-shirt, the wearing position information of the decorative object may indicate that the decorative object is worn on the "torso" of the character object.

[0057] Each gift object may have a display time set according to its type. In one embodiment, the display time of the decorative object may be set longer than the display time of the effect object and the display time of the normal object. For example, the display time of the decorative object may be set to 60 seconds, the display time of the effect object may be set to 5 seconds, and the display time of the normal object may be set to 10 seconds.

[0058] The possession list 23c is a list showing gift objects possessed by a viewing user of a video. An example of the possession list 23c is shown in Fig. 3. As shown in the figure, the possession list 23c stores object IDs that identify gift objects possessed by a viewing user in association with account information of the viewing user (e.g., the user ID of the viewing user). The viewing users include, for example, the first to third viewing users of the client devices 10a to 10c.

[0059] The candidate list 23d is a list of decorative objects for which a viewing user has made a display request. As described later, a viewing user who owns a decorative object can make a display request for the decorative object that the viewing user owns. In the candidate list 23d, an object ID that identifies the decorative object is stored in association with the account information of the viewing user who has made the display request for the decorative object. This candidate list 23d may be created for each distributor. The candidate list 23d may be stored in association with distributor identification information that identifies the distributor (actor A1, actor A2, supporter B1, and / or supporter B2), for example.

[0060] Next, the functions realized by the computer processor 21 will be described in more detail. The computer processor 21 executes computer-readable instructions included in the distribution program to function as a body motion data generating unit 21a, a face motion data generating unit 21b, an animation generating unit 21c, a video generating unit 21d, a video distribution unit 21e, a display request processing unit 21f, a decorative object selecting unit 21g, and an object purchase processing unit 21h. At least a part of the functions realized by the computer processor 21 may be realized by a computer processor other than the computer processor 21 of the video distribution system 1. At least a part of the functions realized by the computer processor 21 may be realized by, for example, a computer processor installed in the supporter computer 40.

[0061] The body motion data generating unit 21a generates first body motion data of each part of the body of the actor A1 based on the detection information of each of the motion sensors 31a to 31f, and generates second body motion data, which is a digital representation of the position and orientation of each part of the body of the actor A2, based on the detection information of each of the motion sensors 32a to 32f. In this specification, the first body motion data and the second body motion data may be collectively referred to simply as "body motion data". The body motion data is generated as time passes. For example, the body motion data may be generated at predetermined sampling time intervals. In this way, the body motion data can represent the body movements of the actor A1 and the actor A2 as digital data in a time series. In the illustrated embodiment, the motion sensors 31a-31f and 32a-32f are attached to the left and right limbs, waist, and head of each of the actors A1 and A2, and therefore it is possible to digitally represent the approximate positions and orientations of the entire bodies of the actors A1 and A2 over time based on the detection information of the motion sensors 31a-31f and 32a-32f. The body motion data can, for example, define the positions and rotation angles of bones constituting the rig data included in the model data 23a.

[0062] The face motion data generating unit 21b generates first face motion data, which is a digital representation of the facial movement of the actor A1, based on the imaging data of the camera 37a, and generates second face motion data, which is a digital representation of the facial movement of the actor A2, based on the imaging data of each of the cameras 38a. In this specification, the first face motion data and the second face motion data may be collectively referred to simply as "face motion data". The face motion data is generated as time passes. For example, the face motion data may be generated at predetermined sampling time intervals. In this way, the face motion data can digitally represent the actor A2 and the facial movement (changes in facial expression) of the actor A2 in a time series.

[0063] The animation generating unit 21c is configured to generate animation of a character object that moves in a virtual space and changes its facial expression by applying the body motion data generated by the body motion data generating unit 21a and the facial motion data generated by the facial motion data generating unit 21b to predetermined model data included in the model data 23a. Specifically, the animation generating unit 21c can generate animation of a character object that moves in synchronization with the body and facial expression movements of the actor A1 based on the first body motion data and the first facial motion data related to the actor A1, and generate animation of a character object that moves in synchronization with the body and facial expression movements of the actor A2 based on the second body motion data and the second facial motion data related to the actor A2. In this specification, a character object generated based on the movement and facial expression of the actor A1 may be referred to as a "first character object," and a character object generated based on the movement and facial expression of the actor A2 may be referred to as a "second character object."

[0064] The video generator 21d constructs a virtual space using the object data 23b, and generates a video including the virtual space, an animation of a first character object corresponding to the actor A1, and an animation of a second character object corresponding to the actor A2. The first character object is placed in the virtual space so as to match the position of the actor A1 relative to the tracking sensor 36a, and the second character object is placed in the virtual space so as to match the position of the actor A2 relative to the tracking sensor 36a. Therefore, by changing the position or orientation of the tracking sensor 36a, the positions and orientations of the first character object and the second character object in the virtual space can be changed.

[0065] In one aspect, the video generating unit 21d constructs a virtual space based on tracking information from the tracking sensor 36a. For example, the video generating unit 21d determines setting information (position, gaze position, gaze direction, and angle of view in the virtual space) of a virtual camera based on the tracking information from the tracking sensor 36a, determines a drawing area of ​​the entire virtual space based on the setting information of the virtual camera, and generates video information for displaying the drawing area of ​​the virtual space.

[0066] The video generation unit 21d may be configured to determine the positions and orientations of the first character object and the second character object in the virtual space, as well as setting information for the virtual camera, based on tracking information from the tracking sensor 36b instead of or in addition to the tracking information from the tracking sensor 36a.

[0067] The moving image generating unit 21d can synthesize the voices of the actors A1 and A2 acquired from the microphone of the studio unit 30 into the generated moving image.

[0068] In this manner, the video generation unit 21d generates an animation of a first character object that moves in synchronization with the body and facial movements of actor A1, and an animation of a second character object that moves in synchronization with the body and facial movements of actor A2, and can generate a video for distribution in which the animations are combined with the voices of actor A1 and actor A2.

[0069] The moving image distribution unit 21e distributes the moving image generated by the moving image generation unit 21d. This moving image is distributed to the client devices 10a to 10c and other client devices via the network 50. The received moving image is played back in the client devices 10a to 10c.

[0070] This video may be distributed to a client device (not shown) installed in studio room R, and projected from this client device onto a screen S via a short focus projector. This video may also be distributed to supporter computer 40. This allows supporter B1 and supporter B2 to check the viewing screen of the distributed video.

[0071] FIG. 5 shows an example of a display of a moving image distributed from the server device 20 to the client device 10a and being played on the client device 10a. As shown in the figure, a display image 70 of the moving image distributed from the server device 20 is displayed on the display of the client device 10a. The display image 70 displayed on the client device 10a includes, in a virtual space, a character object 71A corresponding to the actor A1, a character object 71B corresponding to the actor A2, and an object 72 showing a table. The object 72 is not a gift object, but is one of the objects for constructing the virtual space included in the object data 23b. The character object 71A is generated by applying the first body motion data and the first face motion data of the actor A1 to the model data for the actor A1 included in the model data 23a. The character object 71A is motion-controlled based on the first body motion data and the first face motion data. The character object 71B is generated by applying the second body motion data and the second face motion data of the actor A2 to the model data for the actor A2 included in the model data 23a. The motion of the character object 71B is controlled based on the second body motion data and the second face motion data. Therefore, the character object 71A is controlled to move within the screen in synchronization with the body and facial movement of the actor A1, and the character object 71B is controlled to move within the screen in synchronization with the body and facial movement of the actor A2.

[0072] As described above, the video delivered from the server device 20 may be delivered to the supporter computer 40. The video delivered to the supporter computer 40 is displayed on the supporter computer 40 in the same manner as in FIG. 5. The supporter B1 and the supporter B2 can change the settings of the components of the studio unit 30 by watching the video being played on the supporter computer 40. In one embodiment, when the supporter B1 and the supporter B2 want to change the angle of the character object 71A and the character object 71B in the video being delivered, they can transmit an instruction signal instructing a change in the orientation of the tracking sensor 36a from the supporter computer 40 to the tracking sensor 36a. The tracking sensor 36a can change its orientation in response to the instruction signal. For example, the tracking sensor 36a is attached to a stand so as to be rotatable around its axis via a rotation mechanism having an actuator built in, and when the tracking sensor 36a receives an instruction signal instructing a change in its orientation, the actuator of the rotation mechanism is driven based on the instruction signal, and the tracking sensor 36a may be rotated by an angle corresponding to the instruction signal. In one embodiment, supporter B1 and supporter B2 may send instructions from the supporter computer 40 to the tracking sensors 36a and 36b to use tracking information from the tracking sensor 36b instead of the tracking information from the tracking sensor 36a.

[0073] In one embodiment, when supporter B1 and supporter B2 judge that it is necessary to give instructions to actor A1 or actor A2 after watching the video being played on supporter computer 40, they can input a message indicating the instruction to supporter computer 40 and output this message on display 39. For example, supporter B1 and supporter B2 can instruct actor A1 or actor A2 to change their standing position through a message displayed on display 39.

[0074] The display request processing unit 21f receives a display request for a gift object from a client device of a viewing user, and performs processing according to the display request. Each viewing user can transmit a display request for a gift object to the server device 20 by operating his / her own client device. For example, a first viewing user can transmit a display request for a gift object to the server device 20 by operating the client device 10a. The display request for a gift object may include the user ID of the viewing user and identification information (object ID) that identifies the object requested to be displayed.

[0075] As described above, the gift object may include an effect object, a normal object, and a decorative object. The effect object and the normal object are examples of a first object. A display request for displaying the effect object or the normal object is an example of a second display request.

[0076] In one aspect, when the display request processing unit 21f receives a display request for a specific effect object from a viewing user, the display request processing unit 21f performs processing for displaying, based on the display request, the effect object requested to be displayed in the video display image 70. For example, when a display request is made for an effect object corresponding to confetti, the display request processing unit 21f displays, based on the display request, an effect object 73 representing confetti in the display image 70, as shown in FIG.

[0077] In one aspect, when the display request processing unit 21f receives a display request for a specific normal object from a viewing user, the display request processing unit 21f performs a process for displaying the normal object requested to be displayed in the video 70 based on the display request. For example, when a display request is made for a normal object showing a stuffed bear, the display request processing unit 21f displays a normal object 74 showing a stuffed bear in the display image 70 based on the display request, as shown in FIG.

[0078] The display request for the normal object 74 may include a display position designation parameter that designates the display position of the normal object 74 in the virtual space. In this case, the display request processing unit 21f can display the normal object 74 at the position designated by the display position designation parameter in the virtual space. For example, the display position designation parameter can designate the top of the object 72 representing a table as the display position of the normal object 74. By using the display position designation parameter, the viewing user can view the display of the character object 71A, the character object 71B, the gift object, and other objects included in the video 70 and designate the position at which the normal object is to be displayed.

[0079] In one embodiment, the normal object 74 may be displayed to move within the display image 70 of the video. For example, the normal object 74 may be displayed to fall from the top to the bottom of the screen. In this case, the normal object 74 may be displayed within the display image 70 from the start of the fall to the floor of the virtual space constituting the video 70, and may disappear from the display image 70 after falling to the floor. The viewing user can see the falling normal object 74 from the start of the fall to the end of the fall. The movement direction of the normal object 74 within the screen may be set arbitrarily. For example, the normal object 74 may be displayed in the display image 70 to move from left to right, right to left, upper left to lower left of the video 70, or in a direction other than these. The normal object 74 can move on various trajectories. For example, the normal object 74 can move on a straight trajectory, a circular trajectory, an elliptical trajectory, a spiral trajectory, or on a trajectory other than these. In addition to or instead of the display position designation parameter, the viewing user can include at least one of a movement direction parameter designating the movement direction of the normal object 74 and a trajectory parameter designating the trajectory along which the normal object 74 moves, in the display request for the normal object. In one embodiment, among the effect objects and normal objects, those whose size in the virtual space is smaller than a reference size (for example, the confetti pieces of the effect object 73) may be displayed by overlapping part or all of them with the character object 71A and the character object 71B. In one embodiment, among the effect objects and normal objects, those whose size in the virtual space is larger than a reference size (for example, the normal object 74 (a teddy bear)) are displayed at a position that does not overlap with the character object. In one embodiment, among the effect objects and normal objects, those whose size in the virtual space is larger than a reference size (for example, the normal object 74 (a teddy bear)) are displayed behind the character object that is displayed overlapping, when they overlap at least one of the character object 71A or the character object 71B.

[0080] In one aspect, when the display request processing unit 21f receives a display request for a specific decorative object from a viewing user, the display request processing unit 21f adds the decorative object requested to be displayed to the candidate list 23d based on the display request. The display request for a decorative object is an example of a first display request. For example, the display request processing unit 21f can store in the candidate list 23d identification information (object ID) for identifying the specific decorative object requested to be displayed by the viewing user in association with the user ID of the viewing user (see FIG. 4). When a plurality of display requests for decorative objects are made, the user ID of the viewing user who made the display request and the decorative object ID of the decorative object requested to be displayed by the viewing user are stored in the candidate list 23d in association with each other for each of the plurality of display requests.

[0081] In one aspect, in response to the selection of one or more decorative objects included in the candidate list 23d, the decorative object selection unit 21g performs a process for displaying the selected decorative objects in the video display image 70. In this specification, a decorative object selected from the candidate list 23d may be referred to as a "selected decorative object."

[0082] The selection of a decorative object from the candidate list 23d is performed, for example, by the supporter B1 and the supporter B2 operating the supporter computer 40. In one embodiment, a decorative object selection screen is displayed on the supporter computer 40. FIG. 8 shows an example of a decorative object selection screen 80 in one embodiment. This decorative object selection screen 80 is displayed, for example, on the display of the supporter computer 40. The decorative object selection screen 80 displays, for example, each of a plurality of decorative objects included in the candidate list 23d in a table format. As shown in the figure, the decorative object selection screen 80 in one embodiment has a first column 81 that displays the type of decorative object, a second column 82 that displays an image of the decorative object, and a third column 83 that displays a part of the character object with which the decorative object is associated. In addition, the decorative object selection screen 80 displays selection buttons 84a to 84c for selecting each decorative object. In this way, the decorative object selection screen 80 displays decorative objects that are candidates for the selected decorative object.

[0083] The supporter B1 and the supporter B2 can select one or more of the decorative objects included in the decorative object selection screen 80. For example, the supporter B1 and the supporter B2 can select a headband by selecting the selection button 84a. When the decorative object selection unit 21g detects that the headband has been selected, the display request processing unit 21f displays a selected decorative object 75 indicating the selected headband on the display screen 70 of the moving image, as shown in FIG. 7. The selected decorative object 75 is displayed on the display image 70 in association with a specific part of the character object. The selected decorative object 75 may be displayed so as to be in contact with the specific part of the character object. For example, the selected decorative object 75 indicating the headband is associated with the head of the character object, and is therefore attached to the head of the character object 71A, as shown in FIG. 7. The decorative object may be displayed on the display screen 70 so as to move in association with the movement of the specific part of the character object. For example, when the head of character object 71A wearing a headband moves, selected decoration object 75 representing the headband also moves along with the head of character object 71A as if the headband was being worn on the head of character object 71A.

[0084] As described above, the object data 23b may include wearing position information indicating which part of the character object the decorative object is associated with. In one aspect, the decorative object selection unit 21g may prevent a decorative object included in the candidate list 23d that is to be worn on a part that overlaps with a part indicated by the wearing position information of a decorative object already worn on the character object from being selected as the selected decorative object 75. For example, a headband associated with the "left rear of the head" and the "right rear of the head" and a hair accessory associated with the "left rear of the head" cannot be worn at the same time because the "left rear of the head" overlaps. On the other hand, a headband associated with the "left rear of the head" and the "right rear of the head" and an earring associated with the "left ear (of the head)" and the "right ear (of the head)" can be worn at the same time because the specific parts of the character object do not overlap.

[0085] The selected decorative object 75 may be displayed on the display screen 70 in association with the character object 71B, not with the character object 71A. The selected decorative object 75 may be displayed on the display screen 70 in association with the character object 71A and the character object 71B.

[0086] In one embodiment, the decorative object selection screen 80 may be configured not to include information that can identify a user who owns each decorative object or a user who has requested the display of each decorative object, thereby preventing a selector from favoring a particular user when selecting a decorative object.

[0087] In one embodiment, the decorative object selection screen 80 may display information about a user who owns each decorative object, or about a user who has made a display request for each decorative object. For example, for each decorative object, the number of times that the user who made the display request for the decorative object has made a display request for the decorative object and the number of times that the decorative object has been selected (for example, information indicating that the user has made a display request for the decorative object five times and selected the decorative object twice), the number of times that the user has viewed at least one of the videos of the character object 71A and the character object B, the number of times that the user has viewed a video (regardless of whether the character object 71A and the character object B appear) in the video distribution system 1, the purchase amount of the gift object by the user, the number of times that the user has purchased an object, the points that the user owns and can use in the video distribution system 1, the level of the user in the video distribution system 1, and various other information about the user who made the display request for each decorative object may be displayed. According to this embodiment, the decorative object can be selected based on the behavior and viewing history of the user who made the display request for the decorative object in the video distribution system 1.

[0088] In one embodiment, a restriction may be imposed on the display of the decorative objects to eliminate overlap. For example, when a decorative object associated with a specific part of the character object 71A has already been selected, the selection of other decorative objects associated with the specific part may be prohibited. As shown in the embodiment of FIG. 7, when a headband associated with the "head" of the character object 71B has already been selected, other decorative objects associated with the "head" (for example, a decorative object representing a "hat" associated with the head) may not be displayed on the decorative object selection screen 80, or a selection button for selecting the decorative object representing the hat may be made unselectable on the selection screen 80. According to this embodiment, it is possible to prevent the decorative objects from being displayed overlapping with a specific part of the character object.

[0089] The decorative object selection screen 80 may be displayed on another device instead of or in addition to the supporter computer 40. For example, the decorative object selection screen 80 may be displayed on at least one of the display 39 and the screen S in the studio room R. In this case, the actor A1 and the actor A2 can select a desired decorative object based on the decorative object selection screen 80 displayed on the display 39 or the screen S. The selection of the decorative object by the actor A1 and the actor A2 can be performed, for example, by operating the controller 33a, the controller 33b, the controller 34a, or the controller 34b.

[0090] In one aspect, the object purchase processing unit 21h transmits, in response to a request from a viewing user of a video, purchase information for each of a plurality of gift objects that can be purchased in relation to the video to the viewing user's client device (e.g., client device 10a). The purchase information for each gift object may include the type of the gift object (effect object, normal object, or decoration object), an image of the gift object, the price of the gift object, and other information required for purchasing the gift object. The viewing user can select a gift object to purchase based on the purchase information of the gift object displayed on the client device 10a. The selection of the gift object to be purchased may be performed by operating the client device 10a. When the gift object to be purchased is selected by the viewing user, a purchase request for the gift object is transmitted to the server device 20. The object purchase processing unit 21h performs a payment process based on the purchase request. When this payment process is completed, the purchased gift object is owned by the viewing user. In this case, the object ID of the purchased gift object is stored in the ownership list 23c in association with the user ID of the viewing user who purchased the gift object.

[0091] The purchasable gift objects may be different for each video. The purchasable gift objects may be purchasable across multiple videos. That is, the purchasable gift objects may include unique gift objects that are unique to each video and common gift objects that are purchasable across multiple videos. For example, an effect object showing confetti may be a common gift object that is purchasable across multiple videos.

[0092] In one aspect, when an effect object is purchased while watching a predetermined video, the effect object to be purchased may be automatically displayed in the video being watched in response to completion of a payment process for purchasing the effect object. When a normal object is purchased while watching a predetermined video, the normal gift object to be purchased may be automatically displayed in the video being watched in response to completion of a payment process for purchasing the normal object, similar to the above.

[0093] In another aspect, in response to the completion of the payment process in the object purchase processing unit 21h for the effect object to be purchased, a payment completion notice may be transmitted to the client device 10a, and a confirmation screen may be displayed on the client device 10a to ask the viewing user whether or not to make a display request for the purchased effect object. If the viewing user selects to make a display request for the purchased effect object, a display request requesting the display of the purchased effect object may be transmitted from the viewing user's client device to the display request processing unit 21f, and the display request processing unit 21f may perform processing to display the purchased effect object in the video 70. When the object to be purchased is a normal object, the purchased effect object may be displayed in the same manner as described above. A confirmation screen for confirming with the viewing user whether or not to make a display request for the selected normal object may be displayed on the client device 10a.

[0094] Next, a video distribution process according to one aspect will be described with reference to Fig. 9 to Fig. 11. Fig. 9 is a flow diagram showing the flow of the video distribution process in one embodiment, Fig. 10 is a flow diagram showing the flow of the process for displaying a normal object in one embodiment, and Fig. 11 is a flow diagram showing the flow of the process for displaying a decorative object in one embodiment. In the video distribution process, it is assumed that actor A1 and actor A2 are performing in studio room R.

[0095] First, in step S11, body motion data, which is a digital representation of the body movements of the actors A1 and A2, and face motion data, which is a digital representation of the facial movements (facial expressions) of the actors A1 and A2, are generated. The body motion data is generated, for example, by the body motion data generation unit 21a, and the face motion data is generated, for example, by the face motion data generation unit 21b.

[0096] Next, in step S12, the body motion data and face motion data of actor A1 are applied to the model data for actor A1 to generate an animation of a first character object that moves in synchronization with the body and facial movement of actor A1. Similarly, the body motion data and face motion data of actor A2 are applied to the model data for actor A2 to generate an animation of a second character object that moves in synchronization with the body and facial movement of actor A2. The generation of this animation is performed, for example, by the animation generation unit 21c described above.

[0097] Next, in step S13, a moving image including an animation of a first character object corresponding to actor A1 and an animation of a second character object corresponding to actor A2 is generated. The voices of actor A1 and actor A2 may be synthesized into this moving image. The animation of the first character object and the animation of the second character object may be placed in a virtual space. The generation of this moving image is performed, for example, by the moving image generating unit 21d described above.

[0098] Next, the process proceeds to step S14, where the video generated in step S13 is distributed. This video is distributed to client devices 10a to 10c and other client devices via network 50. This video is distributed to supporter computer 40, and may also be projected onto a screen S in studio room R. The video is distributed continuously for a predetermined distribution period. The video distribution period may be set to, for example, 30 seconds, 1 minute, 5 minutes, 10 minutes, 30 minutes, 60 minutes, 120 minutes, or any other time.

[0099] Next, the process proceeds to step S15, where it is determined whether or not a termination condition for terminating the distribution of the video has been met. The termination condition may be, for example, that the end time of the distribution has been reached, that an instruction to terminate the distribution has been given by the supporter computer 40, or other conditions. If the termination condition has not been met, the processes of steps S11 to S14 are repeatedly executed, and the distribution of the video including animation synchronized with the movements of the actors A1 and A2 is continued. If it is determined that the termination condition has been met for the video, the distribution process of the video is terminated.

[0100] Next, a display process of a normal object performed during distribution of a video will be described with further reference to Fig. 10. The display process of a normal object is performed in parallel with the distribution process of a video shown in Fig. 9.

[0101] During the distribution of the video, in step S21, it is determined whether a display request for a normal object has been made. For example, the first viewing user can select one or more specific normal objects from among the normal objects he or she owns, and transmit a display request for requesting the display of the selected normal objects from the client device 10a to the server device 20. As described above, the display request for a specific normal object may be generated in response to the purchase process or payment process for the specific normal object.

[0102] When a display request for a normal object is made, the display process proceeds to step S22. In step S22, a process is performed to display the normal object requested to be displayed in the video being distributed based on the display request. For example, when a display request for a normal object 74 is made during the distribution of a specific video, the normal object 74 requested to be displayed is displayed on the display screen 70 of the video, as shown in FIG.

[0103] If no request for displaying a normal object has been made, the display process for the normal object ends. The display process for the normal object shown in Fig. 10 is repeatedly performed during the distribution period of the video.

[0104] The display process of the effect object may be performed in the same procedure as the display process of the normal object described above. For example, when a display request for the effect object 73 is made during distribution of a predetermined video, the effect object 73 requested to be displayed is displayed on the display screen 70 of the video, as shown in Fig. 6. The effect object 73 shown in Fig. 6 is an object that resembles confetti. The effect object 73 that resembles confetti is displayed so as to overlap (or contact) with the character object 71A and the character object 71B, but differs from a decorative object in that it is not associated with a specific part of the character object 71A and the character object 71B.

[0105] Next, the display process of the decorative objects performed during the distribution of the video will be described with further reference to Fig. 11. The display process of the decorative objects is performed in parallel with the distribution process of the video shown in Fig. 9. The display process of the decorative objects may also be performed in parallel with the display process of the normal objects shown in Fig. 10.

[0106] During distribution of a video, in step S31, it is determined whether a display request for a decorative object has been made. For example, a first viewing user can select a first decorative object from among his / her own decorative objects, and transmit a display request for requesting display of the selected first decorative object from the client device 10a to the server device 20.

[0107] When a display request for the first decorative object is made, the display process proceeds to step S32. In step S32, the first decorative object requested to be displayed is added to a candidate list based on the display request. The candidate list is a list of objects that are candidates for decorative objects to be displayed in the video being distributed, such as the candidate list 23d described above.

[0108] Next, in step S33, it is determined whether or not a specific decorative object has been selected from the decorative objects stored in the candidate list.

[0109] When a specific decorative object is selected, in step S34, the selected specific decorative object (the "selected decorative object") is deleted from the candidate list, and a process is performed to display the selected decorative object on the display screen of the video being distributed. For example, when a decorative object 75 is selected from the candidate list during the distribution of a video 70 shown in Fig. 5, the selected decorative object 75 is displayed in the display image 70, as shown in Fig. 7. The first decorative object requested to be displayed in step S31 is displayed in the display image 70 if it is selected from the candidate list during the distribution of the video, but is not displayed in the display image 70 if it is not selected.

[0110] If no decorative object is selected from the candidate list in step S33, and if the display process of the selected decorative object is completed in step S34, the display process of the decorative object proceeds to step S35. In step S35, it is determined whether or not the distribution of the video being distributed has ended. In this step S35, the determination may be made, for example, based on the same criteria as in step S15. If it is determined in step S35 that the distribution has not ended, the display process of the decorative object returns to step S31, and the processes of steps S31 to S35 are repeatedly executed. If it is determined that the distribution has ended, the display process of the decorative object proceeds to step S36.

[0111] In step S36, processing is performed on the decorative objects (sometimes referred to as "non-selected objects" in this specification) that remain in the candidate list at the end of the video distribution. In this specification, the processing performed in step S36 is sometimes referred to as non-selected object processing.

[0112] The non-selected objects are objects that have been purchased by the viewing user and have been requested to be displayed during distribution of the video. Therefore, the non-selected object process executed in step S36 may be a process of refunding the purchase cost of the non-selected objects to the viewing user who has requested the display of the non-selected objects. In another aspect, the non-selected object process may be a process of canceling the payment process for purchasing the non-selected objects. In another aspect, the non-selected object process may be a process of giving a decorative object different from the non-selected objects to the viewing user who has requested the display of the non-selected objects.

[0113] In another aspect, the non-selected object process may be a process of granting points that can be used in the video distribution system 1 to the user of the non-selected object, instead of refunding the purchase cost or canceling the payment process. The video distribution system 1 may be configured to consume points to watch videos. The points granted to the user of the non-selected object by the non-selected object process may be points that can be used to watch videos in the video distribution system 1.

[0114] In another aspect, the non-selected object process may be a process of adding the non-selected object to the possession list as an object possessed by the first viewing user, thereby allowing the first viewing user to receive the return of the non-selected object.

[0115] In another aspect, the non-selected object process may be a process for retaining the candidate list at the end of video distribution until the next time the same distributor distributes a video. This allows the distributor to inherit the candidate list used in the previous video distribution at the next video distribution. This inherited candidate list includes decorative objects (i.e., non-selected objects) that were requested to be displayed at the previous video distribution but were not actually displayed in the video. This allows the next video distribution to be performed using the candidate list including the non-selected objects at the previous video distribution. There is a possibility that these non-selected objects will be selected in the next video distribution and displayed in the video.

[0116] After the process in step S36 is completed, the display process of the decorative object ends.

[0117] In one embodiment, an object display prohibition period during which display of a gift object is prohibited may be provided in a video distribution. FIG. 12 is a diagram for explaining a schematic object display prohibition period. FIG. 12 shows that a video is distributed between time t1 and time t2. That is, time t1 is the start time of the video distribution, and time t2 is the end time of the video distribution. In the video distribution period, the object display prohibition period 81 is between time t3 and time t4. Even if a display request r1 of a gift object is made during this object display prohibition period 81, the gift object is not displayed in the display image of the video during the object display prohibition period 81. Specifically, when a display request of an effect object or a normal object among gift objects is made during the object display prohibition period 81, the effect object or normal object requested to be displayed is not displayed in the video being distributed during the object display prohibition period 81, and is displayed in the video after the object display prohibition period 81 has elapsed (i.e., after time t4). Furthermore, when a decorative object is selected from the candidate list during the object display prohibition period 81, the selected decorative object is not displayed in the video being distributed during the object display prohibition period 81, but is displayed in the video at a point in time after the object display prohibition period 81 has elapsed. A display request for a decorative object may be accepted during the object display prohibition period 81. In other words, when a display request for a decorative object is made during the object display prohibition period 81, the decorative object for which the display request has been made may be added to the candidate list even during the object display prohibition period 81.

[0118] According to the above embodiment, the gift object includes three types of objects: a decorative object, a normal object, and an effect object. Of these, only the decorative object is displayed in association with the character object. In a video in which an animation of a character object is displayed, the animation of the character object is considered to be an element that attracts the attention of a viewing user. For example, in the video shown in FIG. 5 to FIG. 7, attention is considered to be focused on the character object 71A and the character object 71B. In the above embodiment, even if there is a display request for a decorative object displayed in association with the character object 71A and the character object 71B, the decorative object is not displayed in the video until the decorative object is selected from the candidate list 23d, thereby preventing the decorative objects from being displayed clutteredly around or overlapping the character object. This prevents the deterioration of the viewing experience of the viewing user.

[0119] In conventional video distribution systems, gift objects, regardless of their type, are displayed in a video in response to a request to display the gift object in the video. Therefore, if gift objects are allowed to be displayed in the video in duplicate, a large number of gift objects will be displayed in the video, degrading the viewing experience of users who watch the video. In the above embodiment, a category of decorative objects that are displayed in association with character objects is provided for gift objects, making it possible to reduce the number (display amount) of decorative objects displayed in association with character objects, which are the main parts of the video.

[0120] The normal object 74 of the gift object is displayed in the video in response to a display request from the viewing user. In the above embodiment, the normal object 74 is displayed on the video display screen 70 so as not to contact or overlap with the character object 71A and the character object 71B, so that the effect on the visibility of the character object 71A and the character object 71B is small. According to this aspect, it is possible to prevent the degradation of the user's viewing experience due to the deterioration of the visibility of the character object.

[0121] Among the gift objects, the effect object 73 and the normal object 74 are displayed in the video in response to a display request from the viewing user. In the above embodiment, the effect object 73 and the normal object 74 are displayed on the display screen 70 for a shorter period of time than the decorative object 75, and therefore have a smaller effect on the visibility of the character object 71A and the character object 71B. According to this aspect, it is possible to prevent a deterioration in the viewing experience of the user due to a deterioration in the visibility of the character object.

[0122] In the above embodiment, the selection of a decorative object from the candidate list 23d is made by a person other than the viewing user who requested the display of the decorative object (for example, supporter B1, supporter B2, actor A1, or actor A2), thereby making it possible to reduce the number of decorative objects displayed.

[0123] According to the above embodiment, the gift object is not displayed in the video during the object display prohibition period 81. This allows the created video to be viewed without being interrupted by the gift object. For example, by setting the time period during which the actors A1 and A2 perform visual performances in the video as the object display prohibition period 81, the audience can see the performances by the actors without being interrupted by the first object and the decorative object.

[0124] According to the above embodiment, it is considered that a viewing user who views a video including a character object such as character object 71A or character object 71B has an attachment to the character object. Therefore, the satisfaction level is increased by having the character object wear a decorative object rather than an effect object or a normal object. In this way, the decorative object that can be worn by the character object can provide the user with an incentive to repeatedly watch the video including the character object.

[0125] In the video distribution system 1 according to the above embodiment, a user can give a decorative object to a character. This makes it possible to provide a more unique system compared to a system in which such decorative objects cannot be given, and the system can provide a more unique service. This makes it possible to attract more users to the video distribution system 1, and therefore to increase the number of times videos are viewed in the video distribution system 1.

[0126] The embodiments of the present invention are not limited to the above-described embodiments, and various modifications are possible without departing from the spirit of the present invention. For example, the video to be distributed may be shot and generated outside the studio room R. For example, the shooting for generating the video to be distributed may be performed at the homes of the actors or supporters.

[0127] In the processing procedures described in this specification, particularly in the processing procedures described using flow diagrams, it is possible to omit some of the steps that make up the processing procedures, to add steps that are not explicitly stated as steps that make up the processing procedures, and / or to change the order of the steps, and processing procedures in which such omissions, additions, or changes in order have been made are also included within the scope of the present invention as long as they do not deviate from the spirit of the present invention.

[0128] The inventions described in the claims of the original application of this application are set forth below. [1] A video distribution server that distributes videos including animations of character objects generated based on the movements of actors, one or more computer processors; one or more storages for storing a decorative object that is displayed in association with a specific part of the character object in the video, and mounting position information that defines the specific part; The one or more computer processors execute the computer readable instructions to: receiving a first display request from a viewing user who is viewing the video to request that the decorative object be displayed on the video during distribution of the video, the first display request including object identification information that identifies the decorative object; When the decorative object is selected by a supporter or the actor supporting the distribution of the video during distribution of the video, the decorative object is displayed in the video in association with a part of the character object that is determined based on the attachment position information set for the decorative object. Video distribution server. [2] The first display request is accepted during distribution of the video. [1] A video distribution server according to the present invention. [3] The decorative object is associated with a specific part of the character object. As shown in the video, [1] or [2]. [4] The storage stores a first object different from the decorative object; the one or more computer processors cause the first object to be displayed in the video based on a second display request from the viewing user; [1] or [2]. [5] the second display request includes a display position designation parameter that designates a display position of the first object; the first object is displayed in the video at a position designated by the display position designation parameter; [4] A video distribution server according to the present invention. [6] the second display request includes a movement direction parameter that specifies a movement direction of the first object; the first object is displayed in the video so as to move in a direction specified by the movement direction parameter; [4] A video distribution server according to the present invention. [7] the second display request includes trajectory parameters that specify a trajectory of the first object; the first object is displayed in the video so as to move along a trajectory specified by the trajectory parameters; [4] A video distribution server according to the present invention. [8] An object display prohibition period is set within the distribution period of the video, the first object and the decorative object are displayed on the video at a timing other than the object display prohibition period during a distribution period of the video. [4] A video distribution server according to the present invention. [9] the one or more computer processors provide the viewing user with purchasing information for purchasing a purchasable gift object associated with the video; the gift object includes the decorative object and the first object; The gift objects include a unique gift object that can be purchased only in the video, and a common gift object that can be purchased in videos other than the video. [4] A video distribution server according to the present invention.

[10] 1. A video distribution method for distributing a video, the video including an animation of a character object generated based on a movement of an actor, to a plurality of viewing users including a first viewing user, by executing computer-readable instructions by one or more computer processors, the method comprising: storing a decorative object to be displayed in association with a specific part of the character object in the video, and mounting position information defining the specific part; receiving a first display request from the first viewing user requesting display of the decorative object, the first display request including object identification information that identifies the decorative object; When the decorative object is selected by a supporter or the actor supporting the distribution of the video during distribution of the video, the decorative object is displayed in the video in association with a part of the character object that is determined based on the attachment position information set for the decorative object; A video distribution method comprising:

[11] A video distribution program for distributing a video including an animation of a character object generated based on a movement of an actor to a plurality of viewing users including a first viewing user, one or more computer processors, storing a decorative object to be displayed in association with a specific part of the character object in the video, and mounting position information defining the specific part; receiving a first display request from the first viewing user requesting display of the decorative object, the first display request including object identification information that identifies the decorative object; When the decorative object is selected by a supporter or the actor supporting the distribution of the video during distribution of the video, the decorative object is displayed in the video in association with a part of the character object that is determined based on the attachment position information set for the decorative object; A video distribution program that executes the following. [Explanation of symbols]

[0129] 1. Video distribution system

Claims

1. A video distribution server that distributes videos including animations of character objects generated based on the movements of actors, one or more computer processors; The one or more computer processors execute the computer readable instructions to: receiving a display request from a viewing user who is viewing the video, requesting that a decorative object be displayed on the video during distribution of the video; In response to receiving the display request, a decorative object selection screen is generated, the decorative object selection screen including a display element for selecting the decorative object, but not including user identification information that can identify the viewing user; In response to the selection of the display element, displaying the decorative object in the video in association with the character object; The decorative object selection screen is displayed on a display visible to the actor. Video distribution server.

2. A video distribution server that distributes videos including animations of character objects generated based on the movements of actors, comprising: one or more computer processors; The one or more computer processors execute the computer readable instructions to: receiving a display request from a viewing user who is viewing the video, requesting that a decorative object be displayed on the video during distribution of the video; In response to receiving the display request, a decorative object selection screen is generated, the decorative object selection screen including a display element for selecting the decorative object, but not including user identification information that can identify the viewing user; In response to the selection of the display element, displaying the decorative object in the video in association with the character object; the decorative object selection screen is displayed on a supporter computer used by a supporter who supports the distribution of the video during the distribution of the video. Video distribution server.

3. The decorative object is associated with a specific part of the character object. the decorative object selection screen includes an area for displaying an image of the decorative object, and an area for displaying a name of the specific portion of the decorative object; 3. The video distribution server according to claim 1 or 2.

4. In response to receiving another display request from another viewing user who views the video, requesting that another decorative object be displayed on the video, the one or more computer processors update the decorative object selection screen to include another display element for selecting the other decorative object, but not to include user identification information that can identify the other viewing user. The video distribution server according to any one of claims 1 to 3.

5. when a specific part of the character object with which the other decorative object is associated is the same as a specific part of the character object with which the other decorative object is associated, other display elements of the other decorative object are made unselectable on the decorative object selection screen. The video distribution server according to claim 4.

6. and one or more storage devices for storing the decorative objects. The video distribution server according to any one of claims 1 to 5.

7. the display request includes object identification information that identifies the decorative object; The video distribution server according to claim 6.

8. the one or more computer processors: accepting a purchase request from the viewing user to purchase the decorative object; adding the decorative object to a holding list, which is a list of objects held by the viewing user, in response to the purchase request; In response to receiving a display request from the viewing user to display the decorative object, delete the decorative object from the holding list; adding the decorative object to the holding list if the decorative object has not been selected by the end of distribution of the video; The video distribution server according to any one of claims 1 to 7.

9. 1. A video distribution method for distributing a video including an animation of a character object generated based on a movement of an actor to a plurality of viewing users including a first viewing user by executing computer readable instructions by one or more computer processors, the method comprising: receiving a display request from the first viewing user requesting display of a decorative object; generating a decorative object selection screen configured to include display elements for selecting the decorative object in response to receiving the display request, but not to include user identification information capable of identifying the viewing user; displaying the decorative object in the video in association with the character object in response to the display element being selected; Equipped with A video distribution method, wherein the decorative object selection screen is displayed on a display viewable by the actor.

10. A video distribution method for distributing a video including animation of a character object generated based on a movement of an actor to a plurality of viewing users including a first viewing user by executing computer-readable instructions by one or more computer processors, comprising: receiving a display request from the first viewing user requesting display of a decorative object; generating a decorative object selection screen configured to include display elements for selecting the decorative object in response to receiving the display request, but not to include user identification information capable of identifying the viewing user; displaying the decorative object in the video in association with the character object in response to the display element being selected; Equipped with A video distribution method, wherein the decorative object selection screen is displayed on a supporter computer used by a supporter who supports the distribution of the video during the distribution of the video.

11. A video distribution program for distributing a video including an animation of a character object generated based on a movement of an actor to a plurality of viewing users including a first viewing user, the program comprising: one or more computer processors, storing a decorative object to be displayed in association with a specific part of the character object in the video, and mounting position information defining the specific part; receiving a display request from the first viewing user requesting display of the decorative object; generating a decorative object selection screen configured to include display elements for selecting the decorative object in response to receiving the display request, but not to include user identification information capable of identifying the viewing user; displaying the decorative object in the video in association with the character object in response to the display element being selected; Run the command, The decorative object selection screen is a video distribution program displayed on a display visible to the actor.

12. A video distribution program for distributing a video including an animation of a character object generated based on a movement of an actor to a plurality of viewing users including a first viewing user, comprising: one or more computer processors, storing a decorative object to be displayed in association with a specific part of the character object in the video, and mounting position information defining the specific part; receiving a display request from the first viewing user requesting display of the decorative object; generating a decorative object selection screen configured to include display elements for selecting the decorative object in response to receiving the display request, but not to include user identification information capable of identifying the viewing user; displaying the decorative object in the video in association with the character object in response to the display element being selected; Run the command, A video distribution program, in which the decorative object selection screen is displayed on a supporter computer used by a supporter who supports the distribution of the video during the distribution of the video.

Images