A video distribution system, video distribution method, and video distribution program that distribute videos including animations of character objects generated based on the movements of actors.

Abstract

In the decorative object selection screen, it will be impossible to select other attachment objects that overlap with decorative objects already attached to a character object. [Solution] The server device 20 distributes a video that includes animations of character objects generated based on the movements of an actor. In this video, a first decorative object is displayed in association with a first part of the character object. When the server device 20 receives a display request from a viewer requesting the display of a second decorative object, it generates a decorative object selection screen that includes an image of the second decorative object. If the second decorative object is an object that is displayed in association with a second part of the character object that is different from the first part, the decorative object selection screen includes a display element for selecting the second decorative object.

Description

Technical Field

[0001] The disclosure in this specification relates to a video distribution system, a video distribution method, and a video distribution program for distributing a video including an animation of a character object generated based on the movement of an actor.

Background Art

[0002] Conventionally, a video distribution system that generates an animation of a character object based on the movement of an actor and distributes a video including the animation of the character object is known. Such a video distribution system is disclosed, for example, in Japanese Patent Application Laid-Open No. 2015-184689 (Patent Document 1).

[0003] There is also known a content distribution system that displays a gift object corresponding to an item purchased by a viewing user on a display screen in response to a request from the viewing user who views the content. For example, in the video distribution system disclosed in Japanese Patent Application Laid-Open No. 2012-120098 (Patent Document 2), a viewing user can purchase a gift item and provide the purchased gift item as a gift to a performer (content distributor). In the same publication, it is desirable that the gift object be displayed in the background area of the distribution screen so as not to interfere with the video.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0005] Displaying gift objects in overlapping areas with the video may degrade the viewer's viewing experience. For example, if the main part of the video is obscured by a gift object, viewers may feel that their viewing experience has been hindered. This problem can become particularly serious if a large number of gift objects are displayed overlapping with the video. For this reason, in the above-mentioned Patent Document 2, gift objects are not displayed in the content display area where the video is displayed, but are displayed in the background area outside the content display area.

[0006] The purpose of this disclosure is to provide technical improvements that solve or mitigate at least some of the problems of the prior art described above. One more specific purpose of this disclosure is to provide a video distribution system, a video distribution method, and a video distribution program that can display gift objects in conjunction with the video without degrading the viewing experience for the viewer. [Means for solving the problem]

[0007] The inventions described herein are sometimes collectively referred to as "the present invention." (1) One aspect of the present invention is a video distribution server comprising one or more computer processors The one or more computer processors execute computer-readable instructions, The system delivers a video that includes an animation of a character object generated based on the movements of an actor, and a first decorative object that is displayed in association with a first part of the character object. The system receives a display request from a viewer of the aforementioned video during its distribution, requesting the display of a second decorative object on the video. If the second decorative object is an object that is displayed in association with a second part of the character object that is different from the first part, in response to receiving the display request, a decorative object selection screen is generated that includes an image of the second decorative object and a display element for selecting the second decorative object. In response to the selection of the display element, the second decorative object is displayed in the video in association with the second part of the character object. If the second decorative object is an object that is displayed in association with the first part of the character object, a decorative object selection screen is generated in response to the receipt of the display request, which includes an image of the second decorative object but does not include a display element for selecting the second decorative object. (2) One aspect of the present invention is a video distribution server comprising one or more computer processors, The one or more computer processors execute computer-readable instructions, The system delivers a video that includes an animation of a character object generated based on the movements of an actor, and a first decorative object that is displayed in association with a first part of the character object. The system receives a display request from a viewer of the aforementioned video during its distribution, requesting the display of a second decorative object on the video. Upon receiving the aforementioned display request, a decorative object selection screen is generated that includes an image of the second decorative object and a display element for selecting the second decorative object. In response to the selection of the display element, the second decorative object is displayed in the video in association with a second part of the character object that is different from the first part. If the second decorative object is an object that is displayed in association with the second part of the character object, the display element is displayed in a selectable format on the decorative object selection screen. If the second decorative object is an object that is displayed in association with the first part of the character object, the display element is displayed as unselectable on the decorative object selection screen. (3) In one embodiment of the present invention, the decorative object selection screen includes an area for displaying an image of the second decorative object and an area for displaying the name of the second part associated with the second decorative object. (4) In one embodiment of the present invention, the one or more computer processors transmit purchase information for purchasing a gift object that can be purchased in connection with the video to the viewing user's client device, The gift object includes a unique gift object that can only be purchased in the video and a common gift object that can be purchased in videos other than the video. (5) In one embodiment of the present invention, the second decorative object is included in the gift object. (6) One aspect of the present invention is a video distribution server further comprising one or more storages for storing the second decorative object. (7) In one embodiment of the present invention, the display request includes object identification information that identifies the second decorative object. (8) One aspect of the present invention is a video distribution method for distributing video to multiple viewers, including a first viewer, by having one or more computer processors execute computer-readable instructions, The aforementioned video includes an animation of a character object generated based on the actor's movements, and a first decorative object displayed in association with a first part of the character object. The process includes receiving a display request from the first viewer requesting the display of a second decorative object on the video, If the second decorative object is an object that is displayed in association with a second part of the character object that is different from the first part, the process of generating a decorative object selection screen that includes an image of the second decorative object and a display element for selecting the second decorative object, in response to receiving the display request, The steps include: displaying the second decorative object in the video in association with the second part of the character object in response to the selection of the display element; If the second decorative object is an object displayed in association with the first part of the character object, the video distribution method includes the step of generating a decorative object selection screen that includes an image of the second decorative object but does not include a display element for selecting the second decorative object, in response to receiving the display request. (9) One aspect of the present invention is a video distribution method for distributing a video to a plurality of viewers, including a first viewer, by having one or more computer processors execute computer-readable instructions, wherein the video includes an animation of a character object generated based on the movement of an actor, and a first decorative object displayed in association with a first part of the character object. The process includes receiving a display request from the first viewer requesting the display of a second decorative object on the video, In response to receiving the aforementioned display request, a step of generating a decorative object selection screen that includes an image of the second decorative object and a display element for selecting the second decorative object, The steps include: displaying the second decorative object in the video in association with a second part of the character object that is different from the first part of the character object, in response to the selection of the display element; Equipped with, If the second decorative object is an object that is displayed in association with the second part of the character object, the display element is displayed in a selectable format on the decorative object selection screen. In the case where the second decorative object is an object displayed in association with the first part of the character object, the display element is displayed as unselectable on the decorative object selection screen in this video distribution method. (10) One aspect of the present invention is a video distribution program that distributes a video to a plurality of viewers, including a first viewer, The aforementioned video includes an animation of a character object generated based on the actor's movements, and a first decorative object displayed in association with a first part of the character object. One or more computer processors, The process includes receiving a display request from the first viewer requesting the display of a second decorative object on the video, If the second decorative object is an object that is displayed in association with a second part of the character object that is different from the first part, the process of generating a decorative object selection screen that includes an image of the second decorative object and a display element for selecting the decorative object, in response to receiving the display request, The steps include: displaying the second decorative object in the video in association with the second part of the character object in response to the selection of the display element; The video distribution program, when the second decorative object is an object displayed in association with the first part of the character object, performs the step of generating a decorative object selection screen that includes an image of the second decorative object but does not include a display element for selecting the second decorative object, in response to receiving the display request. (11) One aspect of the present invention is a video distribution program that distributes a video to a plurality of viewers, including a first viewer, The aforementioned video includes an animation of a character object generated based on the actor's movements, and a first decorative object displayed in association with a first part of the character object. One or more computer processors, The process includes receiving a display request from the first viewer requesting the display of a second decorative object on the video, generating a decorative object selection screen to include an image of the second decorative object and display elements for selecting the second decorative object in response to receiving the display request; causing the second decorative object to be displayed in the video in association with a second part of the character object different from the first part in response to the display element being selected; causing execution of wherein when the second decorative object is an object to be displayed in association with the second part of the character object, the display element is displayed selectably on the decorative object selection screen; a video distribution program, wherein when the second decorative object is an object to be displayed in association with the first part of the character object, the display element is displayed non-selectably on the decorative object selection screen.

[0008] In one aspect, the selection of the decorative object is made by a person other than the viewing user.

[0009] In one aspect, the selection of the decorative object is made by a supporter who supports the distribution of the video.

[0010] In one aspect, the selection of the decorative object is made by the actor.

[0011] In one aspect, in response to receiving a second display request for requesting display of a first object different from the decorative object from a viewing user who views the video, the one or more computer processors cause the first object to be displayed in the video.

[0012] In one aspect, the second display request includes a display position specification parameter for specifying a display position of the first object, and the first object is displayed at the position specified by the display position specification parameter in the video.

[0013] In one embodiment, a movement direction parameter is included that specifies the direction of movement of the first object, and the first object is displayed in the video to move in the direction specified by the movement direction parameter.

[0014] In one embodiment, the second display request includes a trajectory parameter that specifies the trajectory of the first object, and the first object is displayed in the video moving along the trajectory specified by the trajectory parameter.

[0015] In one embodiment, an object display prohibition period is set within the video distribution period, and the first object and the decorative object are displayed in the video at times other than the object display prohibition period within the video distribution period.

[0016] In one embodiment, if the second display request is received during the object display prohibition period, the first object is displayed in the video after the object display prohibition period has elapsed.

[0017] In one embodiment, the one or more computer processors receive a purchase request from the viewing user to purchase the decorative object, perform a payment process in response to the purchase request, and cancel the payment process if the decorative object is not selected by the end of the video distribution.

[0018] In one embodiment, the one or more computer processors receive a purchase request from the viewing user to purchase the decorative object, process a payment in response to the purchase request, and if the decorative object is not selected by the end of the video distribution, award points to the viewing user.

[0019] In one embodiment, the one or more computer processors receive a purchase request from the viewing user to purchase the decorative object, add the decorative object to a list of objects owned by the viewing user in response to the purchase request, remove the decorative object from the list of objects owned by the viewing user in response to receiving a first display request from the viewing user to display the decorative object, and add the decorative object to the list of objects owned if the decorative object is not selected by the end of the video distribution.

[0020] In one embodiment, the one or more computer processors provide the viewer user with purchase information for purchasing gift objects that can be purchased in connection with the video, the gift objects including the decorative objects, and the gift objects including unique gift objects that can be purchased only in the video, and common gift objects that can be purchased in videos other than the video.

[0021] One embodiment relates to a video distribution method for distributing a video that includes animation of character objects generated based on the movements of an actor, by having one or more computer processors execute computer-readable instructions. The video distribution method comprises the steps of: receiving a first display request from a viewer user who is viewing the video to request the display of a decorative object; and, if the decorative object is selected by someone other than the viewer user, displaying the decorative object in the video in association with a part of the character object determined based on attachment position information set on the decorative object.

[0022] One embodiment relates to a video distribution program that distributes a video including animations of character objects generated based on the movements of an actor. The distribution program causes one or more computer processors to perform the steps of: receiving a first display request from a viewer user who is viewing the video to request the display of decorative objects; and, if the decorative objects are selected by someone other than the viewer user, displaying the decorative objects in the video in association with parts of the character objects determined based on attachment position information set on the decorative objects. [Effects of the Invention]

[0023] According to embodiments of the present invention, gift objects can be displayed overlaid on the video without degrading the viewing experience for the user. [Brief explanation of the drawing]

[0024] [Figure 1] Block diagram showing a video distribution system according to one embodiment. [Figure 2] Figure 1 is a schematic diagram illustrating the equipment of a studio used to produce videos distributed through the video streaming system. [Figure 3] This figure illustrates the list of possessions stored in the video distribution system shown in Figure 1. [Figure 4] Figure 1 illustrates the list of candidates stored in the video distribution system. [Figure 5] This figure shows an example of a video displayed on the client device 10a in one embodiment. Figure 5 includes the animation of a character object. [Figure 6] This figure shows an example of a video displayed on the client device 10a in one embodiment. Figure 6 typically includes objects. [Figure 7] This figure shows an example of a video displayed on the client device 10a in one embodiment. Figure 7 includes decorative objects. [Figure 8]This is a schematic diagram illustrating an example of a decorative object selection screen, which allows you to select a desired decorative object from among the decorative objects included in the candidate list. [Figure 9] This is a flowchart showing the video distribution process in one embodiment. [Figure 10] In one embodiment, this is a flowchart showing the process flow for displaying a normal object. [Figure 11] In one embodiment, this is a flowchart showing the process of displaying a decorative object. [Figure 12] Figure 1 is a diagram illustrating the object display prohibition period set for videos distributed in the video distribution system. [Modes for carrying out the invention]

[0025] Hereinafter, various embodiments of the present invention will be described with reference to the drawings as appropriate. In multiple drawings, identical or similar components are denoted by the same reference numerals.

[0026] A video distribution system according to one embodiment will be described with reference to Figures 1 to 4. Figure 1 is a block diagram showing a video distribution system 1 according to one embodiment, Figure 2 is a schematic diagram showing the equipment of a studio where videos distributed by the video distribution system 1 are produced, and Figures 3 and 4 are diagrams for explaining the information stored in the video distribution system 1.

[0027] The video distribution system 1 comprises client devices 10a to 10c, a server device 20, a studio unit 30, and storage 60. The client devices 10a to 10c, the server device 20, and the storage 60 are connected to each other via a network 50 so that they can communicate with one another. The server device 20 is configured to distribute videos that include character animations, as will be described later. The characters included in these videos may be motion-controlled within a virtual space.

[0028] This video can be distributed from server device 20 to each of client devices 10a to 10c. The first viewer, who is a user of client device 10a, the second viewer, who is a user of client device 10b, and the third viewer, who is a user of client device 10c, can view the distributed video on their respective client devices. The video distribution system 1 may have fewer than three client devices or more than three client devices.

[0029] Client devices 10a to 10c are information processing devices such as smartphones. In addition to smartphones, client devices 10a to 10c may also be mobile phones, tablet devices, personal computers, e-book readers, wearable computers, game consoles, and other information processing devices capable of playing videos. Each of the client devices 10a to 10c may be equipped with a computer processor, memory, a communication interface, a display, a sensor unit with various sensors such as a gyroscope, a sound collection device such as a microphone, and storage for storing various information.

[0030] In the illustrated embodiment, the server device 20 includes a computer processor 21, a communication interface 22, and storage 23.

[0031] The computer processor 21 is an arithmetic unit that loads operating systems and various programs that implement various functions from storage 23 or other storage into memory and executes instructions contained in the loaded programs. The computer processor 21 may be, for example, a CPU, MPU, DSP, GPU, various other arithmetic units, or a combination thereof. The computer processor 21 may be implemented by an integrated circuit such as an ASIC, PLD, FPGA, or MCU. In Figure 1, the computer processor 21 is shown as a single component, but the computer processor 21 may be a collection of multiple physically separate computer processors. In this specification, a program or instructions contained in a program described as being executed by the computer processor 21 may be executed by a single computer processor or may be executed in a distributed manner by multiple computer processors. Furthermore, a program or instructions contained in a program executed by the computer processor 21 may be executed by multiple virtual computer processors.

[0032] The communication interface 22 is implemented as hardware, firmware, or communication software such as a TCP / IP driver or a PPP driver, or a combination thereof. The server device 20 can send and receive data with other devices via the communication interface 22.

[0033] Storage 23 is a storage device accessed by the computer processor 21. Storage 23 is, for example, a magnetic disk, an optical disk, a semiconductor memory, or any other storage device capable of storing data. Various programs can be stored in storage 23. At least some of the programs and various data that can be stored in storage 23 may be stored in a storage device (for example, storage 60) that is physically separate from the server device 20.

[0034] Many of the components of the studio unit 30 are located in, for example, studio room R shown in Figure 2. As shown in the figure, actors A1 and A2 are performing in studio room R. The studio unit 30 is configured to detect the movements and facial expressions of actors A1 and A2 and output the detected information to the server device 20.

[0035] Actor A1 and Actor A2 are both subjects whose movements and facial expressions are captured by the group of sensors described later, which are provided in the studio unit 30. Actor A1 and Actor A2 are, for example, a human, animal, or moving object performing a performance. Actor A1 and Actor A2 may also be, for example, autonomously moving robots. The number of actors in the studio room R may be one or three or more.

[0036] The studio unit 30 includes six motion sensors 31a to 31f attached to actor A1, a controller 33a held in actor A1's left hand, a controller 33b held in actor A1's right hand, and a camera 37a attached to actor A1's head via a mounting device 37b. The studio unit 30 also includes six motion sensors 32a to 32f attached to actor A2, a controller 34a held in actor A2's left hand, a controller 34b held in actor A2's right hand, and a camera 38a attached to actor A2's head via a mounting device 38b. Microphones for acquiring audio data may be attached to each of the mounting devices 37b and 38b. These microphones can acquire the speech of actor A1 and actor A2 as audio data. The microphones may be wearable microphones attached to actors A1 and A2 via attachments 37b and 38b, or they may be stationary microphones installed on the floor, wall, or ceiling of the studio room R. In addition to the above components, the studio unit 30 includes a base station 35a, a base station 35b, a tracking sensor 36a, a tracking sensor 36b, and a display 39. A supporter computer 40 is installed in an adjacent room separated from the studio room R by a glass window. The server device 20 may be installed in the same room as the supporter computer 40.

[0037] Motion sensors 31a-31f and 32a-32f work in cooperation with base stations 35a and 35b to detect their own position and orientation. In one embodiment, base stations 35a and 35b are multi-axis laser emitters. Base station 35a scans the laser beam, for example, around the vertical axis, after emitting a synchronization flashing light. Base station 35b scans the laser beam, for example, around the horizontal axis. Motion sensors 31a-31f and 32a-32f may each be equipped with multiple optical sensors that detect the incidence of flashing light and laser light from base stations 35a and 35b. Motion sensors 31a-31f and 32a-32f may each detect their own position and orientation based on the time difference between the incidence timing of the flashing light and the incidence timing of the laser light, the light reception time at each optical sensor, the incidence angle of the laser light detected by each optical sensor, and other information as needed. Motion sensors 31a-31f and motion sensors 32a-32f may be, for example, Vive Trackers provided by HTC CORPORATION. Base stations 35a and 35b may be, for example, base stations provided by HTC CORPORATION.

[0038] Detection information indicating the position and orientation of each motion sensor, calculated by each of the motion sensors 31a-31f and 32a-32f, is transmitted to the server device 20. This detection information may also be transmitted wirelessly from each of the motion sensors 31a-31f and 32a-32f to the server device 20. Since base stations 35a and 35b emit flashing lights and scan laser light at regular intervals, the detection information of each motion sensor is updated at each of these intervals.

[0039] In the illustrated embodiment, actor A1 is fitted with six motion sensors 31a to 31f. Motion sensors 31a, 31b, 31c, 31d, 31e, and 31f are fitted to actor A1's left wrist, right wrist, left instep, right instep, waist, and top of head, respectively. Motion sensors 31a to 31f may be fitted to actor A1 via attachment devices. Actor A2 is fitted with six motion sensors 32a to 32f. Motion sensors 32a to 32f may be fitted to actor A2 in the same positions as motion sensors 31a to 31f. The motion sensors 31a to 31f and motion sensors 32a to 32f shown in Figure 2 are illustrative. Motion sensors 31a to 31f may be fitted to various parts of actor A1, and motion sensors 32a to 32f may be fitted to various parts of actor A2. The number of motion sensors attached to actor A1 and actor A2 may be 5 or less, or 7 or more. In this way, by detecting the position and orientation of motion sensors 31a to 31f and motion sensors 32a to 32f attached to various parts of actor A1 and actor A2's bodies, the movement of actor A1 and actor A2's bodies can be detected.

[0040] In one embodiment, multiple motion sensors attached to actors A1 and A2 may be equipped with numerous infrared LEDs, and the position and orientation of each motion sensor may be detected by detecting the light from these infrared LEDs with infrared cameras installed on the floor and walls of the studio room R. Alternatively, visible light LEDs may be used instead of infrared LEDs, and the position and orientation of each motion sensor may be detected by detecting the light from these visible light LEDs with a visible light camera. In this way, each of the multiple motion sensors attached to the actors may be equipped with a light-emitting unit (e.g., infrared LEDs or visible light LEDs), and the position and orientation of each motion sensor may be detected by detecting the light from these light-emitting units with light-receiving units (e.g., infrared cameras or visible light cameras) installed in the studio room R.

[0041] In one embodiment, multiple reflective markers can be used instead of motion sensors 31a-31f and motion sensors 32a-32f. The reflective markers are attached to actor A1 and actor A2, respectively, using adhesive tape or the like. By photographing actors A1 and A2 with the reflective markers attached in this way to generate image data, the position and orientation of the reflective markers can be detected by image processing of this image data.

[0042] Controllers 33a and 33b output control signals to the server device 20 in accordance with the operations of actor A1. Similarly, controllers 34a and 34b output control signals to the server device 20 in accordance with the operations of actor A2.

[0043] Tracking sensors 36a and 36b generate tracking information to define the settings for a virtual camera used to construct a virtual space included in the video. The tracking information for tracking sensors 36a and 36b is calculated as their respective positions in a three-dimensional Cartesian coordinate system and angles around each axis. The position and orientation of tracking sensor 36a can be changed according to the operator's actions. Tracking sensor 36a transmits tracking information indicating its position and orientation to the tracking information server device 20. Similarly, the position and orientation of tracking sensor 36b are set according to the operator's actions. Tracking sensor 36b transmits tracking information indicating its position and orientation to the tracking information server device 20.

[0044] Camera 37a is mounted on the head of actor A1, as described above. For example, camera 37a is positioned to capture images of actor A1's face. Camera 37a continuously captures images of actor A1's face and acquires image data of actor A1's face. Similarly, camera 38a is mounted on the head of actor A2. Camera 38a is positioned to capture images of actor A2's face and continuously captures images of actor A2's face and acquires image data of actor A2's face. Camera 37a transmits image data of actor A1's face to the server device 20, and camera 38a transmits image data of actor A1's face to the server device 20. Cameras 37a and 38a may be 3D cameras capable of detecting the depth of a person's face.

[0045] The display 39 is configured to display information received from the support computer 40. The information transmitted from the support computer 40 to the display 39 may include, for example, text information, image information, and various other types of information. The display 39 is positioned so that it can be seen by actors A1 and A2.

[0046] In the illustrated embodiment, the supporter computer 40 is installed in a room adjacent to studio room R. Since the room where the supporter computer 40 is installed is separated from studio room R by a glass window, the operator of the supporter computer 40 (sometimes referred to as "supporter" in this specification) can see actors A1 and A2. In the illustrated embodiment, supporters B1 and B2 are present in the room as operators of the supporter computer 40.

[0047] The supporter computer 40 may be configured to change the settings of the components of the studio unit 30 in response to the operations of supporters B1 and B2. For example, the supporter computer 40 can set the scanning interval by base stations 35a and 35b, set the position or orientation of tracking sensors 36a and 36b, and change various settings of other devices. At least one of supporters B1 and B2 can input a message to the supporter computer 40 and display the input message on the display 39.

[0048] The components and functions of the studio unit 30 shown in Figure 2 are illustrative. A studio unit 30 applicable to the present invention may include various components not shown. For example, the studio unit 30 may include a projector that can project video distributed to the client device 10a or other client devices onto the screen S.

[0049] Next, in one embodiment, the information stored in the storage 23 will be described. In the illustrated embodiment, the storage 23 stores model data 23a, object data 23b, possession list 23c, candidate list 23d, and various other information necessary for generating and distributing the video.

[0050] Model data 23a is model data for generating character animation. Model data 23a may be 3D model data for generating 3D animation, or 2D model data for generating 2D model data. Model data 23a includes, for example, rig data (sometimes called "skeleton data") that shows the character's skeleton, and surface data that shows the shape and texture of the character's surface. Model data 23a can contain multiple different model data. These multiple model data may have different rig data, or they may have the same rig data. These multiple model data may have different surface data, or they may have the same surface data. In the illustrated embodiment, model data 23a has at least two different types of model data in order to generate character objects corresponding to actor A1 and character objects corresponding to actor A2. The model data for the character object corresponding to actor A1 and the model data for the character object corresponding to actor A2 may, for example, have the same rig data but different surface data.

[0051] Object data 23b includes asset data for constructing the virtual space that makes up the video. Object data 23b includes data for rendering the background of the virtual space that makes up the video, data for rendering various objects that appear in the video, and data for rendering various other objects that appear in the video. Object data 23a may also include object position information indicating the position of objects in the virtual space.

[0052] Object data 23b may also include gift objects that are displayed in the video based on display requests from viewing users on client devices 10a to 10c, in addition to those mentioned above. Gift objects may include effect objects, normal objects, and decorative objects. Viewing users can purchase the gift objects they desire.

[0053] Effect objects are objects that influence the overall impression of the viewing screen of a streamed video, such as objects that mimic confetti. Confetti-like objects may be displayed across the entire viewing screen, thereby changing the overall impression of the screen before and after their display. Effect objects may sometimes overlap with character objects, but they differ from decorative objects in that they are not associated with specific parts of character objects.

[0054] A normal object is an object that serves as a digital gift from the viewer to an actor (e.g., actor A1 or actor A2), and may be an object resembling a stuffed animal or a bouquet of flowers. In one embodiment, a normal object is displayed on the video screen so as not to touch a character object. In another embodiment, a normal object is displayed on the video screen so as not to overlap with a character object. A normal object may be displayed in a way that overlaps with objects other than character objects in the virtual space. A normal object may be displayed in a way that overlaps with a character object, but it differs from a decorative object in that it is not displayed in association with a specific part of the character object. In one embodiment, when a normal object is displayed in a way that overlaps with a character object, the normal object is displayed so as to overlap with the part of the character object other than the head, including the face, but not with the head of the character object.

[0055] A decorative object is an object displayed on the screen in association with a specific part of a character object. In one embodiment, a decorative object displayed on the screen in association with a specific part of a character object is displayed on the screen so as to be in contact with that specific part of the character object. In another embodiment, a decorative object displayed on the screen in association with a specific part of a character object is displayed on the screen so as to cover part or all of that specific part of the character object. The specific part may be identified by three-dimensional position information indicating its location in a three-dimensional coordinate space, or it may be associated with position information in a three-dimensional coordinate space. For example, in the head of a character, the specific part may be defined as the front left side of the head, the front right side, the back left side, the back right side, the central front side, the central back side, the left eye, the right eye, the left ear, the right ear, and the entire hair.

[0056] Decorative objects include, for example, accessories (headbands, necklaces, earrings, etc.) attached to character objects, clothing (T-shirts, etc.), costumes, and other objects that can be attached to character objects. The object data 23b corresponding to a decorative object may include attachment position information indicating which part of the character object the decorative object is associated with. The attachment position information of a decorative object can indicate which part of the character object the decorative object is attached to. For example, if the decorative object is a headband, the attachment position information of the decorative object may indicate that the decorative object is attached to the "head" of the character object. If the attachment position information to which a decorative object is attached is specified as a position in three-dimensional coordinate space, the attachment position information may be associated with multiple positions in three-dimensional coordinate space. For example, the attachment position information indicating the position to which a decorative object representing a "headband" is attached may be associated with two parts of the character object: the "rear left side of the head" and the "rear right side of the head". In other words, the decorative object representing a "headband" may be attached to both the "rear left side of the head" and the "rear right side of the head". If the decorative object is a T-shirt, the attachment position information for the decorative object may indicate that the decorative object is attached to the "torso" of the character object.

[0057] Each gift object may have a display time set according to its type. In one embodiment, the display time of a decorative object may be set to be longer than the display time of an effect object and a normal object. For example, the display time of a decorative object may be set to 60 seconds, the display time of an effect object to be set to 5 seconds, and the display time of a normal object to be set to 10 seconds.

[0058] The possession list 23c is a list showing the gift objects owned by the video viewer. An example of the possession list 23c is shown in Figure 3. As shown in the figure, the possession list 23c stores object IDs that identify the gift objects owned by the viewer, associated with the viewer's account information (e.g., the viewer's user ID). These viewer users include, for example, the first to third viewer users of client devices 10a to 10c.

[0059] Candidate list 23d is a list of decorative objects that have been requested to be displayed by viewing users. As described later, viewing users who possess decorative objects can request to display the decorative objects they possess. In candidate list 23d, the object ID that identifies the decorative object is stored in association with the account information of the viewing user who made the request to display the decorative object. This candidate list 23d may be created for each broadcaster. Candidate list 23d may be stored in association with broadcaster identification information that identifies the broadcaster (Actor A1, Actor A2, Supporter B1, and / or Supporter B2), for example.

[0060] Next, the functions implemented by the computer processor 21 will be described in more detail. The computer processor 21 functions as a body motion data generation unit 21a, a face motion data generation unit 21b, an animation generation unit 21c, a video generation unit 21d, a video distribution unit 21e, a display request processing unit 21f, a decorative object selection unit 21g, and an object purchase processing unit 21h by executing computer-readable instructions included in the distribution program. At least some of the functions implemented by the computer processor 21 may be implemented by a computer processor other than the computer processor 21 of the video distribution system 1. At least some of the functions implemented by the computer processor 21 may be implemented, for example, by a computer processor installed in the supporter computer 40.

[0061] The body motion data generation unit 21a generates first body motion data for each part of actor A1's body based on the detection information from each of the motion sensors 31a to 31f, and generates second body motion data, which is a digital representation of the position and orientation of each part of actor A2's body, based on the detection information from each of the motion sensors 32a to 32f. In this specification, the first body motion data and the second body motion data may be collectively referred to simply as "body motion data". Body motion data is generated as time progresses. For example, body motion data may be generated at predetermined sampling time intervals. In this way, body motion data can represent the body movements of actor A1 and actor A2 as digital data in a time series. In the illustrated embodiment, motion sensors 31a-31f and 32a-32f are attached to the left and right limbs, waist, and head of actor A1 and actor A2, respectively. Therefore, based on the detection information from motion sensors 31a-31f and 32a-32f, it is possible to digitally represent the position and orientation of almost the entire body of actor A1 and actor A2 over time. The body motion data can, for example, define the position and rotation angle of the bones that make up the rig data included in the model data 23a.

[0062] The face motion data generation unit 21b generates first face motion data, which is a digital representation of actor A1's facial movements, based on the image data from camera 37a, and also generates second face motion data, which is a digital representation of actor A2's facial movements, based on the respective image data from camera 38a. In this specification, the first face motion data and the second face motion data may be collectively referred to simply as "face motion data." Face motion data is generated as time progresses. For example, face motion data may be generated at predetermined sampling time intervals. In this way, face motion data can digitally represent actor A2 and actor A2's facial movements (changes in facial expression) in a time series.

[0063] The animation generation unit 21c is configured to generate animations of character objects that move and change facial expressions in a virtual space by applying body motion data generated by the body motion data generation unit 21a and face motion data generated by the face motion data generation unit 21b to predetermined model data included in the model data 23a. Specifically, the animation generation unit 21c can generate animations of character objects that move in sync with the body and facial movements of actor A1 based on first body motion data and first face motion data relating to actor A1, and can generate animations of character objects that move in sync with the body and facial movements of actor A2 based on second body motion data and second face motion data relating to actor A2. In this specification, character objects generated based on the movements and facial expressions of actor A1 are sometimes referred to as "first character objects," and character objects generated based on the movements and facial expressions of actor A2 are sometimes referred to as "second character objects."

[0064] The video generation unit 21d constructs a virtual space using object data 23b and generates a video that includes this virtual space, the animation of a first character object corresponding to actor A1, and the animation of a second character object corresponding to actor A2. The first character object is positioned in the virtual space to match the position of actor A1 relative to the tracking sensor 36a, and the second character object is positioned in the virtual space to match the position of actor A2 relative to the tracking sensor 36a. Therefore, by changing the position or orientation of the tracking sensor 36a, the positions and orientations of the first and second character objects in the virtual space can be changed.

[0065] In one embodiment, the video generation unit 21d constructs a virtual space based on the tracking information of the tracking sensor 36a. For example, the video generation unit 21d determines the setting information of a virtual camera (position in the virtual space, gaze position, gaze direction, and field of view) based on the tracking information of the tracking sensor 36a, determines the drawing area of ​​the entire virtual space based on this setting information of the virtual camera, and generates video information for displaying the drawing area of ​​this virtual space.

[0066] The video generation unit 21d may be configured to determine the position and orientation of the first character object and the second character object in the virtual space, as well as the setting information of the virtual camera, based on the tracking information of the tracking sensor 36b, in place of the tracking information of the tracking sensor 36a, or in addition to the tracking information of the tracking sensor 36a.

[0067] The video generation unit 21d can synthesize the voices of actors A1 and A2, acquired from the microphone of the studio unit 30, into the generated video.

[0068] As described above, the video generation unit 21d can generate animations for a first character object that move in sync with the body and facial movements of actor A1, and animations for a second character object that move in sync with the body and facial movements of actor A2, and generate a video for distribution in which the voices of actor A1 and actor A2 are synthesized with these animations.

[0069] The video distribution unit 21e distributes the video generated by the video generation unit 21d. This video is distributed via the network 50 to client devices 10a to 10c and other client devices. The received video is played back on client devices 10a to 10c.

[0070] This video may be streamed to a client device (not shown) installed in studio room R, and projected onto screen S via a short-throw projector from this client device. Alternatively, this video may be streamed to supporter computer 40. This allows supporters B1 and B2 to view the streamed video on their screens.

[0071] Figure 5 shows an example of a video being displayed on a client device 10a, which is being played back by the server device 20. As shown in the figure, the display image 70 of the video distributed from the server device 20 is displayed on the display of the client device 10a. The display image 70 displayed on the client device 10a includes a character object 71A corresponding to actor A1, a character object 71B corresponding to actor A2, and an object 72 representing a table, all within a virtual space. Object 72 is not a gift object, but one of the objects included in the object data 23b for constructing the virtual space. Character object 71A is generated by applying actor A1's first body motion data and first face motion data to the model data for actor A1 included in the model data 23a. Character object 71A is motion-controlled based on the first body motion data and first face motion data. Character object 71B is generated by applying actor A2's second body motion data and second face motion data to the model data for actor A2 included in the model data 23a. Character object 71B is motion-controlled based on second body motion data and second face motion data. Therefore, character object 71A is controlled to move on screen in sync with the body and facial movements of actor A1, and character object 71B is controlled to move on screen in sync with the body and facial movements of actor A2.

[0072] As described above, the video streamed from the server device 20 may also be streamed to the supporter computer 40. The video streamed to the supporter computer 40 is displayed on the supporter computer 40 in the same manner as in Figure 5. Supporters B1 and B2 can view the video being played on the supporter computer 40 and change the settings of the components of the studio unit 30. In one embodiment, if supporters B1 and B2 want to change the angles of character objects 71A and 71B in the video being streamed, they can send an instruction signal from the supporter computer 40 to the tracking sensor 36a to instruct it to change its orientation. The tracking sensor 36a can change its orientation in response to the instruction signal. For example, the tracking sensor 36a may be rotatably mounted on a stand via a rotating mechanism with an actuator built into its axis, and when the tracking sensor 36a receives an instruction signal to change its orientation, the actuator of the rotating mechanism is driven based on the instruction signal, and the tracking sensor 36a may rotate by an angle corresponding to the instruction signal. In one embodiment, supporters B1 and B2 may send instructions from the supporter computer 40 to the tracking sensors 36a and 36b to use tracking information from tracking sensor 36b instead of tracking information from tracking sensor 36a.

[0073] In one embodiment, if supporters B1 and B2 determine that instructions are needed for actor A1 or actor A2 after watching the video being played on the supporter computer 40, they can input a message indicating the instructions into the supporter computer 40 and output this message to the display 39. For example, supporters B1 and B2 can instruct actor A1 or actor A2 to change their position through the message displayed on the display 39.

[0074] The display request processing unit 21f receives a request to display a gift object from the viewing user's client device and processes the request accordingly. Each viewing user can send a request to display a gift object to the server device 20 by operating their own client device. For example, the first viewing user can send a request to display a gift object to the server device 20 by operating their client device 10a. The request to display a gift object may include the viewing user's user ID and identification information (object ID) that identifies the object to be displayed.

[0075] As described above, a gift object may include effect objects, normal objects, and decorative objects. Effect objects and normal objects are examples of the first type of object. A display request that requests the display of an effect object or a normal object is an example of the second type of display request.

[0076] In one embodiment, when the display request processing unit 21f receives a request from a viewer to display a specific effect object, it performs processing to display the requested effect object on the video display image 70 based on the display request. For example, if a request is made to display an effect object corresponding to confetti, the display request processing unit 21f displays an effect object 73 representing confetti on the display image 70 based on the display request, as shown in Figure 6.

[0077] In one embodiment, when the display request processing unit 21f receives a request from a viewer to display a specific normal object, it performs processing to display the requested normal object in the video 70 based on the display request. For example, if a request is made to display a normal object representing a teddy bear, the display request processing unit 21f displays the normal object 74 representing the teddy bear in the display image 70 based on the display request, as shown in Figure 6.

[0078] A request to display a normal object 74 may include a display position specification parameter that specifies the display position of the normal object 74 within the virtual space. In this case, the display request processing unit 21f can display the normal object 74 at the position specified by the display position specification parameter within the virtual space. For example, the display position specification parameter can be used to specify the display position of the normal object 74 above the object 72 that represents a table. By using the display position specification parameter, the viewer can see the display of character objects 71A, character objects 71B, gift objects, and other objects included in the video 70 and specify the position where they want to display the normal object.

[0079] In one embodiment, the normal object 74 may be displayed to move within the display image 70 of the video. For example, the normal object 74 may be displayed to fall from the top of the screen downwards. In this case, the normal object 74 may be displayed within the display image 70 from the start of the fall until it falls to the floor of the virtual space constituting the video 70, and may disappear from the display image 70 after falling to the floor. The viewer can see the falling normal object 74 from the start of the fall until the end of the fall. The direction of movement of the normal object 74 within the screen can be set arbitrarily. For example, the normal object 74 may be displayed in the display image 70 to move from left to right, right to left, from the top left to the bottom left, or in any other direction within the video 70. The normal object 74 can move along various trajectories. For example, the normal object 74 can move along a linear trajectory, a circular trajectory, an elliptical trajectory, a spiral trajectory, or any other trajectory. A viewer user may, in addition to or instead of a display position parameter, include in a request to display a normal object a movement direction parameter specifying the direction of movement of the normal object 74 and a trajectory parameter specifying the trajectory of the normal object 74. In one embodiment, effect objects and normal objects whose size in virtual space is smaller than the reference size (e.g., confetti pieces of effect object 73) may be displayed overlapping with character objects 71A and 71B, in whole or in part. In one embodiment, effect objects and normal objects whose size in virtual space is larger than the reference size (e.g., normal object 74 (teddy bear)) are displayed in a position that does not overlap with character objects. In one embodiment, if an effect object or normal object whose size in virtual space is larger than the reference size (e.g., normal object 74 (teddy bear)) overlaps with at least one of character objects 71A or 71B, it is displayed behind the overlapping character object.

[0080] In one embodiment, when the display request processing unit 21f receives a display request for a specific decorative object from a viewing user, it adds the requested decorative object to the candidate list 23d based on the display request. A display request for a decorative object is an example of a first display request. For example, the display request processing unit 21f can store identification information (object ID) that identifies the specific decorative object requested by the viewing user in the candidate list 23d, in association with the user ID of the viewing user (see Figure 4). If multiple display requests for decorative objects are made, for each of the multiple display requests, the user ID of the viewing user who made the request and the decorative object ID of the decorative object requested by the viewing user are stored in the candidate list 23d in association.

[0081] In one embodiment, the decorative object selection unit 21g performs processing to display the selected decorative objects on the video display image 70 when one or more decorative objects included in the candidate list 23d are selected. In this specification, the decorative objects selected from the candidate list 23d may be referred to as "selected decorative objects".

[0082] The selection of a decorative object from the candidate list 23d is performed, for example, by supporters B1 and B2 operating the supporter computer 40. In one embodiment, a decorative object selection screen is displayed on the supporter computer 40. Figure 8 shows an example of a decorative object selection screen 80 in one embodiment. This decorative object selection screen 80 is displayed, for example, on the display of the supporter computer 40. The decorative object selection screen 80 displays each of the multiple decorative objects included in the candidate list 23d in a tabular format, for example. As shown in the figure, the decorative object selection screen 80 in one embodiment has a first column 81 that displays the type of decorative object, a second column 82 that displays an image of the decorative object, and a third column 83 that displays the part of the character object to which the decorative object is associated. The decorative object selection screen 80 also displays selection buttons 84a to 84c for selecting each decorative object. In this way, the decorative object selection screen 80 displays decorative objects that are candidates for the selected decorative object.

[0083] Supporters B1 and B2 can select one or more decorative objects from the decorative object selection screen 80. For example, supporters B1 and B2 can select a headband by selecting the selection button 84a. When the decorative object selection unit 21g detects that a headband has been selected, the display request processing unit 21f displays the selected decorative object 75, which represents the selected headband, on the video display screen 70, as shown in Figure 7. The selected decorative object 75 is displayed on the display image 70 in association with a specific part of the character object. The selected decorative object 75 may be displayed so as to be in contact with that specific part of the character object. For example, the selected decorative object 75 representing a headband is associated with the head of the character object, and is therefore attached to the head of the character object 71A, as shown in Figure 7. The decorative object may be displayed on the display screen 70 so as to move in conjunction with the movement of that specific part of the character object. For example, when the head of character object 71A, which is wearing a headband, moves, the selected decorative object 75 representing the headband also moves along with the head of character object 71A, as if the headband were attached to the head of character object 71A.

[0084] As described above, the object data 23b may include attachment position information indicating which part of the character object the decorative object is associated with. In one embodiment, the decorative object selection unit 21g may prevent the selection of decorative objects included in the candidate list 23d that are attached to parts that overlap with the attachment position information of decorative objects already attached to the character object, from being selected as the selected decorative object 75. For example, a headband associated with "back left side of the head" and "back right side of the head" and a hair accessory associated with "back left side of the head" cannot be attached at the same time because they overlap in terms of "back left side of the head". On the other hand, a headband associated with "back left side of the head" and "back right side of the head" and earrings associated with "(of the head) left ear" and "(of the head) right ear" can be attached at the same time because they do not overlap in terms of specific parts of the character object.

[0085] The selected decorative object 75 may be associated with character object 71B instead of character object 71A and displayed on the display screen 70. The selected decorative object 75 may be associated with both character object 71A and character object 71B and displayed on the display screen 70.

[0086] In one embodiment, the decorative object selection screen 80 may be configured not to include information that can identify the user who owns each decorative object, or the user who requested the display of each decorative object. This prevents a selector from giving preferential treatment to a particular user when selecting a decorative object.

[0087] In one embodiment, the decorative object selection screen 80 may display information about the user who owns each decorative object, or, for each decorative object, the user who requested the display of that decorative object. For example, for each decorative object, the screen may display the number of times the user who requested the display of that decorative object has requested the display of that decorative object and the number of times it has been selected (for example, information indicating that the user has requested the display of the decorative object 5 times and that it has been selected 2 times), the number of times the user has watched videos of at least one of character object 71A and character object B, the number of times the user has watched videos in the video distribution system 1 (regardless of whether character object 71A and character object B appear in them), the amount the user has spent on gift objects, the number of times the user has purchased objects, the points the user owns that can be used in the video distribution system 1, the user's level in the video distribution system 1, and various other information about the user who requested the display of each decorative object. According to this embodiment, decorative objects can be selected based on the user's past actions and viewing history in the video distribution system 1.

[0088] In one embodiment, restrictions may be imposed on the display of decorative objects to eliminate duplication. For example, with respect to character object 71A, if a decorative object associated with a particular part of it has already been selected, the selection of other decorative objects associated with that particular part may be prohibited. As shown in the embodiment of Figure 7, if a headband associated with the "head" of character object 71B has already been selected, other decorative objects associated with the "head" (for example, a decorative object representing a "hat" associated with the head) may not be displayed on the decorative object selection screen 80, or the selection button for selecting the decorative object representing the hat may be disabled on the selection screen 80. According to this embodiment, it is possible to prevent decorative objects from being displayed redundantly on a particular part of the character object.

[0089] The decorative object selection screen 80 may be displayed on another device in place of, or in addition to, the supporter computer 40. For example, the decorative object selection screen 80 may be displayed on at least one of the display 39 and screen S in the studio room R. In this case, actors A1 and A2 can select their desired decorative objects based on the decorative object selection screen 80 displayed on the display 39 or screen S. The selection of decorative objects by actors A1 and A2 can be done, for example, by operating controller 33a, controller 33b, controller 34a, or controller 34b.

[0090] In one embodiment, the object purchase processing unit 21h transmits purchase information for each of several gift objects available for purchase in relation to a video to the viewer's client device (e.g., client device 10a) in response to a request from the viewer of the video. The purchase information for each gift object may include the type of gift object (effect object, normal object, or decorative object), the image of the gift object, the price of the gift object, and other information necessary for purchasing the gift object. The viewer can select the gift object to purchase based on the purchase information of the gift object displayed on the client device 10a. The selection of the gift object to be purchased may be performed by operating the client device 10a. Once the viewer has selected the gift object to be purchased, a purchase request for that gift object is sent to the server device 20. The object purchase processing unit 21h performs a settlement process based on the purchase request. Once this settlement process is completed, the purchased gift object is held by the viewer. In this case, the object ID of the purchased gift object is stored in the holding list 23c in association with the user ID of the viewer who made the purchase.

[0091] The purchasable gift objects may differ from video to video. The same purchasable gift objects may be available across multiple videos. In other words, purchasable gift objects may include unique gift objects specific to each video, and common gift objects available across multiple videos. For example, an effect object representing confetti may be a common gift object available across multiple videos.

[0092] In one embodiment, if an effect object is purchased while watching a predetermined video, the purchased effect object may be automatically displayed in the video being watched once the payment processing for the purchase of the effect object is completed. Similarly, if a regular object is purchased while watching a predetermined video, the purchased regular gift object may be automatically displayed in the video being watched once the payment processing for the purchase of the regular object is completed.

[0093] In another embodiment, when the settlement process for the purchased effect object is completed in the object purchase processing unit 21h, a settlement completion notification may be sent to the client device 10a, and a confirmation screen may be displayed on the client device 10a to ask the viewer whether or not to request the display of the purchased effect object. If the viewer chooses to request the display of the purchased effect object, a display request requesting the display of the purchased effect object is sent from the viewer's client device to the display request processing unit 21f, and the display request processing unit 21f may perform the process of displaying the purchased effect object in the video 70. In the case of a normal object, a confirmation screen may be displayed on the client device 10a in the same manner as above to ask the viewer whether or not to request the display of the purchased normal object.

[0094] Next, a video distribution process according to one embodiment will be described with reference to Figures 9 to 11. Figure 9 is a flowchart showing the flow of the video distribution process in one embodiment, Figure 10 is a flowchart showing the flow of the process for displaying a normal object in one embodiment, and Figure 11 is a flowchart showing the flow of the process for displaying a decorative object in one embodiment. In the video distribution process, it is assumed that actors A1 and A2 are performing in studio room R.

[0095] First, in step S11, body motion data, which is a digital representation of the body movements of actors A1 and A2, and face motion data, which is a digital representation of the facial movements (expressions) of actors A1 and A2, are generated. The body motion data is generated, for example, by the body motion data generation unit 21a described above, and the face motion data is generated, for example, by the face motion data generation unit 21b described above.

[0096] Next, in step S12, the body motion data and face motion data of actor A1 are applied to the model data for actor A1 to generate an animation of a first character object that moves in sync with the body and facial movements of actor A1. Similarly, the body motion data and face motion data of actor A2 are applied to the model data for actor A2 to generate an animation of a second character object that moves in sync with the body and facial movements of actor A2. This animation generation is performed, for example, by the animation generation unit 21c described above.

[0097] Next, in step S13, a video is generated that includes the animation of a first character object corresponding to actor A1 and the animation of a second character object corresponding to actor A2. The voices of actor A1 and actor A2 may be synthesized into this video. The animations of the first character object and the second character object may be placed in a virtual space. This video generation is performed, for example, by the video generation unit 21d described above.

[0098] Next, the process moves to step S14, where the video generated in step S13 is distributed. This video is distributed via the network 50 to client devices 10a to 10c and other client devices. This video is also distributed to the supporter computer 40 and may be projected onto the screen S in the studio room R. The video is distributed continuously for a predetermined distribution period. The distribution period of the video can be set to, for example, 30 seconds, 1 minute, 5 minutes, 10 minutes, 30 minutes, 60 minutes, 120 minutes, and any other arbitrary time.

[0099] Next, the process proceeds to step S15, where it is determined whether the termination conditions for ending the video distribution have been met. The termination conditions include, for example, reaching the distribution end time, receiving an instruction from the supporter computer 40 to end the distribution, or other conditions. If the termination conditions have not been met, the processes in steps S11 to S14 are repeated, and the distribution of the video, which includes animation synchronized with the movements of actors A1 and A2, continues. If it is determined that the termination conditions for a video have been met, the distribution process for that video is terminated.

[0100] Next, referring further to Figure 10, we will explain the display process of normal objects that takes place during video distribution. The display process of normal objects is performed in parallel with the video distribution process shown in Figure 9.

[0101] During video distribution, step S21 determines whether or not a request to display a normal object has been made. For example, a first viewer user can select one or more specific normal objects from among the normal objects they own and send a display request from the client device 10a to the server device 20 requesting the display of these selected normal objects. As described above, a display request for a predetermined normal object may be generated in response to the purchase or payment processing of that predetermined normal object.

[0102] When a request to display a normal object is made, the display process proceeds to step S22. In step S22, based on the display request, processing is performed to display the normal object that was requested to be displayed in the video being streamed. For example, if a request to display a normal object 74 is made while a predetermined video is being streamed, the normal object 74 that was requested to be displayed will be displayed in the video display screen 70, as shown in Figure 6.

[0103] If no request for display of a normal object has been made, the normal object display process will terminate. The normal object display process shown in Figure 10 is repeated throughout the video distribution period.

[0104] The display process for effect objects can also be carried out using the same procedure as the display process for normal objects described above. For example, if a request to display an effect object 73 is made during the distribution of a given video, the requested effect object 73 will be displayed on the video display screen 70, as shown in Figure 6. The effect object 73 shown in Figure 6 is an object that imitates confetti. The confetti-like effect object 73 is displayed so as to overlap with (or touch) character objects 71A and 71B, but differs from decorative objects in that it is not associated with any specific part of character objects 71A and 71B.

[0105] Next, referring further to Figure 11, the display process of decorative objects performed during video distribution will be explained. The display process of decorative objects is performed in parallel with the video distribution process shown in Figure 9. Alternatively, the display process of decorative objects may be performed in parallel with the display process of normal objects shown in Figure 10.

[0106] During video distribution, step S31 determines whether or not a request to display a decorative object has been made. For example, a first viewer user can select a first decorative object from their own decorative objects and send a display request from the client device 10a to the server device 20 requesting the display of this selected first decorative object.

[0107] If a request is made to display the first decorative object, the display process proceeds to step S32. In step S32, based on the display request, the first decorative object that was requested to be displayed is added to the candidate list. The candidate list is a list of objects that are candidates for decorative objects to be displayed in the video being streamed, for example, the candidate list 23d described above.

[0108] Next, in step S33, it is determined whether a specific decorative object has been selected from among the decorative objects stored in the candidate list.

[0109] If a specific decorative object is selected, in step S34, the selected decorative object ("selected decorative object") is removed from the candidate list, and processing is performed to display the selected decorative object on the display screen of the video being streamed. For example, if a decorative object 75 is selected from the candidate list while the video 70 shown in Figure 5 is being streamed, the selected decorative object 75 will be displayed in the display image 70, as shown in Figure 7. The first decorative object for which a display request was made in step S31 will be displayed in the display image 70 if it is selected from the candidate list while the video is being streamed, but will not be displayed in the display image 70 if it is not selected.

[0110] If no decorative object is selected from the candidate list in step S33, or if the display process for the selected decorative object is completed in step S34, the display process for the decorative object proceeds to step S35. In step S35, it is determined whether or not the distribution of the video being streamed has ended. In step S35, the determination may be made using the same criteria as in step S15, for example. If it is determined in step S35 that the distribution has not ended, the display process for the decorative object returns to step S31, and the processes in steps S31 to S35 are repeated. If it is determined that the distribution has ended, the display process for the decorative object proceeds to step S36.

[0111] In step S36, processing is performed on decorative objects (sometimes referred to as "unselected objects" in this specification) that remain in the candidate list at the end of video distribution. In this specification, the processing performed in step S36 is sometimes referred to as unselected object processing.

[0112] Non-selected objects are those purchased by the viewing user and whose display is requested during the video distribution. Therefore, the non-selected object processing performed in step S36 may be a process of refunding the purchase cost of the non-selected object to the viewing user who requested the display of the non-selected object. In another embodiment, the non-selected object processing may be a process of canceling the payment processing for purchasing the non-selected object. In another embodiment, the non-selected object processing may be a process of providing the viewing user who requested the display of the non-selected object with a decorative object different from the non-selected object.

[0113] In another embodiment, the non-selected object processing may involve granting the user of the non-selected object points that can be used in the video distribution system 1, instead of refunding the purchase cost or canceling the payment process. The video distribution system 1 may be configured to consume points in order to watch videos. The points granted to the user of the non-selected object by the non-selected object processing may be points that can be used to watch videos in the video distribution system 1.

[0114] In another embodiment, the non-selected object processing may involve adding the non-selected object to the possession list as an object owned by the first viewer. This allows the first viewer to receive the non-selected object back.

[0115] In another embodiment, the non-selected object processing may be a process for retaining the candidate list at the end of a video distribution until the next time the same distributor distributes a video. This allows the distributor to carry over the candidate list used in the previous video distribution when distributing the next video. This carried-over candidate list includes decorative objects (i.e., non-selected objects) that were requested to be displayed during the previous video distribution but were not actually displayed in the video. As a result, the next video distribution is performed using the candidate list that includes the non-selected objects from the previous video distribution. These non-selected objects may be selected in the next video distribution and displayed in that video.

[0116] After the processing in step S36 is completed, the display process for the decorative object ends.

[0117] In one embodiment, an object display prohibition section may be provided within the video distribution where the display of gift objects is prohibited. Figure 12 is a schematic diagram illustrating the object display prohibition section. Figure 12 shows that the video is being distributed between time t1 and time t2. That is, time t1 is the start time of the video distribution, and time t2 is the end time of the video distribution. The object display prohibition period 81 is the period between time t3 and time t4 within the video distribution period. Even if a request r1 to display a gift object is made during this object display prohibition period 81, the gift object will not be displayed in the video's display image during the object display prohibition period 81. Specifically, if a request to display an effect object or a normal object among the gift objects is made during the object display prohibition period 81, the requested effect object or normal object will not be displayed in the video being distributed during the object display prohibition period 81, but will be displayed in the video after the object display prohibition period 81 has elapsed (i.e., after time t4). Furthermore, if a decorative object is selected from the candidate list during the object display prohibition period 81, the selected decorative object will not be displayed in the video being streamed during that period, but will be displayed in the video after the object display prohibition period 81 has elapsed. Requests to display decorative objects may be accepted within the object display prohibition period 81. That is, if a request to display a decorative object is made during the object display prohibition period 81, the decorative object for which the display request was made may be added to the candidate list even within the object display prohibition period 81.

[0118] According to the above embodiment, the gift object includes three types: decorative objects, normal objects, and effect objects. Of these, only decorative objects are displayed in association with character objects. In videos where the animation of a character object is displayed, the animation of the character object is considered to be an element that attracts the viewer's attention. For example, in the videos shown in Figures 5 to 7, it is considered that attention will be drawn to character objects 71A and 71B. In the above embodiment, even if there is a request to display a decorative object that is displayed in association with character objects 71A and 71B, the decorative object will not be displayed in the video until it is selected from the candidate list 23d, thereby preventing decorative objects from being displayed clutteredly around or overlapping with the character object. This prevents a deterioration in the viewer's viewing experience.

[0119] In conventional video distribution systems, gift objects, regardless of their type, were displayed in a video only when a display request was made. Therefore, allowing duplicate display of gift objects in a video would result in a large number of gift objects being displayed in that video, degrading the viewing experience for users. In the above embodiment, by creating a category of decorative objects that are displayed in association with character objects, the number (amount) of decorative objects displayed in association with character objects, which are the main part of the video, can be suppressed.

[0120] The normal object 74 among the gift objects is displayed in the video in response to a display request from the viewer. In the above embodiment, the normal object 74 is displayed on the video display screen 70 so as not to touch or overlap with the character objects 71A and 71B, so that it has little impact on the visibility of the character objects 71A and 71B. According to this embodiment, it is possible to prevent deterioration of the user's viewing experience due to poor visibility of the character objects.

[0121] Among the gift objects, the effect object 73 and the normal object 74 are displayed in the video in response to a display request from the viewer. In the above embodiment, the effect object 73 and the normal object 74 are displayed on the display screen 70 for a shorter time than the decorative object 75, so they have little impact on the visibility of the character object 71A and the character object 71B. According to this embodiment, it is possible to prevent deterioration of the user's viewing experience due to poor visibility of the character object.

[0122] In the above embodiment, the selection of decorative objects from the candidate list 23d is made by someone other than the viewing user who requested the display of the decorative object (for example, supporter B1, supporter B2, actor A1, or actor A2), thus making it possible to suppress the number of decorative objects displayed.

[0123] According to the above embodiment, during the object display prohibition period 81, the gift object is not displayed in the video. As a result, the created video can be viewed without being interrupted by the gift object. For example, by setting the object display prohibition period 81 to the time when actors A1 and A2 perform visual performances in the video, the actors' performances can be shown to the viewer without being interrupted by the first object and decorative objects.

[0124] According to the above embodiment, viewers who watch videos containing character objects such as character object 71A and character object 71B are likely to develop an attachment to those character objects. Therefore, their satisfaction is higher when decorative objects are attached to the character objects than when effect objects or regular objects are attached to them. In this way, decorative objects that can be attached to character objects provide users with an incentive to repeatedly watch videos containing those character objects.

[0125] In the video distribution system 1 according to the above embodiment, users can send decorative objects to characters. This allows for a more unique system compared to systems where such decorative objects cannot be sent, and enables the provision of a more unique service. As a result, the video distribution system 1 can attract more users, and thus increase the number of views of videos on the video distribution system 1.

[0126] The embodiments of the present invention are not limited to those described above, and various modifications are possible without departing from the spirit of the invention. For example, the distributed video may be filmed and produced outside of Studio Room R. For example, filming for generating the distributed video may take place at the homes of actors or supporters.

[0127] In the processing procedures described herein, particularly those described using flowcharts, it is possible to omit some of the steps constituting the processing procedure, to add steps not explicitly stated as constituting the processing procedure, and / or to change the order of such steps. Processing procedures with such omissions, additions, or changes in order are also included within the scope of the present invention, as long as they do not depart from the spirit of the invention. [Explanation of Symbols]

[0128] 1. Video distribution system

Claims

[Claim 1] A video distribution server comprising one or more computer processors, The one or more computer processors execute computer-readable instructions, The system distributes a video that includes an animation of a character object generated based on the movements of an actor, and a first decorative object that is displayed in association with a first part of the character object. The system receives a display request from a viewer of the aforementioned video during its distribution, requesting the display of a second decorative object on the video. If the second decorative object is an object that is displayed in association with a second part of the character object that is different from the first part, in response to receiving the display request, a decorative object selection screen is generated that includes an image of the second decorative object and a display element for selecting the second decorative object. In response to the selection of the display element, the second decorative object is displayed in the video in association with the second part of the character object. If the second decorative object is an object displayed in association with the first part of the character object, in response to receiving the display request, a decorative object selection screen is generated which includes an image of the second decorative object but does not include a display element for selecting the second decorative object. Video streaming server.

Images