PROGRAM, INFORMATION PROCESSING METHOD AND INFORMATION PROCESSING APPARATUS

Abstract

To distribute a video which avoids boring a viewer user, by properly setting opportunities to display objects provided to a distribution user.SOLUTION: A control unit 20 of a user device 12 which displays a video on a display displays in the video a first avatar object, which reflects motion of a first user, and a second avatar object, which reflects motion of a second user; and, when a distribution situation of the video satisfies a display condition of a provision object, displays a second gift object associated with the first avatar object and displays a second gift object associated with the second avatar object. When a third avatar object corresponding to a third user is newly added to the video, the control unit 20 adds a second gift object associated with the third avatar object.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a program, an information processing method, and an information processing device for distributing or viewing a moving image. [Background technology]

[0002] Conventionally, a video distribution system that distributes a video including an animation of an avatar object based on a distribution user's movement has been known (see, for example, Patent Document 1). In this type of video distribution system, a function has been proposed that allows an arbitrary object to be displayed in the video in response to a display request transmitted from a terminal used by a viewing user who views the video. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2015-184689 A Summary of the Invention [Problem to be solved by the invention]

[0004] In the above video distribution system, the communication between the distribution user and the viewing user is activated through the distribution user's response to the gift object, and the viewing user's satisfaction with the video is increased. Another advantage is that a request to display the gift object induces other viewing users to also make a request to display the gift object. Therefore, if the opportunities to display the gift object increase in this way, it is expected that the number of viewing users of the video, the viewing time per viewing user, or the cumulative viewing time of all viewing users will increase.

[0005] In a video distribution system, a large number of gift objects tend to be displayed in videos distributed by popular broadcasters. On the other hand, a small number of gift objects tend to be displayed in videos distributed by broadcasters with a small number of viewers. This tendency is particularly noticeable among novice users who have only recently started distributing videos.

[0006] In response to this, it is conceivable to automatically display the gift object in the video regardless of the display request of the viewing user. However, simply increasing the number of opportunities for the gift object to be displayed without a display request will result in a decrease in the value of the gift object. If the value of the gift object decreases, even if the number of opportunities for displaying the gift object increases, the viewing user will no longer be interested in the display of the gift object, and the effect of increasing the number of viewing users, the viewing time, and the cumulative viewing time will decrease. For this reason, it is desirable to provide appropriate opportunities for displaying the gift object. [Means for solving the problem]

[0007] A program for solving the above problem causes a computer that displays moving images on a display to function as a first image processing unit that displays a moving image of a first avatar object that reflects the movements of a first user and a second avatar object that reflects the movements of a second user.

[0008] The program also functions as a first gift object display processing unit that displays a first gift object in response to a display request sent by a viewing user watching the video, and a second image processing unit that displays the second gift object associated with the first avatar object and the second gift object associated with the second avatar object when a display condition for a second gift object that is displayed not based on a display request sent by the viewing user is met, and the second image processing unit displays the second gift object according to a scenario, and when the first user starts streaming the video halfway through the scenario within a predetermined period of time, starts displaying the second gift object from a scene corresponding to the start time of streaming the video.

[0009] An information processing method for solving the above problem includes a first image processing step in which a computer displaying a video on a display displays a first avatar object reflecting the movements of a first user and a second avatar object reflecting the movements of a second user in the video, a first display processing step in which a first gift object is displayed in response to a display request sent by a viewing user watching the video, and a second image processing step in which, when a display condition for a second gift object to be displayed not based on a display request sent by the viewing user is satisfied, the second gift object associated with the first avatar object and the second gift object associated with the second avatar object are displayed, wherein in the second image processing step, the second gift object is displayed according to a scenario, and if the first user starts broadcasting the video halfway through the scenario within a predetermined period of time, the display of the second gift object is started from a scene corresponding to the start point of broadcasting the video.

[0010] An information processing device that solves the above problem is an information processing device that displays a video on a display of a user device, and executes the following steps: a drawing data transmission step of transmitting to the user device data for drawing a first avatar object reflecting the movements of a first user and data for drawing a second avatar object reflecting the movements of a second user; a first display processing step of transmitting to the user device a request for displaying a first gift object in response to a display request transmitted by a viewing user watching the video as a display trigger; and a display request transmission step of transmitting to the user device a display request for the second gift object associated with the second avatar object along with a display request for the second gift object associated with the first avatar object when a display condition for a second gift object to be displayed not based on the display request transmitted by the viewing user is satisfied; in the display request transmission step, the display request for the second gift object is transmitted to the user device according to a scenario, and when the first user starts distributing the video halfway through the scenario within a predetermined period, a display request for the second gift object corresponding to a scene corresponding to the start point of distribution of the video is transmitted to the user device.

[0011] An information processing method of an information processing device that solves the above-mentioned problem is an information processing method executed by an information processing device that displays a video on a display of a user device, in which the information processing device executes a drawing data transmission step in which it transmits to the user device data for drawing a first avatar object reflecting the movements of a first user and data for drawing a second avatar object reflecting the movements of a second user, a first display processing step in which it transmits to the user device a request for displaying a first gift object in response to a display request transmitted by a viewing user watching the video as a display trigger, and a display request transmission step in which it transmits to the user device a display request for the second gift object associated with the second avatar object together with a display request for the second gift object associated with the first avatar object when a display condition for a second gift object to be displayed not based on the display request transmitted by the viewing user is satisfied, in which the display request transmission step transmits to the user device a display request for the second gift object associated with the second avatar object in accordance with a scenario, and when the first user starts distributing the video halfway through the scenario within a predetermined period, it transmits to the user device a display request for the second gift object corresponding to a scene corresponding to the start point of distribution of the video. Effect of the Invention

[0012] According to the present invention, by appropriately providing opportunities for displaying objects provided to distribution users, it is possible to distribute moving images that do not tire the viewing users. [Brief description of the drawings]

[0013] [Figure 1] FIG. 1 is a schematic diagram showing an embodiment of a video distribution system according to an embodiment. [Diagram 2] FIG. 4 is a diagram showing a data structure of a portion of user management information according to the embodiment. [Diagram 3] 13 is a diagram showing the positional relationship between a broadcast user and a user device in the real world in the embodiment. [Figure 4]4A to 4C are diagrams showing the movement directions of avatar objects in the embodiment. [Diagram 5] 13A and 13B are diagrams showing a display method of a gift object in the embodiment; [Figure 6] 11A and 11B are diagrams showing a method of displaying a guest avatar object in the embodiment; [Figure 7] 11A and 11B are diagrams showing a method of displaying a guest avatar object in the embodiment; [Figure 8] FIG. 4 is a diagram showing a distribution screen displayed on a user device according to the embodiment. [Figure 9] FIG. 13 is a diagram showing an approval screen for collaboration distribution displayed on a user device according to the embodiment. [Figure 10] FIG. 13 is a diagram showing a distribution screen displayed on a user device during collaboration distribution according to the embodiment. [Figure 11] 13 is a diagram showing a delivery screen including a gift object displayed on a user device of the embodiment. FIG. [Figure 12] FIG. 13 is a diagram showing a screen displayed on a user device during collaboration distribution according to the embodiment, in which an emote function is activated. [Figure 13] FIG. 13 is a diagram showing a screen displayed on a user device during collaboration distribution according to the embodiment, in which one emote function is activated. [Figure 14] FIG. 13 is a diagram showing a screen displayed on the user device during collaboration distribution according to the embodiment, in which another emote function is activated. [Figure 15] 13 is a diagram showing a delivery screen including a gift object displayed on a user device of the embodiment. FIG. [Figure 16] 10 is a chart showing the timing of displaying a gift object in the embodiment. [Figure 17] 13 is a sequence chart of a procedure for collaboration distribution and display of a gift object in the embodiment. [Figure 18] 13 is a flowchart showing a procedure for displaying a gift object in the embodiment. [Figure 19]13 is a sequence chart of a procedure for collaborative distribution and display of a gift object according to a modified example. [Figure 20] FIG. 13 is a schematic diagram of a video distribution system according to a modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Hereinafter, an embodiment of a video distribution system will be described with reference to the drawings. The video distribution system of this embodiment distributes videos in which avatar objects that move in response to user movements are displayed in a three-dimensional virtual space.

[0015] <Video distribution system> As shown in FIG. 1, a video distribution system 11 includes a user device 12 and a server 13. The video distribution system 11 is a system that displays videos on the user device 12 by transmitting and receiving data between a plurality of user devices 12 and the server 13 via a network 14. A video application program for viewing and distributing videos is installed on the user device 12. Hereinafter, a user who distributes a video is referred to as a "distribution user," and a user who views a video distributed by a distribution user is referred to as a "viewing user." A user is a viewing user when he or she contributes to viewing a video, and a distribution user when he or she distributes a video. In addition, when there is no distinction between a "distribution user" and a "viewing user," they are simply referred to as a "user."

[0016] The user device 12 is a smartphone (multifunction phone terminal), a tablet terminal, a personal computer, a console game machine, a head-mounted display, a wearable computer such as a glasses-type wearable terminal, or an information processing device capable of playing videos other than these devices. The user device 12 may be a standalone device that operates independently, or may be composed of multiple devices connected to each other so that various data can be transmitted and received between them.

[0017] The user device 12 includes a control unit 20, a storage 22 (storage medium), and a communication interface (I / F) 23. The control unit 20 includes one or more arithmetic circuits, such as a central processing unit (CPU), a graphic processing unit (GPU), and a neural network processing unit (NPU). The control unit 20 also includes a memory, which is a main storage device (recording medium) from which the arithmetic circuits can read and write. The memory is composed of a semiconductor memory or the like. The control unit 20 loads an operating system and other programs from the storage 22 or an external storage into the memory, and executes commands retrieved from the memory. The communication I / F 23 can transmit and receive data to and from the server 13 and other user devices 12 via the network 14. The network 14 includes various networks, such as a local area network and the Internet.

[0018] The storage 22 is an auxiliary storage device (recording medium), such as a magnetic disk, an optical disk, a semiconductor memory, or the like. A plurality of storages can be combined to be used as the storage 22. The storage 22 stores a video application program 220, avatar data 221 for drawing avatar objects, object data 222, and user management information 223.

[0019] The control unit 20 executes the video application program 220 to appropriately acquire various data from the server 13. In addition, the control unit 20 executes the video application program 220 to switch between a distribution mode in which the user himself / herself distributes a video in response to a user instruction and a viewing mode in which a video distributed by another distribution user is viewed.

[0020] The avatar data 221 is three-dimensional model data for drawing an avatar object. The user device 12 obtains data for updating the avatar data 221 from the server 13 at a predetermined timing, such as when the video application program 220 is started. The avatar data includes data for drawing an avatar object body, texture data applied to the avatar object body, and the like. The data for drawing the avatar object body includes polygon data, skeletal data (bones) for expressing the movement of the avatar object, and the like. The avatar data 221 may include data for drawing a plurality of avatar object bodies. The texture data includes a plurality of parts data applicable to the avatar object. For example, a plurality of parts data is prepared for each category, such as "eyes," "eyebrows," "ears," and "clothes." The user selects the parts data and applies it to the avatar object body to create an avatar object. The combination of the avatar object body and the parts data selected by the user is recorded in the storage 22.

[0021] The object data 222 is data downloaded from the server 13 at a predetermined timing. The object data 222 is information about objects other than avatar objects. The objects other than avatar objects include objects that the broadcasting user can display and gift objects provided by the viewing user to the broadcasting user. One type of gift object is a wearable object that is displayed on the display screen in association with a specific part of the avatar object. The wearable object is, for example, an accessory (hat, glasses, etc.) or clothing (T-shirt, etc.) that is worn on the wearable object, and other objects that can be worn on the avatar object. Other objects include, for example, objects made of two-dimensional images or two-dimensional particles such as fireworks or flames, and objects having three-dimensional coordinates that imitate stuffed toys or bouquets of flowers.

[0022] The object may also be an object that performs a physical behavior. Specifically, the object may simulate a physical behavior such as a fall due to gravity, a movement due to the application of a force, etc. A component (program) for simulating the physical behavior is associated with the physical behavior object in an executable manner.

[0023] The user management information 223 includes user identification information (user ID), information on an initially set avatar object, etc. The user management information 223 may also include user identification information (user ID), purchase media such as coins, points, distribution status, etc.

[0024] The user device 12 also includes a sensor unit 24, a speaker 25, a microphone 26, an operation unit 27, and a display 28. At least one of the sensor unit 24, the speaker 25, the microphone 26, the operation unit 27, and the display 28 may be provided as the same device as the control unit 20, or may be provided in a manner connected to a device including the control unit 20.

[0025] The sensor unit 24 is one or more sensors that detect face motions indicating changes in the user's facial expression and body motions indicating changes in the relative position of the user's body with respect to the sensor unit 24. Face motions include blinking, opening and closing of the mouth, and other movements. The sensor unit 24 may be a publicly known sensor. An example of the sensor unit 24 includes a ToF sensor that measures and detects the time of flight (Time of Flight) until light irradiated toward the user is reflected by the user's face or the like and returns, a camera that captures the user's face, and an image processing unit that processes the data captured by the camera. The sensor unit 24 may also include an RGB camera that captures visible light and a near-infrared camera that captures near-infrared light. For the RGB camera and the near-infrared camera, for example, the True Depth of the "iPhoneX (registered trademark)", the "LIDAR" of the "iPad Pro (registered trademark)", or other ToF sensors installed in smartphones can be used. Specifically, this camera projects tens of thousands of invisible dots (points) onto the user's face or the like using a dot projector. Then, the reflected light of the dot pattern is detected and analyzed to form a depth map of the face, and an infrared image of the face, etc. is captured, thereby capturing accurate facial data. The arithmetic processing unit of the sensor unit 24 generates various information based on the depth map and the infrared image, and compares the information with registered reference data to calculate the depth of each point of the face (the distance between each point and the near-infrared camera) and positional deviations other than the depth.

[0026] The sensor unit 24 may have a function of tracking not only the user's face but also the user's hands (hand tracking). The sensor unit 24 may further include sensors other than the above-mentioned sensors, such as an acceleration sensor and a gyro sensor. The sensor unit 24 may have a spatial mapping function of recognizing an object in the real space in which the user exists based on the detection results of the above-mentioned ToF sensor or other known sensors, and mapping the recognized object on a spatial map. Hereinafter, when the face motion detection data and the body motion detection data are not particularly distinguished from each other, they are simply referred to as "tracking data". The image processing unit of the sensor unit 24 may be provided in the control unit 20.

[0027] The speaker 25 converts voice data into voice and outputs it. The microphone 26 inputs voice spoken by the user and converts it into voice data. The display 28 outputs various images in response to an output instruction from the control unit 20. The operation unit 27 can be one that corresponds to the type of the user device 12. An example of the operation unit 27 is a touch panel integrated with the display 28, an operation button provided on the housing of the user device 12, a keyboard, a mouse, a controller operated by the user's hand, etc. The controller may incorporate various known sensors such as an acceleration sensor, an inertial measurement sensor (IMU: Inertial Measurement Unit) such as a gyroscope, etc. Another example of the operation unit 27 may be a tracking device that identifies the user's hand movement, eye movement, head movement, line of sight, etc. In this aspect, for example, the user's instruction can be determined based on the user's hand movement, and various operations can be performed such as starting or ending the distribution of a video, rating a message or a video, and requesting the display of a predetermined object (for example, a gift to be described later). In addition, if the sensor unit 24 also has an input interface function such as a hand truck function, the operation unit 27 can be omitted.

[0028] The control unit 20 executes a video application program 220 stored in the storage 22, thereby functioning as an application management unit 201 and a display control unit 202. The application management unit 201 is responsible for main control of the video application program. The application management unit 201 acquires a user request input through the operation unit 27 or a request from the server 13, and outputs a request to the display control unit 202 according to the contents of the request. In addition, the application management unit 201 transmits requests and various data from the display control unit 202 to the server 13, and transmits tracking data acquired from the sensor unit 24 to the server 13. In addition, the application management unit 201 records various data received from the server 13 in the storage 22.

[0029] In the distribution mode, the display control unit 202 applies tracking data acquired from the sensor unit 24 to the avatar data 221 to generate an animation. The display control unit 202 also performs rendering including the avatar object and objects other than the avatar object. The rendering here refers to a drawing process including acquisition of the position of the virtual camera, perspective projection, hidden surface removal (rasterization), and the like. The rendering may be at least one of these processes, or may include processes such as shading and texture mapping. The display control unit 202 also generates an animation using the rendered image. The display control unit 202 further outputs to the display 28 video data obtained by combining the animation with a posted message transmitted from the user device 12 of the viewing user or a notification transmitted from the server 13, and the like.

[0030] In the distribution mode, the display control unit 202 synchronizes the audio data and video data input from the microphone 26 and outputs them to the display 28. Furthermore, the display control unit 202 encodes the video data and audio data. The application management unit 201 transmits the encoded data to the server 13.

[0031] Furthermore, in viewing mode, display control unit 202 applies the tracking data of the broadcast user received from server 13 to avatar data 221 to generate animation. Also, display control unit 202 outputs objects other than the avatar object, posted messages, etc. received from server 13 to display 28. Furthermore, display control unit 202 outputs audio data received from server 13 from speaker 25 in synchronization with the video.

[0032] Next, the server 13 will be described. The server 13 is used by a service provider or the like that provides a service for distributing videos. The server 13 includes a control unit 30, a communication I / F 34, and a storage 35. The control unit 30 has a similar configuration to the control unit 20 of the user device 12. The control unit 30 may be configured by combining a plurality of arithmetic circuits. The communication I / F 34 and the storage 35 have the same configuration as the user device 12. The server 13 may be configured as one device, or may be configured as multiple devices. When the server 13 is configured as multiple devices, these devices have the functions of the control unit 30 and various data stored in the storage 35 in a distributed manner.

[0033] A distribution program 353 is stored in the storage 35. The control unit 30 executes the distribution program 353 to function as a distribution management unit 301 and a purchase processing unit 302.

[0034] The distribution management unit 301 stores various data received from the user device 12 in the storage 35, and outputs a request to the purchase processing unit 302 based on a purchase request or the like received from the user device 12. Furthermore, the distribution management unit 301 acquires data requested from the user device 12 from the storage 35 or the like and transmits it to the user device 12. Specifically, the distribution management unit 301 transmits a list of videos being distributed in response to a request from the user device 12 used by the viewing user. The distribution management unit 301 receives identification information of a video selected from the list from the user device 12. Furthermore, the distribution management unit 301 transmits tracking data, etc. acquired from the user device 12 used by the distribution user of the selected video to the user device 12. Furthermore, the distribution management unit 301 receives posted messages, etc. posted by the viewing user for the video being distributed. Furthermore, the distribution management unit 301 transmits the received posted messages to the user device 12 of the distribution user and the user device 12 of the viewing user. In addition to the content of the message, the posted message includes identification information of the viewing user (user account name, etc.), the posting date and time, etc. The message displayed in the video also includes a notification message saying "User A has entered the room."

[0035] The distribution management unit 301 receives a display request for an object on the video being viewed from the user device 12 used by the viewing user. The object for which a display request is made is an object displayed in a virtual space, and includes a gift object provided by the viewing user to the broadcasting user who broadcasts the video, an evaluation object that favorably evaluates the video, and the like. The gift object may be one for which a display request can be made without paying a fee, or one for which a display request can be made by paying a fee. Alternatively, the gift object may be one for which a fee is paid when the gift object is displayed in response to the display request. The distribution management unit 301 transmits a display request for the gift object to the user device 12 of the broadcasting user and the user device 12 of the viewing user together with identification information of the gift object. The server 13 transmits a notification message such as "User B has gifted fireworks" to the user device 12 of the broadcasting user and the user device 12 of the viewing user at a predetermined timing, such as when the display request for the gift object is accepted by the server 13, or when a predetermined operation is performed by the broadcasting user in response to the display request.

[0036] The purchase processing unit 302 performs a purchase process of an object according to a user's operation. The purchase process includes a process of paying a consideration (medium) such as coins, points, or tickets that can be used in a video application program. The purchase process may also include a process of exchanging, selling, or transferring an object. The purchase processing unit 302 may also execute a lottery (gacha) in which a predetermined number of objects are selected from a plurality of objects by paying a consideration. The purchase processing unit 302 records the purchased object in at least one of the user device 12 and the server 13 in association with the user. When a user purchases an object in the distribution mode (or in the closet mode before the start of distribution), the purchase processing unit 302 may store identification information of the purchased object in the storage 35 in association with the user who purchased the object. When a user purchases an object in the viewing mode, the purchase processing unit 302 may store identification information of the purchased object in the storage 35 in association with the distribution user who distributes the video. The sales of the purchasable objects are distributed to, for example, the distribution user and the service provider.

[0037] Next, a description will be given of various data stored in the storage 35 of the server 13. In addition to a delivery program 353, the storage 35 stores user management data 350, avatar data 351, and object data 352.

[0038] User management data 350 is information relating to a user who uses a video application program. Avatar data 351 is master data for drawing an avatar object, and is transmitted to user device 12 in response to a request from user device 12.

[0039] The object data 352 is master data for drawing the gift object, and is transmitted to the user device 12 in response to a request from the user device 12. The object data 352 includes attribute information of the gift object as well as data for drawing the gift object, such as polygon data.

[0040] Next, the user management data 350 will be described with reference to FIG. 2. The user management data 350 is stored for each user. The user management data 350 includes the user's identification information (user ID), a purchasing medium such as coins, points, a distribution status, and the like. The coins are purchased by the user. The points are given to the user at a predetermined timing, such as when a distribution is performed, when an event is participated in, or when an object or the like is sold. The distribution status includes the identification information of a gift object received while the user is distributing a video, information related to a message, and the like. Note that the user management data 350 may store only either coins or points.

[0041] <Gift object> Next, the gift object will be described. In this embodiment, the gift object includes a first gift object that is displayed when a display request is sent by the user device 12 used by the viewing user, and a second gift object that is displayed without being displayed when a display request sent by the viewing user is sent. When the distribution status of the video satisfies the display condition of the second gift object, the server 13 executes the distribution program 353 to display the second gift object in the video. Note that when the first gift object and the second gift object are not distinguished from each other, they are simply described as gift objects.

[0042] An example of a condition for displaying the second gift object is that distribution of a video has started within a predetermined period of time. For example, if a video is distributed within a predetermined period of time, such as "19:00-20:00," the provided object is displayed in the video after a predetermined time has elapsed from the time of video distribution. Alternatively, the broadcasting user may decide the timing of displaying the second gift object on the condition that the video has been distributed within the predetermined period of time. In this case, for example, an operation unit for executing display of the second gift object may be displayed on the screen, and the second gift object may be displayed when an operation of the operation unit by the broadcasting user is accepted.

[0043] The display condition of the second gift object may be a condition related to the distribution of the video. For example, another example of the display condition may be that the number of distributions or the cumulative distribution time of multiple video distributions meets a predetermined value. In addition, another example of the display condition of the second gift object may be that a video is distributed using a predetermined avatar object or other object.

[0044] Instead of or in addition to the distribution status satisfying the display condition of the second gift object, the second gift object may be displayed when the viewing status satisfies the display condition of the second gift object. The viewing status may be, for example, the number of viewers, the viewing time per user, the cumulative viewing time of the viewing users who watch the video, etc. The second gift object may be displayed when these are equal to or greater than a predetermined value, or when these are less than a predetermined value.

[0045] <Video distribution method> There are two types of video distribution methods: a video distribution method in which user device 12 used by the distribution user generates and encodes video data and transmits it to user device 12 used by the viewing user, and a client rendering method in which user device 12 used by the viewing user acquires data necessary for generating a video in addition to user device 12 used by the distribution user, and generates a video. In this embodiment, a method of displaying a video on user device 12 using the client rendering method will be described. Note that a hybrid method in which user device 12 used by the viewing user performs rendering of objects and other image processing using video data generated by user device 12 used by the distribution user, or a method in which video is generated by server 13, or other video distribution methods may be used.

[0046] <Drawing Objects> Next, a method for drawing avatar objects and other objects in a video will be described with reference to FIGS.

[0047] FIG. 3 shows a broadcast user 100 and a user device 12 used by the broadcast user 100. Here, the user device 12 is a smartphone. For ease of explanation, the user device 12 set to broadcast mode is referred to as the "broadcast user device 12A." The broadcast user 100 sets an application program to broadcast mode. The broadcast user 100 also runs the application program while facing the broadcast user device 12A so that at least his or her face is included in the detection range 101 of the sensor unit 24. The detection range 101 shown in FIG. 3 is an example, and is not limited to the range shown in the figure.

[0048] The broadcast user device 12A applies the tracking data output from the sensor unit 24 to the avatar data 221 to generate animation. A video of the virtual space including the avatar object is displayed on the display 28 of the user device 12. The relative distance between the virtual camera and the avatar object in the virtual space changes depending on the relative distance between the broadcast user 100 and the sensor unit 24. In other words, the shorter the relative distance in the real world, the shorter the relative distance between the virtual camera and the avatar object.

[0049] 4 shows an avatar object 105 placed in virtual space 102, and a local coordinate system 106 set for avatar object 105. Local coordinate system 106 is a coordinate system set for each object having three-dimensional coordinates. A world coordinate system 103 is set for the entire virtual space 102. Avatar object 105 moves based on local coordinate system 106, based on the operation of operation unit 27 of broadcasting user 100.

[0050] The method of controlling the movement of the avatar object is not particularly limited, but for example, when the user swipes the touch panel, which is the operation unit 27 of the user device 12, in the right direction among the operation directions 107 in FIG. 4, the avatar object 105 rotates in a Z-axis rotation direction 108 centered on the Z-axis of the local coordinate system. In other words, the avatar object 105 rotates to the left as seen from the user itself centered on the Z-axis of the local coordinate system 106 without changing its standing position. At this time, the avatar object 105 rotates by an amount of rotation according to the length of the swipe operation. Similarly, when the broadcasting user 100 swipes the operation unit 27 of the broadcasting user device 12A to the left, the avatar object 105 rotates in the opposite direction to the Z-axis rotation direction 108 centered on the Z-axis of the local coordinate system 106.

[0051] Furthermore, when the broadcast user 100 swipes the operation unit 27 of the broadcast user device 12A upward, the avatar object 105 rotates in an X-axis rotation direction 109 centered on the X-axis of the local coordinate system 106. That is, the avatar object 105 looks upward in the three-dimensional virtual space in the Z direction of the world coordinate system 103. Similarly, when the broadcast user 100 swipes the operation unit 27 of the broadcast user device 12A downward, the avatar object 105 rotates in the opposite direction to the X-axis rotation direction 109 centered on the X-axis of the local coordinate system. That is, the avatar object 105 looks downward in the virtual space in the opposite direction to the Z direction of the world coordinate system 103.

[0052] In addition, an emote function (expression function) can be applied to the avatar object 105. The emote function is one of the functions that the video application program 220 can implement, and is a function that activates the movement and expression of the avatar object, and is a component associated with each layer of the parts of the avatar object 105, such as the hands, arms, and head. A predetermined number of basic emote functions, such as "clap," "wave," "put hands together," and "peace," can be applied to the avatar object 105. For example, for "wave," an animation of waving hands is associated with the layer of the "right hand" of the avatar object 105. The broadcast user 100 performs a predetermined operation on the operation unit 27 to select one of the emote functions. The broadcast user device 12A applies the selected emote function to the avatar object 105, and causes the avatar object 105 to move.

[0053] Next, drawing of the gift object will be described with reference to FIG. 5. Each gift object is associated with a display area or a display position in the virtual space 102. The display area or the display position is expressed by coordinates in the virtual space 102. The display position of the gift object varies depending on the type of object. For example, the user device 12 displays a gift object 111 such as a "stuffed toy" at any position in the forward area 110 of the avatar object 105. The user device 12 or the server 13 randomly selects a display position within the forward area 110 of the avatar object 105. At this time, the user device 12 may move the gift object 111 from the top to the bottom of the virtual space. Also, the gift object 111 may move within the forward area 110 after appearing in the forward area 110.

[0054] Furthermore, the user device 12 displays a gift object 113, such as a "hanging scroll," at one of a plurality of pre-specified display positions 112 in the rear area of ​​the avatar object 105. An order is assigned to the display positions 112. The user device 12 places the gift object 113 associated with the display position 112 at one of the display positions 112 selected from the plurality of display positions 112 in accordance with the order.

[0055] A case will be described where the server 13 receives, from the user device 12 used by the viewing user, a display request for gift objects 113 that are associated with the display positions 112 and that exceed the number of the display positions 112. If the server 13 receives a gift object 113 indicated as "object 1" and a gift object 113 indicated as "object 2" when no gift object is displayed at the display positions 112, the user device 12 displays the gift objects 113 in order at each of the display positions 112 in accordance with the instruction transmitted from the server 13.

[0056] Then, when there is no vacant display position 112, if the server 13 receives a display request from the user device of the viewing user for new gift objects 113 indicated by "object 3" and new gift objects 113 indicated by "object 4," the server 13 adds the identification information of those gift objects 113 to the waiting queue 114. For ease of explanation, the waiting queue 114 is shown in FIG. 5 in a schematic manner, but the gift objects 113 added to the waiting queue 114 are not displayed on the screen.

[0057] The gift object 113 added to the waiting queue 114 waits for its turn to be displayed at the display position 112. The user device 12 hides the already displayed gift object 113 when a hide condition is satisfied. The hide condition is when the display time of the gift object 113 reaches a predetermined time, when the video distribution end time or a predetermined time before the distribution end time is reached, when the broadcasting user or the viewing user performs an operation to hide the gift object, etc. For example, when the hide condition of the gift object 113 of "object 1" is satisfied, the user device 12 hides the gift object 113. As a result, the display position 112 where the gift object 113 was displayed becomes vacant. Next, based on a request from the server 13, the user device 12 displays the gift object 113 at the head of the waiting queue 114 at the vacant display position 112 as shown by the arrow 115 in FIG. 5. In addition, when there are still gift objects 113 waiting in the waiting queue 114, the server 13 moves up the waiting order as shown by the arrow 116 in FIG. 5.

[0058] The gift object 113 added to the waiting queue 114 may be only the first gift object, or may be a mixture of the first and second gift objects. When the first and second gift objects are associated with the same display position 112, the server 13 adds the identification information of those gift objects to the waiting queue 114 at the timing of receiving a display request or determining to display the second gift object.

[0059] In another embodiment, when the first gift object and the second gift object are associated with the same display position 112, and the server 13 receives a display request for the first gift object from the user device 12 within the same period, and the server 13 determines to display the second gift object according to the distribution program 353, the server 13 may prioritize either the first gift object or the second gift object. For example, the server 13 may prioritize the display of the first gift object. In this case, even if the waiting queue 114 includes the identification information of the second gift object, the server 13 may assign the identification information of the first object in a sequence before the second gift object and display the first gift object before the second gift object. Similarly, the server 13 may prioritize the display of the second gift object. In this case, even if the waiting queue 114 includes the identification information of the first gift object, the server 13 may display the second gift object before the first gift object.

[0060] As another embodiment, the second gift object may not be added to the waiting queue 114, and may be displayed after all the first gift objects included in the waiting queue 114 have been displayed. Specifically, when the server 13 determines to display the second gift object, it stops receiving a display request for the first gift object. At this time, the server 13 may not display a list of gift objects on the user device 12, or may display a list of gift objects but not select any gift object.

[0061] In another aspect, when it is decided to display the second gift object at the start of video distribution, such as when participating in an event, the server 13 may not accept a request to display the first gift object from the start of video distribution until at least the end of displaying the second gift object.

[0062] Also, during the period when the second gift object is displayed, all the first gift objects may not be displayed. This is because, for example, the second gift object may be large in scale including the background, and the first gift object for which a display request has been made may not match the world view of the second gift object, or the first gift object may cause unintended interference with the avatar object 105 or other objects. In this embodiment, during a predetermined period such as the period when the second gift object is displayed, the server 13 may not accept a display request for the first gift object. Alternatively, the server 13 may be able to accept a display request for the first gift object during the period when the second gift object is displayed, and may display the first gift object when the display of the second gift object is finished.

[0063] Next, collaboration distribution (co-starring function) will be described with reference to Figs. 6 and 7. In collaboration distribution, multiple broadcasting users can display their own avatar objects in one video. In this embodiment, the broadcasting user sets whether collaboration distribution is permitted or prohibited, and the viewing user displays an avatar object corresponding to the broadcasting user in a video being distributed for which collaboration distribution is permitted. To participate in collaboration distribution, user device 12 used by the viewing user transmits a participation request to user device 12 used by broadcasting user 100 via server 13. When the broadcasting user approves the participation request, broadcasting user 100 becomes the host user, and the viewing user who made the participation request becomes the guest user.

[0064] 6 is a schematic diagram showing an avatar object corresponding to a host user (hereinafter, host avatar object 105A) and an avatar object corresponding to a guest user (hereinafter, guest avatar object 120). Note that the host avatar object 105A corresponds to the first avatar object, and the guest avatar object 120 corresponds to the second avatar object.

[0065] The number of guest avatar objects 120 that can appear together with the host avatar object 105A (hereinafter, the number of possible appearances) is predetermined. When the server 13 receives display requests from the user devices 12 in the same period that are equal to or greater than the number of possible appearances, the server 13 displays the guest avatar objects 120 in the order in which the display requests were received. First, the guest avatar object 120 whose display request was received first is displayed at a display position 121, such as next to the host avatar object 105A. Then, the identification information of the guest avatar object 120 whose display request was received second or later is added to the co-starring waiting queue 122. In FIG. 6, the identification information of the guest avatar object 120 indicated by "guest 2" and the identification information of the guest avatar object 120 indicated by "guest 3" are added in that order. For convenience of explanation, the co-starring waiting queue 122 is shown in FIG. 6 as a schematic representation, but the guest avatar object 120 added to the co-starring waiting queue 122 is not displayed on the screen.

[0066] Furthermore, in the case of collaborative distribution, the second gift object 125 can be displayed in association with the host avatar object 105A and the guest avatar object 120. For example, the second gift object 125 may be an attached gift object attached to the host avatar object 105A and the guest avatar object 120. The second gift object 125 may be an emote function, or an emote function and an object, applied to the host avatar object 105A and the guest avatar object 120. The emote function provided as the second gift object is an emote function other than the basic function described above.

[0067] For example, the emote function as the second gift object may be a function to lift, wave, or operate the emote object 125A, which is also the second gift object. Specifically, the emote object 125A is associated with a hierarchy of the hands, arms, etc. of the avatar object, and animation of the body part is associated with the emote object 125A. For example, the emote function may lift the emote object 125A, which is the "mug" of the avatar object, wave a "flag," or shoot a "gun." Since emote functions other than the basic functions require a relatively large amount of man-hours for a service provider or the like to newly create them, they have a higher added value in the application than other gift objects such as "glasses." For example, when the emote function is provided as the first gift object, the compensation such as coins is higher than that of the first gift object other than the emote function. It is rare for an emote function to be provided as the first gift object, especially for a beginner user. However, by providing the emote function to the broadcasting user 100 as the second gift object, the broadcasting user 100 can experience the emote function other than the basic function regardless of its popularity or the number of viewing users. The emote function as the second gift object 125 may be associated with the avatar object 105 before the emote function is expressed. When the emote function is provided, the user device 12 receives, from the server 13, identification information designating the emote function and a command to express the emote function. Then, the user device 12 makes the emote function available for expression at a predetermined timing based on the received identification information and command of the emote function. In this way, the user device 12 downloads various emote function components in advance, thereby reducing the amount of communication when the emote function is provided as the second gift object 125 during video distribution. Therefore, it is also possible to express the emote function immediately after the emote function is provided as the second gift object 125.

[0068] Further, the emote function is set to an avatar object 105 to which it is to be applied. For example, even if the emote function is the same action of "lifting a mug", the gender (female, male) set to the avatar object 105 may be set as the target to which it is to be applied. Alternatively, the age (child, adult), height, race, and type (human, animal) of the avatar object 105 may be set as the target to which the emote function is to be applied. When an exit condition is satisfied, the guest avatar object 120 exits from the screen and becomes invisible. The exit condition is that the display time that has elapsed since the host avatar object 105A started performing together reaches a predetermined time, that the broadcasting user or the viewing user has performed an operation to exit the guest avatar object 120, and the like.

[0069] As shown in FIG. 7, when the exit condition of the guest avatar object 120 is satisfied, the user device 12 causes the guest avatar object 120 to exit from the display position 121, as indicated by an arrow 126. This makes the display position 121 where the guest avatar object 120 was displayed vacant. The user device 12 causes the guest avatar object 120 at the head of the co-starring waiting queue 122 to be displayed in the vacant display position 121, as indicated by an arrow 127. Note that the guest avatar object 120 displayed in place of the exited guest avatar object 120 corresponds to the third avatar object. In the example shown in FIG. 6 and FIG. 7, the guest avatar object 120 of "guest 2" is displayed in the display position 121. In addition, the server 13 moves up the order of gift objects waiting in the co-starring waiting queue 122, as indicated by an arrow 128. In the example shown in FIG. 6 and FIG. 7, the guest avatar object 120 of "guest 3" is moved up in the order.

[0070] In the case where the second gift object 125 is displayed in association with the guest avatar object 120, the user device 12 also hides the second gift object 125 when the guest avatar object 120 exits. The second gift object 125 may be moved off the screen together with the guest avatar object 120, or may be made invisible by disappearing immediately after the exit condition is satisfied.

[0071] Then, when the user device 12 displays a new guest avatar object 120, the user device 12 displays a new second gift object 125 in association with the guest avatar object 120. For example, if the second gift object is an emote function, the user device 12 associates the emote function with the new guest avatar object 120. At this time, the user device 12 associates the same second gift object 125 with each of the guest avatar objects 120. Note that the provided emote function does not have to involve the display of an object. In this case, the emote function is a performance gift.

[0072] In another embodiment, the user device 12 may change the second gift object 125 for each guest avatar object 120 based on a request from the server 13. In this case, the server 13 may select one or more second gift objects 125 from an object group including a plurality of different second gift objects 125, and may display the selected second gift object 125 in association with the guest avatar object 120. In this embodiment, the server 13 may display the second gift object 125 associated with the guest avatar object 120 when the guest avatar object 120 is displayed, using data in which the guest avatar object 120 and the second gift object 125 are previously associated with each other. Alternatively, the second gift object 125 may be displayed based on attribute information of the guest avatar object 120. The attribute information is not particularly limited, and may be a group to which the guest avatar object belongs, a rarity, a height, a sex, a set age, or the like. For example, the second gift object 125, which is an attachment object for women, may be displayed for a female guest avatar object 120. The server 13 may also select the second gift object 125 using a predetermined lottery method, such as a method using random numbers.

[0073] Alternatively, the user device 12 may display the second gift object 125 in association with at least one of the host avatar object 105A and the guest avatar object 120 only when a video is distributed using a specific host avatar object 105A. The user device 12 may display the second gift object 125 in association with only when a specific guest avatar object 120 appears. That is, when a guest avatar object 120 other than the specific guest avatar object 120 appears, the second gift object 125 is not displayed, and when a specific guest avatar object 120 appears, the second gift object 125 is displayed in association with the guest avatar object 120. The guest avatar object 120 displayed in association with the second gift object 125 may be displayed as one of events on, for example, a notice screen or a home screen of an application program. Alternatively, the guest avatar object 120 to which the second gift object 125 is associated and displayed may not be notified in advance, and may not know whether the second gift object 125 will be granted to the guest avatar object 120 until the guest avatar object 120 appears together with the host avatar object 105A.

[0074] In another embodiment, a part or all of the second gift object 125 displayed in association with the host avatar object 105A may be given to the host user corresponding to the host avatar object 105A. Also, a part or all of the second gift object 125 displayed in association with the guest avatar object 120 may be given to the guest user corresponding to the guest avatar object 120. In this embodiment, the server 13 updates the user management information 223 and the user management data 350 corresponding to the user, making a part or all of the second gift object 125 available for use. The user device 12 of the user to whom the object or action as a present is given can receive an input operation by the user, and display the object in the virtual space 102 or apply the action to the avatar object 105.

[0075] <Screen Configuration> Next, a delivery screen displayed on the user device 12 will be described with reference to FIGS. 8 shows a broadcast screen 150 displayed on the broadcast user device 12A. Note that, although the operation buttons and the like are different, a similar animation is displayed on the display 28 of the user device 12 of the viewing user.

[0076] The face of the avatar object 105 changes with the change in the expression of the broadcasting user, and the head of the avatar object 105 moves with the movement of the head of the broadcasting user. As described above, the position of the avatar object 105 changes with the change in the relative distance between the broadcasting user 100 and the sensor unit 24. A message 151 is displayed on the broadcasting screen 150 for a predetermined period of time. The message 151 includes a message transmitted from the user device 12 of the viewing user and a message transmitted automatically by the server 13. In addition, various operation units are displayed on the broadcasting screen 150. For example, a comment button 152, an audio switching button 153, a game button 154, and an external video display button 155 may be displayed on the broadcasting screen 150. When the comment button 152 is selected, the broadcasting user can input a comment. The input comment is displayed on the video. When the audio switching button 153 is selected, the audio input can be switched. When the game button 154 is selected, a game can be started within the video. When the external video display button 155 is selected, an operation of acquiring a video from an external server or server 13 can be started. When collaboration setting button 156 is selected, a screen for setting up collaboration distribution can be displayed. Furthermore, a button for selecting an object that can be displayed in a video based on object data 352 of the broadcasting user may be displayed on distribution screen 150. Furthermore, when a gift is given from a viewing user during collaboration distribution, the broadcasting user may be able to select multiple avatar objects 105 displayed in the video or a broadcasting user corresponding to avatar object 105 as a recipient of the gift. Note that the viewing screen displayed on user device 12 of the viewing user includes a message input field, a display request send button for requesting display of a gift object, and a button for requesting a co-starring.

[0077] 9 shows a distribution screen 160 displayed on the distribution user device 12A. When the viewing user performs an operation to send a participation request using the user device 12, an approval request window 162 is displayed on the distribution screen 160. The approval request window 162 displays a wait button 163 for waiting for (denying) approval, and an approval button 164 for approval. When the approval button 164 is selected, the server 13 adds identification information of an avatar object corresponding to the user who made the participation request to the collaboration distribution waiting queue 122, and creates a participation list for the collaboration distribution.

[0078] 10 shows an example of a collaboration distribution screen 170 displayed on the broadcasting user device 12A. A similar screen is also displayed on the display 28 of the user device 12 of the viewing user. The collaboration distribution screen 170 displays a host avatar object 105A of the host user and a guest avatar object 120 of the guest user. The guest avatar object 120 is displayed at a display position 121 next to the host avatar object 105A.

[0079] Next, an example in which the second gift object 125 is displayed will be described with reference to Figs. 11 to 15. The second gift object 125 may be displayed from the start of video distribution, or may not be displayed at the start of video distribution but may be displayed in the middle of the video. When displaying the second gift object 125 in the middle of a video, if there is a large difference between before and after the display of the second gift object 125 and it would be unnatural to suddenly display it, a standby screen may be displayed between before and after the display of the second gift object 125.

[0080] FIG. 11 shows a distribution screen 180 on which the second gift object is displayed on the distribution user device 12A. A similar screen is also displayed on the display 28 of the user device 12 of the viewing user. The second gift object 125 here includes an animation of a "night sky" background 125B and a fireworks object 125C. Note that the first gift object cannot provide the background 125B and the fireworks object 125C that matches the background 125B. For example, the distribution user 100 can swipe the touch panel, which is the operation unit 27, in accordance with the display of the second gift object 125, rotate the avatar object 105 to the left as seen from the avatar object 105, and rotate his head upward to look up at the fireworks object 125C.

[0081] The second gift object 125 including this fireworks object 125C has, for example, a display condition set as participation in an event by the broadcast user 100. The broadcast user can participate in the event by starting to broadcast a video within a specified period during which the event is held. The event may also be synchronized with the period during which a fireworks display is held in the real world.

[0082] 12 and 13 show a distribution screen 190 in which an emote function is provided as the second gift object 125 in the collaborative distribution. A similar screen is also displayed on the display 28 of the user device 12 of the viewing user. As shown in FIG. 12, the distribution screen 190 includes a background 191 of "camp" as the second gift object 125. The background 191 may be a two-dimensional image or may be composed of a plurality of three-dimensional objects. The distribution screen 190 also includes an emote object 125A associated with the host avatar object 105A and an emote object 125A associated with the guest avatar object 120 as the second gift object 125, in addition to the host avatar object 105A and the guest avatar object 120. The distribution screen 190 may also include an attachment object 193 attached to the host avatar object 105A and the guest avatar object 120 and corresponding to the background 191 as the second gift object 125. For example, clothing related to "camping" may be provided as an attachment object to the host avatar object 105A and the guest avatar object 120. This attachment object is displayed even if the host user and the guest user do not possess the attachment object.

[0083] The emote functions in the scene of the distribution screen 190 are to lift the "mug" which is the emote object 125A and make a "cheers" motion, to lower the arm while holding the "mug", to drink from the "mug", and to place the "mug" on a table or the like. When the host user or the guest user performs a predetermined input operation such as long pressing on the distribution screen 190, the emote function selection unit 192 is displayed. The emote function selection unit 192 is capable of selecting each of the emote functions. For example, when the host user operates the operation unit 27 of the user device 12 to select the emote function, the emote function is applied to the host avatar object 105A. When the guest user operates the operation unit 27 of the user device 12 to select the emote function, the emote function is applied to the guest avatar object 120. The emote function selection unit 192 corresponds to the selection operation unit.

[0084] Furthermore, the action of the avatar object 105 provided by the emote function may be performed within an actionable range determined based on the position of the avatar object 105. The actionable range is set as a range having three-dimensional coordinates in a virtual space, such as a cylindrical, spherical, or hemispherical range. When a plurality of avatar objects 105 perform collaboration distribution, the actionable ranges of the avatar objects 105 may be set so as not to overlap with each other. Alternatively, when the actionable ranges of the avatar objects 105 overlap with each other, when a part belonging to one avatar object 105 enters the overlapping range, the part belonging to the other avatar object 105 may be controlled so as not to enter the overlapping range. Specifically, the user device 12 determines whether a part of the avatar object 105 is included in the overlapping range, and when the part is included in the overlapping range, prohibits the part of the other avatar object from entering the overlapping range. Furthermore, the action direction may be set according to the height of the avatar object 105. For example, when a tall avatar object 105 makes a "toasting" motion in the horizontal direction, if there is a possibility that it may interfere with a short avatar object 105, the motion may be made to move upward or in front of the former avatar object 105. According to these aspects, it is possible to prevent interference between the avatar objects 105. Furthermore, when an overlapping range is provided, interference can be prevented even when the avatar objects 105 are brought close to each other.

[0085] Furthermore, the display mode of the emote object 125A changes when a display mode change condition is satisfied. The display mode change condition is, for example, that a predetermined time has elapsed since the display of the emote object 125A started, that a predetermined number of times a predetermined emote function such as "drink" has been activated, etc. The emote object 125A in the initial state is in a "full of drink" state, but after a predetermined time has elapsed, it transitions to a "empty" state.

[0086] When the guest avatar object 120 exits, the emote object 125A associated with the guest avatar object 120 is also hidden. At this time, the emote object 125A of the host avatar object 105A may be hidden at the same time that the emote object 125A associated with the guest avatar object 120 is hidden.

[0087] 13 shows a distribution screen 190 in which a guest avatar object 120 has left and a new guest avatar object 120 has been added. When the server 13 adds a new guest avatar object 120, the server 13 also adds an emote object 125A associated with the guest avatar object 120. At this time, a new emote object 125A may be associated with the host avatar object 105A at the same time that the emote object 125A associated with the guest avatar object 120 is displayed. As a result, the emote object 125A of the "mug" that has transitioned from an initial state such as "full" to an initial state such as "empty" becomes the emote object 125A of the "mug" in the initial state.

[0088] FIG. 14 shows a distribution screen 200 in which an emote function is provided as the second gift object 125 in the collaborative distribution. A similar animation is also displayed on the display 28 of the user device 12 of the viewing user. The distribution screen 200 includes a background 125D of a "pool" as the second gift object 125. The distribution screen 200 also includes a host avatar object 105A and a guest avatar object 120, as well as a "water gun" emote object 125A associated with the host avatar object 105A and the guest avatar object 120 as the second gift object 125. The distribution screen 200 also includes an attachment object 203 attached to the host avatar object 105A and the guest avatar object 120 and corresponding to the background 125D as the second gift object 125. When an emote function selection unit (not shown) is operated, water is sprayed from the emote object 125A of the water gun. The direction in which water is emitted from the emote object 125A is fixed, but the direction in which the water is emitted can be changed by changing the orientation of the host avatar object 105A and the guest avatar object 120 through a user operation.

[0089] FIG. 15 shows a distribution screen 210 in which the second gift object 125 is provided based on information indicating the situation in the real world. A similar animation is also displayed on the display 28 of the user device 12 of the viewing user. The distribution screen 210 includes the avatar object 105 and the second gift object 125, a gift object 125E of "candy" and a gift object 125F of "umbrella". The user device 12 displays these second gift objects 125 when it rains in the real world. In this embodiment, the server 13 acquires the current location of the broadcast user device 12A. The server 13 also acquires weather information of the acquired current location from an external server (not shown). Then, when the server 13 determines that it is raining in the area where the broadcast user device 12A is located, it transmits identification information of the above gift objects 125E and 125F to the user device 12 together with a request for display. When the user device 12 receives the identification information of the gift objects 125E, 125F and a display request, the user device 12 reads out images of the gift objects 125E, 125F from the storage 22 and displays them. The broadcast user device 12A may obtain weather information from its current location and transmit it to the server 13. Alternatively, the broadcast user device 12A may obtain weather information from its current location and determine whether or not to display the gift objects 125E, 125F from the obtained weather information. The information indicating the real-world situation is not particularly limited, but may include environmental information such as the weather and the area where the broadcast user device 12A is located (urban area, mountainous area, etc.), time information, date information, and time of broadcast (season, etc.).

[0090] The display condition for the second gift object 125 based on the information indicating the situation in the real world is, for example, that the information indicating the situation in the real world has changed. (operation) Next, a processing procedure when a host user and a plurality of guest users appear together will be described with reference to FIGS.

[0091] FIG. 16 is a timing chart when the broadcast user 100 participates in an event in which the second gift object 125 is displayed. The event is held within a preset period, for example, "19:00 to 20:00". The display condition for the second gift object 125 is that the broadcast of the video is started within this period. The event scenario shown in FIG. 16 is a "fireworks display" event scenario, which is composed of "Part 1", "Part 2", and "Part 3", and a different second gift object 125 is displayed in each part. In a video broadcast by "broadcast user A" who participated in the event from the start of the event, the second gift object 125 of each part is displayed based on a request from the server 13. On the other hand, in a video broadcast by "broadcast user B" who participated in the event from "Part 2", the second gift object 125 displayed in "Part 2" and "Part 3" is displayed based on a request from the server 13, and the second gift object 125 displayed in "Part 1" is not displayed. In addition, in a video broadcast by a broadcast user who participated in the event from the middle of each part, an animation from a point corresponding to the start point of the broadcast of the video may be displayed. In this way, in a video of a broadcast user 100 who joined an event midway through, the second gift object 125 is displayed midway through in accordance with the scenario, so that the display of the second gift object 125 can be limited. Therefore, the second gift object 125 is not displayed unnecessarily, and a decrease in the value of the gift object can be suppressed.

[0092] FIG. 17 shows the processing procedure of the broadcast user device 12A used by the host user, the server 13, the broadcast user device 12A used by the broadcast user who is a guest user, and the viewing user device 12B used by the viewing user who does not request to perform collaboration, when a second gift object is displayed in collaboration distribution. As a premise, the broadcast user 100 has set to permit collaboration distribution. The server 13 receives a participation request from the viewing user device 12B. The server 13 transmits a participation request to the broadcast user device 12A, and the broadcast user 100 permits the participation request. At this time, the broadcast user device 12A transmits permission of the participation request to the server 13. The server 13 adds the viewing user to a participation list for collaboration distribution, and transmits the participation list to the broadcast user device 12A and the viewing user device 12B. In this way, the host avatar object 105A corresponding to the broadcast user 100 and the guest avatar object 120 corresponding to the viewing user who is permitted to perform collaboration are displayed on one screen. The viewing user who participated in the collaboration distribution becomes a broadcast user as a guest user.

[0093] In the example shown in FIG. 17, it is assumed that the second gift object 125 is displayed at the same time as the guest avatar object 120. When collaboration distribution is started, the broadcast user device 12A transmits moving image composing data used to generate a moving image to the server 13 (step S11). The moving image composing data includes at least tracking data that tracks the actions of the broadcast user 100. The moving image composing data also includes audio data. Identification information of the host avatar object 105A may be included in the moving image composing data, or may be transmitted separately from the moving image composing data.

[0094] Server 13 determines whether or not to display the second gift object based on the display conditions of second gift object 125. As described above, the display conditions of second gift object 125 are that broadcast user 100 is participating in the event, that avatar object 105 of broadcast user 100 is a specified avatar object, that the start time of distribution of the video is included in a specified date or period, etc.

[0095] When the server 13 determines to display the second gift object, it transmits the identification information (ID) of the second gift object associated with the host avatar object 105A to the guest user's broadcast user device 12A and the viewing user device 12B together with the video composition data received from the broadcast user device 12A (step S12). The server 13 also transmits the identification information (ID) of the second gift object 125 to the broadcast user device 12A (step S13). Note that various data for drawing the avatar object and the gift object are acquired in advance by the broadcast user device 12A and the viewing user device 12B.

[0096] Similarly, the broadcast user device 12A used by the guest user transmits the moving image composing data to the server 13 (step S14). The server 13 transmits the identification information (ID) of the second gift object associated with the guest avatar object 120 to the viewing user device 12B together with the moving image composing data received from the broadcast user device 12A (step S15). Similarly, the server 13 transmits the moving image composing data and the identification information (ID) of the second gift object to be associated with the guest avatar object 120 to the broadcast user device 12A of the guest user (step S17).

[0097] Based on the received video composing data and the identification information of the second gift object, the broadcasting user device 12A and the viewing user device 12B generate an animation including the host avatar object 105A, the guest avatar object 120, the second gift object 125, etc., and display it on the display 28 (steps S17 to S19). Note that steps S11 to S17 can be changed as appropriate. The order of steps S11 to S17 may be changed, one step may be divided into multiple steps, or multiple steps may be combined into one step. In short, it is sufficient that the broadcasting user device 12A of the host user and the broadcasting user device 12A of the guest user transmit the video composing data, the server 13 transmits the identification information of the gift object, and the broadcasting user device 12A and the viewing user device 12B display the video based on the video composing data and the identification information of the gift object sent from the other devices.

[0098] When the guest avatar object 120 of the guest user exits the video, the guest user who has exited becomes a viewing user. Then, when a new guest avatar object 120 is added to the video, the broadcasting user device 12A, the server 13, and the viewing user device 12B repeat the above-mentioned steps S11 to S20. That is, the second gift object 125 is displayed in association with the host avatar object 105A, and the second gift object 125 is displayed in association with the new guest avatar object 120. Since the host avatar object 105A does not exit, the display of the second gift object 125 associated with the host avatar object 105A does not need to be changed. Also, when the second gift object 125 displayed in association with the guest avatar object 120 does not change due to the guest avatar object 120, the server 13 may transmit the identification information of the second gift object 125 to the broadcasting user device 12A and the viewing user device 12B only once. In this case, the broadcaster user device 12A and the viewer user device 12B display the second gift object 125 based on the identification information of the second gift object 125 received from the server 13 every time the broadcaster user device 12A and the viewer user device 12B change the guest avatar object 120 .

[0099] In this way, when the display condition for the second gift object is satisfied in the collaboration distribution, the second gift object 125 is displayed every time a guest avatar object 120 is added. This can increase the guest user's satisfaction with the collaboration distribution. Furthermore, when the guest user is notified in advance that the second gift object will be displayed if he or she participates in the collaboration distribution, the viewing user's motivation to participate in the collaboration distribution can be increased.

[0100] In Fig. 18, the display condition of the second gift object 125 may be the presence or absence of an action from the viewing user. In this case, the server 13 refers to the user management data 350 and judges whether or not there has been no action from the viewing user for a predetermined period of time or more (step S21). Specifically, it judges whether or not a display request for the first gift object has been received from the viewing user device 12B for the video being distributed. At this time, in addition to the display request for the first gift object, it may be judged whether or not a message has been posted.

[0101] When the server 13 determines that the action from the viewing user has been performed within the predetermined time (step S21: Yes), it does not display the second gift object 125. On the other hand, when it determines that the action from the viewing user has not been performed within the predetermined time (step S21: No), it transmits the identification information of the second gift object 125 to the broadcasting user device 12A and the viewing user device 12B. The broadcasting user device 12A and the viewing user device 12B that have received the identification information of the second gift object 125 read data for displaying the second gift object 125 corresponding to the identification information and display it on the display 28 (step S22). In this way, even a broadcasting user 100 who has few requests to display the first gift object can liven up the video. In addition, the broadcasting user 100 is more motivated to continue broadcasting videos.

[0102] Next, the effects of this embodiment will be described. (1) In a collaborative distribution in which the host avatar object 105A and the guest avatar object 120 are displayed in a video, the second gift object 125 is displayed only when the distribution status satisfies the display condition of the second gift object 125. This makes it possible to suppress a decrease in added value of the gift object. Also, when a guest avatar object 120 corresponding to a guest user is newly added, the second gift object 125 is displayed in association with the guest avatar object 120. This makes it possible to increase the satisfaction of not only the host user but also all guest users participating in the collaborative distribution.

[0103] (2) When the user device 12 distributes a video within a predetermined period, the second gift object 125 is displayed in the video. When the distribution of the video starts halfway through a scenario, the second gift object 125 starts to be displayed from a scene corresponding to the start time of the distribution of the video. Therefore, the opportunity to display the second gift object 125 is limited, so that the reduction in added value of the second gift object 125 can be suppressed. When the event is a common event for users in an application, the display of the second gift object 125 can be synchronized among multiple videos, so that a video that looks like an event occurring in the real world can be distributed.

[0104] (3) The second gift object 125 is displayed after a predetermined time has elapsed from the start of video distribution within a predetermined period of time. Therefore, the opportunity to display the second gift object 125 is limited, and thus the added value of the second gift object 125 can be prevented from decreasing.

[0105] (4) When there is no activity from the viewing user, such as a request to display the first gift object, for a predetermined period of time, the second gift object 125 is displayed. As a result, the display of the second gift object 125 can be used as an opportunity to expand the range of expression of the broadcasting user. In addition, communication between the broadcasting user and the viewing user can be made more active.

[0106] (5) When the emote function selection unit 192 is operated, the second gift object 125 is displayed in the video. Therefore, the second gift object 125 can be displayed at the timing desired by the user.

[0107] (6) The second gift object 125 is displayed when a specific avatar object is displayed in a video. This limits opportunities for displaying the second gift object 125, thereby preventing a decrease in added value of the second gift object 125. This also increases opportunities for the broadcast user 100 to use the specific avatar object.

[0108] (7) The second gift object 125 is displayed when the external conditions, such as the weather in the real world, satisfy the display conditions. Therefore, the opportunity to display the second gift object 125 is limited, and therefore, it is possible to suppress a decrease in added value of the second gift object 125. In addition, since the display of the second gift object 125 is synchronized with the external conditions, it is possible to display a variety of videos depending on the season and time of day when the video is distributed.

[0109] (8) The emote function of the avatar object 105 is displayed as a second gift object 125. The emote object 125A, which is a part of the emote function, is displayed in association with each part constituting the avatar object 105. Since the emote function is more valuable than other gift objects, even users who are rarely given the emote function as a gift can use emote functions other than the basic emote function. This can increase user satisfaction.

[0110] (9) A second gift object 125 including the background of the avatar object 105 is displayed. The background has a higher value than other gift objects. Therefore, even when the background cannot be provided as the first gift object, or when a user has few opportunities to receive a background as a gift, the user can still have an opportunity to use the background. This can increase the user's satisfaction.

[0111] (10) Since the second gift object 125 including an attachment object for the avatar object 105 is displayed, the user's satisfaction can be increased. (11) Since the first gift object for which the viewing user has made a display request is displayed preferentially, it is possible to increase the satisfaction of the viewing user who has transmitted the display request for the first gift object.

[0112] (12) Since the second gift object is displayed with priority, the video can progress according to the scenario. The above embodiment can be modified as follows: The above embodiment and the following modifications can be combined with each other to the extent that no technical contradiction occurs.

[0113] In the above embodiment, the host user requests a guest user to join the video and adds the guest user's avatar object to the video. Alternatively, a video may be distributed in which the host user and guest user are not specified, and avatar objects corresponding to predetermined users join the video.

[0114] In the above embodiment, the emote function has been described as moving the hands, arms, and other parts of the avatar object, and expressing the facial expression of the avatar object, but is not limited thereto. The emote function may also change the position of the avatar object, or make the avatar object walk or dance.

[0115] In the above embodiment, the server 13 receives a display request for a gift object from the user device 12, and adds identification information of the gift object to the waiting queue 114. Alternatively, the user device 12 of the broadcasting user may receive a display request for a gift object from the server 13, and manage the waiting queue 114.

[0116] In the above embodiment, a video application program for viewing and distributing videos is installed in the user device 12. Alternatively, the application program for viewing videos and the application program for distributing videos may be separate application programs. When distributing videos, the distribution application program is used to distribute the videos. When viewing videos, the viewing application program is used to view the videos. A display request for a gift object is made using the viewing application program.

[0117] In the above embodiment, a client rendering method is used in which the broadcast user device 12A and the viewing user device 12B receive video configuration data and generate a video. Alternatively or in addition to this, a video distribution method in which the broadcast user device 12A encodes video data may be used. As shown in FIG. 19, the server 13 transmits identification information of a gift object to the broadcast user device 12A (step S30). The broadcast user device 12A generates and encodes an animation using the received identification information of the gift object and tracking data and the like (step S31). At this time, a message or audio data from the viewing user may be encoded together with the animation. The broadcast user device 12A transmits the encoded data to the server 13 (step S32). The server 13 transmits the encoded data to the viewing user device 12B (step S33). The broadcast user device 12A displays an animation using the tracking data and the identification information of the gift object (step S34). The viewing user device 12B decodes the encoded data and displays the animation (step S35). In addition, when performing collaboration distribution, the broadcast user device 12A of the broadcast user acting as a guest user may receive moving image composing data and the like and generate a moving image based on the moving image composing data. Alternatively, the broadcast user device 12A of the broadcast user acting as a guest user may receive encoded video data from the broadcast user device 12A of the broadcast user acting as a host user.

[0118] Although the sensor unit 24 has been described as acquiring detection data detecting changes in the user's facial expression, head movement, and the user's relative position with respect to the sensor unit 24, at least one of these may be acquired. Furthermore, the sensor unit 24 may acquire other detection data, such as detection data detecting movement other than head movement, in addition to or instead of at least one of changes in the user's facial expression, head movement, and the user's relative position.

[0119] The virtual space displayed in the video may be an augmented reality (AR) space. For example, animations of an avatar object, a gift object, etc. may be superimposed on an image of the real world captured by the camera of the user device 12. Also, animations of a gift object, etc. may be superimposed on an image of the real world including the user captured by the camera of the user device 12.

[0120] In the above embodiment, the user device 12 is an information processing device such as a smartphone, a mobile phone, a tablet terminal, a personal computer, a console game machine, or a wearable computer such as a head-mounted display. Alternatively, a system provided in a studio for video distribution, which includes an information processing device including a control unit 20, a sensor unit 24 worn on the body of a distribution user, a tracking system for detecting the position of the sensor unit 24, an operation unit 27, a speaker 25, and a display 28, may be used as a system for distributing videos. The tracking system may include a multi-axis laser emitter that emits a pulsed laser light for synchronization. The sensor unit 24 includes a sensor that detects laser light, and detects its own position and orientation while synchronizing with a synchronization pulse. For example, the sensor unit 24 may be a Vive Tracker (registered trademark) and a Vive Base Station provided by HTC Corporation (registered trademark).

[0121] In the above embodiment, the sensor unit 24 is provided on the user device 12 side, but this is not limited to the above. For example, at least a part of the sensor unit 24 may be attached to the body of the broadcast user or provided in the vicinity of the broadcast user. FIG. 20 shows a video distribution system installed in a video distribution studio, and includes a camera 229, a microphone 230, a controller 226, and a distribution server 228. The video distribution system also includes a tracking system including a wearable sensor 227 attached to the limbs of the broadcast user 100, a position detection unit 225 for identifying the position of the wearable sensor 227, and the like. The camera 229 captures the face of the broadcast user 100. The distribution server 228 generates an animation in which the tracking data acquired from the tracking system and the facial expression data acquired from the camera 229 are applied to the avatar object. The animation, in which the background of the virtual space and the avatar object are rendered, is distributed to the viewing user device 12B as video data together with audio. For example, the tracking system may also be configured with a camera or the like that detects a marker attached to the body of the broadcast user. Next, the technical ideas that can be understood from the above-described embodiment and other examples will be described below together with their effects. [1] A computer that displays video on a display. a first image processing unit that displays an avatar object reflecting a user's movement in the video; a first gift object display processing unit that displays a first gift object in response to a display request transmitted by a viewing user who is viewing the video; functioning as a second image processing unit that displays the second gift object when a display condition for the second gift object to be displayed without being based on a display request transmitted by the viewing user is satisfied; the first image processor displays a first avatar object reflecting a movement of a first user and a second avatar object reflecting a movement of a second user in the video; The second image processing unit is a program that displays the second gift object associated with the first avatar object in the video and displays the second gift object associated with the second avatar object when the display condition is met that a predetermined period of time has passed since the viewing user took no action on the video. [2] The program described in [1], wherein the second image processing unit displays the second gift object in association with a part constituting the first avatar object and a part constituting the second avatar object. [3] The second image processing unit displays an expression function selection unit for activating an expression function of the first avatar object or the second avatar object as the second gift object, and expresses the expression function based on operation of the expression function selection unit by a user corresponding to the first avatar object or the second avatar object. The program described in [1] or [2]. [4] The program described in any one of [1] to [3], wherein the second image processing unit displays the second gift object including a background of the first avatar object and the second avatar object. [5] The program described in any one of [1] to [4], wherein the second image processing unit displays the second gift object including an attachment object to be attached to a part of the first avatar object and the second avatar object. [6] The program described in any one of [1] to [5], wherein the second image processing unit hides the second gift object associated with the second avatar object when the second avatar object is hidden from the video, and displays the second gift object associated with the third avatar object in the video when a third avatar object corresponding to a third user is newly displayed in the video. [7] A computer that displays moving images on a display. a first image processing unit that displays an avatar object reflecting a user's movement in the video; a first gift object display processing unit that displays a first gift object in response to a display request transmitted by a viewing user who is viewing the video; functioning as a second image processing unit that displays a second gift object when a display condition for a second gift object that is displayed without being based on a display request transmitted by the viewing user is satisfied; The second image processing unit is a program that displays the second gift object in the video corresponding to the attributes of the avatar object when the display condition is met that a state in which the viewing user has taken no action on the video continues for a predetermined period of time. [8] The program described in [7], wherein the second image processing unit displays the second gift object in association with a part that constitutes the avatar object. [9] The second image processing unit displays an expression function selection unit for activating an expression function of the avatar object as the second gift object, and expresses the expression function based on operation of the expression function selection unit by a user corresponding to the avatar object. The program described in [7] or [8].

[10] The program described in any one of [7] to [9], wherein the second image processing unit displays the second gift object including a background of the avatar object.

[11] The program described in any one of [7] to

[10] , wherein the second image processing unit displays the second gift object including an attachment object to be attached to a part of the avatar object.

[12] A program described in any one of [1] to

[11] , wherein the second image processing unit displays the second gift object in the video when it does not receive a request to display the first gift object for the video from the viewing user device used by the viewing user.

[13] A program described in any one of [1] to

[12] , wherein the second image processing unit displays the second gift object in the video when no message for the video is received from the viewing user device used by the viewing user.

[14] A program described in any one of [1] to

[13] , wherein the second image processing unit displays a selection operation unit in the video for displaying the second gift object in the video when the display condition is satisfied, and displays the second gift object in the video when the selection operation unit is operated.

[15] A computer that displays moving images on a display a first image processing step of displaying an avatar object reflecting a user's movement in the video; a first display processing step of displaying a first gift object in response to a display request transmitted by a viewing user who views the video; A second image processing step of displaying the second gift object when a display condition of the second gift object is satisfied, the second gift object being displayed without being based on a display request transmitted by the viewing user; In the first image processing step, a first avatar object reflecting a movement of a first user and a second avatar object reflecting a movement of a second user are displayed in the video; In the second image processing step, when the display condition is met that a state in which the viewing user has taken no action on the video continues for a predetermined period of time, the second gift object associated with the first avatar object is displayed in the video and the second gift object associated with the second avatar object is displayed in the video.This is an information processing method.

[16] An information processing device that displays a video on a display of a user device, a drawing data transmitting step of transmitting data for drawing an avatar object reflecting a user's movement to the user device; a first display processing step of transmitting a request for displaying a first gift object to the user device in response to a display request transmitted by a viewing user who views the video; a display request sending step of sending a display request for the second gift object to the user device when a display condition for the second gift object to be displayed without being based on the display request sent by the viewing user is satisfied; the drawing data transmitting step transmits, to the user device, data for drawing a first avatar object reflecting a movement of a first user and a second avatar object reflecting a movement of a second user; In the display request sending step, when the display condition is met that a state in which the viewing user has taken no action on the video continues for a predetermined period of time, a display request for the second gift object associated with the first avatar object and the second gift object associated with the second avatar object is sent to the user device.

[17] An information processing method executed by an information processing device that displays a video on a display of a user device, comprising: The information processing device, a drawing data transmitting step of transmitting data for drawing an avatar object reflecting a user's movement to the user device; a first display processing step of transmitting a request for displaying a first gift object to the user device in response to a display request transmitted by a viewing user who views the video; a display request transmission step of transmitting a display request for the second gift object to the user device when a display condition for the second gift object to be displayed without being based on the display request transmitted by the viewing user is satisfied; the drawing data transmitting step transmits, to the user device, data for drawing a first avatar object reflecting a movement of a first user and a second avatar object reflecting a movement of a second user; In the display request sending step, when the display condition is met that a state in which the viewing user has taken no action on the video continues for a predetermined period of time, a display request for the second gift object associated with the first avatar object and the second gift object associated with the second avatar object is sent to the user device.This is an information processing method.

[18] A computer that displays moving images on a display a first image processing step of displaying an avatar object reflecting a user's movement in the video; a first display processing step of displaying a first gift object in response to a display request transmitted by a viewing user who views the video; A second image processing step of displaying the second gift object when a display condition of the second gift object is satisfied, the second gift object being displayed without being based on a display request transmitted by the viewing user; In the second image processing step, when the display condition is met that a state in which the viewing user has taken no action on the video continues for a predetermined period of time, the second gift object corresponding to the attributes of the avatar object is displayed in the video.This is an information processing method.

[19] An information processing device that displays a video on a display of a user device, a drawing data transmitting step of transmitting data for drawing an avatar object reflecting a user's movement to the user device; a first display processing step of transmitting a request for displaying a first gift object to the user device in response to a display request transmitted by a viewing user who views the video; a display request sending step of sending a display request for the second gift object to the user device when a display condition for the second gift object to be displayed without being based on the display request sent by the viewing user is satisfied; In the display request sending step, when the display condition is met that a state in which the viewing user has taken no action on the video continues for a predetermined period of time, the information processing device sends a display request for the second gift object corresponding to the attributes of the avatar object to the user device.

[20] An information processing method executed by an information processing device that displays a video on a display of a user device, comprising: The information processing device, a drawing data transmitting step of transmitting data for drawing an avatar object reflecting a user's movement to the user device; a first display processing step of transmitting a request for displaying a first gift object to the user device in response to a display request transmitted by a viewing user who views the video; a display request transmission step of transmitting a display request for the second gift object to the user device when a display condition for the second gift object to be displayed without being based on the display request transmitted by the viewing user is satisfied; In the display request sending step, when the display condition is met that a state in which the viewing user has taken no action on the video for a predetermined period of time, a display request for the second gift object corresponding to the attributes of the avatar object is sent to the user device.This is an information processing method. [Explanation of symbols]

[0122] 11...Video distribution system, 12, 12A, 12B...User device 13…Server

Claims

1. A computer that displays video on a display. a first image processing unit that displays an avatar object reflecting a user's movement in the video; a first gift object display processing unit that displays a first gift object in response to a display request transmitted by a viewing user who is viewing the video; functioning as a second image processing unit that displays a second gift object when a display condition for a second gift object that is displayed without being based on the display request transmitted by the viewing user is satisfied; The second image processing unit is a program that, when the display condition related to the viewing situation in which the viewing user watches the video is satisfied, displays an expression function selection unit in the video for activating an expression function of the avatar object as the second gift object associated with the avatar object, and expresses the expression function based on the operation of the expression function selection unit by the user corresponding to the avatar object.

2. A computer that displays video on a display. a first image processing unit that displays an avatar object reflecting a user's movement in the video; a first gift object display processing unit that displays a first gift object in response to a display request transmitted by a viewing user who is viewing the video; functioning as a second image processing unit that displays a second gift object when a display condition for a second gift object that is displayed without being based on the display request transmitted by the viewing user is satisfied; The second image processing unit is a program that displays the second gift object associated with the avatar object in the video when the display condition is satisfied that the display request of the first gift object for the video is not received from the viewing user device used by the viewing user.

3. The program according to claim 1 or 2, wherein the second image processing unit, when the display condition is satisfied, displays the second gift object in the video and grants the displayed second gift object to the user.

4. The program according to claim 1 , wherein the second image processing unit displays the second gift object in association with a body part constituting the avatar object.

5. The program according to claim 4 , wherein the second image processing unit displays, as the second gift object, an attachment object to be attached to a part of the avatar object.

6. The program according to claim 1 , wherein the second image processing unit displays the second gift object including a background of the avatar object.

7. the first image processor displays a first avatar object reflecting a movement of a first user and a second avatar object reflecting a movement of a second user in the video; The program described in any one of claims 1 to 6, wherein the second image processing unit displays the second gift object associated with the first avatar object in the video when the display condition is satisfied, and displays the second gift object associated with the second avatar object.

8. The program described in claim 7, wherein the second image processing unit hides the second gift object associated with the second avatar object when the second avatar object is hidden from the video, and displays the second gift object associated with the third avatar object in the video when a third avatar object corresponding to a third user is newly displayed in the video.

9. The program described in any one of claims 1 to 8, wherein the second image processing unit further displays the second gift object in the video when the display condition of not receiving a message for the video from the viewing user device used by the viewing user is satisfied.

10. The program described in any one of claims 1 to 9, wherein the second image processing unit further displays the second gift object in the video when the display condition that the number of viewing users watching the video is less than a predetermined number is satisfied.

11. The program described in any one of claims 1 to 9, wherein the second image processing unit further displays the second gift object in the video when the display condition that the number of viewing users watching the video is greater than or equal to a predetermined number is satisfied.

12. The program described in any one of claims 1 to 11, wherein the second image processing unit further displays the second gift object in the video when the display condition that the viewing time per viewing user is less than a predetermined value is met.

13. The program described in any one of claims 1 to 11, wherein the second image processing unit displays the second gift object in the video when the display condition that the viewing time per viewing user is greater than or equal to a predetermined value is met.

14. The program described in any one of claims 1 to 13, wherein the second image processing unit further displays the second gift object in the video when the display condition is met that the cumulative viewing time of the viewing user is less than a predetermined value.

15. The program described in any one of claims 1 to 13, wherein the second image processing unit further displays the second gift object in the video when the display condition is met that the cumulative viewing time of the viewing user is greater than or equal to a predetermined value.

16. The program described in any one of claims 1 to 15, wherein the second image processing unit further displays the second gift object in the video when the display condition is met that a state in which the viewing user has not taken any action on the video continues for a predetermined period of time.

17. The program described in any one of claims 1 to 16, wherein the second image processing unit displays the second gift object corresponding to the avatar object from a group of multiple different second gift objects in the video when the display condition is met.

18. 18. The program according to claim 17, wherein the second image processing unit selects and displays the second gift object using data that previously associates the avatar object with the second gift object.

19. The program according to claim 17 or 18, wherein the second image processing unit selects and displays the second gift object by lottery from the group of the second gift objects.

20. The computer that displays the video on the display a first image processing step of displaying an avatar object reflecting a user's movement in the video; a first display processing step of displaying a first gift object in response to a display request transmitted by a viewing user who is viewing the video; a second image processing step of displaying the second gift object when a display condition of the second gift object is satisfied, the second gift object being displayed without being based on the display request transmitted by the viewing user; In the second image processing step, when the display condition regarding the viewing situation in which the viewing user watches the video is satisfied, an expression function selection unit for activating an expression function of the avatar object as the second gift object associated with the avatar object is displayed in the video, and the expression function is expressed based on the operation of the expression function selection unit by the user corresponding to the avatar object.

21. The computer that displays the video on the display a first image processing step of displaying an avatar object reflecting a user's movement in the video; a first display processing step of displaying a first gift object in response to a display request transmitted by a viewing user who is viewing the video; a second image processing step of displaying the second gift object when a display condition of the second gift object is satisfied, the second gift object being displayed without being based on the display request transmitted by the viewing user; In the second image processing step, when the display condition that the display request of the first gift object for the video is not received from the viewing user device used by the viewing user is satisfied, the information processing method displays the second gift object associated with the avatar object in the video.

22. An information processing device that displays a video on a display of a user device, a drawing data transmitting step of transmitting data for drawing an avatar object reflecting a user's movement to the user device; a first display processing step of transmitting a request to display a first gift object to the user device in response to a display request transmitted by a viewing user who is viewing the video; a request sending step of sending a request to the user device to display the second gift object when a display condition of the second gift object to be displayed without being based on the display request sent by the viewing user is satisfied; In the request transmission step, sending, to the user device, a request to display the second gift object associated with the avatar object when the display condition relating to the viewing situation of the viewing user watching the video is satisfied; An information processing device that expresses an expression function based on the user's operation of an expression function selection unit for activating the expression function of the avatar object as the second gift object.

23. An information processing device that displays a video on a display of a user device, a drawing data transmitting step of transmitting data for drawing an avatar object reflecting a user's movement to the user device; a first display processing step of transmitting a request to display a first gift object to the user device in response to a display request transmitted by a viewing user who is viewing the video; a request sending step of sending a request to the user device to display the second gift object when a display condition of the second gift object to be displayed without being based on the display request sent by the viewing user is satisfied; In the request sending step, when the display condition of not receiving a display request for the first gift object for the video from the viewing user device used by the viewing user is satisfied, the information processing device sends a request to the user device to display the second gift object associated with the avatar object.

24. An information processing method executed by an information processing device that displays a video on a display of a user device, comprising: The information processing device, a drawing data transmitting step of transmitting data for drawing an avatar object reflecting a user's movement to the user device; a first display processing step of transmitting a request to display a first gift object to the user device in response to a display request transmitted by a viewing user who is viewing the video; a request sending step of sending a request to the user device to display the second gift object when a display condition of the second gift object to be displayed without being based on the display request sent by the viewing user is satisfied; In the request transmission step, sending, to the user device, a request to display the second gift object associated with the avatar object when the display condition relating to the viewing situation of the viewing user watching the video is satisfied; An information processing method, comprising expressing an expression function based on the user's operation of an expression function selection unit for activating the expression function of the avatar object as the second gift object.

25. An information processing method executed by an information processing device that displays a video on a display of a user device, comprising: The information processing device, a drawing data transmitting step of transmitting data for drawing an avatar object reflecting a user's movement to the user device; a first display processing step of transmitting a request to display a first gift object to the user device in response to a display request transmitted by a viewing user who is viewing the video; a request sending step of sending a request to the user device to display the second gift object when a display condition of the second gift object to be displayed without being based on the display request sent by the viewing user is satisfied; In the request sending step, when the display condition that the display request of the first gift object for the video is not received from the viewing user device used by the viewing user is satisfied, a request to display the second gift object associated with the avatar object is sent to the user device.

Images