Application program for moving image, object drawing method for moving image, moving image management program, moving image management method, server, and moving image distribution system

Abstract

To increase user satisfaction with a drawing function for objects requested to be displayed.SOLUTION: A moving image distribution system 11 includes: a display request receiving unit that receives a display request for an object based on an operation of a user viewing a moving image from a terminal used by the user together with the object's identification information; a group determination unit that determines a group to which the object that is a subject of the display request belongs; a management unit that adds the object's identification information to a waiting queue corresponding to the determined group; a determination unit that determines, among a plurality of drawing positions corresponding to the group, a drawing position at which an object at the head of the waiting queue should be drawn according to order assigned to each drawing position; and an execution unit that renders the object at the drawing position determined by the determination unit.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a video application program, a method for drawing an object in a video, a video management program, a video management method, a server, and a video distribution system.

Background Art

[0002] Conventionally, a video distribution system that distributes a video including animation of an avatar object based on the movement of a user has been known (see, for example, Patent Document 1). In this type of video distribution system, a function has been proposed to display an arbitrary object in a video in response to a display request transmitted from a viewing user who views the video. The arbitrary object includes a gift object given from the viewing user to an avatar object (or a distribution user who distributes the video).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] The display position of a gift object often depends on the type of the gift object. For example, as shown in FIG. 16, gift objects 1 to 3 are predetermined to be displayed in a first region 4, a second region 5, and a third region 6, respectively. As shown in FIG. 17, when a large number of display requests for gift object 1 are made by a viewing user, one gift object 1 may be hidden by another gift object 1 within the first region 4, or the gift object 1 may become invisible immediately after being displayed. There is a possibility that the gift object may be displayed in a state where it is difficult to see or not prominent. Thus, if a gift object is displayed in a video in a state unintended by the viewing user, the satisfaction of the viewing user with respect to giving a gift may decrease. Also, for a distribution user, if a gift object received from a viewing user is displayed in a state where it is difficult to see or not prominent, the satisfaction with the function of the video distribution system may decrease.

[0005] The present invention has been made in view of the above circumstances, and an object thereof is to increase the user's satisfaction with respect to the drawing function of an object for which a display request has been made.

Means for Solving the Problem

[0006] A video application program for solving the above problem causes a computer to function as a receiving unit that receives identification information of an object transmitted by a first user device used by a first user who views a video, and based on the received identification information, among a plurality of drawing positions corresponding to a group to which the object belongs, determines a drawing position at which the object should be drawn according to the order assigned to each of the drawing positions, and an execution unit that renders the object at the drawing position determined by the determination unit.

[0007] The object drawing method for a video that solves the above problems includes a receiving step in which a computer receives identification information of an object transmitted by a first user device used by a first user who views the video, and based on the received identification information, among a plurality of drawing positions corresponding to a group to which the object belongs, a determination step of determining a drawing position at which the object should be drawn according to the order assigned to each of the drawing positions, and an execution step of rendering the object at the drawing position determined by the determination unit.

[0008] The video management program that solves the above problems causes a computer to function as a request receiving unit that receives a display request for an object transmitted by a first user device used by a first user who views the video and identification information of the object that is the target of the display request, a group determination unit that receives identification information of an object and the display request for the object based on an operation of a user who views the video and determines a group to which the object belongs, a management unit that adds the identification information of the object to a waiting queue corresponding to the determined group, and a transmission unit that transmits the identification information of the object included in the waiting queue to a second user device used by a second user who distributes the video.

[0009] The video management method that solves the above problems includes a request receiving step in which a computer receives a display request for an object transmitted by a first user device used by a first user who views the video and identification information of the object that is the target of the display request, a group determination step of receiving identification information of an object and the display request for the object based on an operation of a user who views the video and determining a group to which the object belongs, a management step of adding the identification information of the object to a waiting queue corresponding to the determined group, and a transmission step of transmitting the display request for the object included in the waiting queue to a second user device used by a second user who distributes the video.

[0010] The server for solving the above problems includes: a request receiving unit that receives a display request for an object and identification information of the object targeted by the display request, which are transmitted by a first user device used by a first user who views a video; a group determination unit that receives identification information of an object and the display request for the object based on an operation of a user who views a video, and determines a group to which the object belongs; a management unit that adds the identification information of the object to a queue corresponding to the determined group; and a transmission unit that transmits the display request for the object included in the queue to a second user device used by a second user who distributes the video.

[0011] The video distribution system for solving the above problems includes: a display request receiving unit that receives, from a terminal used by a user, a display request for an object together with identification information of the object based on an operation of the user who views a video; a group determination unit that determines a group to which the object targeted by the display request belongs; a management unit that adds the identification information of the object to a queue corresponding to the determined group; a determination unit that determines a drawing position where an object at the head of the queue should be drawn according to the order assigned to each of a plurality of drawing positions corresponding to the group; and an execution unit that renders the object at the drawing position determined by the determination unit.

Advantages of the Invention

[0012] According to the present invention, it is possible to improve the user satisfaction with respect to the drawing function of the object for which a display request is made.

Brief Description of the Drawings

[0013]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

DETAILED DESCRIPTION OF THE INVENTION

[0014] Hereinafter, an embodiment of the video distribution system will be described with reference to the drawings. As shown in FIG. 1, the video distribution system 11 includes a user device 12 and a server 13. The video distribution system 11 is a system that displays a video on the user device 12 by transmitting and receiving data via a network 14 between a plurality of user devices 12 and the server 13. A video application program for viewing and distributing videos is installed on the user device 12. Hereinafter, a user who distributes a video is referred to as a "distribution user", a user who views a video distributed by the distribution user is referred to as a "viewing user", and when these are not distinguished, they are simply referred to as "users".

[0015] The user device 12 is a wearable computer such as a smartphone (multifunctional mobile phone terminal), a tablet terminal, a personal computer, a console game machine, a head-mounted display, or an information processing device capable of playing videos other than these devices.

[0016] The user device 12 includes a computer processor 20, a memory 21, a storage 22 (storage medium), and a communication interface (I / F) 23. The computer processor 20 is an arithmetic device that loads an operating system and other programs from the storage 22 or other storage into the memory 21 and executes instructions fetched from the memory 21. The computer processor 20 is one or more arithmetic circuits such as a CPU (Central Processing Unit), a GPU (Graphic Processing Unit), and an NPU (Neural network Processing Unit). The communication I / F 23 can transmit and receive data to and from the server 13 and other user devices 12 via the network 14. The network 14 includes various networks such as a local area network and the Internet. The communication I / F 23 is implemented as hardware, software, or a combination thereof.

[0017] The memory 21 is a main memory device (recording medium) that can be directly read from and written to by the computer processor 20, and is composed of a semiconductor memory or the like. The storage 22 is an auxiliary storage device (recording medium), and is, for example, a storage medium such as a magnetic disk, an optical disk, or a semiconductor memory. The storage 22 can also be used by combining a plurality of storages. The storage 22 stores a video application program 22A, avatar data 22B for drawing an avatar object, and object information 22C.

[0018] The video application program 22A can be switched between a distribution mode in which the user himself distributes a video and a viewing mode in which the user views a video distributed by another distributing user according to a user's instruction.

[0019] The avatar data 22B is three-dimensional model data for drawing an avatar object. The user device 12 acquires the avatar data 22B from the server 13 at a predetermined timing when the video application program 22A is started or the like. The avatar data includes data for drawing the avatar object main body, texture data applied to the avatar object main body, and the like. The data for drawing the avatar object main body includes polygon data, skeleton data (bones) for expressing the movement of the avatar object, and the like. The avatar data 22B may include data for drawing a plurality of avatar object main bodies. The texture data includes a plurality of part data applicable to the avatar object. For example, a plurality of part data are prepared for each category such as "eyes", "eyebrows", "ears", "clothes", etc. The user selects the part data and applies it to the avatar object main body to create an avatar object. The combination of the avatar object main body and the part data selected by the user is recorded in the storage 22.

[0020] The object information 22C is data downloaded from the server 13 at a predetermined timing. The object information 22C is information regarding objects other than the avatar object. Objects other than the avatar object are distinguished according to the usage form of the user. Specifically, in addition to objects that can be displayed by the distribution user, gift objects provided from the viewing user to the distribution user are included. The gift objects include effect objects, wearable objects, and normal objects. The effect object is an object that affects the impression of the entire viewing screen of the distribution video, and is, for example, an object imitating confetti or an object imitating fireworks. The wearable object is an object that is displayed on the display screen in association with a specific part of the avatar object. The wearable object is, for example, an accessory (hat, glasses, etc.) worn on the wearable object, clothing (such as a T-shirt), a costume, and an object that can be worn on other avatar objects. The wearable object is worn on the avatar object after being provided by the viewing user and selected by the distribution user. The normal object is a gift object other than the wearable object arranged as an object in the virtual space, and is, for example, an object imitating a stuffed toy or a bouquet of flowers.

[0021] Also, the object may be an object that performs physical behavior. Specifically, the object may simulate physical behavior such as falling due to gravity and movement due to the application of force. A component (program) for simulating physical behavior is executable-ly associated with the physical behavior object.

[0022] In addition, the user device 12 includes a sensor unit 24, a speaker 25, a microphone 26, an operation unit 27, and a display 28. At least one of the sensor unit 24, the speaker 25, the microphone 26, the operation unit 27, and the display 28 may be provided as the same device as the computer processor 20, or may be provided in a manner of being connected to the device including the computer processor 20.

[0023] The sensor unit 24 is a group of sensors that detects a face motion indicating a change in the user's facial expression and a body motion indicating a change in the relative position of the user's body with respect to the sensor unit 24. The face motion includes movements such as blinking and opening / closing of the mouth. For example, the sensor unit 24 has at least one of an emission unit that emits infrared rays toward the user and an infrared camera that detects the infrared rays reflected by the user's face or the like, and a camera that captures the user's face and an image processing unit that performs image processing on the data captured by the camera. Alternatively, the sensor unit 24 may be other sensors, or may further combine sensors other than the above sensors such as an acceleration sensor and a gyro sensor. Hereinafter, the detection data of the face motion and the detection data of the body motion are referred to as "motion data".

[0024] The speaker 25 converts voice data into voice and outputs it. The microphone 26 inputs the voice spoken by the user and converts it into voice data. The operation unit 27 is a touch panel integrated with the display 28, operation buttons provided on the housing of the user device 12, a keyboard, a mouse, a controller, or the like. The display 28 outputs various images in response to the output instruction of the computer processor 20.

[0025] By executing the video application program 22A stored in the storage 22, the computer processor 20 functions as an application management unit 20A, a motion data generation unit 20B, and a display control unit 20C. The application management unit 20A manages the video application program. The application management unit 20A inputs the user's request or request from the server 13 input through the operation unit 27, etc., and outputs a request to the motion data generation unit 20B or the display control unit 20C according to the content of these requests. In addition, the application management unit 20A transmits requests and various data from the motion data generation unit 20B and the display control unit 20C to the server 13, or records various data received from the server 13 in the storage 22.

[0026] The motion data generation unit 20B acquires motion data from the sensor unit 24. In addition, the motion data generation unit 20B transmits the acquired detection data to the server 13.

[0027] In the distribution mode, the display control unit 20C applies motion data to the avatar data 22B to generate an animation including an avatar object that operates according to the movement of the distribution user. In addition, the display control unit 20C performs rendering including the avatar object and objects other than the avatar object. The rendering here refers to a drawing process including acquisition of the position of the virtual camera, perspective projection, hidden surface elimination (rasterization), etc. The rendering may be at least one of these processes, or may include processes such as shading and texture mapping. In addition, the display control unit 20C generates an animation using the rendered image. Then, video data synthesized (superimposed) with a post message transmitted from the user device 12 of the viewing user or a notification transmitted from the server 13, etc. is output to the display 28.

[0028] Further, the display control unit 20C synchronizes the audio data input from the microphone 26 with the video data and outputs the synchronized data to the display 28. Further, the display control unit 20C encodes the video data and the audio data. The application management unit 20A transmits the encoded data to the server 13.

[0029] Also, in the viewing mode, the display control unit 20C receives the encoded video data and audio data from the server 13. Further, the display control unit 20C decodes the received data, synchronizes the video data and the audio data, and outputs the synchronized data to the display 28 and the speaker 25.

[0030] Next, the server 13 will be described. The server 13 is used by a service provider or the like that provides a service for distributing videos. The server 13 includes a computer processor 30, a memory 31, a storage 32, and a communication I / F 33. The computer processor 30 has the same configuration as the computer processor 20 of the user device 12. The computer processor 30 may be configured by combining a plurality of arithmetic circuits. Also, the memory 31, the storage 32, and the communication I / F 33 have the same configuration as those of the user device 12. The server 13 may be composed of a plurality of devices, and the computer processor 30, the memory 31, the storage 32, and the communication I / F 33 may be distributed and provided in those devices.

[0031] The storage 32 stores a distribution program 32A. The computer processor 20 functions as a distribution management unit 30A and a purchase processing unit 30B by executing the distribution program 32A. The distribution program 32A corresponds to a video management program.

[0032] The distribution management unit 30A stores various data received from the user device 12 in the storage 32, and outputs a request to the purchase processing unit 30B based on a purchase request or the like received from the user device 12. Further, the distribution management unit 30A acquires the data requested by the user device 12 from the storage 32 or the like and transmits it to the user device 12. Specifically, the distribution management unit 30A transmits a list of videos being distributed in response to a request from the user device 12. When the distribution management unit 30A receives the identification information of the requested video from the user device 12 from among the list, it transmits a distribution request to the user device used by the distributing user of the requested video. Further, the distribution management unit 30A receives a posted message or the like posted by the viewing user for the video being distributed. Furthermore, the distribution management unit 30A transmits the received posted message to the user device 12 of the distributing user and the user device 12 of the viewing user. The posted message includes, in addition to the content of the message, the identification information of the viewing user (such as the user's account name), the posting date and time, etc. Also, together with the posted message, a notification message "User A has entered" is also displayed.

[0033] The distribution management unit 30A receives a display request for an object in the video being viewed from the user device 12 used by the viewing user who views the video. The object for which the display request is made is an object displayed in the virtual space, and includes a gift object provided by the viewing user to the distribution user who distributes the video, an evaluation object that favorably evaluates the video, a cheering object for cheering the distribution user, and the like. The gift object may be one for which a display request can be made without paying a price, or one for which a display request is made by paying a price. Alternatively, the gift object may be one that pays a price when displayed in response to a display request. The distribution management unit 30A transmits the display request for the gift object to the user device 12 of the distribution user together with the identification information of the gift object. When the display request for the gift object is received by the server 13, or when a predetermined operation by the distribution user on the display request is performed, etc., at a predetermined timing, a notification message such as "User B has sent fireworks" is transmitted to the user device 12 of the distribution user and the user device 12 of the viewing user.

[0034] The purchase processing unit 30B performs an object purchase process according to the user's operation. The purchase process includes a purchase in which a price (medium) such as coins, points, and tickets available in the video application program is paid to obtain an object. The purchase process may also include processes for exchanging, selling, and transferring objects. Further, the purchase processing unit 30B may execute a lottery (gacha) in which a predetermined number of objects are selected from a plurality of objects when a price is paid. The purchase processing unit 30B records the purchased object in the user device 12 or the server 13 as being held by the user. The sales of purchasable objects are distributed to, for example, the distribution user and the service provider.

[0035] Next, various data stored in the storage 32 of the server 13 will be described. The storage 32 stores user management information 32B, avatar data 32C, and object information 32D.

[0036] The user management information 32B is information about users who use the video application program. The avatar data 32C is master data for drawing avatar objects, and is transmitted to the user device 12 in response to a request from the user device 12.

[0037] The object information 32D is master data for drawing gift objects, and is transmitted to the user device 12 in response to a request from the user device 12. The object information 32D includes data for drawing gift objects such as polygon data, as well as attribute information of the gift objects.

[0038] Next, referring to FIG. 2, the user management information 32B will be described. The user management information 32B is stored for each user. The user management information 32B includes user identification information (user ID and password), coins, points, etc. The coins are purchased by the user. The points are given to the user at a predetermined timing, such as when a distribution is made, when an event is participated in, or when an object or the like is sold.

[0039] Referring to FIG. 3, the attribute information of the objects included in the object information 32D will be described. This attribute information includes an object ID, a group, an order, and a drawing position. The object ID is identification information of the gift object. The group is a group to which the gift object belongs. The group is created in advance by the service provider or the operator who operates the service. The criteria for creating the group are not particularly limited, but groups may be created for each category, type, or attribute of the gift object. Note that the gift objects include gift objects not associated with a group.

[0040] Furthermore, a plurality of drawing positions are associated with each of the groups. The drawing positions are positions where gift objects are drawn, and are indicated by coordinates in the virtual space. The drawing positions are represented by, for example, three-dimensional coordinates in the virtual space. Also, an order in which drawing is to be performed is assigned to the drawing positions. For example, "hanging shaft 1", "hanging shaft 2",... belong to "group 1". Also, "first drawing position" to "fifth drawing position" are associated with "group 1". For example, the order of "first drawing position" to "fifth drawing position" is assigned as "1" to "5". The gift objects belonging to the group are arranged at one selected drawing position among the plurality of drawing positions associated with the group.

[0041] Next, with reference to FIG. 4, a method for distributing a video using the user device 12 will be described. Note that the user device 12 used for video distribution and viewing will be described as a smartphone. The distributing user 100 confronts the user device 12 such that at least their face is included in the detection range 101 of the sensor unit 24, and executes a distribution application program. At this time, the distributing user 100 sets the distribution application program to the distribution mode.

[0042] The user device 12 used by the distributing user 100 applies the motion data output from the sensor unit 24 to the avatar data 22B to generate an animation. A video of a virtual space including an avatar object is displayed on the display 28 of the user device 12. The angle of the virtual camera in the virtual space can be changed based on the user's operation. The position of the avatar object changes according to the relative distance L between the distributing user 100 and the sensor unit 24. The change in the relative distance L is detected as a change in the distance in the positive x-axis direction, negative x-axis direction, positive z-axis direction, and negative z-axis direction in FIG. 4. The user device 12 encodes the generated animation and transmits the encoded data to the server 13.

[0043] Server 13 distributes the encoded data to user device 12 used by viewing user 102 via server 13. The viewing user 102 performs operations such as giving a gift object to the video, and the user device 12 sends a display request for the gift object to server 13. Server 13 sends the display request for the gift object received from user device 12 to user device 12 of distribution user 100. User device 12 of distribution user 100 sends an animation including the gift object to server 13 based on the display request.

[0044] (Operation) Next, with reference to FIGS. 5 and 6, the processing procedure when displaying a gift object will be described. In the present embodiment, FIG. 5 is the processing procedure executed by the server, and FIG. 6 is the processing procedure executed by user device 12 of the distribution user. Server 13 receives the identification information of the gift object and the display request for the gift object from user device 12 in the viewing mode (step S1).

[0045] Based on the identification information of the gift object, server 13 refers to object information 32D and determines the group to which the gift object for which the display request was made belongs (step S2). Further, server 13 adds the identification information of the gift object to the queue corresponding to the determined group (step S3).

[0046] Also, when server 13 adds a gift object to the queue, it sends the display request for the gift object at the head of the queue to user device 12 of the distribution user. At this time, server 13 may send a list of gift objects included in the queue. Note that this list also includes the order of the gift objects in the queue.

[0047] As shown in FIG. 6, the user device 12 of the distributing user renders objects such as the gift object and the character object at the head of the waiting queue based on the display request received from the server 13 (step S4). Further, the user device 12 outputs the rendered animation as a video to the display 28 together with the audio data, the posted message, etc. received from the server 13 (step S5).

[0048] Next, with reference to FIGS. 7 to 11, the processing in steps S3 to S4 will be described in detail. As shown in FIG. 7, when the server 13 receives a display request for gift objects such as "scroll 1" and "scroll 2" from the user device 12 of the viewing user, the server 13 adds the identification information 111, 112 of those gift objects to the rendering waiting queue 110 of the group to which the gift objects belong. The server 13 adds the identification information 111, 112 to the rendering waiting queue 110 in the order in which the display requests for the gift objects are received. When the server 13 further receives a display request for a gift object such as "scroll 3", the server 13 adds the identification information 113 to the end of the rendering waiting queue 110. Further, the server 13 transmits the display request for "scroll 1" at the head of the rendering waiting queue 110 to the user device 12 of the distributing user, and moves up the order of the other gift objects included in the rendering waiting queue 110.

[0049] As shown in FIG. 8, in the group to which the gift object of the "hanging scroll" belongs, the first drawing position 116 to the fifth drawing position 120 in the virtual space are set. The first drawing position 116 to the fifth drawing position 120 are provided at positions that do not obstruct the drawing of the avatar object 130 when viewed from the virtual camera. In the example of FIG. 8, the first drawing position 116 to the fifth drawing position 120 are arranged in a row. The drawing positions 116 to 120 are set such that the gift objects do not overlap each other and look good in terms of their intervals, etc., considering the size of the gift objects belonging to the group. To each of the first drawing position 116 to the fifth drawing position 120, a drawing order such as "1" to "5" is assigned. For example, as shown in FIG. 8, the first order may be assigned to the central position, and the subsequent orders may be alternately assigned to the left and right. Or, the drawing order may be assigned in ascending or descending order in the direction from left to right.

[0050] When the gift object is not displayed at any of the first drawing position 116 to the fifth drawing position 120 in the user device 12 of the distributing user, the position of the gift object of the "hanging scroll 1" is set to the drawing position 116 to which the first number "1" is assigned. Next, the user device 12 sets the position of the gift object of the "hanging scroll 2" to the drawing position 117 to which the second number is assigned. Similarly, the user device 12 assigns the positions of the gift objects of the "hanging scroll 3" and "hanging scroll 4" from the drawing positions with higher priority among the available drawing positions. The "drawing position with higher priority" here refers to the drawing position to which the smallest order among the available drawing positions is assigned. Also, the user device 12 draws the gift objects 131 to 133 that do not belong to any group at the drawing positions set for them.

[0051] As shown in FIG. 9, as a result of the gift objects being rendered at the drawing positions corresponding to the groups and being drawn as an animation, the gift objects 140 to 141 are displayed neatly side by side in the horizontal direction of the screen without overlapping each other. No gift object is displayed at the drawing position 120 at the right end in FIG. 9. When the user device 12 receives a display request for a new gift object belonging to the same group via the server 13, a gift object is displayed at the drawing position 120. When arranging the gift objects 140 to 141 at the drawing position 120, an effect such as falling at a constant speed from the upper side to the lower side of the screen may be performed.

[0052] Also, when the exit condition is satisfied, the gift object exits from the drawing position. The exit condition is, for example, that the display time elapsed since the display of the gift object was started has reached the upper limit value. When gift objects are displayed at all the drawing positions 116 to 120, when the elapsed time of any one of the gift objects reaches the upper limit value, the user device 12 erases the gift object or executes an effect of moving it from the drawing position. When the gift object exits from the drawing position, the distribution management unit 30A transmits a display request for the gift object at the head of the rendering queue to the user device 12 of the distribution user. Alternatively, the user device 12 of the distribution user renders the gift object at the head of the queue at the empty drawing position based on the list.

[0053] For example, as shown in FIG. 9, when the gift object 140 at the drawing position with the highest priority exits in a state where the drawing position 120 with the lowest priority is empty, a new gift object may be drawn not at the drawing position 120 but at the position where the gift object 140 was drawn. Alternatively, a new gift object may be drawn at the drawing position 120 where the time when no gift object is displayed is the longest.

[0054] The exit condition may be other than the display time reaching the upper limit value. For example, the distribution user has performed an operation to exit the gift object using the user device 12, either intentionally or unintentionally, the viewing user has performed an operation to exit the gift object, the number of gift objects added to the waiting queue has reached a predetermined number, and so on.

[0055] Figures 10 and 11 are examples of the arrangement of gift objects belonging to a group different from the group to which the above-described gift objects 140 to 141 belong. In the example shown in Figure 10, the first drawing positions 151 to the sixth drawing positions 156 are arranged in multiple rows. The first drawing positions 151 to the sixth drawing positions 156 are arranged in a staggered pattern when viewed from the virtual camera. Also, in each row, the height positions of the first drawing positions 151 to the sixth drawing positions 156 in the direction from the lower side to the upper side of the screen (the positive direction of the Y axis in Figure 10) are different. Specifically, they increase in the order of the rows of the first drawing position 151, the second drawing position 152, and the third drawing position 153, and the rows of the fourth drawing position 154 to the sixth drawing position 156.

[0056] Figure 11 shows a state where gift objects 161 to 166, namely "Tower Cake 1" to "Tower Cake 6", are arranged at these first to sixth drawing positions 151 to 156. If all of the gift objects 161 to 166 are arranged side by side, they cannot be fully accommodated within the screen. Also, it is difficult to display the gift objects 161 to 166 within the screen without overlapping them. In contrast, by staggering the first to sixth drawing positions 151 to 156 in a zigzag pattern as viewed from the camera position side, the overlapping portions can be minimized as much as possible, and the gift objects 161 to 166 can be displayed in an orderly state. Also, a large number of gift objects 161 to 166 can be displayed within the screen. By displaying the gift objects 161 to 166 in a high-density state within the screen like this, as many gift objects presented by viewing users as possible can be displayed within the video distribution time. Also, when there is an upper limit value for the display time of one gift object, the time for each of the gift objects to be displayed can be made as long as possible. Also, for tall objects like these gift objects 161 to 166, shifting them in the height direction makes it easier to see the gift objects behind. For this reason, viewing users who presented the gift objects behind can recognize their own gift objects on the video, so the satisfaction with the gifts increases.

[0057] Note that the number of drawing positions set for the objects belonging to a group does not necessarily have to be plural. For example, since only one "wallpaper" object can be displayed within the virtual space, one drawing position is set. When a plurality of "wallpaper" objects are presented, those gift objects are added to the rendering waiting queue of the "wallpaper" object group. Then, the "wallpaper" object for which a predetermined time has elapsed since being drawn at the drawing position is erased or moved, and the leading "wallpaper" object waiting in the waiting queue is rendered.

[0058] Next, referring to FIGS. 12 and 13, the screen displayed on the display 28 of the user device 12 used by the viewing user will be described. As shown in FIG. 12, an avatar object 201 is displayed on the viewing screen 200. The avatar object 201 changes its expression according to the change in the expression of the distributing user. Further, the avatar object 201 moves based on the change in the relative position of the distributing user with respect to the user device 12.

[0059] On the viewing screen 200, a posting column 170 for posting a message and a message 171 posted by a viewing user who is watching a video using the posting column 170 are displayed. Further, on the viewing screen 200, an evaluation button 172 for giving a good evaluation to the video and a gift button 173 for giving a gift object to the video are displayed. When the viewing user operates the gift button 173, the user device 12 receives the input operation and displays a gift list described later.

[0060] When the server 13 receives a display request for a gift object sent from the user device 12 of the viewing user, gift objects 140 to 143 and 180 are displayed on the screen. The gift objects 140 to 143 belonging to the group are displayed at the drawing positions corresponding to the group. The gift object 180 not belonging to the group is displayed in another area. Further, the wearable object is displayed in association with a predetermined part of the avatar object 201. The gift object not belonging to the group may be displayed at a position randomly selected from a predetermined area. In this way, while the objects belonging to the group are displayed side by side in a row according to the characteristics of the objects, the objects not belonging to the group are displayed in other areas, so that the processing load required for the group determination and the selection of the drawing position of the distributing user's user device 12 and the server 13 is reduced, and a rich variety of expressions becomes possible.

[0061] FIG. 13 shows a gift selection screen 210 when the gift button 173 is selected. A gift list 211 is displayed on the gift selection screen 210. In the gift list 211, selectable gift objects are displayed together with their prices. The viewing user performs an operation of selecting one gift object from the gift list 211. If the selected gift object is an object that requires a price, the user operates the purchase button 212. Thereby, the identification information and display request of the gift object are transmitted from the user device 12 to the server 13.

[0062] Next, the effects of the present embodiment will be described. (1) When a plurality of gift objects belonging to a group are simultaneously displayed on the screen, among the plurality of drawing positions corresponding to the group, the gift objects are drawn in the order assigned to the drawing positions. Therefore, even when display requests for a plurality of gift objects are made, since those gift objects are displayed in a preset layout, the gift objects are not duplicated or erased in an unintended manner and are displayed in a good-looking state. For this reason, the satisfaction of the viewing user who makes a display request for the gift object and the satisfaction of the distribution user with respect to the gift function can be enhanced.

[0063] (2) After a predetermined time has elapsed since the display of the gift object started, the gift object exits from the drawing position, and among the drawing positions where the object is not displayed, the drawing position with the highest display order priority is set as the drawing position for the new object. For this reason, even when the number of display requests for the gift object increases, as many objects as possible can be displayed.

[0064] (3) When the identification information of a new object is received, the gift object sets the drawing position of the object with the longest drawing time as the drawing position of the new object. For this reason, even when the number of display requests for the gift object increases, as many objects as possible can be displayed.

[0065] Since the drawing positions corresponding to the group (4) include drawing positions with different depth positions and height positions, even a bulky gift object can be displayed in an easy-to-see manner for a plurality of gift objects.

[0066] (5) The gift object includes a gift object that does not belong to the group, and the gift object that does not belong to the group is rendered in an area other than the drawing position corresponding to the group. According to this, the processing load on the user device 12 and the server 13 of the distribution user is reduced, and a rich variety of expressions becomes possible.

[0067] The above embodiment can be implemented with the following modifications. The above embodiment and the following modification examples can be implemented in combination with each other within a technically non - conflicting range. · In the above-described embodiment, an example in which gift objects of the same type or category are grouped, such as "hanging scroll 1" and "hanging scroll 2", has been described. However, the gift objects may be grouped according to other criteria. FIG. 14 schematically shows avatar objects 130A and 130B, and gift objects 220A to 220C, 221A to 221C, and 224. In FIG. 14, solid lines indicate objects, and dashed lines indicate regions. For example, when avatar objects 130A and 130B co-star in a video, display regions 220 and 221 for gift objects may be set around avatar objects 130A and 130B. At this time, the user device 12 determines whether the gift object for which a display request has been made is associated with either of avatar objects 130A and 130B, and displays the gift object in the display region of the associated avatar object. For example, when a female avatar object 130A and a male avatar object 130B co-star, if a gift object 222 which is a "bag" for avatar object 130A is requested to be displayed, gift object 220A is displayed in display region 220 set around avatar object 130A. Also, if a gift object 222 which is "shoes" for avatar object 130B is requested to be displayed, gift object 221A is displayed in display region 221 set around avatar object 130B. A plurality of drawing positions are set in display regions 220 and 221, and the gift objects are rendered in the order assigned to these drawing positions. When a gift object 224 not associated with either of avatar objects 130A and 130B is requested to be displayed, it is displayed in a region 225 other than display regions 220 and 221. Or, the delivery user corresponding to the main co-starring avatar object 130A performs an operation to determine the display region.

[0068] ·In the above-described embodiment, the case where there is an upper limit value for the display time of the gift object has been described. However, the exit conditions of the gift object may be made different according to the group. As shown in FIG. 15, the free object and the paid object may be displayed in different display areas 230 and 231. The free object is one that takes the points given in the video application as consideration, and the paid object is one that takes currency such as money or points that can be used outside the video application as consideration. Note that the free object may be given to the user without requiring consideration at a predetermined timing. Drawing positions 232 to 234 are set in the display area 230 of the free object. Drawing positions 235 to 239 are set in the display area 231 of the paid object. The upper limit value Tmax2 of the display duration of the paid object displayed in the display area 231 may be longer than the upper limit value Tmax1 of the display duration of the free object displayed in the display area 230 (Tmax2 > Tmax1). Also, the maximum number of paid objects displayed in the display area 231 may be larger than the maximum number of free objects displayed in the display area 230. By doing so, the display time of the paid object can be lengthened. Also, the display area 231 is arranged closer to the camera position than the display area 230. By doing so, the motivation to give a paid object is enhanced, and it is expected that the viewing time and number of views of the video, and the distribution time and number of distributions of the video will increase.

[0069] ·In the above-described embodiment, it is assumed that an order is assigned to a plurality of drawing positions in the display area. Instead of this, the distribution management unit 30A may randomly select one from among the plurality of drawing positions in the display area and display the gift object at the selected drawing position.

[0070] · In the above-described embodiment, the gift objects displayed at the drawing positions are caused to exit from the drawing positions in the order in which the exit conditions are satisfied. Instead of or in addition to this, when the exit condition is satisfied, the gift objects may be caused to exit from the drawing positions all at once. Also, the gift objects may be continuously displayed while the video is being distributed. For example, when the viewing user makes a display request for an object of "red ball", the user device 12 of the distributing user displays the gift objects of "red ball" at the drawing positions in the corresponding display area in order or randomly. When the viewing user selects an object of "white ball", the user device 12 of the distributing user displays the gift objects of "white ball" at the drawing positions in the corresponding display area in order or randomly. During a predetermined period, the gift objects displayed in the display area are not erased or caused to exit from the display area. At this time, the distribution management unit 30A may count the number of gift objects for each display area, compare the number of gift objects for each display area, and perform a win / loss or evaluation. Also, when a predetermined period has elapsed, all the "red balls" and "white balls" in the display area may be caused to exit all at once.

[0071] · In the above-described embodiment, the server 13 transmits the posted message to both the user device 12 of the distributing user and the user device 12 of the viewing user. Then, the user device 12 composes (superimposes) the posted message onto the animation for drawing. Instead of this, the posted message may be transmitted only to the user device 12 of the distributing user. Then, the user device 12 of the viewing user may receive the video data in which the animation and the posted message are composed by the user device 12 of the distributing user.

[0072] · In the above-described embodiment, the server 13 receives the display request for the gift object from the user device 12 and adds the identification information of the gift object to the waiting queue. Instead of this, the user device 12 of the distributing user may receive the display request for the gift object from the server 13 and manage the waiting queue.

[0073] · In the above-described embodiment, it is assumed that a video application program for viewing and distributing videos is installed in the user device 12. Instead of this, an application program for viewing videos and an application program for distributing videos may be separated into different application programs. When distributing, the video is distributed using the distribution application program. When viewing, the video is viewed using the viewing application program. The display request for the gift object is made using the viewing application program.

[0074] · In the above-described embodiment, the user device 12 of the distributing user encodes video data and audio data, transmits the encoded data to the server 13, and the user device 12 of the viewing user displays the video on the display 28 based on the encoded data (video distribution method). Instead of this, from the user device 12 of the distributing user, the minimum necessary data (video composition data) for generating a video such as audio data and motion data is transmitted to the server 13, and the server 13 transmits the video composition data to other user devices 12, and each of the user devices 12 generates a video (client rendering method). In the client rendering method, the server 13 transmits a display request for the gift object to each of the user devices 12. Or, the server 13 may transmit a list of gift objects to each of the user devices 12. The user device 12 performs rendering of the object including the avatar object based on the display request or the list, and generates a video. According to this, the encoding process of the user device 12 of the distributing user is omitted, and the communication volume between the user device 12 of the distributing user and the server 13 and between the server 13 and the user device 12 of the viewing user can be reduced.

[0075] Alternatively, the server 13 may perform rendering of the avatar object and the gift object. In this case, the server 13 generates video data, encodes it, and distributes it to each user device 12.

[0076] · The motion data generation unit 20B was to acquire detection data obtained by detecting changes in the user's facial expressions, head movements, and the user's relative position with respect to the sensor unit 24 from the sensor unit 24, but at least one of them may be used. Further, in addition to or instead of at least one of the changes in the user's facial expressions, head movements, and the user's relative position, the motion data generation unit 20B may acquire other detection data such as detection data obtained by detecting movements other than head movements.

[0077] · The virtual space displayed in the video may be an augmented reality (AR) space. For example, animations such as avatar objects and gift objects may be superimposed on an image of the real world captured by the camera of the user device 12. Further, animations such as gift objects may be superimposed on an image of the real world including the user captured by the camera of the user device 12.

[0078] · In the above-described embodiment, the user device 12 is an information processing device such as a smartphone, a mobile phone, a tablet terminal, a personal computer, a console game machine, a wearable computer such as a head-mounted display, etc. Instead of this, the user device 12 may be a system composed of at least one information processing device, an input device, and an output device. For example, the user device 12 may be a system in which a console game machine including a computer processor 20 etc., a sensor unit 24 provided separately from this, a controller which is an operation unit 27, a speaker 25, a display 28, etc. can transmit and receive data to and from each other. Further, the user device 12 may be a system in which an information processing device such as a personal computer, a sensor unit 24 provided separately from this, a controller which is an operation unit 27, a speaker 25, a wearable display which is a display 28, etc. can transmit and receive data to and from each other. Or, instead of the user device 12 that distributes videos, a system provided in a studio for video distribution, which includes an information processing device, a sensor unit 24, an operation unit 27, a speaker 25, and a display 28, may be used as a system for distributing videos.

[0079] · In the above-described embodiment, the sensor unit 24 is provided on the user device 12 side, but at least a part of the sensor unit 24 may be attached to the body of the distribution user or provided in the vicinity of the distribution user. For example, the sensor unit 24 may be composed of an emitting unit that emits detection light such as infrared rays at predetermined intervals, and a light receiving unit that is attached to the body of the distribution user, receives the detection light, and transmits the detection result to the computer processor 20. Or, the sensor unit 24 may be composed of a camera etc. that detects a marker attached to the body of the distribution user. 〔Supplementary Notes〕 The description of the claims of the original application of this application at the time of filing is appended below. [1] A computer, a receiving unit that receives identification information of an object transmitted by a first user device used by a first user who views a video, A determination unit that determines a drawing position where the object should be drawn according to the order assigned to each of the drawing positions corresponding to the group to which the object belongs, based on the received identification information; Function as an execution unit that renders the object at the drawing position determined by the determination unit Video application program. [2] After a predetermined time has elapsed since the drawing of the object started, the execution unit causes the object to exit from the drawing position. Among the drawing positions where the object is not displayed, the determination unit sets the drawing position with a higher display order priority as the drawing position for a new object. The video application program according to claim 1. [3] When the identification information of a new object is received, the determination unit sets the drawing position of the object with the longest drawing time as the drawing position of the new object. The video application program according to claim 1 or 2. [4] The plurality of drawing positions include positions where the depth position and the height position are different in the direction away from the camera position of the video. The video application program according to any one of claims 1 to 3. [5] The object includes an object that does not belong to the group. The execution unit renders an object that does not belong to the group in an area other than the drawing position corresponding to the group. The video application program according to any one of claims 1 to 4. [6] The computer is further caused to Function as a generation unit that generates an animation in which the object is rendered; Function as an encoding unit that encodes the animation and transmits it to a video distribution server. The video application program according to any one of claims 1 to 4. [7] Further function the computer as a position transmission unit that transmits the drawing position determined by the determination unit to a video distribution server with a user device for viewing a video as a transmission destination The video application program according to any one of claims 1 to 4. [8] A computer a receiving step of receiving identification information of an object transmitted by a first user device used by a first user who views a video; a determination step of determining a drawing position where the object should be drawn according to the order assigned to each of the drawing positions, among a plurality of drawing positions corresponding to a group to which the object belongs, based on the received identification information; and an execution step of rendering the object at the drawing position determined by the determination step. A method for drawing an object in a video. [9] A computer a request receiving unit that receives a display request of an object transmitted by a first user device used by a first user who views a video and identification information of the object that is the target of the display request; a group determination unit that receives identification information of an object and a display request of the object based on an operation of a user who views a video, and determines a group to which the object belongs; a management unit that adds the identification information of the object to a waiting queue corresponding to the determined group; and further function as a transmission unit that transmits the identification information of the object included in the waiting queue to a second user device used by a second user who distributes the video. A video management program.

[10] A computer A request receiving step of receiving a display request for an object transmitted by a first user device used by a first user who views a video and identification information of the object that is the target of the display request, A group determination step of receiving identification information of an object and a display request for the object based on an operation of a user who views a video, and determining a group to which the object belongs, A management step of adding the identification information of the object to a queue corresponding to the determined group, A transmission step of transmitting the identification information of the object included in the queue to a second user device used by a second user who distributes the video, and executing Video management method.

[11] A request receiving unit that receives a display request for an object transmitted by a first user device used by a first user who views a video and identification information of the object that is the target of the display request, A group determination unit that receives identification information of an object and a display request for the object based on an operation of a user who views a video, and determines a group to which the object belongs, A management unit that adds the identification information of the object to a queue corresponding to the determined group, A transmission unit that transmits the identification information of the object included in the queue to a second user device used by a second user who distributes the video, and includes Server.

[12] A display request receiving unit that receives a display request for an object together with identification information of the object from a terminal used by the user based on an operation of the user who views a video, A group determination unit that determines a group to which the object that is the target of the display request belongs, A management unit that adds the identification information of the object to a queue corresponding to the determined group, A determination unit that determines a drawing position where the object at the head of the queue should be drawn according to the order assigned to each of the plurality of drawing positions corresponding to the group, An execution unit that renders the object at the drawing position determined by the determination unit. Video distribution system.

Description of Signs

[0080] 11 Video distribution system 12 User device 13 Server.

Claims

1. On the computer, a receiving function for receiving, from a first user device used by a first user, identification information of an object that can be displayed in a virtual space in which a character object of a second user can be displayed, the object being different from the character object; a determination function that determines whether the object belongs to a specific group based on the identification information received by the receiving function; When it is determined that the object belongs to a specific group as a result of the determination by the determining function, rendering the object at a specific drawing position determined from at least one drawing position corresponding to the specific group; an execution function of rendering the object in an area other than the specific drawing position when it is determined that the object does not belong to a specific group as a result of the determination by the determination function; A computer program that achieves this.

2. The computer further comprises:

2. The computer program according to claim 1, further comprising an exit function for causing the objects to exit all at once from the specific drawing position when a predetermined exit condition is met.

3. 3. The computer program product of claim 2, wherein the specified exit condition is that the display time of the object has reached an upper limit, that the second user has intentionally or unintentionally performed an operation to cause the object to exit, and / or that the first user has performed an operation to cause the object to exit.

4. 3. The computer program according to claim 2, wherein the predetermined exit condition varies depending on the group.

5. 2. The computer program according to claim 1, wherein the groups are created for each category, type, or attribute.

6. 2. The computer program product according to claim 1, wherein the groups include a group to which a paid object belongs.

7. The computer program product according to claim 1 , wherein the execution function determines the specific drawing position so as to avoid objects belonging to the same group being displayed overlapping each other when viewed from the direction of a virtual camera.

8. The computer program product according to claim 1 or 7, characterized in that the execution function determines the specific drawing position according to an order assigned to each of a plurality of drawing positions corresponding to a group to which the object belongs.

9. 8. The computer program product according to claim 1, wherein the execution function randomly determines the specific drawing position from among a plurality of drawing positions corresponding to a group to which the object belongs.

10. The computer program product according to claim 1 or 7, characterized in that the execution function determines the specific drawing position so as to avoid the object being displayed overlapping with the second user's character object when viewed from the direction of a virtual camera.

11. the first user is a user participating in a first mode; The computer program product of claim 1 , wherein the second user is a user participating in a second mode.

12. The second mode is a mode for distributing moving images, The computer program product of claim 11 , wherein the first mode is a mode for watching the video.

13. The rendering position includes a position where the depth position and the height position in the direction away from the virtual camera are different.

2. The computer program product of claim 1.

14. The computer further comprises: A generating function for generating an animation by rendering the object; and an encoding function for encoding the animation and transmitting it to a server.

2. The computer program product of claim 1.

15. The computer further comprises: A position transmission function is realized for transmitting the specific drawing position to a server with the first user device as a destination.

2. The computer program product of claim 1.

16. The computer a receiving step of receiving, from a first user device used by a first user, identification information of an object that can be displayed in a virtual space in which a character object of a second user can be displayed, the object being different from the character object; a determination step of determining whether the object belongs to a specific group based on the identification information received in the receiving step; When it is determined in the determining step that the object belongs to a specific group, rendering the object at a specific drawing position determined from at least one drawing position corresponding to the specific group; an execution step of rendering the object in an area other than the specific drawing position when it is determined in the determination step that the object does not belong to a specific group; The object drawing method to perform.

17. a request receiving unit that receives, from a first user device used by a first user, a display request for an object that is displayable in a virtual space in which a character object of a second user can be displayed, and that is different from the character object, and identification information of the object that is the target of the display request; a determination unit that determines whether the object belongs to a specific group based on the identification information received by the request receiving unit; When it is determined that the object belongs to a specific group as a result of the determination by the determination unit, rendering the object at a specific drawing position determined from at least one drawing position corresponding to the specific group; an execution unit that, when it is determined that the object does not belong to a specific group as a result of the determination by the determination unit, renders the object in an area other than the specific drawing position. server.

18. a display request receiving unit that receives, from a first user terminal used by a first user, a display request for an object that can be displayed in a virtual space in which a character object of a second user can be displayed, and identification information of the object that is different from the character object of the second user; a determination unit that determines whether or not the object belongs to a specific group based on the identification information received by the display request receiving unit; When it is determined that the object belongs to a specific group as a result of the determination by the determination unit, rendering the object at a specific drawing position determined from at least one drawing position corresponding to the specific group; an execution unit that renders the object in an area other than the specific drawing position when it is determined that the object does not belong to a specific group as a result of the determination by the determination unit; Equipped Information processing system.

Images