Video processing method, server device, and computer program

Abstract

To provide a moving image processing method, a server device and a program that allow viewing users to increase gifting opportunities.SOLUTION: A moving image processing method that is executed by one or more processors which execute computer-readable instructions in a moving image distribution system 1 comprises: a reception step of receiving a request signal that is generated on the basis of an operation of a viewing user who views a moving image which includes an animation of an avatar object of a distribution user and requests for giving a first gift to a mount site of the avatar object, from a terminal device of the viewing user through a communication line; and a generation step of generating, when it is determined that a combination of a plurality of the first gifts that are given to the mounting site of the avatar object satisfies a predetermined condition on the basis of a plurality of the request signals, a moving image which includes an animation mounted with a second gift having a characteristic in common with the first gift at the mount site of the avatar object.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The technology disclosed in this application relates to a video processing method for video viewed by a viewing user, a server device and a computer program for controlling the video. [Background technology]

[0002] Conventionally, video distribution services that distribute videos to terminal devices via a network have been known. In this type of video distribution service, an avatar (avatar object) of a distributor user who distributes the video is displayed, and an environment is provided in which a viewing user who watches the video and the distributor user can communicate with each other through messages, chats, etc.

[0003] Furthermore, as a communication tool between viewing users and broadcasting users, Patent Document 1 discloses an electronic implementation of the act of gifting, in which a viewing user can provide an item acquired by the viewing user as a gift to an avatar (broadcasting user) in a video.

[0004] In addition, video distribution services such as REALITY (registered trademark) provide an environment in which viewing users can gift each part of an avatar (distributor) that is worn on the avatar (distributor) (e.g., head, neck, and hands) (Non-Patent Document 1).

[0005] The above Patent Document 1 and Non-Patent Document 1 are incorporated herein by reference in their entirety. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2012-120098 A [Non-patent literature]

[0007] [Non-Patent Document 1] "REALITY", [online], [Retrieved August 27, 2019], Internet (URL: https: / / twitter.com / WFLE_REALITY) Summary of the Invention [Problem to be solved by the invention]

[0008] The above-mentioned gifting fosters a sense of affinity and involvement of the viewing user with the avatar through direct communication between the viewing user and the distribution user (avatar). However, in gifting to each wearing part of the avatar as described in Non-Patent Document 1, when one viewing user gifts, for example, the head of the avatar, and a video including the avatar with the gift based on the gifting worn on the head is distributed, even if other viewing users gift the head of the avatar during a predetermined time until the gift worn on the head is deleted from the video, the gift based on the gifting will not be worn on the avatar's head. Therefore, in the case of such gifting control, only limited gifting actions are reflected in the video, and the opportunity for gifting by the viewing user is limited, which causes a problem of suppressing the viewing user's motivation to gift.

[0009] On the other hand, as a method for solving the above-mentioned problem, an alternative has been proposed in which, in a case where one viewing user gifts, for example, gift A to the head of an avatar, and a video is distributed including an avatar with gift A attached to the head based on the gifting, when another viewing user gifts gift B to the avatar's head, gift A is immediately overwritten with gift B. However, in this case, there is also a problem that the viewing user who gifted gift A will find that the gift he or she gifted is suddenly deleted from the video due to gifting by another viewing user, which may increase disappointment in the gifting act.

[0010] In addition, since gifting refers to a situation in which a viewing user purchases a gift by paying a fee to a service provider that offers a video distribution service, and then gifts the gift to a distribution user (avatar), it can be said that increasing gifting opportunities by viewing users is a challenge for service providers.

[0011] Therefore, some embodiments disclosed in the present application provide a video processing method, a server device, and a computer program that increase gifting opportunities for viewing users. [Means for solving the problem]

[0012] A video processing method according to one embodiment is a video processing method executed by one or more processors that execute computer-readable instructions, and includes a receiving step of receiving a request signal from a terminal device of the viewing user via a communication line, the request signal being generated based on an operation of a viewing user watching a video including an animation of an avatar object of a broadcasting user, the request signal requesting that a first gift be assigned to the wearing part of the avatar object; and a generating step of generating the video including an animation of a second gift having characteristics in common with the first gift being attached to the wearing part of the avatar object when it is determined that a combination of a plurality of the first gifts assigned to the wearing part of the avatar object based on a plurality of the request signals satisfies a predetermined condition.

[0013] A server device in one embodiment includes one or more processors, and the processor receives a request signal from the viewing user's terminal device via a communication line, the request signal being generated based on the operation of a viewing user watching a video including an animation of an avatar object of a broadcasting user, requesting that a first gift be assigned to the wearing part of the avatar object, and when it is determined that a combination of multiple first gifts assigned to the wearing part of the avatar object based on multiple request signals satisfies a predetermined condition, generates the video including an animation of a second gift having characteristics in common with the first gift being attached to the wearing part of the avatar object.

[0014] A server device in one embodiment includes one or more processors, and receives a request signal from a terminal device of the viewing user via a communication line, the request signal being generated based on an operation of a viewing user watching a video including an animation of an avatar object of a broadcasting user, requesting that a first gift be assigned to the wearing part of the avatar object, and when it is determined that a combination of multiple first gifts assigned to the wearing part of the avatar object based on multiple request signals satisfies a predetermined condition, the server device transmits information regarding a second gift having characteristics in common with the first gift to the wearing part of the avatar object to the terminal device of the viewing user that generates the video including an animation of the second gift being attached to the terminal device of the broadcasting user or to the terminal device of the viewing user that generates the video including an animation of the second gift being attached to the terminal device of the broadcasting user.

[0015] A computer program in one embodiment, when executed by one or more processors, causes the processors to function as follows: the computer program is generated based on the operation of a viewing user watching a video including an animation of an avatar object of a broadcasting user; the computer program receives a request signal via a communication line from the viewing user's terminal device requesting that a first gift be assigned to the wearing part of the avatar object; and, when it is determined that a combination of multiple first gifts assigned to the wearing part of the avatar object based on multiple request signals satisfies a predetermined condition, the computer program generates the video including an animation of a second gift having characteristics in common with the first gift being attached to the wearing part of the avatar object.

[0016] A computer program according to one embodiment, when executed by one or more processors, causes the processor to function as follows: a request signal is generated based on the operation of a viewing user watching a video including an animation of an avatar object of a broadcasting user; the request signal requests that a first gift be assigned to the wearing part of the avatar object from a terminal device of the viewing user via a communication line; and, when it is determined that a combination of multiple first gifts assigned to the wearing part of the avatar object based on multiple request signals satisfies a predetermined condition, the computer program causes the processor to function as follows: a request signal is generated based on the operation of a viewing user watching a video including an animation of an avatar object of a broadcasting user; the processor receives a request signal from a terminal device of the viewing user via a communication line requesting that a first gift be assigned to the wearing part of the avatar object; and, when it is determined that a combination of multiple first gifts assigned to the wearing part of the avatar object based on multiple request signals satisfies a predetermined condition, the computer program transmits information regarding a second gift having characteristics in common with the first gift to the wearing part of the avatar object to the terminal device of the viewing user or a server device which generates the video including an animation of the second gift being attached to the wearing part of the avatar object.

[0017] A computer program in one embodiment, when executed by one or more processors, causes the processor to function as follows: a request signal is generated based on the operation of a viewing user watching a video including an animation of an avatar object of a broadcasting user, the request signal is sent via a communication line requesting that a first gift be granted to the wearing part of the avatar object, and when it is determined that a combination of multiple first gifts granted to the wearing part of the avatar object based on multiple request signals satisfies a predetermined condition, the computer program causes the processor to function as follows: a request signal is generated based on the operation of a viewing user watching a video including an animation of a broadcasting user's avatar object ... animation.

[0018] A computer program in one embodiment, when executed by one or more processors, causes the processors to function as follows: a request signal is generated based on the operation of a viewing user watching a video including an animation of a broadcasting user's avatar object, the request signal is sent via a communication line requesting that a first gift be assigned to the wearing part of the avatar object, and when it is determined that a combination of multiple first gifts assigned to the wearing part of the avatar object based on multiple request signals satisfies a predetermined condition, the computer program causes the processors to function as follows: a request signal is generated based on the operation of a viewing user watching a video including an animation of a broadcasting user's avatar object ... video including an animation of a second gift having characteristics in common with the first gift being attached to the wearing part of the avatar object based on a plurality of the request signals, the computer program causes the processors to function as follows: [Brief description of the drawings]

[0019] [Figure 1] FIG. 1 is a block diagram showing an example of a configuration of a video distribution system according to an embodiment. [Diagram 2] FIG. 2 is a block diagram illustrating an example of a hardware configuration of the terminal device (server device) illustrated in FIG. [Diagram 3]FIG. 3 is a block diagram illustrating an example of functions of the terminal device illustrated in FIG. [Figure 4] FIG. 4 is a block diagram illustrating an example of the functions of the server device illustrated in FIG. [Diagram 5] FIG. 5 is a diagram illustrating an example of a table managed by the database unit. [Figure 6A] FIG. 6A is a diagram showing an example of a table managed by the database unit, and is a diagram showing a schematic image of the determination unit making a determination. [Figure 6B] FIG. 6B is a diagram showing an example of a table managed by the database unit, and is a diagram showing a schematic image of the determination unit making a determination. [Figure 6C] FIG. 6C is a diagram showing an example of a table managed by the database unit, and is a diagram showing a schematic image of the determination unit making a determination. [Figure 6D] FIG. 6D is a diagram showing an example of a table managed by the database unit, and is a diagram showing a schematic image of the determination unit making a determination. [Figure 7] FIG. 7 is a diagram showing an example of a confirmation screen displayed on the display unit of the broadcast user's terminal device. [Figure 8] FIG. 8 is a flow diagram showing an example of the operation performed in the video distribution system shown in FIG. [Figure 9] FIG. 9 is a diagram showing an example of a video including animation of a broadcast user's avatar object. [Figure 10] FIG. 10 is a diagram showing an example of a video including an animation of the first gift being attached to an attachment part of the broadcast user's avatar object. [Figure 11] FIG. 11 is a diagram that shows a schematic example of an image in which a second gift is worn in place of a first gift on an attachment part of an avatar object of a broadcast user. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0020] Hereinafter, various embodiments of the present invention will be described with reference to the accompanying drawings. In addition, common components in the drawings are given the same reference numerals. In addition, it should be noted that components shown in one drawing may be omitted in another drawing for convenience of explanation. Furthermore, it should be noted that the accompanying drawings are not necessarily drawn to scale. Furthermore, the term application may be referred to as software or a program, and may be a command for a computer that is combined to achieve a certain result.

[0021] 1. Video distribution system configuration In short, the video distribution system 1 disclosed in the present application enables a broadcasting user to use his / her terminal device to distribute, via a communication line, a video including animation of an avatar object generated based on data regarding the broadcasting user's movements and / or audio data regarding the speaking or singing uttered by the broadcasting user to a terminal device of a viewing user who is watching the video.

[0022] Fig. 1 is a block diagram showing an example of a configuration of a video distribution system 1 according to an embodiment. As shown in Fig. 1, the video distribution system 1 can include a plurality of terminal devices 10 connected to a communication line (not shown) and one or more server devices 20 connected to the communication line. Each terminal device 10 is connected to one or more server devices 20 via the communication line.

[0023] The communication lines may include, but are not limited to, a mobile phone network, a wireless LAN, a landline telephone network, the Internet, an intranet, and / or Ethernet (registered trademark), etc.

[0024] 1-1. Terminal device 10 1, the multiple terminal devices 10 may include one or more terminal devices 10 of broadcasting users (terminal device 10A in this example) and one or more terminal devices 10 of viewing users (terminal devices 10B to 10D in this example). Each terminal device 10 has a common configuration, and can function as either a terminal device for broadcasting videos (terminal device 10 of a broadcasting user) or a terminal device for viewing videos (terminal device 10 of a viewing user).

[0025] When each terminal device 10 operates as a terminal device 10 of a broadcast user, it executes an installed video distribution application to acquire data on the actions of the broadcast user and / or audio data on speech or singing uttered by the broadcast user, generates a video including animation of a virtual character (avatar object) changed according to the acquired data, and transmits the video to the server device 20 (distribution server device 20C) via a communication line. The video is distributed by the server device 20 (distribution server device 20C) via a communication line to a terminal device 10 (terminal device 10 of a viewing user) that executes an installed video viewing application and is used to receive the video.

[0026] Furthermore, when each terminal device 10 operates as the terminal device 10 of the broadcasting user, when the server device 20 receives a request signal via a communication line from the terminal device 10 of the viewing user watching the video, requesting that a gift (first gift) be given (gifted) to the wearing part of the broadcasting user (avatar object) based on the operation of the viewing user, each terminal device 10 can receive the request signal from the server device 20 (information processing server device 20B) and generate a video including an animation of the first gift being worn on the wearing part of the avatar object.

[0027] By the way, the wearing part of an avatar object means a part of the avatar object, such as the head, face, neck, right hand, left hand, waist, right foot, left foot, etc., and / or a part away from the avatar object (including the space surrounding the avatar object, such as above the head, below the feet, behind, etc.).

[0028] In addition, in the case of the above-mentioned gifting, if multiple request signals are transmitted (including both cases where multiple request signals are transmitted from one viewing user terminal device 10 and cases where request signals are transmitted from multiple viewing user terminal devices 10) requesting that the first gift be given to the wearing portion of the avatar object, the terminal device 10 of the broadcasting user can receive information from the server device 20 (information processing server device 20B) requesting the generation of a video including an animation of a state in which a second gift having characteristics in common with the first gift is worn on the wearing portion of the avatar object, and can generate the video.

[0029] The method of determining whether or not to generate a video including an animation of the second gift being attached to the attachment part of the avatar object will be described later, and this determination is performed by server device 20 (information processing server device 20B) which will be described later.

[0030] On the other hand, when each terminal device 10 operates as a terminal device for viewing videos (terminal device of a viewing user), it can receive videos distributed by the terminal device 10 of the distribution user via the server device 20 (distribution server device 20C) by executing an installed video viewing application.

[0031] Furthermore, when each terminal device 10 operates as a terminal device of a viewing user, it can execute a video viewing application to send a request signal to the server device 20 (gift API server device 20A) requesting that a gift (first gift) be granted to the attachment part of the broadcasting user (avatar object) based on the operation of the viewing user.

[0032] Furthermore, when each terminal device 10 operates as a terminal device of a viewing user, it can execute a video viewing application to transmit information regarding comments from the viewing user to the distribution user (avatar object) to the server device 20 (comment API server device 20D).

[0033] The above-mentioned video distribution application and video viewing application may be installed and executed on each terminal device 10 as a single integrated application, or as separate applications.

[0034] Each terminal device 10 is any terminal device capable of performing such operations, and may include, but is not limited to, a smartphone, a tablet, a mobile phone (feature phone), and / or a personal computer.

[0035] 1-2. Server device 20 As shown in FIG. 1, the server device 20 can also be called a video distribution system in which a plurality of server devices, which will be described later, are combined.

[0036] The server device 20 can distribute the video transmitted from the terminal device 10 of the broadcasting user to the terminal devices 10 of each viewing user.

[0037] Furthermore, the server device 20 can receive a request signal from each viewing user's terminal device 10 requesting that a gift (first gift) be given (gifted) to the attachment part of the avatar object. Also, the server device 20 can transmit information related to the request signal to the terminal device 10 of the broadcasting user, and can receive a video including an animation of the state in which the gift is attached to the attachment part of the avatar object, which is generated by the terminal device 10 of the broadcasting user that received the information.

[0038] In the case of the above-mentioned gifting, if multiple request signals are sent requesting that the first gift be given to the attachment portion of the avatar object (including both the case where multiple request signals are sent from one viewing user terminal device 10 and the case where request signals are sent from multiple viewing user terminal devices 10), the server device 20 can determine whether or not to generate a video including an animation of the state in which the second gift is attached to the attachment portion of the avatar object, and if it is determined that the video should be generated, can transmit information requesting the generation of the video to the terminal device 10 of the broadcasting user. Then, the server device 20 can receive the video including an animation of the state in which the second gift is attached to the attachment portion of the avatar object from the terminal device 10 of the broadcasting user.

[0039] Furthermore, the server device 20 can receive information related to comments from the viewing user to the broadcasting user (avatar object) from the viewing user's terminal device 10, and can broadcast the comments to the viewing users who are watching the same video.

[0040] In order to perform such operations, the server device 20, in one embodiment, may include a gift API server device 20A, an information processing server device 20B, a distribution server device 20C, and a comment API server device 20D, which are connected to each other via communication lines (including wireless lines and / or wired lines not shown).

[0041] The gift API server device 20A can receive a request signal from each viewing user's terminal device 10, which requests the gifting (gifting) of a gift (first gift) to a wearing part of an avatar object based on an operation of the viewing user. At this time, the gift API server device 20A can read at least the identification information of the viewing user who performed the gifting act (such as the serial number of the terminal device 10 of each viewing user and ID information given to each viewing user), information related to the gifted gift (information regarding what kind of gift corresponds to which wearing part of the avatar object), and the identification information of the broadcasting user who is the avatar object to be gifted (such as the serial number of the terminal device 10 of the broadcasting user and ID information given to the broadcasting user), from the request signal, and transmit the read information to the information processing server device 20B automatically or when an inquiry is received from the information processing server device 20B.

[0042] The information processing server device 20B receives the information read by the gift API server device 20A from the gift API server device 20A automatically or by making an inquiry thereof. In addition, the information processing server device 20B can have a table (database) for each broadcast user, and can store the gift-related information read by the gift API server device 20A in each table.

[0043] Furthermore, the information processing server device 20B can refer to the information related to the gifts stored in the table and determine whether or not to generate a video including an animation of a state in which a second gift having a common feature with the first gift is attached to an attachment part of an avatar object when there are multiple gifting acts (including both multiple gifting acts by one viewing user and multiple gifting acts by multiple viewing users). Note that this determination is made based on whether or not a combination of multiple gifting acts (multiple first gifts) satisfies a predetermined condition set in advance.

[0044] Furthermore, the information processing server device 20B can refer to the gift-related information stored in the table and transmit information to the broadcast user's terminal device 10 requesting the generation of a video including an animation of the state in which the first gift is attached to the attachment portion of the avatar object. Similarly, if it is determined by the above-mentioned determination that a video including an animation of the state in which the second gift is attached to the attachment portion of the avatar object is to be generated, information can be transmitted to the broadcast user's terminal device 10 requesting the generation of a video including an animation of the state in which the second gift is attached to the attachment portion of the avatar object.

[0045] Furthermore, the information processing server device 20B can refer to the identification information of the viewing user and the information related to the gift stored in the table and transmit to the comment API server device 20D all or part of the information related to which viewing user has given what gift to the wearing part of the avatar object (broadcast user).

[0046] Furthermore, when the information processing server device 20B determines that a combination of multiple gifting acts (multiple first gifts) does not satisfy a preset predetermined condition, it can calculate a necessary condition for the combination to satisfy the predetermined condition, and then transmit the necessary condition to the comment API server device 20D. The necessary condition will be described in detail later.

[0047] The distribution server device 20C can distribute the video transmitted from the terminal device 10 of the distributor user to the terminal devices 10 of each viewing user.

[0048] In addition, the distribution server device 20C can receive a video including an animation of the first gift being attached to the attachment part of the avatar object from the terminal device 10 of the distribution user, and distribute the video to the terminal device 10 of each viewing user.

[0049] Furthermore, the distribution server device 20C can receive a video including an animation of the second gift being attached to the attachment part of the avatar object from the terminal device 10 of the distribution user, and distribute the video to the terminal device 10 of each viewing user.

[0050] The comment API server device 20D can receive comments of the viewing users from the terminal devices 10 of the viewing users, and can distribute the received comments to each viewing user who is viewing the same video.

[0051] In addition, the comment API server device 20D can distribute comments corresponding to all or part of the information received from the information processing server device 20B regarding which viewing user has given what gift to the wearing part (broadcasting user) of the avatar object, to each viewing user watching the same video.

[0052] Furthermore, the comment API server device 20D can also distribute comments that meet the above-mentioned necessary conditions, received from the information processing server device 20B, to each viewing user who is viewing the same video.

[0053] 1, for the purpose of distributing the load, the server device 20 is shown to have four server devices, namely, a gift API server device 20A, an information processing server device 20B, a distribution server device 20C, and a comment API server device 20D. However, at least one of these four server devices may be integrated with any of the remaining server devices.

[0054] 2. Hardware configuration of each device Next, an example of the hardware configuration of each of the terminal device 10 and the server device 20 will be described.

[0055] 2-1. Hardware configuration of terminal device 10 An example of the hardware configuration of each terminal device 10 will be described with reference to Fig. 2. Fig. 2 is a block diagram showing a schematic example of the hardware configuration of the terminal device 10 (server device 20) shown in Fig. 1 (note that in Fig. 2, the reference symbols in parentheses are those described in relation to the server device 20, as described later).

[0056] 2, each terminal device 10 can mainly include a central processing unit 11, a main memory device 12, an input / output interface device 13, an input device 14, an auxiliary memory device 15, and an output device 16. These devices are connected to each other by a data bus and / or a control bus.

[0057] The central processing unit 11 is referred to as a "CPU" and performs calculations on instructions and data stored in the main memory device 12 and stores the results of the calculations in the main memory device 12. Furthermore, the central processing unit 11 can control an input device 14, an auxiliary memory device 15, an output device 16, etc. via an input / output interface device 13. The terminal device 10 can include one or more such central processing units 11.

[0058] The main memory device 12 is referred to as a "memory" and stores instructions and data received from the input device 14, the auxiliary memory device 15, and the communication line 30 (such as the server device 20) via the input / output interface device 13, as well as the results of calculations by the central processing unit 11. The main memory device 12 may include, but is not limited to, a RAM (random access memory), a ROM (read only memory), and / or a flash memory.

[0059] The auxiliary storage device 15 is a storage device having a larger capacity than the main storage device 12. It stores the commands and data (computer programs) constituting the specific applications (video distribution applications, video viewing applications, etc.) and web browsers described above, and can transmit these commands and data (computer programs) to the main storage device 12 via the input / output interface device 13 under the control of the central processing unit 11. The auxiliary storage device 15 can include, but is not limited to, a magnetic disk device and / or an optical disk device.

[0060] The input device 14 is a device that inputs data from the outside, and includes, but is not limited to, a touch panel, a button, a keyboard, a mouse, and / or a sensor, etc. The sensor may include, but is not limited to, one or more cameras, etc. and / or one or more microphones, etc., as described below.

[0061] The output device 16 may include, but is not limited to, a display device, a touch panel, and / or a printer device.

[0062] In such a hardware configuration, the central processing unit 11 sequentially loads instructions and data (computer programs) constituting a specific application stored in the auxiliary storage device 15 into the main storage device 12, and performs operations on the loaded instructions and data to control the output device 16 via the input / output interface device 13, or to transmit and receive various information to and from other devices (such as a server device 20 and other terminal devices 10, etc.) via the input / output interface device 13 and a communication line 30 (communication network 30).

[0063] As a result, the terminal device 10 can execute the operations necessary for generating videos, the operations necessary for sending (distributing) and / or receiving videos, the operations necessary for gifting activities, and the operations necessary for sending comments (including various other operations that will be described in detail later) by executing specific installed applications.

[0064] Note that the terminal device 10 may include, instead of the central processing unit 11 or in addition to the central processing unit 11, one or more microprocessors and / or a graphics processing unit (GPU).

[0065] 2-2. Hardware configuration of server device 20 An example of the hardware configuration of each server device 20 will also be described with reference to Fig. 2. The hardware configuration of each server device 20 (gift API server device 20A, information processing server device 20B, distribution server device 20C, and comment API server device 20D) may be the same as the hardware configuration of each terminal device 10 described above. Therefore, the reference characters for the components of each server device 20 are shown in parentheses in Fig. 2.

[0066] 2, each server device 20 can mainly include a central processing unit 21, a main memory device 22, an input / output interface device 23, an input device 24, an auxiliary memory device 25, and an output device 26. These devices are connected to each other by a data bus and / or a control bus.

[0067] The central processing unit 21, main memory device 22, input / output interface device 23, input device 24, auxiliary memory device 25 and output device 26 can be approximately the same as the central processing unit 11, main memory device 12, input / output interface device 13, input device 14, auxiliary memory device 15 and output device 16 included in each of the terminal devices 10 described above, respectively.

[0068] In such a hardware configuration, the central processing unit 21 sequentially loads instructions and data (computer programs) constituting a specific application stored in the auxiliary storage device 25 into the main storage device 22, and by calculating the loaded instructions and data, it is possible to control the output device 26 via the input / output interface device 23, or to send and receive various information to and from other devices (such as each terminal device 10) via the input / output interface device 23 and the communication line 30 (communication network 30).

[0069] As a result, the server device 20 can perform operations necessary to distribute videos transmitted by the terminal device 10 of each distribution user to the terminal device 10 of each viewing user, operations necessary to receive gifting actions transmitted from the terminal device 10 of each viewing user, operations necessary to generate request information required to cause the terminal device 10 to generate a video, operations necessary to transmit (distribute) and / or receive videos, etc. (including various operations described in detail later).

[0070] Note that the server device 20 may include, instead of the central processing unit 21 or in addition to the central processing unit 21, one or more microprocessors and / or a graphics processing unit (GPU).

[0071] 3. Functions of each device Next, an example of the details of the functions of the terminal device 10 and the server device 20 will be described.

[0072] 3-1. Functions of terminal device 10 An example of the functions of the terminal device 10 will be described with reference to Fig. 3. Fig. 3 is a block diagram that illustrates an example of the functions of the terminal device 10 illustrated in Fig. 1.

[0073] As shown in FIG. 3, the terminal device 10 may mainly include a video generating unit 100, a display unit 110, a storage unit 120, a user interface unit 130, a gift storage unit 140, and a communication unit 150.

[0074] (1) Video generation unit 100 The video generation unit 100 can generate a video including an animation of the avatar object of the broadcast user based on data related to the broadcast user's movements and / or audio data related to speech or singing uttered by the broadcast user. To achieve this, the video generation unit 100 can include, for example, an acquisition unit (not shown) and a processing unit (not shown).

[0075] The acquisition unit may include one or more first sensors (not shown) that acquire data regarding the broadcast user's face, limbs, etc. (entire body), and one or more second sensors (not shown) that acquire audio data regarding speaking and / or singing uttered by the broadcast user.

[0076] In a preferred embodiment, the first sensor can include an RGB camera for capturing visible light and a near-infrared camera for capturing near-infrared light, such as the True Depth camera included in the iPhone X. The second sensor can include a microphone for recording audio.

[0077] First, regarding the first sensor, the acquisition unit captures the face, hands, feet, etc. of the broadcasting user using the first sensor arranged close to the face, hands, feet, etc. of the broadcasting user. This allows the acquisition unit to generate data (e.g., an MPEG file) in which the images acquired by the RGB camera are associated with a time code (a code indicating the time of acquisition) and recorded over a unit time. Furthermore, the acquisition unit can generate data (e.g., a TSV file [a file in a format in which multiple data are recorded with tabs separating the data]) in which a predetermined number (e.g., 51) of numerical values ​​(e.g., floating-point numerical values) indicating depths acquired by the near-infrared camera are associated with the time code and recorded over a unit time.

[0078] Concerning the near-infrared camera, specifically, a dot projector emits an infrared laser forming a dot pattern onto the face and limbs of the broadcasting user, and the near-infrared camera captures the infrared dots projected and reflected from the face and limbs of the broadcasting user, and generates an image of the infrared dots thus captured. The acquisition unit compares an image of a dot pattern emitted by a dot projector registered in advance with an image captured by the near-infrared camera, and can calculate the depth of each point (each feature point) (e.g., each of 51 points / feature points) in both images (the distance between each point / feature point and the near-infrared camera) using the positional deviation of each point (each feature point). The acquisition unit can generate data in which the numerical value indicating the depth thus calculated is associated with a time code as described above and recorded over a unit time.

[0079] Next, regarding the second sensor, the acquisition unit acquires audio related to speech and / or singing uttered by the broadcast user using the second sensor arranged close to the broadcast user. This allows the acquisition unit to generate data (e.g., an MPEG file) recorded over a unit time in association with a time code. In one embodiment, the acquisition unit can acquire data related to the face and limbs of the broadcast user using the first sensor, and at the same time acquire audio data related to speech and / or singing uttered by the broadcast user using the second sensor. In this case, the acquisition unit can generate data (e.g., an MPEG file) recorded over a unit time in association with the same time code, including an image acquired by the RGB camera and audio data related to speech and / or singing uttered by the broadcast user using the second sensor.

[0080] The acquisition unit can output the data generated in this manner relating to the face, limbs, etc. of the broadcast user (MPEG files, TSV files, etc.) and / or audio data relating to the speech and / or singing uttered by the broadcast user (MPEG files, etc.) to the processing unit.

[0081] Here, the case where the first sensor includes an RGB camera and an infrared camera has been described, but the first sensor may include, for example, any of (A) a camera that detects infrared rays emitted by an infrared laser and reflected off the face, hands, feet, etc. of the broadcasting user, (B) multiple RGB cameras that capture visible light, and (C) a single camera that captures visible light. In the case of (A) above, the acquisition unit can calculate the depth for each feature point on the face, hands, feet, etc. of the broadcasting user by a method similar to that described above. In the case of (B) above, the acquisition unit can calculate the depth for each feature point on the face, hands, feet, etc. of the broadcasting user using multiple images captured by multiple RGB cameras. In the case of (C) above, the acquisition unit can calculate the depth for each feature point on the face, hands, feet, etc. of the broadcasting user from an image captured by a single camera using deep learning, etc. In the case of (C) above, the acquisition unit may calculate the depth of each feature point on the broadcast user's face, hands, feet, etc. by performing analysis processing (image processing, etc.) on an image captured by a single camera.

[0082] The processing unit can generate a moving image including an animation of a virtual character (avatar object) based on data on the face, limbs, etc. of the broadcasting user from the acquisition unit. Regarding the moving image of the avatar object itself, the processing unit can also generate a moving image of the avatar object by causing a rendering unit (not shown) to perform rendering using various information (e.g., geometry information, bone information, texture information, shader information, blend shape information, etc.) stored in a character data storage unit (not shown).

[0083] It is also possible to use any other known technology to generate a video including animation of the broadcast user's avatar object based on data regarding the broadcast user's movements and / or audio data regarding speech or singing uttered by the broadcast user.

[0084] Incidentally, when the communication unit 150, which will be described later, receives request information from the server device 20 (information processing server device 20B) to generate a video including an animation of a state in which the first gift or the second gift is attached to an attachment part of an avatar object, the video generating unit 100 can receive the request information from the communication unit 150 and generate the video. In this case, the video generating unit 100 can combine data related to the video including the animation of the avatar object generated as described above in detail with data related to the first gift or the second gift (data related to which attachment part of the avatar object the gift has and what shape, size, and color it has) to generate a video including an animation of a state in which the first gift or the second gift is attached to an attachment part of an avatar object. Specifically, information (attachment position information) regarding which attachment part of the avatar object the first gift and the second gift are attached to is set in advance for the first gift and the second gift, and the first gift or the second gift can be displayed on the video at the attachment part based on the attachment position information when gifted by a viewing user or when a predetermined condition, which will be described later, is satisfied. For example, if the first gift is a "red backpack", the attachment position information is "back", and when the "red backpack" is gifted by the viewing user, the "red backpack" is displayed on the video so as to cover at least a part of the "back" of the avatar object (or to be in contact with at least a part of the "back"). Similarly, if the second gift is a "large rainbow fork", the attachment position information is "left hand" (or may be "right hand"), and when a predetermined condition described later is satisfied in the "left hand", the "large rainbow fork" is displayed on the video so as to be in contact with the "left hand" of the avatar object (to cover a part of the "left hand"). Note that the position (position information) of each attachment part of the avatar object in the video is detected by, for example, a sensor such as a motion sensor described later. Therefore, when the "red backpack" is displayed on the "back" of the avatar object, the position information of the "back" at that time is referenced, and the "red backpack" is displayed on the video in correspondence with the "back".The first and second gifts may be displayed on the video so that they move in accordance with the movement of the part of the avatar object to which they are attached while they are displayed (the duration described below). A method for generating such a video including an animation of the first or second gift being attached to the part of the avatar object to which it is attached may use the method described in the specification of Japanese Patent No. 6431233 or other well-known techniques.

[0085] (2) Display section 110 The display unit 110 can display various information required for the distribution and / or viewing of videos (including videos including animations of a state in which the first gift or the second gift is attached to an attachment portion of an avatar object). For example, the display unit 110 can display distributed videos, received videos, and / or generated videos. The display unit 110 can also display various comments distributed from the server device 20 to each terminal device 10 together with the received videos. Furthermore, the display unit 110 can also appropriately display gift information stored in the gift storage unit 140 in response to an operation by the viewing user.

[0086] (3) Storage section 120 The memory unit 120 can store various information required for distribution and / or viewing of videos (including videos that include animations of the first gift or the second gift being attached to the attachment portion of an avatar object).

[0087] (4) User interface unit 130 The user interface unit 130 can input various information required for distribution and / or viewing of a video (including a video including an animation of a state in which a first gift or a second gift is attached to an attachment portion of an avatar object) via an operation of a broadcasting user or a viewing user. For example, the user interface unit 130 can input operation data from the viewing user indicating the content of the viewing user's operation related to gifting to an avatar object (including an operation such as selecting a specific gift from a plurality of first gifts prepared in advance and selecting a command to give to the avatar object), and output the operation data to the communication unit 150. Here, the aforementioned operation data can include, for example, information related to what kind of gift (type of gift) the viewing user gifted to the broadcasting user.

[0088] As another example, when the user interface unit 130 receives an inquiry from the server device 20 about attaching a gift (first gift or second gift) corresponding to one or more giftings from a viewing user to a wearing part of the avatar object, the user interface unit 130 can input operation data related to a response to the inquiry from the distribution user and output the operation data to the communication unit 150.

[0089] (5) Gift memory unit 140 The gift storage unit 140 can store gift information preset in the video distribution application and the video viewing application when these applications are installed in the terminal device 10. The gift information can include identification information such as the name, shape, and color of each gift, and the amount of each gift to be charged to the viewing user when the viewing user gifts the gift.

[0090] (6) Communications Department 150 The communication unit 150 can communicate various information required for distribution and / or viewing of videos (including videos including animations of a state in which the first gift or the second gift is attached to an attachment portion of an avatar object) with the server device 20. For example, when the terminal device 10 operates as the terminal device 10 of a broadcasting user, the communication unit 150 can receive request information from the server device 20 (information processing server device 20B) to generate a video including an animation of a state in which the first gift or the second gift is attached to an attachment portion of an avatar object, and transmit the generated video to the server device 20 (distribution server device 20C). Similarly, when the terminal device 10 is operating as the terminal device 10 of the broadcasting user and one or more gifts are given by the viewing user, it can receive an inquiry from the server device 20 about attaching a gift corresponding to the gift (first gift or second gift) to the attachment portion of the avatar object, output information about the inquiry to the display unit 110, receive operation data related to a response to the inquiry from the user interface unit 130, and transmit information related to the response to the server device 20.

[0091] On the other hand, when the terminal device 10 operates as the terminal device 10 of the viewing user, the communication unit 150 can receive video generated by the terminal device 10 of the broadcasting user from the server device 20. Similarly, when the terminal device 10 operates as the terminal device 10 of the viewing user, the communication unit 150 can transmit information related to gifting from the viewing user to the broadcasting user (avatar object) and information related to comments from the viewing user to the broadcasting user (avatar object) to the server device 20 (comment API server device 20D).

[0092] (7) Studio Unit A studio unit (not shown) including the above-mentioned video generating unit 100, display unit 110, storage unit 120, user interface unit 130, gift storage unit 140, and communication unit 150 can also be used as the terminal device 10.

[0093] The studio unit can be implemented by an information processing device such as a personal computer, and can mainly include a central processing unit, a main memory device, an input / output interface device, an input device, an auxiliary memory device, and an output device, similar to the terminal device 10 and the server device 20 described above. These devices are connected to each other by a data bus and / or a control bus. In addition, the studio unit functions as an information processing device that executes a specific installed application, and can generate a video including an animation of an avatar object based on data related to the actions of a broadcast user who is in a studio room (not shown) in which the studio unit is installed and / or data related to speech or singing uttered by the broadcast user.

[0094] Many of the components of the video generating unit 100 included in the studio unit are arranged in the studio room. In the studio room, the broadcast user performs various performances, and the studio unit detects the movements, facial expressions, and speech (including singing) of the broadcast user.

[0095] The broadcast user is a subject whose movements, facial expressions, speech (including singing), and the like are captured by a group of various sensors included in the studio unit (video generating unit 100). In this case, the broadcast user does not necessarily have to be a human being, and may be, for example, a robot capable of independent movement. Also, there may be one broadcast user in the studio room, or two or more broadcast users.

[0096] The video generating unit 100 in the studio unit may have various motion sensors (not shown) worn by the broadcast user, a controller (not shown) held by the hand of the broadcast user, and a camera (not shown) attached to the head of the broadcast user via a wearing device (not shown). In addition, the studio unit is provided with a microphone on the above-mentioned wearing device or somewhere in the studio room (e.g., a wall, floor, ceiling, etc.) in order to obtain voice data of the broadcast user. Furthermore, the studio unit may have a plurality of base stations (not shown), a tracking sensor (not shown), and a display (not shown) in addition to the above configuration.

[0097] The motion sensor can detect the position and orientation of the broadcast user in cooperation with the base station. In one embodiment, the base stations are multi-axis laser emitters, and after emitting a flashing light for synchronization, one base station is configured to scan the laser light around, for example, a vertical axis, and the other base station is configured to scan the laser light around, for example, a horizontal axis. The motion sensor includes a plurality of optical sensors that detect the incidence of the flashing light and the laser light from the base stations, and can detect the time difference between the incidence timing of the flashing light and the incidence timing of the laser light, the light reception time at each optical sensor, the incidence angle of the laser light detected by each optical sensor, and the like. The motion sensor may be, for example, a Vive Tracker provided by HTC CORPORATION, or an Xsens MVN Analyze provided by ZERO C SEVEN Inc.

[0098] The video generating unit 100 in the studio unit acquires detection information indicating the position and orientation of each motion sensor calculated by the motion sensor. The motion sensors are attached to the broadcast user's wrists, insteps, waist, top of the head, and other parts of the body, and by detecting the position and orientation of the motion sensors, the motion of the broadcast user can be detected.

[0099] In one embodiment, multiple infrared LEDs are mounted on multiple motion sensors, and the positions and orientations of the motion sensors may be detected by detecting light from the infrared LEDs with an infrared camera installed on the floor or wall of the studio room. Also, visible light LEDs may be used instead of infrared LEDs, and the positions and orientations of the motion sensors may be detected by detecting light from the visible light LEDs with a visible light camera.

[0100] In one embodiment, a plurality of reflective markers may be used instead of the motion sensor. The reflective markers are attached to the broadcasting user with adhesive tape or the like. The broadcasting user to which the reflective markers are attached may be photographed to generate photographic data, and the photographic data may be subjected to image processing to detect the position and orientation of the reflective markers.

[0101] The controller outputs a control signal in response to an operation by the distributor user, and the video generating unit 100 acquires this control signal.

[0102] The tracking sensor generates tracking information for determining setting information of a virtual camera for constructing a virtual space included in a video. The tracking information is calculated as a position in a three-dimensional orthogonal coordinate system and angles around each axis, and the video generator 100 acquires the tracking information.

[0103] The camera attached to the broadcast user's head is positioned so as to capture an image of the broadcast user's face. The camera continuously captures an image of the broadcast user's face to obtain image data of the broadcast user's face, and the video generating unit 100 obtains this image data from the camera. Note that the camera may be a 3D camera capable of detecting the depth of the broadcast user's face.

[0104] The display functions as display unit 110 and is placed in a position where it can be viewed by the distribution user, and the distribution user can obtain various information and view the video generated by video generation unit 100 through the display.

[0105] In addition to the components described above, the studio unit similarly includes the previously described storage unit 120, user interface unit 130, gift storage unit 140, and communication unit 150. The components of the studio unit described above are merely examples, and the studio unit may include various other applicable components.

[0106] 3-2. Functions of the server device 20 An example of the functions of server device 20 will be described with reference to Figures 4 to 7. Figure 4 is a block diagram showing an example of the functions of server device 20 shown in Figure 1. Figure 5 is a diagram showing an example of a table managed by database section 230. Figures 6A to 6D are diagrams showing an example of a table managed by database section 230, and are diagrams showing an example of a judgment made by judgment section 240. Figure 7 is a diagram showing an example of a confirmation screen displayed on display section 110 of terminal device 10 of a broadcast user.

[0107] As shown in FIG. 4, the server device 20 may mainly include a storage unit 200, a communication unit 210, a gift processing unit 220, a database unit 230, a determination unit 240, and a comment processing unit 250.

[0108] (1) Storage section 200 The memory unit 200 can store various information required for distribution and / or viewing of videos (including videos that include animations of the first gift or the second gift being attached to the attachment portion of an avatar object).

[0109] (2) Communications unit 210 The communication unit 210 can communicate various information required for distribution and / or viewing of videos (including videos including animations of a state in which the first gift or the second gift is attached to an attachment portion of an avatar object) between the terminal device 10 of the broadcasting user and / or the terminal device 10 of the viewing user. For example, the communication unit 210 can receive videos (including videos including animations of a state in which the first gift or the second gift is attached to an attachment portion of an avatar object) from the terminal device 10 of the broadcasting user and distribute them to the terminal device 10 of each viewing user.

[0110] In addition, the communication unit 210 receives information related to gifting from the viewing user to the distribution user (avatar object) and information related to comments from the viewing user to the distribution user (avatar object) from the viewing user's terminal device 10, and outputs the information related to gifting to the gift processing unit 220 and the information related to the comments to the comment processing unit 250.

[0111] Furthermore, the communication unit 210 can send request information to the broadcast user's terminal device 10 to generate a video including an animation of the avatar object with the first gift or the second gift attached to the attachment part of the avatar object.

[0112] Furthermore, if multiple gifts are made by the viewing user and the determination unit 240 described later determines that the combination of first gifts satisfies a specified condition, a request signal related to an inquiry (confirmation) to obtain the broadcast user's confirmation regarding wearing the second gift on the wearing part of the avatar object can be sent to the broadcast user's terminal device 10, and information related to the response to the inquiry can be received from the broadcast user's terminal device 10.

[0113] (3) Gift Processing Unit 220 When information related to gifting (a request signal related to gifting) is output from the communication unit 210, the gift processing unit 220 reads at least the identification information of the viewing user for whom the gifting act was performed (such as the serial number of each viewing user's terminal device 10 and ID information assigned to each viewing user), gifted gift information (information regarding which gift corresponds to which wearing part of the avatar object, and identification information such as the name, shape, color, etc. of each gift), and identification information of the broadcasting user who is the avatar object to be gifted (such as the serial number of the broadcasting user's terminal device 10 and ID information assigned to the broadcasting user), and stores the read information in the database unit 230 automatically or in response to an inquiry.

[0114] (4) Database section 230 The database unit 230 can receive various information read by the gift processing unit 220 from the gift processing unit 220 automatically, or by inquiring at predetermined time intervals to the gift processing unit 220. In addition, as shown in Fig. 5, the database unit 230 has a table (reference table) for each broadcast user, and stores various information received from the gift processing unit 220 in each table for the corresponding broadcast user.

[0115] Next, an example of information stored in a table will be described with reference to FIG.

[0116] Database unit 230 has a table 500 for each broadcast user, and broadcast user identification information 501 (e.g., broadcast user ID information) is assigned to each table 500. Furthermore, database unit 230 stores the gift information gifted in the corresponding table in sequence (in FIG. 5, the order in which the gift was given is taken as an example, but it may also be the order in which the first gift was attached to the avatar object) according to the broadcast user identification information 501 received from gift processing unit 220.

[0117] To explain in more detail, when one or more viewing users give first gifts in the order of "red backpack", "diamond crown", "silver fork", "golden paper fan", "gold ring" and "white sneakers" to the wearing parts of the avatar object in the initial state where no gifts are attached to the wearing parts of the avatar object as shown in Fig. 5, the first gifts are attached to the wearing parts of the avatar object in that order (a moving image including an animation of the first gifts being attached to the wearing parts of the avatar object is generated). Therefore, in the table 500, the database unit 230 stores the "red backpack", "diamond crown", "silver fork", "golden paper fan", "gold ring", and "white sneakers" in this order (the order in which they were gifted or worn) in the box 502 of the "List of worn gifts". Although not shown in FIG. 5, information regarding the wearing part of the avatar object corresponding to each first gift (the wearing part of the avatar object corresponding to the "red school bag" is the "back") and identification information of the viewing user who gifted each first gift (e.g., the viewing user's ID information) may be stored (displayed) in box 502 so as to correspond to each first gift.

[0118] Next, from the state where the six first gifts are attached to the attachment parts of the avatar object, one or more viewing users further gift the first gifts in the order of "diamond crown", "silver fork", "silver ring", "copper knife", "black backpack", "white backpack", "gold fork", "gold glasses", and "silver spoon". In this case, the six first gifts are already attached to the attachment parts of the avatar object corresponding to these gifts. That is, the "red backpack" is attached to the "back", the "diamond crown" is attached to the "head", the "silver fork" is attached to the "left hand", the "golden sash" is attached to the "right hand", the "gold ring" is attached to the "fingers", and the "white sneakers" are attached to both feet. On the other hand, the corresponding attachment parts are overlapped, such as the "black backpack" attached to the "back" and the "silver ring" attached to the "fingers". In such a case, the database unit 230 at least temporarily stores the further gifted first gifts in the "unattached gift list" box 503 in the order in which they were gifted. In this case, similar to box 502, information relating to the part of the body on which the corresponding avatar object is worn and identification information of the viewing user who gifted each first gift may be stored (displayed) in box 503 so as to correspond to each first gift.

[0119] It can be said that the database unit 230 stores the types of first gifts given to the attachment parts of the avatar object and the number of first gifts given for each type in association with each other based on the information stored as described above. In other words, the database unit 230 uses the table 500 to manage (store) how many of each type of first gift have been given to each attachment part, and the managed (stored) information is also output to the determination unit 240 in response to an inquiry from the determination unit 240.

[0120] The video distribution application and the video viewing application are preset so that the first gift attached to the avatar object is automatically deleted from the video when a predetermined time (e.g., 1 or 2 minutes) has elapsed since the first gift was attached to the avatar object. Therefore, if a "black backpack" is gifted after a predetermined time has elapsed since the aforementioned "red school bag" was attached to the avatar object, the "black backpack" will be attached to the avatar object (in this case, database 230 will store the "black backpack" in box 502).

[0121] (5) Judgment unit 240 When there are multiple gifting actions (including both multiple gifting actions by one viewing user and multiple gifting actions by multiple viewing users), the determination unit 240 determines whether or not to generate a video including an animation of a state in which a second gift having a common feature with the first gift is attached to an attachment part of an avatar object. This determination is performed by referring to the table 500 managed by the database unit 230 (based on information output from the database unit 230), and is determined based on whether or not a combination of multiple first gifts satisfies a predetermined condition that is preset in the video distribution application and the video viewing application.

[0122] An example of the determination will be described with reference to FIGS. 6A to 6D.

[0123] As described above with reference to FIG. 5, when focusing on the "head" of the wearing parts of the avatar object, the "diamond crown" is already worn. In this state, if the "diamond crown" is further gifted, the combination of the first gifts will be two identical "diamond crowns" (see FIG. 6A). Here, if at least one of the above-mentioned predetermined conditions is that two identical first gifts are available, the presence of two "diamond crowns" satisfies the above-mentioned predetermined condition. Such a predetermined condition can be arbitrarily set in advance in the video distribution application and the video viewing application. When the predetermined condition is satisfied in this way, the determination unit 240 determines to generate a video including an animation of a state in which a second gift having a common feature with the "diamond crown" as the first gift is worn on the "head" of the avatar object. As the second gift in this case, for example, a "large diamond crown" or a "100-carat diamond tiara" or the like that changes the size, color, and / or at least a part of the shape of the first gift can be appropriately adopted.

[0124] Next, as described above with reference to FIG. 5, when focusing on the "finger" of the wearing part of the avatar object, a "gold ring" is already worn. In this state, if a "silver ring" is further gifted, the combination of the first gifts will be a "gold ring" and a "silver ring" (see FIG. 6B). Here, if at least one of the above-mentioned predetermined conditions is that two first gifts differ only in color, the combination satisfies the predetermined condition. When the predetermined condition is satisfied in this way, the determination unit 240 determines to generate a video including an animation of a state in which a second gift such as a "diamond ring" having a feature in common with the first gift "gold ring" is worn, as in the case described with reference to FIG. 6A.

[0125] Next, as described above with reference to FIG. 5, when focusing on the "back" of the wearing parts of the avatar object, the "red backpack" is already worn. In this state, if the "black backpack" and the "white backpack" are further gifted, the combination of the first gifts will be three combinations of the "red backpack", the "black backpack" and the "white backpack" (see FIG. 6C). Here, if at least one of the above-mentioned predetermined conditions is that three first gifts are arranged on the "back", the combination satisfies the predetermined condition. When the predetermined condition is satisfied in this way, the determination unit 240 determines to generate a video including an animation of a state in which a second gift having a common feature with the "red backpack" as the first gift is worn, as in the case described with reference to FIG. 6A. As the second gift in this case, for example, "big wings" are set. In this way, the second gift may be considered to have a common feature with the first gift simply by the fact that the first gift and the second gift have a common wearing part. In addition, if the second gift is the same color as the first gift, the same size, or the same type of item (same variety), it can also be said that the second gift has characteristics in common with the first gift.

[0126] Next, as described above with reference to FIG. 5, when focusing on the "left hand" of the avatar object's wearing parts, a "silver fork" is already attached. In this state, if a "silver fork", a "copper knife", a "gold fork", and a "silver spoon" are further gifted, the first gift combination will be five combinations in total, namely, two "silver forks", a "copper knife", a "gold fork", and a "silver spoon" (see FIG. 6D). Here, if at least one of the above-mentioned predetermined conditions is that the colors of gold, silver, and copper are the same in the "left hand" and that a knife, a fork, and a spoon are the same, the combination satisfies the predetermined condition. When the predetermined condition is satisfied in this way, the determination unit 240 determines to generate a video including an animation of a state in which a second gift having a common feature with the first gift, the "silver fork", is attached, as in the case described with reference to FIG. 6A. In this case, for example, a "rainbow-colored large fork" is set as the second gift.

[0127] As in the above examples, the above-mentioned predetermined condition can be set in any way. If the predetermined condition is simple (for example, the example described with reference to FIG. 6A or 6B, etc.), many types of second gifts can be made to appear, stimulating the viewing user's motivation to gift. On the other hand, even if the predetermined condition is difficult to understand (for example, the example described with reference to FIG. 6D, etc.), the viewing user's interest and curiosity about what kind of combination of first gifts will make the second gift appear can be aroused. Therefore, the viewing user's opportunities for gifting will increase.

[0128] Meanwhile, when a combination of a plurality of first gifts does not satisfy a predetermined condition, the determination unit 240 can calculate a necessary condition (such as the type and number of gifts required to satisfy the predetermined condition) required for the combination to satisfy the predetermined condition. The determination unit 240 compares the set predetermined condition with the combination of a plurality of first gifts, and calculates a condition as to what kind of first gift needs to be additionally gifted to satisfy the predetermined condition. The calculated necessary condition is output to the comment processing unit 250. Here, a specific example of the necessary condition will be described. For example, in the case described above with reference to FIG. 6C, if the predetermined condition is "three first gifts aligned on the back" as described above, when only a "red backpack" (worn) and a "black backpack" have been gifted by the viewing user, the necessary condition is "one first gift corresponding to the back of the avatar object". In the case of such a necessary condition, the comment processing unit 250 synthesizes comment information such as "If you have one more gift to wear on your back, the gift will change" into the video (displayed on the video) and transmits it to the terminal device 10 of the broadcasting user. In addition, in the case described above with reference to FIG. 6D, if the predetermined condition is "the colors of gold, silver, and copper are the same for the left hand, and a knife, fork, and spoon are all present," if the viewing user has only gifted a "silver fork" (already worn), a "gold fork," and a "silver poon," the necessary condition is "a copper knife corresponding to the left hand of the avatar object." In the case of such a necessary condition, the comment processing unit 250 synthesizes comment information such as "We are looking for giftees of copper knives!!" into the video (synthesized on the video) and transmits it to the terminal device 10 of the broadcasting user.

[0129] Furthermore, when the determination unit 240 determines that the combination of the first gifts satisfies a predetermined condition, it can output a request signal to the communication unit 210, which is related to an inquiry to obtain the broadcast user's confirmation regarding wearing the second gift on the wearing portion of the avatar object (generating a video including an animation of the second gift being worn on the wearing portion of the avatar object). The communication unit 210 transmits the request signal to the broadcast user (the broadcast user's terminal device 10) and receives information related to a response to the inquiry from the broadcast user's terminal device 10. In this case, specifically, a screen 600 as shown in FIG. 7 is displayed on the display unit 110 of the broadcast user's terminal device 10. In addition, the wording "Do you want to combine?" in FIG. 7 can be replaced with the wording "Do you want to wear the second gift on the avatar object?". In this way, if the broadcasting user agrees to attaching the second gift to the avatar object (in Figure 7, the broadcasting user selects "Yes"), the determination unit 240 may instruct the comment processing unit 250 to send comment information such as "You can't combine them any more" or "The second gift is already attached!!" to the broadcasting user's terminal device 10 in order to inform the viewing user that even if the viewing user further gifts the second gift to the attachment part of the avatar object to which the second gift is attached, the gifting will not be reflected in the avatar object for a certain period of time (the duration described below).

[0130] The duration (e.g., 1 or 2 minutes) that the second gift attached to the avatar object will last in the video (the second gift is present in the video including an animation of the state in which the second gift is attached to the attachment part of the avatar object) is preset, and is set in the video distribution application and the video viewing application so that the second gift will be deleted from the video when the duration has elapsed. The duration of the second gift may be set to start from the time when the second gift is attached to the attachment part of the avatar object, or may be set to start from the time when the last gifting performed by the viewing user to satisfy a predetermined condition (the time when the predetermined condition is satisfied). In addition, in order to induce gifting by the viewing user immediately after the second gift is deleted from the video, the determination unit 240 may instruct the comment processing unit 250 to send comment information such as "The second gift will disappear, so new gifting is welcome!!" to the terminal device 10 of the broadcasting user immediately before the second gift is deleted from the video.

[0131] (6) Comment processing unit 250 The comment processing unit 250 can receive comment information from the viewing user to the distribution user (avatar object) from the viewing user's terminal device 10 via the communication unit 210, and can distribute the comment information from the viewing user to each viewing user who is watching the same video.

[0132] In addition, the comment processing unit 250 can refer to table 500 managed in the database unit 230 to create comment information corresponding to all or part of the information regarding which viewing user gifted what gift to the attachment part of the avatar object, and distribute the comment information to each viewing user who is watching the same video.

[0133] Furthermore, the comment processing unit 250 can refer to table 500 managed in the database unit 230 to create comment information indicating that the first gift and / or second gift has been given to and / or worn on the wearing part of the avatar object, and distribute the comment information to each viewing user who is watching the same video.

[0134] Furthermore, the comment processing unit 250 can also create comment information corresponding to the above-mentioned necessary conditions calculated by the determination unit, and distribute the comment information to each viewing user who is viewing the same video.

[0135] 4. Overall operation of video distribution system 1 Next, the overall operation performed in the video distribution system 1 having the above configuration will be described with reference to Figs. 8 to 11. Fig. 8 is a flow diagram showing an example of the operation performed in the video distribution system 1 shown in Fig. 1. Fig. 9 is a diagram showing an example of a video including an animation of the broadcast user's avatar object. Fig. 10 is a diagram showing an example of a video including an animation of a state in which a first gift is attached to an attachment portion of the broadcast user's avatar object. Fig. 11 is a diagram showing a schematic example of an image in which a second gift is attached to an attachment portion of the broadcast user's avatar object in place of the first gift.

[0136] First, in step (hereinafter referred to as "ST") 300, in accordance with an operation of a broadcast user (here, broadcast user A), terminal device 10 (here, terminal device 10A) launches and executes a video broadcasting application.

[0137] Next, in ST301, terminal device 10A generates a video including animation of broadcast user A's avatar object based on data related to broadcast user A's movements and / or audio data related to speech or singing uttered by the broadcast user. As a result, as exemplified in Fig. 9, video 401 including animation of broadcast user A's avatar object 400 is displayed on display unit 110 of terminal device 10A.

[0138] Furthermore, the terminal device 10A transmits the generated video 401 to the distribution server device 20C of the server device 20. The distribution server device 20C distributes the video received from the terminal device 10A to the terminal device 10 of each viewing user who is executing a video viewing application. As a result, the video 401 as exemplified in FIG. 9 is also displayed on the display unit 110 of the terminal device 10 of each viewing user.

[0139] Next, in ST302, the viewing user's terminal device 10 transmits a request signal to server device 20 (gift API server device 20A) requesting that the first gift be granted to broadcast user A (the attachment part of avatar object 400) based on the viewing user's operation on user interface unit 130.

[0140] Next, in ST303, server device 20 (gift API server device 20A) that has received a request signal for the first gift from the viewing user's terminal device 10 reads out at least the identification information of the viewing user who performed the gifting act, information related to the gift that was gifted, and the identification information of the broadcast user who is the avatar object to be gifted. Then, the various pieces of information that have been read out are stored in a table in information processing server device 20B in server device 20.

[0141] Next, in ST304, server device 20 (information processing server device 20B) checks whether or not a first gift is already attached to each attachment part of avatar object 400 of broadcast user A at the time when the information is stored in the table in ST303. In ST304, if the attachment part of avatar object 400 gifted by the viewing user is, for example, the "head", and the first gift is not attached to the "head" at the time when the information related to the gifting is stored in the table in ST303, server device 20 (information processing server device 20B) judges "NO" in ST304 and transmits information to terminal device 10A of broadcast user A requesting generation of a video including an animation in which the first gift (for example, a "diamond crown") gifted by the viewing user is attached to the "head" of avatar object 400, in order to proceed to ST310.

[0142] On the other hand, in ST304, if the part of the body on which the avatar object 400 gifted by the viewing user is worn is, for example, the "head," and a "diamond crown" is already being worn on the "head" at the time the information related to the gifting is stored in the table in ST303, server device 20 (information processing server device 20B) will understand that there are multiple request signals to grant the first gift ("diamond crown") to the "head," judge "YES" in ST304, and then perform a judgment regarding the combination of the first gift in ST320 described below.

[0143] Next, as a result of the server device 20 judging "NO" in ST304 as described above, when the terminal device 10A of the broadcast user A receives information from the server device 20 (information processing server device 20B) requesting the generation of a video including an animation in which the first gift (e.g., a "diamond crown") gifted by the viewing user is attached to the "head" of the avatar object 400, the terminal device 10A generates the video in ST310. As a result, as illustrated in FIG. 10, the display unit 110 of the terminal device 10A displays a video 402 including an animation in which the first gift 410, which is a "diamond crown", is attached to the "head" of the avatar object 400 of the broadcast user A. Note that the video 402 in FIG. 10 shows an example in which the first gift 420, which is a "silver fork", is attached to the "left hand" of the avatar object 400 in the same step.

[0144] Furthermore, terminal device 10A transmits the generated video 402 to distribution server device 20C of server device 20. In ST311, distribution server device 20C distributes the video received from terminal device 10A to terminal devices 10 of each viewing user executing a video viewing application. As a result, video 402 as exemplified in FIG. 10 is also displayed on display unit 110 of terminal device 10 of each viewing user, and the step in which the server device judges "NO" in ST304 ends.

[0145] On the other hand, if the server device 20 judges "YES" in ST304 as described above, the judgment unit 240 judges whether or not the first gift combination satisfies the predetermined condition. If the first gift combination satisfies the predetermined condition (if "YES" in ST320), the server device 20 (the judgment unit 240 of the information processing server device 20B) transmits information to the terminal device 10A of the broadcast user A in ST321, which inquires (confirms) whether or not the second gift may be worn by the avatar object 400. When the broadcast user A transmits a response to this inquiry from the terminal device 10A of the broadcast user A to the server device 20 that it is OK, the server device 20 (information processing device 20B) transmits information to the terminal device 10A of the broadcast user A requesting the generation of a video including an animation in which the second gift (e.g., "100 carat diamond tiara") is worn on the wearing part (e.g., "head") of the avatar object 400. Incidentally, to further explain a specific example of the second gift with reference to FIG. 11, for example, when a first gift 420, which is a "silver fork," is attached to the "left hand" of the avatar object 400, a second gift 420Z, which is a "large rainbow fork," is generated (combined) when a predetermined condition is satisfied. In this case, the first gift 420 and the second gift 420Z not only share the same attachment location on the corresponding avatar object 400, but also share a common shape, which is one of their characteristics. In this way, the first gift 420 and the second gift 420Z have some common characteristics.

[0146] Next, in ST322, when terminal device 10A of broadcast user A receives information from server device 20 (information processing server device 20B) requesting the generation of a video including an animation of a second gift (e.g., a "100-carat diamond tiara") being attached to the "head" of avatar object 400, terminal device 10A generates the video (not shown).

[0147] Furthermore, terminal device 10A transmits the generated video to distribution server device 20C of server device 20. In ST323, distribution server device 20C distributes the video received from terminal device 10A to terminal devices 10 of each viewing user executing a video viewing application. As a result, the same video is also displayed on display unit 110 of terminal device 10 of each viewing user, and the step in which the server device judges "YES" in ST304 and judges "YES" in ST320 is completed.

[0148] If the first gift combination does not satisfy the predetermined condition in ST320 (if "NO" in ST320), the server device 20 (determination unit 240 of information processing server device 20B) calculates the necessary conditions (such as the type and number of gifts required to satisfy the predetermined condition) required for the combination to satisfy the predetermined condition in ST330. Furthermore, the calculated necessary conditions are converted into comment information and distributed to the terminal device 10 of each viewing user via the comment processing unit 250. As a result, the same comment information is also displayed on the display unit 110 of the terminal device 10 of each viewing user. In this way, the step when "NO" is determined in ST320 ends.

[0149] The above steps are executed every time a gifting action is performed by a viewing user. Therefore, for every gifting action, a video including an animation in which the first gift or the second gift is attached to each attachment part of the avatar object 400 can be generated and distributed in a timely manner.

[0150] 5. Modifications In the embodiment described above, the generation of the video (including a video including an animation of the first gift or the second gift being attached to the attachment portion of the avatar object) was performed by the broadcasting user's terminal device 10, but in another embodiment, it may be performed, for example, by the server device 20 or the viewing user's terminal device 10. Furthermore, each of the broadcasting user's terminal device 10, the server device 20, and the viewing user's terminal device 10 may generate a portion of the video to generate the final video, or a device other than these devices may further generate a portion of the video. In addition, in another embodiment described above, a rendering unit (not shown) may be provided in the server device 20 and / or the terminal device 10 of the viewing user, and the terminal device 10 of the broadcasting user may be configured to generate only data regarding the actions of the broadcasting user and / or data regarding speech or singing uttered by the broadcasting user in addition to information regarding the first gift and information regarding the second gift, so that the server device 20 and / or the terminal device 10 of the viewing user can generate a video (including a video including an animation of the first gift or the second gift being attached to the attachment portion of the avatar object), and transmit this data to the server device 20 and / or the terminal device 10 of the viewing user.

[0151] In order to realize such a configuration, the functions of the server device 20, the terminal device 10 of the viewing user, and the terminal device 10 of the broadcasting user may be appropriately changed from the above-described embodiment to adopt another embodiment. For example, in the embodiment, the video generating unit 100 is provided in the terminal device 10, but it may be provided in the server device 20, or in the terminal device 10 or the terminal device 10 of the viewing user.

[0152] Furthermore, the table 500 storing gift information and the determination as to whether or not the first gift combination satisfies a predetermined condition by referring to the table 500 were executed by the information processing server device 20B in the server device 20 in the embodiment described above, but in another embodiment, they may be executed by the terminal device 10 of the broadcast user. Accordingly, although the determination unit 240 was provided in the server device 20 in the embodiment described above, it may be provided in the terminal device 10 of the broadcast user.

[0153] Furthermore, in the above-mentioned embodiment, a combination of first gifts given to each wearing part of an avatar object (for example, a combination of first gifts given to the "head") is used to determine whether the combination satisfies a predetermined condition, but in another embodiment, a combination of multiple first gifts given to multiple wearing parts of an avatar object may be used to determine whether the combination satisfies a predetermined condition. Specifically, the combination may be a combination of a first gift given to the "head" and a first gift given to the "neck" of an avatar object, or a combination of a first gift given to the "left hand", a first gift given to the "right hand", a first gift given to the "left foot", and a first gift given to the "right foot" of an avatar object.

[0154] Furthermore, in another embodiment, the above-mentioned predetermined condition may be set to change at predetermined time intervals (for example, daily, weekly, or monthly).

[0155] Furthermore, as explained with reference to FIG. 11 in the above-mentioned embodiment, the second gift may be set so that a predetermined gift is synthesized according to a combination of pre-set first gifts, but in another embodiment, multiple types of second gifts may be set so that they are synthesized according to a combination of pre-set first gifts, and a second gift selected by the broadcast user from the multiple types of second gifts may be attached to the avatar object.

[0156] Therefore, according to various embodiments, it is possible to provide a video processing method, a server device, and a computer program that increase gifting opportunities for viewing users.

[0157] 6. Various Aspects The video processing method of the first aspect is "a video processing method executed by one or more processors that execute computer-readable instructions, comprising: a receiving step of receiving a request signal from a terminal device of the viewing user via a communication line, the request signal being generated based on an operation of a viewing user watching a video including an animation of an avatar object of a broadcasting user, the request signal requesting that a first gift be assigned to the wearing part of the avatar object; and a generating step of generating the video including an animation of a second gift having characteristics in common with the first gift being attached to the wearing part of the avatar object when it is determined that a combination of a plurality of the first gifts assigned to the wearing part of the avatar object based on a plurality of the request signals satisfies a predetermined condition."

[0158] The video processing method according to a second aspect is the above-mentioned first aspect, in which "the animation is generated based on the movement of the broadcast user".

[0159] The video processing method of the third aspect is the one in the first or second aspect above, in which "the second gift changes the size, color, and / or at least a part of the shape of the first gift."

[0160] The video processing method of the fourth aspect is any of the first to third aspects above, further including a step of transmitting, if a combination of a plurality of the first gifts does not satisfy a predetermined condition, comment information indicating a necessary condition for the combination to satisfy the predetermined condition to terminal devices of a plurality of viewing users.

[0161] The video processing method of the fifth aspect is any of the first to fourth aspects, further including a step of transmitting, to the terminal devices of a plurality of viewing users, comment information indicating that the first gift has been given to the wearing portion of the avatar object and / or that the first gift has been worn on the wearing portion of the avatar object in response to the request signal received from a terminal device of a certain viewing user.

[0162] A sixth aspect of the video processing method is any one of the first to fifth aspects, in which "the determination as to whether the combination satisfies the predetermined condition is made based on a reference table that stores the types of the first gifts given to the attachment parts of the avatar object in association with the numbers of the first gifts given for each type of first gift." .

[0163] The video processing method of the seventh aspect is any of the first to sixth aspects above, further comprising the step of "setting a duration for the second gift to persist in the video when the combination satisfies the specified condition, and erasing the second gift from the video when the duration has elapsed."

[0164] The video processing method of the eighth aspect is any of the first to seventh aspects above, wherein "the receiving process and the generating process are executed by a server device connected to a terminal device of the viewing user and / or a terminal device of the distribution user via a communication line."

[0165] A moving image processing method according to a 9th aspect is the moving image processing method according to the above-mentioned 8th aspect, wherein "it is determined by the server device that the combination satisfies the predetermined condition".

[0166] A video processing method according to a tenth aspect is any one of the first to seventh aspects, wherein "the generating step is executed by a terminal device of the broadcast user."

[0167] The video processing method according to an eleventh aspect is the video processing method according to the tenth aspect, wherein "it is determined by the server device or the terminal device of the broadcast user that the combination satisfies the predetermined condition."

[0168] A moving image processing method according to a twelfth aspect is any one of the first to seventh aspects, wherein "the generating step is executed by a terminal device of the viewing user."

[0169] The video processing method according to the 13th aspect is the above-mentioned 12th aspect, in which "it is determined by the server device or the terminal device of the broadcast user that the combination satisfies the predetermined condition."

[0170] The video processing method of the 14th aspect is any of the first to 13th aspects above, wherein "the attachment part of the avatar object is located in a part of the avatar object and / or a part separated from the avatar object."

[0171] The video processing method according to the 15th aspect is any of the first to 14th aspects, wherein "the processor is a central processing unit (CPU), a microprocessor or a graphics processing unit (GPU)."

[0172] A video processing method according to a sixteenth aspect is any one of the first to fifteenth aspects, wherein "the communication line includes the Internet."

[0173] The server device of the 17th aspect is equipped with "one or more processors, which receive a request signal from the viewing user's terminal device via a communication line, the request signal being generated based on the operation of a viewing user watching a video including an animation of an avatar object of a broadcasting user, requesting that a first gift be assigned to the wearing part of the avatar object, and when it is determined that a combination of a plurality of the first gifts assigned to the wearing part of the avatar object based on a plurality of the request signals satisfies a predetermined condition, generate the video including an animation of a second gift having characteristics in common with the first gift being attached to the wearing part of the avatar object."

[0174] The server device of the 18th aspect is equipped with "one or more processors, which receive a request signal via a communication line from a terminal device of the viewing user, the request signal being generated based on the operation of a viewing user watching a video including an animation of an avatar object of a broadcasting user, requesting that a first gift be assigned to the wearing part of the avatar object, and when it is determined that a combination of multiple first gifts assigned to the wearing part of the avatar object based on multiple request signals satisfies a predetermined condition, transmits information regarding a second gift having characteristics in common with the first gift to the wearing part of the avatar object to the terminal device of the viewing user which generates the video including an animation of the second gift being attached to the terminal device of the broadcasting user or to the terminal device of the viewing user which generates the video including an animation of the second gift being attached to the terminal device of the broadcasting user."

[0175] The server device of the 19th aspect is the server device of the 17th aspect or the 18th aspect, wherein "the processor is a central processing unit (CPU), a microprocessor, or a graphics processing unit (GPU)."

[0176] The server device according to the twentieth aspect is the server device according to any one of the seventeenth to nineteenth aspects, wherein "the communication line includes the Internet".

[0177] The computer program of the 21st aspect causes the processor to function as follows: "When executed by one or more processors, the computer program causes the processor to function as follows: the video is generated based on the operation of a viewing user watching a video including an animation of an avatar object of a broadcasting user, the video receives a request signal via a communication line from the terminal device of the viewing user requesting that a first gift be assigned to the wearing part of the avatar object, and when it is determined that a combination of multiple first gifts assigned to the wearing part of the avatar object based on multiple request signals satisfies a predetermined condition, the video includes an animation of a second gift having characteristics in common with the first gift being attached to the wearing part of the avatar object."

[0178] The computer program of the 22nd aspect causes the processor to function as follows: "When executed by one or more processors, the computer program causes the processor to function as follows: receive a request signal from the viewing user's terminal device via a communication line, the request signal being generated based on the operation of a viewing user watching a video including an animation of an avatar object of a broadcasting user, requesting that a first gift be assigned to the wearing part of the avatar object; and, when it is determined that a combination of multiple first gifts assigned to the wearing part of the avatar object based on multiple request signals satisfies a predetermined condition, transmit information regarding a second gift having characteristics in common with the first gift to the wearing part of the avatar object to the terminal device of the viewing user or a server device that generates the video including an animation of the second gift being attached to the wearing part of the avatar object."

[0179] The computer program of the 23rd aspect is the computer program of the 21st aspect or the 22nd aspect, wherein "the processor is a central processing unit (CPU), a microprocessor, or a graphics processing unit (GPU)."

[0180] The computer program according to the 24th aspect is any one of the 21st to 23rd aspects, wherein "the communication line includes the Internet."

[0181] The computer program of the 25th aspect causes the processor to "function, when executed by one or more processors, to generate a video including an animation of an avatar object of a broadcasting user, based on the operation of a viewing user watching the video including an animation of the avatar object of the broadcasting user, to transmit a request signal via a communication line requesting that a first gift be granted to the wearing part of the avatar object, and, when it is determined that a combination of multiple first gifts granted to the wearing part of the avatar object based on multiple request signals satisfies a predetermined condition, to receive information related to the second gift from the terminal device or server device of the broadcasting user in order to generate the video including an animation of a second gift having characteristics in common with the first gift being worn to the wearing part of the avatar object."

[0182] The computer program of the 26th aspect causes the processor to function as follows: "When executed by one or more processors, the computer program causes the processor to function as follows: a request signal is generated based on the operation of a viewing user watching a video including an animation of an avatar object of a broadcasting user, the request signal requesting that a first gift be assigned to the wearing part of the avatar object via a communication line; and when it is determined that a combination of multiple first gifts assigned to the wearing part of the avatar object based on multiple request signals satisfies a predetermined condition, the computer program receives from the broadcasting user's terminal device or server device the video including an animation of a second gift having characteristics in common with the first gift being attached to the wearing part of the avatar object."

[0183] The computer program of the 27th aspect is the computer program of the 25th aspect or the 26th aspect, wherein "the processor is a central processing unit (CPU), a microprocessor, or a graphics processing unit (GPU)."

[0184] The computer program according to the 28th aspect is any one of the 25th to 27th aspects, wherein "the communication line includes the Internet."

[0185] 7. Fields to which the technology disclosed in this application is applicable The technology disclosed in the present application can be applied, for example, in the following fields: (1) An application service that distributes live videos featuring avatar objects (2) Application services that allow communication using characters and avatar objects (chat applications, messengers, email applications, etc.) [Explanation of symbols]

[0186] 1. Video distribution system 10(10A~10D) Terminal device 20 Server device 20A Gift API server device 20B Information processing server device 20C Distribution server device 20D Comment API server device 100 Video Generation Unit 220 Gift Processing Department 230 Database Department 240 Judgment section 250 Comment Processing Section 400 Avatar Objects 401, 402 videos 410, 420 First Gift 420Z Second Gift 500 Tables

Claims

1. 1. A method of video processing performed by one or more processors executing computer readable instructions, comprising: a receiving step of receiving, via a communication line, from a terminal device of a first user, a request signal that is generated based on an operation of a second user viewing a video including an animation of an avatar object of a first user and requests that a first gift be given to the avatar object; a first generation step of generating the moving image including an animation of the avatar object being fitted with the first gift based on the request signal; a second generation step of generating the moving image including an animation in which a second gift having a common feature with the first gift is attached to the avatar object when it is determined that a combination of the first gifts granted to the avatar object based on the request signals satisfies a predetermined condition; an erasing step of erasing the first gift from the video when a predetermined time has elapsed; A video processing method comprising:

2. The method further includes, before the second generating step, a query step of querying the first user to obtain a confirmation of generating the video including an animation in which the second gift is attached; When it is determined that the predetermined condition is satisfied and when the confirmation is obtained, the second generation step is executed. The moving image processing method according to claim 1 .

3. the first gift and the second gift have a common characteristic; The common feature is that the attachment parts to the avatar objects are common. The moving image processing method according to claim 1 or 2.

4. the first gift and the second gift have a common characteristic; The common feature is the same color, the same size, or the same type of item; The moving image processing method according to claim 1 or 2.

5. The video processing method according to claim 1 , wherein the combination is a combination of a plurality of the first gifts given to a plurality of attachment positions of the avatar object.

6. 6. The moving image processing method according to claim 1, wherein the predetermined condition is set so as to change at predetermined time intervals.

7. A video processing method described in any one of claims 1 to 6, wherein when it is determined that the combination satisfies the specified condition, multiple types of second gifts are combined and the video including the animation in which one type of second gift determined by selection of the first user from the multiple types of second gifts is attached is generated in the second generation process.

8. The video processing method according to claim 1 , wherein the animation is generated based on a movement of the first user.

9. A video processing method as described in any one of claims 1 to 8, further comprising a step of sending comment information indicating necessary conditions for the combination to satisfy the specified conditions to terminal devices of a plurality of second users if the combination of a plurality of the first gifts does not satisfy the specified conditions.

10. A video processing method as described in any one of claims 1 to 9, further comprising a step of transmitting comment information to a plurality of terminal devices of second users in response to the request signal received from a terminal device of a second user, the comment information indicating that the first gift has been granted to the avatar object and / or that the first gift has been attached to the avatar object.

11. A video processing method as described in any one of claims 1 to 10, wherein the determination as to whether the combination satisfies the specified condition is made based on a reference table that stores in correspondence with the type of first gift granted to the avatar object and the number of first gifts granted for each type.

12. A video processing method as described in any one of claims 1 to 11, further comprising a second erasing step of setting a duration for the second gift to last in the video when the combination satisfies the specified condition, and erasing the second gift from the video when the duration has elapsed.

13. A video processing method according to any one of claims 1 to 12, wherein the receiving process, the first generation process, the second generation process and the erasure process are performed by a terminal device of the second user and / or a server device connected to the terminal device of the first user via a communication line.

14. The moving image processing method according to claim 1 , wherein the first generating step, the second generating step, and the erasing step are executed by a terminal device of the first user.

15. The video processing method according to claim 14, wherein the fact that the combination satisfies the specified condition is determined by a terminal device of the second user and / or a server device connected to the terminal device of the first user via a communication line, or by the terminal device of the first user.

16. The video processing method according to any one of claims 1 to 15, wherein the processor is a central processing unit (CPU), a microprocessor or a graphics processing unit (GPU).

17. The moving image processing method according to claim 1 , wherein the communication line includes the Internet.

18. One or more processors; The processor: receiving, via a communication line, from a terminal device of a first user, a request signal that is generated based on an operation of a second user viewing a video including an animation of an avatar object of a first user and requests that a first gift be given to the avatar object; generating the video including an animation of the avatar object wearing the first gift based on the request signal; generating the video including an animation in which a second gift having a common characteristic with the first gift is attached to the avatar object when it is determined that a combination of the first gifts granted to the avatar object based on the request signals satisfies a predetermined condition; A server device that erases the first gift from the video when a predetermined time has elapsed.

19. Before generating the video including the animation in which the second gift is attached, send an inquiry to the terminal device of the first user to obtain the first user's confirmation regarding the generation of the video including the animation in which the second gift is attached; The server device according to claim 18, further comprising: when it is determined that the specified condition is met and the confirmation is received, the video is generated, the video including an animation of the second gift being attached to the avatar object.

20. One or more processors; The processor: receiving, via a communication line, from a terminal device of a first user, a request signal that is generated based on an operation of a second user viewing a video including an animation of an avatar object of a first user and requests that a first gift be given to the avatar object; Based on the request signal, information related to the first gift is transmitted to a terminal device of the second user or a terminal device of the first user that generates the video including an animation of the first gift being attached to the avatar object; when it is determined that a combination of the first gifts granted to the avatar object based on the request signals satisfies a predetermined condition, transmitting information about a second gift having a common characteristic with the first gifts to a terminal device of the second user or a terminal device of the first user that generates the video including an animation of the second gift being attached to the avatar object; A server device that, when a predetermined time has elapsed, transmits information regarding the deletion of the first gift to the terminal device of the second user or the terminal device of the first user which generates the video including an animation of the first gift being deleted.

21. Before transmitting information related to the second gift, send an inquiry to the terminal device of the first user to obtain the first user's confirmation regarding generating the video including an animation of the second gift being worn; The server device described in claim 20, wherein when it is determined that the specified condition is met and the confirmation is received, information related to the second gift is transmitted to a terminal device of the second user or a terminal device of the first user which generates the video including an animation of the second gift being attached to the avatar object.

22. 22. The server device according to claim 18, wherein the combination is a combination of a plurality of the first gifts given to a plurality of attachment positions of the avatar object.

23. 23. The server device of claim 18, wherein the processor is a central processing unit (CPU), a microprocessor or a graphics processing unit (GPU).

24. 24. The server device according to claim 18, wherein the communication line includes the Internet.

25. When executed by one or more processors, receiving, via a communication line, from a terminal device of a first user, a request signal that is generated based on an operation of a second user viewing a video including an animation of an avatar object of a first user and requests that a first gift be given to the avatar object; generating the video including an animation of the avatar object wearing the first gift based on the request signal; generating the video including an animation in which a second gift having a common characteristic with the first gift is attached to the avatar object when it is determined that a combination of the first gifts granted to the avatar object based on the request signals satisfies a predetermined condition; When a predetermined time has elapsed, the first gift is erased from the video. A computer program product that causes the processor to function in such a manner.

26. before generating the video including the animation in which the second gift is attached, querying the first user to obtain a confirmation for generating the video including the animation in which the second gift is attached; generating the video including an animation of the second gift being attached to the avatar object when it is determined that the predetermined condition is satisfied and when the confirmation is obtained; 26. The computer program product of claim 25, causing the processor to:

27. When executed by one or more processors, receiving, via a communication line, from a terminal device of a first user, a request signal that is generated based on an operation of a second user viewing a video including an animation of an avatar object of a first user and requests that a first gift be given to the avatar object; Based on the request signal, information related to the first gift is transmitted to a terminal device or a server device of the second user, which generates the video including an animation of the first gift being attached to the avatar object; when it is determined that a combination of the first gifts granted to the avatar object based on the request signals satisfies a predetermined condition, transmitting information about a second gift having a common characteristic with the first gifts to a terminal device of the second user or the server device which generates the video including an animation of the second gift being attached to the avatar object; When a predetermined time has elapsed, information regarding the deletion of the first gift is transmitted to the terminal device of the second user that generates the video including an animation of the first gift being deleted or to the server device. A computer program product that causes the processor to function in such a manner.

28. before transmitting information about the second gift, querying the first user to obtain a confirmation regarding generating the video including an animation of the second gift being worn; When it is determined that the predetermined condition is satisfied and the confirmation is obtained, information related to the second gift is transmitted to the terminal device of the second user or the server device which generates the video including an animation of the second gift being attached to the avatar object.

28. The computer program product of claim 27, causing the processor to:

29. When executed by one or more processors, receiving, via a communication line, from a terminal device of a first user, a request signal that is generated based on an operation of a second user viewing a video including an animation of an avatar object of a first user and requests that a first gift be given to the avatar object; Based on the request signal, information related to the first gift is transmitted to a terminal device of the second user or a terminal device of the first user that generates the video including an animation of the first gift being attached to the avatar object; when it is determined that a combination of the first gifts granted to the avatar object based on the request signals satisfies a predetermined condition, transmitting information about a second gift having a common characteristic with the first gifts to a terminal device of the second user or a terminal device of the first user that generates the video including an animation of the second gift being attached to the avatar object; When a predetermined time has elapsed, information regarding the deletion of the first gift is transmitted to the terminal device of the second user or the terminal device of the first user which generates the video including an animation of the first gift being deleted. A computer program product that causes the processor to function in such a manner.

30. Before transmitting information related to the second gift, send an inquiry to the terminal device of the first user to obtain the first user's confirmation regarding generating the video including an animation of the second gift being worn; When it is determined that the predetermined condition is satisfied and the confirmation is received, transmitting information related to the second gift to the terminal device of the second user or the terminal device of the first user, which generates the video including an animation of the second gift being attached to the avatar object.

30. The computer program product of claim 29, causing the processor to:

31. 31. The computer program product according to claim 25, wherein the combination is a combination of a plurality of the first gifts imparted to a plurality of attachment sites of the avatar object.

32. 32. A computer program product according to any one of claims 25 to 31, wherein the processor is a central processing unit (CPU), a microprocessor or a graphics processing unit (GPU).

33. 33. A computer program product as claimed in any one of claims 25 to 32, wherein the communication line includes the Internet.

34. When executed by one or more processors, a request signal is generated based on an operation of a second user viewing a video including an animation of an avatar object of a first user, the request signal requesting that a first gift be given to the avatar object via a communication line; receiving information related to the first gift from a terminal device or a server device of the first user to generate the video including an animation of the first gift being attached to the avatar object based on the request signal; receiving information about the second gifts from the terminal device of the first user or the server device to generate the video including an animation in which the avatar object is equipped with a second gift having a characteristic in common with the first gifts when it is determined that a combination of the first gifts granted to the avatar object based on the request signals satisfies a predetermined condition; receiving information related to the deletion of the first gift from the terminal device of the first user or the server device in order to generate the video including an animation of the first gift being deleted when a predetermined time has elapsed; A computer program product that causes the processor to function in such a manner.

35. Before receiving the information about the second gift, send an inquiry to the terminal device of the first user to obtain the first user's confirmation about generating the video including an animation of the second gift being worn; When it is determined that the predetermined condition is satisfied and the confirmation is received, information related to the second gift is received from the terminal device of the first user or the server device.

35. The computer program product of claim 34, causing the processor to:

36. When executed by one or more processors, a request signal is generated based on an operation of a second user viewing a video including an animation of an avatar object of a first user, the request signal requesting that a first gift be given to the avatar object via a communication line; receiving, based on the request signal, the video including an animation of the first gift being attached to the avatar object from the terminal device of the first user or a server device; when it is determined that a combination of the first gifts granted to the avatar object based on the request signals satisfies a predetermined condition, receiving the video including an animation of the avatar object being equipped with a second gift having characteristics in common with the first gifts from the terminal device of the first user or the server device; receiving, when a predetermined time has elapsed, the video including an animation in which the first gift is deleted from the terminal device of the first user or the server device; A computer program product that causes the processor to function in such a manner.

37. 37. The computer program product according to any one of claims 34 to 36, wherein the combination is a combination of a plurality of the first gifts imparted to a plurality of attachment sites of the avatar object.

38. 38. A computer program product according to any one of claims 34 to 37, wherein the processor is a central processing unit (CPU), a microprocessor or a graphics processing unit (GPU).

39. 39. A computer program product as claimed in any one of claims 34 to 38, wherein the communication line includes the Internet.

Images