Live communication system using characters

Abstract

To deepen non-language communication between a character and a viewer in a communication using the character.SOLUTION: The present invention is directed to a live communication system including a distribution apparatus operated by a distributer and a viewing apparatus operated by a viewer. A distribution terminal captures an image of the distributor and generates movement information indicating features of a distributor's movement. The distribution terminal receives an audio message from the distributor to transmit the movement information and the audio message to the viewing apparatus. The viewing apparatus moves the character according to the movement information and outputs an audio message in link with movement of the character. The viewing apparatus receives an operation of movement of an object for drinking or eating by the viewer. When the object for eating or drinking is brought closer to a mouth of a character, a motion picture showing that the character drinks or eats an object for drinking or eating is displayed.SELECTED DRAWING: Figure 11

Description

[Technical field]

[0001] The present invention relates to visual communication technology over a communication network. [Background technology]

[0002] With the spread of smartphones, communication via SNS (Social Networking Service) has become common. SNS allows you to easily share a variety of content, including not only text but also photos and videos. SNS is a tool that makes you feel a strong bond (connection) between people.

[0003] On the other hand, in the field of computer games, there are games in which a user plays while having a conversation with a character (computer). Users often have strong feelings for characters that do not exist in reality. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2012-231281 A Summary of the Invention [Problem to be solved by the invention]

[0005] Characters are virtual entities created by game designers and do not have the sense of reality that humans have. On the other hand, characters have a unique charm that stems from their non-existence. The inventors thought that by incorporating both the unique charm of characters and the "realistic connection" that is unique to humans, they could propose a new method of communication.

[0006] Specifically, we consider a conversation between a streamer (human) and a viewer (human). The streamer acts as a spokesperson for the character, just like a voice actor in a television anime, and converses with the viewer through the character. If we consider this type of communication, we believe that if the viewer can have a relationship with the character that goes beyond words, the viewer's attachment to the character will be further strengthened.

[0007] The present invention was completed based on the above recognition, and its main purpose is to provide technology for deepening non-verbal communication between characters and viewers in communication via characters. [Means for solving the problem]

[0008] A live communication system according to an embodiment of the present invention includes a distribution device operated by a distributor and a viewing device operated by a viewer. The distribution device includes an imaging unit that images the broadcaster, a motion information generation unit that generates motion information indicating characteristics of the broadcaster's motion from the captured image of the broadcaster, a first message acquisition unit that receives a first message from the broadcaster, and a transmission unit that transmits the motion information and the first message. The viewing device includes a receiving unit that receives the action information and the first message, a viewing character display unit that displays a character as an animation on the screen of the viewing device and moves the character according to the action information, a first message output unit that outputs a first message in accordance with the character's action, a food and beverage operation unit that accepts movement operations on food and beverage objects from the viewer, and a food and beverage display unit that moves and displays the food and beverage objects in accordance with the operation by the viewer. The viewing character display unit displays a moving image of the character eating the food object when a predetermined eating condition is met.

[0009] A live communication system according to another aspect of the present invention includes a distribution device operated by a distributor and a viewing device operated by a viewer. The distribution device includes an imaging unit that images the broadcaster, a motion information generation unit that generates motion information indicating characteristics of the broadcaster's motion from the captured image of the broadcaster, a distribution character display unit that displays a character on the screen of the distribution device and moves the character according to the motion information, a mouth identification unit that identifies the position coordinates of the character's mouth, an eating and drinking determination unit that determines whether the eating and drinking conditions are met, a first message acquisition unit that accepts a first message from the broadcaster, and a transmission unit that transmits the motion information and the first message. The transmission unit transmits an instruction to eat or drink as part of the operation information when the eating or drinking condition is met. The viewing device comprises a receiving unit that receives the action information and the first message, a viewing character display unit that displays an animated character on the screen of the viewing device and moves the character according to the action information, a first message output unit that outputs a first message in accordance with the character's action, a food and beverage operation unit that accepts movement operations on food and beverage objects from the viewer, a food and beverage display unit that moves and displays the food and beverage objects in accordance with the operation by the viewer, a food and beverage identification unit that identifies the position coordinates of the food and beverage objects, and a transmitting unit that transmits the position coordinates of the food and beverage objects. An eating and drinking determination unit of the distribution device determines that the eating and drinking condition is met when the distance between the position coordinates of the character's mouth and the position coordinates of the food and drink object is equal to or less than a first threshold value. When transmitting the action information, the transmitting section of the distribution device does not include the moving image data of the character as a transmission target for transmission to the viewing device. When an instruction to eat or drink is received, the viewing character display section of the viewing device displays a moving image of a character eating or drinking a food object. Effect of the Invention

[0010] According to the present invention, rich communication via characters can be easily realized. [Brief description of the drawings]

[0011] [Figure 1] FIG. 2 is a hardware configuration diagram of a live communication system. [Diagram 2]FIG. 1 is a schematic diagram for explaining a conversation service provided by a live communication system. [Diagram 3] FIG. 2 is a functional block diagram of a distribution device and a server. [Figure 4] FIG. 2 is a functional block diagram of the viewing device. [Diagram 5] 11 is a screen diagram of a viewer conversation screen displayed on the viewing device. FIG. [Figure 6] FIG. 13 is a screen diagram of a distributor conversation screen displayed on the distribution device. [Figure 7] FIG. 11 is a sequence diagram of a process for displaying a character on both the distribution device and the viewing device. [Figure 8] FIG. 13 is a screen diagram showing a character when the distributor leans his / her body. [Figure 9] 11 is a screen diagram showing a character attempting to eat a food or drink object on the viewing device. [Figure 10] FIG. 1 is a schematic diagram for explaining eating and drinking conditions. [Figure 11] FIG. 11 is a screen diagram showing eating and drinking videos on a viewing device. [Figure 12] FIG. 13 is a schematic diagram showing an image change in the case of a drink. [Figure 13] FIG. 13 is a sequence diagram of a process for displaying an image of a character eating and drinking on both the distribution device and the viewing device. [Figure 14] FIG. 13 is a diagram showing a screen when a sign object is added to a food and drink object. [Figure 15] FIG. 13 is a diagram showing a screen when a character eats a food object to which a sign object has been added. [Figure 16] 13 is a schematic diagram showing a state in which a portion of a food or drink object is shared and given to a player; FIG. [Figure 17] FIG. 11 is a screen diagram showing a character catching a food or drink object thrown by a viewer. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] FIG. 1 is a diagram showing the hardware configuration of a live communication system 100. As shown in FIG. In the live communication system 100, a plurality of distribution devices 104a, 104b,..., 104m (hereinafter collectively referred to as "distribution device 104" when they are referred to collectively or when there is no particular distinction) and a plurality of viewing devices 108a, 108b,..., 108n (hereinafter collectively referred to as "viewing device 108" when they are referred to collectively or when there is no particular distinction) are connected to a server 102 via the Internet 106. The distribution device 104 and the viewing device 108 are assumed to be smartphones, but may also be general-purpose computers such as laptop PCs.

[0013] A user who uses the distribution device 104 is called a "distributor." A user who uses the viewing device 108 is called a "viewer." The distributor is the provider of the service, and the viewer is the recipient of the service.

[0014] FIG. 2 is a schematic diagram for explaining a conversation service provided by the live communication system 100. As shown in FIG. In this embodiment, a large number of viewing devices 108 can be simultaneously connected to one distribution device 104. The following description is based on the premise of one-to-many communication. Fig. 2 assumes a situation in which three viewers 112a, 112b, and 112c (hereinafter, collectively referred to as "viewers 112" when referring to them collectively or when no particular distinction is made) are having a group conversation with one distributor 110.

[0015] A character is assigned in advance to the distributor 110. A distribution character 114a assigned to the distributor 110 is displayed on the distribution device 104. A viewing character 114b is also displayed on the viewing device 108. The distribution character 114a and the viewing character 114b are exactly the same character. Hereinafter, when there is no particular need to distinguish between the distribution character 114a and the viewing character 114b, they will simply be referred to as "character 114."

[0016] When the distributor 110 speaks in front of the distribution device 104, the audio data is transmitted to all viewing devices 108. The distribution device 104 detects the movement of the distributor's mouth, and moves the mouth of the distribution character 114a. In conjunction with this, the viewing device 108 also moves the mouth of the viewing character 114b. To the viewer 112, it appears as if the viewing character 114b is speaking of its own volition, rather than the distributor. In a sense, the distributor 110 serves as a "voice actor" and speaks for the character 114. Hereinafter, the voice message input by the distributor 110 is referred to as a "first message."

[0017] The viewer 112 inputs a message (hereinafter referred to as a "second message") in text to the viewing device 108. The second message is simultaneously transmitted to the distribution device 104 and the viewing device 108. The viewer 112 converses with the character 114 (distributor 110) by inputting the second message while listening to the story of the viewing character 114b.

[0018] The individuality of the character 114 is formed by the basic settings of the character 114 (such as the character's 114 appearance and the variety of facial expressions) and the voice quality and conversational ability of the distributor 110.

[0019] FIG. 3 is a functional block diagram of the distribution device 104 and the server 102. Each component of the distribution device 104 and the server 102 is realized by hardware including computing units such as a CPU (Central Processing Unit) and various coprocessors, storage devices such as memory and storage, and wired or wireless communication lines connecting them, and software stored in the storage devices and supplying processing instructions to the computing units. The computer programs may be composed of device drivers, an operating system, various application programs located at higher layers than those, and libraries that provide common functions to these programs. Each block described below represents a functional block, not a hardware-based configuration. The same is true for the audiovisual device 108.

[0020] (Distribution device 104) The distribution device 104 includes a user interface processing unit 116, an imaging unit 118, a data processing unit 120, a communication unit 122, and a data storage unit 124. The communication unit 122 is responsible for communication processing. The imaging unit 118 images the distributor 110. The user interface processing unit 116 accepts operations from the distributor 110 and is responsible for processing related to the user interface, such as image display and audio output. The data storage unit 124 stores various data including image data of the character 114. The data processing unit 120 executes various processes based on data acquired by the communication unit 122, the user interface processing unit 116, and the imaging unit 118 and data stored in the data storage unit 124. The data processing unit 120 also functions as an interface for the user interface processing unit 116, the imaging unit 118, the communication unit 122, and the data storage unit 124.

[0021] The communication unit 122 includes a transmitting unit 148 and a receiving unit 150 .

[0022] The user interface processing unit 116 includes an input unit 126 that accepts input from the distributor 110 and an output unit 128 that outputs various information to the distributor 110 . The input unit 126 includes a motion detection unit 130, a first message acquisition unit 132, a delivery sign input unit 134, and a food and drink selection unit 136. The motion detection unit 130 detects facial expressions and body movements of the distributor 110 via the imaging unit 118. The first message acquisition unit 132 acquires a first message (audio message). The delivery sign input unit 134 accepts a sign input from the distributor 110 for a "food and drink object" (described later). Details of the food and drink object will be described later, but it is sufficient that the image represents food or drink, and at least that it is sufficient that the image represents something that is generally ingested and digested by humans. The food and drink selection unit 136 accepts selections of multiple food and drink objects provided by multiple viewers 112.

[0023] The output section 128 includes a delivery character display section 138 , a second message output section 140 and a food and drink display section 142 . The delivery character display unit 138 displays the delivery character 114a on the delivery device 104. The second message output unit 140 displays a second message (text message) by the viewer 112 on the delivery device 104. The food and drink display unit 142 displays food and drink objects provided by the viewer 112 on the screen of the delivery device 104.

[0024] The data processing unit 120 includes a motion information generating unit 144 , an eating and drinking determining unit 220 , and a mouth identifying unit 146 . The motion information generating unit 144 generates "motion information" from the detection result of the motion detecting unit 130. The motion information is numerical data indicating the motion state of the broadcaster 110, such as a feature vector indicating the facial expression of the broadcaster 110 (e.g., a numerical value indicating the angle of the eyebrows, the opening degree of the eyes and mouth, and a numerical value indicating the relative positional relationship (front, back, left, right) between the broadcaster 110 and the broadcasting device 104). The eating and drinking determining unit 220 determines whether or not the "eating and drinking condition" is satisfied. The eating and drinking condition may be any condition for determining that the character 114 has consumed a food and drink object. In this embodiment, the eating and drinking condition is satisfied when the food and drink object is sufficiently close to the mouth of the character 114 (described later in relation to FIG. 9). The mouth identifying unit 146 detects the position coordinates of the mouth of the character 114 (hereinafter referred to as "mouth coordinates"). The broadcasting device 104 and the viewing device 108 share the same screen coordinate system (two-dimensional coordinate system). The mouth coordinates indicate the position coordinates of the mouth in the screen coordinate system (xy coordinate system).

[0025] (Server 102) The server 102 includes a communication unit 152 , a live control unit 154 , and a data storage unit 156 . The communication unit 152 is responsible for communication processing. The data storage unit 156 stores various data. The live control unit 154 mediates and manages communication between the distribution device 104 and the viewing device 108 based on the data acquired by the communication unit 152 and the data stored in the data storage unit 156. The live control unit 154 also functions as an interface between the communication unit 152 and the data storage unit 156.

[0026] The data storage unit 156 includes a character storage unit 158 ​​that stores data of a plurality of characters 114. The data storage unit 156 also stores image data of food and drink objects. The food and drink objects are uniquely identified by a food and drink ID.

[0027] FIG. 4 is a functional block diagram of the viewing device 108. The viewing device 108 includes a user interface processing unit 162 , a data processing unit 166 , a communication unit 164 and a data storage unit 168 . The communication unit 164 is responsible for communication processing. The user interface processing unit 162 accepts operations from the viewer 112 and is responsible for processing related to the user interface, such as image display and audio output. The data storage unit 168 stores various data including image data of the character 114. Both the distribution device 104 and the viewing device 108 store data of the character 114. The data processing unit 166 executes various processes based on data acquired by the communication unit 164 and the user interface processing unit 162 and data stored in the data storage unit 168. The data processing unit 166 also functions as an interface for the user interface processing unit 162, the communication unit 164, and the data storage unit 168.

[0028] The communication unit 122 includes a transmitting unit 186 and a receiving unit 190 .

[0029] The user interface processing unit 162 includes an input unit 170 that receives input from the viewer 112 and an output unit 172 that outputs various information to the viewer 112 . The input unit 170 includes a second message acquisition unit 174, a character selection unit 176, a food and drink operation unit 178, and a viewing sign input unit 222. The second message acquisition unit 174 acquires a second message (text message). The character selection unit 176 accepts the selection of the character 114 to converse with. The food and drink operation unit 178 accepts the selection of a food and drink object to be presented to the character 114 and the operation of moving the food and drink object 226. The viewing sign input unit 222 accepts a sign input from the viewer 112 for the food and drink object (described later).

[0030] The output section 172 includes a viewing character display section 180 , a first message output section 182 , a second message output section 184 , and a food and drink display section 224 . The viewing character display unit 180 displays the viewing character 114b on the viewing device 108. The first message output unit 182 outputs the first message from the distributor 110 as audio from the viewing device 108. The second message output unit 184 displays the second message from the viewer 112 on the screen of the viewing device 108. The food and drink display unit 224 displays food and drink objects on the screen of the viewing device 108.

[0031] The data processing unit 166 includes a food and drink identification unit 227. The food and drink identification unit 227 detects the position coordinates of a food and drink object (hereinafter referred to as "food and drink coordinates"). The food and drink coordinates indicate the position coordinates of the food and drink object in the same screen coordinate system (xy coordinate system) as the mouth coordinates.

[0032] At the start of the live communication service, the live control unit 154 of the server 102 causes the viewing device 108 to display a character selection screen (not shown). The viewer 112 selects a viewing character 114b (distributor 110) with whom he / she wishes to converse on the character selection screen displayed on the viewing device 108. The live control unit 154 presents characters 114 corresponding to distributors 110 who are in a conversation-ready state (standby state) on the character selection screen as conversation-ready characters. The character selection unit 176 accepts the selection of the viewing character 114b. In the following description, it is assumed that the viewer 112 enjoys a conversation with a viewing character 114b1 (see FIG. 5).

[0033] FIG. 5 is a diagram showing a viewer conversation screen 196 displayed on the viewing device 108. The viewing character display unit 180 of the viewing device 108 displays a moving image of the viewing character 114b1 selected as the conversation partner. The viewer 112 enjoys a conversation with the viewing character 114b1. The viewer 112 cannot see the distributor 110. The first message output unit 182 of the viewing device 108 outputs a voice (first message) from the distributor 110 who is in charge of the viewing character 114b1. The viewer 112 inputs a message (second message) to the viewing character 114b1 by text. The server 102 shares the first message and the second message between the distribution device 104 and the viewing device 108.

[0034] The second message output unit 184 displays the second message as text in the message area 198. Since this is a method in which one distributor 110 converses with multiple viewers 112 simultaneously, the server 102 distributes the second messages of each viewer 112 to the distribution device 104 and the multiple viewers 112 all at once. The viewers 112 can view not only their own second messages but also the second messages of the other viewers 112 in the message area 198. The second message output unit 184 displays the second messages in order of reception.

[0035] The viewer 112 can provide a food or drink object to the viewer character 114b1 by selecting the food or drink button 200 (described in detail below).

[0036] FIG. 6 is a diagram showing the distributor conversation screen 206 displayed on the distribution device 104. The distributor conversation screen 206 shown in FIG. 6 is displayed on the distribution device 104 of the distributor 110 in charge of the distribution character 114a1 (corresponding to the viewing character 114b1). The distribution character display unit 138 displays the distribution character 114a1 as a moving image. The viewing character 114b1 and the distribution character 114a are the same character and move in the same way. The distributor 110 talks with multiple viewers 112 (viewers 112 who have selected the viewing character 114b1 as a conversation partner) while checking the movement of the distribution character 114a1, which is his / her alter ego, on the distribution device 104. The distributor 110 inputs a first message by voice to the distribution device 104. The transmission unit 148 transmits the first message to the server 102, and the live control unit 154 of the server 102 distributes the first message to multiple viewing devices 108.

[0037] The second message output unit 140 displays the second messages from the viewers 112 in the message area 198 in chronological order. The distributor 110 talks to the unspecified number of viewers 112 while watching the second messages displayed one after another in the message area 198. The camera 208 (imaging unit 118) of the distribution device 104 captures an image of the distributor 110. The motion detection unit 130 detects the facial expression and motion of the distributor 110 from the captured image, and the motion information generation unit 144 generates motion information. The distribution character display unit 138 determines the motion of the distribution character 114a1 based on the motion information. In addition, the viewing character 114b1 is also displayed as a moving image on the viewing device 108 based on the same motion information, as will be described in detail later.

[0038] FIG. 7 is a sequence diagram of a process for displaying character 114 on both distribution device 104 and viewing device 108. The motion detection unit 130 of the broadcasting device 104 detects the motion of the broadcaster 110 (S10). The motion information generation unit 144 generates motion information (S12). The motion information is numerical data indicating the facial expression of the broadcaster 110, the angle of the body, the distance of the broadcaster 110 from the imaging unit 118, and the like (S12). The motion information also includes "eating and drinking instructions" to be described later.

[0039] The transmission unit 148 of the distribution device 104 transmits the motion information to each viewing device 108 via the server 102 (S14). The distribution character display unit 138 generates a moving image of the distribution character 114a1 based on the motion information (S16) and causes the distribution device 104 to display the moving image of the distribution character 114a1 (S18).

[0040] Meanwhile, the viewing character display unit 180 of the viewing device 108 also generates a moving image of the viewing character 114b1 based on the received action information (S20), and causes the viewing device 108 to display the moving image of the viewing character 114b1 (S22).

[0041] The delivered character 114a1 and the viewed character 114b1 are the same character and their movements are determined based on the same motion information, so that the delivered character 114a1 and the viewed character 114b appear the same and perform the same movements on the delivery device 104 and the viewing device 108, respectively.

[0042] The distribution device 104 does not transmit the moving image (character image) of the character 114 itself to the viewing device 108, but transmits only the motion information that defines the motion of the character 114. Since the amount of data transmitted is smaller than when transmitting the moving image itself, it is easier to quickly link the motions of the distributed character 114a1 and the viewed character 114b1. In other words, since the difference between the time until the motion information is reflected as the motion of the distributed character 114a1 and the time until the same motion information is reflected as the motion of the viewed character 114b1 is small, the viewer 112 can enjoy a pleasant conversation with the character 114 (distributor 110).

[0043] The first message (voice message) and the motion information may be transmitted from the distribution device 104 to the viewing device 108 in an integrated manner. In this case, the viewing character display unit 180 is less likely to misalign the motion of the viewing character 114b1 and the voice message. In addition, transmitting motion information for determining a moving image, rather than the moving image itself, is also effective in reducing the communication load on the Internet 106.

[0044] FIG. 8 is a screen diagram showing the character 114 when the distributor 110 leans his / her body. When the distributor 110 tilts his / her body left or right, the motion detection unit 130 detects the tilt of the body. The motion information generation unit 144 includes the tilt angle and tilt direction in the motion information. The viewing character display unit 180 tilts the viewing character 114b1 according to the motion information. The delivery character display unit 138 also tilts the delivery character 114a1 according to the same motion information. In this way, when the distributor 110 tilts his / her body left or right, the characters 114 on both the delivery side and the viewing side tilt their bodies to match the distributor 110. When the distributor 110 tilts his / her body forward or backward, the characters 114 move their bodies forward or backward in the same manner. The motion detection unit 130 may recognize the forward or backward tilt of the distributor 110 from the size of the distributor 110 reflected in the captured image.

[0045] It is generally said that human psychology is reflected in the inclination of the body. For example, it is said that when a person is interested in a conversation, they tend to lean forward (as if they are about to listen), and when they are upset, their body sways from side to side. By reflecting the body movements of the distributor 110 in the character 114, the viewer 112 can sense the psychology of the character 114 (distributor 110).

[0046] In addition, the distributor 110 can change the position of the mouth of the character 114 by moving his / her body. The mouth specifying unit 146 of the distribution device 104 appropriately detects the mouth coordinates of the distribution character 114a1. Whether or not the eating condition is met is determined based on the mouth coordinates of the distribution character 114a1, as will be described in detail later.

[0047] FIG. 9 is a screen diagram showing a character 114 attempting to eat a food or drink object 226 on a viewing device 108. The viewer 112 touches the food and drink button 200 (see FIG. 5) to select one of a plurality of types of food and drink objects 226. The food and drink operation unit 178 accepts the selection of the food and drink object 226. In FIG. 9, a food and drink object 226 modeled after the chocolate confectionery Pocky (registered trademark) has been selected.

[0048] The food and drink display unit 224 displays the food and drink object 226 on the screen of the viewing device 108. The viewing device 108 transmits the food and drink ID of the food and drink object 226 to the distribution device 104 via the server 102. The food and drink display unit 142 of the distribution device 104 also displays the food and drink object 226 on the screen of the distribution device 104. As a result, the same food and drink object 226 is displayed on both the distribution device 104 and the viewing device 108. The viewing device 108 reduces the communication load by transmitting the food and drink ID rather than transmitting image data of the food and drink object 226 itself to the distribution device 104.

[0049] The viewer 112 can freely move the food and drink object 226 in two dimensions on the screen by touching the food and drink object 226 on the viewing device 108. The food and drink operation unit 178 of the viewing device 108 accepts the movement operation of the viewer 112 with respect to the food and drink object 226. The food and drink identification unit 227 identifies food and drink coordinates indicating the position of the food and drink object 226.

[0050] The transmitting unit 186 of the viewing device 108 transmits the food and drink coordinates to the distribution device 104. The food and drink display unit 142 of the distribution device 104 determines the display position of the food and drink object 226 according to the received food and drink coordinates. Therefore, the same food and drink object 226 is displayed at the same position (mouth coordinates) on both the distribution device 104 and the viewing device 108. When the viewer 112 brings the tip of the food and drink object 226 close to the mouth of the viewed character 114b1, the eating condition is met, and a video (hereinafter referred to as "eating video") in which the viewed character 114b1 (distributed character 114a1) eats the food and drink object 226 is displayed. The eating video is prepared in advance in both the distribution device 104 and the viewing device 108 as a "video in which the character 114 holds the food and drink object 226 in his mouth, takes a bite, and moves his mouth."

[0051] FIG. 10 is a schematic diagram for explaining eating and drinking conditions. The food and drink identification unit 227 of the viewing device 108 identifies the coordinates on the screen of the tip of the food and drink object 226 as the food and drink coordinate P2. The transmission unit 186 of the viewing device 108 transmits the food and drink coordinate P2 to the distribution device 104 as appropriate. Meanwhile, the mouth identification unit 146 of the distribution device 104 detects the mouth coordinate P1 of the distribution character 114a1 as appropriate. The eating and drinking determination unit 220 of the distribution device 104 determines that the eating condition is met when the distance d1 between the mouth coordinate P1 and the food and drink coordinate P2 is within a predetermined threshold value, in other words, when the tip of the food and drink object 226 and the mouth of the character 114 are sufficiently close to each other.

[0052] When the eating condition is met, the delivery character display unit 138 of the delivery device 104 displays an eating video, which is a moving image of the delivery character 114a1 eating the food and drink object 226. Meanwhile, the transmission unit 148 of the delivery device 104 transmits an "eating instruction" indicating the establishment of the eating condition to the viewing device 108 as part of the action information. When the eating instruction is received, the viewing character display unit 180 of the viewing device 108 displays an eating video, which is a moving image of the delivery character 114b1 eating the food and drink object 226. The eating video data itself is not transmitted from the delivery device 104 to the viewing device 108.

[0053] FIG. 11 is a screen diagram showing eating and drinking videos on viewing device 108. When the eating and drinking conditions are met, the distribution device 104 transmits an eating instruction to the viewing device 108. At this time, the viewed character 114b1 opens his mouth and stuffs part of the food and drink object 226 into his cheek, munching on the food and drink object 226. In this manner, the viewed character display unit 180 of the viewing device 108 displays the eating video of the viewed character 114b1 when receiving the eating instruction.

[0054] The food and drink display unit 224 of the viewing device 108 changes the image of the food and drink object 226. In Fig. 11, half of the food and drink object 226 is missing and the other half remains. By using this method of expression, when the viewer 112 brings the food and drink object 226 close to the mouth of the character 114, the viewer 112 can have the sense that the character 114 has eaten the food and drink object 226, in other words, the viewer 112 can have a realistic sense that the character 114 has accepted the gift from the viewer 112 and is in the act of eating and drinking.

[0055] FIG. 12 is a schematic diagram showing an image change in the case of a drink. The food and drink object 226 is not limited to food, and may be a drink. The food and drink object 226 shown in FIG. 12 shows a drink that imitates tapioca milk tea (registered trademark). Tapioca milk tea (registered trademark) contains milk 232 (liquid) and tapioca dumplings 230 (solid matter), and is consumed by sucking it up through a straw 228. The food and drink specification unit 227 specifies the tip of the straw 228 as the food and drink coordinate P2. The eating and drinking condition is met when the tip of the straw 228 is brought close to the mouth of the viewed character 114b1.

[0056] When the eating and drinking conditions are met, the character 114 drinks the tapioca milk tea (registered trademark) little by little. The food and drink display unit 142 gradually lowers the level of the milk 232 over time, thereby expressing the character 114 drinking the tapioca milk tea (registered trademark) (food and drink object 226). Additionally, tapioca dumplings 230 are also sucked up through the straw 228 as appropriate.

[0057] In this way, by providing the food and drink object 226 as a drink, the viewer 112 can feel as if the character 114 is drinking the drink that he or she has presented to the viewer 112. In the live communication system 100, the viewer 112 not only enjoys conversation with the character 114, but also enhances the sense of reality of the character 114 by realizing the actions of "giving food and drink" and "having the character consume (accept) the food and drink."

[0058] FIG. 13 is a sequence diagram of a process for displaying the image of character 114 eating and drinking on both distribution device 104 and viewing device 108. The viewer 112 touches the food and drink button 200 (see FIG. 5) and selects the food and drink object 226 (S30). The transmission unit 186 of the viewing device 108 transmits the food and drink ID of the selected food and drink object 226 to the server 102 (S32). The server 102 has registered in advance the food and drink ID and the image of the food and drink object 226 in association with each other, and transmits image information of the food and drink object 226 (hereinafter also referred to as a "food and drink image") to the distribution device 104 (S34). When the distribution device 104 already has a food and drink image, the server 102 may transmit a food and drink ID to the distribution device 104 instead of a food and drink image.

[0059] The viewer 112 can move the food and drink object 226. The food and drink object 226 of the viewing device 108 detects the food and drink coordinates, and the transmission unit 186 transmits the food and drink coordinates to the server 102 (S36). The communication unit 152 of the server 102 transmits the food and drink coordinates to the distribution device 104 (S38).

[0060] The food and drink display unit 142 of the distribution device 104 displays the food and drink object 226 at the specified food and drink coordinates (S40). Similarly, the food and drink display unit 224 of the viewing device 108 also displays the food and drink object 226 (S41). The food and drink identification unit 227 of the viewing device 108 periodically detects the food and drink coordinates, and the transmission unit 186 also periodically transmits the food and drink coordinates to the server 102 (S42, S44).

[0061] The eating and drinking determination unit 220 of the distribution device 104 determines whether the eating and drinking conditions are met each time the food and drink coordinates are received. When the eating and drinking conditions are met (S46), the viewing device 108 of the distribution device 104 transmits an eating instruction to the server 102 (S48). The server 102 transfers the eating instruction to the viewing device 108 (S49).

[0062] The delivery character display unit 138 of the delivery device 104 displays the eating video of the delivery character 114a1 (S50). In addition, the food and drink display unit 142 of the delivery device 104 displays a food and drink object 226 with a part missing due to eating (S52). Similarly, the viewing character display unit 180 of the viewing device 108 displays the eating video of the viewing character 114b1 (S54). The food and drink display unit 224 of the viewing device 108 also displays a food and drink object 226 with a part missing due to eating (S56).

[0063] 13, the server 102 transmits a food and drink image to the distribution device 104, and the distribution device 104 moves and displays the food and drink object 226 indicated by the food and drink image based on the food and drink coordinates. Once the distribution device 104 has acquired a food and drink image, it does not need to acquire the food and drink image again. After acquiring the food and drink image, the distribution device 104 independently moves and displays the food and drink object 226 according to the food and drink coordinates received as appropriate. Since the food and drink image of the food and drink object 226 is not constantly transmitted from the viewing device 108 to the distribution device 104, the communication load is small, and the food and drink object 226 can be moved and displayed smoothly on the distribution device 104.

[0064] There may be cases where multiple viewers 112 simultaneously wish to provide multiple food and drink objects 226 to the character 114. In this case, the distribution device 104 receives multiple food and drink IDs. The distributor 110 selects and eats a food and drink object 226 that the distributor 110 wants to eat by bringing the mouth of the character 114 close to the food and drink object 226 that corresponds to the multiple food and drink IDs.

[0065] Alternatively, the broadcaster 110 may tap to select a food and drink object 226 that the broadcaster 110 wants to eat from multiple food and drink objects 226. In this case, the food and drink selection unit 136 of the broadcasting device 104 accepts the selection of the food and drink object 226 by the broadcaster 110. The food and drink display unit 142 of the broadcasting device 104 displays only the selected food and drink object 226 on the broadcasting device 104.

[0066] For example, it is assumed that viewer 112a provides a food and drink object 226a, and viewer 112b provides a food and drink object 226b. The food and drink object 226a and the food and drink object 226b are displayed on the distribution device 104. Here, it is assumed that the distributor 110 selects the food and drink object 226a. The transmission unit 148 of the distribution device 104 transmits the food and drink ID of the selected food and drink object 226a to all viewing devices 108. The food and drink coordinates of the food and drink object 226a are distributed from the distribution device 104 to all viewing devices 108. Therefore, the same food and drink object 226a is displayed at the same position on all viewing devices 108. When the eating condition is met, the same eating video is displayed on all viewing devices 108.

[0067] The distributor 110 selects one of the food and drink objects 226 provided by the multiple viewers 112. In the above example, when the distributor 110 selects the food and drink object 226a, a video of the character 114 eating the food and drink object 226a is displayed on all viewing devices 108. This allows the viewer 112a who provided the food and drink object 226a to have a special feeling of being "selected."

[0068] FIG. 14 is a diagram showing a screen when a sign object 236 is added to a food and drink object 226. The viewer 112 can also use the tool object 234 to modify the food and drink object 226. In Fig. 14, a sign object 236 indicating the message "Congratulations" is drawn on the food and drink object 226 that resembles an omelette using the tool object 234 that resembles ketchup.

[0069] After selecting the food and drink object 226, the viewer 112 instructs execution of the edit mode. The food and drink operation unit 178 accepts the input of the edit mode. In the edit mode, the food and drink display unit 224 enlarges and displays the food and drink object 226. In the edit mode, the viewer 112 can write a message on the food and drink object 226 (omelette) by selecting the tool object 234 (ketchup) and moving the tool object 234 freehand. The message is integrated with the food and drink object 226 as a sign object 236. Here, the viewer 112 is about to present the favorite character 114 with an omelette on which "Happy Birthday" has been written in ketchup to celebrate the character's birthday.

[0070] The transmitting unit 186 of the viewing device 108 transmits the food and drink ID of the food and drink object 226 and an image of the sun object sign object 236 (hereinafter referred to as the "signature image") to the distribution device 104 via the server 102. The distribution device 104 acquires the food and drink object 226 and the signature image, and generates an image showing an omelette with the signature. The distribution device 104 also transmits the new food and drink object 226 showing the signed omelette to the other viewing devices 108. By this control method, the "signed omelette image" is shared by all participants in the live communication system 100.

[0071] FIG. 15 is a diagram showing a screen when the character 114 eats a food object 226 to which a sign object 236 has been added. When the viewer 112 brings the food and drink object 226 close to the mouth of the viewed character 114b1, the eating condition is met, and an eating video in which the viewed character 114b1 eats the food and drink object 226 is displayed. At this time, the food and drink display unit 224 causes a part of the food and drink object 226 to be missing. In addition, the food and drink display unit 224 also causes a part of the sign object 236 to be missing in accordance with the part of the food and drink object 226 being missing. The same is true for the distribution device 104 and other viewing devices 108.

[0072] The viewer 112 can create a highly original food and drink object 226 by using the tool object 234. In addition, the viewer 112 can feel an even stronger bond and special relationship with the character 114 by having the character 114 eat the food and drink object 226 into which the viewer 112 has put his or her feelings using the sign object 236. The viewer 112 may save the food and drink object 226 with the sign object 236 added, or the scene in which the character 114 eats the food and drink object 226, as a moving or still image.

[0073] FIG. 16 is a schematic diagram showing a state in which a portion of a food or drink object 226 is shared and given to a player. The food and drink object 226 shown in FIG. 16 is three ice creams 238 (ice cream 238a, ice cream 238b, and ice cream 238c) served in a glass container 242. The viewer 112 can separate the ice cream 238c (first partial object) from the food and drink object 226 by using the spoon object 240 (split operation). The viewer 112 moves the spoon object 240 with a finger to place the tip of the spoon object 240 on the ice cream 238c. At this time, the food and drink display unit 224 of the viewing device 108 displays an image of the ice cream 238c being scooped up by the spoon object 240 from the food and drink object 226. Similarly, the position coordinates of the spoon object 240 are transmitted to the distribution device 104, and the food and drink display unit 142 of the distribution device 104 also independently displays an image of the ice cream 238c being scooped up by the spoon object 240. The same is true for other viewing devices 108.

[0074] The viewer 112 moves the ice cream 238c to the mouth of the character 114. The food and drink object 226 of the viewing device 108 transmits the position coordinates of the ice cream 238c as the food and drink coordinates to the distribution device 104, and the eating and drinking determination unit 220 of the distribution device 104 determines whether the eating condition is met based on the food and drink coordinates. When the eating condition is met, an eating video is displayed in which the character 114 receives the ice cream 238c from the spoon object 240 with his mouth and eats it. The ice cream 238c is erased from the screen.

[0075] The food and drink object 226 includes ice cream 238a, ice cream 238b, and glass container 242, and is an image that has lost ice cream 238c (remaining object). The viewer 112 can further scoop up ice cream 238a (second partial object) with spoon object 240 (split operation), and similarly feed ice cream 238a to the character 114. At this time, an eating video is displayed in which the character 114 eats ice cream 238a. The food and drink object 226 includes ice cream 238b and glass container 242, and is an image that has lost ice cream 238a as well. Ice cream 238a is erased from the screen.

[0076] According to this control method, the viewer 112 can enjoy the act of scooping up a portion of food or drink (such as ice cream 238c) and feeding it to the character 114. The distributor 110 can also move his or her body to bring the mouth of the character 114 closer to the ice cream 238c, thereby causing the character 114 to receive the ice cream 238c. By realizing the act of "taking out" and "handing over" a portion of the food or drink object 226 in this way, the viewer 112 can easily feel a sense of interaction with the character 114 as if they were interacting with a loved one.

[0077] FIG. 17 is a screen diagram showing when the character 114 catches a food or drink object 226 thrown by the viewer 112. The food and drink object 226 shown in FIG. 17 resembles a marshmallow. The viewer 112 can throw the food and drink object 226 by placing a finger on the food and drink object 226 and performing a flick operation (a flicking operation with a finger). The food and drink operation unit 178 detects the flick operation on the food and drink object 226 and detects the direction and speed of the flick. The food and drink display unit 224 displays on the screen the food and drink object 226 flying along a parabola based on the speed and direction of the flick. At this time, the food and drink object 226 of the viewing device 108 appropriately detects the food and drink coordinates, and the transmission unit 186 transmits the food and drink coordinates to the distribution device 104.

[0078] The eating and drinking determination unit 220 of the distribution device 104 calculates the distance between the appropriately changing food and drink coordinates of the food and drink object 226 and the mouth coordinates of the character 114, and determines that the eating and drinking condition is met when the distance between the two coordinates is within a threshold. When the mouth of the character 114 and the food and drink object 226 are sufficiently close, the character 114 can eat the food and drink object 226. According to this control method, the so-called "marshmallow catch" can be enjoyed with the character 114.

[0079] <Summary> The live communication system 100 has been described above based on the embodiment. According to this embodiment, the viewer 112 can not only enjoy a conversation with the character 114, but can also make the character 114 "eat and drink", which can further increase the intimacy between the viewer 112 and the character 114 (the distributor 110). When the food and drink object 226 comes close enough to the mouth of the character 114, the eating and drinking condition is met. The viewer 112 brings the food and drink object 226 close to the mouth of the character 114, and the character 114 (the distributor 110) brings his mouth close to the food and drink object 226. In order for the eating and drinking condition to be met, a certain degree of mutual understanding is required between the viewer 112 and the character 114 (the distributor 110). When the character 114 eats and drinks the food and drink object 226, the viewer 112 can have a unique feeling as if they are in sync with the character 114 and have communicated with each other.

[0080] When people become good friends, they often go out to eat together. The joint act of "having a meal together" has an important meaning in increasing intimacy between people. Also, buying souvenirs at a travel destination is an important act for increasing and confirming intimacy. Focusing on such psychological meanings related to food and drink, the live communication system 100 realizes the feeling of "having a meal together" by the viewer 112 presenting the food and drink object 226 to the character 114, and the character 114 eating or drinking the food and drink object 226. The eating and drinking condition is established not only by providing the food and drink object 226, but also by bringing the food and drink object 226 close to the mouth of the character 114, and the character 114 (the distributor 110) bringing his mouth close to the food and drink object 226. This allows the viewer 112 to feel as if his sincerity has been conveyed to the character 114.

[0081] Furthermore, when the character 114 eats the food and drink object 226, the presentation effect can be enhanced to make it appear as if the character 114 has actually consumed the food and drink object 226 by causing the food and drink object 226 to be missing (see FIG. 11), by changing the image of the food and drink object 226 (see FIG. 12), or by sharing a portion of the food and drink object 226 and displaying the remainder (see FIG. 16).

[0082] The present invention is not limited to the above-mentioned embodiment and modified examples, and the components can be modified without departing from the gist of the present invention. Various inventions can be formed by appropriately combining multiple components disclosed in the above-mentioned embodiment and modified examples. In addition, some components can be deleted from all the components shown in the above-mentioned embodiment and modified examples.

[0083] [Variations] In the present embodiment, the first message is voice and the second message is text. As a modification, the first message may be text and the second message may be voice. Furthermore, the message may be conveyed by an icon image such as a stamp image or an emoticon.

[0084] In the present embodiment, it has been described that the distribution device 104 determines whether the eating and drinking condition is met. As a modified example, the viewing device 108 may be equipped with the eating and drinking determination unit 220 and the mouth identification unit 146, instead of the distribution device 104. In this case, the mouth identification unit 146 of the viewing device 108 detects the mouth coordinates, and the eating and drinking determination unit 220 of the viewing device 108 determines the eating and drinking condition based on the mouth coordinates and the food and drink coordinates. When the eating and drinking condition is met, the viewing device 108 transmits an eating instruction to the distribution device 104. The server 102 also transmits an eating instruction to the other viewing devices 108. When the eating and drinking condition is met, the distribution device 104 and the viewing device 108 may each display an eating video.

[0085] The food and drink object 226 may be provided for a fee. The viewer 112 may purchase the food and drink object 226 for a fee and provide it to the character 114. The food and drink operation unit 178 may also allow the viewer 112 to obtain the food and drink object 226 free of charge only during a predetermined period, for example, from 19:00 to 20:00.

[0086] The eating and drinking determination unit 220 has been described as determining whether the eating and drinking condition is met based on the food and drink coordinates and the mouth coordinates. Alternatively, the eating and drinking condition may be met when the viewer 112 brings the food and drink object 226 close to the hand of the character 114. Furthermore, the output unit 128 of the distribution device 104 may display an eating and drinking button on the screen when the food and drink object 226 is provided. When the distributor 110 touches the eating and drinking button, the character 114 may eat the food and drink object 226.

[0087] In the present embodiment, it has been described that the viewer 112 moves the food and drink object 226 by touching and moving the food and drink object 226. As a variation, the hand and body movements of the viewer 112 may be detected by a camera, and the position (food and drink coordinates) of the food and drink object 226 may be changed accordingly.

[0088] The character 114 (distributor 110) may eat the multiple food and drink objects 226 in the order in which they are provided. For example, suppose that the viewing device 108a provides a food and drink object 226a, and the viewing device 108b provides a food and drink object 226b a little later. The food and drink display unit 142 of the distribution device 104 may first display only the food and drink object 226a, and then display the next food and drink object 226b on the condition that the food and drink object 226a has been consumed.

[0089] A degree of fullness may be set for the character 114. The eating and drinking determination unit 220 may satisfy the eating condition on the condition that the degree of fullness of the character 114 is equal to or less than a predetermined value. When the character 114 eats a food and drink object 226, the eating and drinking determination unit 220 increases the degree of fullness. In addition, the eating and drinking determination unit 220 decreases the degree of fullness of the character 114 over time. According to such a control method, the viewer 112 needs to provide the food and drink object 226 at the appropriate time when the character 114 is hungry, so that the viewer 112 can feel the reality of the character 114 even more. The rate at which the degree of fullness increases or decreases may be different for each character 114.

[0090] In the present embodiment, it has been described that the viewer 112 designs the sign object 236 freehand by using the tool object 234. As a variation, the food and drink object 226 may be decorated with a tool object 234 that resembles a stamp, or may be decorated with items such as small flags and powder.

[0091] The viewer 112 may present the character 114 with decorative objects such as hats and clothes, in addition to the food and drink objects 226. At this time, a signature or a stamp may be added to the decorative object. According to this control method, a highly original decorative object can be presented to the character 114.

[0092] Not only the viewer 112, but also the distributor 110 may decorate the food and drink object 226 with the sign object 236. For example, the distributor 110 specifies an edit mode for the food and drink object 226 provided by the viewer 112. In the edit mode, the distributor 110 adds the sign object 236 to the food and drink object 226. The distribution device 104 transmits the food and drink image of the food and drink object 226 with the sign object 236 added to the viewing device 108. As a result, the food and drink image of the food and drink object 226 with the sign is shared with all participants. The character 114 who provided the food and drink object 226 moves the food and drink object 226, and the character 114 eats the food and drink object 226.

[0093] According to such a control method, the distributor 110 (character 114) can return an original message such as "Thank you" to the food and drink object 226 provided by the viewer 112. The viewer 112 may take a picture of the original food and drink object 226 processed by the distributor 110 (character 114).

[0094] The distributor 110 (character 114) may sign an item (object) such as a colored paper given as a present by the viewer 112.

[0095] The viewer 112 may create an original food and drink object 226 by cooking. For example, the viewer 112 selects some material objects from a plurality of material objects. The viewing device 108 includes a food and drink creation unit (not shown), which generates various food and drink objects 226 based on the selected material objects. According to such a control method, the viewer 112 can enjoy the pleasure of cooking and having others eat the food. [Explanation of symbols]

[0096] 100 live communication system, 102 server, 104 distribution device, 106 Internet, 108 viewing device, 110 distributor, 112 viewer, 114 character, 114a distribution character, 114b viewing character, 116 user interface processing unit, 118 imaging unit, 120 data processing unit, 122 communication unit, 124 data storage unit, 126 input unit, 128 output unit, 130 action detection unit, 132 first message acquisition unit, 134 distribution sign input unit, 136 food and drink selection unit, 138 distribution character display unit, 140 second message output unit, 142 food and drink display unit, 144 action information generation unit, 146 mouth identification unit, 148 transmission unit, 150 reception unit, 152 communication unit, 154 live control unit, 156 data storage unit, 158 character storage unit, 162 User interface processing unit, 164, communication unit, 166, data processing unit, 168, data storage unit, 170, input unit, 172, output unit, 174, second message acquisition unit, 176, character selection unit, 178, food and drink operation unit, 180, viewing character display unit, 182, first message output unit, 184, second message output unit, 186, transmission unit, 190, reception unit, 196, viewer conversation screen, 198, message area, 200, food and drink button, 206, distributor conversation screen, 208, camera, 220, eating and drinking determination unit, 222, viewing sign input unit, 224, food and drink display unit, 226, food and drink object, 227, food and drink identification unit, 228, straw, 230, tapioca dumpling, 232, milk, 234, tool object, 236, sign object, 238, ice cream, 240, spoon object, 242, glass container

Claims

1. A distribution device operated by a distributor and a viewing device operated by a viewer, The distribution device includes: An imaging unit that images a broadcaster; a motion information generating unit that generates motion information indicating characteristics of the motion of the distributor from a captured image of the distributor; A transmitter that transmits the operation information, The viewing device includes: A receiving unit that receives the operation information; a viewing character display unit that displays a moving image of a character on a screen of the viewing device and moves the character in accordance with the action information; an object display unit that displays an object selected by a viewer from among a plurality of types of objects; the viewing character display unit displays a moving image of the character performing a predetermined action when a predetermined condition regarding a positional relationship between the object and a predetermined part of the character is satisfied; The viewing device includes: a viewing sign input unit that receives an input of a sign for the object from a viewer, The object display unit is configured to display the sign by combining it with the object.

2. A distribution device operated by a distributor and a viewing device operated by a viewer, The distribution device includes: An imaging unit that images a broadcaster; a motion information generating unit that generates motion information indicating characteristics of the motion of the distributor from a captured image of the distributor; A transmitter that transmits the operation information, The viewing device includes: A receiving unit that receives the operation information; a viewing character display unit that displays a moving image of a character on a screen of the viewing device and moves the character in accordance with the action information; an object display unit that displays an object selected by a viewer from among a plurality of types of objects; the viewing character display unit displays a moving image in which the object changes when a predetermined condition regarding a positional relationship between the object and a predetermined part of the character is satisfied; The viewing device includes: a viewing sign input unit that receives an input of a sign for the object from a viewer, The object display unit is configured to display the sign by combining it with the object.

3. A distribution device operated by a distributor and a viewing device operated by a viewer, The distribution device includes: An imaging unit that images a broadcaster; a motion information generating unit that generates motion information indicating characteristics of the motion of the distributor from a captured image of the distributor; A transmitter that transmits the operation information, The viewing device includes: A receiving unit that receives the operation information; a viewing character display unit that displays a moving image of a character on a screen of the viewing device and moves the character in accordance with the action information; an object display unit that displays an object selected by a viewer from among a plurality of types of objects; the viewing character display unit displays a moving image of the character performing a predetermined action when a predetermined condition regarding a positional relationship between the object and a predetermined part of the character is satisfied; The distribution device includes: a signature input unit that receives a signature input for the object from a distributor, The transmission unit further transmits an image of the signature, The receiving unit of the viewing device receives an image of the sign, The object display unit is configured to display an image of the sign combined with the object.

4. A distribution device operated by a distributor and a viewing device operated by a viewer, The distribution device includes: An imaging unit that images a broadcaster; a motion information generating unit that generates motion information indicating characteristics of the motion of the distributor from a captured image of the distributor; A transmitter that transmits the operation information, The viewing device includes: A receiving unit that receives the operation information; a viewing character display unit that displays a moving image of a character on a screen of the viewing device and moves the character in accordance with the action information; an object display unit that displays an object selected by a viewer from among a plurality of types of objects; the viewing character display unit displays a moving image in which the object changes when a predetermined condition regarding a positional relationship between the object and a predetermined part of the character is satisfied; The distribution device includes: a signature input unit that receives a signature input for the object from a distributor, The transmission unit further transmits an image of the signature, The receiving unit of the viewing device receives an image of the sign, The object display unit is configured to display an image of the sign combined with the object.

5. A distribution device operated by a distributor and a viewing device operated by a viewer, The distribution device includes: An imaging unit that images a broadcaster; a motion information generating unit that generates motion information indicating characteristics of the motion of the distributor from a captured image of the distributor; A transmitter that transmits the operation information, The viewing device includes: A receiving unit that receives the operation information; a viewing character display unit that displays a moving image of a character on a screen of the viewing device and moves the character in accordance with the action information; an object display unit that displays an object selected by a viewer from among a plurality of types of objects; the viewing character display unit displays a moving image of the character performing a predetermined action when a predetermined condition regarding a positional relationship between the object and a predetermined part of the character is satisfied; the distribution device is simultaneously connected to a plurality of the viewing devices; The viewing device further includes a transmission unit that transmits an ID of an object designated by a viewer, the distribution device further includes an object selection unit configured to receive a selection by a distributor for an object designated on one or more viewing devices; the transmission unit of the distribution device simultaneously transmits the selected object to the plurality of viewing devices; A live communication system characterized in that the viewing character display unit of each of the plurality of viewing devices displays a video of the character performing the specified action, with the selected object as the target.

6. A distribution device operated by a distributor and a viewing device operated by a viewer, The distribution device includes: An imaging unit that images a broadcaster; a motion information generating unit that generates motion information indicating characteristics of the motion of the distributor from a captured image of the distributor; A transmitter that transmits the operation information, The viewing device includes: A receiving unit that receives the operation information; a viewing character display unit that displays a moving image of a character on a screen of the viewing device and moves the character in accordance with the action information; an object display unit that displays an object selected by a viewer from among a plurality of types of objects; the viewing character display unit displays a moving image of the character performing a predetermined action when a predetermined condition regarding a positional relationship between the object and a predetermined part of the character is satisfied; when a split operation on the object from a viewer is accepted, the object display unit separates the object into a first partial object and a remaining object, and moves and displays the first partial object in accordance with the operation by the viewer; the viewing character display unit, when a distance between position coordinates of the first partial object and position coordinates of the predetermined part of the character is equal to or less than a second threshold, determines that the predetermined condition is met, displays a video in which the character performs the predetermined action on the first partial object, and erases the first partial object; when a division operation on the remaining object is accepted, the object display unit separates the remaining object into a second partial object and a new remaining object, and moves and displays the second partial object in accordance with an operation by the viewer; The live communication system is characterized in that when the distance between the position coordinates of the second partial object and the position coordinates of the specified part of the character is less than or equal to a third threshold, the specified condition is met again, and a video of the character performing the specified action on the second partial object is displayed and the second partial object is erased.

7. A distribution device operated by a distributor and a viewing device operated by a viewer, The distribution device includes: An imaging unit that images a broadcaster; a motion information generating unit that generates motion information indicating characteristics of the motion of the distributor from a captured image of the distributor; A transmitter that transmits the operation information, The viewing device includes: A receiving unit that receives the operation information; a viewing character display unit that displays a moving image of a character on a screen of the viewing device and moves the character in accordance with the action information; an object display unit that displays an object selected by a viewer from among a plurality of types of objects; the viewing character display unit displays a moving image of the character performing a predetermined action when a predetermined condition regarding a positional relationship between the object and a predetermined part of the character is satisfied; the object display unit of the viewing device, when a viewer performs an operation to throw the object, moves and displays the object along a predetermined trajectory; The live communication system is characterized in that the viewing character display unit displays a video of the character performing the specified movement when the specified condition is met when the distance between the position coordinates of the object displayed in a moving manner and the position coordinates of the specified part of the character is within a fourth threshold.

8. 8. The live communication system according to claim 1, wherein the object display unit of the viewing device moves and displays the object in accordance with an operation by the viewer.

9. the object display unit of the viewing device changes a position coordinate of the object in response to a position of a hand of the viewer; The live communication system described in any one of claims 1, 3, and 5 to 7, characterized in that when the distance between the position coordinates of the object and the position coordinates of the specified part of the character is less than or equal to a first threshold value, the specified condition is met and a video of the character performing the specified action is displayed.

10. The function of capturing images of the broadcaster, A function of generating motion information indicating characteristics of the motion of the distributor from a captured image of the distributor; a first program for causing a distribution device to perform a function of transmitting the operational information; receiving said operational information; a function of displaying a moving image of a character on a screen of a viewing device and moving the character in accordance with the motion information; A function of displaying an object selected by a viewer from among a plurality of types of objects; a function of displaying a video of the character performing a predetermined action when a predetermined condition regarding a positional relationship between the object and a predetermined part of the character is satisfied; and a second program for causing the viewing device to perform the above function, the second program further causes the viewing device to perform a function of accepting input of a sign for the object from a viewer; A live communication program, wherein the function of displaying the object is to display the sign by combining the object with the sign.

11. The function of capturing images of the broadcaster, A function of generating motion information indicating characteristics of the motion of the distributor from a captured image of the distributor; a first program for causing a distribution device to perform a function of transmitting the operational information; receiving said operational information; a function of displaying a moving image of a character on a screen of a viewing device and moving the character in accordance with the motion information; A function of displaying an object selected by a viewer from among a plurality of types of objects; a second program for causing a viewing device to display a video in which the object changes when a predetermined condition regarding a positional relationship between the object and a predetermined part of the character is satisfied; the second program further causes the viewing device to perform a function of accepting input of a sign for the object from a viewer; A live communication program, wherein the function of displaying the object is to display the sign by combining the object with the sign.

12. The function of capturing images of the broadcaster, A function of generating motion information indicating characteristics of the motion of the distributor from a captured image of the distributor; a first program for causing a distribution device to perform a function of transmitting the operational information; receiving said operational information; a function of displaying a moving image of a character on a screen of a viewing device and moving the character in accordance with the motion information; A function of displaying an object selected by a viewer from among a plurality of types of objects; a function of displaying a video of the character performing a predetermined action when a predetermined condition regarding a positional relationship between the object and a predetermined part of the character is satisfied; and a second program for causing the viewing device to perform the above function, the first program further causes the distribution device to perform a function of receiving input of a signature for the object from a distributor; The transmitting function further includes transmitting an image of the signature; The receiving function receives an image of the signature; A live communication program, characterized in that the function of displaying the object comprises synthesizing an image of the sign with the object and displaying the image.

13. The function of capturing images of the broadcaster, A function of generating motion information indicating characteristics of the motion of the distributor from a captured image of the distributor; a first program for causing a distribution device to perform a function of transmitting the operational information; receiving said operational information; a function of displaying a moving image of a character on a screen of a viewing device and moving the character in accordance with the motion information; A function of displaying an object selected by a viewer from among a plurality of types of objects; a second program for causing a viewing device to display a video in which the object changes when a predetermined condition regarding a positional relationship between the object and a predetermined part of the character is satisfied; the first program further causes the distribution device to perform a function of receiving input of a signature for the object from a distributor; The transmitting function further includes transmitting an image of the signature; The receiving function receives an image of the signature; A live communication program, characterized in that the function of displaying the object comprises synthesizing an image of the sign with the object and displaying the image.

14. The function of capturing images of the broadcaster, A function of generating motion information indicating characteristics of the motion of the distributor from a captured image of the distributor; a first program for causing a distribution device to perform a function of transmitting the operational information; receiving said operational information; a function of displaying a moving image of a character on a screen of a viewing device and moving the character in accordance with the motion information; A function of displaying an object selected by a viewer from among a plurality of types of objects; a function of displaying a video of the character performing a predetermined action when a predetermined condition regarding a positional relationship between the object and a predetermined part of the character is satisfied; and a second program for causing the viewing device to perform the above function, the distribution device is simultaneously connected to a plurality of the viewing devices; the second program further causes the viewing device to perform a function of transmitting an ID of an object designated by a viewer; the first program further causes the distribution device to perform a function of receiving a selection of a distributor for an object specified on one or more viewing devices; The function of transmitting the motion information includes simultaneously transmitting the selected object to the plurality of viewing devices; A live communication program, characterized in that the function of displaying a video of the character performing the specified action is to display a video of the character performing the specified action, with the selected object as the target.

15. The function of capturing images of the broadcaster, A function of generating motion information indicating characteristics of the motion of the distributor from a captured image of the distributor; a first program for causing a distribution device to perform a function of transmitting the operational information; receiving said operational information; a function of displaying a moving image of a character on a screen of a viewing device and moving the character in accordance with the motion information; A function of displaying an object selected by a viewer from among a plurality of types of objects; a function of displaying a video of the character performing a predetermined action when a predetermined condition regarding a positional relationship between the object and a predetermined part of the character is satisfied; and a second program for causing the viewing device to perform the above function, the function of displaying the object includes, when a split operation for the object from a viewer is received, separating the object into a first partial object and a remaining object, and moving and displaying the first partial object in accordance with the operation by the viewer; the function of displaying a moving image of the character performing the predetermined action comprises displaying a moving image of the character performing the predetermined action relative to the first partial object and erasing the first partial object when the predetermined condition is met and a distance between the position coordinates of the first partial object and the position coordinates of the predetermined part of the character is equal to or less than a second threshold value; the function of displaying the object includes, when a division operation on the remaining object is accepted, separating the remaining object into a second partial object and a new remaining object, and moving and displaying the second partial object in accordance with an operation by the viewer; The function of displaying a video of the specified action is characterized in that when the distance between the position coordinates of the second partial object and the position coordinates of the specified part of the character is less than or equal to a third threshold, the specified condition is met again, and a video of the character performing the specified action relative to the second partial object is displayed and the second partial object is erased.

16. The function of capturing images of the broadcaster, A function of generating motion information indicating characteristics of the motion of the distributor from a captured image of the distributor; a first program for causing a distribution device to perform a function of transmitting the operational information; receiving said operational information; a function of displaying a moving image of a character on a screen of a viewing device and moving the character in accordance with the motion information; A function of displaying an object selected by a viewer from among a plurality of types of objects; a function of displaying a video of the character performing a predetermined action when a predetermined condition regarding a positional relationship between the object and a predetermined part of the character is satisfied; and a second program for causing the viewing device to perform the above function, the function of displaying the object comprises, when a viewer performs an operation to throw the object, displaying the object in a moving manner along a predetermined trajectory; The function of displaying a video of the character performing the specified movement is characterized in that when the distance between the position coordinates of the object displayed in motion and the position coordinates of the specified part of the character is within a fourth threshold, the specified condition is met and a video of the character performing the specified movement is displayed.

Images