Avatar display device, avatar display system, avatar display method, and computer program product

Abstract

The avatar display device (1) includes: a storage device (10) that stores passive permission data (13) including a permission flag indicating permission or rejection of an action from an active avatar to a passive avatar by the permission flag; and an output unit (23) that outputs data for displaying moving image data of the passive avatar accepting the action of the active avatar on the active terminal (2) and the passive terminal (3) when an action from the active avatar to the passive avatar is detected and the permission flag in the passive permission data (13) indicates permission.

Description

Technical Field

[0001] The present invention relates to an avatar display device, an avatar display system, an avatar display method and an avatar display program for displaying dynamic image data of a virtual space on an active terminal and a passive terminal. Background Art

[0002] As a method of communication between users using a communication terminal, there is a method of making an avatar, which is a clone of a user, move in a virtual space. The avatar moves in the virtual space through operations input by the user. In addition, in the virtual space, the avatars of multiple users can perform actions such as handshakes by performing actions corresponding to each other.

[0003] There is also an avatar display device that expresses the avatar through a predetermined animation when the avatar satisfies a predetermined condition (Patent Document 1).

[0004] Prior art literature

[0005] Patent Literature

[0006] Patent Document 1: Japanese Patent Application Publication No. 2001-160154 Summary of the invention

[0007] Problems to be solved by the invention

[0008] Each user can perform actions corresponding to each other by appropriately moving the avatar, and realize a combination of actions such as handshake. However, in order to realize the action combination, each user must adjust the position and state of his own avatar while understanding the position and state of the other party's avatar to perform the action, and sometimes it is difficult for each user to perform actions corresponding to each avatar.

[0009] Patent Document 1 merely discloses that an avatar is expressed by a predetermined animation based on the distance to other avatars, etc., and does not disclose any combination of actions of a plurality of avatars.

[0010] Therefore, an object of the present invention is to provide an avatar display device, an avatar display system, an avatar display method, and an avatar display program for displaying dynamic image data of avatars performing actions corresponding to each other.

[0011] Means for solving problems

[0012] In order to solve the above problems, the first feature of the present invention relates to an avatar display device that is connected to an active terminal for inputting action instructions of an active avatar moving in a virtual space and a passive terminal for inputting action instructions of a passive avatar moving in the virtual space, and displays dynamic image data of the virtual space on the active terminal and the passive terminal. The avatar display device according to the first feature of the present invention includes: a storage device that stores passive permission data including a permission flag indicating permission or rejection of an action from the active avatar to the passive avatar by the passive avatar; and an output unit that outputs data for displaying, on the active terminal and the passive terminal, dynamic image data in which the passive avatar accepts the action of the active avatar when it detects an action from the active avatar to the passive avatar and the permission flag in the passive permission data indicates permission.

[0013] Alternatively, the action may be an action that is established for performing a corresponding action between the active avatar and the passive avatar, and the active avatar promotes the action of the passive avatar.

[0014] Alternatively, the passive permission data may further include the action of the passive avatar when the permission flag indicates permission. In the dynamic image data, for the action of the active avatar, the passive avatar performs the action corresponding through the passive permission data.

[0015] Alternatively, when it detects an action from the active avatar to the passive avatar and no permission flag for the action is set in the passive permission data, it indicates in the dynamic image data that the active avatar is performing an action on the passive avatar.

[0016] Alternatively, when it detects an action from the active avatar to the passive avatar and the permission flag for the action in the passive permission data indicates rejection, it indicates in the dynamic image data that the passive avatar does not accept the action of the active avatar.

[0017] For the action from the active avatar to the passive avatar in the virtual space, the passive permission data corresponds, for each part of the active avatar, a permission flag indicating whether the passive avatar permits the action from the active avatar. When it detects an action from the active avatar to a predetermined part of the passive avatar and the permission flag corresponding to the predetermined part in the passive permission data indicates permission, it indicates in the dynamic image data that the passive avatar accepts the action of the active avatar.

[0018] The second feature of the present invention relates to an avatar display system, comprising: an active terminal that inputs action instructions of an active avatar moving in a virtual space; a passive terminal that inputs action instructions of a passive avatar moving in a virtual space; and an avatar display device that is connected to the active terminal and the passive terminal and displays dynamic image data of the virtual space on the active terminal and the passive terminal. In the avatar display system according to the second feature of the present invention, the avatar display device has: a storage device that stores passive permission data including a permission flag indicating permission or rejection by the passive avatar of an action from the active avatar to the passive avatar; and an output unit that, when an action from the active avatar to the passive avatar is detected and the permission flag in the passive permission data indicates permission, outputs data for displaying on the active terminal and the passive terminal dynamic image data of the passive avatar accepting the action of the active avatar, and the active terminal and the passive terminal display the dynamic image data.

[0019] The third feature of the present invention relates to an avatar display method for an avatar display device that is connected to an active terminal that inputs action instructions of an active avatar moving in a virtual space and a passive terminal that inputs action instructions of a passive avatar moving in a virtual space, and displays dynamic image data of the virtual space on the active terminal and the passive terminal. The avatar display method according to the third feature of the present invention includes the following steps: a computer stores passive permission data including a permission flag indicating permission or rejection by the passive avatar of an action from the active avatar to the passive avatar in a storage device; and the computer, when an action from the active avatar to the passive avatar is detected and the permission flag in the passive permission data indicates permission, outputs data for displaying on the active terminal and the passive terminal dynamic image data of the passive avatar accepting the action of the active avatar.

[0020] The fourth feature of the present invention relates to an avatar display program for an avatar display device that is connected to an active terminal that inputs action instructions of an active avatar moving in a virtual space and a passive terminal that inputs action instructions of a passive avatar moving in a virtual space, and displays dynamic image data of the virtual space on the active terminal and the passive terminal. The avatar display program according to the fourth feature of the present invention causes a computer to function as: a storage unit that stores passive permission data including a permission flag indicating permission or rejection by the passive avatar of an action from the active avatar to the passive avatar; and an output unit that, when an action from the active avatar to the passive avatar is detected and the permission flag in the passive permission data indicates permission, outputs data for displaying on the active terminal and the passive terminal dynamic image data of the passive avatar accepting the action of the active avatar.

[0021] Advantages of the Invention

[0022] According to the present invention, it is possible to provide an avatar display device, an avatar display system, an avatar display method, and an avatar display program that display moving image data in which avatars perform corresponding actions with each other. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] Figure 1 FIG. is a diagram for explaining the system configuration of an avatar display system according to an embodiment of the present invention.

[0024] Figure 2 FIG. is a diagram for explaining the hardware configuration and functional blocks of an avatar display device according to an embodiment of the present invention.

[0025] Figure 3 FIG. is a diagram for explaining an example of the data structure and data of passive permission data.

[0026] Figure 4 FIG. is an example of capturing moving image data of a handshake between an active avatar and a passive avatar.

[0027] Figure 5 FIG. is an example of capturing moving image data in which an active avatar requests a handshake from a passive avatar.

[0028] Figure 6 FIG. is a flowchart for explaining the generation process of a generation unit. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0029] Next, embodiments of the present invention will be described with reference to the accompanying drawings. In the following description of the drawings, the same or similar parts are denoted by the same or similar reference numerals.

[0030] (Avatar Display System)

[0031] Refer to Figure 1 An avatar display system 5 according to an embodiment of the present invention will be described. The avatar display system 5 includes: an avatar display device 1, an active terminal 2, and a passive terminal 3. The avatar display device 1 and the active terminal 2 can communicate with each other via a communication network. The avatar display device 1 and the passive terminal 3 can communicate with each other via a communication network. In the embodiment of the present invention, a case where the avatar display system 5 includes two terminals, i.e., the active terminal 2 and the passive terminal 3, as user terminals will be described, but the number of user terminals is not limited.

[0032] The active terminal 2 and the passive terminal 3 respectively input instructions for the actions of the avatars moving in the virtual space to the avatar display device. The active terminal 2 inputs an instruction for the action of the active avatar moving in the virtual space. The passive terminal 3 inputs an instruction for the action of the passive avatar moving in the virtual space.

[0033] The method of indicating an action can be any method. For example, the user can also input the action indication of the avatar into the active terminal 2 or the passive terminal 3 using input devices such as a keyboard and a mouse. There is also a motion capture method that attaches markers to the user's body and tracks the positions of the markers to determine the user's actions. The user can also input the actions of the user determined by motion capture as the action indication of the avatar input by the user into the active terminal 2 or the passive terminal 3.

[0034] In addition, the active terminal 2 and the passive terminal 3 display the dynamic image data on the display device according to the data received from the avatar display device 1. When the avatar display device 1 outputs the dynamic image data, the active terminal 2 and the passive terminal 3 display the output dynamic image data. When the avatar display device 1 outputs the data for displaying the dynamic image data, the active terminal 2 and the passive terminal 3 generate the dynamic image data according to the output data and display the generated dynamic image data.

[0035] The avatar display device 1 makes the avatar act in the virtual space according to the action indication of the avatar received from the active terminal 2 and the passive terminal 3, and displays the dynamic image data of the virtual space on the active terminal 2 and the passive terminal 3.

[0036] The method for the avatar display device 1 to display the dynamic image data on the user terminal can be any method. For example, the avatar display device 1 can generate the dynamic image data obtained by photographing the virtual space using a virtual camera and publish the dynamic image data to the user terminal. Or, the avatar display device 1 can also generate the motion data capable of rendering the virtual space and send it to the user terminal, and the user terminal renders the motion data to generate and display the dynamic image data of the virtual space.

[0037] In the embodiment of the present invention, the avatar display device 1 not only makes the avatar act in the virtual space according to the instruction from the user terminal, but also makes the avatar perform actions different from the instruction from the user terminal under predetermined conditions, specifically, based on the action combinations of multiple avatars.

[0038] The action combination is an action established by the active avatar and the passive avatar performing corresponding actions with each other. The action combination is established by multiple avatars respectively taking corresponding postures and performing corresponding activities at corresponding positions. The action combinations are, for example, shaking hands, high-fiving, hugging, princess carry, pyramid building, etc.

[0039] In an embodiment of the present invention, the following situations are described: the active avatar requests a handshake, etc. from the passive avatar, the active avatar urges the passive avatar to perform an action combination, and the active avatar and the passive avatar perform an action combination. In addition, in an embodiment of the present invention, an action combination based on two avatars, namely the active avatar and the passive avatar, is described, but it is not limited thereto. The number of avatars for realizing the action combination is not limited, and the action combination can also be realized by three or more avatars.

[0040] In order to perform an action combination, multiple avatars need to perform appropriate actions at appropriate positions respectively. However, a user who operates while viewing the dynamic image data of the virtual space sometimes has difficulty in inputting such fine action instructions.

[0041] Therefore, regardless of the action instructions of the active avatar and the passive avatar input from the active terminal 2 and the passive terminal 3, the avatar display device 1 displays the dynamic image data in which the active avatar and the passive avatar perform an action combination under a predetermined condition. Thus, even if the user does not input fine action instructions, the user's own avatar can take actions corresponding to the action combination, and it is possible to easily realize the action combination with the avatars of other users. Thereby, the avatar display device 1 can achieve smooth communication using avatars in the virtual space.

[0042] (Avatar display device)

[0043] Refer to Figure 2 , the avatar display device 1 of the embodiment of the present invention will be described. The avatar display device 1 is a general computer having a storage device 10, a processing device 20, and a communication control device 30. The general computer realizes the Figure 2 functions shown.

[0044] The storage device 10 is a ROM (Read Only Memory), a RAM (Random access memory), a hard disk, an SSD (Solid State Drive), etc., and stores various data such as input data, output data, and intermediate data for the processing device 20 to execute processing. The processing device 20 is a CPU (Central Processing Unit), reads and writes the data stored in the storage device 10, or inputs and outputs data with the communication control device 30 to execute the processing in the avatar display device 1. The communication control device 30 is an interface for communicatively connecting to each of the active terminal 2 and the passive terminal 3.

[0045] The storage device 10 stores an avatar display program, and also stores active action data 11, passive action data 12, passive permission data 13, and motion data 14.

[0046] The active action data 11 is data of an action instruction for an active avatar received from the active terminal 2. The active action data 11 is sequentially updated according to the action instruction input from the active terminal 2.

[0047] The passive action data 12 is data of an action instruction for a passive avatar received from the passive terminal 3. The passive action data 12 is sequentially updated according to the action instruction input from the passive terminal 3.

[0048] The passive permission data 13 includes a permission flag indicating permission or rejection of the passive avatar for an action from the active avatar to the passive avatar. The passive permission data 13 presets the intention of whether the user of the passive terminal 3 accepts the action of the passive avatar. In the case where the active avatar requests an action combination from the passive avatar, the passive permission data 13 sets whether the passive avatar accepts the request of the active avatar. The passive permission data 13 sets the permission flag according to the action of the active avatar. The passive permission data 13 can also be set according to the avatar.

[0049] The passive permission data 13 can, for the action of the active avatar in the virtual space to the passive avatar, further correspond the permission flag indicating whether the passive avatar permits the action from the active avatar to each part of the active avatar. The parts of the active avatar are, for example, parts that make up the active avatar such as the right hand, left hand, head, etc. For example, in the case where the active avatar requests a touch to the right hand of the passive avatar, a permission flag is set, and in the case where a touch is requested to the hip, a rejection flag is set.

[0050] The passive permission data 13 can also include the action of the passive avatar when the permission flag indicates permission. The action of the passive avatar is the action of the passive avatar when accepting the action of the active avatar.

[0051] Generally, the degree of freedom of the shape of the avatar in the virtual space is high, and each user can select any shape. Therefore, there are cases where the size varies according to the avatar, or there are avatars with shapes different from humans. Depending on the shape of the avatar, consider communicating with other avatars through methods different from those used in communication with humans. Therefore, in the case of receiving a predetermined action from another avatar, the action performed by the passive avatar is defined by the "action" of the passive permission data 13. In addition, the "action" set by the passive permission data 13 is not limited to actions performed by humans, and includes any actions that can be performed on the avatar, such as getting larger or smaller.

[0052] The passive permission data 13 can also be generated according to the settings of the user of the passive terminal 3. In addition, the passive permission data 13 can be default setting data pre-generated by the system, or data obtained by the user of the passive terminal 3 changing the default setting.

[0053] For example, asFigure 3 As shown, the passive permission data 13 is data that correlates the values of each item of "active action type", "part of the passive avatar", "flag", and "action".

[0054] The "active action type" is the type of action combination requested by the active avatar from the passive avatar.

[0055] The "part of the passive avatar" is the part where the active avatar requests the action combination. The action requested by the active avatar from the passive avatar can be determined by the "active action type" and the "part of the passive avatar". In Figure 3 the example shown, when the active action type is a handshake and the part of the passive avatar is the right hand, it means the active avatar requests a "handshake" with the "right hand" of the passive avatar.

[0056] The "flag" indicates whether the passive avatar permits or rejects the action of the passive avatar requested by the active avatar. The "flag" can also be set to any one of the two values of "permit" and "reject". By presetting whether to permit or reject the request of the active avatar, actions that the user of the passive terminal 3 dislikes are not performed on the passive avatar in the virtual space.

[0057] In addition, the "flag" can be set to any one of the three values including "pending", in addition to "permit" and "reject". "Pending" can also include the "null" state where neither "permit" nor "reject" is set. "Pending" can indicate waiting for an indication of "permit", "reject", or the action of the passive avatar from the passive terminal 3, or can perform a default action.

[0058] The "action" is the action of the passive avatar when the active avatar requests a predetermined action. In Figure 3 the example shown, when "permit" is set for the "flag", the passive avatar performs the action corresponding to the "action". At this time, the passive permission data 13 can also correlate the motion data for making the avatar move. When "permit" is set for the "flag" and nothing is set for the "action", a default action is performed.

[0059] In Figure 3 the example shown, when the active avatar requests a "handshake" with the "right hand" of the passive avatar, "suggested left - hand handshake" is set for the "action". For an avatar with a prop like a weapon equipped on the right hand, it is difficult to perform a right - hand handshake like a person. In such a case, the passive avatar performs an action such as extending the left hand, i.e., "suggested left - hand handshake". In addition, when a weapon is equipped on the right hand, actions such as "removing the weapon equipped on the right hand to perform a handshake" can also be correlated, and any action can be set.

[0060] In addition, in Figure 3In the example shown, in the "action" in the case of the active avatar requesting a "high-five" with the "right hand" of the passive avatar, there is "changing the avatar size according to the active avatar". When the size of the passive avatar is too large or too small relative to the size of the active avatar, it is difficult for the active avatar and the passive avatar to perform a high-five. Therefore, when the active avatar requests a high-five, the passive avatar changes the size of the passive avatar in a way that matches the size of the active avatar, and then performs the high-five action.

[0061] The example of the action is not limited to Figure 3 the action example shown. For example, when the passive avatar has no hand, it can also be set in the "action" as "growing a right hand". When the active avatar requests a handshake with the passive avatar, in the dynamic image data, the right hand of the passive avatar grows, and the active avatar and the passive avatar shake hands with the right hand.

[0062] In addition, the "part of the passive avatar" and the "action" can be arbitrary items.

[0063] The motion data 14 is data for rendering the dynamic image data of the situation in the virtual space in the active terminal 2 and the passive terminal 3. In the embodiment of the present invention, the case where the motion data 14 is output to the avatar display device 1 is described, but it is also possible to output the dynamic image data generated according to the motion data 14.

[0064] The processing device 20 includes: an acquisition unit 21, a generation unit 22, and an output unit 23.

[0065] The acquisition unit 21 acquires the action instruction of the active avatar from the active terminal 2 and stores it in the active action data 11, and acquires the action instruction of the passive avatar from the passive terminal 3 and stores it in the passive action data 12.

[0066] The generation unit 22 generates data for displaying the dynamic image data in the active terminal 2 and the passive terminal 3. The generation unit 22 determines the action of the active avatar according to the active action data 11, and determines the action of the passive avatar according to the passive action data 12. The generation unit 22 generates data for displaying the dynamic image data representing the situation where the active avatar and the passive avatar move in the virtual space according to the determined actions of the active avatar and the passive avatar.

[0067] The data for displaying the dynamic image data can also be the data indicating to display the dynamic image data. At this time, the generation unit 22 generates the dynamic image data in addition to the indicated data. In addition, the data for displaying the dynamic image data can be the data for rendering the dynamic image data in the active terminal 2 and the passive terminal 3. The data for rendering is, for example, the data for determining the virtual space, the data for determining the forms and actions of the active avatar and the passive avatar, and the like.

[0068] In order to display dynamic image data on the active terminal 2 and the passive terminal 3, the output unit 23 sends the data generated by the generation unit 22 to the active terminal 2 and the passive terminal 3. When the output unit 23 outputs dynamic image data, the active terminal 2 and the passive terminal 3 play the dynamic image data sent from the output unit 23 through the display device. When the output unit 23 outputs data for rendering the dynamic image data, the active terminal 2 and the passive terminal 3 render the sent data to generate dynamic image data representing the situation where the active avatar and the passive avatar are active in the virtual space, and play it through the display device.

[0069] (Generation unit)

[0070] When generating the data for displaying dynamic image data on the active terminal 2 and the passive terminal 3, the generation unit 22 of the embodiment of the present invention performs an action different from the actions represented by the active action data 11 and the passive action data 12 in the dynamic image data under a predetermined condition.

[0071] Specifically, when detecting an action from the active avatar to the passive avatar and the permission flag in the passive permission data indicates permission, the generation unit 22 generates data for displaying dynamic image data in which the passive avatar accepts the action of the active avatar on the active terminal 2 and the passive terminal 3. In the embodiment of the present invention, the data for displaying dynamic image data on the active terminal 2 and the passive terminal 3 is the motion data 14.

[0072] First, the generation unit 22 detects an action in which the active avatar promotes the action of the passive avatar in order to perform an action combination according to the situation of the virtual space, the situation of the active avatar, etc. The action combination is any one of the "actions" set in the passive permission data 13. The generation unit 22 detects that the active avatar wants to perform any one of the "actions" of the passive permission data 13 on the passive avatar. Several methods for detecting the action of the active avatar are considered.

[0073] The generation unit 22 can make a judgment according to the process of the action of the active avatar not long ago. For example, when there is an action of bringing the right hand of the active avatar close to the passive avatar, the generation unit 22 detects that the action of the active avatar is an action for promoting the action combination of shaking hands.

[0074] The generation unit 22 can make a judgment according to the conversation of the active avatar with the passive avatar. For example, when the active avatar says "Let's shake hands" to the passive avatar, it is detected that the words of the active avatar are an action for promoting the action combination of shaking hands.

[0075] The generation unit 22 can make a judgment based on the action instruction input by the user of the active terminal 2. For example, when there is an instruction for an action such as an active avatar shaking hands with a passive avatar, the generation unit 22 detects an action that promotes the action combination of the handshaking active avatar.

[0076] The generation unit 22 can make a judgment based on the emotion expressed by the active avatar. For example, when an active avatar with a hand-shaped object or other predetermined item corresponding to "handshake" approaches the passive avatar, the generation unit 22 detects an action that promotes the action combination of the handshake by the active avatar. The item is the clothing, prop, aura, etc. of the avatar, which is something corresponding to the active avatar.

[0077] Here, it can be judged whether it is an action that promotes the action combination on the premise that the distance between the active avatar and the passive avatar is below a constant value, and the positional relationship between the active avatar and the passive avatar such as face to face. In addition, the positional relationship between the active avatar and the passive avatar is appropriately set according to the type of action combination.

[0078] When the passive permission data 13 has an item of "part of the passive avatar", when the action of the active avatar is detected, the generation unit 22 can focus on the action of the active avatar on the predetermined part of the passive avatar to detect the action of the active avatar that promotes the action of the passive avatar.

[0079] Regarding the generation unit 22, when an action from the active avatar to the predetermined part of the passive avatar is detected and the permission flag corresponding to the predetermined part in the passive permission data 13 indicates permission, it is shown in the moving image data that the passive avatar accepts the action of the active avatar. The predetermined part is the "part of the passive avatar" set in the passive permission data. The generation unit 22 detects that the active avatar wants to perform any one of the "actions" corresponding to the "part of the passive avatar" of the passive permission data 13 of the passive avatar.

[0080] When the generation unit 22 detects an action of the active avatar that promotes the action of the passive avatar, the generation unit 22 refers to the passive permission data 13 to determine whether the passive avatar accepts the action of the active avatar. In the passive permission data 13, when "permission" corresponds to the detected action, data for generating moving image data showing that the passive avatar accepts the action of the active avatar is generated.

[0081] When it is detected that the active avatar wants to perform an action of "handshake" on the passive avatar, and when "permission" corresponds to "handshake" in the passive permission data 13, as Figure 4 shown, the generation unit 22 generates data for moving image data showing the active avatar and the passive avatar shaking hands. In Figure 4In the capture of the displayed screen, the active avatar A1 approaches while extending its right hand towards the passive avatar A2. When the distance is below a predetermined value, in the moving image data, the active avatar A1 and the passive avatar A2 automatically approach and each closes its fingers to shake hands.

[0082] When the passive permission data 13 has an item of "part of the passive avatar", the generation unit 22 also considers the part of the passive avatar that is the object of the action of the active avatar and determines whether the passive avatar accepts the action of the active avatar. For example, in Figure 3 the example shown, when the active avatar wants to shake hands with the right hand of the passive avatar, the passive avatar accepts. On the other hand, when the active avatar wants to hug the upper body of the passive avatar, the passive avatar refuses.

[0083] Here, regarding the generation unit 22, when an action that hinders the action combination of the active avatar and the passive avatar is indicated in the active action data 11 or the passive action data 12, the action indicated in the active action data 11 or the passive action data 12 can be ignored, and data for generating moving image data showing the active avatar and the passive avatar shaking hands can be generated. The hindering action is an action indication for the part used in the case of the action combination.

[0084] For example, when the active avatar and the passive avatar shake hands with each other with their right hands, and the action of the passive avatar waving its right hand is specified in the passive action data 12, the generation unit 22 can make the passive avatar perform the action of shaking hands with the active avatar in the moving image data instead of making the passive avatar wave its hand. On the other hand, when the active avatar and the passive avatar shake hands with each other with their right hands, and the action of the passive avatar waving its left hand is specified in the passive action data 12, the generation unit 22 can make the passive avatar perform the action of waving its left hand and shaking hands with the active avatar in the moving image data.

[0085] When corresponding to "action" in the passive permission data 13 and the passive avatar accepts the action of the active avatar, in the moving image data, the passive avatar performs the action corresponding to the action of the active avatar through the passive permission data. For example, in Figure 3 the example shown, when the active avatar requests to shake hands with the passive avatar, in the moving image data, the passive avatar "suggests a handshake with the left hand". Specifically, the passive avatar extends its left hand towards the active avatar that has extended its right hand and waves its left hand up and down to promote the handshake with the left hand. In addition, when the active avatar requests a high-five with the passive avatar, in the moving image data, the passive avatar "changes the avatar size according to the active avatar" and gives a high-five with the active avatar.

[0086] When an action from the active avatar to the passive avatar is detected and the permission flag for this action is not set in the passive permission data 13, in the dynamic image data, it can be shown that the active avatar performs an action on the passive avatar. For example, when "rejected" or "pending" is set in the flag of the passive permission data 13, in the dynamic image data, it is shown that the active avatar promotes the action combination it wants to perform on the passive avatar.

[0087] For example, as Figure 5 shown by the capture of the screen, a message display section V1 is set in the dynamic image data. By displaying a message such as "Let's shake hands!" in the message display section V1, the situation where the active avatar A1 urges the passive avatar A2 to shake hands is transmitted to the user of the passive terminal 3 via the dynamic image data. Additionally, as another method, in the dynamic image data, an emphasis display section V2a that emphasizes the right hand of the active avatar A1 and an emphasis display section V2b that emphasizes the right hand of the passive avatar A2 can be set, and the situation where the active avatar A1 wants to shake hands can be transmitted to the user of the passive terminal 3 via the dynamic image data. It is also possible to perform emphasis display only on either the active avatar A1 or the passive avatar A2.

[0088] The user of the passive terminal 3 refers to the message or the emphasis display to understand that the active avatar A1 wants to shake hands with the passive avatar A2, and inputs an instruction to permit or reject the request. In the case of permission, in the dynamic image data, the active avatar A1 and the passive avatar A2 shake hands.

[0089] When an action from the active avatar to the passive avatar is detected and the permission flag for this action in the passive permission data 13 indicates rejection, in the dynamic image data, it is shown that the passive avatar does not accept the action of the active avatar. Thus, the user of the active terminal 2 can recognize that the action is rejected by the passive avatar.

[0090] For example, when "rejected" is set in the passive permission data 13, in the dynamic image data, the passive avatar passes through the active avatar, etc., the active avatar and the passive avatar do not entangle, and the active avatar and the passive avatar perform actions as if there is no other party. Specifically, when the active avatar requests to shake hands with the passive avatar and the passive avatar rejects, in the dynamic image data, it is shown that the passive avatar passes through the outstretched right hand of the active avatar, etc., and the situation where the active avatar and the passive avatar simply overlap. Or, in the dynamic image data, the situation where the active avatar and the passive avatar move backward from each other in a repelling manner can also be shown. Additionally, a message display section showing "Handshake rejected" can also be displayed in the dynamic image data.

[0091] Refer to Figure 6 to explain the generation process of the generation unit 22. In Figure 6In this case, the avatar display device 1 generates motion data 14 capable of rendering a virtual space, and the active terminal 2 and the passive terminal 3 generate dynamic image data based on the motion data.

[0092] First, the generation unit 22 waits for the detection of the action of the active avatar set in the passive permission data 13. When the part of the passive avatar is set in the passive permission data 13, it is also detected that the action of the active avatar is an action directed to the part of the passive avatar.

[0093] In the case where it is not detected, in step S4, the generation unit 22 generates the motion data 14 according to the active action data 11 and the passive action data 12.

[0094] In the case where it is detected, in step S2, the generation unit 22 refers to the flag corresponding to the action in the passive permission data 13. When the flag is permitted, it proceeds to step S3, and when the flag is rejected, it proceeds to step S7.

[0095] In the case where the flag is permitted, in step S3, the generation unit 22 determines whether there is an action setting in the passive permission data 13. In the case where there is no action setting, in step S5, the generation unit 22 changes the active action data 11 and the passive action data 12, and generates the motion data 14 in which the active avatar and the passive avatar perform an action combination. According to the motion data 14, regardless of the active action data 11 and the passive action data 12, the dynamic image data of the motion combination of the active avatar and the passive avatar is played through the active terminal 2 and the passive terminal 3.

[0096] In the case where there is an action setting, in step S5, the generation unit 22 changes the passive action data 12, and generates the motion data 14 in which the passive avatar performs the action set in the passive permission data 13. According to the motion data 14, regardless of the passive action data 12, the dynamic image data of the passive avatar performing the set action is played through the active terminal 2 and the passive terminal 3. The active avatar can perform an action according to the active action data 11, can also perform a predetermined action, or can stop by temporarily stopping.

[0097] In the case where the flag is rejected, in step S7, the generation unit 22 changes the passive action data 12, and generates the motion data 14 in which the passive avatar does not accept the action. In the motion data 14, the meaning of the active avatar requesting an action combination can be expressed by a message or an emphasized display.

[0098] When any one of the processes in steps S4 to S7 ends, the generation unit 22 returns to step S1.

[0099] According to the avatar display system 5 of an embodiment of the present invention, when the active avatar requests an action combination from the passive avatar and the passive avatar permits the request, regardless of the action instructions input from the active terminal 2 and the passive terminal 3, dynamic image data showing the active avatar and the passive avatar performing corresponding actions with each other is displayed. Thus, it is possible to easily implement an action combination in the virtual space without inputting fine action instructions for performing the action combination in the active terminal 2 and the passive terminal 3. Users communicating in the virtual space can easily communicate with other avatars regardless of the operation skills of the avatars.

[0100] In addition, in the embodiment of the present invention, the case where action instructions are input in real time to the active avatar and the passive avatar moving in the virtual space is described, but it is not limited thereto. For example, the active avatar moves according to the action instructions input in real time, and the passive avatar moves according to the action instructions input in advance, etc., and the input timing of the action instructions is not limited. For example, in the dynamic image data of a handshake event of an avatar of an idol (passive avatar) moving in the virtual space, when the active avatar approaches the idol and requests a handshake and the passive permission data 13 permits the handshake, a situation where the active avatar and the idol shake hands is shown.

[0101] In the embodiment of the present invention, the case where the passive permission data 13 is generated for the passive avatar is described, but it is not limited thereto. For example, the passive avatar without the passive permission data 13 can be controlled in such a way that all action combinations with the active avatar are rejected. In addition, the avatar display device 1 can hold data for setting whether to accept an action combination for the passive avatar. It is easy to identify the passive avatar that does not accept the action combination, and thus, the processing cost of the generation unit 22 can be reduced.

[0102] Regarding Figure 3 the case where flags are set according to the active action type and the part of the passive avatar in the shown passive permission data 13 is described, but it is not limited thereto. For example, flags can be set for the active avatar. The passive permission data 13 may also include identification information of the active avatar that accepts the action combination, or identification information of the active avatar that does not accept the action combination. The identification information of the active avatar only needs to be able to identify the active avatar, and it can be the identifier of each avatar, or the attributes of the active avatar such as occupation and intimacy. In addition, in the passive permission data 13, in addition to the active action type and the part of the passive avatar, flags can also be set according to the identification information of the active avatar.

[0103] In addition, in the passive permission data 13, environmental setting flags of the virtual space such as attributes, time, and weather of the regions that divide the virtual space can also be set. For example, it can also be set such that in the block of an idol, the passive avatar with the occupation of an idol receives urgings from all active avatars, while in the regions outside the block of the idol, it does not receive urgings from active avatars at all.

[0104] In addition, in the case of setting a rejection for the flag, in the passive permission data 13, the conditions for the passive avatar to accept the action combination of the active avatar can be made corresponding. The conditions are, for example, the avatar of a paying user with a predetermined level or higher of intimacy and having a predetermined item, etc. The active avatar user is notified of this condition in a recognizable manner. For example, it can be notified either in the moving image data displayed on the active terminal 2 or by a direct message to the active terminal 2.

[0105] In this way, in the passive permission data 13, the conditions for the passive avatar to accept urgings from the active avatar are predetermined in advance. Thus, the avatar display device 1 can realize communication in the virtual space that reflects the intention of the passive avatar.

[0106] (Other Embodiments)

[0107] As described above, the embodiments of the present invention have been described, but the discussions and drawings that form a part of this disclosure should not be construed as limiting the present invention. Based on this disclosure, those skilled in the art can clearly understand various alternative embodiments, examples, and application techniques.

[0108] For example, the avatar display device described in the embodiments of the present invention can be configured on one piece of hardware as shown Figure 2 or can be configured on multiple pieces of hardware according to its functions and the number of processes. In addition, it can also be implemented on an existing processing device together with other functions.

[0109] The present invention naturally includes various embodiments not described herein, etc. Therefore, the technical scope of the present invention is determined only by the specific matters of the invention covered by the appropriate scope of patent protection according to the above description.

[0110] Reference Signs

[0111] 1 Avatar display device,

[0112] 2 Active terminal,

[0113] 3 Passive terminal,

[0114] 5 Avatar display system,

[0115] 10 Storage device,

[0116] 11 Active action data,

[0117] 12 Passive action data,

[0118] 13 Passive permission data,

[0119] 14 Motion data,

[0120] 20 Processing device,

[0121] 21 Acquisition unit,

[0122] 22 Generation unit,

[0123] 23 Output unit,

[0124] 30 Communication control device.

Claims

1. An avatar display device is connected to an active terminal that inputs action instructions of an active avatar moving in a virtual space and a passive terminal that inputs action instructions of a passive avatar moving in the virtual space, and displays dynamic image data of the virtual space on the active terminal and the passive terminal to assist communication between avatars in the virtual space. It is characterized in that the avatar display device has: a storage device that stores passive permission data, which is generated by the setting of the user of the passive terminal and includes a permission flag that indicates whether the passive avatar permits or rejects an action from the active avatar to the passive avatar, that is, an action to achieve communication between the active avatar and the passive avatar; and an output unit that, when it detects the action from the active avatar to the passive avatar and the permission flag in the passive permission data indicates permission, outputs data for displaying, on the active terminal and the passive terminal, dynamic image data in which the passive avatar accepts the action of the active avatar. The action is an action combination established for the active avatar and the passive avatar to perform corresponding actions with each other, and the active avatar promotes the action of the passive avatar.

2. An avatar display device is connected to an active terminal that inputs action instructions of an active avatar moving in a virtual space and a passive terminal that inputs action instructions of a passive avatar moving in the virtual space, and displays dynamic image data of the virtual space on the active terminal and the passive terminal to assist communication between avatars in the virtual space. It is characterized in that the avatar display device has: a storage device that stores passive permission data, which is generated by the setting of the user of the passive terminal and includes a permission flag that indicates whether the passive avatar permits or rejects an action from the active avatar to the passive avatar, that is, an action to achieve communication between the active avatar and the passive avatar; and an output unit that, when it detects the action from the active avatar to the passive avatar and the permission flag in the passive permission data indicates permission, outputs data for displaying, on the active terminal and the passive terminal, dynamic image data in which the passive avatar accepts the action of the active avatar. When it detects the action from the active avatar to the passive avatar and there is no permission flag set for the action in the passive permission data, in the dynamic image data, it indicates that the active avatar is performing the action on the passive avatar.

3. An avatar display device is connected to an active terminal that inputs action instructions of an active avatar moving in a virtual space and a passive terminal that inputs action instructions of a passive avatar moving in the virtual space, and displays dynamic image data of the virtual space on the active terminal and the passive terminal to assist communication between avatars in the virtual space. It is characterized in that the avatar display device has: A storage device that stores passive permission data, which is generated by the setting of the user of the passive terminal and includes a permission flag that indicates whether the passive avatar permits or rejects the action from the active avatar to the passive avatar, i.e., the action to achieve communication between the active avatar and the passive avatar; And An output unit that, when detecting the action from the active avatar to the passive avatar and the permission flag in the passive permission data indicates permission, outputs data for dynamic image data used to display on the active terminal and the passive terminal that the passive avatar accepts the action of the active avatar, When detecting the action from the active avatar to the passive avatar and the permission flag for the action in the passive permission data indicates rejection, it indicates in the dynamic image data that the passive avatar does not accept the action of the active avatar.

4. The avatar display device according to any one of claims 1 to 3, characterized in that The passive permission data further includes the action of the passive avatar when the permission flag indicates permission, In the dynamic image data, for the action of the active avatar, the passive avatar performs the action corresponding through the passive permission data.

5. The avatar display device according to any one of claims 1 to 3, characterized in that For the action from the active avatar to the passive avatar in the virtual space, the passive permission data corresponds, by the part of the active avatar, the permission flag that indicates whether the passive avatar permits the action from the active avatar, When detecting the action from the active avatar to a predetermined part of the passive avatar and the permission flag corresponding to the predetermined part in the passive permission data indicates permission, it indicates in the dynamic image data that the passive avatar accepts the action of the active avatar.

6. An avatar display system, comprising: an active terminal that inputs action instructions of an active avatar moving in a virtual space; a passive terminal that inputs action instructions of a passive avatar moving in the virtual space; And an avatar display device that is connected to the active terminal and the passive terminal, displays dynamic image data of the virtual space on the active terminal and the passive terminal, and assists in the communication between avatars in the virtual space, characterized in that The avatar display device has: A storage device that stores passive permission data, which is generated by the setting of the user of the passive terminal and includes a permission flag that indicates whether the passive avatar permits or rejects the action from the active avatar to the passive avatar, i.e., the action to achieve communication between the active avatar and the passive avatar; And An output unit that, when detecting the action from the active avatar to the passive avatar and the permission flag in the passive permission data indicates permission, outputs data for dynamic image data used to display on the active terminal and the passive terminal that the passive avatar accepts the action of the active avatar, The active terminal and the passive terminal display the dynamic image data, The action is as follows: an action combination established for performing corresponding actions between the active avatar and the passive avatar, and the active avatar promotes the action of the passive avatar.

7. An avatar display system, comprising: an active terminal that inputs the action instructions of an active avatar moving in a virtual space; a passive terminal that inputs the action instructions of a passive avatar moving in the virtual space; And an avatar display device, which is connected to the active terminal and the passive terminal, displays dynamic image data of the virtual space on the active terminal and the passive terminal, and assists in communication between avatars in the virtual space, characterized in that the avatar display device has: a storage device that stores passive permission data, which is generated by setting of a user of the passive terminal and includes a permission flag indicating permission or rejection by the passive avatar of an action from the active avatar to the passive avatar, that is, an action for realizing communication between the active avatar and the passive avatar; and an output unit that, when detecting the action from the active avatar to the passive avatar and the permission flag in the passive permission data indicates permission, outputs data for displaying on the active terminal and the passive terminal dynamic image data in which the passive avatar accepts the action of the active avatar, the active terminal and the passive terminal display the dynamic image data, when detecting the action from the active avatar to the passive avatar and no permission flag for the action is set in the passive permission data, in the dynamic image data, it is indicated that the active avatar is performing the action on the passive avatar.

8. An avatar display system, comprising: an active terminal for inputting action instructions of an active avatar that is active in a virtual space; a passive terminal for inputting action instructions of a passive avatar that is active in the virtual space; And an avatar display device, which is connected to the active terminal and the passive terminal, displays dynamic image data of the virtual space on the active terminal and the passive terminal, and assists in communication between avatars in the virtual space, characterized in that the avatar display device has: a storage device that stores passive permission data, which is generated by setting of a user of the passive terminal and includes a permission flag indicating permission or rejection by the passive avatar of an action from the active avatar to the passive avatar, that is, an action for realizing communication between the active avatar and the passive avatar; and an output unit that, when detecting the action from the active avatar to the passive avatar and the permission flag in the passive permission data indicates permission, outputs data for displaying on the active terminal and the passive terminal dynamic image data in which the passive avatar accepts the action of the active avatar, the active terminal and the passive terminal display the dynamic image data, when detecting the action from the active avatar to the passive avatar and the permission flag for the action in the passive permission data indicates rejection, in the dynamic image data, it is indicated that the passive avatar does not accept the action of the active avatar.

9. An avatar display method for an avatar display device, the avatar display device being connected to an active terminal that inputs action instructions of an active avatar moving in a virtual space and a passive terminal that inputs action instructions of a passive avatar moving in the virtual space, and displaying dynamic image data of the virtual space on the active terminal and the passive terminal to assist communication between avatars in the virtual space, characterized in that the avatar display method comprises the following steps: The computer generates passive permission data through the setting of the user of the passive terminal and stores it in a storage device. The passive permission data includes a permission flag, and the permission flag indicates the permission or rejection of the passive avatar for the action from the active avatar to the passive avatar, that is, the action to achieve communication between the active avatar and the passive avatar; and when the computer detects the action from the active avatar to the passive avatar and the permission flag in the passive permission data indicates permission, it outputs data for displaying dynamic image data on the active terminal and the passive terminal that the passive avatar accepts the action of the active avatar, wherein the action is: an action combination established for the active avatar and the passive avatar to perform corresponding actions with each other, and the active avatar promotes the action of the passive avatar.

10. An avatar display method for an avatar display device, the avatar display device being connected to an active terminal that inputs action instructions of an active avatar moving in a virtual space and a passive terminal that inputs action instructions of a passive avatar moving in the virtual space, and displaying dynamic image data of the virtual space on the active terminal and the passive terminal to assist communication between avatars in the virtual space, characterized in that the avatar display method comprises the following steps: The computer generates passive permission data through the setting of the user of the passive terminal and stores it in a storage device. The passive permission data includes a permission flag, and the permission flag indicates the permission or rejection of the passive avatar for the action from the active avatar to the passive avatar, that is, the action to achieve communication between the active avatar and the passive avatar; and when the computer detects the action from the active avatar to the passive avatar and the permission flag in the passive permission data indicates permission, it outputs data for displaying dynamic image data on the active terminal and the passive terminal that the passive avatar accepts the action of the active avatar, when the computer detects the action from the active avatar to the passive avatar and no permission flag for the action is set in the passive permission data, in the dynamic image data, it indicates that the active avatar is performing the action on the passive avatar.

11. An avatar display method for an avatar display device, the avatar display device being connected to an active terminal that inputs action instructions of an active avatar moving in a virtual space and a passive terminal that inputs action instructions of a passive avatar moving in the virtual space, and displaying dynamic image data of the virtual space on the active terminal and the passive terminal to assist communication between avatars in the virtual space, characterized in that: The avatar display method has the following steps: The computer generates passive permission data through the setting of the user of the passive terminal and stores it in a storage device. The passive permission data includes a permission flag, and the permission flag indicates the permission or rejection of the passive avatar for the action from the active avatar to the passive avatar, that is, the action to achieve communication between the active avatar and the passive avatar; And When the computer detects the action from the active avatar to the passive avatar and the permission flag in the passive permission data indicates permission, it outputs data for displaying dynamic image data on the active terminal and the passive terminal indicating that the passive avatar accepts the action of the active avatar; When the computer detects the action from the active avatar to the passive avatar and the permission flag for the action in the passive permission data indicates rejection, it indicates in the dynamic image data that the passive avatar does not accept the action of the active avatar.

12. A computer program product, including an avatar display program for an avatar display device, the avatar display device being connected to an active terminal that inputs action instructions of an active avatar moving in a virtual space and a passive terminal that inputs action instructions of a passive avatar moving in the virtual space, and displaying dynamic image data of the virtual space on the active terminal and the passive terminal to assist communication between avatars in the virtual space, characterized in that: The avatar display program causes the computer to function as the following parts: A storage part that generates and stores passive permission data through the setting of the user of the passive terminal. The passive permission data includes a permission flag, and the permission flag indicates the permission or rejection of the passive avatar for the action from the active avatar to the passive avatar, that is, the action to achieve communication between the active avatar and the passive avatar; And An output part that, when the action from the active avatar to the passive avatar is detected and the permission flag in the passive permission data indicates permission, outputs data for displaying dynamic image data on the active terminal and the passive terminal indicating that the passive avatar accepts the action of the active avatar; The action is the following action: an action combination established for the active avatar and the passive avatar to perform corresponding actions with each other, and the active avatar promotes the action of the passive avatar.

13. A computer program product, comprising an avatar display program for an avatar display device, the avatar display device being connected to an active terminal that inputs action instructions of an active avatar moving in a virtual space and a passive terminal that inputs action instructions of a passive avatar moving in the virtual space, and displaying dynamic image data of the virtual space on the active terminal and the passive terminal to assist communication between the avatars in the virtual space, characterized in that the avatar display program causes a computer to function as the following parts: a storage unit that generates and stores passive permission data through the setting of a user of the passive terminal, the passive permission data including a permission flag that indicates permission or rejection by the passive avatar of an action from the active avatar to the passive avatar, that is, an action to achieve communication between the active avatar and the passive avatar; and an output unit that, when detecting the action from the active avatar to the passive avatar and the permission flag in the passive permission data indicates permission, outputs data for displaying, on the active terminal and the passive terminal, dynamic image data of the passive avatar accepting the action of the active avatar, and when detecting the action from the active avatar to the passive avatar and no permission flag for the action is set in the passive permission data, in the dynamic image data, it indicates that the active avatar is performing the action on the passive avatar.

14. A computer program product, comprising an avatar display program for an avatar display device, the avatar display device being connected to an active terminal that inputs action instructions of an active avatar moving in a virtual space and a passive terminal that inputs action instructions of a passive avatar moving in the virtual space, and displaying dynamic image data of the virtual space on the active terminal and the passive terminal to assist communication between the avatars in the virtual space, characterized in that the avatar display program causes a computer to function as the following parts: a storage unit that generates and stores passive permission data through the setting of a user of the passive terminal, the passive permission data including a permission flag that indicates permission or rejection by the passive avatar of an action from the active avatar to the passive avatar, that is, an action to achieve communication between the active avatar and the passive avatar; and an output unit that, when detecting the action from the active avatar to the passive avatar and the permission flag in the passive permission data indicates permission, outputs data for displaying, on the active terminal and the passive terminal, dynamic image data of the passive avatar accepting the action of the active avatar, and when detecting the action from the active avatar to the passive avatar and the permission flag for the action in the passive permission data indicates rejection, in the dynamic image data, it indicates that the passive avatar does not accept the action of the active avatar.

Images