Avatar display device, avatar display system, avatar display method, and avatar display program

Abstract

To display moving image data in which avatars take actions corresponding to each other.SOLUTION: An avatar display device 1 is provided with: a storage device 10 for storing passive permission data 13 including a permission flag indicating permission or denial of a passive avatar in relation to an action of an active avatar on the passive avatar; and an output unit 23 which, if the action of the active avatar on the passive avatar is detected and the permission flag in the passive permission data 13 indicates permission, outputs data for displaying, on an active terminal 2 and a passive terminal 3, moving image data in which the passive avatar accepts the action of the active avatar.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present invention relates to an avatar display device, an avatar display system, an avatar display method, and an avatar display program for displaying video data in a virtual space on an active terminal and a passive terminal. [Background technology]

[0002] One method of communication between users using communication terminals is to have an avatar, which is an alter-ego of the user, act in a virtual space. The avatar acts in the virtual space by inputting operations by the user. In addition, in the virtual space, the avatars of multiple users can perform corresponding actions, allowing multiple avatars to perform a combination of actions, such as shaking hands.

[0003] There is also an avatar display device that displays an avatar using a predefined animation when the avatar satisfies a predetermined condition (Patent Document 1). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2001-160154 A Summary of the Invention [Problem to be solved by the invention]

[0005] By appropriately moving their avatars, users can perform corresponding actions and realize action combinations such as shaking hands. However, to realize action combinations, each user must grasp the position and state of the other user's avatar while adjusting the position and state of his or her own avatar, and it may be difficult for each user to make the corresponding avatar perform the action.

[0006] Patent Document 1 only describes how an avatar is expressed using a predefined animation based on the distance from other avatars, and does not disclose any combination of actions by multiple avatars.

[0007] SUMMARY OF THE PRESENT EMBODIMENTS Accordingly, an object of the present invention is to provide an avatar display device, an avatar display system, an avatar display method, and an avatar display program that display video data in which avatars perform actions corresponding to each other. [Means for solving the problem]

[0008] In order to solve the above problems, a first feature of the present invention relates to an avatar display device that is connected to an active terminal that inputs movement instructions for an active avatar active in a virtual space and a passive terminal that inputs movement instructions for a passive avatar active in the virtual space, and displays video data of the virtual space on the active terminal and the passive terminal. The avatar display device according to the first feature of the present invention includes a storage device that stores passive permission data including a permission flag indicating whether the passive avatar is allowed or denied a movement from the active avatar to the passive avatar, and an output unit that outputs data for displaying video data in which the passive avatar accepts the movement of the active avatar on the active terminal and the passive terminal when a movement from the active avatar to the passive avatar is detected and the permission flag in the passive permission data indicates permission.

[0009] The action may be an action in which an active avatar prompts an action of a passive avatar to form an action combination in which the active avatar and the passive avatar perform corresponding actions.

[0010] The passive permission data may further include a motion of the passive avatar when the permission flag indicates permission, and in the video data, the passive avatar may perform a motion associated with the passive permission data in response to a motion of the active avatar.

[0011] When a motion from an active avatar to a passive avatar is detected and a permission flag for the motion is not set in the passive permission data, the video data may indicate that the active avatar is performing the motion on the passive avatar.

[0012] When a motion from an active avatar to a passive avatar is detected and the permission flag for the motion in the passive permission data indicates denial, the video data may indicate that the passive avatar does not accept the motion of the active avatar.

[0013] The passive permission data may associate, with respect to actions from an active avatar to a passive avatar in the virtual space, a permission flag indicating whether the passive avatar permits the action from the active avatar with each body part of the active avatar, and when an action from the active avatar to a specified body part of the passive avatar is detected and the permission flag corresponding to the specified body part in the passive permission data indicates permission, the video data may indicate that the passive avatar accepts the action of the active avatar.

[0014] A second aspect of the present invention relates to an avatar display system comprising an active terminal for inputting movement instructions of an active avatar active in a virtual space, a passive terminal for inputting movement instructions of a passive avatar active in the virtual space, and an avatar display device connected to the active and passive terminals and displaying video data of the virtual space on the active and passive terminals. In the avatar display system according to the second aspect of the present invention, the avatar display device comprises a storage device for storing passive permission data including a permission flag indicating whether the passive avatar is allowed or denied a movement from the active avatar to the passive avatar, and an output unit for outputting data for displaying video data in which the passive avatar accepts the movement of the active avatar on the active and passive terminals when a movement from the active avatar to the passive avatar is detected and the permission flag in the passive permission data indicates permission, and the active and passive terminals display the video data.

[0015] A third aspect of the present invention relates to an avatar display method used in an avatar display device that is connected to an active terminal that inputs movement instructions for an active avatar active in a virtual space and a passive terminal that inputs movement instructions for a passive avatar active in the virtual space and displays video data of the virtual space on the active terminal and the passive terminal. The avatar display method according to the third aspect of the present invention includes a step of a computer storing in a storage device passive permission data including a permission flag indicating whether the passive avatar allows or rejects an action from the active avatar to the passive avatar, and a step of the computer outputting data for displaying on the active terminal and the passive terminal video data in which the passive avatar accepts the action of the active avatar when an action from the active avatar to the passive avatar is detected and the permission flag in the passive permission data indicates permission.

[0016] A fourth aspect of the present invention relates to an avatar display program used in an avatar display device that is connected to an active terminal that inputs movement instructions for an active avatar active in a virtual space and a passive terminal that inputs movement instructions for a passive avatar active in the virtual space and displays video data of the virtual space on the active terminal and the passive terminal. The avatar display program according to the fourth aspect of the present invention causes a computer to function as: a storage unit that stores passive permission data including a permission flag indicating whether the passive avatar allows or rejects an action from the active avatar to the passive avatar; and an output unit that outputs data for displaying, on the active terminal and the passive terminal, video data in which the passive avatar accepts the action of the active avatar when an action from the active avatar to the passive avatar is detected and the permission flag in the passive permission data indicates permission. Effect of the Invention

[0017] According to the present invention, it is possible to provide an avatar display device, an avatar display system, an avatar display method, and an avatar display program that display video data in which avatars perform actions corresponding to each other. [Brief description of the drawings]

[0018] [Figure 1] 1 is a diagram illustrating a system configuration of an avatar display system according to an embodiment of the present invention. [Diagram 2] FIG. 1 is a diagram illustrating a hardware configuration and functional blocks of an avatar display device according to an embodiment of the present invention. [Diagram 3] 11A and 11B are diagrams illustrating an example of the data structure and data of passive permission data. [Figure 4] 1 is an example of captured video data of an active avatar and a passive avatar shaking hands. [Diagram 5] 1 is an example of a captured video data of an active avatar requesting a handshake from a passive avatar. [Figure 6] 13 is a flowchart illustrating a generation process by a generation unit. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Next, an embodiment of the present invention will be described with reference to the drawings. In the following description of the drawings, the same or similar parts are denoted by the same or similar reference numerals.

[0020] (Avatar Display System) An avatar display system 5 according to an embodiment of the present invention will be described with reference to Fig. 1. The avatar display system 5 includes an avatar display device 1, an active terminal 2, and a passive terminal 3. The avatar display device 1 and the active terminal 2 can communicate with each other via a communication network. The avatar display device 1 and the passive terminal 3 can communicate with each other via a communication network. In the embodiment of the present invention, a case will be described in which the avatar display system 5 includes two user terminals, the active terminal 2 and the passive terminal 3, but the number of user terminals is not important.

[0021] The active terminal 2 and the passive terminal 3 each input, to the avatar display device, instructions for the actions of an avatar active in a virtual space. The active terminal 2 inputs instructions for the actions of an active avatar active in a virtual space. The passive terminal 3 inputs instructions for the actions of a passive avatar active in a virtual space.

[0022] Any method may be used to instruct the movement. For example, the user may input the movement instruction of the avatar to the active terminal 2 or the passive terminal 3 using an input device such as a keyboard and a mouse. There is also a method using motion capture, in which a marker is attached to the user's body and the position of the marker is tracked to identify the user's movement. The user may input the user's movement identified by motion capture to the active terminal 2 or the passive terminal 3 as the movement instruction of the avatar input by the user.

[0023] Furthermore, the active terminal 2 and the passive terminal 3 display video data on the display device according to the data received from the avatar display device 1. When the avatar display device 1 outputs video data, the active terminal 2 and the passive terminal 3 display the output video data. When the avatar display device 1 outputs data for displaying video data, the active terminal 2 and the passive terminal 3 generate video data according to the output data and display the generated video data.

[0024] The avatar display device 1 operates the avatar in a virtual space according to avatar operation instructions received from the active terminal 2 and the passive terminal 3, and displays video data of the virtual space on the active terminal 2 and the passive terminal 3.

[0025] The avatar display device 1 may display video data on the user terminal in any manner. For example, the avatar display device 1 may generate video data by capturing a virtual space with a virtual camera and distribute the video data to the user terminal. Alternatively, the avatar display device 1 may generate motion data capable of rendering the virtual space and transmit the motion data to the user terminal, and the user terminal may render the motion data to generate and display video data of the virtual space.

[0026] In an embodiment of the present invention, the avatar display device 1 not only causes an avatar to act in a virtual space in accordance with instructions from a user terminal, but also causes the avatar to perform an action different from the instructions from the user terminal, specifically, a combination of actions by multiple avatars, under specified conditions.

[0027] An action combination is achieved when an active avatar and a passive avatar perform corresponding actions. An action combination is achieved when multiple avatars take corresponding poses and perform corresponding movements in corresponding positions. Examples of action combinations include shaking hands, high-fiving, hugging, carrying someone like a princess, and doing gymnastics.

[0028] In the embodiment of the present invention, a case will be described in which an active avatar encourages a passive avatar to perform an action combination, such as when the active avatar asks the passive avatar to shake hands, and the active and passive avatars perform the action combination. Note that, although the action combination is described as being performed by two avatars, an active avatar and a passive avatar, in the embodiment of the present invention, the action combination is not limited to this. There is no restriction on the number of avatars that realize the action combination, and the action combination may be realized by three or more avatars.

[0029] To perform a combination of actions, multiple avatars need to perform appropriate actions in appropriate positions, but it can be difficult for a user who is operating the avatar while watching video data in a virtual space to input such precise motion instructions.

[0030] Therefore, the avatar display device 1 displays video data in which the active avatar and passive avatar perform a combination of actions under a predetermined condition, regardless of the action instructions for the active avatar and passive avatar input from the active terminal 2 and passive terminal 3. This allows a user to make his / her avatar perform the action corresponding to the action combination without inputting detailed action instructions, and easily realize an action combination with another user's avatar. This allows the avatar display device 1 to realize smooth communication using avatars in a virtual space.

[0031] (Avatar display device) An avatar display device 1 according to an embodiment of the present invention will be described with reference to Fig. 2. The avatar display device 1 is a general computer including a storage device 10, a processing device 20, and a communication control device 30. The general computer executes an avatar display program to realize the functions shown in Fig. 2.

[0032] The storage device 10 is a ROM (Read Only Memory), RAM (Random access memory), hard disk, SSD (Solid State Drive), etc., and stores various data such as input data, output data, and intermediate data for the processing device 20 to execute processing. The processing device 20 is a CPU (Central Processing Unit), and executes processing in the avatar display device 1 by reading and writing data stored in the storage device 10 and inputting and outputting data to and from the communication control device 30. The communication control device 30 is an interface for connecting to each of the active terminal 2 and the passive terminal 3 so that they can communicate with each other.

[0033] The storage device 10 stores an avatar display program, as well as active action data 11, passive action data 12, passive permission data 13, and motion data 14.

[0034] The active movement data 11 is data of movement instructions for an active avatar received from the active terminal 2. The active movement data 11 is updated successively in accordance with the movement instructions input from the active terminal 2.

[0035] The passive action data 12 is data of action instructions for a passive avatar received from the passive terminal 3. The passive action data 12 is updated successively in accordance with the action instructions input from the passive terminal 3.

[0036] The passive permission data 13 includes a permission flag indicating whether the passive avatar is permitted or denied a motion from the active avatar to the passive avatar. The passive permission data 13 sets in advance the intention of the user of the passive terminal 3 as to whether or not to accept the motion of the passive avatar. When an active avatar requests a passive avatar for a combination of motions, the passive permission data 13 sets whether or not the passive avatar will accept the request from the active avatar. The passive permission data 13 sets a permission flag for each motion of the active avatar. The passive permission data 13 may be set for each avatar.

[0037] The passive permission data 13 may further include a permission flag corresponding to each body part of the active avatar, which indicates whether the passive avatar permits the action from the active avatar, for each action from the active avatar in the virtual space. The body part of the active avatar is, for example, a part that constitutes the active avatar, such as a right hand, a left hand, a head, etc. For example, if the active avatar requests a touch to the passive avatar's right hand, the permission flag is set, and if the active avatar requests a touch to the passive avatar's buttocks, the refusal flag is set.

[0038] The passive permission data 13 may further include a behavior of the passive avatar when the permission flag indicates permission. The behavior of the passive avatar is a behavior of the passive avatar when the behavior of the active avatar is accepted.

[0039] Generally, the shape of an avatar in a virtual space has a high degree of freedom, and each user can select any shape. Therefore, there are cases where avatars have different sizes and shapes different from humans. Depending on the shape of an avatar, it is possible that the avatar communicates with other avatars in a way different from the way humans communicate with each other. Therefore, the action that a passive avatar performs when it receives a predetermined action from another avatar is defined as "action" in the passive permission data 13. Note that the "action" set in the passive permission data 13 is not limited to actions performed by humans, but includes any action that an avatar can perform, such as getting bigger or smaller.

[0040] The passive permission data 13 may be generated based on the settings made by the user of the passive terminal 3. The passive permission data 13 may be data of default settings previously generated by the system, or may be data in which the user of the passive terminal 3 has changed the default settings.

[0041] The passive permission data 13 is data that associates values ​​of each of the items "active action type," "passive avatar body part," "flag," and "action," as shown in FIG.

[0042] An "active action type" is a type of action combination that an active avatar requests from a passive avatar.

[0043] "Passive avatar's body part" is the body part for which the active avatar requests a combination of actions. The "active action type" and "passive avatar's body part" allow the active avatar to specify the action that the passive avatar requests. In the example shown in Figure 3, if the active action type is handshake and the passive avatar's body part is the right hand, this indicates that the active avatar is requesting a "handshake" with the passive avatar's "right hand."

[0044] The "flag" indicates whether the passive avatar will allow or deny the action of the passive avatar requested by the active avatar. The "flag" may be set to one of two values, "allow" or "deny." By setting in advance whether to allow or deny the request of the active avatar, the passive avatar will not be subjected to actions in the virtual space that the user of the passive terminal 3 dislikes.

[0045] The "flag" may be set to one of three values, including "allow", "reject", and "pending". "Pending" may include a null state where neither "allow" nor "reject" is set. "Pending" may indicate waiting for an instruction from the passive terminal 3 to "allow", "reject", or an action of the passive avatar, or may indicate a default action.

[0046] An "action" is an action of a passive avatar when an active avatar requests a specific action. In the example shown in FIG. 3, when "flag" is set to "permission," the passive avatar performs the action associated with "action." In this case, the passive permission data 13 may correspond to motion data for moving the avatar. When "flag" is set to "permission" and no setting is made for "action," a default action is performed.

[0047] In the example shown in FIG. 3, "offer a handshake with left hand" is set as the "action" when the active avatar requests a "handshake" with the "right hand" of the passive avatar. It is difficult for an avatar who is wearing a tool such as a weapon on his right hand to shake hands with the right hand, as is the case with humans. In such a case, the passive avatar will make an action of "offering a handshake with left hand", such as by extending his left hand. Even if a weapon is worn on the right hand, any action may be associated with the action, such as "removing the weapon worn on the right hand and shaking hands."

[0048] In the example shown in Figure 3, the "Action" for when the active avatar is asking for a "high-five" with the passive avatar's "right hand" reads "Change avatar size to match active avatar." If the size of the passive avatar is too big or too small compared to the size of the active avatar, it is difficult for the active and passive avatars to high-five. Therefore, when the passive avatar is asked to high-five by the active avatar, it changes its size to match the active avatar's and then performs the high-five action.

[0049] The example of the action is not limited to that shown in Fig. 3. For example, if the passive avatar does not have hands, the "action" may be set to "grow a right hand." When the active avatar asks the passive avatar for a handshake, the passive avatar's right hand grows in the video data, and the active and passive avatars shake hands with their right hands.

[0050] The "body part of the passive avatar" and the "action" may be any item.

[0051] The motion data 14 is data for rendering video data of the state of the virtual space in the active terminal 2 and the passive terminal 3. In the embodiment of the present invention, the avatar display device 1 outputs the motion data 14, but it may also output video data generated from the motion data 14.

[0052] The processing device 20 includes an acquisition unit 21, a generation unit 22, and an output unit 23.

[0053] The acquisition unit 21 acquires movement instructions of an active avatar from the active terminal 2 and stores them in the active movement data 11 , and also acquires movement instructions of a passive avatar from the passive terminal 3 and stores them in the passive movement data 12 .

[0054] The generation unit 22 generates data for displaying the video data on the active terminal 2 and the passive terminal 3. The generation unit 22 specifies the motion of the active avatar based on the active motion data 11, and specifies the motion of the passive avatar based on the passive motion data 12. The generation unit 22 generates data for displaying video data showing the active avatar and passive avatar acting in a virtual space in accordance with the specified motions of the active avatar and passive avatar.

[0055] The data for displaying the video data may be instruction data for displaying the video data. In this case, the generating unit 22 generates not only the instruction data but also the video data. The data for displaying the image data may be data for rendering the video data in the active terminal 2 and the passive terminal 3. The data for rendering is, for example, data for specifying a virtual space, data for specifying the forms and actions of an active avatar and a passive avatar, etc.

[0056] In order to display the video data on the active terminal 2 and the passive terminal 3, the output unit 23 transmits the data generated by the generation unit 22 to the active terminal 2 and the passive terminal 3. When the output unit 23 outputs the video data, the active terminal 2 and the passive terminal 3 play the video data transmitted from the output unit 23 on a display device. When the output unit 23 outputs data for rendering the video data, the active terminal 2 and the passive terminal 3 render the transmitted data, generate video data showing the active avatar and passive avatar acting in the virtual space, and play the video data on a display device.

[0057] (Generation part) When generating data for displaying video data on an active terminal 2 and a passive terminal 3, the generation unit 22 according to an embodiment of the present invention causes the video data to perform an operation different from the operations indicated by the active action data 11 and the passive action data 12 under specified conditions.

[0058] Specifically, when a movement from an active avatar to a passive avatar is detected and the permission flag in the passive permission data indicates permission, generation unit 22 generates data for displaying video data in which the passive avatar accepts the movement of the active avatar on active terminal 2 and passive terminal 3. In the embodiment of the present invention, the data for displaying the video data on active terminal 2 and passive terminal 3 is motion data 14.

[0059] First, the generation unit 22 detects, based on the situation in the virtual space, the situation of the active avatar, etc., that the active avatar is performing an action to prompt the passive avatar to perform an action combination. The action combination is one of the "actions" set in the passive permission data 13. The generation unit 22 detects that the active avatar is about to perform one of the "actions" in the passive permission data 13 for the passive avatar. There are several possible methods for detecting the action of the active avatar.

[0060] The generation unit 22 may make a judgment based on the sequence of actions taken immediately before by the active avatar. For example, if there is an action of bringing the right hand of the active avatar closer to the passive avatar, the generation unit 22 detects that the action of the active avatar is an action that prompts the action combination of shaking hands.

[0061] The generation unit 22 may make a judgment based on a conversation between an active avatar and a passive avatar. For example, if an active avatar says to a passive avatar, "Let's shake hands," the generation unit 22 detects that the active avatar's statement is an action that prompts the action combination of shaking hands.

[0062] The generation unit 22 may make the determination based on an action instruction input by a user at the active terminal 2. For example, when an action instruction is given for an active avatar to shake hands with a passive avatar, the generation unit 22 detects that the active avatar of shaking hands prompts the action combination.

[0063] The generation unit 22 may determine the emotion from the emotion expressed by the active avatar. For example, when an active avatar having a predetermined item corresponding to a "handshake", such as a hand-shaped object, approaches a passive avatar, the generation unit 22 detects that the active avatar is making a motion to prompt the passive avatar to perform a combination of handshake actions. The item is the avatar's clothing, tools, aura, etc., and is associated with the active avatar.

[0064] Here, whether or not an action prompts an action combination may be determined based on the positional relationship between the active avatar and the passive avatar, such as whether the distance between the active avatar and the passive avatar is equal to or less than a certain value, whether the active avatar and the passive avatar are facing each other, etc. Furthermore, the positional relationship between the active avatar and the passive avatar is appropriately set depending on the type of action combination.

[0065] If the passive permission data 13 has an item for "passive avatar's body part," the generation unit 22, when detecting the movement of the active avatar, may focus on the movement of the active avatar toward a specific body part of the passive avatar and detect that the active avatar is making a movement that prompts the movement of the passive avatar.

[0066] When a motion from the active avatar to a predetermined body part of the passive avatar is detected and the permission flag corresponding to the predetermined body part in the passive permission data 13 indicates permission, the generation unit 22 indicates in the video data that the passive avatar accepts the motion of the active avatar. The predetermined body part is a "body part of the passive avatar" set in the passive permission data. The generation unit 22 detects that the active avatar is about to perform one of the "motions" corresponding to the "body part of the passive avatar" in the passive permission data 13 of the passive avatar.

[0067] When detecting that the active avatar is making a motion that prompts the passive avatar to make a motion, the generation unit 22 judges whether or not the passive avatar accepts the motion of the active avatar by referring to the passive permission data 13. When the detected motion is associated with "permission" in the passive permission data 13, the generation unit 22 generates data for displaying video data in which the passive avatar accepts the motion of the active avatar.

[0068] When a motion of an active avatar attempting to "shake hands" with a passive avatar is detected, and "permission" is associated with "handshake" in the passive permission data 13, the generation unit 22 generates data displaying video data of the active and passive avatars shaking hands, as shown in Fig. 4. In the screen capture shown in Fig. 4, the active avatar A1 approaches the passive avatar A2 with its right hand outstretched, and when the distance between them becomes equal to or less than a predetermined value, in the video data, the active avatar A1 and passive avatar A2 automatically approach each other and shake hands with their fingers closed.

[0069] If the passive permission data 13 has an item for "body part of passive avatar," the generation unit 22 also takes into consideration the body part of the passive avatar that is the target of the active avatar's action, and determines whether the passive avatar will accept the action of the active avatar. For example, in the example shown in Fig. 3, if the active avatar tries to shake hands with the passive avatar's right hand, the passive avatar accepts it, but if the active avatar tries to hug the upper half of the passive avatar, the passive avatar rejects it.

[0070] Here, when a motion that inhibits an active avatar and a passive avatar from performing a motion combination is specified in the active motion data 11 or the passive motion data 12, the generating unit 22 may generate data that displays video data of an active avatar and a passive avatar shaking hands, ignoring the motion specified in the active motion data 11 or the passive motion data 12. The inhibiting motion is a motion instruction for a body part to be used when performing a motion combination.

[0071] For example, when an active avatar and a passive avatar shake hands with their right hands, if the passive motion data 12 specifies that the passive avatar waves its right hand, the generation unit 22 may cause the passive avatar to shake hands with the active avatar in the video data, rather than waving its hand. On the other hand, when an active avatar and a passive avatar shake hands with their right hands, if the passive motion data 12 specifies that the passive avatar waves its left hand, the generation unit 22 may cause the passive avatar to shake hands with the active avatar in the video data.

[0072] When an "action" is associated in the passive permission data 13 and the passive avatar accepts the action of the active avatar, in the video data, the passive avatar performs the action associated in the passive permission data in response to the action of the active avatar. For example, in the example shown in FIG. 3, when the active avatar asks the passive avatar for a handshake, in the video data, the passive avatar "suggests a handshake with left hand." Specifically, in response to the active avatar holding out his right hand, the passive avatar holds out his left hand and shakes it up and down to encourage the handshake with the left hand. In addition, when the active avatar asks the passive avatar for a high-five, in the video data, the passive avatar "changes its avatar size to match that of the active avatar" and high-five the active avatar.

[0073] If an action from an active avatar to a passive avatar is detected and the permission flag for that action is not set in the passive permission data 13, the video data may indicate that the active avatar is performing the action on the passive avatar. For example, if the flag in the passive permission data 13 is set to "rejected" or "pending," the video data indicates that the active avatar is attempting to perform an action combination with the passive avatar.

[0074] For example, as shown in the screen capture of FIG. 5, a message display section V1 is provided in the video data. By displaying the message "Let's shake hands!" in the message display section V1, the user of the passive terminal 3 is informed through the video data that the active avatar A1 is encouraging the passive avatar A2 to shake hands. As another method, an emphasis display section V2a that emphasizes the right hand of the active avatar A1 and an emphasis display section V2b that emphasizes the right hand of the passive avatar A2 may be provided in the video data, so that the user of the passive terminal 3 is informed through the video data that the active avatar A1 is about to shake hands. Only one of the active avatar A1 and the passive avatar A2 may be highlighted.

[0075] The user of the passive terminal 3 sees the message or highlighting and knows that the active avatar A1 wants to shake hands with the passive avatar A2, and inputs an instruction to allow or deny the request. If allowed, the active avatar A1 and the passive avatar A2 shake hands in the video data.

[0076] When a motion from an active avatar to a passive avatar is detected and the permission flag for that motion in the passive permission data 13 indicates denial, the passive avatar indicates in the video data that it does not accept the motion of the active avatar, allowing the user of the active terminal 2 to recognize that the motion has been rejected by the passive avatar.

[0077] For example, when "reject" is set in the passive permission data 13, the active and passive avatars behave as if they are not involved, such as when the passive avatar slips through the active avatar in the video data. Specifically, when the active avatar requests a handshake from the passive avatar and the passive avatar refuses, the video data shows the active and passive avatars simply overlapping, such as when the passive avatar slips through the active avatar's outstretched right hand. Alternatively, the video data may show the active and passive avatars moving backwards from each other, as if they are repelling each other. Also, a message display section saying "I refuse the handshake" may be displayed in the video data.

[0078] The generation process by the generation unit 22 will be described with reference to Fig. 6. In Fig. 6, the avatar display device 1 generates motion data 14 capable of rendering a virtual space, and the active terminal 2 and the passive terminal 3 generate video data from the motion data.

[0079] First, the generation unit 22 waits for detection of a motion of an active avatar set in the passive permission data 13. If a body part of a passive avatar is set in the passive permission data 13, the generation unit 22 also detects that the motion of the active avatar is a motion for the body part of the passive avatar.

[0080] If not detected, the generator 22 generates the motion data 14 according to the active motion data 11 and the passive motion data 12 in step S4.

[0081] If detected, in step S2, the generation unit 22 refers to a flag associated with the operation in the passive permission data 13. If the flag indicates permission, the process proceeds to step S3, and if the flag indicates denial, the process proceeds to step S7.

[0082] If the flag is "permitted", in step S3 the generation unit 22 determines whether or not an action is set in the passive permission data 13. If no action is set, in step S5 the generation unit 22 changes the active action data 11 and the passive action data 12 to generate motion data 14 in which the active avatar and passive avatar perform a combination of actions. With this motion data 14, video data in which the active avatar and passive avatar perform a combination of actions is played on the active terminal 2 and the passive terminal 3, regardless of the active action data 11 and the passive action data 12.

[0083] If an action is set, in step S5, the generation unit 22 modifies the passive action data 12 to generate motion data 14 in which the passive avatar performs the action set in the passive permission data 13. Regardless of the passive action data 12, this motion data 14 causes video data in which the passive avatar performs the set action to be played on the active terminal 2 and the passive terminal 3. The active avatar may perform an action according to the active action data 11, may perform a predetermined action, or may pause and stop.

[0084] If the flag is set to reject, in step S7 the generator 22 modifies the passive movement data 12 to generate motion data 14 in which the passive avatar does not accept the movement. In the motion data 14, a message or highlighting may be displayed to indicate that the active avatar is requesting a movement combination.

[0085] When any one of the processes in steps S4 to S7 is completed, the generation unit 22 returns to step S1.

[0086] According to the avatar display system 5 according to the embodiment of the present invention, when an active avatar requests an action combination from a passive avatar and the passive avatar accepts the request, video data is displayed in which the active avatar and passive avatar perform corresponding actions, regardless of the action instructions input from the active terminal 2 and the passive terminal 3. This makes it possible to easily realize an action combination in the virtual space without inputting detailed action instructions for performing the action combination in the active terminal 2 and the passive terminal 3. Users who communicate in the virtual space can easily interact with other avatars, regardless of their avatar operation skills.

[0087] In the embodiment of the present invention, a case will be described in which motion instructions to an active avatar and a passive avatar active in a virtual space are input in real time, but the present invention is not limited to this. For example, the active avatar acts according to motion instructions input in real time, and the passive avatar acts according to motion instructions input in advance; the timing of input of motion instructions does not matter. For example, in video data of a handshake event for an idol (passive avatar) active in a virtual space, if the active avatar approaches the idol and asks for a handshake, and the handshake is permitted in the passive permission data 13, the active avatar and the idol shaking hands will be shown.

[0088] In the embodiment of the present invention, the passive permission data 13 shown in the figure is generated for each passive avatar, but this is not limited to the above. For example, a passive avatar that does not have the passive permission data 13 may be controlled to reject all action combinations with active avatars. The avatar display device 1 may also hold data for setting whether or not to accept an action combination for each passive avatar. By easily identifying passive avatars that do not accept action combinations, the processing cost of the generation unit 22 can be reduced.

[0089] In the passive permission data 13 shown in FIG. 3, a flag is set for each active action type and each body part of a passive avatar, but this is not limiting. For example, a flag may be set for each active avatar. The passive permission data 13 may include specific information of active avatars that accept action combinations, or specific information of active avatars that do not accept action combinations. This specific information of an active avatar only needs to be able to identify an active avatar, and may be an identifier of an individual avatar, or may be an attribute of an active avatar, such as an occupation or intimacy level. In addition to the active action type and the body part of a passive avatar, a flag may be set for each specific information of an active avatar in the passive permission data 13.

[0090] Furthermore, in the passive permission data 13, a flag may be set for each environment of the virtual space, such as attributes of areas that divide the virtual space, time, weather, etc. For example, a flag may be set so that in an idol town, a passive avatar whose occupation is idol accepts approaches from all active avatars, while in areas other than the idol town, the passive avatar does not accept any approaches from active avatars.

[0091] Furthermore, when the flag is set to reject, the passive permission data 13 may be associated with a condition under which the passive avatar accepts the action combination by the active avatar. The condition may be, for example, that the intimacy level is equal to or higher than a predetermined level, that the avatar has a predetermined item, that the avatar is an avatar of a paying user, etc. The condition is notified so that the user of the active avatar can recognize it. For example, the condition may be notified in the video data displayed on the active terminal 2, or may be notified to the active terminal 2 by a direct message.

[0092] In this way, by predefining the conditions under which a passive avatar accepts an approach from an active avatar in the passive permission data 13, the avatar display device 1 can realize communication in the virtual space that reflects the intentions of the passive avatar.

[0093] (Other embodiments) As described above, the present invention has been described by way of the embodiment, but the description and drawings forming part of this disclosure should not be understood as limiting the present invention. From this disclosure, various alternative embodiments, examples and operating techniques will become apparent to those skilled in the art.

[0094] For example, the avatar display device described in the embodiment of the present invention may be configured on one piece of hardware as shown in Fig. 2, or may be configured on multiple pieces of hardware depending on the functions and number of processes. Also, it may be realized on an existing processing device together with other functions.

[0095] Of course, the present invention includes various embodiments not described herein. Therefore, the technical scope of the present invention is defined only by the invention-specifying matters related to the claims that are appropriate from the above description. [Explanation of symbols]

[0096] 1 Avatar display device 2 Active Terminals 3 Passive Terminals 5. Avatar Display System 10 Storage device 11 Active movement data 12 Passive motion data 13 Passive Permissions Data 14 Motion Data 20 Processing equipment 21 Acquisition Department 22 Generation part 23 Output section 30 Communication control device

Claims

1. An avatar display device connected to an active terminal for inputting movement instructions of an active avatar active in a virtual space and a passive terminal for inputting movement instructions of a passive avatar active in the virtual space, and displaying video data of the virtual space on the active terminal and the passive terminal, a storage device for storing passive permission data including a permission flag indicating permission or denial of a passive avatar to an action from the active avatar to the passive avatar; an output unit that outputs, when the action from the active avatar to the passive avatar is detected and the permission flag in the passive permission data indicates permission, data for displaying video data in which the passive avatar accepts the action of the active avatar on the active terminal and the passive terminal; An avatar display device comprising:

2. The action is an action in which the active avatar prompts the passive avatar to perform an action combination that is established by the active avatar and the passive avatar performing corresponding actions. The avatar display device according to claim 1 .

3. the passive permission data further includes an action of the passive avatar when the permission flag indicates permission; In the video data, the passive avatar performs an action corresponding to the passive permission data in response to an action of the active avatar.

3. The avatar display device according to claim 1 or 2.

4. When the action from the active avatar to the passive avatar is detected and a permission flag for the action is not set in the passive permission data, a permission flag is set in the video data indicating that the active avatar is performing the action on the passive avatar.

4. The avatar display device according to claim 1, wherein the display device is a display device that displays an avatar.

5. When the action from the active avatar to the passive avatar is detected and the permission flag for the action in the passive permission data indicates denial, the passive avatar indicates in the video data that it does not accept the action of the active avatar.

5. The avatar display device according to claim 1, wherein the display device is a display device for displaying an avatar.

6. the passive permission data associates, with respect to an action from the active avatar to the passive avatar in the virtual space, a permission flag indicating whether the passive avatar permits the action from the active avatar for each body part of the active avatar; When the motion from the active avatar to a predetermined part of the passive avatar is detected and the permission flag corresponding to the predetermined part in the passive permission data indicates permission, the video data indicates that the passive avatar accepts the motion of the active avatar.

6. The avatar display device according to claim 1, wherein the display device is a display device that displays an avatar.

7. An avatar display system comprising: an active terminal for inputting movement instructions of an active avatar active in a virtual space; a passive terminal for inputting movement instructions of a passive avatar active in the virtual space; and an avatar display device connected to the active terminal and the passive terminal and displaying video data of the virtual space on the active terminal and the passive terminal, The avatar display device includes: a storage device for storing passive permission data including a permission flag indicating permission or denial of a passive avatar to an action from the active avatar to the passive avatar; an output unit configured to output, when the action from the active avatar to the passive avatar is detected and the permission flag in the passive permission data indicates permission, data for displaying video data in which the passive avatar accepts the action of the active avatar on the active terminal and the passive terminal; The active terminal and the passive terminal display the video data. The avatar display system is characterized by:

8. 1. An avatar display method for an avatar display device that is connected to an active terminal that inputs movement instructions of an active avatar that operates in a virtual space and a passive terminal that inputs movement instructions of a passive avatar that operates in the virtual space, and displays video data of the virtual space on the active terminal and the passive terminal, comprising: storing, in a storage device, passive permission data including a permission flag indicating permission or denial of the passive avatar to an action from the active avatar to the passive avatar; a step of outputting data for displaying, on the active terminal and the passive terminal, video data in which the passive avatar accepts the action of the active avatar, when the action from the active avatar to the passive avatar is detected and the permission flag in the passive permission data indicates permission; 23. An avatar display method comprising:

9. An avatar display program for use in an avatar display device that is connected to an active terminal that inputs movement instructions of an active avatar that operates in a virtual space and a passive terminal that inputs movement instructions of a passive avatar that operates in the virtual space, and that displays video data of the virtual space on the active terminal and the passive terminal, comprising: Computer, a storage unit for storing passive permission data including a permission flag indicating permission or denial of a passive avatar to an action from the active avatar to the passive avatar; an output unit that outputs, when the action from the active avatar to the passive avatar is detected and the permission flag in the passive permission data indicates permission, data for displaying video data in which the passive avatar accepts the action of the active avatar on the active terminal and the passive terminal; and a display program for displaying an avatar, the display program causing the avatar to function as an avatar display device.

Images