Avatar display device, avatar display system, avatar display method, and avatar display program

Abstract

To display moving image data in which avatars take actions corresponding to each other.SOLUTION: An avatar display device 1 is provided with: a storage device 10 for storing passive permission data 13 including a permission flag indicating permission or denial of a passive avatar in relation to an action of an active avatar on the passive avatar; and an output unit 23 which, if the action of the active avatar on the passive avatar is detected and the permission flag in the passive permission data 13 indicates permission, outputs data for displaying, on an active terminal 2 and a passive terminal 3, moving image data in which the passive avatar accepts the action of the active avatar.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an avatar display device, an avatar display system, an avatar display method, and an avatar display program that display video data in a virtual space on an active terminal and a passive terminal. [Background technology]

[0002] One method of communication between users using communication terminals is to have avatars, which are the users' alter egos, move in a virtual space. Avatars move in the virtual space according to the operations input by the users. Also, by having the avatars of multiple users perform corresponding actions in the virtual space, it is possible to perform a combination of actions by multiple avatars, such as shaking hands.

[0003] There is also an avatar display device that displays an avatar using a predetermined animation when the avatar satisfies a predetermined condition (Patent Document 1). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2001-160154 Summary of the Invention [Problem to be solved by the invention]

[0005] By appropriately controlling the movements of each user's avatar, the users can perform corresponding actions, enabling them to realize action combinations such as shaking hands. However, to achieve action combinations, each user must grasp the position and state of the other user's avatar while adjusting the position and state of their own avatar to perform the corresponding action, which can make it difficult for each user to control their respective avatars to perform the corresponding action.

[0006] Patent Document 1 only describes how avatars are expressed using predetermined animations based on the distance from other avatars, and does not disclose any combination of actions by multiple avatars.

[0007] SUMMARY OF THE INVENTION It is therefore an object of the present invention to provide an avatar display device, an avatar display system, an avatar display method, and an avatar display program that display video data in which avatars perform actions corresponding to each other. [Means for solving the problem]

[0008] To solve the above problems, a first feature of the present invention relates to an avatar display device that is connected to an active terminal that inputs movement instructions for an active avatar that operates in a virtual space and a passive terminal that inputs movement instructions for a passive avatar that operates in the virtual space, and that displays video data of the virtual space on the active terminal and the passive terminal. The avatar display device according to the first feature of the present invention includes a storage device that stores passive permission data including a permission flag that indicates whether the passive avatar accepts or rejects a movement from the active avatar to the passive avatar, and an output unit that, when a movement from the active avatar to the passive avatar is detected and the permission flag in the passive permission data indicates permission, outputs data for displaying video data in which the passive avatar accepts the movement of the active avatar on the active terminal and the passive terminal.

[0009] The action may be an action in which an active avatar prompts an action of a passive avatar, so that an action combination is established when the active avatar and the passive avatar perform corresponding actions.

[0010] The passive permission data may further include a motion of the passive avatar when the permission flag indicates permission, and in the video data, the passive avatar may perform a motion associated with the passive permission data in response to a motion of the active avatar.

[0011] When an action from an active avatar to a passive avatar is detected and the permission flag for the action is not set in the passive permission data, the video data may indicate that the active avatar is performing the action on the passive avatar.

[0012] When a motion from an active avatar to a passive avatar is detected and the permission flag for the motion in the passive permission data indicates denial, the video data may indicate that the passive avatar does not accept the motion of the active avatar.

[0013] The passive permission data may associate a permission flag indicating whether the passive avatar allows the action from the active avatar to the passive avatar for each part of the active avatar in the virtual space, and when an action from the active avatar to a specific part of the passive avatar is detected and the permission flag corresponding to the specific part in the passive permission data indicates permission, the video data may indicate that the passive avatar accepts the action from the active avatar.

[0014] A second aspect of the present invention relates to an avatar display system comprising: an active terminal that inputs movement instructions for an active avatar that operates in a virtual space; a passive terminal that inputs movement instructions for a passive avatar that operates in the virtual space; and an avatar display device connected to the active and passive terminals and displaying video data of the virtual space on the active and passive terminals. In the avatar display system according to the second aspect of the present invention, the avatar display device comprises: a storage device that stores passive permission data including a permission flag indicating whether the passive avatar accepts or rejects a movement from the active avatar to the passive avatar; and an output unit that outputs data for displaying video data in which the passive avatar accepts the movement of the active avatar on the active and passive terminals when a movement from the active avatar to the passive avatar is detected and the permission flag in the passive permission data indicates permission, and the active and passive terminals display the video data.

[0015] A third aspect of the present invention relates to an avatar display method used in an avatar display device connected to an active terminal that inputs movement instructions for an active avatar active in a virtual space and a passive terminal that inputs movement instructions for a passive avatar active in the virtual space, and that displays video data of the virtual space on the active terminal and the passive terminal. The avatar display method according to the third aspect of the present invention includes the steps of: a computer storing passive permission data in a storage device, the passive permission data including a permission flag indicating whether the passive avatar accepts or rejects a movement from the active avatar to the passive avatar; and, when a movement from the active avatar to the passive avatar is detected and the permission flag in the passive permission data indicates permission, the computer outputting data for displaying video data in which the passive avatar accepts the movement of the active avatar on the active terminal and the passive terminal.

[0016] A fourth aspect of the present invention relates to an avatar display program used in an avatar display device connected to an active terminal that inputs movement instructions for an active avatar active in a virtual space and a passive terminal that inputs movement instructions for a passive avatar active in the virtual space, and that displays video data of the virtual space on the active terminal and the passive terminal. The avatar display program according to the fourth aspect of the present invention causes a computer to function as: a storage unit that stores passive permission data including a permission flag that indicates whether the passive avatar accepts or rejects a movement from the active avatar to the passive avatar; and an output unit that, when a movement from the active avatar to the passive avatar is detected and the permission flag in the passive permission data indicates permission, outputs data for displaying video data in which the passive avatar accepts the movement of the active avatar on the active terminal and the passive terminal. [Effects of the Invention]

[0017] According to the present invention, it is possible to provide an avatar display device, an avatar display system, an avatar display method, and an avatar display program that display video data in which avatars perform actions corresponding to each other. [Brief explanation of the drawings]

[0018] [Figure 1] 1 is a diagram illustrating a system configuration of an avatar display system according to an embodiment of the present invention. [Figure 2] 1 is a diagram illustrating a hardware configuration and functional blocks of an avatar display device according to an embodiment of the present invention. [Figure 3] 10A and 10B are diagrams illustrating an example of the data structure and data of passive permission data. [Figure 4] 1 is an example of a captured video data showing an active avatar and a passive avatar shaking hands. [Figure 5] This is an example of a captured video data in which an active avatar requests a handshake from a passive avatar. [Figure 6] 10 is a flowchart illustrating a generation process performed by a generation unit. DETAILED DESCRIPTION OF THE INVENTION

[0019] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Next, an embodiment of the present invention will be described with reference to the drawings. In the following description of the drawings, the same or similar parts are designated by the same or similar reference numerals.

[0020] (Avatar display system) An avatar display system 5 according to an embodiment of the present invention will be described with reference to Figure 1. The avatar display system 5 includes an avatar display device 1, an active terminal 2, and a passive terminal 3. The avatar display device 1 and the active terminal 2 can communicate with each other via a communication network. The avatar display device 1 and the passive terminal 3 can communicate with each other via a communication network. In the embodiment of the present invention, the avatar display system 5 includes two user terminals, the active terminal 2 and the passive terminal 3, but the number of user terminals is not limited.

[0021] The active terminal 2 and the passive terminal 3 each input instructions for the movements of an avatar active in a virtual space to the avatar display device. The active terminal 2 inputs instructions for the movements of an active avatar active in a virtual space. The passive terminal 3 inputs instructions for the movements of a passive avatar active in a virtual space.

[0022] Any method may be used to instruct a movement. For example, a user may input an instruction for an avatar's movement into the active terminal 2 or the passive terminal 3 using an input device such as a keyboard and a mouse. Another method is to use motion capture, in which markers are attached to the user's body and the positions of the markers are tracked to identify the user's movements. The user may input the user's movements identified by motion capture into the active terminal 2 or the passive terminal 3 as an instruction for an avatar's movement input by the user.

[0023] Additionally, the active terminal 2 and the passive terminal 3 display video data on their display devices according to the data received from the avatar display device 1. When the avatar display device 1 outputs video data, the active terminal 2 and the passive terminal 3 display the output video data. When the avatar display device 1 outputs data for displaying video data, the active terminal 2 and the passive terminal 3 generate video data according to the output data and display the generated video data.

[0024] The avatar display device 1 operates the avatar in the virtual space according to the avatar operation instructions received from the active terminal 2 and the passive terminal 3, and displays video data of the virtual space on the active terminal 2 and the passive terminal 3.

[0025] The avatar display device 1 may display video data on the user terminal in any manner. For example, the avatar display device 1 may generate video data by capturing a virtual space with a virtual camera and distribute it to the user terminal. Alternatively, the avatar display device 1 may generate motion data capable of rendering the virtual space and transmit it to the user terminal, and the user terminal may then render the motion data to generate and display video data of the virtual space.

[0026] In an embodiment of the present invention, the avatar display device 1 not only causes avatars to act in a virtual space in accordance with instructions from a user terminal, but also causes the avatars to perform actions, specifically, combinations of actions by multiple avatars, different from the instructions from the user terminal under specified conditions.

[0027] An action combination is formed when an active avatar and a passive avatar perform corresponding actions. An action combination is formed when multiple avatars take corresponding poses and perform corresponding movements in corresponding positions. Examples of action combinations include handshakes, high-fives, hugs, princess carries, and group gymnastics.

[0028] In the embodiment of the present invention, a case will be described in which an active avatar encourages a passive avatar to perform an action combination, such as when the active avatar asks the passive avatar to shake hands, and the active and passive avatars perform the action combination. Note that in the embodiment of the present invention, an action combination using two avatars, an active avatar and a passive avatar, will be described, but this is not limiting. There is no restriction on the number of avatars that can realize the action combination, and the action combination may be realized by three or more avatars.

[0029] To combine actions, multiple avatars must each perform the appropriate action in the appropriate position. However, it can be difficult for a user who operates the avatar while viewing video data in a virtual space to input such precise motion instructions.

[0030] Therefore, the avatar display device 1 displays video data in which the active avatar and passive avatar perform a combination of actions under predetermined conditions, regardless of the action instructions for the active avatar and passive avatar input from the active terminal 2 and passive terminal 3. This allows the user to make their own avatar perform the action corresponding to the action combination without inputting detailed action instructions, and easily realize an action combination with another user's avatar. This allows the avatar display device 1 to realize smooth communication using avatars in a virtual space.

[0031] (Avatar display device) An avatar display device 1 according to an embodiment of the present invention will be described with reference to Fig. 2. The avatar display device 1 is a general computer including a storage device 10, a processing device 20, and a communication control device 30. The general computer executes an avatar display program to realize the functions shown in Fig. 2.

[0032] The storage device 10 is a ROM (Read Only Memory), RAM (Random Access Memory), hard disk, SSD (Solid State Drive), etc., and stores various data such as input data, output data, and intermediate data for the processing device 20 to execute processing. The processing device 20 is a CPU (Central Processing Unit), and executes processing in the avatar display device 1 by reading and writing data stored in the storage device 10 and inputting and outputting data to and from the communication control device 30. The communication control device 30 is an interface for connecting to each of the active terminal 2 and the passive terminal 3 so that they can communicate with each other.

[0033] The storage device 10 stores an avatar display program, as well as active action data 11, passive action data 12, passive permission data 13, and motion data 14.

[0034] The active action data 11 is data of action instructions for an active avatar received from the active terminal 2. The active action data 11 is updated successively according to the action instructions input from the active terminal 2.

[0035] The passive action data 12 is data of action instructions for a passive avatar received from the passive terminal 3. The passive action data 12 is updated successively according to the action instructions input from the passive terminal 3.

[0036] The passive permission data 13 includes a permission flag indicating whether the passive avatar will allow or reject an action from the active avatar to the passive avatar. The passive permission data 13 presets the intention of the user of the passive terminal 3, whether to accept the action of the passive avatar. When an active avatar requests an action combination from a passive avatar, the passive permission data 13 sets whether the passive avatar will accept the request from the active avatar. The passive permission data 13 sets a permission flag for each action of the active avatar. The passive permission data 13 may be set for each avatar.

[0037] The passive permission data 13 may further include a permission flag associated with each body part of the active avatar, indicating whether the passive avatar is permitted to perform an action from the active avatar to the passive avatar in the virtual space. The active avatar's body part may be a part that constitutes the active avatar, such as the right hand, left hand, or head. For example, if the active avatar requests a touch to the passive avatar's right hand, the permission flag is set, and if the active avatar requests a touch to the passive avatar's buttocks, the denial flag is set.

[0038] The passive permission data 13 may further include a behavior of the passive avatar when the permission flag indicates permission. The behavior of the passive avatar is a behavior of the passive avatar when the behavior of the active avatar is accepted.

[0039] Generally, there is a high degree of freedom in the shape of avatars in virtual space, and each user can select any shape. Therefore, avatars may vary in size, or avatars may have shapes that differ from those of humans. Depending on the shape of an avatar, it is possible that an avatar may communicate with other avatars in a way that differs from the way humans communicate with each other. Therefore, the action that a passive avatar will perform when receiving a predetermined action from another avatar is defined as "action" in the passive permission data 13. Note that the "action" set in the passive permission data 13 is not limited to actions performed by humans, but also includes any action that an avatar can perform, such as growing larger or smaller.

[0040] The passive permission data 13 may be generated based on settings made by the user of the passive terminal 3. The passive permission data 13 may also be default setting data generated in advance by the system, or may be data obtained by changing the default setting by the user of the passive terminal 3.

[0041] The passive permission data 13 is data that associates values ​​of the items "active action type," "passive avatar body part," "flag," and "action," as shown in FIG. 3, for example.

[0042] The "active action type" is the type of action combination that an active avatar requests a passive avatar to perform.

[0043] The "passive avatar's body part" is the body part for which the active avatar requests a combination of actions. The "active action type" and "passive avatar's body part" allow the active avatar to specify the action that the passive avatar requests. In the example shown in Figure 3, if the active action type is handshake and the passive avatar's body part is the right hand, this indicates that the active avatar is requesting a "handshake" with the passive avatar's "right hand."

[0044] The "flag" indicates whether the passive avatar will allow or deny the passive avatar's action requested by the active avatar. The "flag" may be set to one of two values, "allow" or "deny." By setting in advance whether to allow or deny the request of the active avatar, the passive avatar will not perform actions in the virtual space that the user of the passive terminal 3 dislikes.

[0045] The "flag" may be set to one of three values, including "allow", "reject", and "pending". "Pending" may include a null state where neither "allow" nor "reject" is set. "Pending" may indicate that the passive terminal 3 is waiting for an instruction to "allow", "reject", or an action of the passive avatar, or may perform a default action.

[0046] "Action" is the action of a passive avatar when an active avatar requests a specific action. In the example shown in FIG. 3, if "flag" is set to "permission," the passive avatar performs the action associated with "action." In this case, the passive permission data 13 may be associated with motion data for moving the avatar. If "flag" is set to "permission" and no setting is made for "action," a default action is performed.

[0047] In the example shown in FIG. 3, when an active avatar requests a handshake with the passive avatar's right hand, the action is set to "offer a handshake with left hand." For an avatar carrying a weapon or other tool in its right hand, it is difficult to shake hands with the right hand, as is the case with humans. In such a case, the passive avatar performs an action to "offer a handshake with left hand," such as extending its left hand. Even when a weapon is worn on the right hand, any action may be associated, such as "removing the weapon worn on the right hand and shaking hands."

[0048] In the example shown in Figure 3, the "Action" for when the active avatar requests a "high-five" with the passive avatar's "right hand" is "Change avatar size to match the active avatar." If the passive avatar's size is too large or too small compared to the active avatar, it will be difficult for the two avatars to high-five. Therefore, when the passive avatar is asked to high-five by the active avatar, it will change its size to match the active avatar's, and then perform the high-five action.

[0049] Examples of actions are not limited to those shown in Fig. 3. For example, if the passive avatar does not have hands, the "action" may be set to "grow a right hand." When the active avatar asks the passive avatar for a handshake, the passive avatar's right hand grows in the video data, and the active and passive avatars shake hands with their right hands.

[0050] The "part of the passive avatar" and "action" may be any items.

[0051] The motion data 14 is data for rendering video data of the state of the virtual space in the active terminal 2 and the passive terminal 3. In the embodiment of the present invention, the avatar display device 1 outputs the motion data 14, but it may also output video data generated from the motion data 14.

[0052] The processing device 20 includes an acquisition unit 21, a generation unit 22, and an output unit 23.

[0053] The acquisition unit 21 acquires movement instructions of an active avatar from the active terminal 2 and stores them in the active movement data 11 , and also acquires movement instructions of a passive avatar from the passive terminal 3 and stores them in the passive movement data 12 .

[0054] The generation unit 22 generates data for displaying the video data on the active terminal 2 and the passive terminal 3. The generation unit 22 identifies the action of the active avatar based on the active action data 11, and identifies the action of the passive avatar based on the passive action data 12. The generation unit 22 generates data for displaying video data showing the active avatar and passive avatar acting in a virtual space in accordance with the identified actions of the active avatar and passive avatar.

[0055] The data for displaying the video data may be instruction data for displaying the video data. In this case, the generation unit 22 generates not only the instruction data but also the video data. The data for displaying the video data may also be data for rendering the video data on the active terminal 2 and the passive terminal 3. The data for rendering may be, for example, data for specifying the virtual space, data for specifying the forms and actions of the active avatar and passive avatar, etc.

[0056] The output unit 23 transmits the data generated by the generation unit 22 to the active terminal 2 and the passive terminal 3 in order to display the video data on the active terminal 2 and the passive terminal 3. When the output unit 23 outputs the video data, the active terminal 2 and the passive terminal 3 play the video data transmitted from the output unit 23 on a display device. When the output unit 23 outputs data for rendering the video data, the active terminal 2 and the passive terminal 3 render the transmitted data to generate video data showing the active avatar and passive avatar acting in the virtual space, and play the video data on a display device.

[0057] (Generation part) When generating data for displaying video data on an active terminal 2 and a passive terminal 3, the generation unit 22 according to an embodiment of the present invention causes the video data to perform an action different from the action indicated by the active action data 11 and the passive action data 12 under specified conditions.

[0058] Specifically, when a movement from the active avatar to the passive avatar is detected and the permission flag in the passive permission data indicates permission, generation unit 22 generates data for displaying video data in which the passive avatar accepts the movement of the active avatar on active terminal 2 and passive terminal 3. In the embodiment of the present invention, the data for displaying the video data on active terminal 2 and passive terminal 3 is motion data 14.

[0059] First, the generation unit 22 detects, based on the situation in the virtual space, the situation of the active avatar, etc., that the active avatar is performing an action that prompts the passive avatar to perform an action combination. The action combination is one of the "actions" set in the passive permission data 13. The generation unit 22 detects that the active avatar is about to perform one of the "actions" in the passive permission data 13 with respect to the passive avatar. There are several possible methods for detecting the action of the active avatar.

[0060] The generation unit 22 may make a judgment based on the sequence of the active avatar's previous actions. For example, if the active avatar moves its right hand closer to the passive avatar, the generation unit 22 detects that the active avatar's action is an action that prompts a handshake action combination.

[0061] The generation unit 22 may make a judgment based on a conversation between an active avatar and a passive avatar. For example, if an active avatar says to a passive avatar, "Let's shake hands," the generation unit 22 detects that the active avatar's statement is an action that encourages the action combination of shaking hands.

[0062] The generation unit 22 may make a determination based on an action instruction input by the user at the active terminal 2. For example, if an active avatar is instructed to shake hands with a passive avatar, the generation unit 22 detects that the active avatar is instructed to shake hands to encourage the action combination.

[0063] The generation unit 22 may determine the emotion from the emotion expressed by the active avatar. For example, when an active avatar carrying a predetermined item corresponding to a "handshake," such as a hand-shaped object, approaches a passive avatar, the generation unit 22 detects that the active avatar's action is a gesture that prompts the passive avatar to perform the handshake action combination. The item is an avatar's clothing, tool, aura, etc., and is associated with the active avatar.

[0064] Here, whether or not an action prompts an action combination may be determined based on the positional relationship between the active and passive avatars, such as whether the distance between the active and passive avatars is equal to or less than a certain value, whether the active and passive avatars are facing each other, etc. The positional relationship between the active and passive avatars is set appropriately depending on the type of action combination.

[0065] If the passive permission data 13 has an item for "part of passive avatar," when detecting the movement of the active avatar, the generation unit 22 may focus on the movement of the active avatar toward a specific part of the passive avatar and detect that the active avatar is making a movement that encourages the movement of the passive avatar.

[0066] When an action from the active avatar to a predetermined part of the passive avatar is detected and the permission flag corresponding to the predetermined part in the passive permission data 13 indicates permission, the generation unit 22 indicates in the video data that the passive avatar accepts the action of the active avatar. The predetermined part is a "part of the passive avatar" set in the passive permission data. The generation unit 22 detects that the active avatar is about to perform one of the "actions" corresponding to the "part of the passive avatar" of the passive avatar in the passive permission data 13.

[0067] When detecting that the active avatar is making a motion that prompts the passive avatar to make a motion, the generation unit 22 determines whether or not the passive avatar accepts the motion of the active avatar by referring to the passive permission data 13. If the detected motion is associated with "permission" in the passive permission data 13, the generation unit 22 generates data for displaying video data in which the passive avatar accepts the motion of the active avatar.

[0068] When a motion of the active avatar attempting to "shake hands" with the passive avatar is detected, and "permission" is associated with "handshake" in the passive permission data 13, the generation unit 22 generates data displaying video data of the active and passive avatars shaking hands, as shown in Fig. 4. In the screen capture shown in Fig. 4, the active avatar A1 approaches the passive avatar A2 with its right hand outstretched, and when the distance between them becomes equal to or less than a predetermined value, the active avatar A1 and passive avatar A2 automatically approach each other and close their fingers to shake hands in the video data.

[0069] If the passive permission data 13 has an item for "body part of passive avatar," the generation unit 22 determines whether the passive avatar will accept the action of the active avatar, taking into consideration the body part of the passive avatar that is the target of the action of the active avatar. For example, in the example shown in Fig. 3, if the active avatar tries to shake the passive avatar's right hand, the passive avatar will accept it, but if the active avatar tries to hug the upper half of the passive avatar, the passive avatar will reject it.

[0070] Here, if the active motion data 11 or the passive motion data 12 indicates a motion that inhibits the active avatar and the passive avatar from performing a motion combination, the generation unit 22 may generate data that displays video data of the active avatar and the passive avatar shaking hands, ignoring the motion indicated in the active motion data 11 or the passive motion data 12. The inhibiting motion is a motion instruction for a body part to be used when performing a motion combination.

[0071] For example, if the passive action data 12 specifies that the passive avatar shakes hands with its right hand when the active avatar and the passive avatar shake hands with their right hands, the generation unit 22 may cause the passive avatar to shake hands with the active avatar instead of waving its hand in the video data. On the other hand, if the passive action data 12 specifies that the passive avatar shakes hands with its left hand when the active avatar and the passive avatar shake hands with their right hands, the generation unit 22 may cause the passive avatar to wave its left hand and shake hands with the active avatar in the video data.

[0072] When an "action" is associated in the passive permission data 13 and the passive avatar accepts the action of the active avatar, the passive avatar performs the action associated in the passive permission data in response to the action of the active avatar in the video data. For example, in the example shown in FIG. 3, when the active avatar asks the passive avatar for a handshake, the passive avatar "offers a handshake with his left hand" in the video data. Specifically, when the active avatar extends his right hand, the passive avatar extends his left hand and waves it up and down to encourage a handshake with his left hand. When the active avatar asks the passive avatar for a high-five, the passive avatar "changes its avatar size to match that of the active avatar" in the video data and high-five the active avatar.

[0073] When an action from an active avatar to a passive avatar is detected and the permission flag for that action is not set in the passive permission data 13, the video data may indicate that the active avatar is performing the action on the passive avatar. For example, when the flag in the passive permission data 13 is set to "rejected" or "pending," the video data indicates that the active avatar is encouraging the passive avatar to perform an action combination.

[0074] For example, as shown in the screen capture in FIG. 5, a message display section V1 is provided in the video data. By displaying the message "Let's shake hands!" in the message display section V1, the user of the passive terminal 3 is informed via the video data that the active avatar A1 is encouraging the passive avatar A2 to shake hands. As another method, the video data may be provided with an emphasis display section V2a that highlights the right hand of the active avatar A1 and an emphasis display section V2b that highlights the right hand of the passive avatar A2, thereby informing the user of the passive terminal 3 via the video data that the active avatar A1 is about to shake hands. Only one of the active avatar A1 and the passive avatar A2 may be highlighted.

[0075] The user of the passive terminal 3 sees the message or highlighting and understands that the active avatar A1 wants to shake hands with the passive avatar A2, and inputs an instruction to allow or deny the request. If the request is allowed, the active avatar A1 and the passive avatar A2 shake hands in the video data.

[0076] When an action from an active avatar to a passive avatar is detected and the permission flag for that action in the passive permission data 13 indicates denial, the passive avatar indicates in the video data that it does not accept the action of the active avatar, allowing the user of the active terminal 2 to recognize that the action has been denied by the passive avatar.

[0077] For example, if "reject" is set in the passive permission data 13, the active and passive avatars will not interact with each other and will act as if there is no one around them, such as when the passive avatar slips past the active avatar in the video data. Specifically, if the active avatar requests a handshake from the passive avatar and the passive avatar refuses, the video data will show the active and passive avatars simply overlapping, such as when the passive avatar slips past the active avatar's extended right hand. Alternatively, the video data may show the active and passive avatars moving backwards, as if they are repelling each other. A message display unit saying "Handshake rejected" may also be displayed in the video data.

[0078] The generation process by the generation unit 22 will be described with reference to Fig. 6. In Fig. 6, the avatar display device 1 generates motion data 14 capable of rendering a virtual space, and the active terminal 2 and passive terminal 3 generate video data from the motion data.

[0079] First, the generation unit 22 waits for detection of a movement of the active avatar set in the passive permission data 13. If a body part of the passive avatar is set in the passive permission data 13, the generation unit 22 also detects that the movement of the active avatar is a movement for the body part of the passive avatar.

[0080] If not detected, the generator 22 generates the motion data 14 according to the active movement data 11 and the passive movement data 12 in step S4.

[0081] If detected, in step S2, the generation unit 22 refers to the flag associated with the operation in the passive permission data 13. If the flag indicates permission, the process proceeds to step S3, and if the flag indicates denial, the process proceeds to step S7.

[0082] If the flag is set to "permit," in step S3 the generation unit 22 determines whether or not an action is set in the passive permission data 13. If no action is set, in step S5 the generation unit 22 modifies the active action data 11 and the passive action data 12 to generate motion data 14 in which the active avatar and passive avatar perform a combination of actions. Using this motion data 14, video data in which the active avatar and passive avatar perform a combination of actions is played on the active terminal 2 and the passive terminal 3, regardless of the active action data 11 and the passive action data 12.

[0083] If an action is set, in step S5, the generation unit 22 modifies the passive action data 12 to generate motion data 14 in which the passive avatar performs the action set in the passive permission data 13. Regardless of the passive action data 12, this motion data 14 causes the passive avatar to perform the set action, and video data is played on the active terminal 2 and the passive terminal 3. The active avatar may perform an action according to the active action data 11, may perform a predetermined action, or may pause and stop.

[0084] If the flag is set to "reject," in step S7, the generator 22 modifies the passive action data 12 to generate motion data 14 in which the passive avatar does not accept the action. The motion data 14 may include a message or highlighting to indicate that the active avatar is requesting a combination of actions.

[0085] When the process of any one of steps S4 to S7 is completed, the generation unit 22 returns to step S1.

[0086] According to the avatar display system 5 according to the embodiment of the present invention, when an active avatar requests an action combination from a passive avatar and the passive avatar accepts the request, video data is displayed in which the active and passive avatars perform corresponding actions, regardless of the action instructions input from the active terminal 2 and the passive terminal 3. This makes it possible to easily realize action combinations in a virtual space without having to input detailed action instructions for performing the action combination in the active terminal 2 and the passive terminal 3. Users communicating in a virtual space can easily interact with other avatars, regardless of their avatar operation skills.

[0087] In the embodiment of the present invention, a case where movement instructions to an active avatar and a passive avatar active in a virtual space are input in real time will be described, but this is not limiting. For example, the active avatar may move according to movement instructions input in real time, while the passive avatar may move according to movement instructions input in advance; the timing of input of movement instructions does not matter. For example, in video data of a handshake event for an idol (passive avatar) active in a virtual space, if the active avatar approaches the idol and asks for a handshake, and the handshake is permitted in the passive permission data 13, the active avatar and the idol will be shown shaking hands.

[0088] In the embodiment of the present invention, the passive permission data 13 shown in the figure is generated for each passive avatar, but this is not limited to this. For example, a passive avatar without passive permission data 13 may be controlled to reject all action combinations with active avatars. Furthermore, the avatar display device 1 may store data for each passive avatar that specifies whether or not to accept an action combination. By easily identifying passive avatars that do not accept an action combination, the processing cost of the generation unit 22 can be reduced.

[0089] In the passive permission data 13 shown in FIG. 3, a flag is set for each active action type and each body part of a passive avatar, but this is not limiting. For example, a flag may be set for each active avatar. The passive permission data 13 may include specific information about active avatars that accept action combinations, or specific information about active avatars that do not accept action combinations. This specific information about active avatars only needs to be able to identify the active avatars, and may be an identifier for each avatar, or attributes of the active avatar, such as occupation or intimacy level. Furthermore, in the passive permission data 13, a flag may be set for each specific information about the active avatars, in addition to the active action type and the body part of the passive avatar.

[0090] Furthermore, in the passive permission data 13, a flag may be set for each environment of the virtual space, such as the attributes of the areas that divide the virtual space, the time, the weather, etc. For example, in an idol town, a passive avatar whose occupation is idol may be allowed to accept approaches from all active avatars, while in areas other than the idol town, a flag may be set so that the passive avatar does not accept any approaches from active avatars.

[0091] Furthermore, when the flag is set to reject, the passive permission data 13 may also be associated with conditions under which the passive avatar accepts the action combination by the active avatar. Examples of such conditions include having a certain level of intimacy or higher, possessing a certain item, or being the avatar of a paying user. The conditions are notified so that the user of the active avatar can recognize them. For example, the conditions may be notified in video data displayed on the active terminal 2, or may be notified to the active terminal 2 by a direct message.

[0092] In this way, by predefining the conditions under which a passive avatar accepts an approach from an active avatar in the passive permission data 13, the avatar display device 1 can realize communication in the virtual space that reflects the passive avatar's intentions.

[0093] (Other embodiments) As described above, the present invention has been described by way of an embodiment, but the descriptions and drawings that form part of this disclosure should not be understood as limiting the present invention. From this disclosure, various alternative embodiments, examples, and operating techniques will become apparent to those skilled in the art.

[0094] For example, the avatar display device described in the embodiment of the present invention may be configured on a single piece of hardware as shown in Fig. 2, or may be configured on multiple pieces of hardware depending on the functions and number of processes. Also, it may be realized on an existing processing device together with other functions.

[0095] The present invention naturally includes various embodiments not described herein. Therefore, the technical scope of the present invention is defined only by the invention-specifying matters according to the claims that are appropriate from the above description. [Explanation of symbols]

[0096] 1 Avatar display device 2 Active terminals 3 Passive Terminals 5 Avatar display system 10 Storage device 11 Active movement data 12 Passive movement data 13 Passive Authorization Data 14 Motion Data 20 Processing equipment 21 Acquisition Department 22 Generation part 23 Output section 30 Communication control device

Claims

1. An avatar display device that is connected to a passive terminal that inputs movement instructions for a passive avatar active in a virtual space, displays video data of the virtual space on the passive terminal, and supports communication between an active avatar and the passive avatar in the virtual space, comprising: a storage device for storing passive permission data including a permission flag indicating whether the passive avatar is permitted or denied a motion from the active avatar to the passive avatar that realizes communication between the active avatar and the passive avatar; an output unit that outputs, when the action from the active avatar to the passive avatar is detected and the permission flag in the passive permission data indicates denial, data for displaying video data in which the passive avatar does not accept the action of the active avatar on the passive terminal; An avatar display device comprising:

2. The video data that does not accept the action is video data in which the active avatar passes through the passive avatar. The avatar display device according to claim 1 .

3. The video data that does not accept the movement is video data in which the active avatar and the passive avatar move in a repulsive manner. The avatar display device according to claim 1 .

4. The video data that does not accept the action is video data that displays a message indicating that the passive avatar rejects the action from the active avatar. The avatar display device according to claim 1 .

5. Connecting to an active terminal for inputting movement instructions for the active avatar active in the virtual space, The output unit further outputs data for displaying, on the active terminal, video data in which the passive avatar does not accept the action of the active avatar. The avatar display device according to claim 1 .

6. The output unit detects the action from the active avatar to the passive avatar when the active avatar approaches the passive avatar and the distance between the active avatar and the passive avatar is equal to or less than a certain value. The avatar display device according to claim 1 .

7. the passive permission data associates a permission flag, which indicates whether the passive avatar permits a movement from the active avatar to the passive avatar in the virtual space, with each body part of the active avatar; When the action from the active avatar to a predetermined part of the passive avatar is detected and the permission flag corresponding to the predetermined part in the passive permission data indicates denial, the video data indicates that the passive avatar does not accept the action of the active avatar.

7. The avatar display device according to claim 1, wherein the display device is a display device for displaying an avatar.

8. An avatar display system comprising: a passive terminal for inputting operation instructions for a passive avatar active in a virtual space; and an avatar display device connected to said passive terminal, displaying video data of said virtual space on said passive terminal, and supporting communication between an active avatar and said passive avatar in said virtual space, The avatar display device includes: a storage device for storing passive permission data including a permission flag indicating whether the passive avatar is permitted or denied a motion from the active avatar to the passive avatar that realizes communication between the active avatar and the passive avatar; an output unit that outputs, when the action from the active avatar to the passive avatar is detected and the permission flag in the passive permission data indicates denial, data for displaying video data in which the passive avatar does not accept the action of the active avatar on the passive terminal; The passive terminal displays the video data. An avatar display system comprising:

9. An avatar display method for use in an avatar display device that supports communication between an active avatar and a passive avatar in a virtual space by connecting to a passive terminal that inputs operation instructions for a passive avatar active in a virtual space, and displaying video data of the virtual space on the passive terminal, comprising: a step of storing, by the computer, passive permission data in a storage device, the passive permission data including a permission flag indicating whether the passive avatar has permitted or denied an action from the active avatar to the passive avatar, the action realizing communication between the active avatar and the passive avatar; a step of outputting data for displaying, on the passive terminal, video data in which the passive avatar does not accept the action of the active avatar, when the action from the active avatar to the passive avatar is detected and the permission flag in the passive permission data indicates denial; An avatar display method comprising:

10. An avatar display program used in an avatar display device that is connected to a passive terminal that inputs operation instructions for a passive avatar active in a virtual space, displays video data of the virtual space on the passive terminal, and supports communication between an active avatar and the passive avatar in the virtual space, comprising: Computer, a storage unit for storing passive permission data including a permission flag indicating whether the passive avatar is permitted or denied a motion from the active avatar to the passive avatar that realizes communication between the active avatar and the passive avatar; an output unit that outputs, when the action from the active avatar to the passive avatar is detected and the permission flag in the passive permission data indicates denial, data for displaying video data in which the passive avatar does not accept the action of the active avatar on the passive terminal; and a display program for displaying an avatar, the program causing the avatar to function as an avatar display program.

Images