Avatar control device, avatar control method, and avatar control program

Abstract

An avatar control device (101) is provided with an avatar operation setting unit (4) and an avatar generation unit (7). An avatar generation unit (7) draws an avatar corresponding to each user and generates each avatar. The avatar action setting unit (4) sets whether or not to cause the avatar to reflect at least some of the actions of the user on the basis of the number of avatars generated by the avatar generation unit (7). Accordingly, the avatar control device (101) may perform control to generate an avatar corresponding to a user while preventing a rendering load or a communication load from being too large.

Description

Technical Field

[0001] The present disclosure relates to an avatar control device, an avatar control method, and an avatar control program. Background Art

[0002] In recent years, as the processing speed of processors has increased, in a virtual reality (VR) space, each user moves an avatar generated corresponding to each user, or allows the avatars to communicate with each other (see Patent Document 1). Typically, a server that controls the avatar communicates with a user terminal held by each user via a network, thereby generating an avatar corresponding to each user.

[0003] Prior art literature

[0004] Patent Literature

[0005] Patent Document 1: Japanese Patent Application Publication No. 2009-172239. Summary of the invention

[0006] Although the processing speed of the processor is increased, sometimes the rendering load for rendering the avatar corresponding to each user is too large, or the communication load between the server and the user terminal is too large. As a result, the avatar may stop accidentally or fail to follow the user's movement, and the avatar's movement becomes unnatural, and the user may feel uncomfortable.

[0007] One or more embodiments aim to provide an avatar control device, an avatar control method, and an avatar control program, which are capable of controlling so as to generate an avatar corresponding to a user while preventing an excessive drawing load or a communication load.

[0008] A first method of one or more embodiments provides an avatar control device, including: an avatar generation unit, which draws avatars corresponding to each user to generate each avatar; and an avatar action setting unit, which sets whether to make the avatar reflect the actions of at least some users according to the number of avatars generated by the avatar generation unit.

[0009] A second method of one or more embodiments provides an avatar control device, comprising: an avatar generation unit, which draws an avatar corresponding to each user to generate each avatar; an avatar action setting unit, which sets whether to reflect the actions of each user on the avatar; a tracking loss detection unit, which detects a state in which an action detection signal corresponding to the actions of each user is no longer generated as tracking loss; and a specific posture data holding unit, which holds specific posture data for putting the avatar in a static state or a specific action, wherein the avatar action setting unit sets an avatar corresponding to the user whose tracking loss is detected by the tracking loss detection unit and whose number of other avatars watching the user's avatar is less than a predetermined number to a static state based on the specific posture data held in the specific posture data holding unit, and sets an avatar whose number of other avatars watching the user's avatar exceeds the predetermined number to a specific action based on the specific posture data held in the specific posture data holding unit.

[0010] A third method of one or more embodiments provides an avatar control device, comprising: an avatar generation unit, which draws an avatar corresponding to each user to generate each avatar; an avatar action setting unit, which sets whether to reflect the action of each user on the avatar; a tracking loss detection unit, which detects a state in which an action detection signal corresponding to the action of each user is no longer generated as tracking loss; and a specific posture data holding unit, which holds specific posture data for putting the avatar in a static state or a specific action, wherein the avatar action setting unit sets the avatar corresponding to the user whose tracking loss is detected by the tracking loss detection unit and whose avatar's action before the tracking loss is detected is less than or equal to a predetermined size to a static state based on the specific posture data held in the specific posture data holding unit, and sets the avatar whose avatar's action before the tracking loss is detected exceeds the predetermined size to a specific action based on the specific posture data held in the specific posture data holding unit.

[0011] A fourth mode of one or more embodiments provides an avatar control method, wherein an avatar corresponding to each user is drawn to generate each avatar, and according to the number of generated avatars, the avatars are set so that actions of at least some of the users are reflected in the avatars.

[0012] A fifth mode of one or more embodiments provides an avatar control program that causes a computer to execute the following steps: generating each avatar by drawing an avatar corresponding to each user; and setting whether to reflect the actions of at least some users on the avatar according to the number of generated avatars.

[0013] According to the avatar control device, avatar control method, and avatar control program according to one or more embodiments, it is possible to control so that an avatar corresponding to a user is generated while preventing a rendering load or a communication load from being excessive. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 It is a block diagram showing an avatar control device according to the first embodiment.

[0015] Figure 2 This is a diagram showing an example of user actions.

[0016] Figure 3 It shows that when the user Figure 2 Diagram of the skeleton's motion for the actions shown.

[0017] Figure 4 It shows that the user Figure 2 Schematic diagram of the skeletal motion signals of the skeletal motion when performing such an action.

[0018] Figure 5 It shows the user Figure 2 A diagram of the avatar's movements when moving like that.

[0019] Figure 6 This is a schematic diagram showing changes in skeletal motion signals when tracking loss occurs.

[0020] Fig. 7A This is a diagram showing a state in which there is only one other avatar viewing one's own avatar.

[0021] Figure 7B This is a diagram showing a state in which four other avatars are viewing one's own avatar.

[0022] Figure 8 This is a flowchart showing a process for causing a computer to execute the operation of the avatar control device of the first embodiment, the avatar control method of the first embodiment, and the avatar control program of the first embodiment.

[0023] Fig. 9 It is a block diagram showing an avatar control device according to the second embodiment.

[0024] Fig.10 This is a flowchart showing a process for causing a computer to execute the operation of the avatar control device of the second embodiment, the avatar control method of the second embodiment, and the avatar control program of the second embodiment.

[0025] Fig.11 This is a flowchart showing a process for causing a computer to execute the operation of the avatar control device of the third embodiment, the avatar control method of the third embodiment, and the avatar control program of the third embodiment. DETAILED DESCRIPTION

[0026] Hereinafter, an avatar control device, an avatar control method, and an avatar control program according to each embodiment will be described with reference to the drawings.

[0027] <First Embodiment>

[0028] like Figure 1 As shown, the avatar control server 10a and the user terminals 20a to 20c are connected via a network 50. Any user terminal of the unspecified user terminals 20a to 20c and any other user terminals not shown are referred to as user terminals 20. The number of user terminals 20 connected to the avatar control server 10a via the network 50 is any number of one or more. Typically, the network 50 is the Internet.

[0029] The avatar control server 10a includes an avatar control device 101. The avatar control device 101 includes a communication unit 1, a motion detection unit 2, a tracking loss detection unit 3, an avatar motion setting unit 4, a specific posture data storage unit 5, an avatar control signal generation unit 6, an avatar generation unit 7, a rendering unit 8, a control unit 9, an avatar position control unit 11, and an avatar / background setting unit 12. Each user terminal 20 includes a motion sensor 21, a control unit 22, an operation unit 23, a communication unit 24, and an image display unit 25. The avatar generation unit 7 includes a calculation unit 71.

[0030] The communication unit 1 can be composed of a communication circuit that communicates with the user terminal 20 using a communication protocol such as the Internet protocol. The avatar control device 101 other than the communication unit 1 can be composed of a computer including a processor and a memory. The specific posture data storage unit 5 and the avatar / background setting unit 12 can be composed of a computer memory. The parts of the avatar control device 101 other than the communication unit 1, the specific posture data storage unit 5 and the avatar / background setting unit 12 can be composed of a computer processor.

[0031] Assume that the user holding the user terminal 20a is Figure 2 The user U1 is shown. The motion sensor 21 is a TOF (Time of Flight) sensor or a camera. When the motion sensor 21 is a TOF sensor, the motion sensor 21 measures the time from irradiating light or ultrasound to the light or ultrasound returning to the user U1, and generates a motion detection signal corresponding to the motion (including posture) of the user U1, which indicates what posture the user U1 is in or how the motion is performed.

[0032] The motion sensor 21 may be an acceleration sensor or a gyro sensor attached to a plurality of parts of the body of the user U1 . The motion sensor 21 may be any sensor as long as it can detect the motion or posture of the body of the user U1 .

[0033] When the motion sensor 21 is a camera, the motion sensor 21 photographs the user U1 and generates a motion detection signal corresponding to the motion (including posture) of the user U1. When a camera is used as the motion sensor 21, the camera is a camera that photographs the user U1 two-dimensionally or a stereo camera that photographs the user U1 three-dimensionally. Since a stereo camera can be used as the motion sensor 21 to photograph the user U1 three-dimensionally, it is preferred. The motion detection signal output from the motion sensor 21 is sent to the avatar control server 10a via the control unit 22, the communication unit 24, and the network 50.

[0034] The communication unit 1 receives the motion detection signal and provides it to the motion detection unit 2. The motion detection unit 2 detects the positions of multiple joints and specific parts of the body of the user U1 based on the input motion detection signal, and generates a skeletal motion signal indicating the skeletal motion of the user U1, which indicates the posture of the user U1 or how the user U1 moves. The skeletal motion signal is an example of a body motion signal indicating the body motion of the user U1. Figure 2 As shown, it is assumed that the user U1 changes from a posture P1 in which he stands with both hands down to a posture P2 in which his right arm is bent and his left arm is pushed up. Figure 3 As shown, the motion detection unit 2 generates a skeletal motion signal including a skeletal posture Q1 corresponding to the posture P1 and a skeletal posture Q2 corresponding to the posture P2.

[0035] Despite Figure 3 Although not shown in the figure, the motion detection unit 2 generates a skeletal motion signal halfway from the posture P1 to the posture P2. Figure 4 The skeleton motion signal indicating that the skeleton posture Q1 has changed to the skeleton posture Q2 is provided to the tracking loss detection unit 3 and the avatar motion setting unit 4 .

[0036] The user terminal 20 may also include a structure corresponding to the motion detection unit 2. In this case, the communication unit 24 of the user terminal 20 sends the skeletal motion signal of each user to the avatar control server 10a, and the communication unit 1 of the avatar control server 10a receives the skeletal motion signal. The received skeletal motion signal is provided to the tracking loss detection unit 3 and the avatar motion setting unit 4.

[0037] When the skeletal motion signal is no longer input, the tracking loss detection unit 3 detects that the motion sensor 21 no longer generates a motion detection signal corresponding to the motion of the user U1, that is, tracking loss has occurred. When the tracking loss detection unit 3 detects that tracking loss has occurred, it notifies the avatar motion setting unit 4 that tracking loss has occurred. The tracking loss detection unit 3 can also detect that tracking loss has occurred when the skeletal motion signal indicates an abnormal motion that is usually impossible. For example, sometimes when a part of the body of the user U1 deviates from the TOF sensor or the camera, the skeletal motion signal indicates an abnormal motion.

[0038] If there is no notification of tracking loss, the avatar motion setting unit 4 instructs the avatar control signal generating unit 6 to make the avatar perform motions corresponding to the skeleton motion signals. The avatar control signal generating unit 6 generates an avatar control signal and supplies it to the avatar generating unit 7, wherein the avatar control signal controls the avatar Av to perform motions corresponding to the skeleton motion signals.

[0039] The computing unit 71 of the avatar generation unit 7 generates an avatar by drawing an avatar that performs an action corresponding to the skeletal action signal. The avatar / background setting unit 12 sets what form of avatar the avatar generation unit 7 generates. Assume that the form of the avatar set in the avatar / background setting unit 12 is as follows: Figure 5 The avatar / background setting unit 12 also sets the correspondence between the human body part and the avatar part.

[0040] Therefore, if Figure 5 As shown, the avatar generation unit 7 generates Figure 3 The avatar Av1 shown changes from the posture Pav1 to the posture Pav2 in response to the change of the skeleton posture Q1 to the skeleton posture Q2. Any avatar including the avatar Av1 is referred to as an avatar Av.

[0041] The user may upload the form of the avatar Av to the avatar / background setting unit 12 via the user terminal 20. A plurality of forms of the avatar Av may be set in the avatar / background setting unit 12, and the user may select any form.

[0042] Background data that determines the three-dimensional virtual space in which the avatar Av is located and moves is set in the avatar / background setting unit 12. If the avatar Av is a two-dimensional image, the background data may be two-dimensional image data. The rendering unit 8 obtains the background data from the avatar / background setting unit 12 and renders so that the avatar Av is located in the virtual space based on the background data.

[0043] The user can operate the operation unit 23 in the user terminal 20 to move the avatar Av in the virtual space. The control unit 22 of the user terminal 20 generates a movement control signal for moving the avatar Av according to the operation of the operation unit 23. The movement control signal is transmitted to the avatar control server 10a via the communication unit 24 and the network 50. The communication unit 1 of the avatar control server 10a receives the movement control signal, and the control unit 9 provides the movement control signal to the avatar position control unit 11. The avatar position control unit 11 controls the rendering unit 8 so that the avatar Av in the virtual space moves according to the movement control signal.

[0044] As described above, the avatar control server 10a generates an avatar Av corresponding to the user of each user terminal 20, and generates a rendering image in the virtual space. The communication unit 1 sends the rendering image to each user terminal 20. The communication unit 24 receives the rendering image, and the control unit 22 controls so that the rendering image is displayed on the image display unit 25. While watching the rendering image displayed on the image display unit 25, the user can change his own posture to change the posture of the avatar Av, or move the avatar Av in the virtual space.

[0045] Here, the operation of the avatar control server 10a when the tracking loss detection unit 3 detects the tracking loss will be described. The specific posture data storage unit 5 stores specific posture data for making the avatar Av stand still or perform specific actions. For example, the specific posture data storage unit 5 stores specific posture data related to the avatar Av. Figure 6 Here, the skeletal posture Q0 in the static state is set to be equivalent to Figure 4 The specific posture data for setting the avatar Av to a specific motion may be posture data of a skeleton posture such that a part of the skeleton posture Q0 changes periodically, for example.

[0046] like Figure 6 As shown, it is assumed that tracking loss occurs at the moment when the motion detection unit 2 generates a skeletal motion signal corresponding to the skeletal posture Q11. When the avatar motion setting unit 4 is notified by the tracking loss detection unit 3 that tracking loss has occurred, it instructs the avatar control signal generation unit 6 to make the avatar Av replace the skeletal posture Q11 at the time of tracking loss with a posture corresponding to the skeletal posture Q0 in a static state (or the skeletal posture of a specific action). At this time, the motion detection unit 2 may not immediately transfer from the skeletal posture Q11 to the skeletal posture Q0, but may sequentially change to the skeletal postures between the skeletal posture Q11 and the skeletal posture Q0, namely, the skeletal postures Q12 and Q13, and transfer to the skeletal posture Q0.

[0047] The avatar action setting unit 4 may also be provided with a user terminal 20 that controls the skeletal posture Q0 to be in a static state, and a user terminal 20 that controls the skeletal posture to be in a specific action. The avatar action setting unit 4 may select whether to set the skeletal posture Q0 to be in a static state or to set the skeletal posture to be in a specific action, depending on whether the ID assigned to the user terminal 20 is an odd number or an even number. The avatar action setting unit 4 may also select the skeletal posture for a specific action when the number of other avatars Av that are viewing the own avatar Av is large (exceeding a predetermined number), and select the skeletal posture Q0 in a static state when the number of other avatars Av that are viewing the own avatar Av is small (below a predetermined number).

[0048] The avatar action setting unit 4 can select the skeletal posture of a specific action when the action of the avatar Av immediately before the tracking loss occurs is large (exceeding a predetermined size), and select the skeletal posture Q0 of a stationary state when the action of the avatar Av immediately before the tracking loss occurs is small (below a predetermined size). Specific posture data for performing multiple specific actions can also be maintained in the specific posture data maintenance unit 5. The avatar action setting unit 4 can select any one skeletal posture of a specific action from the skeletal postures of multiple specific actions based on the action of the avatar Av immediately before the tracking loss occurs. The user can also select the skeletal posture Q0 of a stationary state and the skeletal posture of a specific action.

[0049] In addition, when the number of user terminals 20 connected to the avatar control server 10a via the network 50 is too large, the drawing load for the avatar generating unit 7 to draw the avatar Av corresponding to each user becomes too large, or the communication load between the avatar control server 10a and the user terminal 20 becomes too large. Therefore, in the first embodiment, in order to reduce the drawing load and the communication load, the avatar control device 101 is configured as follows.

[0050] The control unit 9 obtains the number of user terminals 20 with which the communication unit 1 communicates. When the number of user terminals 20 connected to the avatar control server 10a exceeds a predetermined number, the control unit 9 sends an instruction signal to at least some of the user terminals 20, the instruction signal indicating that the motion detection signal (or skeletal motion signal) is not to be sent to the avatar control server 10a. The user terminal 20 that has obtained the instruction signal and is instructed not to send the motion detection signal to the avatar control server 10a stops sending the motion detection signal to the avatar control server 10a. Therefore, the communication load between the avatar control server 10a and the user terminal 20 can be reduced.

[0051] In addition, the user terminal 20 that stops sending the motion detection signal to the avatar control server 10a enters the above-mentioned tracking loss state in the avatar control device 101. The avatar Av corresponding to the user of the user terminal 20 that stops sending the motion detection signal to the avatar control server 10a becomes stationary or performs only specific actions. Therefore, the rendering load in the avatar generation unit 7 can be reduced.

[0052] The control unit 9 may select the user terminal 20 that is instructed not to send the motion detection signal to the avatar control server 10a as follows. As a first example, the control unit 9 selects the user terminal 20 that is instructed not to send the motion detection signal to the avatar control server 10a based on the ID assigned to the user terminal 20. For example, the control unit 9 divides the user terminal 20 into two groups according to whether the ID is an odd number or an even number, and instructs the user terminal 20 in one group not to send the motion detection signal to the avatar control server 10a.

[0053] As a second example, the control unit 9 selects the user terminal 20 of the user corresponding to the avatar Av with a small number of other avatars Av who are viewing the own avatar Av as the user terminal 20 for instructing not to send the motion detection signal to the avatar control server 10a. The control unit 9 grasps the position of each avatar Av in the virtual space and the direction to which each avatar Av is facing. The field of view of each avatar Av is preset.

[0054] Fig. 7A This shows that the other avatars Av who are viewing the own avatar Av10 are only the avatar Av11. Figure 7B The other avatars Av that are watching the own avatar Av10 are shown as avatars Av11 to Av14. Fig. 7A and Figure 7B In FIG. 1 , the predetermined angle range indicated by the dashed line represents the field of view of each avatar Av. Fig. 7A and Figure 7B When the user's avatar Av10 that is in motion suddenly stops, the user corresponding to the other avatars Av will feel the most discomfort if the number of other avatars Av is large. Figure 7B situation.

[0055] Therefore, the control unit 9 gives the highest priority to selecting the user terminal 20 of the user corresponding to the avatar Av that has no other avatars Av viewing the own avatar Av10 as the user terminal 20 that instructs not to send the motion detection signal to the avatar control server 10a. When the number of user terminals 20 connected to the avatar control server 10a other than the selected user terminal 20 still exceeds the predetermined number, the control unit 9 selects the user terminal 20 of the user corresponding to the avatar Av that has fewer other avatars Av viewing the own avatar Av10.

[0056] The control unit 9 may select the user terminal 20 that instructs not to transmit the motion detection signal to the avatar control server 10a until the number of user terminals 20 connected to the avatar control server 10a other than the selected user terminal 20 becomes equal to or less than the predetermined number.

[0057] use Figure 8 The flowchart shown in FIG. 1 is used to explain the process of causing a computer to execute the operation of the avatar control device 101 of the first embodiment, the avatar control method of the first embodiment, and the avatar control program of the first embodiment. Figure 8In the process of the avatar control device 101, if the process starts, then in step S1, the control unit 9 determines whether the number of connected user terminals 20 exceeds the predetermined number. If the number of user terminals 20 exceeds the predetermined number (yes), in step S2, the control unit 9 instructs at least part of the user terminals 20 to stop sending the user's motion detection signal, and the process is transferred to step S10. If the number of user terminals 20 does not exceed the predetermined number (no), the control unit 9 transfers the process to step S10.

[0058] In parallel with step S1, in step S3, the tracking loss detection unit 3 determines whether there is a user terminal 20 whose tracking is lost. If there is a user terminal 20 whose tracking is lost (yes), in step S4, the tracking loss detection unit 3 notifies the avatar action setting unit 4 to set the avatar corresponding to the user of the corresponding user terminal 20 to a static state. Following step S4, if there is no user terminal 20 whose tracking is lost (no) in step S3, in step S5, the avatar action setting unit 4 instructs the avatar control signal generation unit 6 on the action of each avatar Av.

[0059] In step S6 , the avatar control signal generating unit 6 generates an avatar control signal. In step S7 , the avatar generating unit 7 generates an avatar Av. In step S8 , the rendering unit 8 renders the avatar Av so that it is located in the virtual space. In step S9 , the communication unit 1 transmits the rendered image to each user terminal 20 .

[0060] In step S10, the avatar control device 101 determines whether the avatar control operation is completed. If the avatar control operation is not completed (No), the avatar control device 101 returns the process to steps S1 and S3 and repeats the subsequent processes. If the avatar control operation is completed (Yes), the avatar control device 101 ends the process.

[0061] As described above, the avatar control device 101 of the first embodiment includes: an avatar generation unit 7 that draws an avatar Av corresponding to each user to generate each avatar; and an avatar action setting unit 4 that sets whether to reflect the actions of at least some users on the avatar Av according to the number of avatars Av generated by the avatar generation unit 7. The avatar control method and avatar control program of the first embodiment draw an avatar Av corresponding to each user to generate each avatar, and set whether to reflect the actions of at least some users on the avatar Av according to the number of avatars Av generated.

[0062] Therefore, according to the avatar control device 101, the avatar control method, and the avatar control program of the first embodiment, control can be performed so that the avatar Av corresponding to the user is generated while preventing the drawing load or the communication load from being excessive.

[0063] The avatar motion setting unit 4 may set the avatar Av, which does not reflect the user's motion, to a stationary state or a specific motion.

[0064] The avatar control device 101 of the first embodiment is provided in an avatar control server 10a connected to each user terminal 20 via a network 50. Each user terminal 20 transmits a motion detection signal generated by a motion sensor 21 detecting motion of each user or a skeletal motion signal of each user generated based on the motion detection signal to the avatar control server 10a.

[0065] The avatar control device 101 obtains the number of user terminals 20 connected to the avatar control server 10a. The avatar control device 101 includes a control unit 9, which instructs at least some of the user terminals 20 not to send motion detection signals or skeletal motion signals to the avatar control server 10a when the number of user terminals 20 connected to the avatar control server 10a exceeds a predetermined number. Therefore, it is possible to realize the avatar control device 101 that prevents excessive drawing load or communication load.

[0066] <Second Embodiment>

[0067] exist Fig. 9 In the second embodiment shown in the figure, the same reference numerals are sometimes used to indicate the same parts as those in the first embodiment, and their description is omitted. Fig. 9 As shown, the avatar control server 10b and user terminals 20d to 20f are connected via a network 50. Any one of the unspecified user terminals 20d to 20f and any other user terminals not shown are referred to as user terminals 20. The number of user terminals 20 connected to the avatar control server 10b via the network 50 is any number of one or more.

[0068] Each user terminal 20 includes an avatar control device 222. As a structure different from the user terminal 20 of the first embodiment, each user terminal 20 includes a motion detection unit 202, a tracking loss detection unit 203, an avatar motion setting unit 204, a specific posture data storage unit 205, an avatar control signal generation unit 206, an avatar generation unit 207, a rendering unit 208, and a storage unit 209. The avatar generation unit 207 includes a calculation unit 2071. The avatar control server 10b includes a communication unit 1, a control unit 9, an avatar / background setting unit 12, and an avatar position management unit 110.

[0069] The avatar control device 222 can be formed by a computer including a processor and a memory. The specific posture data storage unit 205 and the storage unit 209 can be formed by the memory of the computer. The parts of the avatar control device 222 other than the motion sensor 21, the operation unit 23, the communication unit 24, the image display unit 25, the specific posture data storage unit 205 and the storage unit 209 can be formed by the processor of the computer.

[0070] The motion detection unit 202 generates a skeletal motion signal for each user in the same manner as the motion detection unit 2. The skeletal motion signal is provided to the tracking loss detection unit 203, the avatar motion setting unit 204, and the communication unit 24. The communication unit 24 transmits the skeletal motion signal to the avatar control server 10b. The communication unit 1 of the avatar control server 10b receives the skeletal motion signal transmitted from each user terminal 20. The communication unit 1 transmits the skeletal motion signal transmitted from all other user terminals 20 to each user terminal 20 under the control of the control unit 9.

[0071] exist Fig. 9 In the example shown, the communication unit 1 transmits the skeletal motion signals received from the user terminals 20e and 20f to the user terminal 20d. The communication unit 1 transmits the skeletal motion signals received from the user terminals 20d and 20f to the user terminal 20e. The communication unit 1 transmits the skeletal motion signals received from the user terminals 20d and 20e to the user terminal 20f.

[0072] The tracking loss detection unit 203 detects whether tracking is lost in each user terminal 20 based on the skeletal motion signal provided by the motion detection unit 202 in the own user terminal 20 and the skeletal motion signal generated by the motion detection unit 202 in the other user terminal 20. When the tracking loss detection unit 203 detects that tracking is lost in any user terminal 20, it notifies the avatar motion setting unit 204 that tracking is lost.

[0073] If there is no notification of the occurrence of tracking loss, the avatar motion setting unit 204 instructs the avatar control signal generating unit 206 to make the avatar Av perform a motion corresponding to the skeleton motion signal. The avatar control signal generating unit 206 generates an avatar control signal and provides it to the avatar generating unit 207. The avatar control signal controls so that the avatar Av performs a motion corresponding to the skeleton motion signal. The computing unit 2071 of the avatar generating unit 207 draws the avatar Av that performs the motion corresponding to the skeleton motion signal to generate the avatar Av.

[0074] Information indicating the form of the avatar Av set in the avatar / background setting unit 12 of the avatar control server 10b, information indicating the correspondence relationship between a part of the human body and which part of the avatar Av corresponds, and background data are transmitted to each user terminal 20 and stored in the storage unit 209. The rendering unit 8 acquires the background data from the storage unit 209 and renders the avatar Av so that it is located in the virtual space based on the background data.

[0075] The control unit 22 of each user terminal 20 generates a movement control signal for moving the avatar Av according to the operation of the operation unit 23. The control unit 22 controls the rendering unit 208 so that the avatar Av corresponding to the user of the user terminal 20 moves in the virtual space according to the movement control signal. The movement control signal is transmitted to the avatar control server 10b. The avatar position management unit 110 obtains the movement control signal from all user terminals 20 and manages the position of each avatar Av in the virtual space.

[0076] The communication unit 1 transmits the mobile control signal transmitted from all other user terminals 20 to each user terminal 20 according to the control of the control unit 9. Fig. 9 In the example shown, the communication unit 1 transmits the movement control signal received from the user terminals 20e and 20f to the user terminal 20d. The communication unit 1 transmits the movement control signal received from the user terminals 20d and 20f to the user terminal 20e. The communication unit 1 transmits the movement control signal received from the user terminals 20d and 20e to the user terminal 20f. The control unit 22 controls the rendering unit 208 so that the avatar Av corresponding to the user of the other user terminal 20 moves in the virtual space according to the movement control signal.

[0077] The image display unit 25 displays the rendered image generated by the rendering unit 208. While viewing the rendered image displayed on the image display unit 25, the user can change the posture of the avatar Av by changing his or her own posture or move the avatar Av in the virtual space.

[0078] The specific posture data holding unit 205 holds specific posture data for making the avatar Av stand still or perform specific actions. The operation of the avatar action setting unit 204 when the tracking loss detection unit 203 detects tracking loss is the same as that of the avatar action setting unit 4.

[0079] In the second embodiment, in order to reduce the drawing load and the communication load, the avatar control server 10b is constructed as follows. The control unit 9 is connected to the avatar control server 10b and obtains the number of user terminals 20 with which the communication unit 1 communicates. When the number of user terminals 20 connected to the avatar control server 10b exceeds a predetermined number, the control unit 9 sends an indication signal to at least a part of the user terminals 20, and the indication signal indicates that the skeletal motion signal is not to be sent to the avatar control server 10b. The user terminal 20 that has obtained the indication signal and has been instructed not to send the skeletal motion signal to the avatar control server 10b stops sending the skeletal motion signal to the avatar control server 10b. Therefore, the communication load between the avatar control server 10b and the user terminal 20 is reduced.

[0080] In addition, the avatar Av corresponding to the user of the user terminal 20 that stops sending the skeletal motion signal to the avatar control server 10b becomes a tracking loss state in other user terminals 20. The avatar Av corresponding to the user of the user terminal 20 that stops sending the skeletal motion signal to the avatar control server 10b is set to a static state or performs only specific actions. Therefore, the rendering load in the avatar generation unit 207 can be reduced.

[0081] The method by which the control unit 9 instructs the user terminal 20 not to send the skeleton motion signal to the avatar control server 10b may be selected in the same manner as the method by which the control unit 9 instructs the user terminal 20 not to send the motion detection signal to the avatar control server 10a in the first embodiment.

[0082] use Fig.10 The flowchart shown in FIG. 1 is used to explain the process of causing a computer to execute the operation of the avatar control device 222 of the second embodiment, the avatar control method of the second embodiment, and the avatar control program of the second embodiment. Fig.10 In step S21, when the processing of the avatar control device 222 starts, the control unit 22 determines whether the instruction to stop sending the skeleton motion signal is given. If the instruction to stop sending the skeleton motion signal is given (yes), in step S22, the communication unit 24 stops sending the skeleton motion signal, and the control unit 22 transfers the processing to step S210. If the instruction to stop sending the skeleton motion signal is not given (no), the control unit 22 transfers the processing to step S210.

[0083] In parallel with step S21, the tracking loss detection unit 203 determines in step S23 whether there is a user terminal 20 whose tracking is lost. If there is a user terminal 20 whose tracking is lost (yes), in step S24, the tracking loss detection unit 203 notifies the avatar action setting unit 204 to set the avatar corresponding to the user of the corresponding user terminal 20 to a static state. Following step S24, if there is no user terminal 20 whose tracking is lost (no) in step S23, in step S25, the avatar action setting unit 204 instructs the avatar control signal generation unit 206 on the action of each avatar Av.

[0084] In step S26, the avatar control signal generating unit 206 generates an avatar control signal. In step S27, the avatar generating unit 207 generates an avatar Av. In step S28, the rendering unit 208 performs rendering so that the avatar Av is located in the virtual space. In step S29, the image display unit 25 displays the rendered image.

[0085] In step S210, the avatar control device 222 determines whether the avatar control operation is completed. If the avatar control operation is not completed (No), the avatar control device 222 returns the process to steps S21 and S23 and repeats the subsequent processes. If the avatar control operation is completed (Yes), the avatar control device 222 ends the process.

[0086] As described above, the avatar control device 222 of the second embodiment includes: the avatar generation unit 207, which draws the avatar Av corresponding to each user to generate each avatar; and the avatar action setting unit 204, which sets whether to make the avatar Av reflect the action of at least some users according to the number of avatars Av generated by the avatar generation unit 207. The avatar control method and avatar control program of the second embodiment draw the avatar Av corresponding to each user to generate each avatar, and set whether to make the avatar Av reflect the action of at least some users according to the number of avatars Av generated.

[0087] Therefore, according to the avatar control device 222, the avatar control method, and the avatar control program of the second embodiment, it is possible to perform control so as to prevent the rendering load or the communication load from being excessive and to generate the avatar Av corresponding to the user.

[0088] The avatar action setting unit 204 may set the avatar Av that does not reflect the user's action to a stationary state or a specific action.

[0089] The avatar control device 222 of the second embodiment is provided in each user terminal 20. Each user terminal 20 sends a skeletal motion signal of each user generated based on a motion detection signal generated by the motion sensor 21 that obtains the motion of each user to the avatar control server 10b. The avatar control device 222 of each user terminal 20 obtains skeletal motion signals generated by other user terminals 20 other than the user terminal 20 of the user terminal 20 from the avatar control server 10b.

[0090] When the number of user terminals 20 connected to the avatar control server 10b exceeds a predetermined number, the avatar control server 10b sends an instruction signal to at least some of the user terminals 20, the instruction signal instructing not to send the skeletal motion signal to the avatar control server 10b. Therefore, the avatar control device 222 of at least some of the user terminals 20 obtains the instruction signal sent from the avatar control server 10b.

[0091] The avatar control device 222 includes the control unit 22, and the control unit 22 performs control so that when the instruction signal is acquired, the skeleton motion signal is not sent to the avatar control server 10b. Therefore, according to the second embodiment, it is possible to realize the avatar control device 222 that prevents the rendering load or the communication load from being excessive.

[0092] <Third Embodiment>

[0093] like Figure 1 As shown, the avatar control server 10a includes an avatar control device 103 of the third embodiment, which has the same configuration as the avatar control device 101. Fig.11 The flowchart shown in the figure explains the processing for causing a computer to execute the operation of the avatar control device 103 of the third embodiment, the avatar control method of the third embodiment, and the avatar control program of the third embodiment.

[0094] exist Fig.11 In step S31, if the processing of the avatar control device 103 starts, the control unit 9 determines whether the number of connected user terminals 20 exceeds the predetermined number. If the number of user terminals 20 exceeds the predetermined number (yes), the control unit 9 instructs the user terminal 20 of the user corresponding to the avatar whose motion is less than the predetermined size to stop sending the motion detection signal in step S32, and transfers the processing to step S310. If the number of user terminals 20 does not exceed the predetermined number (no), the control unit 9 transfers the processing to step S310. Steps S33 to S310 are the same as Figure 8 Steps S3 to S10 are the same.

[0095] The avatar control device 103 of the third embodiment includes: an avatar generation unit 7 that draws an avatar Av corresponding to each user to generate each avatar; and an avatar action setting unit 4 that sets the action of each avatar based on the action detection signal generated by the action sensor 21 that obtains the action of each user. When the number of avatars generated by the avatar generation unit 7 exceeds a predetermined number, the avatar action setting unit 4 sets the avatar whose action is less than a predetermined size to a static state or a specific action regardless of the action detection signal generated by the action sensor 21. The specific action here can be an action smaller than the predetermined size mentioned above.

[0096] The avatar control method and the avatar control program of the third embodiment draw avatars corresponding to each user to generate each avatar, and set the action of each avatar based on the action detection signal generated by the action sensor 21 that obtains the action of each user. When the number of generated avatars exceeds a predetermined number, the avatar control method and the avatar control program of the third embodiment set the avatar corresponding to the user whose action is less than a predetermined size to a static state or a specific action regardless of the action detection signal generated by the action sensor 21.

[0097] Therefore, according to the avatar control device 103, the avatar control method, and the avatar control program of the third embodiment, it is possible to control so that the avatar Av corresponding to the user is generated while preventing the drawing load or the communication load from being too large. Since it is considered that the avatar whose movement is less than a predetermined size does not perform such an important movement, even if it is set to a stationary state, other users other than the user corresponding to the avatar set to the stationary state rarely feel discomfort.

[0098] The avatar control device 103, avatar control method and avatar control program of the third embodiment can also set the avatar corresponding to the user whose movement is less than a predetermined size to a static state or a specific movement, regardless of whether the number of generated avatars exceeds a predetermined number, and regardless of the motion detection signal generated by the motion sensor 21.

[0099] <Fourth Embodiment>

[0100] like Fig. 9 As shown, each user terminal 20 includes an avatar control device 224 of the fourth embodiment having the same structure as the avatar control device 222. When the number of user terminals 20 connected to the avatar control server 10b exceeds a predetermined number, the control unit 9 of the avatar control server 10b instructs the user terminal 20 corresponding to the avatar whose motion is less than a predetermined size not to send a skeletal motion signal to the avatar control server 10b based on the skeletal motion signal sent from each user terminal 20. The user terminal 20 instructed not to send a skeletal motion signal to the avatar control server 10b stops sending the skeletal motion signal to the avatar control server 10b.

[0101] Operation of the avatar control device 224 of the fourth embodiment, the avatar control method of the fourth embodiment, and the avatar control program of the fourth embodiment and Fig.10 same.

[0102] The avatar control device 224 of the fourth embodiment includes: an avatar generation unit 207 that draws an avatar Av corresponding to each user to generate each avatar; and an avatar action setting unit 204 that sets the action of each avatar based on the action detection signal generated by the action sensor 21 that obtains the action of each user. When the number of avatars generated by the avatar generation unit 207 exceeds a predetermined number, the avatar action setting unit 204 sets the avatars whose actions are less than a predetermined size to a static state regardless of the action detection signal generated by the action sensor 21.

[0103] The avatar control method and the avatar control program of the fourth embodiment draw avatars corresponding to each user to generate each avatar, and set the action of each avatar based on the action detection signal generated by the action sensor 21 that obtains the action of each user. When the number of generated avatars exceeds a predetermined number, the avatar control method and the avatar control program of the fourth embodiment set the avatar corresponding to the user whose action is less than a predetermined size to a static state regardless of the action detection signal generated by the action sensor 21.

[0104] Therefore, according to the avatar control device 224, the avatar control method, and the avatar control program of the fourth embodiment, control can be performed so that the avatar Av corresponding to the user is generated while preventing the drawing load or the communication load from being too large. Since it is considered that the avatar whose movement is less than a predetermined size does not perform such an important movement, even if it is set to a stationary state, other users other than the user corresponding to the avatar set to the stationary state rarely feel discomfort.

[0105] The avatar control device 224, avatar control method and avatar control program of the fourth embodiment can also set the avatar corresponding to the user whose movement is less than a predetermined size to a stationary state or a specific movement, regardless of whether the number of generated avatars exceeds a predetermined number, and regardless of the motion detection signal generated by the motion sensor 21.

[0106] The present invention is not limited to the first to fourth embodiments described above, and various modifications can be made without departing from the gist of the present invention.

[0107] This application claims priority based on Japanese Patent Application No. 2022-133533 filed with the Japan Patent Office on August 24, 2022, the entire disclosure of which is incorporated herein by reference.

Claims

1. An avatar control device, comprising: an avatar generation unit that draws avatars corresponding to respective users to generate respective avatars; as well as The avatar action setting unit sets whether to reflect actions of at least a part of users on the avatars, based on the number of avatars generated by the avatar generation unit.

2. The avatar control device according to claim 1, wherein: When the number of avatars generated by the avatar generating unit exceeds a predetermined number, the avatar action setting unit sets so that actions of selecting some users based on the number of other avatars viewing the user's avatar are not reflected on the avatar.

3. The avatar control device according to claim 2, wherein: The user terminal held by each user sends a motion detection signal or a body motion signal to the avatar control device, wherein the motion detection signal is generated by a motion sensor that detects the motion of each user, and the body motion signal represents the body motion of each user generated based on the motion detection signal. The avatar control device further includes a control unit, the control unit instructing user terminals of some users not to send the motion detection signal or the body motion signal to the avatar control device, the some users selecting based on the number of other avatars viewing their own avatars, The avatar motion setting unit sets so that the motion of the following user is not reflected on the avatar, and the user is a user who holds a user terminal instructed by the control unit not to send the motion detection signal or the body motion signal to the avatar control device.

4. The avatar control device according to claim 1, wherein: The avatar control device is provided in an avatar control server, and the avatar control server is connected to a user terminal held by each user via a network. Each user terminal sends a motion detection signal or a body motion signal to the avatar control server, wherein the motion detection signal is generated by a motion sensor that detects the motion of each user, and the body motion signal represents the body motion of each user generated based on the motion detection signal. The avatar control device obtains the number of user terminals connected to the avatar control server, The avatar control device further includes a control unit which, when the number of user terminals connected to the avatar control server exceeds a predetermined number, instructs at least some of the user terminals not to send the motion detection signal or the body motion signal to the avatar control server.

5. The avatar control device according to claim 1, wherein: The avatar control device is arranged in a user terminal held by each user. The user terminal sends a body motion signal representing the body motion of the user generated based on a motion detection signal generated by a motion sensor that detects the motion of the user holding the user terminal to an avatar control server connected via a network, The user terminal acquires the body motion signal generated by other user terminals other than the user terminal itself from the avatar control server, The avatar control device also includes a control unit. Once the number of user terminals connected to the avatar control server exceeds a predetermined number and an instruction signal sent by the avatar control server indicating not to send the body motion signal to the avatar control server is obtained, the control unit controls so that the body motion signal is not sent to the avatar control server.

6. An avatar control device, comprising: an avatar generation unit that draws avatars corresponding to respective users to generate respective avatars; an avatar action setting unit, which sets whether to reflect the actions of each user on the avatar; a tracking loss detection unit that detects a state in which a motion detection signal corresponding to the motion of each user is no longer generated as a tracking loss; as well as a specific posture data holding unit for holding specific posture data for making the avatar in a static state or in a specific action, The avatar action setting unit sets, among the avatars corresponding to the user whose tracking loss is detected by the tracking loss detection unit, an avatar whose number of other avatars viewing its own avatar is less than a predetermined number to a static state based on the specific posture data maintained in the specific posture data maintenance unit, and sets an avatar whose number of other avatars viewing its own avatar exceeds the predetermined number to a specific action based on the specific posture data maintained in the specific posture data maintenance unit.

7. An avatar control device, comprising: an avatar generation unit that draws avatars corresponding to respective users to generate respective avatars; an avatar action setting unit, which sets whether to reflect the actions of each user on the avatar; a tracking loss detection unit that detects a state in which a motion detection signal corresponding to the motion of each user is no longer generated as a tracking loss; as well as a specific posture data holding unit for holding specific posture data for making the avatar in a static state or in a specific action, The avatar motion setting unit sets, among the avatars corresponding to the user whose tracking loss is detected by the tracking loss detection unit, an avatar whose motion is less than or equal to a predetermined size before the tracking loss is detected to a stationary state based on the specific posture data maintained in the specific posture data maintaining unit, and sets an avatar whose motion exceeds the predetermined size before the tracking loss is detected to a specific motion based on the specific posture data maintained in the specific posture data maintaining unit.

8. A method for controlling an avatar, Drawing an avatar corresponding to each user to generate each avatar, According to the number of generated avatars, it is set so that the actions of at least some users are reflected on the avatars.

9. An avatar control program causes a computer to execute the following steps: Drawing avatars corresponding to respective users to generate respective avatars; and Whether or not to reflect the actions of at least a part of the users on the avatars is set according to the number of avatars generated.

Images