Display control device, display control method, and display system

Abstract

The terminal (10) of the present embodiment is a display control device for displaying a virtual space including an avatar operated by a user wearing a head-mounted display. The display control device includes: an avatar control unit (11) that generates control data of an avatar corresponding to the user's actions; an arithmetic unit (13) that calculates the physical behavior of the avatar and an object corresponding to a collision when the avatar collides with the object; a VR space management unit (12) that applies the calculation result of the arithmetic unit (13) to the virtual space; and a rendering unit (14) that renders an avatar in which the behavior corresponding to the collision is suppressed within a predetermined range as an image provided to the head-mounted display when the posture of the avatar to which the calculation result is applied deviates from the posture of the avatar based on the user's operation by more than a specified amount.

Description

Technical Field

[0001] The invention relates to a display control device, a display control method and a display system. Background Art

[0002] In recent years, services that allow users to operate avatars in a virtual reality (VR) space to distribute programs or communicate with each other via avatars have become popular.

[0003] When an object placed in the VR space by the viewer collides with a virtual image, or when virtual images come into contact with each other, or when an object collides with a virtual image operated by the user, if the virtual image does not react in a timing consistent with the collision with the object, the viewer cannot truly feel that the object and the virtual image have collided.

[0004] Non-patent document 1 proposes a technology for automatically generating a reaction action of an avatar through a physical engine when an avatar collides with an object. In non-patent document 1, a reaction corresponding to the collision with the object is automatically performed, so the user does not need to perform an action in accordance with the timing of the collision with the object. In addition, when an avatar contacts another avatar or an object, the arm of the avatar does not penetrate the object, so that a more realistic image can be delivered.

[0005] Prior art literature

[0006] Non-patent literature

[0007] Non-patent document 1: Ken Sugimori, 4 other people, "Acting support! Vtuber avatar that moves freely when winning a gift (Sugimori Ken, 4 people outside, acting skills! ギフトが道たると胜手に动くVTuber", CEDEC2019, Computer Entertainment Association (Computer Entertainment Association), September 4, 2019 Summary of the invention

[0008] Problems to be solved by the invention

[0009] However, in non-patent document 1, when a virtual image collides with an object, the virtual image reacts automatically regardless of the intention of the user operating the virtual image. Therefore, there is a problem that the state of the virtual image that the user wants is inconsistent with the state of the virtual image that the user sees, and the user feels a sense of disharmony.

[0010] The present invention has been made in view of the above circumstances, and an object of the present invention is to make the collision between a virtual character and an object realistic and to reduce the sense of discomfort for a user operating the virtual character.

[0011] Means for solving problems

[0012] A display control device according to an aspect of the present invention is used to display a virtual space including an avatar operated by a user wearing a head-mounted display. The display control device includes: an avatar control unit that generates control data of the avatar corresponding to the user's actions; an arithmetic unit that calculates physical behaviors of the avatar and the object corresponding to the collision when the avatar collides with an object; a virtual space management unit that applies the calculation result of the arithmetic unit to the virtual space; and a rendering unit that renders the avatar in which the behavior corresponding to the collision is suppressed within a predetermined range as an image provided to the head-mounted display when the posture of the avatar to which the calculation result is applied deviates from a predetermined value or more from the posture of the avatar based on the user's operation.

[0013] Advantages of the Invention

[0014] According to the present invention, it is possible to make the collision between the avatar and the object realistic and it is difficult for the user operating the avatar to feel a sense of discomfort. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 The figure showing a structural example of a display system including a display control terminal according to the first embodiment.

[0016] Figure 2 The functional block diagram showing a structural example of the display control terminal according to the first embodiment.

[0017] Figure 3 The flowchart showing the processing flow of the display control terminal according to the first embodiment.

[0018] Figure 4 The figure showing an example of an avatar when no collision processing is performed.

[0019] Figure 5 The figure showing an example of an avatar when collision processing is performed.

[0020] Figure 6 The figure showing an example when collision processing is performed only on one avatar.

[0021] Figure 7 The figure showing an example when collision processing is performed only on another avatar.

[0022] Figure 8 The figure showing an example of an avatar when no collision processing is performed.

[0023] Figure 9 The figure showing an example of an avatar when collision processing is performed.

[0024] Figure 10 This is a diagram showing the structural example of an image distribution system including a display control terminal according to the second embodiment.

[0025] Figure 11 This is a functional block diagram showing the structural example of the display control terminal according to the second embodiment.

[0026] Figure 12 This is a flowchart showing the processing flow of the display control terminal according to the second embodiment. Detailed implementation mode

[0027] [First embodiment]

[0028] Hereinafter, a display system including a display control terminal according to the first embodiment will be described with reference to the accompanying drawings.

[0029] A display system including a display control terminal according to the first embodiment is a system in which users respectively operate virtual avatars in a virtual space, chat in the virtual space via the virtual avatars, and can communicate with each other over the network.

[0030] Figure 1 The display system includes a plurality of terminals 10 communicably connected via a network. Each terminal 10 is a display control terminal according to the first embodiment. In Figure 1 , only two terminals 10 are illustrated, but three or more users can participate in the chat, and the number of terminals 10 is arbitrary.

[0031] A controller 20 and a head-mounted display (HMD) 30 are connected to each terminal 10. A user can operate a virtual avatar through the controller 20 and can wear the HMD 30 to observe the virtual space from the viewpoint of the virtual avatar. The HMD 30 includes a microphone and a speaker. The sound of the user collected by the microphone is sent to the terminals 10 of other users. In addition, the sound of other users received from the terminals 10 of other users is output from the speaker.

[0032] The virtual avatars operated by each user exist in the same virtual space. It is possible to synchronize the data of the virtual space between the terminals 10, or the data of the virtual space can be managed by any one of the terminals 10.

[0033] Refer to Figure 2 to describe the structure of the terminal 10. Figure 2The terminal 10 used by each user is shown. The terminal 10 includes an avatar control unit 11, a VR space management unit 12, an arithmetic unit 13, a rendering unit 14, and a communication unit 15. The terminal 10 can use, for example, a general-purpose computer system including a central processing unit (CPU), a memory, a storage device, a communication device, and an input / output device. In this computer system, the CPU executes a predetermined program loaded onto the memory to implement each unit of the terminal 10. This program can be recorded in a computer-readable recording medium such as a magnetic disk, an optical disk, or a semiconductor memory, or can be distributed via a network.

[0034] The avatar control unit 11 receives the user's posture, position, and operation information from devices such as the controller 20, and generates control data for controlling the posture and movement of the user's own avatar. The control data is motion data obtained by motion-capturing the user's movement. Hereinafter, when distinguishing between the avatar operated by the user himself / herself and the avatars operated by other users, the user's own avatar is sometimes referred to as the "user avatar", and the avatars of other users are referred to as "other avatars".

[0035] The VR space management unit 12 manages the data of the objects existing in the virtual space. As the data of the objects, it includes the model data and the position data of the objects. The avatar is one of the objects existing in the virtual space. As the data related to the avatar, for example, there are model data and control data. Each terminal 10 acquires the data of the virtual space in advance. For example, each terminal 10 can acquire the data of the virtual space from a data server (not shown), or can acquire the data of the virtual space from other terminals 10.

[0036] The VR space management unit 12 applies the control data generated by the avatar control unit 11 to the user avatar to update the posture and position of the user avatar, and applies the control data received from the terminals 10 of other users to the other avatars. In addition, if there are moving objects in the virtual space, the VR space management unit 12 updates the postures and positions of the objects according to the movement. The data of the virtual space is managed synchronously between the terminals 10, and the virtual spaces managed by each terminal 10 become the same virtual space. The virtual space can be managed by any one of the terminals 10, or can be managed by a server (not shown). In the case where the virtual space is managed by a specific device, each terminal 10 acquires the data of the virtual space from that device.

[0037] When a collision occurs between objects (including avatars) in the virtual space, the arithmetic unit 13 calculates the physical behaviors of the respective objects corresponding to the collision. The arithmetic unit 13 can utilize a known physical operation engine.

[0038] The VR Space Management Unit 12 updates the poses and positions of each object based on the calculation results. For the user avatar, in addition to managing the information on the pose and position of the user avatar after applying the calculation results, the VR Space Management Unit 12 also manages the information on the pose and position of the user avatar in the state where the calculation results are not applied. Alternatively, the VR Space Management Unit 12 can manage the information on the pose and position of the user avatar in the state where the calculation results are calculated by changing the parameters, or can manage the information on the pose and position of the user avatar in the state where the calculation results are applied by changing the application degree.

[0039] The Rendering Unit 14 renders the virtual space from the viewpoint of the user avatar and supplies the rendered image to the HMD 30. At this time, for the user avatar, the Rendering Unit 14 replaces the information on the pose and position of the user avatar managed separately in such a way that the reaction actions of the user avatar are suppressed within a predetermined range, and renders the user avatar. The predetermined range means the range within which the user does not feel a sense of discomfort. For example, whether it is within the predetermined range can be determined based on the deviation degree between the pose of the reaction action of the user avatar and the pose of the user's operation and the length of the reaction action.

[0040] As a method of suppressing the reaction actions of the user avatar within a predetermined range in the image supplied to the HMD 30, the Rendering Unit 14 renders the user avatar in the state where the calculation results are not applied.

[0041] Alternatively, as the calculation results applied by the Rendering Unit 14 to the user avatar, the Arithmetic Unit 13 can also calculate the behavior of the user avatar when parameters such as the weight of the object colliding with the user avatar are changed, and the Rendering Unit 14 renders the user avatar to which the calculation results after changing the parameters are applied. By treating the object colliding with the user avatar as a lighter object, the reaction actions of the user avatar can be suppressed, so it is difficult for the user to feel a sense of discomfort.

[0042] Alternatively, the Rendering Unit 14 can also change the application degree and render the user avatar to which the calculation results are applied. For example, when a heavier object collides with the user avatar, if the calculation results of the Arithmetic Unit 13 are applied, the user avatar shows a large stagger. In this case, when rendering the user avatar, the Rendering Unit 14 suppresses the application degree of the calculation results in such a way that the reaction actions of the user avatar become small reaction actions within the range where the user does not feel a sense of discomfort, and applies the calculation results to the user avatar.

[0043] In any case, others other than the user see the normal calculation result of the application operation unit 13 and a user avatar with a large reaction. In the image provided to the HMD 30, the reaction action of the user avatar based on the calculation result of the operation unit 13 is replaced for rendering, so the reaction action of the user avatar seen by others is different from the reaction action of the user avatar seen or felt by the user himself.

[0044] In addition, when the user avatar makes a reaction action equal to or greater than a predetermined level due to the collision of an object, the calculation result may not be applied to the user avatar, or the application degree of the calculation result may be suppressed, or the calculation result calculated by changing parameters may be applied. That is, when the posture of the user avatar to which the calculation result is applied deviates from the posture of the user avatar based on the user's operation by more than a predetermined level, the rendering unit 14 can make the calculation result applied to the user avatar different.

[0045] The communication unit 15 transmits and receives the control data of the user avatar and the voice data of the user between the terminals 10 of other users. More specifically, the communication unit 15 transmits the control data of the user avatar generated by the virtual avatar control unit 11 to the terminals 10 of other users, and receives the control data of other avatars from the terminals 10 of other users. In addition, the communication unit 15 transmits the voice data of the user collected by the microphone of the HMD 30 to the terminals 10 of other users, and receives the voice data of other users from the terminals 10 of other users.

[0046] In addition, any one of the terminals 10 may not have the operation unit 13, but receive the calculation result of the operation unit 13 and the data of the virtual space after applying the calculation result from other terminals 10. For example, Figure 2 in the case where the terminal 10 on the left (hereinafter referred to as terminal 10A) has the operation unit 13 and the terminal 10 on the right (hereinafter referred to as terminal 10B) does not have the operation unit 13, terminal 10B receives the data of the virtual space after applying the calculation result from terminal 10A. At this time, for the user avatar B of user B of terminal 10B, the rendering unit 14 of terminal 10B replaces the posture and position of the user avatar B to which the calculation result is applied with the posture and position of the user avatar B to which the calculation result is not applied, and renders the virtual space.

[0047] As long as the above functions can be implemented in the entire system, the device for processing each part of the execution terminal 10 is not limited. For example, a server (not shown) may also have a VR space management unit 12 and a calculation unit 13. The server receives the control data of the virtual avatar from each terminal 10. The VR space management unit 12 applies the control data to the virtual avatar in the virtual space, and the calculation unit 13 performs collision processing and applies the calculation result to the virtual space. Each terminal 10 receives the data of the virtual space after applying the calculation result from the server. At this time, for the user virtual avatar of the user using the terminal 10, the rendering unit 14 of each terminal 10 replaces the posture and position of the user virtual avatar to which the calculation result has been applied with the posture and position of the user virtual avatar to which the calculation result has not been applied, and renders the virtual space.

[0048] In addition, the server may also have a rendering unit 14. The server receives the line-of-sight information of the user from the terminals 10A and 10B respectively. The rendering unit 14 sends the image of the virtual space in which the calculation result is not applied to the user virtual avatar A to the terminal 10A, and provides the image of the virtual space in which the calculation result is not applied to the user virtual avatar B to the terminal 10B. In this case, the terminals 10A and 10B only need to have the function of capturing the movements of users A and B and the function of displaying the received image.

[0049] Refer to Figure 3 the flowchart to explain the operation of the terminal 10. Hereinafter, the case where the calculation result is not applied to the user virtual avatar will be described, but the same applies to the case where the application degree of the calculation result is suppressed or the calculation result calculated by applying changed parameters is used.

[0050] In step S11, the virtual avatar control unit 11 receives information such as the user's posture from the controller 20 and generates control data for the user virtual avatar. The communication unit 15 sends the control data generated by the virtual avatar control unit 11 to other terminals 10.

[0051] In step S12, the communication unit 15 receives the control data of other virtual avatars from other terminals 10.

[0052] In step S13, the VR space management unit 12 applies the control data to the virtual avatar and updates the posture and position of the moving object.

[0053] In step S14, the calculation unit 13 performs collision processing between objects. For example, the calculation unit 13 determines whether there are colliding objects, and for the colliding objects, obtains information such as the collision position, collision direction, and overlapping depth, and calculates the behavior of each object corresponding to the collision based on information such as the mass, speed, and bounce coefficient of the object.

[0054] In step S15, the VR space management unit 12 reflects the calculation result of the arithmetic unit 13 in the virtual space and updates the pose and position of the object. For example, when the virtual avatar 100A performs an action of hitting the head of the virtual avatar 100B, as Figure 4 shown, the arm of the virtual avatar 100A collides with the head of the virtual avatar 100B. If the calculation results of the arithmetic unit 13 are respectively reflected in the virtual avatars 100A and 100B, then as Figure 5 shown, it becomes a state where the arm of the virtual avatar 100A and the head of the virtual avatar 100B do not dent (do not sink in).

[0055] In addition, the VR space management unit 12 independently manages the pose and position of the user's virtual avatar in a state where the calculation result is not applied. For example, it manages the Figure 4 pose and position of the virtual avatar 100A respectively. The VR space management unit 12 can separately manage the pose and position of the applied user virtual avatar by changing the application degree of the calculation result, or can also separately manage the pose and position of the user virtual avatar to which the calculation result calculated by changing the parameters is applied.

[0056] In step S16, the rendering unit 14 renders the virtual space without applying the calculation result to the user virtual avatar, and provides the rendered image to the HMD 30.

[0057] For example, when the calculation result is applied to the virtual avatar 100A, the position of the arm of the virtual avatar 100A becomes Figure 5 the position shown. However, since the user has performed an operation of lowering the arm of the virtual avatar 100A to Figure 4 the position shown, the user's operation is inconsistent with the pose of the virtual avatar 100A, and the user will feel a sense of discomfort.

[0058] Therefore, in the present embodiment, the pose and position of the user virtual avatar to which the calculation result is not applied are also pre-managed, and the rendering unit 14 replaces the user virtual avatar to which the calculation result is applied with the user virtual avatar to which the calculation result is not applied, and renders the virtual space. For example, as Figure 6 shown, an image is presented to the user operating the virtual avatar 100A, in which the virtual avatar 100A is replaced with the virtual avatar 100A to which the calculation result is not applied ( Figure 4 the virtual avatar 100A) and is rendered. In Figure 6 , the calculation result is applied to the virtual avatar 100B. On the other hand, as Figure 7 shown, an image is presented to the user operating the virtual avatar 100B, in which the virtual avatar 100B is replaced with the virtual avatar 100B to which the calculation result is not applied ( Figure 4 the virtual avatar 100B) and is rendered. In Figure 7In this case, the calculation result is applied to the virtual avatar 100A. In addition, to users other than the user operating the virtual avatars 100A and 100B, a Figure 5 video is presented that shows the virtual avatars 100A and 100B to which the calculation result has been applied and that have been rendered.

[0059] The collision between the virtual avatar and an object other than the virtual avatar is also processed in the same way. For example, as Figure 8 shown, it is assumed that the object 110 has collided with the virtual avatar 100. When the calculation results of the arithmetic unit 13 are respectively reflected in the virtual avatar 100 and the object 110, as Figure 9 shown, the posture of the virtual avatar 100 becomes a state in which it is greatly deformed.

[0060] A video is provided to the user operating the virtual avatar 100 that shows the virtual avatar 100 that has not had the calculation result applied and that has been rendered. A video is provided to other users that shows the virtual avatar 100 to which the calculation result has been applied and that has been rendered. Figure 8 Figure 9

[0061]

[0062] As described above, according to the present embodiment, the arithmetic unit 13 performs collision processing of objects to calculate the physical behavior of each object, the VR space management unit 12 applies the calculation results of the arithmetic unit 13 to each object, and when the rendering unit 14 renders the video supplied to the HMD 30 worn by the user, for the user virtual avatar operated by the user, the user virtual avatar is rendered in such a way that the reaction action of the user virtual avatar is suppressed within a predetermined range. As a result, it is possible to present to others other than the user a user virtual avatar that reacts according to a collision with an object, and it is possible to present to the user a user virtual avatar in which the reaction action is suppressed. Therefore, the user does not feel a sense of incongruity with respect to the movement of the user virtual avatar, and the collision of the object with the user virtual avatar can be made realistic.

[0062] [Second Embodiment]

[0063] Hereinafter, an image distribution system including a display control terminal according to the second embodiment will be described with reference to the drawings.

[0064] The image distribution system including a display control terminal according to the second embodiment is a system in which a distributor operates a distributor virtual avatar in a virtual space and distributes an image in the virtual space to viewers. The viewers can not only watch the image, but also make the viewer virtual avatar operated by the viewer participate in the same virtual space as the distributor virtual avatar.

[0065] Figure 10The image distribution system has a distributor terminal 40 and a distribution server 50 that serve as the display control terminal in the second embodiment. The distributor terminal 40 and the distribution server 50 are communicably connected via a network.

[0066] The distribution server 50 receives the image rendering the virtual space from the distributor terminal 40 and distributes the received image to the viewer terminal 60. The distribution server 50 can perform live image distribution of the received image in real time, or can pre-store the received image and distribute the image according to a request from the viewer terminal 60.

[0067] The viewer terminal 60 is a terminal for viewers to view images. As long as it is a device capable of viewing the distributed images, devices such as portable terminals and personal computers can be used as the viewer terminal 60. The viewer terminal 60 can also receive the data of the virtual space and render the virtual space. In addition, when the viewer participates in the live image distribution, the viewer terminal 60 is connected to an HMD, a controller, etc., and uses a device with VR function. For example, the terminal 10 of the first embodiment is used as the viewer terminal 60 to synchronize the data of the virtual space with the distributor terminal 40.

[0068] Refer to Figure 11 and the structure of the distributor terminal 40 will be described. The distributor terminal 40 includes an avatar control unit 11, a VR space management unit 12, an arithmetic unit 13, a rendering unit 14, a communication unit 15, a distribution image rendering unit 16, and a distribution unit 17. The distributor terminal 40 has a distribution image rendering unit 16 for rendering the image for distribution and a distribution unit 17 for distributing the image in the terminal 10 of the first embodiment.

[0069] The avatar control unit 11 receives the posture, position, and operation information of the distributor from devices such as the controller 20, and generates control data for controlling the posture and movement of the distributor avatar.

[0070] The VR space management unit 12 manages the data of the objects existing in the virtual space. The VR space management unit 12 applies the control data generated by the avatar control unit 11 to the distributor avatar to update the posture and position of the distributor avatar. When the viewer participates, the VR space management unit 12 applies the control data received from the viewer terminal 60 of the participating viewer to the model data of the viewer avatar.

[0071] When a collision occurs between objects in the virtual space, the arithmetic unit 13 calculates the physical behavior of the object corresponding to the collision. For the distributor avatar, the VR space management unit 12 manages not only the information on the posture and position of the distributor avatar after applying the calculation result, but also the information on the posture and position of the distributor avatar in the state where the calculation result has not been applied. Similarly to the first embodiment, the VR space management unit 12 can manage the information on the posture and position of the distributor avatar in the state where the calculation result is calculated by changing the parameters, or can manage the information on the posture and position of the distributor avatar in the state where the calculation result is applied by changing the application degree.

[0072] The rendering unit 14 does not apply the calculation result to the distributor avatar, but renders the virtual space from the viewpoint of the distributor avatar, and provides the rendered image to the HMD 30. Similarly to the first embodiment, for the distributor avatar, the rendering unit 14 renders the distributor avatar in such a manner that the reaction action of the distributor avatar is suppressed within a predetermined range.

[0073] The communication unit 15 transmits and receives control data and sound data of the avatar between the viewer terminal 60 of the participating viewer. In addition, the communication unit 15 can receive comments (text information), gifts, equipment (items), and other information from the viewer terminal 60. For the comments received from the viewer terminal 60, the distributor terminal 40 can also display an object showing the comment content in the virtual space. The distributor terminal 40 can also make an object corresponding to the gift or equipment received from the viewer terminal 60 appear in the virtual space. When an object corresponding to these comments, gifts, and equipment collides with the distributor avatar, the distributor avatar makes a reaction action based on the calculation result of the arithmetic unit 13.

[0074] The distribution image rendering unit 16 renders the virtual space to which the calculation result of the arithmetic unit 13 is also applied to generate a distribution image. The distribution image rendering unit 16 can render the virtual space from the viewpoint of the distributor avatar or from the viewpoint of a virtual camera arranged in the virtual space. It is also possible to attach the sound data of the distributor and the participants to the distribution image.

[0075] The distribution unit 17 sends the distribution image rendered by the distribution image rendering unit 16 to the distribution server 50. The distribution server 50 distributes the received image to each viewer terminal 60.

[0076] In addition, the distribution server 50 may also include a distribution image rendering unit 16 and a distribution unit 17. In this case, the distribution server 50 stores the data of the virtual space and synchronizes the data of the virtual space with the distributor terminal 40. The distribution server 50 renders the virtual space and distributes it to the viewer terminal 60. The distribution server 50 may also include a VR space management unit 12 and a calculation unit 13 to manage the data of the virtual space, and the distributor terminal 40 obtains the data of the virtual space from the distribution server 50. The rendering unit 14 of the distributor terminal 40 renders the virtual space by replacing the distributor avatar with the distributor avatar without applying the calculation result of the calculation unit 13. The distribution server 50 may also include a rendering unit 14 to render the image supplied to the distributor's HMD 30.

[0077] Refer to Figure 12 the flowchart of to explain the operation of the distributor terminal 40. Hereinafter, the case where the calculation result is not applied to the distributor avatar will be described, but the same applies to the case where the application degree of the calculation result is suppressed or the calculation result calculated by applying changed parameters is used.

[0078] In step S21, the avatar control unit 11 receives information such as the posture of the distributor from the controller 20 and generates control data for the distributor avatar. When a viewer participates, the communication unit 15 sends the control data generated by the avatar control unit 11 to the viewer terminal 60 of the participating viewer.

[0079] In step S22, the VR space management unit 12 applies the control data to the avatar and updates the posture and position of the moving object. In addition, the VR space management unit 12 applies the control data received from the viewer terminal 60 of the participating viewer to the viewer avatar.

[0080] In step S23, the calculation unit 13 performs collision processing between objects.

[0081] In step S24, the VR space management unit 12 reflects the calculation result of the calculation unit 13 in the virtual space and updates the posture and position of the object. At this time, the VR space management unit 12 manages the posture and position of the distributor avatar in the state where the calculation result is not applied respectively.

[0082] In step S25, the distribution image rendering unit 16 renders the virtual space to which the calculation result of the calculation unit 13 is applied to generate a distribution image. For example, as Figure 9 shown, the distribution image rendering unit 16 renders the virtual space to which the calculation result is applied to the avatar.

[0083] In step S26, the distribution unit 17 sends the distribution image.

[0084] In step S27, the rendering unit 14 renders the virtual space without applying the calculation result to the distributor avatar, and provides the rendered image to the HMD 30. For example, as Figure 8 shown, the rendering unit 14 renders the virtual space without applying the calculation result to the avatar. That is, the rendering unit 14 renders the virtual space in which the distributor avatar is replaced with an avatar to which the calculation result is not applied.

[0085] In addition, when the calculation result is not applied to the distributor avatar, the distributor may not notice that the object has collided with the distributor avatar. Therefore, the distributor terminal 40 may also have a function of notifying the distributor of the collision between the distributor avatar and the object.

[0086] For example, when the distributor avatar collides with an object, the distributor terminal 40 notifies the distributor by sound. At the moment of collision when the distributor avatar collides with an object, both the distributor and the viewer can hear a sound corresponding to the collision. During the period when the distributor avatar is in contact with the object, only the distributor hears the sound notifying the contact. As Figure 8 、 9 shown, when the object 110 collides with the head of the avatar 100, at the moment of collision, the distributor and the viewer hear the sound effect of the collision between the object 110 and the avatar 100. After that, during the period when the object 110 is resting on the head of the avatar 100, only the distributor continuously hears the sound indicating the collision between the object 110 and the avatar 100.

[0087] Alternatively, the distributor terminal 40 enables the distributor to see the image seen by the viewer. The image seen by the viewer is displayed on a monitor in the virtual space. For example, a monitor is arranged in front of the line of sight of the distributor avatar in advance.

[0088] Alternatively, the rendering unit 14 renders not only the user avatar that suppresses the reaction action within a predetermined range but also the user avatar to which the calculation result is applied. At this time, the rendering unit 14 makes the user avatar to which the calculation result is applied semi-transparent or the like and depicts it by changing the display method.

[0089] The structure for notifying the collision between the avatar and the object may also be applied to the first embodiment.

[0090] As described above, according to the present embodiment, the arithmetic unit 13 performs collision processing of objects to calculate the physical behavior of each object, and the VR space management unit 12 applies the calculation result of the arithmetic unit 13 to each object. When the rendering unit 14 renders the image supplied to the HMD 30 worn by the user, for the avatar operated by the distributor, the avatar of the distributor is rendered in such a way that the reaction action of the avatar of the distributor is suppressed within a predetermined range. Thus, it is possible to present to the viewer an avatar of the distributor that reacts according to the collision with the object, and it is possible to present to the distributor an avatar of the distributor with the reaction action suppressed. Therefore, it is possible to prevent the distributor from feeling a sense of incongruity with the movement of the avatar of the distributor, and to give a sense of reality to the collision of the object with the avatar of the distributor.

[0091] Reference Signs

[0092] 10…Terminal; 11…Avatar control unit; 12…VR space management unit; 13…Arithmetic unit; 14…Rendering unit; 15…Communication unit; 16…Distributed image rendering unit; 17…Distribution unit; 20…Controller; 30…HMD; 40…Distributor terminal; 50…Distribution server; 60…Viewer terminal.

Claims

1. A display control device for displaying a virtual space including an avatar operated by a user wearing a head-mounted display, characterized in that, The display control device includes: An avatar control unit that generates control data of the avatar corresponding to the actions of the user; An arithmetic unit that calculates the physical behaviors of the avatar and the object corresponding to the collision when the avatar collides with the object; A virtual space management unit that applies the calculation result of the arithmetic unit to the virtual space; And A rendering unit that renders, as an image provided to the head-mounted display, the avatar whose behavior corresponding to the collision is suppressed within a predetermined range when the posture of the avatar to which the calculation result is applied deviates from the posture of the avatar based on the user's operation by more than a specified amount, where the predetermined range means a degree within which the user does not feel a sense of discomfort.

2. The display control device according to claim 1, wherein The rendering unit does not apply the calculation result to the avatar operated by the user, changes the application degree and applies the calculation result to the avatar operated by the user, or applies other calculation results calculated by changing parameters to the avatar operated by the user, so as to render an image in which the behavior of the avatar is suppressed within a predetermined range.

3. The display control device according to claim 1 or 2, wherein The display control device includes: a notification unit that notifies the user that the avatar has collided with an object.

4. The display control device according to claim 1 or 2, wherein The display control device includes: a distribution unit that distributes an image obtained by rendering the virtual space to which the calculation result of the arithmetic unit is applied.

5. A display control method, which is executed by a display control device for displaying a virtual space including an avatar operated by a user wearing a head-mounted display, characterized in that The display control method includes the following steps: A step of generating control data of the avatar corresponding to the actions of the user; A step of calculating the physical behaviors of the avatar and the object corresponding to the collision when the avatar collides with the object; A step of applying the calculation result obtained in the calculation step to the virtual space; And A step of rendering, as an image provided to the head-mounted display, the avatar whose behavior corresponding to the collision is suppressed within a predetermined range when the posture of the avatar to which the calculation result is applied deviates from the posture of the avatar based on the user's operation by more than a specified amount, where the predetermined range means a degree within which the user does not feel a sense of discomfort.

6. A display system that includes first and second display control devices respectively used by a first user and a second user, and achieves communication in a virtual space through a first avatar and a second avatar respectively operated by the first user and the second user wearing head-mounted displays, wherein The first display control device includes: A first avatar control unit that generates control data of the first avatar corresponding to the actions of the first user; and A first rendering unit that renders the virtual space as an image provided to the head-mounted display worn by the first user, The second display control device includes: A second avatar control unit that generates control data of the second avatar corresponding to the actions of the second user; A second rendering unit that renders the virtual space as an image provided to the head-mounted display worn by the second user. At least one of the first display control device and the second display control device includes an arithmetic unit that calculates the physical behaviors of the virtual avatar and the object corresponding to a collision when the virtual avatar collides with the object. Synchronize the virtual space to which the calculation result of the arithmetic unit is applied between the first display control device and the second display control device. When the posture of the first virtual avatar to which the calculation result is applied deviates from the posture of the first virtual avatar based on the operation of the first user by more than a specified amount, the first rendering unit renders the first virtual avatar whose behavior corresponding to the collision is suppressed within a predetermined range. When the posture of the second virtual avatar to which the calculation result is applied deviates from the posture of the second virtual avatar based on the operation of the second user by more than a specified amount, the second rendering unit renders the second virtual avatar whose behavior corresponding to the collision is suppressed within a predetermined range. Herein, "within the predetermined range" means within the range where the user does not feel uncomfortable.

Images