Information processing device, control method for information processing device, program, and storage medium

Abstract

To provide a technology for facilitating switching between avatars to be used by a user.SOLUTION: Provided is an information processing device including: control means for controlling a behavior of a first avatar which is an avatar in a virtual space or a second avatar which is an avatar robot in a real space based on a user operation; and switching means for switching between a first mode of displaying virtual video of the virtual space and a second mode of displaying real viewpoint video of the second avatar in the real space based on the user operation.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an information processing device, a control method for an information processing device, a program, and a storage medium. [Background technology]

[0002] Patent document 1 discloses a technology in which a user existing in a first area of ​​real space controls the movement of a control object existing in a second area of ​​real space that is different from the first area in at least one of time and location. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6933849 Summary of the Invention [Problem to be solved by the invention]

[0004] However, the technique described in Patent Document 1 has a problem in that it is difficult to switch between an avatar in a virtual space and an avatar in a real space.

[0005] The present invention has been made in consideration of the above-mentioned problems, and has an object to provide a technique for enabling a user to easily switch between avatars to be used. [Means for solving the problem]

[0006] To achieve the above object, an information processing device according to the present invention comprises: A control means for controlling a behavior of a first avatar which is an avatar in a virtual space or a second avatar which is an avatar robot in a real space based on a user operation; a switching means for switching between a first mode for displaying a virtual image of the virtual space and a second mode for displaying a real viewpoint image of the second avatar in the real space based on the user operation; a display control means for causing a display device to display the virtual image or the real viewpoint image; Equipped with 、 the display control means, in the first mode, causes an image of a location where the second avatar is present to be superimposed on a predetermined area of ​​the virtual image; The switching means switches from the first mode to the second mode when a specific operation is performed on the predetermined area based on the user operation. It is characterized by the above. Effect of the Invention

[0007] According to the present invention, it becomes possible for a user to easily switch between avatars to be used. [Brief description of the drawings]

[0008] [Figure 1] FIG. 1 is a diagram illustrating an example of a configuration of an information processing system according to an embodiment. [Diagram 2] (a) is a diagram showing an example of the configuration of a server device (information processing device) according to one embodiment, (b) is a diagram showing an example of the configuration of an avatar robot according to one embodiment, and (c) is a diagram showing an example of the configuration of a VR goggle device according to one embodiment. [Diagram 3] (a) is a diagram showing an example of the functional configuration of a server device (information processing device) according to one embodiment, (b) is a diagram showing an example of the functional configuration of an avatar robot according to one embodiment, and (c) is a diagram showing an example of the functional configuration of a VR goggle device according to one embodiment. [Figure 4] FIG. 2 is a processing sequence diagram showing an example of a transition process from a first avatar in a virtual space to a second avatar in a real space according to an embodiment. [Diagram 5] 1 is a flowchart showing a procedure of a process performed by a server device (information processing device) according to an embodiment. [Figure 6] FIG. 11 is a processing sequence diagram showing an example of a transition process from a second avatar in real space to a first avatar in virtual space according to an embodiment. [Figure 7] 1 is a flowchart showing a procedure of a process performed by a server device (information processing device) according to an embodiment. [Figure 8] FIG. 2 is an explanatory diagram of a transition process from a first avatar in a virtual space to a second avatar in a real space according to one embodiment. [Figure 9] FIG. 11 is an explanatory diagram of a transition process from a first avatar in a virtual space to a second avatar in a real space in accordance with Modification 1. [Figure 10] FIG. 11 is an explanatory diagram of a transition process from a first avatar in a virtual space to a second avatar in a real space in accordance with Modification Example 2. [Figure 11] FIG. 13 is an explanatory diagram of a transition process from a first avatar in a virtual space to a second avatar in a real space in accordance with Modification Example 3. [Figure 12] FIG. 2 is an explanatory diagram of a transition process from a second avatar in a real space to a first avatar in a virtual space according to one embodiment. [Figure 13] FIG. 11 is an explanatory diagram of a transition process from a second avatar in a real space to a first avatar in a virtual space in accordance with Modification 1. [Figure 14] FIG. 11 is an explanatory diagram of a transition process from a second avatar in a real space to a first avatar in a virtual space in accordance with Modification Example 2. [Figure 15] FIG. 13 is an explanatory diagram of a transition process from a second avatar in a real space to a first avatar in a virtual space in accordance with Modification Example 3. [Figure 16] FIG. 13 is an explanatory diagram of a transition process from a second avatar in the real space to a first avatar in the virtual space in accordance with Modification Example 4. [Figure 17] FIG. 13 is an explanatory diagram of a transition process from a second avatar in a real space to a first avatar in a virtual space in accordance with Modification Example 5. [Figure 18] FIG. 13 is an explanatory diagram of the orientation of the first avatar after transition processing according to Modifications 2 to 5. [Figure 19] FIG. 13 is an explanatory diagram of the orientation of a first avatar after transition processing according to Modifications 2 to 5, and the distance (when close) from another content display area. [Figure 20] FIG. 13 is an explanatory diagram of the orientation of the first avatar after the transition process according to Modifications 2 to 5, and the distance (when far) from another content display area. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, the embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the invention according to the claims, and not all combinations of features described in the embodiments are essential to the invention. Two or more features among the multiple features described in the embodiments may be arbitrarily combined. In addition, the same reference numbers are used for the same or similar configurations, and duplicated descriptions are omitted.

[0010] <System configuration> FIG. 1 is a diagram showing an example of the configuration of an information processing system according to this embodiment. In FIG. 1, 10 is a server device (information processing device). 20 is an avatar robot. The avatar robot 20 is placed in the real world (for example, a resort area) and can freely move within a predetermined range of the real world (for example, a range set as a movable area within the resort area) based on a remote user operation. While checking the video captured by the avatar robot 20, the user can remotely operate the avatar robot 20 and freely change the position and / or orientation of the avatar robot 20 and further the shooting direction (viewpoint direction). By operating the avatar robot 20, the user can have an experience as if he or she had actually visited the remote real world.

[0011] 30 is a VR (Virtual Reality) goggle device. A user 50 wears the VR goggle device 30 and can view various images (for example, an image of a virtual space or an image from a real viewpoint of the avatar robot 20, etc.) or can operate the VR goggle device 30 while watching the displayed images, thereby freely operating a first avatar in a virtual space or a second avatar which is the avatar robot 20 in a real space. However, the display device is not limited to the VR goggle device 30, and may be a display of a smartphone or a PC (personal computer), or may be a projection type display which projects onto a wall, etc. 40 is a network. The server device 10, the avatar robot 20, and the VR goggle device 30 are connected via the network 40.

[0012] <Device configuration> Next, configuration examples of the server device 10, the avatar robot 20, and the VR goggle device 30 according to one embodiment of the present invention will be described with reference to Fig. 2(a) to Fig. 2(c). Fig. 2(a) is a diagram showing a configuration example of the server device 10 according to one embodiment of the present invention, Fig. 2(b) is a diagram showing a configuration example of the avatar robot 20 according to one embodiment of the present invention, and Fig. 2(c) is a diagram showing a configuration example of the VR goggle device 30 according to one embodiment of the present invention.

[0013] As shown in FIG. 2(a), the server device 10 includes a CPU 101, a storage device 102, and a communication unit 103. The control operation of the server device 10 is realized by the CPU 101 reading and executing a computer program stored in the storage device 102. The CPU 101 may be one or more CPUs. The storage device 102 is one or more memories that store various information. For example, the storage device 102 stores information received from other devices, computer programs that are read and executed by the CPU 101, and the like. The communication unit 103 has a function of communicating with other devices via the network 40 in a wired or wireless manner.

[0014] As shown in FIG. 2(b), the avatar robot 20 includes a CPU 201, a storage device 202, a communication unit 203, a photographing unit 204, and a driving unit 205. The control operation of the avatar robot 20 is realized by the CPU 201 reading and executing a computer program stored in the storage device 202. The CPU 201 may be one or more CPUs. The storage device 202 is one or more memories that store various information. For example, the storage device 202 stores information received from other devices, computer programs that are read and executed by the CPU 201, and the like. The communication unit 203 has a function of communicating with other devices via the network 40 in a wired or wireless manner.

[0015] The image capturing unit 204 is a camera, and captures a real viewpoint image of the avatar robot 20. The driving unit 205 drives wheels (not shown) that the avatar robot 20 is equipped with. This allows the avatar robot 20 to move forward and backward, move left and right, and rotate on the spot, based on remote control by the user. The driving unit 205 can also change the image capturing direction of the image capturing unit 204, based on remote control by the user.

[0016] As shown in FIG. 2(c), the VR goggle device 30 includes a CPU 301, a storage device 302, a communication unit 303, a display unit 304, an operation input unit 305, and an acceleration sensor 306. The control operation of the VR goggle device 30 is realized by the CPU 301 reading and executing a computer program stored in the storage device 302. The CPU 301 may be one or more CPUs. The storage device 302 is one or more memories that store various information. For example, the storage device 302 stores information received from other devices, computer programs that are read and executed by the CPU 301, and the like.

[0017] The communication unit 303 has a function of communicating with other devices via the network 40 in a wired or wireless manner. The display unit 304 displays various images to the user 50. The operation input unit 305 accepts input of instructions for operating the first avatar in the virtual space or the second avatar which is the avatar robot 20 in the real space. The acceleration sensor 306 detects the acceleration applied to the VR goggle device 30.

[0018] The operation input unit 305 can receive the detection result of the acceleration sensor 306 as an input of an operation instruction. For example, when the user 50 wearing the VR goggle device 30 stretches his / her back or bends his / her knees, the avatar is raised or the line of sight of the avatar is gradually changed upward. When the user 50 leans back or bends his / her knees, the avatar is lowered or the line of sight of the avatar is gradually changed downward. When the user 50 turns his / her head left, the avatar is rotated leftward. When the user 50 turns his / her head right, the avatar is rotated rightward. When the user 50 turns his / her head forward, the avatar is moved forward. When the user 50 turns his / her head back, the avatar is moved backward. When the user 50 turns his / her head left, the avatar is moved leftward. When the user 50 turns his / her head right, the avatar is moved rightward.

[0019] In this embodiment, an example in which operation input is received by the movement of the VR goggle device 30 itself will be described, but the operation input unit 305 is not limited to this example. For example, the operation input may be received using a device (such as a joystick, a game controller, or an interactive seat) separate from the VR goggle device 30. An interactive seat is a seat that can receive operation input by performing various actions on the seat unit while sitting in the chair. In this case, such a separate device may be configured to communicate with the server device 10, etc.

[0020] <Functional configuration> Next, examples of functional configurations of the server device 10, the avatar robot 20, and the VR goggle device 30 according to one embodiment of the present invention will be described with reference to Fig. 3(a) to Fig. 3(c). Fig. 3(a) is a diagram showing an example of the functional configuration of the server device 10 according to one embodiment of the present invention, Fig. 3(b) is a diagram showing an example of the functional configuration of the avatar robot 20 according to one embodiment of the present invention, and Fig. 3(c) is a diagram showing an example of the functional configuration of the VR goggle device 30 according to one embodiment of the present invention.

[0021] As shown in FIG. 3(a), the server device 10 includes a video transmission unit 1001, a video reception unit 1002, an avatar control unit 1003, a display control unit 1004, and a mode switching unit 1005. The video transmission unit 1001 transmits a video of a virtual space or a real viewpoint video of the avatar robot 20 in the real space to the VR goggle device 30. The video of the virtual space may be an overhead video that allows the appearance of the avatar in the virtual space to be visually recognized, or may be a virtual viewpoint video of the avatar placed in the virtual space. The video reception unit 1002 receives the real viewpoint video of the avatar robot 20 in the real space from the avatar robot 20.

[0022] The avatar control unit 1003 controls the behavior of the first avatar, which is an avatar in the virtual space, or the second avatar, which is the avatar robot 20 in the real space, based on a user operation using the operation input unit 305. The display control unit 1004 controls an image to be displayed on the display unit 304 of the VR goggle device 30. The mode switching unit 1005 switches between a first mode that displays a virtual image in the virtual space and a second mode that displays a real viewpoint image of the second avatar, which is the avatar robot 20 in the real space, based on a user operation.

[0023] As shown in Fig. 3(b), the avatar robot 20 includes a photographing unit 2001, a video transmission unit 2002, and a control unit 2003. The photographing unit 2001 is provided, for example, near the head of the avatar robot 20, and captures a video of the area in front of the avatar robot 20. The video captured by the photographing unit 2001 is a real viewpoint video of the avatar robot 20. The video transmission unit 2002 transmits the real viewpoint video of the avatar robot 20 captured by the photographing unit 2001 to the server device 10. The control unit 2003 controls the movement of the avatar robot 20, changes in the line of sight, and the like, based on the control by the avatar control unit 1003 of the server device 10.

[0024] As shown in Fig. 3(c), the VR goggle device 30 includes a video receiving unit 3001, a display unit 3002, and an operation input unit 3003. The video receiving unit 3001 receives a virtual video of the virtual space from the server device 10, and receives a real viewpoint video of the avatar robot 20 via the server device 10. The display unit 3002 displays the video received by the video receiving unit 3001 to the user 50. The operation input unit 3003 receives an input of an instruction to operate a first avatar, which is an avatar in the virtual space, or a second avatar, which is the avatar robot 20 in the real space.

[0025] <Transition from a first avatar in the virtual world to a second avatar in the real world> Fig. 8 is an explanatory diagram of a transition process from a first avatar in a virtual space to a second avatar in a real space according to this embodiment. The upper part of Fig. 8 shows changes in the position of the first avatar in the virtual space and the position of the second avatar in the real space. The middle part of Fig. 8 shows changes in the display image of the display unit 3002 of the VR goggles device 30 worn by the user 50 according to the changes in the position of the avatar. The lower part of Fig. 8 shows the relationship between the moving speed of the avatar (vertical axis) and the changes in the position of the first avatar in the virtual space and the position of the second avatar in the real space.

[0026] As shown in the first image from the left in the middle of Fig. 8, in a first mode in which a virtual image of a virtual space is displayed, a virtual image is displayed on the display unit 3002 of the VR goggle device 30. The first mode can include an overhead mode in which a virtual image including the first avatar 800 in the virtual space is displayed, and a virtual viewpoint mode in which a virtual image seen from the virtual viewpoint of the first avatar 800 is displayed, and the virtual image is displayed in either mode. In the first image from the left in the middle of Fig. 8, a virtual image is displayed in the overhead mode, and the first avatar 800 can be observed in the virtual space.

[0027] The virtual space is, for example, a space such as a room, and an image 811 of a location where the second avatar (avatar robot 20) exists is displayed superimposed on at least a part of a wall area 810, which is a predetermined area of ​​this virtual image. Note that this image 811 does not need to be a real viewpoint image of avatar robot 20, and may be a still image related to the location where avatar robot 20 exists. In the illustrated example, an image of a resort landscape is displayed superimposed.

[0028] The user 50 can freely move within the virtual space by operating the operation input unit 3003 of the VR goggle device 30 to operate the first avatar 800. The user 50 operates the operation input unit 3003 to execute a specific action on a predetermined area (a display area of ​​the image 811, which is at least a part of the wall area 810), thereby switching from the first mode to the second mode.

[0029] As the specific action, an action is performed to move the first avatar 800 closer to the position of the predetermined area to a threshold distance (position 801 away from position 802 where image 811 is displayed). When the first avatar reaches position 801 from position 821, first, a viewpoint switching process is performed from the first mode of bird's-eye view mode to the first mode of virtual viewpoint mode. As a result, as shown in the second from the left in the middle row of FIG. 8, a virtual image is displayed in the virtual viewpoint mode, and an image from the viewpoint of the first avatar 800 is displayed. At this time, the display content of the predetermined area (image display area) is changed from image 811 of the location where avatar robot 20, which is the second avatar, exists to real viewpoint image 812 of the second avatar. Then, as the specific action, an action is performed to move the first avatar 800 closer from position 801 to the display position (position 802) of the predetermined area (image display area), and the first avatar 800 automatically decelerates toward position 802. Then, the avatar 800 moves so that the movement speed becomes zero at the position 802 .

[0030] When the first avatar 800 reaches the position 802, as shown in the third from the left in the middle of FIG. 8, a switch to the second mode is executed to display a real viewpoint image of the second avatar, which is the avatar robot 20 in the real space, and a real viewpoint image 812 is displayed on the display unit 3002 of the VR goggle device 30. This allows a transition from the first avatar 800 in the virtual space to the second avatar, which is the avatar robot 20. At the time of the transition, the avatar robot 20 is in a stopped state, and the real viewpoint image 812 is displayed. After the transition, the user 50 can move the avatar robot 20 by operating the operation input unit 3003 of the VR goggle device 30. As shown in the fourth from the left in the middle of FIG. 8, the position of the avatar robot 20 changes from a position 823 to a position 824 in response to a user operation, and the displayed image changes to a real viewpoint image 813. By operating the second avatar, which is the avatar robot 20, the user 50 can freely move the avatar robot 20 within a movable area in the real space in which the avatar robot 20 can move, and can view the real viewpoint image. This allows the user to experience, via the real viewpoint image of the avatar robot 20, as if he or she had actually visited the place where the avatar robot 20 exists (e.g., a resort).

[0031] <Processing> Next, a transition process from a first avatar in the virtual space to a second avatar in the real space according to this embodiment will be described with reference to the process sequence diagram of FIG. 4, the flowchart of FIG. 5, and FIG.

[0032] 4, the server device 10 transmits a virtual image of the virtual space to the VR goggle device 30. In F402, the VR goggle device 30 operates a first avatar in the virtual space based on an operation of the user 50. In F403, the server device 10 controls the behavior of the first avatar in the virtual space, and transmits a virtual image of the virtual space reflecting the operation content of the user 50 to the VR goggle device 30.

[0033] In F404, the avatar robot 20 transmits an image of the location where the second avatar (avatar robot 20) is located to the server device 10. For example, a still image related to the location where the avatar robot 20 is located (for example, an image of a resort landscape) may be transmitted. Note that the process of F404 may be performed in advance, and the image may be stored in the server device 10.

[0034] In F405, the server device 10 superimposes an image of the location in the real space where the second avatar (avatar robot 20) is located (e.g., an image of a resort landscape) onto a predetermined area of ​​the virtual image in the virtual space (in the example of FIG. 8, an image display area 811 provided in at least a part of the wall area 810 in the virtual space), and transmits the superimposed image.

[0035] In F406, the VR goggle device 30 executes a specific operation on the predetermined area based on the operation of the user 50. In the example of Fig. 8, the specific operation here is an operation of moving the first avatar 800 closer to the position of the predetermined area to a threshold distance (position 801 separated from position 802 where image 811 is displayed).

[0036] In F407, the avatar robot 20 transmits a real viewpoint video of the second avatar (avatar robot 20) to the server device 10. This process may be performed in response to the server device 10 notifying the avatar robot 20 that a specific action has been executed. Alternatively, the real viewpoint video of the second avatar (avatar robot 20) may be constantly transmitted to the server device 10.

[0037] In F408, the server device 10 changes the display content of the predetermined area from an image of the location where the second avatar (the avatar robot 20) exists to a real viewpoint image of the second avatar. In F409, the VR goggle device 30 executes a specific action on the predetermined area based on the operation of the user 50. In the example of FIG. 8, the specific action here is an action of moving the first avatar 800 closer to a position 802 which is the display position of the predetermined area (image display area).

[0038] In F410, the server device 10 switches from the first mode to the second mode. This causes a transition from the first avatar in the virtual space to the second avatar in the real space. In F411, the server device 10 transmits a real viewpoint video of the second avatar (the avatar robot 20) to the VR goggle device 30 to display it. In the example of FIG. 8, the VR goggle device 30 displays a real viewpoint video 812.

[0039] In F412, the VR goggle device 30 operates the second avatar in the real space based on the operation content of the user 50. In F413, the server device 10 controls the behavior of the second avatar in the real space. In F414, the avatar robot 20 transmits a real viewpoint video reflecting the operation content of the user 50 (the real viewpoint video 813 in the example of FIG. 8) to the server device 10.

[0040] In F415, the server device 10 transmits the real viewpoint video reflecting the operation content of the user 50 (the real viewpoint video 813 in the example of FIG. 8) to the VR goggle device 30 to display it. This ends the processing sequence of FIG. 4.

[0041] 5 is a flowchart showing the procedure of the process executed by the server device (information processing device) according to this embodiment. The process starts in a first mode in which a virtual image of a virtual space is displayed.

[0042] In S501, the avatar control unit 1003 of the server device 10 controls a first avatar in a virtual space based on a user operation on the VR goggle device 30. In S502, the display control unit 1004 of the server device 10 displays an image (image 811 in the example of FIG. 8) of a location in the real space where the second avatar, which is the avatar robot 20, exists, superimposed on a predetermined area of ​​a virtual image in the virtual space.

[0043] In S503, the mode switching unit 1005 of the server device 10 judges whether or not a specific action has been performed on the predetermined area based on a user operation on the VR goggle device 30. In the example of Fig. 8, the specific action here is an action of moving the first avatar 800 to the position of the predetermined area up to a threshold distance (position 801 separated from position 802 where image 811 is displayed). If this step is Yes, proceed to S504, whereas if this step is No, return to S501.

[0044] In S504, the display control unit 1004 of the server device 10 changes the display content of the predetermined area from an image of the location where the second avatar exists to a real viewpoint video of the second avatar. In the example of Fig. 8, an image 811 displayed in a part of a wall area 810 is changed to a real viewpoint video 812. Since the image is switched to the real viewpoint video 812 by approaching the wall area 810, it is possible to increase the expectation of the virtual experience using the avatar robot 20.

[0045] In S505, the mode switching unit 1005 of the server device 10 judges whether or not a specific action has been performed on the predetermined area based on a user operation on the VR goggle device 30. In the example of FIG. 8, the specific action here is an action of moving the first avatar 800 closer to position 802, which is the display position of the predetermined area (image display area). If this step is Yes, the process proceeds to S506, whereas if this step is No, the process waits. Alternatively, if the avatar does not move from position 801 to position 802 but moves in the opposite direction away from it, the process may be configured to return to S502.

[0046] In S506, the mode switching unit 1005 of the server device 10 switches from a first mode in which a virtual image in a virtual space is displayed to a second mode in which a real viewpoint image of a second avatar, which is the avatar robot 20 in a real space, is displayed. In S507, the display control unit 1004 of the server device 10 transmits a real viewpoint image of the second avatar (the avatar robot 20) to the VR goggle device 30 in the second mode to display it. In S508, the avatar control unit 1003 controls the second avatar (the avatar robot 20) in the real space based on a user operation on the VR goggle device 30. This ends the processing in FIG. 5.

[0047] As described above, according to this embodiment, it is possible to easily switch from a first mode that displays a virtual image of a virtual space to a second mode that displays a real viewpoint image of a second avatar in a real space.

[0048] [Variation 1 (transition from first mode to second mode)] FIG. 9 is an explanatory diagram of a transition process from a first avatar in a virtual space to a second avatar in a real space according to the first modification. The display method of the first virtual image from the left in the middle of FIG. 9 is different from that of FIG. 8. In the example of FIG. 8, an example of displaying a virtual image in a bird's-eye view mode of the first mode has been described, but as in FIG. 9, a virtual image may be displayed in a virtual viewpoint mode of the first mode. In this case, even if the first avatar 800 reaches a position 801, switching from the bird's-eye view mode to the virtual viewpoint mode as in FIG. 8 is not performed. In this case, it is possible to configure so that the same process as that described in FIG. 8 is performed in response to passing the position 801 and approaching the position 802.

[0049] [Variation 2 (transition from first mode to second mode)] FIG. 10 is an explanatory diagram of a transition process from a first avatar in a virtual space to a second avatar in a real space according to the second modification. In FIG. 10, the display method of the first virtual image from the left in the middle row is the bird's-eye view mode as in FIG. 8. In FIG. 10, unlike FIG. 8, when an action is performed to move the first avatar 800 closer to the position 801, the first avatar 800 decelerates as it approaches the position 801, and the movement of the first avatar 800 automatically stops at the position 801. Alternatively, the user 50 may move the first avatar 800 while decelerating until it reaches the position 801, and perform an operation to stop the first avatar 800 on the position 801. Based on the first avatar 800 stopping on the position 801, the bird's-eye view mode is switched to the virtual viewpoint mode as in the example of FIG. 8.

[0050] In the present modified example 2, the first mode is switched to the second mode without the first avatar 800 approaching up to the position 802 of the wall region. Before the first mode is switched to the second mode, as in the virtual image second from the left in the middle row of FIG. 10, a real viewpoint image 832 of a part of a real viewpoint image 833 of the avatar robot 20 is displayed in a predetermined region of the virtual image (for example, within a frame 831 of the wall region). Then, after the first mode is switched to the second mode, a real viewpoint image 833 of the avatar robot 20 is displayed. At this time, the real viewpoint image 833 is displayed so as to include the real viewpoint image 832. Although the frame 831 is displayed superimposed for convenience of explanation, only the real viewpoint image 833 is displayed, and the frame 831 is not displayed.

[0051] At that time, the real viewpoint image 832, which is a part of the real viewpoint image 833, is controlled to be displayed at the same position in the display unit 3002. That is, the transition is performed so that the display position of the real viewpoint image 832 does not change before and after the transition from the first mode to the second mode. In this way, the mode switching is performed while maintaining the amount of change in the visual information of the user 50 at or below a predetermined value. This makes it possible to suppress a large change in the field of view from the real viewpoint image 832, thereby reducing the sense of discomfort felt by the user 50 when the mode transition occurs.

[0052] After switching from the first mode to the second mode, the user 50 can operate the VR goggle device 30 to freely move the avatar robot 20 and view the real viewpoint image 834 thereof.

[0053] In the present second modification, a part of the real viewpoint image 832 of the avatar robot 20 is displayed over the entire wall area, but this is not limited to the example of displaying over the entire wall area, and may be displayed over only a part of the wall area.

[0054] [Variation 3 (transition from the first mode to the second mode)] FIG. 11 is an explanatory diagram of a transition process from a first avatar in a virtual space to a second avatar in a real space according to the third modification. The display method of the first virtual image from the left in the middle of FIG. 11 is different from that of FIG. 10. In the example of FIG. 10, an example of displaying a virtual image in a bird's-eye view mode of the first mode has been described, but as in FIG. 11, a virtual image may be displayed in a virtual viewpoint mode of the first mode. In this case, even if the first avatar 800 reaches the position 801, the bird's-eye view mode is not switched to the virtual viewpoint mode. In this case, as in FIG. 10, when an operation is performed to move the first avatar 800 closer to the position 801, the first avatar 800 decelerates as it approaches the position 801, and the movement of the first avatar 800 stops at the position 801. The subsequent process is the same as that of the second modification described with reference to FIG. 10.

[0055] <Transition from a second avatar in the real world to a first avatar in the virtual world> Next, Fig. 12 is an explanatory diagram of the transition process from the second avatar in the real space to the first avatar in the virtual space according to this embodiment. The upper part of Fig. 12 shows the change in the position of the second avatar in the real space and the position of the first avatar in the virtual space. The middle part of Fig. 12 shows the change in the display image of the display unit 3002 of the VR goggle device 30 worn by the user 50 according to the change in the position of the avatar. The lower part of Fig. 12 shows the relationship between the moving speed of the avatar (vertical axis) and the change in the position of the second avatar in the real space and the position of the first avatar in the virtual space.

[0056] 12, in the second mode for displaying a real viewpoint image of the second avatar, which is the avatar robot 20 in real space, a real viewpoint image 1211 is displayed on the display unit 3002 of the VR goggle device 30. In the illustrated example, an image of a path passing through a bamboo forest is displayed.

[0057] The user 50 can operate the operation input unit 3003 of the VR goggle device 30 to operate the second avatar (the avatar robot 20) to freely move within a predetermined range of the real space. The user 50 can switch from the second mode to the first mode by operating the operation input unit 3003 to execute a specific action. The specific action here includes an action of moving the avatar robot 20 close to a boundary position of the movable area. When the avatar robot 20 moves from a position 1221 and approaches a position 1222 corresponding to the boundary position, the avatar robot 20 is controlled to stop. At this time, as shown second from the left in the middle of FIG. 12, a real viewpoint image 1212 (including a real viewpoint image 1213) is displayed.

[0058] Then, by operating the operation input unit 3003 of the VR goggle device 30 to press a specific button or perform an action to move the avatar robot 20 in a direction in which it cannot move any further (further outward from the boundary position), the second mode is transitioned to the first mode.

[0059] 12, a virtual image of the virtual space in the first mode (bird's-eye view mode) is displayed on the display unit 3002 of the VR goggle device 30. The first avatar 1200 in the virtual space exists at a position 1223, and is displayed in a state controlled so as to face the wall region.

[0060] At this time, the real viewpoint image 1213, which is a part of the real viewpoint image 1212, is controlled to be displayed at the same position in the display unit 3002. That is, the transition is performed so that the display position of the real viewpoint image 1213 does not change before and after the transition from the second mode to the first mode. This makes it possible to suppress a large change in the field of view from the real viewpoint image 1213, thereby reducing the sense of discomfort felt by the user 50 at the time of the mode transition. In addition, the virtual image portion of the virtual space other than the real viewpoint image 1213 may be configured to be displayed by a fade-in operation. This allows the user 50 to recognize that he or she has returned to the virtual space without feeling uncomfortable, while suppressing a sudden change from the real viewpoint image.

[0061] Thereafter, the user 50 can freely move within the virtual space by operating the first avatar 1200 in the virtual space. This allows the user to experience, via the real viewpoint image of the avatar robot 20, as if he or she had actually visited the place where the avatar robot 20 exists (for example, a path through a bamboo forest), and then to experience returning to the user's virtual space.

[0062] <Processing> Next, a transition process from a second avatar in the real space to a first avatar in the virtual space according to this embodiment will be described with reference to the process sequence diagram of FIG. 6, the flowchart of FIG. 7, and FIG.

[0063] 6, the VR goggle device 30 displays a real viewpoint video of the second avatar (avatar robot 20) received from the server device 10. In F602, the VR goggle device 30 operates the second avatar (avatar robot 20) based on an operation of the user 50. In F603, the server device 10 controls the behavior of the second avatar (avatar robot 20) in the real space.

[0064] In F604, the avatar robot 20 transmits a real viewpoint video of the second avatar (avatar robot 20) to the server device 10. In F605, the server device 10 transmits the real viewpoint video of the second avatar (avatar robot 20) to the VR goggle device 30 to display it. In F606, the VR goggle device 30 executes a specific action based on an operation of the user 50. In the example of FIG. 12, the specific action here is an action of moving the avatar robot 20 closer to the boundary position of its movable area. In F607, the server device 10 switches from the second mode to the first mode.

[0065] In F608, the server device 10 superimposes a real viewpoint video of a partial area of ​​the real viewpoint video of the second avatar (the avatar robot 20) on a predetermined area of ​​the virtual video, and transmits the virtual video to the VR goggle device 30. In F609, the VR goggle device 30 displays the received virtual video. In the example of FIG. 12, in the first mode (bird's-eye view mode), a real viewpoint video 1213 of a partial area of ​​the real viewpoint video 1212 is displayed superimposed on the wall area. At this time, control is performed so that the real viewpoint video 1213, which is a part of the real viewpoint video 1212, is displayed at the same position in the display unit 3002. In other words, the transition is performed so that the display position of the real viewpoint video 1213 does not change before and after the transition from the second mode to the first mode.

[0066] In F610, the VR goggle device 30 operates a first avatar in the virtual space (the first avatar 1200 in the example of FIG. 12) based on the operation of the user 50. In F611, the server device 10 controls the behavior of the first avatar in the virtual space, and transmits a virtual image of the virtual space reflecting the operation content of the user 50 to the VR goggle device 30. This ends the processing sequence in FIG. 7.

[0067] 7 is a flowchart showing a procedure of a process performed by the server device (information processing device) according to this embodiment. The process starts in a second mode in which a real viewpoint video of a second avatar, which is the avatar robot 20 in real space, is displayed.

[0068] In S701, the avatar control unit 1003 of the server device 10 controls a second avatar, which is the avatar robot 20 in real space, based on a user operation on the VR goggle device 30. In S702, the display control unit 1004 of the server device 10 transmits the real viewpoint video of the second avatar (the avatar robot 20) received from the avatar robot 20 to the VR goggle device 30 to display it.

[0069] In S703, the mode switching unit 1005 of the server device 10 judges whether or not a specific action has been executed based on a user operation on the VR goggle device 30. In the example of Fig. 12, the specific action here is an action of moving the avatar robot 20 closer to the boundary position of the movable area. If this step is Yes, the process proceeds to S704, whereas if this step is No, the process returns to S701.

[0070] In S704, the mode switching unit 1005 of the server device 10 switches from the second mode in which a real viewpoint video of the second avatar (avatar robot 20) in the real space is displayed to the first mode in which a virtual video of the virtual space is displayed.

[0071] In S705, the display control unit 1004 of the server device 10 superimposes a real viewpoint video of a partial area of ​​the real viewpoint video of the second avatar (avatar robot 20) on a predetermined area of ​​the virtual video, and transmits the superimposed video to the VR goggle device 30 for display. In the example of FIG. 12, in the first mode (bird's-eye view mode), a real viewpoint video 1213 of a partial area of ​​the real viewpoint video 1212 is superimposed on the wall area and displayed. At this time, control is performed so that the real viewpoint video 1213, which is a part of the real viewpoint video 1212, is displayed at the same position in the display unit 3002. In other words, the transition is performed so that the display position of the real viewpoint video 1213 does not change before and after the transition from the second mode to the first mode.

[0072] In S706, the avatar control unit 1003 of the server device 10 controls the first avatar in the virtual space based on a user operation on the VR goggle device 30. This ends the processing in FIG.

[0073] As described above, according to this embodiment, it is possible to easily switch from a second mode that displays a real viewpoint image of a second avatar in real space to a first mode that displays a virtual image of a virtual space.

[0074] [Variation 1 (transition from the second mode to the first mode)] Fig. 13 is an explanatory diagram of a transition process from a second avatar in real space to a first avatar in virtual space according to Modification 1. The display method of the virtual image third from the left in the middle row of Fig. 13 is different from that of Fig. 12. In the example of Fig. 12, an example of displaying the virtual image in the bird's-eye view mode of the first mode has been described, but as in Fig. 13, the virtual image may be displayed in the virtual viewpoint mode of the first mode.

[0075] [Variation 2 (transition from the second mode to the first mode)] FIG. 14 is an explanatory diagram of a transition process from a second avatar in the real space to a first avatar in the virtual space according to the second modification. In FIG. 14, unlike the example of FIG. 12, an operation is performed in which avatar robot 20 approaches position 802 at a substantially constant moving speed. When avatar robot 20 approaches or reaches position 802, switching from the second mode to the first mode is performed. When avatar robot 20 reaches position 802, avatar robot 20 automatically stops. Then, when transitioning to first avatar 1200 in the virtual space, direction 1232 of the virtual viewpoint of the virtual image is controlled not to face the direction of the wall area which is the display area of ​​real viewpoint image 1231.

[0076] 18 is an explanatory diagram of the orientation of the first avatar after the transition process for transition from the second mode to the first mode according to Modifications 2 to 5. The direction in which the first avatar 1200 faces is the direction indicated by circle 1712, not the direction indicated by cross 1711, which is the direction in which wall region 1701 and image display region 1702, which is the predetermined region, exist in the virtual space.

[0077] Furthermore, for the first avatar 1200 after the transition process according to Modifications 2 to 5, as shown in FIG. 19, at least one of other content display areas 1901 and 1902 may be further displayed in the direction in which the first avatar 1200 faces. Also, as shown in FIG. 20, at least one of other content display areas 2001 and 2002 may be further displayed. In FIG. 19, the other content display areas 1901 and 1902 are displayed at positions close to the first avatar 1200. In FIG. 20, the other content display areas 1901 and 1902 are displayed at positions farther from the first avatar 1200. The display positions of the other content display areas may be further away as the moving speed of the first avatar 1200 is faster, and closer as the moving speed of the first avatar 1200 is slower. That is, the position of the other content display area may be controlled so that the greater the moving speed of the first avatar 1200, the greater the distance from the first avatar 1200 to the other content display area. This makes it possible to prevent the first avatar after the transition from coming too close to the other content display area.

[0078] 19 and 20, the process of displaying one or more other content display areas in the direction in which the avatar in the virtual space faces is not limited to the cases of Modifications 2 to 5. When transitioning from the second mode in which a real viewpoint video of the second avatar (avatar robot 20) in the real space is made to the first mode in which a virtual video of the virtual space is displayed, one or more other content display areas may be controlled to be displayed in the direction in which the avatar in the virtual space faces.

[0079] [Variation 3 (transition from the second mode to the first mode)] Fig. 15 is an explanatory diagram of a transition process from a second avatar in real space to a first avatar in virtual space according to Modification Example 3. The display method of the virtual image third from the left in the middle row of Fig. 15 is different from that of Fig. 14. In the example of Fig. 14, an example of displaying the virtual image in the bird's-eye view mode of the first mode has been described, but as in Fig. 15, the virtual image may be displayed in the virtual viewpoint mode of the first mode.

[0080] [Variation 4 (transition from the second mode to the first mode)] FIG. 16 is an explanatory diagram of a transition process from a second avatar in the real space to a first avatar in the virtual space according to the fourth modification. In FIG. 16, unlike the examples of FIG. 14 and FIG. 15, an operation is performed in which the avatar robot 20 is accelerated while approaching the position 802. When the avatar robot 20 approaches or reaches the position 802, the mode is switched from the second mode to the first mode. When the avatar robot 20 reaches the position 802, the avatar robot 20 automatically stops. Then, when the transition is made to the first avatar 1200 in the virtual space, the direction 1232 of the virtual viewpoint of the virtual image is controlled not to face the direction of the wall region which is the display region of the real viewpoint image 1231. Then, the first avatar 1200 determines the moving speed of the first avatar 1200 after the transition based on the acceleration and speed when the avatar robot 20 was accelerating. That is, if the avatar robot 20 was accelerated before the transition, the first avatar 1200 is moved in a state reflecting the acceleration. This makes it possible to prevent the avatar from suddenly approaching the real viewpoint image 1231 after transitioning to the first avatar 1200, while maintaining the feel of operability of the avatar before and after the transition.

[0081] [Variation 5 (transition from the second mode to the first mode)] Fig. 17 is an explanatory diagram of a transition process from a second avatar in real space to a first avatar in virtual space according to Modification 5. The display method of the virtual image third from the left in the middle row of Fig. 17 is different from that of Fig. 16. In the example of Fig. 16, an example of displaying the virtual image in the bird's-eye view mode of the first mode has been described, but as in Fig. 17, the virtual image may be displayed in the virtual viewpoint mode of the first mode.

[0082] In the above embodiment, the predetermined area of ​​the virtual image is described as being at least a part or the entire area of ​​the wall area of ​​the virtual space, but is not limited to this example. For example, the predetermined area of ​​the virtual image may be a display area on a frame that imitates a display floating in the virtual space. Therefore, the predetermined area may be at least a part of the area in the virtual space. Similarly, the other content display area may be at least a part or the entire area of ​​the wall area, or may be a display area on a frame that imitates a display floating in the virtual space. Therefore, the other content display area may be at least a part of the area in the virtual space.

[0083] <Other embodiments> Furthermore, a program for realizing one or more functions described in each embodiment can be supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device can read and execute the program. The present invention can also be realized in such an embodiment.

[0084] <Summary of the embodiment> 1. The information processing device (10) according to the above embodiment is A control means (1003) for controlling the behavior of a first avatar (800, 1200) which is an avatar in a virtual space or a second avatar which is an avatar robot (20) in a real space based on a user operation; a switching means (1005) for switching between a first mode for displaying a virtual image of the virtual space and a second mode for displaying a real viewpoint image of the second avatar in the real space based on the user operation; Equipped with.

[0085] This allows the user to easily switch between avatars to be used.

[0086] 2. The information processing device (10) according to the above embodiment is The display device further includes a display control means for displaying the virtual image or the real viewpoint image on the display device, The display control means, in the first mode, displays an image (811) of a location where the second avatar is present in a predetermined area (810) of the virtual image in a superimposed manner; The switching means switches from the first mode to the second mode when a specific action is performed on the predetermined area based on the user operation.

[0087] This allows the user to easily switch from the virtual image to the real viewpoint image by simply performing a specific action in the virtual space.

[0088] 3. In the information processing device (10) according to the above embodiment, The specific action includes an action of moving the first avatar close to a position (802) in the predetermined area.

[0089] This allows the user to easily switch from the virtual image to the real viewpoint image by simply moving the avatar within the virtual space.

[0090] 4. In the information processing device (10) according to the above embodiment, The specific action includes an action of moving the first avatar closer to the position of the predetermined area to within a threshold distance (to position 801) (FIGS. 10, 11, etc.).

[0091] This allows the user to easily switch from the virtual image to the real viewpoint image by simply moving the avatar within the virtual space.

[0092] 5. In the information processing device (10) according to the above embodiment, When the specific action is executed, the display control means changes the display content of the specified area from an image (811) of the location where the second avatar is located to a real viewpoint image (812, 832) of at least a part of an area of ​​the real viewpoint image (812, 833) of the second avatar (Figures 8 to 11).

[0093] This allows the user to recognize the real viewpoint image of the location where the avatar robot is present, thereby increasing the anticipation of the virtual experience using the avatar robot 20.

[0094] 6. In the information processing device (10) according to the above embodiment, When the switching means switches from the first mode to the second mode, the display control means causes the display device to display the real viewpoint image (833) of the second avatar that includes the real viewpoint image (832) of the partial area without changing the display position of the real viewpoint image (832) of the partial area that was displayed in the specified area (Figures 10 and 11).

[0095] This makes it possible to prevent the field of view from changing significantly from the real viewpoint image of a certain area, thereby reducing the sense of discomfort felt by the user when switching modes.

[0096] 7. In the information processing device (10) according to the above embodiment, The predetermined area is at least a portion (810) of the virtual space.

[0097] This makes it possible to realize mode switching simply by moving the first avatar in the virtual space closer to a specific area.

[0098] 8. In the information processing device (10) according to the above embodiment, the first mode includes an overhead mode in which the virtual image including the first avatar is displayed, and a virtual viewpoint mode in which the virtual image viewed from a virtual viewpoint of the first avatar is displayed; The information processing device includes: The first mode further includes a second switching means (1005) for switching from the overhead view mode to the virtual viewpoint mode when the specific action is executed in the overhead view mode (FIG. 8).

[0099] This can reduce the change in field of view when switching from the first mode to the second mode.

[0100] 9. In the information processing device (10) according to the above embodiment, the first mode includes an overhead mode in which the virtual image including the first avatar is displayed, and a virtual viewpoint mode in which the virtual image viewed from a virtual viewpoint of the first avatar is displayed; The information processing device includes: The apparatus further comprises a third switching means (1005) for switching between the bird's-eye view mode and the virtual viewpoint mode based on an instruction from a user in the first mode.

[0101] This allows the user to freely switch between the bird's-eye view mode and the virtual viewpoint mode according to their preference.

[0102] 10. In the information processing device (10) according to the above embodiment, When the first avatar approaches the predetermined area to within the threshold distance, the control means stops the movement of the first avatar (FIGS. 10 and 11).

[0103] This makes it possible to transition to the avatar robot 20 in response to an additional operation received from the user in this state (e.g., pressing a button or an instruction to move the first avatar further toward a specified area).

[0104] 11. The information processing device (10) according to the above embodiment is The present invention further includes a display control means (1004) for displaying the virtual image or the real viewpoint image on a display device (30) worn by a user, The switching means switches from the second mode to the first mode when a specific action is executed based on the user operation.

[0105] This allows the user to easily switch from a real viewpoint image to a virtual image simply by performing a specific action in the virtual space.

[0106] 12. In the information processing device (10) according to the above embodiment, The display control means displays the real viewpoint image (1211) of the second avatar in the second mode, When the specific action is executed to switch from the second mode to the first mode, the display control means superimposes a real viewpoint image (1213) of at least a portion of the real viewpoint image of the second avatar onto a predetermined area of ​​the virtual image, thereby displaying the virtual image (Figure 12).

[0107] This makes it possible to prevent the field of view from changing significantly from the displayed real viewpoint image, thereby reducing the sense of discomfort felt by the user when switching modes.

[0108] 13. In the information processing device (10) according to the above embodiment, the first mode includes an overhead mode in which the virtual image including the first avatar is displayed, and a virtual viewpoint mode in which the virtual image viewed from a virtual viewpoint of the first avatar is displayed; When the specific action is executed and the mode is switched from the second mode to the first mode, the display control means displays the virtual image in the virtual viewpoint mode by superimposing a real viewpoint image of at least a portion of the area on a specified area of ​​the virtual image (Figures 13, 15, and 17).

[0109] This makes it easy to recognize that a transition has occurred from a real viewpoint image in real space to a virtual image in virtual space.

[0110] 14. In the information processing device (10) according to the above embodiment, In the virtual viewpoint mode, the display control means displays the virtual image such that the first avatar does not face the predetermined area (FIGS. 13, 15, 17, and 18).

[0111] This makes it possible to avoid a situation where the real viewpoint image before the transition jumps into the user's field of vision when transitioning from a real viewpoint image in real space to a virtual space, thereby enabling a transition that reduces the sense of discomfort felt by the user.

[0112] 15. In the information processing device (10) according to the above embodiment, the first mode includes an overhead mode in which the virtual image including the first avatar is displayed, and a virtual viewpoint mode in which the virtual image viewed from a virtual viewpoint of the first avatar is displayed; When the specific operation is executed and the mode is switched from the second mode to the first mode, the display control means displays the virtual image in the overhead mode by superimposing a real viewpoint image of at least a portion of the area on a specified area of ​​the virtual image (Figures 12, 14, and 16).

[0113] This makes it easy to recognize that a transition has occurred from a real viewpoint image in real space to a virtual image in virtual space.

[0114] 16. In the information processing device (10) according to the above embodiment, The display control means, in the overhead mode, displays the virtual image such that the first avatar does not face the predetermined area (FIGS. 12, 14, 16, and 18).

[0115] This makes it possible to avoid a situation where the real viewpoint image before the transition jumps into the user's field of vision when transitioning from a real viewpoint image in real space to a virtual space, thereby enabling a transition that reduces the sense of discomfort felt by the user.

[0116] 17. In the information processing device (10) according to the above embodiment, The specific action includes an action of moving the second avatar close to a boundary of a movable area in the real space.

[0117] This makes it possible to easily switch modes simply by moving avatar robot 20, which is the second avatar.

[0118] 18. In the information processing device (10) according to the above embodiment, When the specific action is performed and the mode is switched from the second mode to the first mode, the control means controls the movement of the first avatar based on the movement speed and movement acceleration of the second avatar (Figures 14, 15, 16, and 17).

[0119] This makes it possible to maintain the continuity of user operations before and after mode switching, thereby improving operability.

[0120] 19. In the information processing device (10) according to the above embodiment, the display control means displays other content display areas (1901, 1002, 2001, 2002) together with the predetermined area in the virtual image; The display control means controls the position of the other content display area relative to the first avatar based on the movement speed of the first avatar when the specific action is executed and the mode is switched from the second mode to the first mode.

[0121] This makes it possible to display other content display areas at appropriate positions that are easily visible to the user.

[0122] 20. In the information processing device (10) according to the above embodiment, The display control means controls a position of the other content display area such that the greater the moving speed of the first avatar, the greater the distance from the first avatar to the other content display area.

[0123] This makes it possible to prevent the avatar in the virtual space from suddenly approaching other content display areas when switching to the first mode.

[0124] 21. The control method of the information processing device (10) according to the above embodiment includes: a control step of controlling a behavior of a first avatar which is an avatar in a virtual space or a second avatar which is an avatar robot in a real space based on a user operation; a switching step of switching between a first mode for displaying a virtual image of the virtual space and a second mode for displaying a real viewpoint image of the second avatar in the real space based on the user operation; has.

[0125] This allows the user to easily switch between avatars to be used.

[0126] 22. The program according to the above embodiment is A program for causing a computer to execute the control method for the information processing device according to the above embodiment.

[0127] This makes it possible to realize the functions of the information processing device as a program.

[0128] 23. The storage medium according to the above embodiment is A storage medium storing a program for causing a computer to execute the control method for the information processing device according to the above embodiment.

[0129] This makes it possible to realize the functions of the information processing device as a storage medium.

[0130] The invention is not limited to the above-described embodiment, and various modifications and variations are possible within the scope of the gist of the invention. [Explanation of symbols]

[0131] 10: server device, 20: avatar robot, 30: VR goggle device, 1003: avatar control unit, 1004: display control unit, 1005: mode switching unit

Claims

1. a control means for controlling a behavior of a first avatar which is an avatar in a virtual space or a second avatar which is an avatar robot in a real space based on a user operation; a switching means for switching between a first mode for displaying a virtual image of the virtual space and a second mode for displaying a real viewpoint image of the second avatar in the real space based on the user operation; a display control means for causing a display device to display the virtual image or the real viewpoint image; Equipped with the display control means, in the first mode, causes an image of a location where the second avatar is present to be superimposed on a predetermined area of ​​the virtual image; The information processing apparatus, wherein the switching means switches from the first mode to the second mode when a specific action is executed on the predetermined area based on the user operation.

2. The information processing apparatus according to claim 1 , wherein the specific action includes an action of moving the first avatar close to a position in the predetermined area.

3. The information processing apparatus according to claim 1 , wherein the specific action includes an action of moving the first avatar closer to a position of the predetermined area up to a threshold distance.

4. The information processing device described in claim 1, characterized in that when the specific action is executed, the display control means changes the display content of the specified area from an image of the location where the second avatar is located to a real viewpoint image of at least a part of the area of ​​the real viewpoint image of the second avatar.

5. The information processing device described in claim 4, characterized in that when the switching means switches from the first mode to the second mode, the display control means causes the display device to display the real viewpoint image of the second avatar, which includes the real viewpoint image of at least a portion of the area, without changing the display position of the real viewpoint image of at least a portion of the area displayed in the specified area.

6. The information processing apparatus according to claim 1 , wherein the predetermined area is at least a part of the virtual space.

7. the first mode includes an overhead mode in which the virtual image including the first avatar is displayed, and a virtual viewpoint mode in which the virtual image viewed from a virtual viewpoint of the first avatar is displayed; The information processing device includes: 2 . The information processing apparatus according to claim 1 , further comprising: a second switching unit that switches from the overhead view mode to the virtual viewpoint mode when the specific action is executed in the overhead view mode in the first mode.

8. An information processing device, a control means for controlling a behavior of a first avatar which is an avatar in a virtual space or a second avatar which is an avatar robot in a real space based on a user operation; a switching means for switching between a first mode for displaying a virtual image of the virtual space and a second mode for displaying a real viewpoint image of the second avatar in the real space based on the user operation; Equipped with the first mode includes an overhead mode in which the virtual image including the first avatar is displayed, and a virtual viewpoint mode in which the virtual image viewed from a virtual viewpoint of the first avatar is displayed; The information processing device includes:

2. The information processing apparatus according to claim 1, further comprising: a second switching means for switching between the bird's-eye view mode and the virtual viewpoint mode based on an instruction from a user in the first mode.

9. 4. The information processing apparatus according to claim 3, wherein the control means stops movement of the first avatar when the first avatar approaches the predetermined area to within the threshold distance.

10. A control means for controlling the behavior of a first avatar which is an avatar in a virtual space or a second avatar which is an avatar robot in a real space based on a user operation; a switching means for switching between a first mode for displaying a virtual image of the virtual space and a second mode for displaying a real viewpoint image of the second avatar in the real space based on the user operation; a display control means for displaying the virtual image or the real viewpoint image on a display device worn by a user; Equipped with The information processing apparatus, wherein the switching means switches from the second mode to the first mode when a specific action is executed based on the user operation.

11. the display control means, in the second mode, causes the real viewpoint image of the second avatar to be displayed; The information processing device described in claim 10, characterized in that when the specific action is executed and the second mode is switched to the first mode, the display control means superimposes a real viewpoint image of at least a portion of the real viewpoint image of the second avatar on a predetermined area of ​​the virtual image to display the virtual image.

12. the first mode includes an overhead mode in which the virtual image including the first avatar is displayed, and a virtual viewpoint mode in which the virtual image viewed from a virtual viewpoint of the first avatar is displayed; The information processing device according to claim 11, characterized in that when the specific operation is executed and the second mode is switched to the first mode, the display control means displays the virtual image in the virtual viewpoint mode by superimposing a real viewpoint image of at least a portion of the area on a predetermined area of ​​the virtual image.

13. 13 . The information processing apparatus according to claim 12 , wherein the display control means, in the virtual viewpoint mode, displays the virtual image such that the first avatar does not face the predetermined area.

14. the first mode includes an overhead mode in which the virtual image including the first avatar is displayed, and a virtual viewpoint mode in which the virtual image viewed from a virtual viewpoint of the first avatar is displayed; The information processing device according to claim 11, characterized in that when the specific operation is executed and the second mode is switched to the first mode, the display control means displays the virtual image in the overhead mode by superimposing a real viewpoint image of at least a portion of the area on a predetermined area of ​​the virtual image.

15. The information processing apparatus according to claim 14 , wherein the display control means, in the overhead view mode, displays the virtual image such that the first avatar does not face the predetermined area.

16. The information processing apparatus according to claim 10 , wherein the specific action includes an action of moving the second avatar close to a boundary of a movable area in the real space.

17. The information processing device according to claim 10, characterized in that the control means controls the movement of the first avatar based on the movement speed and movement acceleration of the second avatar when the specific action is executed and the mode is switched from the second mode to the first mode.

18. the display control means displays another content display area together with the predetermined area in the virtual image; The information processing device according to claim 11, characterized in that the display control means controls the position of the other content display area relative to the first avatar based on the movement speed of the first avatar when the specific action is executed and the mode is switched from the second mode to the first mode.

19. The information processing device according to claim 18, characterized in that the display control means controls the position of the other content display area so that the greater the moving speed of the first avatar, the greater the distance from the first avatar to the other content display area.

20. A method for controlling an information processing device, comprising: a control step in which a control means of the information processing device controls a behavior of a first avatar which is an avatar in a virtual space or a second avatar which is an avatar robot in a real space based on a user operation; a switching step in which a switching means of the information processing device switches between a first mode in which a virtual image of the virtual space is displayed and a second mode in which a real viewpoint image of the second avatar in the real space is displayed based on the user operation; a display control step of causing a display device to display the virtual image or the real viewpoint image by a display control means of the information processing device; having In the display control step, in the first mode, an image of a location where the second avatar is present is displayed in a superimposed manner in a predetermined area of ​​the virtual image; A method for controlling an information processing device, characterized in that, in the switching step, when a specific operation is performed on the specified area based on the user operation, the first mode is switched to the second mode.

21. A method for controlling an information processing device, comprising: a control step in which a control means of the information processing device controls a behavior of a first avatar which is an avatar in a virtual space or a second avatar which is an avatar robot in a real space based on a user operation; a switching step in which a switching means of the information processing device switches between a first mode in which a virtual image of the virtual space is displayed and a second mode in which a real viewpoint image of the second avatar in the real space is displayed based on the user operation; having the first mode includes an overhead mode in which the virtual image including the first avatar is displayed, and a virtual viewpoint mode in which the virtual image viewed from a virtual viewpoint of the first avatar is displayed; The control method includes: The method for controlling an information processing device, further comprising a second switching step of switching between the bird's-eye view mode and the virtual viewpoint mode based on an instruction from a user in the first mode.

22. A method for controlling an information processing device, comprising: a control step in which a control means of the information processing device controls a behavior of a first avatar which is an avatar in a virtual space or a second avatar which is an avatar robot in a real space based on a user operation; a switching step in which a switching means of the information processing device switches between a first mode in which a virtual image of the virtual space is displayed and a second mode in which a real viewpoint image of the second avatar in the real space is displayed based on the user operation; a display control step of causing a display control means of the information processing device to display the virtual image or the real viewpoint image on a display device worn by a user; having The method for controlling an information processing device, wherein the switching step switches from the second mode to the first mode when a specific action is executed based on the user operation.

23. 23. A program for causing a computer to execute the method for controlling an information processing device according to claim 20.

24. 23. A storage medium storing a program for causing a computer to execute the method for controlling an information processing device according to claim 20.

Images