Information processing device, control method therefor, and program

Abstract

To provide an information processing device capable of preventing an unintended avatar from being photographed in front of a subject avatar in photographing by a virtual camera.SOLUTION: An HMD 111 provided with a display part 113 is connected to an information processing device 101. The information processing device 101 performs control for displaying a virtual space with avatars arranged in the display part 113. The information processing device 101 divides a photographing area of the virtual camera on the basis of camera visual field area information 207 showing a visual field area of the virtual camera for photographing the avatars included in the virtual space, and position information of a designated reference subject avatar. The information processing device 101 performs display control for preventing avatars other than the subject avatar from being photographed in front of the subject avatar, on the basis of whether or not the avatars are included in the divided area.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an information processing device, a control method thereof, and a program. [Background technology]

[0002] In recent years, the metaverse, where multiple users communicate and experience content in the same virtual space on the Internet, has been attracting attention. In the metaverse, interactions are possible without location or time restrictions. Users can place and operate their avatars, which are their alter egos, in the virtual space, to communicate and work as if they were actually present there. Users can also take pictures of avatars and objects displayed in the metaverse using a virtual camera. For example, Patent Document 1 describes a system that can take pictures of a capture range in a virtual space specified by a user.

[0003] Incidentally, when taking pictures in a virtual space, there are cases where it is desired to prevent avatars from being reflected in the virtual camera, as in the case of taking pictures in the real space. In the metaverse, since a large number of avatars exist, it is not easy to arrange the virtual camera so that other avatars are not reflected. It is also not easy to operate all the avatars so that they are not reflected in the virtual camera. In response to this, for example, a technology has been proposed that prevents avatars other than acquaintances from being reflected in pictures taken in a virtual space (for example, see Non-Patent Document 1). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Publication No. 2022-006502 [Non-patent literature]

[0005] [Non-Patent Document 1] https: / / www.moguravr.com / vrchat-20 / Summary of the Invention [Problem to be solved by the invention]

[0006] However, with the technology of Non-Patent Document 1 mentioned above, for example, when photographing an avatar other than an acquaintance, if the acquaintance's avatar gets between the virtual camera and the subject avatar, the acquaintance's avatar will unintentionally appear in front of the subject avatar.

[0007] The present invention aims to provide an information processing device, a control method thereof, and a program capable of preventing an unintended avatar from appearing in front of a subject avatar when photographing with a virtual camera. [Means for solving the problem]

[0008] In order to achieve the above-mentioned object, the information processing device of the present invention is an information processing device that controls the display of a virtual space in which avatars are placed on a display means, and is equipped with a means for determining a subject avatar to be photographed in the virtual space, and a means for controlling the display of the avatar on the display means, wherein the control means acquires information indicating the field of view of a virtual camera that photographs an avatar included in the virtual space, acquires positional information of the avatar included in the virtual space, divides the shooting area of ​​the virtual camera based on the information indicating the field of view of the virtual camera and the positional information of the subject avatar, and performs display control to prevent an avatar other than the subject avatar from being reflected in front of the subject avatar when photographed by the virtual camera, based on which of the divided areas an avatar other than the subject avatar is included in. Effect of the Invention

[0009] According to the present invention, it is possible to prevent an unintended avatar from appearing in front of a subject avatar when photographing with a virtual camera. [Brief description of the drawings]

[0010] [Figure 1]1 is a block diagram illustrating a hardware configuration of an information processing device according to an embodiment of the present invention. [Diagram 2] 2 is a functional block diagram illustrating a schematic functional configuration of the information processing device in FIG. 1. [Diagram 3] A figure showing an example of a virtual space in which avatars operated by users participating in the virtual experience content and virtual cameras are placed. [Figure 4] 4 is a flowchart showing the procedure of a virtual space display control process executed by the information processing device of FIG. 1. [Diagram 5] 5 is a flowchart showing the procedure of the shooting area division process in S405 of FIG. 4. [Figure 6] 5 is a flowchart showing the procedure of the avatar display control process of S406 in FIG. 4. [Figure 7] FIG. 7 is a diagram for explaining the display control in S605 of FIG. [Figure 8] FIG. 7 is a diagram for explaining the display control in S610 of FIG. [Figure 9] 2 is a diagram for explaining avatar display control in a case where a user wearing the HMD in FIG. 1 is operating a plurality of virtual cameras. [Figure 10] 7 is a flowchart showing another procedure of the avatar display control process in S406 of FIG. 4. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. The following embodiments do not limit the present invention, and not all of the combinations of features described in the present embodiments are necessarily essential to the solution of the present invention. The configuration of the present embodiments may be appropriately modified or changed depending on the specifications of the device to which the present invention is applied and various conditions (conditions of use, environment of use, etc.). In addition, the present invention may be configured by appropriately combining parts of each of the embodiments described below. In the following embodiments, the same configurations are described with the same reference symbols.

[0012] Fig. 1 is a block diagram showing a schematic hardware configuration of an information processing device 101 according to the present embodiment. In Fig. 1, the information processing device 101 includes a CPU 102, a ROM 103, a RAM 104, a recording unit 105, an input detection unit 106, a communication I / F 107, a GPU board 108, and a display driver 109. These are connected to each other via a bus 110.

[0013] The information processing device 101 is, for example, a personal computer (hereinafter, referred to as "PC"). An HMD 111, which is a wearable display device, is connected to the information processing device 101. HMD is an abbreviation for Head Mounted Display. The HMD 111 includes an operation unit 112 and a display unit 113. The information processing device 101 generates a VR image in which an avatar is placed in a virtual space generated by computer graphics (CG) technology, and transmits the VR image to the HMD 111 connected to the information processing device 101. The information processing device 101 also generates an MR image in which a virtual object or an avatar generated by computer graphics (CG) technology is superimposed on an image of real space captured by an imaging device mounted on the HMD 111, and transmits the MR image to the HMD 111.

[0014] The CPU 102 is a system control unit and controls the entire information processing device 101. The CPU 102 also executes an information processing program to realize a virtual space display control process shown in FIG. 4, which will be described later. The ROM 103 is a read-only memory that stores programs and parameters that do not require modification, such as basic programs and initial data. The RAM 104 is a memory for temporarily storing input information, calculation results in various processes, and the like.

[0015] The recording unit 105 is a device capable of writing and reading various information. The recording unit 105 is, for example, a hard disk or a memory card built into or external to the information processing device 101, or a memory card, a flexible disk, or an IC card detachable from the information processing device 101. The information processing program according to the present embodiment is recorded in the recording unit 105, and the information processing program is read from the recording unit 105, expanded in the RAM 104, and executed by the CPU 102. The information processing program may be stored in the ROM 103. The recording unit 105 also records information indicating an instruction input by a user to the operation unit 112, and information indicating the position and posture of the user detected by the HMD 111. Furthermore, the recording unit 105 records three-dimensional coordinate (x, y, z) data defining a three-dimensional virtual space and coordinate system (x, y) data on a plane for arranging an avatar.

[0016] The input detection unit 106 transmits information received from the operation unit 112 to the CPU 102. The operation unit 112 is, for example, a controller of the HMD 111, and is an operation device capable of implementing pointing operations and input operations of various commands. For example, the operation unit 112 receives an operation instruction for an avatar in a virtual space from a user. When the operation unit 112 receives an operation instruction for an avatar from a user, it transmits information indicating the operation instruction to the input detection unit 106. Note that the operation unit 112 is not limited to the controller of the HMD 111, and may be an operation device such as a keyboard or a mouse connected to the information processing device 101. Furthermore, the operation unit 112 may include a function of receiving instructions by voice in addition to a function of receiving instructions by the operation device.

[0017] The communication I / F 107 is an interface unit capable of transmitting and receiving data to and from a management server or the like that provides virtual experience content that allows users to experience virtual spaces such as VR, MR, the metaverse, etc. For example, the communication I / F 107 can receive, via the management server, voice data acquired by a microphone of an HMD worn by another user participating in the virtual experience content, position and orientation information detected by an HMD worn by another user, and the like.

[0018] The GPU board 108 is a general-purpose graphic board, and performs processes such as image generation and synthesis. In the present embodiment, the GPU board 108 can perform image generation and synthesis processes in which a plurality of avatars are arranged in the same virtual space. Note that an image generated in advance as an image of a virtual object may be recorded in the recording unit 105.

[0019] The display driver 109 is software for controlling a display unit 113 of the HMD 111 connected to the information processing device 101. The display unit 113 is an electronic display device such as a liquid crystal display device mounted on the HMD 111. The display unit 113 displays a UI such as a mouse cursor that can be operated by the user, a VR image generated by the GPU board 108 based on information recorded in the recording unit 105, and the like.

[0020] In this embodiment, when a user accesses a management server from information processing device 101, the user can participate in virtual experience content provided by this management server. When participating in the virtual experience content, an image of a virtual space in which avatars of other users participating in the virtual experience content are arranged is displayed on display unit 113 of HMD 111 worn by the user. In this embodiment, for example, when a user operates operation unit 112 to enable a photographing mode, the avatars can take pictures of each other. Note that in this embodiment, a camera that takes pictures in a virtual space is defined as a "virtual camera," and an avatar that is the subject of the photograph is defined as a "subject avatar."

[0021] Fig. 2 is a functional block diagram illustrating a schematic functional configuration of the information processing device 101 in Fig. 1. In Fig. 2, the information processing device 101 includes, as its functional configuration, a subject avatar determination unit 201, a subject avatar position acquisition unit 202, a camera field of view acquisition unit 204, a shooting area division unit 208, an avatar position acquisition unit 210, and an avatar display control unit 211.

[0022] The subject avatar determination unit 201 determines a subject avatar to be photographed in a virtual space. In this embodiment, for example, the subject avatar determination unit 201 may determine the subject avatar by a touch operation of a user operating a virtual camera, or may determine the subject avatar based on preregistered information such as friend information. The subject avatar determination unit 201 may also determine the subject avatar by utilizing the voice or line of sight of the user operating the virtual camera.

[0023] The subject avatar position acquisition unit 202 acquires position information in the virtual space of the subject avatar determined by the subject avatar determination unit 201. The subject avatar position acquisition unit 202 stores subject avatar information 203 including the acquired position information in the RAM 104 or the like.

[0024] Camera visual field area acquisition unit 204 calculates the visual field area of ​​the virtual camera based on virtual space information 205, virtual camera information 206 including information such as the angle of view of the virtual camera, and position information of the virtual camera placed in the virtual space by the user. Camera visual field area acquisition unit 204 stores camera visual field area information 207 including information on this visual field area in RAM 104 or the like. Note that in this embodiment, the virtual camera may be held by an avatar, or may be installed at a specific position in the virtual space.

[0025] The shooting area division unit 208 divides the shooting area of ​​the virtual camera based on the subject avatar information 203 and the camera field of view area information 207. Specifically, the shooting area division unit 208 divides the shooting area of ​​the virtual camera into a front area and a rear area based on the subject avatar. The front area is an area on the virtual camera side based on the subject avatar, that is, an area from the virtual camera to the subject avatar. The rear area is an area on the opposite side of the virtual camera based on the subject avatar, that is, an area behind the subject avatar. The shooting area division unit 208 stores shooting area information 209 including each coordinate information of the front area and the rear area in the RAM 104 or the like.

[0026] The avatar position acquisition unit 210 acquires position information of the avatar in the shooting area of ​​the virtual camera. The avatar display control unit 211 controls the display of the avatar based on the avatar position information acquired by the avatar position acquisition unit 210 and the shooting area information 209.

[0027] Next, avatar display control in this embodiment will be described.

[0028] FIG. 3 is a diagram showing an example of a virtual space in which avatars of users participating in virtual experience content and virtual cameras are placed.

[0029] 3 includes avatars 302 to 305 and a virtual camera 306. Avatar 302 is the avatar of a user who operates virtual camera 306. Avatars 303 to 305 are the avatars of other users who participate in the virtual experience content.

[0030] Here, for example, assume that a user who operates virtual camera 306 places virtual camera 306 in a position where his / her avatar 302 can be photographed together with avatars 303 and 304. However, since many avatars exist in virtual space 301, it is difficult for virtual camera 306 to photograph only the avatars to be photographed, and for example, as shown in Fig. 3, avatar 305 that is not the subject of the photograph may be reflected in the image. In order to avoid such a situation, for example, a function for preventing avatars other than acquaintances from being reflected in the image has been conventionally used, but with this function, for example, when avatar 305 is the avatar of an acquaintance, avatar 305 may be unintentionally reflected in the image.

[0031] In contrast, in this embodiment, the shooting area of ​​the virtual camera is divided into a front area and a rear area based on the subject avatar information 203 and the camera field of view area information 207. Based on whether an avatar other than the subject avatar is included in the front area or the rear area, display control is performed to prevent the avatar from being captured in front of the subject avatar in the shooting by the virtual camera.

[0032] 4 is a flowchart showing the procedure of the virtual space display control process executed by the information processing device 101 of FIG. 1. The virtual space display control process is realized by the CPU 102 reading out the information processing program stored in the recording unit 105 to the RAM 104 and executing it. In this embodiment, the process is executed when the shooting mode for shooting with the virtual camera is set to be enabled. The virtual space display control process may be executed periodically at a specified time interval after the shooting mode is set to be enabled, or may be executed when an execution instruction is received from the user after the shooting mode is set to be enabled. In this embodiment, as an example, a control when shooting with the virtual camera 306 in the virtual space 301 will be described as shown in FIG. 3.

[0033] In FIG. 4, first, CPU 102 determines a subject avatar to be photographed in virtual space 301 by subject avatar determination unit 201 (S (step) 401). Subject avatar information 203 including position information of the determined subject avatar in virtual space 301 is stored in RAM 104 or the like. Note that in S401, as described above, a pre-registered avatar may be determined as the subject avatar, or an avatar designated by a user operating virtual camera 306 on a panel of virtual camera 306 or the like may be determined as the subject avatar. Also, the avatar of the user operating virtual camera 306 may be determined as the subject avatar. Note that in S401, multiple avatars may be determined as the subject avatar.

[0034] Next, CPU 102 determines whether or not the photographed avatar information 203 corresponding to the photographed avatar determined in S401 is stored in RAM 104 etc. (S402). If it is determined in S402 that the photographed avatar information 203 corresponding to the photographed avatar determined in S401 is not stored in RAM 104 etc., this process ends.

[0035] If it is determined in S402 that the photographed avatar information 203 corresponding to the photographed avatar determined in S401 is stored in the RAM 104 or the like, the CPU 102 acquires the photographed avatar information 203 corresponding to the photographed avatar determined in S401 (S403).

[0036] Next, CPU 102 uses camera field of view acquisition unit 204 to calculate the field of view of virtual camera 306 based on virtual space information 205, virtual camera information 206, and position information of virtual camera 306 placed by the user in virtual space 301. CPU 102 stores camera field of view information 207 including information on the field of view of virtual camera 306 in RAM 104 or the like (S404).

[0037] Next, CPU 102 performs shooting area division processing in Fig. 5 (described later) by shooting area division unit 208 (S405), and divides the shooting area of ​​virtual camera 306 into forward area 307 and rear area 308. Next, CPU 102 performs avatar display control processing in Fig. 6 (described later) (S406), and performs display control to prevent an unintended avatar from appearing in front of the subject avatar in shooting by virtual camera 306. Thereafter, this processing ends.

[0038] FIG. 5 is a flowchart showing the procedure of the shooting area division process in S405 of FIG.

[0039] In FIG. 5, the CPU 102 determines a criterion for dividing the photographed area (S501). For example, when one avatar is determined as the subject avatar in S401, the avatar determined as the subject avatar is determined as the criterion. Also, when multiple avatars are determined as the subject avatars in S401, the avatar that is closest to the virtual camera 306 among the multiple avatars determined as the subject avatars is determined as the criterion. Note that the method of determining the criterion when multiple avatars are determined as the subject avatars in S401 is not limited to this method. For example, the avatar that is farthest from the virtual camera 306 among the multiple avatars determined as the subject avatars may be determined as the criterion. Also, the avatar designated by the user who operates the virtual camera 306 among the multiple avatars determined as the subject avatars may be determined as the criterion. Also, when the avatar determined as the criterion is away from the virtual camera 306 by a predetermined distance or more, control may be performed to change the criterion to another avatar. Hereinafter, the subject avatar determined as the criterion is referred to as the "reference subject avatar."

[0040] Next, CPU 102 acquires position information of the reference subject avatar in the virtual space (S501). Next, CPU 102 divides the shooting area of ​​virtual camera 306 into forward area 307 and rearward area 308 based on camera field of view area information 207 stored in RAM 104 or the like and position information of the reference subject avatar. As described above, forward area 307 is an area on the virtual camera 306 side based on the reference subject avatar, that is, an area from virtual camera 306 to the reference subject avatar in the shooting area of ​​virtual camera 306. Rearward area 308 is an area on the opposite side of virtual camera 306 based on the reference subject avatar, that is, an area behind the reference subject avatar in the shooting area of ​​virtual camera 306.

[0041] Next, the CPU 102 converts the coordinate information of the front area 307 and the coordinate information of the rear area 308 into coordinate information in three-dimensional space, stores the shooting area information 209 including the converted coordinate information in the RAM 104 or the like (S504), and ends this process.

[0042] 6 is a flowchart showing the procedure of the avatar display control process in S406 in FIG. 4. In FIG. 6, CPU 102 acquires coordinate information of forward region 307 and coordinate information of backward region 308 from shooting region information 209 (S601). Next, CPU 102 acquires position information of avatars included in virtual space 301 by avatar position acquisition unit 210 (S602). In S602, CPU 102 acquires, for example, position information of all avatars included in virtual space 301. Note that in S602, position information of avatars within a viewing area of ​​a second virtual camera arranged in advance in virtual space 301 may be acquired among the avatars included in virtual space 301. Note that the second virtual camera is a virtual camera with a wider angle than virtual camera 306, and the viewing area of ​​the second virtual camera includes at least the entire viewing area of ​​virtual camera 306. Also, in S602, position information of avatars within the field of view of the user operating the virtual camera 306, among the avatars included in the virtual space 301, may be acquired.

[0043] Next, the CPU 102 determines whether or not the avatar is included in the forward area based on the coordinate information acquired in S601 and the position information acquired in S602 (S603).

[0044] If it is determined in S603 that the avatar is included in the forward region, the CPU 102 determines whether or not the avatar included in the forward region is a subject avatar (S604).

[0045] When it is determined in S604 that the avatar included in the forward region is not the subject avatar, the CPU 102 transparently displays this avatar (in FIG. 6, this is referred to as the "corresponding avatar") in the virtual space 301 (S605). As a result, the virtual camera 306 is displayed on the display unit 113 of the HMD 111 worn by the user who operates the virtual camera 306 as in the image 701 of FIG. 7(a), but the avatar 305 included in the forward region and which is not the subject avatar is not displayed. In other words, the avatar 305 is substantially erased from the virtual space 301 seen by the user who operates the virtual camera 306. By controlling in this manner, the viewpoint image of the virtual camera 306 includes the subject avatars 302 to 304 as in the image 702 of FIG. 7(b), but does not include the avatar 305 included in the forward region and which is not the subject avatar. Note that virtual camera 306 and avatar 305 are displayed on the display unit of an HMD worn by another user, for example, a user corresponding to subject avatars 303 and 304, as in image 703 in Fig. 7(c). Thus, in this embodiment, avatar 305 that is included in the forward area and is not a subject avatar is not displayed on display unit 113 of HMD 111 worn by a user who operates virtual camera 306, among multiple users participating in the virtual experience content. Then, this process ends.

[0046] If it is determined in S604 that the avatar included in the forward region is the subject avatar, CPU 102 displays this avatar (in FIG. 6, this is referred to as the "corresponding avatar") in virtual space 301 (S606), and ends this process.

[0047] If it is determined in S603 that the avatar is not included in the forward region, the CPU 102 determines whether or not the avatar is included in the backward region based on the coordinate information acquired in S601 and the position information acquired in S602 (S607).

[0048] If it is determined in S607 that the avatar is not included in the rear region, the process proceeds to S606. If it is determined in S607 that the avatar is included in the rear region, the CPU 102 determines whether the avatar included in the rear region is a subject avatar (S608).

[0049] If it is determined in S608 that the avatar included in the rear region is the subject avatar, the process proceeds to S606. If it is determined in S608 that the avatar included in the rear region is not the subject avatar, the CPU 102 displays this avatar (indicated as "corresponding avatar" in FIG. 6) in the virtual space 301 (S609). Next, the CPU 102 performs blurring on this avatar so that the avatar cannot be identified (S610). By controlling in this manner, for example, as shown in FIG. 8(a), when an avatar 801 other than the subject avatars 302 to 304 is included in the rear region 308, the subject avatars 302 to 304 and the avatar 801 are included in the viewpoint image of the virtual camera 306, as in the image 802 in FIG. 8(b). The avatar 801 has been subjected to blurring so that the avatar 801 cannot be identified. Then, the process ends.

[0050] According to the above-described embodiment, the shooting area of ​​the virtual camera 306 is divided into a forward area 307 and a rearward area 308 based on the camera field of view information 207 and the position information of the reference subject avatar. Based on whether an avatar other than the subject avatar is included in the forward area 307 or the rearward area 308, display control is performed to prevent the avatar from appearing in front of the subject avatar when shooting with the virtual camera 306. This makes it possible to prevent an unintended avatar from appearing in front of the subject avatar when shooting with the virtual camera 306.

[0051] Furthermore, in the above-described embodiment, when multiple avatars are determined as subject avatars, the shooting area of ​​virtual camera 306 is divided based on an avatar designated by the user operating virtual camera 306 among the multiple avatars determined as subject avatars. This makes it possible to prevent an avatar other than the subject avatar from appearing in front of the subject avatar designated by the user operating virtual camera 306.

[0052] Furthermore, in the above-described embodiment, when multiple avatars are determined as subject avatars, the shooting area of ​​virtual camera 306 is divided based on the avatar that is closest to virtual camera 306 among the multiple avatars determined as subject avatars. This makes it possible to prevent avatars other than the subject avatar from appearing in front of the subject avatar that is closest to virtual camera 306.

[0053] Furthermore, in the above-described embodiment, when multiple avatars are determined as subject avatars, the shooting area of ​​virtual camera 306 is divided based on the avatar that is the furthest from virtual camera 306 among the multiple avatars determined as subject avatars. This makes it possible to prevent avatars other than the subject avatar from appearing in front of all of the subject avatars.

[0054] In the above-described embodiment, when an avatar other than the subject avatar is included in the forward region, the avatar is displayed transparently. In other words, avatars other than the subject avatar that are included in the forward region are substantially erased from virtual space 301 viewed by the user operating virtual camera 306. This makes it possible to control the avatar so that it is not captured in the image captured by virtual camera 306.

[0055] In the above-described embodiment, when an avatar other than the subject avatar is included in the rear area, the avatar is blurred before being displayed. This makes it possible to control the shooting of the virtual camera 306 so that avatars included in the rear area and other than the subject avatar cannot be identified.

[0056] In the above-described embodiment, the display unit that displays the avatar is the display unit 113 of the HMD 111 connected to the information processing device 101. This makes it possible to prevent an unintended avatar from appearing in front of the subject avatar when an avatar displayed on the display unit 113 of the HMD 111 connected to the information processing device 101 is photographed by the virtual camera 306.

[0057] In this embodiment, when the user operating HMD 111 operates a plurality of virtual cameras, the display of the avatar may be controlled based on camera field of view information 207 of each virtual camera.

[0058] FIG. 9 is a diagram for explaining avatar display control in a case where a user wearing HMD 111 in FIG. 1 operates a plurality of virtual cameras.

[0059] 9(a) shows an example of a virtual space 901 in which avatars of users participating in virtual experience content and multiple virtual cameras operated by these users are arranged. Virtual cameras 902 and 903 are arranged in the virtual space 901. The virtual space 901 also includes avatars 904 to 906 that are not to be photographed and subject avatars 907 and 908. Note that subject avatar 907 is the avatar of the user operating virtual cameras 902 and 903, and subject avatar 907 is determined as a criterion for dividing the photographed area.

[0060] 9(a), the area indicated by the dotted line is the shooting area of ​​virtual camera 902, which is divided into a forward area 909 and a rear area 910 based on subject avatar 907. The area indicated by the dashed dotted line is the shooting area of ​​virtual camera 903, which is divided into a forward area 911 and a rear area 912 based on subject avatar 907.

[0061] In this way, when a user who operates the HMD 111 operates a plurality of virtual cameras 902 and 903, in S404 in Fig. 4 described above, the camera field of view area information 207 of the virtual camera 902 and the camera field of view area information 207 of the virtual camera 903 are stored in the RAM 104 or the like. Next, in S405, the shooting area information 209 of the virtual camera 902 including the coordinate information of the front area 909 and the coordinate information of the rear area 910 divided based on the camera field of view area information 207 of the virtual camera 902 is stored in the RAM 104 or the like. Also, in S405, the shooting area information 209 of the virtual camera 903 including the coordinate information of the front area 911 and the coordinate information of the rear area 912 divided based on the camera field of view area information 207 of the virtual camera 903 is stored in the RAM 104 or the like. Next, in S406, the avatar display control process in Fig. 10 is performed.

[0062] Fig. 10 is a flowchart showing another procedure of the avatar display control process of S406 in Fig. 4. Note that the avatar display control process in Fig. 10 is similar to the avatar display control process in Fig. 6 described above, and the following will particularly describe the contents that differ from the avatar display control process in Fig. 6 described above.

[0063] In FIG. 10, the CPU 102 determines whether or not a plurality of virtual cameras operated by a user wearing the HMD 111 exist in the virtual space (S1001).

[0064] If it is determined in S1001 that there are multiple virtual cameras in the virtual space operated by the user wearing the HMD 111, the CPU 102 selects one of the multiple virtual cameras (S1002). For example, as shown in Fig. 9, if there are multiple virtual cameras 902 and 903 in the virtual space 901, the CPU 102 selects one of the virtual cameras 902 and 903, for example, the virtual camera 902. Next, the process proceeds to S1003.

[0065] If it is determined in S1001 that the virtual space does not include a plurality of virtual cameras operated by the user wearing the HMD 111, the process proceeds to S1003. In S1003, the CPU 102 acquires coordinate information of the front area and coordinate information of the rear area from the shooting area information 209 of the virtual camera. For example, as shown in FIG. 3, when one virtual camera 306 exists in the virtual space 301, the CPU 102 acquires coordinate information of the front area 307 and coordinate information of the rear area 308 from the shooting area information 209 of the virtual camera 306. On the other hand, as shown in FIG. 9, when a plurality of virtual cameras 902 and 903 exist in the virtual space 901, the CPU 102 acquires coordinate information of the front area 909 and coordinate information of the rear area 910 from the shooting area information 209 of the virtual camera 902 selected in S1002.

[0066] Next, the CPU 102 performs steps S1004 and S1005 which are the same processes as steps S602 and S603 described above.

[0067] If it is determined in S1005 that the avatar is not included in the forward region, S1006 to S1009, which are the same processes as S607 to S610 described above, are performed. After that, the process proceeds to S1013, which will be described later.

[0068] If it is determined in S1005 that the avatar is included in the forward region, the process proceeds to S1010, which is the same process as S604 described above.

[0069] If it is determined in S1010 that the avatar included in the forward region is not a subject avatar, S1011, which is the same process as S605 described above, is performed. As a result, for example, when virtual camera 902 is selected in S1002, avatar 904 included in forward region 909 and not a subject avatar is displayed transparently. That is, avatar 904 is substantially erased from virtual space 901 viewed by the user operating virtual camera 902. By controlling in this manner, subject avatars 907 to 908 are included in the viewpoint image of virtual camera 902 as in image 913 in FIG. 9(b), but avatar 904 included in forward region 909 and not a subject avatar is not included. After that, the process proceeds to S1013 described later.

[0070] If it is determined in S1010 that the avatar included in the forward area is the subject avatar, the process of S1012, which is the same as the process of S606 described above, is performed. Next, the CPU 102 determines whether the display control process based on the shooting area information 209 of all virtual cameras operated by the user wearing the HMD 111 has been completed (S1013).

[0071] When it is determined in S1013 that the display control process based on the shooting area information 209 of any of the virtual cameras operated by the user wearing the HMD 111 is not completed, the process returns to S1002. The CPU 102 selects the virtual camera 903, which is another virtual camera, from the virtual cameras 902 and 903. In this manner, the display control process based on the shooting area information 209 of the virtual camera 903 is performed. For example, in S1004, the avatar 905 included in the forward area 911 and not a subject avatar is transparently displayed, and the avatar 905 is substantially erased from the virtual space 901 seen by the user operating the virtual camera 903. By controlling in this manner, the viewpoint image of the virtual camera 903 includes the subject avatars 907 to 908 as in the image 914 of FIG. 9(c), but does not include the avatar 905 included in the forward area 911 and not a subject avatar. In this manner, in the present embodiment, the display control process based on the shooting area information 209 of each of the virtual cameras 902 and 903 is performed. As a result, the virtual cameras 902, 903 and the subject avatar 908 are displayed on the display unit 113 of the HMD 111 worn by the user operating the virtual cameras 902, 903, as in the image 915 in Fig. 9(d), and the avatars 904, 905 that are included in the forward area and are not subject avatars are not displayed. Note that the virtual cameras 902, 903 and the avatars 904, 905 are displayed on the display unit of the HMD worn by another user, for example, the user corresponding to the subject avatar 908, as in the image 916 in Fig. 9(e).

[0072] If it is determined in S1013 that the display control process based on the shooting area information 209 of all virtual cameras operated by the user wearing the HMD 111 has been completed, this process ends.

[0073] In the present embodiment, a PC is shown as an example of the information processing device 101, but the information processing device 101 is not limited to a PC. For example, the information processing device 101 may be a smartphone or a tablet terminal.

[0074] Furthermore, an HMD having a function of communicating with a management server and a function of generating and synthesizing VR images and MR images may be the information processing device 101. Such an HMD may be connected to the above-mentioned operation unit 112 as its operation unit.

[0075] In the present embodiment, the configuration in which the avatars included in the forward area and other than the subject avatar are transparently displayed in S605 and S1011 has been described, but the present invention is not limited to this configuration. For example, only the outline of the avatar may be displayed, or a fade-out process may be performed to gradually display the avatar transparently. By controlling in this way, it is possible to prevent the subject avatar from being blocked by an unintended avatar when shooting with a virtual camera.

[0076] In the present embodiment, the configuration in S610 and S1009 has been described in which blurring is performed on avatars included in the rear area other than the subject avatar, but the present invention is not limited to this configuration. For example, the avatars may be displayed transparently. This makes it possible to prevent an unintended avatar from appearing behind the subject avatar.

[0077] In the present embodiment, the configuration in which it is determined whether the avatar is included in the forward region and then it is determined whether the avatar is included in the rear region has been described with reference to Fig. 6 and Fig. 10, but the present invention is not limited to this configuration. For example, it may be determined whether the avatar is included in the forward region and then it may be determined whether the avatar is included in the rear region.

[0078] In the present embodiment, the display unit of the HMD worn by a user other than the user who operates the virtual camera displays an avatar that is included in the forward area and is not the subject avatar, but the present invention is not limited to this configuration. For example, an instruction to transparently display an avatar that is included in the forward area and is not the subject avatar may be sent directly or indirectly via a management server to an information processing device operated by a user corresponding to the subject avatar among the other users. That is, the viewpoint images of all users corresponding to the subject avatar are controlled so that avatars that are included in the forward area and are not the subject avatar are not included. This makes it possible to prevent the subject avatar from being distracted by the avatar, which would interfere with the shooting.

[0079] In addition, in this embodiment, an instruction to display only the contours of avatars that are included in the forward area and are other than the subject avatar may be sent directly or indirectly via a management server to an information processing device operated by a user corresponding to the subject avatar among other users.

[0080] The present invention can also be realized by executing the following process. That is, software (programs) that realize the functions of the above-mentioned embodiments are supplied to a system or device via a network or various storage media, and the computer (or CPU, MPU, etc.) of the system or device reads and executes the programs. The present invention can also be realized by multiple processors working together to perform processes.

[0081] Furthermore, all of the above-described embodiments are illustrative of the present invention and are not limiting, and the present invention can be embodied in various other modified and altered forms.

[0082] The disclosure of this embodiment includes the following configurations and methods. (Configuration 1) An information processing device that controls the display of a virtual space in which avatars are placed on a display means, comprising: a means for determining a subject avatar to be photographed in the virtual space; and a means for controlling the display of the avatar on the display means, wherein the control means acquires information indicating a field of view of a virtual camera that photographs an avatar included in the virtual space, acquires positional information of the avatar included in the virtual space, divides the shooting area of ​​the virtual camera based on the information indicating the field of view of the virtual camera and the positional information of the subject avatar, and performs display control to prevent an avatar other than the subject avatar from being captured in front of the subject avatar when photographed by the virtual camera, based on which of the divided areas an avatar other than the subject avatar is included in. (Configuration 2) The information processing device described in Configuration 1, wherein the control means divides the shooting area of ​​the virtual camera into a first area which is an area on the virtual camera side based on the subject avatar, and a second area which is an area on the opposite side of the virtual camera based on the subject avatar. (Configuration 3) The information processing device according to configuration 2, wherein the control means, when an avatar other than the subject avatar is included in the first area, displays the avatar transparently. (Configuration 4) The information processing device described in configuration 3, characterized in that the control means transmits, directly or indirectly, an instruction to another information processing device different from the information processing device and operated by a user corresponding to the subject avatar, to transparently display avatars included in the first area other than the subject avatar. (Configuration 5) The information processing device according to configuration 2, wherein the control means, when an avatar other than the subject avatar is included in the first area, displays only the outline of the avatar. (Configuration 6) The information processing device described in Configuration 5, characterized in that the control means transmits, directly or indirectly, an instruction to another information processing device different from the information processing device and operated by a user corresponding to the subject avatar, to display only the contours of avatars that are included in the first area and other than the subject avatar. (Configuration 7) An information processing device described in any one of configurations 2 to 6, characterized in that when an avatar other than the subject avatar is included in the second area, the control means applies a blurring process to the avatar and displays it. (Configuration 8) An information processing device as described in any one of configurations 1 to 7, characterized in that when multiple virtual cameras are placed in the virtual space, the control means acquires information indicating the field of view of the multiple virtual cameras corresponding to the multiple virtual cameras, and controls the display of each of the avatars based on the information indicating the field of view of the multiple virtual cameras. (Configuration 9) An information processing device according to any one of configurations 1 to 8, characterized in that when multiple avatars are determined to be the subject avatars, the control means divides the shooting area of ​​the virtual camera based on the avatar among the multiple avatars that is closest to the virtual camera. (Configuration 10) An information processing device described in any one of configurations 1 to 8, characterized in that when multiple avatars are determined to be the subject avatars, the control means divides the shooting area of ​​the virtual camera based on the avatar among the multiple avatars that is farthest from the virtual camera. (Configuration 11) An information processing device described in any one of configurations 1 to 8, characterized in that when multiple avatars are determined to be the subject avatars, the control means divides the shooting area of ​​the virtual camera based on an avatar among the multiple avatars that is specified by a user operating the virtual camera. (Configuration 12) The information processing device according to any one of configurations 1 to 11, wherein the display means is a display means of a wearable display device connected to the information processing device. (Configuration 13) The information processing device according to any one of configurations 1 to 11, characterized in that the information processing device is a wearable display device integrated with the display means. [Explanation of symbols]

[0083] 101 Information processing device 102 CPU 111 HMD 113 Display section 301 Virtual Space 306 Virtual Camera 307 Anterior area 308 Posterior area 902 Virtual Camera 903 Virtual Camera

Claims

1. An information processing device that controls displaying a virtual space in which an avatar is placed on a display means, A means for determining a subject avatar to be photographed in the virtual space; a means for controlling the display of an avatar on the display means, The control means includes: acquiring information indicating a viewing area of ​​a virtual camera that captures an avatar included in the virtual space; Acquire location information of an avatar included in the virtual space; Dividing a shooting area of ​​the virtual camera based on information indicating a viewing area of ​​the virtual camera and position information of the subject avatar; An information processing device characterized by performing display control to prevent an avatar other than the subject avatar from appearing in front of the subject avatar when photographed by the virtual camera, based on which of the divided areas an avatar other than the subject avatar is included in.

2. The information processing device described in claim 1, characterized in that the control means divides the shooting area of ​​the virtual camera into a first area which is an area on the virtual camera side based on the subject avatar, and a second area which is an area on the opposite side of the virtual camera based on the subject avatar.

3. The information processing apparatus according to claim 2 , wherein the control means, when an avatar other than the subject avatar is included in the first area, displays the avatar transparently.

4. The information processing device described in claim 3, characterized in that the control means directly or indirectly sends an instruction to another information processing device different from the information processing device and operated by a user corresponding to the subject avatar to transparently display avatars included in the first area other than the subject avatar.

5. 3 . The information processing apparatus according to claim 2 , wherein, when an avatar other than the subject avatar is included in the first area, the control means displays only an outline of the avatar.

6. The information processing device described in claim 5, characterized in that the control means directly or indirectly sends an instruction to another information processing device different from the information processing device and operated by a user corresponding to the subject avatar to display only the contours of avatars included in the first area and other than the subject avatar.

7. 3. The information processing apparatus according to claim 2, wherein the control means, when an avatar other than the subject avatar is included in the second area, displays the avatar by applying a blurring process to the avatar.

8. The information processing device described in claim 1, characterized in that when multiple virtual cameras are placed in the virtual space, the control means acquires information indicating the field of view of the multiple virtual cameras corresponding to the multiple virtual cameras, and controls the display of each of the avatars based on the information indicating the field of view of the multiple virtual cameras.

9. The information processing device according to claim 1, characterized in that when multiple avatars are determined to be the subject avatars, the control means divides the shooting area of ​​the virtual camera based on the avatar among the multiple avatars that is closest to the virtual camera.

10. The information processing device according to claim 1, characterized in that, when multiple avatars are determined to be the subject avatars, the control means divides the shooting area of ​​the virtual camera based on the avatar among the multiple avatars that is farthest from the virtual camera.

11. The information processing device according to claim 1, characterized in that when multiple avatars are determined to be the subject avatars, the control means divides the shooting area of ​​the virtual camera based on an avatar among the multiple avatars that is specified by a user operating the virtual camera.

12. The information processing apparatus according to claim 1 , wherein the display means is a display means of a wearable display device connected to the information processing apparatus.

13. The information processing apparatus according to claim 1 , wherein the information processing apparatus is a wearable display device integrated with the display means.

14. A method for controlling an information processing device that controls displaying a virtual space in which an avatar is placed on a display means, the method comprising: determining a subject avatar to be photographed in the virtual space; and controlling the display means to display an avatar. The step of controlling includes: acquiring information indicating a viewing area of ​​a virtual camera that captures an avatar included in the virtual space; Acquire location information of an avatar included in the virtual space; Dividing a shooting area of ​​the virtual camera based on information indicating a viewing area of ​​the virtual camera and position information of the subject avatar; A control method for an information processing device, characterized in that display control is performed to prevent an avatar other than the subject avatar from being reflected in front of the subject avatar when photographed by the virtual camera, based on which of the divided areas an avatar other than the subject avatar is included in.

15. A program for causing a computer to execute a control method of an information processing device for controlling display of a virtual space in which an avatar is placed on a display means, comprising: The method for controlling the information processing device includes: determining a subject avatar to be photographed in the virtual space; and controlling the display means to display an avatar. The step of controlling includes: acquiring information indicating a viewing area of ​​a virtual camera that captures an avatar included in the virtual space; Acquire location information of an avatar included in the virtual space; Dividing a shooting area of ​​the virtual camera based on information indicating a viewing area of ​​the virtual camera and position information of the subject avatar; A program characterized by performing display control to prevent an avatar other than the subject avatar from appearing in front of the subject avatar when photographed by the virtual camera, based on which of the divided areas an avatar other than the subject avatar is included in.

Images