Information processing device, method for controlling the information processing device, and program

Abstract

The objective is to provide an information processing device, a control method for the information processing device, and a program that can reliably convey composition instructions from the photographer to the subject during shooting in a metaverse space. [Solution] The HMD 100 includes a subject setting means 301 for the photographer user 103 to set the subject to be instructed on the composition from among one or more subject users 101, 102 in the metaverse space; a standing position setting means 302 for the photographer user 103 to set the standing position 601 in the metaverse space for the subject user 101 set by the subject setting means 301; and a marker display means 303 that displays a standing position marker 108 at the standing position 601 in the metaverse space that can be seen by the photographer user 103 and the subject user 101 set by the subject setting means 301, in a manner that it does not appear in the photograph taken in the metaverse space.

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, a control method for the information processing apparatus, and a program.

Background Art

[0002] In recent years, technological innovation in virtual reality (hereinafter referred to as "VR") has been remarkable. Along with the technological innovation, the spread of VR devices such as head-mounted displays (hereinafter referred to as "HMDs") has advanced, and communication between users in the virtual space of VR has become active. The form of applications for such communication is called the metaverse.

[0003] In the virtual space of the metaverse (hereinafter referred to as the "metaverse space"), a user can communicate with other users using an avatar that is their alter ego. As communication with other users, for example, there is shooting with an avatar as the subject. In this regard, due to the progress of tracking technologies such as eye tracking that tracks the user's line of sight and body tracking that tracks the user's entire body, avatars have become able to reproduce the user's body movements more faithfully. Therefore, in shooting in the metaverse space, by correctly reflecting the user's line of sight and pose detected by these tracking technologies on the user's avatar, the expressiveness can be greatly improved.

[0004] Given this background, it is likely that photography activities in the metaverse space will evolve in a direction that pursues artistic expression. However, even if the physical movements of the subject user (hereinafter referred to as "subject user") can be directly reflected in the subject user's avatar, it does not necessarily mean that the photographer user (hereinafter referred to as "photographer user") can take a photograph as intended. In other words, unlike real-world photography, in photography in the metaverse space, the photographer user's intentions are often not properly conveyed to the subject user, and there is a tendency for the resulting image to differ from the intended composition.

[0005] Regarding related technologies, for example, Patent Document 1 describes an imaging system in which a person wearing AR goggles is photographed by a camera. In the imaging system described in Patent Document 1, the relative positional relationship between the AR goggles and the camera is determined using image recognition from the image captured by the camera for live view. Furthermore, the live view is displayed on the AR goggles' display so that the person wearing the AR goggles is looking directly at the camera. As a result, the person wearing the AR goggles can check how they appear in the live view while maintaining eye contact with the camera. [Prior art documents] [Patent Documents]

[0006] [Patent Document 1] Japanese Patent Publication No. 2022-114600 [Overview of the project] [Problems that the invention aims to solve]

[0007] However, the imaging system described in Patent Document 1 is a technology that assumes the subject is looking at the camera, and therefore could not be applied to shooting in the metaverse space when the user taking the picture did not expect the subject to be looking at the camera. Furthermore, the imaging system described in Patent Document 1 could not control elements such as the position and pose of the subject user's avatar, that is, elements that greatly affect the composition of the shot in the metaverse space.

[0008] The present invention has been made in view of the above-mentioned problems. The present invention aims to provide an information processing device, a control method for the information processing device, and a program that can reliably convey composition instructions from the photographer user to the subject user during shooting in the metaverse space. [Means for solving the problem]

[0009] To achieve the above objective, the information processing device of the present invention is characterized by comprising: a first target setting means for the photographer to set the target of composition instructions from among one or more subject users in a photograph taken in the metaverse space; a first position setting means for the photographer to set the standing position in the metaverse space relative to the subject user set by the first target setting means; and a first display means for displaying a first marker at the standing position in the metaverse space that can be seen by the photographer and the subject user set by the first target setting means, in such a way that it does not appear in the photograph taken in the metaverse space. [Effects of the Invention]

[0010] According to the present invention, the photographer's composition instructions for shooting in the metaverse space can be reliably conveyed to the subject. [Brief explanation of the drawing]

[0011] [Figure 1A] This is an illustrative diagram to explain photography in the metaverse space. [Figure 1B] This is an illustrative diagram to explain photography in the metaverse space. [Figure 2] Block diagram showing an example of an HMD hardware configuration. [Figure 3] This block shows an example of the functional configuration of an HMD. [Figure 4] This flowchart shows the process of how a photographer can give composition instructions to a subject during a shoot in the metaverse space. [Figure 5] This diagram shows the GUI used by the photographer to select a subject from among the subject users for composition instructions. [Figure 6] This diagram shows, from the photographer's perspective, the expected position of the subject user's avatar in the metaverse space, which is the target of the composition instructions. [Figure 7] This diagram shows, from the photographer's perspective, the expected viewpoint in the metaverse space for the subject user's avatar, which is the target of the composition instructions. [Figure 8] This is a diagram showing a pose object from a third-person perspective. [Figure 9] This diagram shows the subject's field of view when composition instructions are given. [Figure 10] This diagram shows the field of view of the subject user when the subject avatar moves to its position and faces the live view. [Figure 11] This flowchart shows the process by which the standing position markers and live view positions are adjusted. [Figure 12] This diagram shows the metaverse space from the photographer's perspective, where the photographer selects the target for position adjustment from the standing position marker and the live view. [Figure 13] This diagram illustrates how to adjust the position of the live view that has been set as the target of position adjustment. [Figure 14] This flowchart shows the process by which the gaze of the subject avatar is displayed. [Figure 15] This diagram shows the metaverse space, where the subject avatar's gaze is displayed, from the perspective of the photographer / user.

Best Mode for Carrying Out the Invention

[0012] Hereinafter, each embodiment of the present invention will be described in detail with reference to the drawings. However, the configurations described in the following embodiments are merely examples, and the scope of the present invention is not limited by the configurations described in each embodiment. For example, each part constituting the present invention can be replaced with any configuration that can exhibit the same function. Also, any components may be added. Also, any two or more configurations (features) in each embodiment can be combined. Also, not all combinations of the features described in each embodiment are essential for the solution means of the present invention. Also, the features of each embodiment can be appropriately modified or changed according to the specifications of the device to which the present invention is applied and various conditions (usage conditions, usage environment, etc.).

[0013] <First Embodiment> Hereinafter, the first embodiment will be described with reference to FIGS. 1A to 10. In the first embodiment, an example of shooting in the metaverse space will be described. FIGS. 1A and 1B are image diagrams for explaining shooting in the metaverse space. FIG. 1A shows the real space, and FIG. 1B shows the metaverse space. In FIGS. 1A(a), (b), and (c), 100 indicates a full immersion type HMD (information processing device), and 101 to 103 indicate users of the metaverse. Each of the users 101 to 103 wears the HMD 100 and exists in physically different real spaces.

[0014] In the first embodiment, users 101 and 102 will be described as subject users, and user 103 will be described as a photographer user. The roles of the subjects and the photographer of users 101 to 103 can be arbitrarily interchanged. Hereinafter, when specifying the roles of the subject and the photographer and describing users 101 to 103, user 101 will be described as "subject user 101", user 102 will be described as "subject user 102", and user 103 will be described as "photographer user 103". Note that the subjects of shooting in the metaverse space are not limited to the two users 101 and 102, and may be three or more people.

[0015] 104 to 106 in FIG. 1B show avatars in the metaverse space. Avatar 104 is a clone of subject user 101, avatar 105 is a clone of subject user 102, and avatar 106 is a clone of photographer user 103. Hereinafter, when specifying the role of the subject and describing avatar 104, it may be described as "subject avatar 104". Also, when specifying the roles of the subject and the photographer and describing avatars 105 and 106, avatar 105 is described as "subject avatar 105" and avatar 106 is described as "photographer avatar 106".

[0016] Camera object 107 is a 3D CG object of the camera. In shooting in the metaverse space, the position and direction of the lens of camera object 107 are taken as the shooting position and the shooting direction. Camera object 107 is visible from each of users 101 to 103, and is arranged for the purpose of making the subject users 101 and 102 recognize from where the shooting is being done, or improving the immersion and sense of presence of shooting in the metaverse space.

[0017] Standing position markers 108 and 109 (the first markers) are markers for subject users 101 and 102 to confirm their own standing positions at the time of shooting, and are displayed as CG objects on the floor surface of the metaverse space. The positions of standing position markers 108 and 109 are determined by photographer user 103. Subject user 101 can only see his own standing position marker 108. Similarly, subject user 102 can only see his own standing position marker 109. On the other hand, photographer user 103 can see standing position markers 108 and 109. Note that standing position markers 108 and 109 do not appear in the image (hereinafter abbreviated as "shooting image") taken by photographer user 103 in the metaverse space. Also, instead of standing position markers 108 and 109, display objects visible to users 101 to 103 may be used.

[0018] Live Views 110 and 111 (second markers) are live views used by subject users 101 and 102 to check how their subject avatars 104 and 105 appear, and are displayed as flat CG objects in the metaverse space. Live Views 110 and 111 have textures applied to them, which are real-time images taken in the metaverse space from the camera object 107. The positions of Live Views 110 and 111 are determined by the photographer user 103. Subject user 101 can only see their own Live View 110. Similarly, subject user 102 can only see their own Live View 111. On the other hand, photographer user 103 can see Live Views 110 and 111. However, photographer user 103 may switch the display of Live Views 110 and 111 on and off. Live Views 110 and 111 do not appear in the captured image. Alternatively, instead of live views 110 and 111, a display that is visible to users 101-103 may be used.

[0019] Figure 2 is a block diagram showing an example of the hardware configuration of the HMD100. The HMD100 has a main unit 201 and a controller 202. Users 101 to 103 each wear the main unit 201 of the HMD100 on their heads and grasp the controller 202, which is wirelessly or wiredly connected to the main unit 201. First, the main unit 201 will be described. The CPU 211 (computer) is the system control unit and controls the entire HMD100. The CPU 211 realizes information processing according to the first embodiment by executing an information processing program. The ROM 212 is a read-only memory that stores various programs and parameters that do not require modification, such as the basic program and initial data. The RAM 213 is a memory that temporarily stores input information as well as calculation results in information processing and image processing. The sensor 214 is a sensing component such as a gyroscope or IMU that detects the position and orientation of the main unit 201.

[0020] The input / output interface 215 accepts the input and output of required data. Required data includes input information, haptic information, and position and orientation information of the controller 202 connected to the main unit 201. The input / output connection via the input / output interface 215 includes both local connections such as USB and Bluetooth®, and internet connections such as Ethernet® and Wi-Fi®. These points also apply to the input / output interface 222 of the controller 202, which will be described later. The HMD 100 can control the display of the metaverse space on other HMD 100s via its input / output interface 215. In this case, the HMD 100 performs information input and output with other HMD 100s via its input / output interface 215. The HMD 100 may also control the display of the metaverse space on other HMD 100s through an external computer (not shown) connected via its input / output interface 215.

[0021] The recording unit 216 is a device capable of writing and reading data. Specifically, the recording unit 216 is a hard disk or memory card built into or attached to the main unit 201, or a memory card, removable disk, or IC card that can be attached to or removed from the main unit 201. The information processing program executed by the CPU 211 is recorded in the recording unit 216. The information processing program may also be stored in the ROM 212. In addition, the recording unit 216 records the necessary data used when the information processing program is executed by the CPU 211. Furthermore, the captured images are also recorded in the recording unit 216.

[0022] The imaging unit 217 is a camera mounted on the main unit 201. The imaging unit 217 has multiple cameras to enable body tracking of the person wearing the main unit 201. The real-world images captured by the imaging unit 217 are subjected to image recognition and used to track the full-body movements of the person wearing the main unit 201 and to detect planes superimposed on virtual objects such as chairs and tables. Furthermore, the imaging unit 217 has multiple cameras to enable eye tracking of the person wearing the main unit 201. The display unit 218 is an electronic display mounted on the main unit 201. The display unit 218 is configured as a stereo display corresponding to both eyes of the person wearing the main unit 201. The operation unit 219 controls the input to the main unit 201. The operation unit 219 has input components for the main unit 201, such as a power button, menu button, selection button, and confirm button. All hardware components of the main unit 201 are connected to the bus 220, enabling them to communicate with each other.

[0023] Next, the controller 202 will be described. Sensor 221 is a sensing component such as a gyroscope or IMU that detects the position and orientation of the controller 202. Input / Output I / F 222 accepts the required data input and output. Operation unit 223 controls the input to the controller 202. The operation unit 223 has input components for the controller 202 such as a power button, menu button, select button, confirm button, trackpad, and thumbstick. Vibration unit 224 is a vibration device that controls the vibration of the controller 202 based on haptic information transmitted from the main unit 201. In other words, the vibration unit 224 vibrates in conjunction with the input result. All hardware components of the controller 202 can communicate with each other by being connected to the bus 225.

[0024] Furthermore, if the HMD100 is made smaller and lighter, the imaging / display system and processing system of the HMD100 may be separated, with the imaging / display system located in the HMD101, while the processing system is located as an external component in a small external box computer. Additionally, a part of the HMD100's imaging system (the camera for body tracking) may be separated and located independently of the HMD100 and the small external box computer. In these configurations, the small external box computer corresponds to the information processing unit. Note that the external component is not limited to a small external box computer; for example, it may be a portable computer such as a notebook PC, tablet PC, or smartphone, or a stationary computer such as a desktop PC.

[0025] Figure 3 is a block diagram showing an example of the functional configuration of the HMD100. Here, the integrated set of all the functions shown in Figure 3 is referred to as the composition instruction support system 300. The composition instruction support system 300 includes a subject setting means 301 (first target setting means), a standing position setting means 302 (first position setting means), and a marker display means 303 (first display means). The composition instruction support system 300 further includes a gaze setting means 304 (second position setting means), a live view display means 305 (second display means), a photographer pose detection means 306 (first detection means), and a sample pose display means 307 (third display means). The composition instruction support system 300 further includes a marker / live view setting means 308 (second target setting means) and a marker / live view adjustment means 309 (position adjustment means). The composition instruction support system 300 further includes a subject line of sight detection means 310 (second detection means) and a subject line of sight display means 311 (fourth display means).

[0026] The subject setting means 301 is a means for the photographer user 103 to select and set the target to send composition instructions to the composition instruction support system 300 from among the subject users 101 and 102. In the following explanation, the case in which subject user 101 is set by the subject setting means 301 will be used as an example. The standing position setting means 302 is a means for the photographer user 103 to set the expected standing position in the metaverse space for the avatar 104 of subject user 101, which has been set by the subject setting means 301, to the composition instruction support system 300. The marker display means 303 is a means for displaying a standing position marker 108 at the standing position in the metaverse space set by the standing position setting means 302.

[0027] The gaze setting means 304 is a means for the photographer user 103 to set the expected gaze position in the metaverse space for the avatar 104 of the subject user 101, which has been set by the subject setting means 301, to the composition instruction support system 300. The live view display means 305 is a means for displaying the live view 110 at the gaze position in the metaverse space set by the gaze setting means 304. The above describes the case when the subject user 101 has been set by the subject setting means 301, but the same method is used when the subject user 102 has been set by the subject setting means 301 to display the standing position marker 109 and the live view 111.

[0028] The photographer pose detection means 306 is a means for detecting and setting the full-body posture (hereinafter referred to as "pose") of the photographer user 103 for the composition instruction support system 300. The specific detection method is performed using body tracking with multiple cameras mounted on the main body 201 of the HMD 100, but it may also be performed using body tracking with dedicated devices attached to the limbs of the photographer user 103. The sample pose display means 307 is a means for generating a 3DCG pose object based on the pose of the photographer user 103 set by the photographer pose detection means 306 and displaying it in the metaverse space.

[0029] The marker / live view setting means 308 is a means for the photographer user 103 to set, for the composition instruction support system 300, which of the standing position markers 108, 109 and live views 110, 111 will be adjusted. Hereinafter, the object to be adjusted will be abbreviated as "position adjustment target". The marker / live view adjustment means 309 is a means for adjusting the position of the position adjustment target set by the marker / live view setting means 308 up, down, left, and right. Furthermore, the marker / live view adjustment means 309 is a means for setting the adjusted position of the position adjustment target to the composition instruction support system 300.

[0030] The subject gaze detection means 310 is a means for detecting the gaze of the subject avatars 104 and 105. Furthermore, the subject gaze detection means 310 is a means for setting the detected gazes of the subject avatars 104 and 105 in the composition instruction support system 300. The subject gaze display means 311 is a means for displaying the gazes of the subject avatars 104 and 105 detected by the subject gaze detection means 310 in the metaverse space as 3DCG objects so that the photographer user 103 can see them.

[0031] Next, we will explain the case where the photographer user 103 gives composition instructions to the subject users 101 and 102 during shooting in the metaverse space. Figure 4 is a flowchart showing the flow when the photographer user 103 gives composition instructions to the subject users 101 and 102 during shooting in the metaverse space. The flowchart in Figure 4 (control method of the information processing device) is realized when the CPU 211 in the photographer user 103's HMD 100 reads the information processing program (program) recorded in the recording unit 216, expands it in the RAM 213, and executes it. This is also true for the flowcharts (control methods of the information processing device) in Figures 11 and 14 described later. Note that the flowchart in Figure 4 is started when the photographer user 103 selects to give composition instructions to the subject users 101 and 102 through GUI operation or other means.

[0032] In step S401, the CPU 211 sets the composition instruction support system 300 with the subject setting means 301, which selects the subject user 103 from among the subject users 101 and 102 as the target for composition instruction (first target setting step). Figure 5 shows the GUI used by the photographer user 103 when selecting the subject user 101 and 102 as the target for composition instruction. The GUI shown in Figure 5 is displayed on the display unit 218 of the main unit 201 on the photographer user 103's HMD 100. The GUI shown in Figure 5 displays an icon 501 representing subject user 101 (user A) and an icon 502 representing subject user 102 (user B).

[0033] The photographer user 103 selects either subject user 101 or subject user 102 by specifying either icon 501 or 502 using GUI operations via controller 202. In Figure 5, a focus frame is displayed on icon 501, which represents subject user 101 (user A), so photographer user 103 has selected icon 501 and subject user 101 has been selected. In this state, when photographer user 103 presses the OK button on controller 202, subject user 101 is set as the target of composition instructions. Note that photographer user 103 can move the focus frame to icon 502, which represents subject user 102 (user B), by performing operations such as tilting the thumbstick on controller 202.

[0034] Let's return to the explanation of Figure 4. Below, we will explain using the example of the case in step S401 where the subject setting means 301 sets the subject user 101 as the target of composition instructions to the composition instruction support system 300. The explanation is the same when subject user 102 is set. In step S402, the CPU 211 sets the standing position setting means 302 to the composition instruction support system 300 the standing position in the metaverse space that the photographer user 103 expects for the avatar 104 of the subject user 101, who is the target of composition instructions. In other words, step S402 corresponds to the first position setting step. Figure 6 is a diagram showing the standing position 601 (hereinafter abbreviated as "standing position 601") in the metaverse space that the photographer user 103 expects for the avatar 104 of the subject user 101, who is the target of composition instructions, from the viewpoint of the photographer user 103.

[0035] The standing position setting means 302 displays a floor object 602 that clearly indicates the floor surface along the floor surface of the metaverse space. The standing position setting means 302 also identifies the intersection point between the ray object 603, which is projected from the camera user 103's controller 202, and the floor object 602. Furthermore, the standing position setting means 302 sets the identified intersection point as the standing position 601 in the composition instruction support system 300. In this way, the camera user 103 can determine the standing position 601 by identifying one location in the metaverse space. The projection direction of the ray object 603 is determined based on the position and orientation information of the camera user 103's controller 202. The floor object 602 and the ray object 603 are visible only to the camera user 103 and do not appear in the captured image.

[0036] Returning to the explanation of Figure 4, in step S403, the CPU 211 displays the standing position marker 108 at the standing position 601 set in step S402 using the marker display means 303 (first display step). Specifically, as shown in Figure 6, the standing position marker 108 is displayed in the metaverse space. At this time, as described above, the standing position marker 108 is visible only to the subject user 101 and the photographer user 103. The marker display means 303 may also display the username of the subject user 101, who is the target of the composition instruction, near the standing position marker 108 in the photographer user 103's field of view, so as not to appear in the captured image. This allows the photographer user 103 to easily recognize that the standing position marker 108 was displayed in response to a composition instruction for the subject user 101. The marker display means 303 may also move the standing position marker 108 in conjunction with changes in the illumination direction of the ray object 603.

[0037] Returning to the explanation of Figure 4, in step S404, the CPU 211 uses the gaze setting means 304 to set the gaze position in the metaverse space that the photographer user 103 expects for the avatar 104 of the subject user 101, who is the target of the composition instruction, in the composition instruction support system 300. In other words, step S404 corresponds to the second position setting step. Figure 7 is a diagram showing the gaze position 701 (hereinafter abbreviated as "gaze position 701") in the metaverse space that the photographer user 103 expects for the avatar 104 of the subject user 101, who is the target of the composition instruction, from the viewpoint of the photographer user 103.

[0038] The line-of-sight setting means 304 displays the hemispherical object 702 centered on the standing position 601 set in step S402. The line-of-sight setting means 304 also identifies the intersection point between the ray object 603, which is projected from the camera user 103's controller 202, and the hemispherical object 702. Furthermore, the line-of-sight setting means 304 sets the identified intersection point as the line-of-sight position 701 in the composition instruction support system 300. In this way, the camera user 103 can determine the line-of-sight position 701 by identifying one location in the metaverse space.

[0039] However, the intersection points between the spherical surface of the hemispherical object 702 and the straight line of the ray object 603 usually occur in two locations: one on the near side (white X mark) and one on the far side (black X mark). In this regard, the photographer user 103 can select the intersection point between the hemispherical object 702 and the ray object 603 by operating buttons on the controller 202. Note that the hemispherical object 702 and the ray object 603 are only visible to the photographer user 103 and do not appear in the captured image.

[0040] Returning to the explanation of Figure 4, in step S405, the CPU 211 displays the live view 110 at the eye-line position 701 set in step S404 using the live view display means 305 (second display step). Specifically, as shown in Figure 7, the live view 110 is displayed in the metaverse space. At this time, as described above, the live view 110 is visible only to the subject user 101 and the photographer user 103. This allows the subject user 101 to adjust their pose while looking at the live view 110. The live view display means 305 also positions the live view 110 so as to be perpendicular to the line of sight, taking into account the eye height of the subject avatar 104 when standing at the standing position 601 set in step S402. This ensures that the live view 110 is easy to see.

[0041] Furthermore, the live view display means 305 may display the username of the subject user 101, who is the target of the composition instructions, near the live view 110, in the field of view of the photographer user 103, so as not to appear in the captured image. This allows the photographer user 103 to easily recognize that the live view 110 is displayed in response to composition instructions for the subject user 101. In addition, the live view display means 305 may move the live view 110 in conjunction with changes in the illumination direction of the ray object 603.

[0042] Returning to the explanation of Figure 4, in step S406, the CPU 211 detects the pose of the photographer user 103 using the photographer pose detection means 306 and sets it in the composition instruction support system 300 (first detection step). In this regard, the photographer pose detection means 306 continuously performs body tracking to detect the pose of the photographer user 103, regardless of the processing in step S406. Therefore, in step S406, the photographer pose detection means 306 determines the current pose of the photographer user 103, which has been detected by body tracking, according to GUI operations by the photographer user 103, and sets it in the composition instruction support system 300.

[0043] In step S407, the CPU 211 generates a 3DCG pose object, which serves as a sample pose for the subject avatar 104, based on the pose set in step S406, using the sample pose display means 307. Furthermore, the sample pose display means 307 places and displays the generated pose object at the standing position 601 set in step S402 (third display step). After that, the flowchart in Figure 4 ends.

[0044] Figure 8 shows the pose object 801 from a third-person perspective. In Figure 8, the photographer avatar 106, which reflects the current pose of the photographer user 103, is in a pose with its right hand raised, and this pose is set in the composition instruction support system 300. Therefore, the sample pose display means 307 generates a subject avatar 104 in the same pose as the photographer avatar 106, as the pose object 801, separately from the original subject avatar 104. Furthermore, the sample pose display means 307 displays the generated pose object 801 at the standing position 601. By displaying the pose object 801 in this way, the pose that the photographer user 103 expects the subject avatar 104 to strike is shown to the subject user 101.

[0045] In this case, the pose object 801 is visible only to the subject user 101 and the photographer user 103, and does not appear in the captured image. The sample pose display means 307 adjusts the orientation of the pose object 801 so that the direction of the pose object 801's gaze matches the direction of the live view 110 at the gaze position 701 as closely as possible. For example, the sample pose display means 307 adjusts the position of the pupils of the pose object 801 so that the gaze of the pose object 801 is perpendicular to the live view 110 at the gaze position 701 set in step S404. Through the display of the pose object 801 in this way, the pose that the photographer user 103 expects from the subject avatar 104 is shown to the subject user 101 in accordance with the composition assumed by the photographer user 103. However, the position and orientation of the pose object 801 when it is displayed may be any position and orientation unrelated to the standing position 601 and the gaze position 701.

[0046] Figure 9 shows the field of view of the subject user 101 when composition instructions are given. In the subject user 101's field of view, the photographer avatar 106 and camera object 107 are located to the left, and the subject avatar 105 is located to the right and slightly behind the camera object 107. Also, a standing position marker 108 is located on the floor to the right and slightly in front of the subject avatar 105, and a pose object 801 facing the direction of the live view 110 is located on the standing position marker 108.

[0047] Figure 10 shows the field of view of the subject user 101 when the subject avatar 104 moves to the standing position 601 and faces the live view 110. In the subject user 101's field of view, the live view 110 is located approximately in the center. The live view 110 displays the pose object 801 superimposed on the real-time image captured from the camera object 107, i.e., in the metaverse space. This allows the subject user 101 to adjust their pose while viewing the pose object 801 in the live view 110.

[0048] Based on the above, the HMD 100 of the first embodiment can reliably convey the photographer user 103's compositional instructions regarding the standing position 601, gaze position 701, and pose during shooting in the metaverse space to the subject users 101 and 102.

[0049] <Second Embodiment> The second embodiment will be described below with reference to Figures 11 to 13. In the second embodiment, a method for adjusting (including fine-tuning) the positions of the standing position markers 108 and 109 and the live views 110 and 111 after the first embodiment has been performed will be described. Therefore, the differences from the first embodiment will be described in the second embodiment. In the second embodiment, components identical to those in the first embodiment will be given the same reference numerals, and their descriptions will be omitted. Figure 11 is a flowchart showing the flow when the positions of the standing position markers 108 and 109 and the live views 110 and 111 are adjusted. The flowchart in Figure 11 is started when the photographer user 103 selects to adjust the positions of the standing position markers 108 and 109 and the live views 110 and 111 using a GUI or other means.

[0050] In step S1101, the CPU 211 performs the following processing using the marker / live view setting means 308. The marker / live view setting means 308 sets the position adjustment target selected by the photographer user 103 from the standing position markers 108 and 109 displayed in step S403 to the composition instruction support system 300. In addition, the marker / live view setting means 308 sets the position adjustment target selected by the photographer user 103 from the live views 110 and 111 displayed in step S405 to the composition instruction support system 300.

[0051] Figure 12 shows the metaverse space from the perspective of the photographer user 103 when the photographer user 103 selects a position adjustment target from among the position markers 108 and 109 and the live views 110 and 111. The photographer user 103 tilts the thumbstick 1201 of the controller 202 up, down, left, or right. Each time the thumbstick 1201 is tilted, the focus frame 1202 shifts to the position marker 108 and 109 and the live views 110 and 111 that are closest to the focus frame 1202 in the direction the thumbstick 1201 was tilted. At this time, the focus frame 1202 is visible only to the photographer user 103 and does not appear in the captured image.

[0052] In Figure 12, the focus frame 1202 is positioned to surround the live view 111, but if, for example, the thumbstick 1201 is tilted to the right, it moves to a position surrounding the live view 110. Furthermore, if, for example, the thumbstick 1201 is tilted downwards, the focus frame 1202 moves to a position surrounding the standing position marker 108. Furthermore, if, for example, the thumbstick 1201 is tilted to the left, the focus frame 1202 moves to a position surrounding the standing position marker 109. Furthermore, if, for example, the thumbstick 1201 is tilted to the left, the focus frame 1202 moves to a position surrounding the live view 111.

[0053] In this way, the photographer user 103 selects either the standing position markers 108, 109 or the live views 110, 111 by enclosing them with the focus frame 1202, which can be accessed using the thumbstick 1201 of the controller 202. Furthermore, when the photographer user 103 presses the OK button on the controller 202, the one of the standing position markers 108, 109 or the live views 110, 111 that is enclosed by the focus frame 1202 is set as the target for position adjustment.

[0054] Returning to the explanation of Figure 11, in step S1102, the CPU 211 adjusts the position of the position adjustment target set in step S1101 up, down, left, and right using the marker / live view adjustment means 309. After that, the flowchart in Figure 11 ends. Figure 13 is a diagram illustrating the adjustment of the position of the live view 110, which is set as the position adjustment target. For example, each time the photographer user 103 tilts the thumbstick 1201 of the controller 202 upwards, the position of the live view 110 moves upwards relative to the horizontal plane of the live view 110. This is also true when the thumbstick 1201 of the controller 202 is tilted down, left, or right. In this way, the photographer user 103 can adjust the position of the live view 110.

[0055] Subsequently, when the photographer user 103 presses the OK button on the controller 202, the marker / live view adjustment means 309 sets the current position of the live view 110 to the composition instruction support system 300. In this way, the live view 110, whose position has been adjusted, is always displayed in its latest position by the live view display means 305. Also, in the field of view of the photographer user 103 and the subject user 101, the live view 110 appears to move slightly up, down, left, or right in response to the photographer user 103's operation of the thumbstick 1201 on the controller 202. This is also the case when the live view 111, standing position marker 108, or standing position marker 109 is set as the target for position adjustment.

[0056] Furthermore, adjusting the positions of the standing position markers 108 and 109 and adjusting the positions of the live views 110 and 111 may be selected separately by the photographer user 103 via GUI operation or other means. In this case, if adjusting the positions of the standing position markers 108 and 109 is selected, the focus frame 1202 will move to a position surrounding either the standing position marker 108 or the standing position marker 109. Similarly, if adjusting the positions of the live views 110 and 111 is selected, the focus frame 1202 will move to a position surrounding either the live view 110 or the live view 111.

[0057] Based on the above, the HMD 100 of the second embodiment can communicate to the subject users 101 and 102 the composition instructions of the photographer user 103 regarding the standing position 601 and line of sight position 701 when shooting in the metaverse space, while correcting them.

[0058] <Third Embodiment> The third embodiment will be described below with reference to Figures 14 and 15. In the third embodiment, a method for displaying the gaze of the subject avatars 104 and 105 will be described. In the third embodiment, the differences from the second embodiment will be described. In the third embodiment, components identical to those in the second embodiment will be given the same reference numerals, and their descriptions will be omitted.

[0059] Figure 14 is a flowchart showing the process when the gazes of subject avatars 104 and 105 are displayed. The flowchart in Figure 14 is triggered when the photographer user 103 selects to display the gazes of subject avatars 104 and 105 through GUI operations or other means. Note that the flowchart in Figure 14 is performed for all subjects being photographed in the metaverse space, i.e., subject avatars 104 and 105. Therefore, as shown in Figure 3, in the composition instruction support system 300, the subject gaze detection means 310 and the subject gaze display means 311, which are related to the method of displaying the gazes of subject avatars 104 and 105, have no direct connection to any other means.

[0060] In step S1401, the CPU 211 detects the gaze of the subject avatars 104 and 105 using the subject gaze detection means 310. Furthermore, the subject gaze detection means 310 sets the detected gazes of the subject avatars 104 and 105 in the composition instruction support system 300. Note that since the gazes of the subject avatars 104 and 105 reflect the gazes of the subject users 101 and 102, the subject gaze detection means 310 may also detect the gazes of the subject avatars 104 and 105 from the eye-tracking results of the subject users 101 and 102. In step S1402, the CPU 211 displays the gazes of the subject avatars 104 and 105 set in step S1401 in the metaverse space using the subject gaze display means 311. After that, the flowchart in Figure 14 ends. Note that the display of the gazes of the subject avatars 104 and 105 continues until the photographer user 103 selects to end the display through GUI operation or other means.

[0061] Figure 15 is a diagram showing the metaverse space where the gazes of the subject avatars 104 and 105 are displayed, from the perspective of the photographer user 103. The subject gaze display means 311 displays 3DCG ray-shaped gaze objects 1501 and 1502, which indicate the gazes of the subject avatars 104 and 105, so that they emanate from the eyes of the subject avatars 104 and 105. In this case, the gaze objects 1501 and 1502 are visible only to the photographer user 103 and do not appear in the captured image.

[0062] Based on the above, the HMD 100 of the third embodiment displays the gaze of the subject avatars 104 and 105. This allows the photographer user 103 to accurately grasp the gaze of the subject avatars 104 and 105, thereby improving, for example, the accuracy of adjusting the position of the live views 110 and 111.

[0063] <Other> While preferred embodiments of the present invention have been described above, the present invention is not limited to the embodiments described above, and various modifications and changes are possible within the scope of its gist. For example, the CPU 211 (automatic shooting means) of the HMD 100 may automatically perform shooting in the metaverse space when the similarity between the pose object 801 and the subject avatar 104 exceeds a threshold. This allows the HMD 100 to perform shooting in the metaverse space at a timing that matches the expectations of the photographer user 103 when the pose of the subject avatar 104 matches. The same applies to the subject avatar 105. Alternatively, shooting in the metaverse space may be automatically performed when the similarity between the subject avatar 104 and the subject avatar 105 both exceed a threshold.

[0064] Furthermore, each embodiment described the case where the present invention is applied to shooting in the metaverse space of VR. However, the present invention can also be applied to shooting in the metaverse space of Augmented Reality (AR) and Mixed Reality (MR). In this case, the camera of the photographer user 103 is not a virtual camera such as the camera object 107, but a camera built into or attached to the HMD 100. Therefore, a composite image in which the CG of the metaverse space is superimposed on the live image transmitted from these cameras is displayed in the live view 110, 111. Also, in AR and MR, the positional relationships of the real space are directly reflected in the metaverse space, so the subject of shooting in the metaverse space is the subject users 101, 102 themselves, not the subject avatars 104, 105. Accordingly, the metaverse space of AR and MR is a space in which a virtual space is superimposed on the real space. Furthermore, for AR and MR, the HMD100 uses a video see-through or optical see-through method (including smart glasses) instead of a fully immersive method.

[0065] The present invention can also be realized by supplying a program that implements one or more of the functions of each of the embodiments described above to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. Furthermore, the present invention can also be realized by a dedicated processor (for example, an ASIC, FPGA, or other circuit) that implements one or more functions. Moreover, the present invention can also be realized by a combination of a general-purpose processor and a dedicated processor. Note that "processor" refers to a processor in a broad sense and includes general-purpose processors and dedicated processors. Furthermore, the operation of the processor may not only be performed by a single processor, but may also be performed by multiple processors located in physically separate locations working together.

[0066] Each embodiment of the disclosure includes the following configurations, methods, and programs. (Configuration 1) A first target setting means for the photographer to set the target of composition instructions from among one or more subject users in a photograph in the metaverse space, A first position setting means for the photographer to set the standing position in the metaverse space relative to the subject user set by the first target setting means, An information processing apparatus comprising: a first display means that displays a first marker at the standing position in the metaverse space, which can be viewed on the respective display units of the photographer user and the subject user set by the first target setting means, in such a way that it does not appear in the photograph taken in the metaverse space. (Configuration 2) A second position setting means for the photographer to set the line of sight position in the metaverse space for the subject user set by the first target setting means, The information processing apparatus according to configuration 1, further comprising: a second display means for displaying a second marker at the line of sight position in the metaverse space, which can be viewed on the respective display units of the photographer user and the subject user set by the first target setting means, in such a way that it is not captured in the photograph taken in the metaverse space. (Configuration 3) A second target setting means for the photographer user to set the target for position adjustment from among the first and second markers, The information processing apparatus according to configuration 2, further comprising: position adjustment means for adjusting the position of the first marker or the second marker set by the second marker set by the second marker set by the second marker set by the first (Configuration 4) The information processing device according to Configuration 2 or 3, characterized in that the second position setting means identifies the line of sight position at the intersection of a hemispherical object centered on the standing position and a ray object that can be operated by the photographer user. (Configuration 5) The information processing device according to any one of Configurations 2 to 4, characterized in that the second display means displays the live view of the shooting in the metaverse space as a second marker, such that it is perpendicular to the line of sight of the subject user avatar set by the first target setting means when the subject user is standing at the position. (Configuration 6) The information processing device according to any one of Configurations 1 to 5, characterized in that the first position setting means identifies the standing position at the intersection of a floor object representing the floor surface of the metaverse space and a ray object that can be operated by the photographer user. (Configuration 7) The information processing apparatus according to any one of Configurations 1 to 6, characterized in that the first display means displays the username of the subject user set by the first target setting means near the first marker in such a way that it is not captured in the photograph in the metaverse space. (Configuration 8) A second position setting means for the photographer to set the line of sight position in the metaverse space for the subject user set by the first target setting means, A second display means that displays a second marker at the line of sight position in the metaverse space, which can be viewed on the respective display units of the photographer user and the subject user set by the first target setting means, in such a way that it does not appear in the photograph taken in the metaverse space. A first detection means for detecting the pose of the photographer user, The information processing apparatus according to Configuration 1, further comprising: a third display means that displays a posed object detected by the first detection means in the metaverse space, which can be viewed on the respective display units of the photographer user and the subject user set by the first target setting means, in such a way that it does not appear in the photograph taken in the metaverse space. (Configuration 9) A first target setting means for the photographer to set the target of composition instructions from among one or more subject users in the shooting in the metaverse space, A second position setting means for the photographer to set the line of sight position in the metaverse space for the subject user set by the first target setting means, An information processing device comprising: a second display means that displays a second marker at a line of sight set by the second position setting means in the metaverse space, which can be viewed by the photographer user and the subject user set by the first target setting means on their respective display units, such that the second marker is not captured in the photograph taken in the metaverse space. (Configuration 10) The information processing device according to Configuration 9, characterized in that the second display means displays the live view of the shooting in the metaverse space as the second marker. (Configuration 11) The information processing apparatus according to Configuration 9 or 10, characterized in that the second display means displays the username of the subject user set by the first target setting means near the second marker in such a way that it is not captured in the photograph in the metaverse space. (Configuration 12) A first target setting means for the photographer to set the target of composition instructions from among one or more subject users in a photograph in the metaverse space, A first detection means for detecting the pose of the photographer user, An information processing apparatus comprising: a third display means that displays a posed object detected by the first detection means in the metaverse space, which can be viewed on the respective display units of the photographer user and the subject user set by the first target setting means, in such a way that it does not appear in the photograph taken in the metaverse space. (Configuration 13) A first position setting means for the photographer to set the standing position in the metaverse space relative to the subject user set by the first target setting means, The information processing apparatus according to configuration 12, comprising: a first display means that displays a first marker at the standing position in the metaverse space, which can be viewed on the respective display units of the photographer user and the subject user set by the first target setting means, in such a way that it does not appear in the photograph taken in the metaverse space. (Configuration 14) The information processing apparatus according to Configuration 13, wherein the third display means displays the pose object at the standing position. (Configuration 15) A second position setting means for the photographer to set the line of sight position in the metaverse space for the subject user set by the first target setting means, The information processing device according to configuration 12, further comprising: a second display means that displays a second marker at the line of sight position set by the second position setting means in the metaverse space, which can be viewed by the photographer user and the subject user set by the first target setting means on their respective display units, such that the second marker is not captured in the photograph taken in the metaverse space. (Configuration 16) The information processing device according to Configuration 15, wherein the third display means aligns the orientation of the pose object with the line of sight. (Configuration 17) The information processing device according to Configuration 15 or 16, characterized in that the second display means displays an image of the pose object superimposed on the live view of the shooting in the metaverse space as a second marker. (Configuration 18) An information processing device according to any one of Configurations 12 to 17, characterized in that it includes an automatic shooting means that performs shooting in the metaverse space when the similarity between the avatar of the subject user set by the first target setting means and the pose object becomes equal to or greater than a threshold. (Configuration 19) A second detection means for detecting the gaze of the subject user's avatar in the metaverse space, An information processing device according to any one of configurations 1 to 18, comprising: a fourth display means that displays a line-of-sight object indicating the line of sight detected by the second detection means in the metaverse space that can be viewed on the display unit by the photographer user, in such a way that it does not appear in the photograph taken in the metaverse space. (Configuration 20) An information processing device according to any one of Configurations 1 to 19, characterized in that the metaverse space is based on virtual reality, augmented reality, or mixed reality. (Configuration 21) The information processing device according to any one of Configurations 1 to 20, characterized in that the information processing device is a head-mounted display equipped with the display unit. (Method 1) A first target setting step in which the photographer user sets the target for composition instructions from among one or more subject users in the shooting in the metaverse space, A first position setting step in which the photographer user sets the standing position in the metaverse space relative to the subject user set in the first target setting step, A control method for an information processing device, comprising: a first display step of displaying a first marker at the standing position in the metaverse space, which can be viewed on the respective display units of the photographer user and the subject user set in the first target setting step, in such a way that it does not appear in the photograph taken in the metaverse space. (Method 2) A first target setting step in which the photographer user sets the target for composition instructions from among one or more subject users in the shooting in the metaverse space, A second position setting step in which the photographer user sets the line of sight position in the metaverse space for the subject user set in the first target setting step, A control method for an information processing device, comprising: a second display step, in the metaverse space that can be viewed on the respective display units of the photographer user and the subject user set in the first target setting step, a second marker is displayed at the line of sight set in the second position setting step in such a way that it does not appear in the photograph taken in the metaverse space. (Method 3) A first target setting step in which the photographer user sets the target for composition instructions from among one or more subject users in the shooting in the metaverse space, A first detection step for detecting the pose of the photographer user, A control method for an information processing device, comprising: a third display step, in the metaverse space that can be viewed on the respective display units of the photographer user and the subject user set in the first target setting step, the posed object detected in the first detection step is displayed in such a way that it does not appear in the photograph taken in the metaverse space. (Program 1) A program that causes a computer to execute each of the means of the information processing device described in any one of Configurations 1 to 21. [Explanation of Symbols]

[0067] 100 HMDs (Human-Mounted Displays) 101, 102 Subject users 103 Photographer User 108, 109 Standing position marker (first landmark) 218 Display section 301 Subject setting means (first target setting means) 302 Standing position setting means (first position setting means) 303 Marker display means (first display means) 601 Standing position

Claims

1. A first target setting means for the photographer to select the subject to be instructed on the composition from among one or more subject users in a photograph taken in the metaverse space, A first position setting means for the photographer to set the standing position in the metaverse space relative to the subject user set by the first target setting means, An information processing apparatus comprising: a first display means that displays a first marker at the standing position in the metaverse space, which can be viewed on the respective display units of the photographer user and the subject user set by the first target setting means, in such a way that it does not appear in the photograph taken in the metaverse space.

2. A second position setting means for the photographer to set the line of sight position in the metaverse space for the subject user set by the first target setting means, The information processing apparatus according to claim 1, further comprising: a second display means for displaying a second marker at the line of sight position in the metaverse space, which can be viewed on the respective display units of the photographer user and the subject user set by the first target setting means, in such a way that it is not captured in the photograph taken in the metaverse space.

3. A second target setting means for the photographer user to set the target for position adjustment from among the first and second markers, The information processing apparatus according to claim 2, further comprising a position adjustment means for adjusting the position of the first marker or the second marker set by the second marker set by the second marker set by the second marker set by the first

4. The information processing device according to claim 2, characterized in that the second position setting means identifies the line of sight position at the intersection of a hemispherical object centered on the standing position and a ray-like object that can be operated by the photographer user.

5. The information processing apparatus according to claim 2, characterized in that the second display means displays the live view of the shooting in the metaverse space as a second marker, such that it is perpendicular to the line of sight of the subject user avatar set by the first target setting means when the subject user is standing at the position.

6. The information processing device according to claim 1, characterized in that the first position setting means identifies the standing position at the intersection of a floor object representing the floor surface of the metaverse space and a ray object that can be operated by the photographer user.

7. The information processing apparatus according to claim 1, characterized in that the first display means displays the username of the subject user set by the first target setting means near the first marker in such a way that it is not captured in the photograph in the metaverse space.

8. A second position setting means for the photographer to set the line of sight position in the metaverse space for the subject user set by the first target setting means, A second display means that displays a second marker at the line of sight position in the metaverse space, which can be viewed by the photographer user and the subject user set by the first target setting means, in such a way that it does not appear in the photograph taken in the metaverse space, A first detection means for detecting the pose of the photographer user, The information processing apparatus according to claim 1, further comprising: a third display means for displaying a posed object detected by the first detection means in the metaverse space, which can be viewed by the photographer user and the subject user set by the first target setting means, in such a way that it is not captured in the photograph taken in the metaverse space.

9. A second detection means for detecting the gaze of the subject user's avatar in the metaverse space, The information processing apparatus according to claim 1, further comprising: a fourth display means for displaying a line-of-sight object indicating the line of sight detected by the second detection means in the metaverse space that can be viewed on the display unit by the photographer user, in such a way that it is not captured in the photograph taken in the metaverse space.

10. The information processing device according to claim 1, characterized in that the metaverse space is based on virtual reality, augmented reality, or mixed reality.

11. The information processing apparatus according to claim 1, characterized in that the information processing apparatus is a head-mounted display equipped with the display unit.

12. A first target setting means for the photographer to select the subject to be instructed on the composition from among one or more subject users in a photograph taken in the metaverse space, A second position setting means for the photographer to set the line of sight position in the metaverse space for the subject user set by the first target setting means, An information processing device comprising: a second display means that displays a second marker at a line of sight set by the second position setting means in the metaverse space, which can be viewed by the photographer user and the subject user set by the first target setting means on their respective display units, such that the second marker is not captured in the photograph taken in the metaverse space.

13. The information processing apparatus according to claim 12, characterized in that the second display means displays a live view of the shooting in the metaverse space as a second marker.

14. The information processing apparatus according to claim 12, characterized in that the second display means displays the username of the subject user set by the first target setting means near the second marker in such a way that it is not captured in the photograph in the metaverse space.

15. A second detection means for detecting the gaze of the subject user's avatar in the metaverse space, The information processing apparatus according to claim 12, further comprising: a fourth display means for displaying a line-of-sight object indicating the line of sight detected by the second detection means in the metaverse space that can be viewed on the display unit by the photographer user, in such a way that it is not captured in the photograph taken in the metaverse space.

16. The information processing device according to claim 12, characterized in that the metaverse space is based on virtual reality, augmented reality, or mixed reality.

17. The information processing apparatus according to claim 12, characterized in that the information processing apparatus is a head-mounted display equipped with the display unit.

18. A first target setting means for the photographer to select the subject to be instructed on the composition from among one or more subject users in a photograph taken in the metaverse space, A first detection means for detecting the pose of the photographer user, An information processing apparatus comprising: a third display means that displays a posed object detected by the first detection means in the metaverse space, which can be viewed on the respective display units of the photographer user and the subject user set by the first target setting means, in such a way that it does not appear in the photograph taken in the metaverse space.

19. A first position setting means for the photographer to set the standing position in the metaverse space relative to the subject user set by the first target setting means, The information processing apparatus according to claim 18, further comprising: a first display means for displaying a first marker at the standing position in the metaverse space, which can be viewed on the respective display units of the photographer user and the subject user set by the first target setting means, in such a way that it is not captured in the photograph taken in the metaverse space.

20. The information processing apparatus according to claim 19, characterized in that the third display means displays the pose object at the standing position.

21. A second position setting means for the photographer to set the line of sight position in the metaverse space for the subject user set by the first target setting means, The information processing apparatus according to claim 18, further comprising: a second display means for displaying a second marker at a line of sight position set by the second position setting means in the metaverse space, which can be viewed by the photographer user and the subject user set by the first target setting means on their respective display units, such that the second marker is not captured in the photograph taken in the metaverse space.

22. The information processing device according to claim 21, characterized in that the third display means aligns the orientation of the pose object with the line of sight.

23. The information processing apparatus according to claim 21, characterized in that the second display means displays an image of the pose object superimposed on the live view of the shooting in the metaverse space as a second marker.

24. The information processing apparatus according to claim 18, further comprising an automatic shooting means that performs shooting in the metaverse space when the similarity between the avatar of the subject user set by the first target setting means and the pose object exceeds a threshold.

25. A second detection means for detecting the gaze of the subject user's avatar in the metaverse space, The information processing apparatus according to claim 18, further comprising: a fourth display means for displaying a line-of-sight object indicating the line of sight detected by the second detection means in the metaverse space that can be viewed on the display unit by the photographer user, in such a way that it is not captured in the photograph taken in the metaverse space.

26. The information processing device according to claim 18, characterized in that the metaverse space is based on virtual reality, augmented reality, or mixed reality.

27. The information processing apparatus according to claim 18, characterized in that the information processing apparatus is a head-mounted display equipped with the display unit.

28. A first target setting step in which the photographer user selects the subject to be instructed on the composition from among one or more subject users in the shooting in the metaverse space, A first position setting step in which the photographer user sets the standing position in the metaverse space relative to the subject user set in the first target setting step, A control method for an information processing device, comprising: a first display step of displaying a first marker at the standing position in the metaverse space, which can be viewed on the respective display units of the photographer user and the subject user set in the first target setting step, in such a way that it does not appear in the photograph taken in the metaverse space.

29. A first target setting step in which the photographer user selects the subject to be instructed on the composition from among one or more subject users in the shooting in the metaverse space, A second position setting step in which the photographer user sets the line of sight position in the metaverse space for the subject user set in the first target setting step, A control method for an information processing device, comprising: a second display step, in the metaverse space that can be viewed on the respective display units of the photographer user and the subject user set in the first target setting step, a second marker is displayed at the line of sight set in the second position setting step in such a way that it is not captured in the photograph taken in the metaverse space.

30. A first target setting step in which the photographer user selects the subject to be instructed on the composition from among one or more subject users in the shooting in the metaverse space, A first detection step for detecting the pose of the photographer user, A control method for an information processing device, comprising: a third display step, in the metaverse space that can be viewed on the respective display units of the photographer user and the subject user set in the first target setting step, the posed object detected in the first detection step is displayed in such a way that it does not appear in the photograph taken in the metaverse space.

31. A program for causing a computer to execute each means of the information processing apparatus described in any one of claims 1 to 27.

Images