Information processing apparatus, method for controlling information processing apparatus, and program

Abstract

To provide an information processing apparatus, a method for controlling an information processing apparatus, and a program that can improve the operability of a virtual menu.SOLUTION: A HMD 100 comprises a CPU 101 that stores information on the type of a UI in use as operation information, determines if a display operation of a virtual menu is executed, and when determining that the display operation of the virtual menu is executed, determines, on the basis of the operation information, a drawing mode in a virtual space of the virtual menu as a drawing mode suitable for the type of the UI in use.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an information processing apparatus, a control method for an information processing apparatus, and a program.

Background Art

[0002] In conventional XR (Cross Reality), a virtual object (hereinafter referred to as "virtual menu") of a menu drawn in a virtual space can be operated by a user for applications such as games and simulations. XR is a general term for VR (Virtual Reality), AR (Augmented Reality), MR (Mixed Reality), and the like. When operating a virtual menu in XR, the user uses various UIs (User Interfaces) such as hand gestures, rays, gaze input, or a controller. At this time, the virtual menu is displayed in a uniform shape at a uniform position on the display unit regardless of the type of UI being used by the user. Therefore, the user's previous work may be interrupted or the operability may be impaired. In this regard, for example, Patent Document 1 discloses a technique for selecting and targeting a virtual object using information of a plurality of UIs.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, the technique disclosed in Patent Document 1 cannot exert an effect when newly displaying a virtual object. Therefore, even when the technique disclosed in Patent Document 1 is applied to the display of a virtual menu, there is a problem that the virtual menu is displayed in a uniform shape at a uniform position on the display unit as in the prior art.

[0005] The present invention has been made in view of the above problems. An object of the present invention is to provide an information processing apparatus, a control method for the information processing apparatus, and a program that can improve the operability of a virtual menu.

Means for Solving the Problems

[0006] In order to achieve the above object, an information processing apparatus according to the present invention includes storage means for storing information on the type of UI in use as operation information, determination means for determining whether a display operation of a virtual menu has been executed, and when the determination means determines that a display operation of a virtual menu has been executed, determination means for determining a drawing mode in the virtual space of the virtual menu based on the operation information to a drawing mode suitable for the type of UI in use.

Effects of the Invention

[0007] According to the present invention, the operability of the virtual menu can be improved.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Embodiments for Carrying Out the Invention

[0009] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. However, the configurations described in the following embodiments are merely examples, and the scope of the present invention is not limited by the configurations described in the present embodiments. For example, each part constituting the present invention can be replaced with any configuration that can exhibit the same function. Also, any components may be added. Further, any two or more configurations (features) in the present embodiment can be combined. Furthermore, in the accompanying drawings, the same or similar configurations are denoted by the same reference numerals, and redundant descriptions are omitted. Hereinafter, the present embodiment will be described with reference to FIGS. 1 to 7. In the present embodiment, an HMD will be described as an example of the information processing apparatus of the present invention.

[0010] [HMD] FIG. 1 is a block diagram showing the configuration of the HMD 100. The HMD 100 includes a CPU 101, a GPU 102, a ROM 103, a RAM 104, a display unit 105, a communication unit 106, an inertial measurement device 107, a geomagnetic sensor 108, a camera 109, a hand gesture detection unit 110, and a system bus 111. The CPU 101, the GPU 102, the ROM 103, the RAM 104, the display unit 105, the communication unit 106, the inertial measurement device 107, the geomagnetic sensor 108, the camera 109, and the hand gesture detection unit 110 are connected to the system bus 111. The CPU 101 (storage means) (determination means) (decision means) is a central processing unit that uses the RAM 104 as a work memory, executes the program stored in the ROM 103, and controls each configuration connected to the system bus 111. Thereby, the CPU 101 provides a space realized by VR, AR, MR, etc. to the user wearing the HMD 100 on the head.

[0011] The GPU 102 is a graphics processing unit that renders virtual objects in a virtual space. The ROM 103 is a non-volatile storage means and a storage device for programs. The RAM 104 is a work memory necessary for the CPU 101 to execute programs. The display unit 105 is an output device such as a liquid crystal panel or an organic EL panel used for displaying the rendered graphics. The communication unit 106 has a wired or wireless communication function for transmitting and receiving data. The inertial measurement device 107 is a sensor for detecting the posture and movement of the HMD 100.

[0012] The geomagnetic sensor 108 is a sensor for detecting the direction of the HMD 100. The camera 109 is a device for photographing the surrounding situation of the HMD 100 as a video. The hand gesture detection unit 110 has a function of analyzing the video captured by the camera 109 and detecting the user's hand, fingers, etc. A detailed description of the function of the hand gesture detection unit 110 will be given together with the description of FIG. 2 below. Note that the HMD 100 may be an optical transmission type, a video transmission type, or a non-transmission type.

[0013] [Function of Hand Gesture Detection Unit] Here, the function of the hand gesture detection unit 110 will be described with reference to FIG. 2. FIG. 2 is a diagram showing an example of a video 200 captured by the camera 109 of the HMD 100 worn on the user's head. The hand 201 of the user is shown in the video 200. The hand gesture detection unit 110 detects information on the region 202 indicating the position and size of the user's hand 201 from the video 200. Further, the hand gesture detection unit 110 detects information on the positions 204 of the tips and each joint point of the fingers 203 of the user's hand 201.

[0014] Note that although the lead lines of 203 and 204 in FIG. 2 are drawn from the index finger of the user's hand 201, similar information can be detected not only for the index finger of the user's hand 201 but also for other fingers of the user's hand 201. Also, in this embodiment, unless otherwise specified, the finger 203 refers to each finger of the user's hand 201. The CPU 101 controls the hand gesture detection unit 110 and stores the information obtained by these detections in the RAM 104 as three-dimensional coordinate information in the virtual space. Also, the hand gesture detection unit 110 can detect the movements of the user's hand 201 and finger 203 by analyzing the video continuously captured by the camera 109 of the HMD 100.

[0015] [UI] Here, an example of the UI used when the user operates the virtual object displayed on the display unit 105 of the HMD 100 will be described with reference to FIGS. 3 and 4. FIG. 3 is a diagram showing an example of the video 300 displayed on the display unit 105 of the HMD 100 worn on the user's head. When the CPU 101 acquires the video 300 by the camera 109 capturing the surroundings including the user's hand 201, the CPU 101 controls the hand gesture detection unit 110 to detect the positions of the user's hand 201 and finger 203 from the video 300. Further, the CPU 101 controls the GPU 102 to draw the virtual object 301 in the virtual space so that the virtual object 301 is displayed on the display unit 105 at a position slightly away from the user's hand 201 and finger 203. The user can perform operations such as pressing and grasping on the virtual object 301 with the hand 201 or finger 203. The CPU 101 controls the GPU 102 to change the drawing position and drawing shape of the virtual object 301 in the virtual space according to the user's operation. Such an operation of the user on the virtual object 301 is one of the UIs that can be used by the user in XR and is known as a hand gesture.

[0016] FIG. 4 is a diagram showing an example of a video 400 displayed on a display unit 105 of an HMD 100 worn on a user's head. When the camera 109 captures the surroundings including the user's hand 201 to obtain the video 400, the CPU 101 controls the hand gesture detection unit 110 to detect the positions of the user's hand 201 and fingers 203 from the video 400. Further, the CPU 101 controls the GPU 102 to draw the virtual object 401 in the virtual space so that the virtual object 401 is displayed on the display unit 105 at a position far from the user's hand 201 and fingers 203. Also, the CPU 101 controls the GPU 102 to draw the ray 402 in the virtual space so that the ray 402 is displayed on the display unit 105 in a state extending from the tip of one of the user's fingers 203.

[0017] The CPU 101 can detect the irradiation position 403 of the ray 402 on the virtual object 401, and stores the information of the detected irradiation position 403 in the RAM 104 as three-dimensional coordinate information in the virtual space. Note that the irradiation position 403 is not limited to the intersection point of the virtual object 401 and the ray 402. The irradiation position 403 may be, for example, the intersection point of the ray 402 and a real object, or the tip position of the ray 402. The user can perform operations such as selecting or grasping the virtual object 401 with the ray 402.

[0018] The CPU 101 controls the GPU 102 to change the drawing position and drawing shape of the virtual object 401 and the ray 402 in the virtual space according to the user's operation using the ray 402. The ray 402 used in such a user operation is one of the UIs that can be used by the user in XR. Note that in the video 400, the ray 402 extends from the tip of one of the user's fingers 203, but is not limited thereto. The ray 402 may extend, for example, from the palm of the user's hand 201.

[0019] [Display operation of virtual menu] Here, the display operation of the virtual menu will be described. The display operation of the virtual menu is an operation to cause the CPU 101 to display the virtual menu on the display unit 105. Therefore, when the user performs the display operation of the virtual menu using the UI, the CPU 101 controls the GPU 102 to draw the virtual menu (that is, the virtual object of the menu) in the virtual space. As a result, the virtual menu is displayed on the display unit 105. Note that the UI that can be used by the user in the display operation of the virtual menu includes, in addition to the above-described hand gesture and ray, for example, eye gaze input and a controller.

[0020] Note that in the case of eye gaze input, for example, when the HMD 100 detects that the user has directed the line of sight to a specific position, the virtual menu is displayed on the display unit 105. In addition, the controller includes at least one of a button incorporating an OTP (optical track pad), a touch pad, a touch panel, a cross key, a joystick, a track pad device, a motion sensor, and the like. Further, this virtual menu may be displayed by a display operation for another virtual menu different from the virtual menu.

[0021] [Drawing mode of virtual menu] The drawing mode of the virtual menu differs depending on the type of UI in use. In the present embodiment, the drawing modes of the virtual menu include a drawing mode for hand gestures, a drawing mode for rays, and a general-purpose drawing mode. Therefore, when the type of UI that the user is using is other than hand gestures and rays, the virtual menu is drawn in the virtual space in the general-purpose drawing mode. Note that the general-purpose drawing mode is a drawing mode of the virtual menu that is not for a specific type of UI.

[0022] [Determination of drawing mode of virtual menu] FIG. 5 is a flowchart showing a flow 500 of operations of the HMD 100 that determines a drawing mode of the virtual menu to a drawing mode suitable for the type of UI in use. The flow 500 of operations of the HMD 100 (control method of the information processing apparatus) shown in the flowchart of FIG. 5 is realized by the CPU 101 (computer) expanding and executing a program stored in the ROM 103 in the RAM 104. In step S501, the CPU 101 stores operation information in the RAM 104 (storage step). The operation information includes at least information on the type of UI in use and information on the use position of the UI. The information on the use position of the UI includes, for example, the three-dimensional coordinate information on the virtual space described above.

[0023] Therefore, the operation information includes information on the area 202 indicating the position and size of the user's hand 201, information on the positions 204 of the tips and each joint point of the fingers 203 of the user's hand 201, and information on the irradiation position 403 of the ray 402. When the UI is not being used, the CPU 101 includes information indicating that the UI is not being used in the operation information. In step S502, the CPU 101 determines whether or not a display operation of the virtual menu has been executed (determination step). When the CPU 101 determines that the display operation of the virtual menu has not been executed, the process returns to step S501. On the other hand, when the CPU 101 determines that the display operation of the virtual menu has been executed, the process proceeds to step S503.

[0024] In step S503, the CPU 101 refers to the operation information stored in the RAM 104. In step S504, the CPU 101 determines the type of the UI in use. This determination is made based on the information on the type of the UI in use included in the operation information referred to in step S503. If the CPU 101 determines that the type of the UI in use is a hand gesture, the process proceeds to step S505. If the CPU 101 determines that the type of the UI in use is a layout, the process proceeds to step S506. If the CPU 101 determines that the type of the UI in use is different from both a hand gesture and a layout, the process proceeds to step S507. Note that if information indicating that no UI is being used is included in the operation information referred to in step S503, that is, if the information on the type of the UI in use is not included in the operation information, the process also proceeds to step S507.

[0025] In step S505, the CPU 101 determines the drawing mode of the virtual menu to be the drawing mode for hand gestures (determination step). As a result, the virtual menu is drawn in the virtual space in the drawing mode for hand gestures. Consequently, the virtual menu is displayed on the display unit 105 in the drawing mode for hand gestures, for example, as shown in FIG. 6. Note that a detailed description of FIG. 6 will be given later. In step S506, the CPU 101 determines the drawing mode of the virtual menu to be the drawing mode for a ray (determination step). As a result, the virtual menu is drawn in the virtual space in the drawing mode for a ray. Consequently, the virtual menu is displayed on the display unit 105 in the drawing mode for a ray, for example, as shown in FIG. 7. Note that a detailed description of FIG. 7 will be given later. In step S507, the CPU 101 determines the drawing mode of the virtual menu to be a general-purpose drawing mode (determination step). As a result, the virtual menu is drawn in the virtual space in the general-purpose drawing mode. Consequently, although not shown, the virtual menu is displayed on the display unit 105 in the general-purpose drawing mode. In this way, by changing the process executed after step S504 according to the type of the UI in use, the virtual menu is drawn in the virtual space in a drawing mode suitable for the type of the UI in use and is further displayed on the display unit 105. When the process of step S505, step S506, or step S507 is executed, the operation flow 500 of the HMD 100 shown in the flowchart of FIG. 5 ends.

[0026] [Drawing Mode of Virtual Menu] Here, the drawing mode of the virtual menu will be described with reference to FIGS. 6 and 7. FIG. 6 is a diagram for explaining an example of the drawing mode of the virtual menu when the type of the UI in use is a hand gesture. When the display operation of the virtual menu is executed when the type of the UI in use is a hand gesture, the CPU 101 controls the GPU 102 to draw the virtual menu 601 in the virtual space in the drawing mode for hand gestures. As a result, the CPU 101 displays the virtual menu 601 on the display unit 105 in the drawing mode for hand gestures.

[0027] Specifically, based on the information of the positions 204 of the tips of the fingers 203 of the user's hand 201 and each joint point included in the operation information, the CPU 101 determines the drawing position of the virtual menu 601 at a position near the user's hand 201 and fingers 203. At this time, the CPU 101 may determine the drawing position of the virtual menu 601 at a position near the user's hand 201, or may determine the drawing position at a position near one finger 203 of the user's hand 201. For example, the CPU 101 determines the drawing position of the virtual menu 601 at a position slightly opposite to the position of the tip of the index finger of the user's hand 201. Note that the CPU 101 may also determine the drawing position of the virtual menu 601 based on the information of the area 202 indicating the position and size of the user's hand 201 included in the operation information. In this way, by determining the drawing position of the virtual menu 601 in the virtual space, the user can more easily recognize the virtual menu 601 on the display unit 105, and can operate the virtual menu 601 with a hand gesture without moving the hand 201 significantly.

[0028] Further, based on the information of the area 202 indicating the position and size of the user's hand 201 included in the operation information, the CPU 101 determines the drawing size of the virtual menu 601 to be a size that is easy to operate with a hand gesture compared to a general drawing mode. For example, the CPU 101 determines the drawing size of the virtual menu 601 to be a compact size compared to a general drawing mode. When the button 602 of the virtual menu 601 is operated by the palm of the user's hand 201, the CPU 101 may determine the drawing size of the virtual menu 601 to be a larger size compared to a general drawing mode. On the other hand, when the button 602 of the virtual menu 601 is operated by the tip of the finger 203 of the user's hand 201, the CPU 101 may determine the drawing size of the virtual menu 601 to be a smaller size compared to a general drawing mode. Further, the CPU 101 may also determine the drawing size of the virtual menu 601 based on the information of the positions 204 of the tips of the fingers 203 of the user's hand 201 and each joint point included in the operation information.

[0029] Furthermore, the CPU 101 determines the drawing shape of the button 602 of the virtual menu 601 to be a three-dimensional shape that makes it easy for the user to recognize that the button 602 has been operated by a hand gesture. Note that such three-dimensional shapes of the button 602 include, for example, the three-dimensional shape of a push-button or the three-dimensional shape of a slide-button.

[0030] FIG. 7 is a diagram for explaining an example of the drawing mode of the virtual menu when the type of the UI in use is a ray. When the type of the UI in use is a ray and a display operation of the virtual menu is executed, the CPU 101 controls the GPU 102 to draw the virtual menu 601 in the virtual space in the drawing mode for the ray. Thereby, the CPU 101 displays the virtual menu 601 on the display unit 105 in the drawing mode for the ray. Specifically, the CPU 101 determines the drawing position of the virtual menu 701 to be a position near the irradiation position 403 of the ray 402 based on the information of the irradiation position 403 of the ray 402 included in the operation information. In this way, by determining the drawing position of the virtual menu 701 in the virtual space, it becomes easier for the user to recognize the virtual menu 701 on the display unit 105, and it also becomes easier to indicate the virtual menu 701 with the tip of the ray 402.

[0031] Also, the CPU 101 determines the interval between the buttons 702 of the virtual menu 701 to be wider than that in the general-purpose drawing mode. Note that the CPU 101 may widen the interval between the buttons 702 by determining the drawing size of the virtual menu 701 to be larger than that in the general-purpose drawing mode. Further, the CPU 101 may determine the interval between the buttons 702 of the virtual menu 701 or the drawing size of the virtual menu 701 in proportion to the length of the ray 402. That is, the longer the length of the ray 402, the wider the interval between the buttons 702 of the virtual menu 701 or the larger the drawing size of the virtual menu 701. The length of the ray 402 is calculated from the position 204 of the tip of the finger 203 and the irradiation position 403 of the ray 402 when the ray 402 extends from the tip of one finger 203 of the user's hand 201. Also, the length of the ray 402 is calculated from the position of the hand 201 and the irradiation position 403 of the ray 402 when the ray 402 extends from the palm of the user's hand 201. Note that the information on the position 204 of the tip of the finger 203 from which the ray 402 extends, the information on the irradiation position 403 of the ray 402, and the information on the area 202 indicating the position of the hand 201, etc. are included in the operation information as described above. In this way, by determining the interval between the buttons 702 of the virtual menu 701, the erroneous operation of the ray 402 is reduced.

[0032] Furthermore, the CPU 101 determines the drawing color of the buttons 702 of the virtual menu 701 to be a color that changes when the user selects with the ray 402. In this way, by determining the drawing color of the buttons 702 of the virtual menu 701 in the virtual space, the user can easily recognize that the buttons 702 of the virtual menu 701 have been selected with the ray 402 on the display unit 105.

[0033] As described above, based on the operation information stored in the RAM 104, the HMD 100 determines the drawing mode in the virtual space of the virtual menus 601 and 701 to be a drawing mode suitable for the type of UI being used by the user. Thereby, the HMD 100 can improve the operability of the virtual menus 601 and 701.

[0034] As described above, the preferred embodiments of the present invention have been explained. However, the present invention is not limited to the above embodiments, and various modifications and changes are possible within the scope of the gist thereof. For example, when the HMD 100 is optically transmissive, a smart glass may be used instead of the HMD 100. Further, the operation flow 500 of the HMD 100 shown in the flowchart of FIG. 5 may be performed by a smartphone, a tablet terminal, a personal computer, or a digital camera connected to the HMD 100 by wire or wirelessly. However, in this case, a smartphone, a tablet terminal, a personal computer, a digital camera, or the like constitutes the information processing apparatus of the present invention.

[0035] The present invention can also be realized by a process in which a program that realizes one or more functions of the above-described embodiments is supplied to a system or apparatus via a network or a storage medium, and one or more processors of a computer of the system or apparatus read and execute the program. Further, the present invention can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

[0036] The disclosure of the present embodiment includes the following configurations, methods, and programs. (Configuration 1) Storage means for storing information on the type of the UI in use as operation information, Determination means for determining whether or not a display operation of a virtual menu has been executed, When the determination means determines that a display operation of a virtual menu has been executed, determination means for determining, based on the operation information, a drawing mode in the virtual space of the virtual menu to a drawing mode suitable for the type of the UI in use. An information processing apparatus characterized by comprising: (Configuration 2) The information processing apparatus according to Configuration 1, wherein the type of the UI in use is a hand gesture. (Configuration 3) The operation information includes information on the position of the user's hand or finger, The determination means determines, as a drawing mode suitable for the type of the UI in use, the drawing position of the virtual menu to a position near the user's hand or finger. The information processing apparatus according to Configuration 2. (Configuration 4) The operation information includes information on the position and size of the user's hand. The determination means determines the drawing size of the virtual menu to be a larger size or a smaller size compared to the general drawing mode as a drawing mode suitable for the type of UI in use, in the information processing apparatus according to Configuration 2 or 3. (Configuration 5) The determination means determines the drawing shape of the buttons of the virtual menu to be a three-dimensional shape as a drawing mode suitable for the type of UI in use, in the information processing apparatus according to any one of Configurations 2 to 4. (Configuration 6) The information processing apparatus according to Configuration 1, characterized in that the type of UI in use is a ray. (Configuration 7) The operation information includes information on the irradiation position of the ray. The determination means determines the drawing position of the virtual menu to be a position near the irradiation position of the ray as a drawing mode suitable for the type of UI in use, in the information processing apparatus according to Configuration 6. (Configuration 8) The determination means determines the interval between the buttons of the virtual menu to be a wider interval compared to the general drawing mode as a drawing mode suitable for the type of UI in use, in the information processing apparatus according to Configuration 6 or 7. (Configuration 9) The determination means determines the interval between the buttons of the virtual menu in proportion to the length of the ray as a drawing mode suitable for the type of UI in use, in the information processing apparatus according to Configuration 6 or 7. (Configuration 10) The determination means determines the drawing color of the buttons of the virtual menu to be a color that changes when selected by the ray as a drawing mode suitable for the type of UI in use, in the information processing apparatus according to any one of Configurations 6 to 9. (Configuration 11) The determination means determines the general drawing mode as a drawing mode suitable for the type of UI in use when the type of UI in use is different from the hand gesture and the ray, or when the information on the type of UI in use is not included in the operation information, in the information processing apparatus according to any one of Configurations 1 to 10. (Configuration 12) The information processing apparatus according to any one of Configurations 1 to 11, characterized in that the types of UI that can be used in the information processing apparatus include gaze input or a controller. (Method 1) A storage step of storing information on the type of the UI in use as operation information, A determination step of determining whether a display operation of a virtual menu has been executed, When the determination step determines that a display operation of a virtual menu has been executed, a determination step of determining a drawing mode in the virtual space of the virtual menu to a drawing mode suitable for the type of the UI in use based on the operation information. A control method for an information processing apparatus, characterized by comprising: (Program 1) A program for causing a computer to execute each means of the information processing apparatus according to any one of Configurations 1 to 12.

Explanation of Signs

[0037] 100 HMD (Information Processing Apparatus) 101 CPU (Storage Means) (Determination Means) (Determination Means) 201 User's Hand 203 User's Finger 402 Ray 403 Irradiation Position of Ray 601, 701 Virtual Menu 602, 702 Buttons of Virtual Menu

Claims

1. Storage means for storing information on the type of UI in use as operation information; Determination means for determining whether a display operation of a virtual menu has been executed; Determination means for determining, when the determination means determines that a display operation of a virtual menu has been executed, a drawing mode in the virtual space of the virtual menu to a drawing mode suitable for the type of UI in use based on the operation information. An information processing apparatus characterized by comprising:

2. The information processing apparatus according to claim 1, wherein the type of UI in use is a hand gesture.

3. The operation information includes information on the position of the user's hand or finger. The information processing apparatus according to claim 2, wherein the determination means determines the drawing position of the virtual menu to a position near the user's hand or finger as a drawing mode suitable for the type of UI in use.

4. The operation information includes information on the position and size of the user's hand. The information processing apparatus according to claim 2, wherein the determination means determines the drawing size of the virtual menu to a larger size or a smaller size compared to a general drawing mode as a drawing mode suitable for the type of UI in use.

5. The information processing apparatus according to claim 2, wherein the determination means determines the drawing shape of the button of the virtual menu to a three-dimensional shape as a drawing mode suitable for the type of UI in use.

6. The information processing apparatus according to claim 1, wherein the type of UI in use is a ray.

7. The operation information includes information on the irradiation position of the ray. The information processing apparatus according to claim 6, wherein the determination means determines the drawing position of the virtual menu to a position near the irradiation position of the ray as a drawing mode suitable for the type of UI in use.

8. The information processing apparatus according to claim 6, wherein the determination means determines the interval between the buttons of the virtual menu to a wider interval compared to a general drawing mode as a drawing mode suitable for the type of UI in use.

9. The information processing apparatus according to claim 6, wherein the determination means determines the interval between the buttons of the virtual menu in proportion to the length of the ray as a drawing mode suitable for the type of UI in use.

10. The information processing apparatus according to claim 6, wherein the determination means determines the drawing color of the button of the virtual menu to a color that changes when selected by the ray as a drawing mode suitable for the type of UI in use.

11. The information processing apparatus according to claim 1, wherein the determination means determines a general-purpose drawing mode as a drawing mode suitable for the type of UI in use when the type of UI in use is different from hand gestures and rays, or when information on the type of UI in use is not included in the operation information.

12. The information processing apparatus according to claim 1, wherein the types of UIs that can be used in the information processing apparatus include gaze input or a controller.

13. A storage step of storing information on the type of UI in use as operation information; A determination step of determining whether or not a display operation of a virtual menu has been executed; A control method for an information processing apparatus, comprising: a determination step of determining, when the determination step determines that a display operation of a virtual menu has been executed, a drawing mode in the virtual space of the virtual menu as a drawing mode suitable for the type of UI in use based on the operation information.

14. A program for causing a computer to execute each means of the information processing apparatus according to claim 1.

Images