Information processor and method for processing information

Abstract

To provide a technology for simply and accurately determining coordinates of a gaze point of a user in a three-dimensional space such as a virtual reality space, a mixed reality space, or an augmented reality space.SOLUTION: The information processer according to the present invention includes: first acquisition means for acquiring information regarding a gaze direction of one eye of a user; and second acquisition means for acquiring, on the basis of the information, a three-dimensional coordinate in the gaze direction as the coordinate of a gaze point of the user. The second acquisition means adjusts the position of the gaze point in a depth direction based on an operation by the user.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present invention relates to an information processing device and an information processing method, and more particularly to a technique for determining the coordinates of a user's point of gaze in a three-dimensional space such as a virtual reality space, a mixed reality space, or an augmented reality space. [Background technology]

[0002] Mixed reality (MR) is known as a technology that combines real space and virtual space in real time. In a head-mounted display (HMD) to which mixed reality is applied, for example, an image of real space is captured by a camera provided in the HMD, and a composite image is displayed in which an image of virtual space corresponding to the position and orientation of the HMD (camera) is superimposed on the image of real space.

[0003] In such HMDs, an eye-tracking device is used to detect the gaze point, which can then be used to perform various controls, such as accepting operations on the content UI, changing the displayed content, and linking the avatar's eye movements to the user's eye movements.

[0004] However, eye-tracking devices are expensive, so using them significantly increases costs. Furthermore, incorporating an eye-tracking device requires time and effort. This problem becomes particularly pronounced when each developer is individually provided with an eye-tracking device to check or test the operation of content that uses gaze points during development. For this reason, content operation simulations are sometimes performed without using an eye-tracking device.

[0005] In the simulation, an image (an image of a portion of the mixed reality space) that will be displayed to one eye of the person experiencing the mixed reality space is displayed on the developer's monitor. The developer can specify the direction of one eye (gaze direction) of the person experiencing the mixed reality space by specifying a position within this image (two-dimensional coordinates that do not include the position in the depth direction). The intersection of the gaze direction and an object in the mixed reality space is then estimated as the gaze point. However, the simulation is unable to estimate the position of the gaze point in the depth direction with high accuracy.

[0006] Patent Document 1 discloses a technique for estimating the intersection of the lines of sight of both eyes as the gaze point without capturing an image of the pupils. The technique disclosed in Patent Document 1 makes it possible to estimate the position of the gaze point in the depth direction with high accuracy. [Prior art documents] [Patent documents]

[0007] [Patent Document 1] Japanese Patent Application Publication No. 2019-200502 Summary of the Invention [Problem to be solved by the invention]

[0008] However, the technology disclosed in Patent Document 1 requires information on the line of sight of both eyes, which complicates processing and configuration and increases costs. Similar issues arise not only in the case of mixed reality, but also in the case of technologies such as virtual reality (VR) or augmented reality (AR).

[0009] The present invention relates to a three-dimensional space such as a virtual reality space, a mixed reality space, or an augmented reality space. The present invention aims to provide a technology that can easily and accurately determine the coordinates of a user's gaze point in a video game. [Means for solving the problem]

[0010] A first aspect of the present invention is an information processing device having a first acquisition means for acquiring information regarding the gaze direction of one of a user's eyes, and a second acquisition means for acquiring, based on the information, three-dimensional coordinates in the gaze direction as coordinates of the user's point of gaze, wherein the second acquisition means adjusts the position of the point of gaze in the depth direction based on an operation by the user.

[0011] A second aspect of the present invention is an information processing device characterized by having a step of acquiring information regarding the gaze direction of one of a user's eyes, a step of acquiring three-dimensional coordinates in the gaze direction based on the information as coordinates of the user's gaze point, and a step of adjusting the position of the gaze point in the depth direction based on an operation by the user.

[0012] A third aspect of the present invention is a program for causing a computer to function as each of the means of the information processing device. [Effects of the Invention]

[0013] According to the present invention, the coordinates of a user's point of gaze in a three-dimensional space such as a virtual reality space, a mixed reality space, or an augmented reality space can be determined easily and with high accuracy. [Brief explanation of the drawings]

[0014] [Figure 1] FIG. 2 is a hardware configuration diagram of an information processing device. [Figure 2] 1 is a functional configuration diagram of an information processing device according to a first embodiment. [Figure 3] 4 is a flowchart illustrating an operation of the information processing device according to the first embodiment. [Figure 4] FIG. 2 is a schematic diagram of a virtual reality image. [Figure 5] This is an overhead view of the virtual reality space. [Figure 6] This is an overhead view of the virtual reality space. [Figure 7] FIG. 10 is a functional configuration diagram of an information processing device according to a second embodiment. [Figure 8] 10 is a flowchart illustrating an operation of the information processing device according to the second embodiment. [Figure 9] FIG. 2 is a schematic diagram showing a camera coordinate system. [Figure 10] 10 is a flowchart illustrating an operation of the information processing device according to the third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0015] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0016] Fig. 1 is a hardware configuration diagram of an information processing device 100 according to this embodiment. The information processing device 100 in Fig. 1 is, for example, a personal computer. Note that the information processing device to which the present invention is applied is not limited to a personal computer, and may be, for example, a server, a head mounted display (HMD), a tablet terminal, or a smartphone.

[0017] 1, a CPU 101 comprehensively controls each device connected to the CPU 101 via a bus 112. The CPU 101 reads and executes programs stored in a read-only memory (ROM) 103. Various programs such as an operating system (OS), a processing program for realizing the operation according to this embodiment, and a device driver are stored in the ROM 103. The programs stored in the ROM 103 are temporarily stored in a random access memory (RAM) 102 and are executed by the CPU 101 as appropriate.

[0018] The operation I / F 104 is an interface for connecting an operation member 105 such as a keyboard, a mouse, a controller, a tablet terminal, or a smartphone to the information processing device 100 by wire or wirelessly.

[0019] The storage medium 106 is a storage medium such as a semiconductor memory or a magnetic disk, and stores various data. The storage medium I / F 107 is an interface for connecting an external storage medium 108, such as a USB memory or an external SSD, to the information processing device 100 via a wired or wireless connection.

[0020] The display I / F 109 is an interface for connecting a display device 110, such as a liquid crystal display or an organic EL display, to the information processing device 100 via a wired or wireless connection. The display device 110 may be an HMD. Note that although the display device 110 has been described as being a device separate from the information processing device 100, the display device 110 may be a display unit that is integral with the information processing device 100 (a display unit that is a part of the information processing device 100).

[0021] The communication I / F 111 is an interface for connecting the information processing device 100 to an external server via a network, for example, wired LAN communication, wireless LAN communication, Wifi communication, Bluetooth (registered trademark) communication, or infrared communication.

[0022] Example 1 A first embodiment of the present invention will be described below. In the first embodiment, a user uses a three-button mouse (a mouse having a right button, a left button, and a wheel) as the operation member 105 to perform an operation for determining (adjusting) the point of gaze.

[0023] Fig. 2 is a functional configuration diagram of the information processing device 100 according to the embodiment 1. Fig. 3 is a flowchart showing the operation of the information processing device 100 according to the embodiment 1. The CPU 101 loads a program stored in the ROM 103 into the RAM 102 and executes the program, thereby realizing each functional unit in Fig. 2 and realizing the operation in Fig. 3.

[0024] In step S301, the virtual camera information acquisition unit 201 acquires information about the position and orientation of a virtual camera provided in a virtual reality space. The user may be able to specify (change) the position and orientation of the virtual camera using an operation unit 105 such as a keyboard, a mouse, a controller, a tablet terminal, or a smartphone. If the display device 110 is an HMD, the virtual camera information acquisition unit 201 may acquire information about the orientation of the HMD as information about the orientation of the virtual camera. The virtual camera information acquisition unit 201 may take the position of the HMD into consideration when acquiring information about the position of the virtual camera. The position and orientation of the HMD can be estimated based on the output of a built-in sensor or an external sensor of the HMD.

[0025] In step S302, virtual reality image acquisition unit 202 acquires a virtual reality image (an image of a part of the virtual reality space, an image captured by the virtual camera) based on the information acquired in step S301 (information on the position and orientation of the virtual camera). CPU 101 controls display device 110 to display the acquired virtual reality image. This allows the user to view the virtual reality image (virtual reality space). For example, the user may be a developer of content that provides a virtual reality space, and in step S302, an image for simulating the operation of the content is acquired. Note that the user is not limited to a developer, and the image acquired in step S302 is not limited to an image for a simulation. For example, the image acquired in step S302 may be an image of completed content, or the user may be a person experiencing the virtual reality space.

[0026] When providing a virtual reality space to a user, different virtual reality images (two images with parallax) may be displayed to the user's right and left eyes to enable stereoscopic viewing of the virtual reality space. In such a case, in step S302, a virtual reality image to be displayed to one eye (either the right or left eye) is acquired and displayed. Note that both the virtual reality image to be displayed to the right eye and a different virtual reality image to be displayed to the left eye may be acquired and displayed.

[0027] In step S303, the line-of-sight information acquisition unit 203 acquires line-of-sight information related to the line-of-sight direction of one eye of the user. In the first embodiment, as shown in FIG. 4, the user specifies a position 401 (two-dimensional coordinates not including the position in the depth direction) within a displayed virtual reality image 400. Virtual objects 402 and 403 existing in the virtual reality space are depicted within the virtual reality image 400. The position 401 is specified, for example, by pointing with a three-button mouse. The line-of-sight information acquisition unit 203 acquires line-of-sight information based on the position 401 (and the position and orientation of the virtual camera). FIG. 5 is a bird's-eye view of the virtual reality space from the up-down direction of the virtual camera 501 (directions perpendicular to the front-back, left-right, and right-left directions). As shown in FIG. 5, the line-of-sight information acquisition unit 203 estimates, as the line-of-sight direction, the direction of a straight line 503 that starts from the position of the virtual camera 501 and passes through the position 401 (the position specified by the user) on the projection plane 502 for obtaining the virtual space image.

[0028] In step S304, the gaze point determination unit 204 acquires (determines) three-dimensional coordinates in the gaze direction as the coordinates of the user's gaze point based on the gaze information acquired in step S303. Fig. 6 is a bird's-eye view showing the positional relationship between the user (virtual camera 501) and the gaze point. For example, the gaze point determination unit 204 determines the intersection 601 of the gaze direction and the surface of the object, which is closest to the user (virtual camera 501), as the gaze point.

[0029] In step S305, the drawing unit 208 superimposes (draws) a marker indicating the point of gaze determined in step S304 on the virtual reality image acquired in step S302. The marker indicates two-dimensional coordinates (two-dimensional coordinates of the point of gaze) that do not include a position in the depth direction. Furthermore, the drawing unit 208 superimposes an overhead view (an overhead view indicating the positional relationship between the user (virtual camera) and the point of gaze) as shown in FIG. 6 on a part of the virtual reality image. Then, the drawing unit 208 outputs data of the virtual reality image after the marker and the overhead view have been superimposed to the display device 110. As a result, the virtual reality image after the marker and the overhead view have been superimposed is displayed on the display device 110. By displaying the marker and the overhead view, the user can grasp the three-dimensional coordinates of the point of gaze. Note that the method of displaying the overhead view is not limited to the above method; for example, the overhead view may be displayed outside the virtual reality image.

[0030] In step S306, the gaze point determination unit 204 adjusts the position of the gaze point in the depth direction (line of sight) based on the user's operation. In the first embodiment, the gaze point determination unit 204 adjusts the position of the gaze point in the depth direction (line of sight) in response to the operation of rotating the wheel of the three-button mouse. When the wheel is scrolled downward, the gaze point determination unit 204 moves the gaze point closer to the user (virtual camera) (moves the gaze point in the direction of arrow 602a in FIG. 6). When the wheel is scrolled upward, the gaze point determination unit 204 moves the gaze point away from the user (virtual camera) (moves the gaze point in the direction of arrow 602b). The directions of the arrows 602a and 602b are parallel to the line of sight. When the gaze point is adjusted, the overhead view displayed on the display device 110 (an overhead view showing the positional relationship between the user (virtual camera) and the gaze point) is also updated. This allows the user to adjust the gaze point while checking changes in the three-dimensional coordinates of the gaze point.

[0031] The method for adjusting the point of gaze is not limited to the above method. For example, the point of gaze may be moved closer to the user in response to the mouse being dragged downward, and moved farther away from the user in response to the mouse being dragged upward. The point of gaze may be moved in response to an operation using the keyboard. Furthermore, the gaze point determination unit 204 may adjust (reset) the gaze point to the intersection (intersection 601 in FIG. 6) between the line of sight direction and the surface of the object that is closest to the user (virtual camera 501) in response to a predetermined operation by the user. The predetermined operation is, for example, left-clicking the mouse or pressing the space bar on the keyboard.

[0032] According to the first embodiment described above, the three-dimensional coordinates of the user's gaze point in the virtual reality space can be determined easily and with high accuracy. For example, since the gaze point is determined based on gaze information from one eye, the processing and configuration are simpler and the cost is lower than when gaze information from both eyes is used. Furthermore, the position of the gaze point in the depth direction can be adjusted to a desired position by a simple operation such as operating a mouse.

[0033] Although an example of determining a gaze point in a virtual reality space has been described, a gaze point may be determined in another three-dimensional space such as a mixed reality space or an augmented reality space. The present invention is not limited to virtual reality (VR) but is also applicable to mixed reality (MR) or augmented reality (AR). The mixed reality space or augmented reality space may be provided by a video see-through method that combines an image of the virtual space with an image of the real space, or by an optical see-through method that combines an image of the virtual space with a real space that is not an image.

[0034] Example 2 A second embodiment of the present invention will be described below. In the second embodiment, the user performs a gesture operation as an operation for determining (adjusting) the point of gaze.

[0035] Fig. 7 is a functional configuration diagram of an information processing device 100 according to a second embodiment. Fig. 8 is a flowchart illustrating an operation of the information processing device 100 according to the second embodiment. The CPU 101 loads a program stored in the ROM 103 into the RAM 102 and executes the program, thereby realizing each functional unit in Fig. 7 and realizing the operation in Fig. 8. The functional configuration of the information processing device 100 according to the second embodiment is the same as that of the first embodiment (Fig. 2), but an imaging device 700 is connected to the information processing device 100 according to the second embodiment. Note that although the imaging device 700 is a device separate from the information processing device 100, the imaging device 700 may be an imaging unit (an imaging unit that is a part of the information processing device 100) that is configured integrally with the information processing device 100.

[0036] Steps S801 and S802 are the same as steps S301 and S302 in the first embodiment (FIG. 3).

[0037] In step S803, similarly to step S303, the gaze information acquisition unit 203 acquires gaze information relating to the gaze direction of one eye of the user. In the second embodiment, the gaze information acquisition unit 203 detects a specific fingertip of the user (for example, the tip of the index finger of the right hand) as feature point A from an image captured by the imaging device 700. The feature point A can be detected using a known hand tracking technique. Then, the gaze information acquisition unit 203 acquires gaze information based on the detected feature point A. As shown in FIG. 9 , the coordinates of the feature point A in the captured image are coordinates on a projection plane 902 (a plane perpendicular to the front-to-back direction of the imaging device 700) of a camera coordinate system 901 of the imaging device 700. The gaze information acquisition unit 203 converts the position (coordinates) of the feature point A in the captured image into a position (coordinates) in the virtual reality image acquired in step S802. Then, the gaze information acquisition unit 203 acquires gaze information in the same manner as in the first embodiment, using the converted position as a position specified by the user.

[0038] Steps S804 and S805 are similar to steps S304 and S305.

[0039] In step S806, similarly to step S306, the gaze point determination unit 204 The position of the point of gaze in the depth direction (line of sight direction) is adjusted based on an operation by the user. In the second embodiment, it is assumed that the distance from the user (for example, the face or torso of the user) to the feature point A is detected using the image capturing device 700. For example, the image capturing device 700 is provided near the user, and the distance from the image capturing device 700 to the feature point A is detected as the distance from the user to the feature point A. Then, the point of gaze determination unit 204 adjusts the position of the point of gaze in the depth direction (line of sight direction) in accordance with an operation that changes the distance from the user to the feature point A. When the feature point A is brought closer to the user, the point of gaze determination unit 204 brings the point of gaze closer to the user (virtual camera), and when the feature point A is moved away from the user, the point of gaze is moved away from the user (virtual camera).

[0040] Note that the range in which feature point A is detected (the range in which the fingertip of the right index finger can move) may be limited by performing calibration for the detection of feature point A in advance. For example, in the calibration, three points are specified at a first depth position, and a rectangle is formed by two line segments L1 and L2 connecting the three points and two line segments L3 and L4 parallel to the two line segments L1 and L2. Then, a second depth position is specified, and the formed rectangle extends from the first depth position to the second depth position to form a rectangular prism. The range within this rectangular prism is set as the range in which feature point A is detected.

[0041] According to the second embodiment described above, the three-dimensional coordinates of the user's gaze point in the virtual reality space can be determined easily and with high accuracy. For example, as in the first embodiment, the gaze point is determined based on gaze information from one eye, which simplifies processing and configuration and reduces costs compared to when gaze information from both eyes is used. Furthermore, the position of the gaze point in the depth direction can be adjusted to a desired position by a simple operation such as a gesture operation.

[0042] Example 3 A third embodiment of the present invention will be described. In the second embodiment, the user performs a gesture operation with one fingertip, but in the third embodiment, the user performs a gesture operation with two fingertips. The functional configuration of the information processing device 100 according to the third embodiment is the same as that of the second embodiment (FIG. 7).

[0043] 10 is a flowchart showing the operation of the information processing apparatus 100 according to the embodiment 3. The CPU 101 loads a program stored in the ROM 103 into the RAM 102 and executes the program, thereby realizing the operation of FIG.

[0044] Steps S1001 and S1002 are the same as steps S801 and S802 in the second embodiment (FIG. 8).

[0045] In step S1003, similarly to step S803, the gaze information acquisition unit 203 acquires gaze information relating to the gaze direction of one eye of the user. In the third embodiment, the gaze information acquisition unit 203 detects the tip of the first finger of the user (for example, the tip of the index finger of the right hand) as feature point A and detects the tip of the second finger of the user (for example, the tip of the thumb of the right hand) as feature point B from the image captured by the imaging device 700. Then, similarly to the second embodiment, the gaze information acquisition unit 203 acquires gaze information based on the detected feature point A (using the position of feature point A as the position specified by the user). Note that the position of feature point B may be used as the position specified by the user, or an intermediate position between feature points A and B may be used as the position specified by the user.

[0046] Steps S1004 and S1005 are similar to steps S804 and S805.

[0047] In step S1006, similarly to step S806, the gaze point determination unit 204 The position of the gaze point in the depth direction (line of sight) is adjusted based on an operation by the user. In the third embodiment, the gaze point determination unit 204 adjusts the position of the gaze point in the depth direction (line of sight) in response to an operation to change the distance from feature point A to feature point B. When the distance from feature point A to feature point B becomes shorter, the gaze point determination unit 204 moves the gaze point closer to the user (virtual camera), and when the distance from feature point A to feature point B becomes longer, the gaze point determination unit 204 moves the gaze point farther away from the user (virtual camera). This operation is, for example, an operation simulating a pinch operation that changes the distance from the tip of the index finger to the tip of the thumb. When the imaging device 700 is provided near the user, as feature points A and B are moved closer to the user, the distance from feature point A to feature point B in the captured image becomes longer. On the other hand, as feature points A and B are moved farther away from the user, the distance from feature point A to feature point B in the captured image becomes shorter. Therefore, assuming an operation to change the distance from the user to feature points A and B, the point of gaze may be moved away from the user when the distance from feature point A to feature point B in the captured image becomes shorter. Then, when the distance from feature point A to feature point B in the captured image becomes longer, the point of gaze may be moved closer to the user.

[0048] Note that the range in which feature points A and B are detected (the range in which the fingertips of the index finger and thumb of the right hand can move) may be limited by performing calibration in advance regarding the detection of feature points A and B. For example, in calibration, the depth direction is not taken into consideration, and three points are specified, and a rectangle is formed by two line segments L1 and L2 connecting the three points and two line segments L3 and L4 parallel to the two line segments L1 and L2. The range within this rectangle is set as the range in which feature points A and B are detected.

[0049] According to the above-described embodiment 3, it is possible to obtain the same effect as that of embodiment 2. Furthermore, by assuming gesture operations using two fingertips, even if the imaging device is a monocular camera that cannot detect the distance from the imaging device, the user can suitably adjust the position of the gaze point by intuitive gesture operations.

[0050] The above-described embodiment (including modifications) is merely an example, and the present invention also includes configurations obtained by appropriately modifying or changing the configuration of the above-described embodiment within the scope of the gist of the present invention. The present invention also includes configurations obtained by appropriately combining the configurations of the above-described embodiment.

[0051] (Other embodiments) The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0052] The disclosure of this embodiment includes the following configuration, method, and program. (Configuration 1) a first acquisition means for acquiring information about the gaze direction of one eye of the user; a second acquisition means for acquiring three-dimensional coordinates in the line of sight direction as coordinates of a gaze point of the user based on the information; and The second acquisition means adjusts the position of the gaze point in the depth direction based on an operation by the user. 1. An information processing device comprising: (Configuration 2) The display device further includes a control means for controlling the display device to display an overhead view showing the positional relationship between the user and the point of gaze. 2. The information processing device according to configuration 1, (Configuration 3) The control means controls the bird's-eye view to be displayed superimposed on a part of an image of the three-dimensional space visually recognized by the user. 3. The information processing device according to configuration 2. (Configuration 4) The first acquisition means acquires the information regarding the gaze direction based on a position designated by the user in an image of a three-dimensional space displayed for the one eye. 4. The information processing device according to any one of configurations 1 to 3. (Configuration 5) The first acquisition means acquires the information regarding the gaze direction based on a position where a predetermined fingertip of the user is detected. 4. The information processing device according to any one of configurations 1 to 3. (Configuration 6) The first acquisition means converts the detected position of the predetermined fingertip into a position in an image in a three-dimensional space displayed for the one eye, and acquires the information regarding the gaze direction based on the position in the image. 6. The information processing device according to configuration 5. (Configuration 7) The second acquisition means adjusts the position of the gaze point in the depth direction in response to an operation of rotating a wheel of a mouse. 7. The information processing device according to any one of configurations 1 to 6. (Configuration 8) The second acquisition means adjusts the position of the gaze point in the depth direction in response to an operation that changes a distance from the user to a predetermined fingertip of the user. 7. The information processing device according to any one of configurations 1 to 6. (Configuration 9) The second acquisition means adjusts the position of the gaze point in the depth direction in response to an operation of changing a distance from a first fingertip of the user to a second fingertip of the user. 7. The information processing device according to any one of configurations 1 to 6. (Configuration 10) The second acquisition means adjusts the gaze point to an intersection of the line of sight and a surface of an object that is closest to the user in response to a predetermined operation by the user. 10. The information processing device according to any one of configurations 1 to 9. (method) obtaining information regarding the gaze direction of one eye of the user; acquiring three-dimensional coordinates in the line of sight direction as coordinates of a gaze point of the user based on the information; adjusting the position of the gaze point in the depth direction based on an operation by the user; An information processing method comprising: (program) 11. A program for causing a computer to function as each means of the information processing device according to any one of configurations 1 to 10. [Explanation of symbols]

[0053] 100: Information processing device 101: CPU 203: Gaze information acquisition unit 204: Gazing point determination unit

Claims

1. a first acquisition means for acquiring information regarding the gaze direction of one eye of the user; a second acquisition means for acquiring three-dimensional coordinates in the line of sight direction as coordinates of a gaze point of the user based on the information; and The second acquisition means adjusts the position of the gaze point in the depth direction based on an operation by the user.

1. An information processing device comprising:

2. The display device further includes a control means for controlling the display device to display an overhead view showing the positional relationship between the user and the point of gaze.

2. The information processing apparatus according to claim 1, wherein:

3. The control means controls the display so that the overhead view is superimposed on a part of the image of the three-dimensional space visually recognized by the user.

3. The information processing apparatus according to claim 2, wherein:

4. The first acquisition means acquires the information regarding the line of sight direction based on a position designated by the user in an image of a three-dimensional space displayed for the one eye.

2. The information processing apparatus according to claim 1, wherein:

5. The first acquisition means acquires the information regarding the gaze direction based on a position where a predetermined fingertip of the user is detected.

2. The information processing apparatus according to claim 1, wherein:

6. The first acquisition means converts the detected position of the predetermined fingertip into a position in an image in a three-dimensional space displayed for the one eye, and acquires the information regarding the gaze direction based on the position in the image.

6. The information processing apparatus according to claim 5,

7. The second acquisition means adjusts the position of the gaze point in the depth direction in response to an operation of rotating a wheel of a mouse.

2. The information processing apparatus according to claim 1, wherein:

8. The second acquisition means adjusts the position of the gaze point in the depth direction in response to an operation that changes a distance from the user to a predetermined fingertip of the user.

2. The information processing apparatus according to claim 1, wherein:

9. The second acquisition means adjusts the position of the gaze point in the depth direction in response to an operation of changing a distance from a first fingertip of the user to a second fingertip of the user.

2. The information processing apparatus according to claim 1, wherein:

10. The second acquisition means adjusts the gaze point to an intersection of the line of sight direction and a surface of an object that is closest to the user in response to a predetermined operation by the user.

2. The information processing apparatus according to claim 1, wherein:

11. obtaining information regarding the gaze direction of one eye of the user; acquiring three-dimensional coordinates in the line of sight direction as coordinates of a gaze point of the user based on the information; adjusting the position of the gaze point in the depth direction based on an operation by the user; An information processing method comprising:

12. A program for causing a computer to function as each of the means of the information processing device according to any one of claims 1 to 10.

Images