Line-of-sight detection device and line-of-sight detection method

Abstract

[Problem] To make it possible to detect a line of sight more reliably. [Solution] A line-of-sight detection device characterized by comprising: a first image capturing device that captures an image of at least a portion of one eye of a wearer; a second image capturing device that captures an image of at least a portion of the eye of the wearer from a different direction from the first image capturing device; and a control unit that determines the line-of-sight direction of the wearer on the basis of a first image captured by the first image capturing device and a second image captured by the second image capturing device.

Description

Eye Gaze Detection Device and Eye Gaze Detection Method

[0001] The present invention relates to an eye gaze detection device and an eye gaze detection method.

[0002] A head-mounted display having an eye gaze detection function is known (see Patent Document 1).

[0003] Japanese Patent No. 6408629

[0004] However, there are cases where the wearer's eyes cannot be imaged and the eye gaze cannot be detected.

[0005] The present invention has been made in view of such a background, and an object thereof is to provide a technique capable of more reliably detecting an eye gaze.

[0006] A main invention of the present invention for solving the above problems is an eye gaze detection device, including a first imaging device that images at least a part of one eye of a wearer, a second imaging device that images at least a part of the wearer's eye from a direction different from that of the first imaging device, and a control unit that determines the eye gaze direction of the wearer based on a first image captured by the first imaging device and a second image captured by the second imaging device.

[0007] Regarding other problems disclosed in the present application and solutions therefor, they will be clarified by the embodiments of the invention and the drawings.

[0008] According to the present invention, an eye gaze can be detected more reliably.

[0009] This is a diagram for explaining the configuration of the head-mounted display 1 according to the present embodiment. This is a diagram for explaining the configuration of the head-mounted display 1. This is a plan view of the A-A plane of the head-mounted display 1 in FIG. 1. This is a diagram showing an example of an image captured by the first camera 351, the second camera 352, and the third camera 353. This is a diagram for explaining the alignment of the display module 3.

[0010] <System Overview> The following describes a head-mounted display 1 according to one embodiment of the present invention. The head-mounted display 1 of this embodiment is a display device that displays images and is also a gaze detection device that detects gaze. As will be described later, the head-mounted display 1 of this embodiment is equipped with multiple cameras that capture images of the wearer's eyes from different directions, and each camera captures an image of the wearer's eyes, and the direction of the wearer's gaze is detected using the images from the multiple cameras. Because the direction of gaze is detected based on images of the eyes captured from different angles, the accuracy of gaze detection can be improved. In addition, the head-mounted display 1 is equipped with a movement mechanism that moves a module including a camera and a display for each of the left and right eyes, so that these modules can be moved to positions corresponding to the left and right eyes, respectively. At this time, the modules are not moved to positions corresponding to the pupils and irises of each eye, but rather to positions corresponding to the centers of each eye. This makes it possible to position the modules in an appropriate position relative to the eyes, even when the pupil or iris is off-center from the center of the eyeball, for example, when the wearer is looking to the right relative to the direction of their face, and thus accurately detect the gaze. Even if the position of the pupil and iris changes, by photographing the eye from various angles, it becomes possible to compensate for the pupil and iris that could not be captured by one camera with another. This also improves the accuracy of eye tracking.

[0011] <Overall Configuration> Figure 1 is a diagram illustrating the configuration of the head-mounted display 1 according to this embodiment. Figure 2 is a diagram illustrating the configuration of the head-mounted display 1. Figure 3 is a plan view of the head-mounted display 1 of Figure 1 along line A-A.

[0012] The head-mounted display 1 comprises a housing 2, two display modules 3 (left and right), a movement mechanism 4, and a control unit (not shown). The control unit may be located inside the housing 2, outside the housing 2, or it may be a separate unit connected to the head-mounted display 1 by wire or wireless connection.

[0013] The housing 2 is molded from resin or the like and covers a space inside which the display module 3, the moving mechanism 4, the control unit, etc. can be housed.

[0014] The display module 3, as shown in Figure 3, comprises a frame 31, a display 32, and a mirror member 33. The display module 3 also includes an optical system that directs the image from the display 32 to the wearer's eye E. The optical system includes a lens 34, which is positioned opposite the wearer's eye E. The display module 3 also comprises a plurality of imaging devices 35 and a light source 36 (see Figure 1). The display module 3 is positioned in front of the wearer's eye E.

[0015] The frame 31 may be made of resin or the like. The frame 31 holds the display 32, mirror member 33, lens 34, imaging device 35, and light source 36.

[0016] The display 32 displays an image. The display 32 is a flat plate-shaped component held by the frame 31. When the wearer wears the head-mounted display 1, the display 32 is positioned in front of the wearer's eyes E. The display 32 may be of any type, such as an LCD, organic EL display, mini OLED, micro OLED, or micro LED.

[0017] The mirror member 33 is held by the frame 31 and positioned between the display 32 and the wearer's eye E when worn. The mirror member 33 may be positioned at an angle that gradually approaches the display downwards. The mirror member 33 transmits light from the display 32 and reflects light from the wearer's eye E side as shown by the dotted arrow 40. The mirror member 33 may be a half mirror, hot mirror, or cold mirror. Note that the inclination angle of the mirror member is just an example, and other angles are possible, and it can also be positioned parallel to the display.

[0018] The lens 34 is made of resin or the like and is held in the frame 31. When worn by the wearer, the lens 34 is positioned on the side of the wearer's eye E that faces the wearer's eye E, closer to the wearer's eye E than the mirror member 33. The lens 34 may be a Fresnel lens, with the surface facing the eye E formed in a spherical shape.

[0019] The light source 36 irradiates light onto the wearer's eye E. In this embodiment, the light source 36 is capable of emitting infrared light. Multiple light sources 36 may be arranged around the lens 34. In this embodiment, six light sources 36 are fixed to the frame 31, but there may be six or more, or five or fewer.

[0020] The imaging device 35 is capable of imaging the wearer's eye E. The imaging device 35 is fixed to the frame 31. The imaging device 35 is located below the lens 34 and may be positioned to image the mirror surface of the mirror member 33 (the surface facing the wearer's eye E). The imaging device 35 photographs the light (infrared) emitted by the light source 36 that is reflected off the eye E (hereinafter referred to as a bright spot). The direction of the line of sight can be determined from how the bright spot is captured. In this embodiment, the device is fixed to the frame, but the present invention is not limited to this configuration, and may be indirectly fixed to the frame or fixed to other members.

[0021] The imaging device 35 includes a first camera (imaging device) 351, a second camera (imaging device) 352, and a third camera (imaging device) 353. The imaging device 35 may have two cameras or four or more cameras. The imaging device 35 is configured to image each eye with multiple cameras. The first camera 351, the second camera 352, and the third camera 353 are all positioned below the lens 34. The first camera 351, the second camera 352, and the third camera 353 image at least one of the pupil P or iris of the wearer's eye E.

[0022] The first camera 351 is positioned below the optical center of the lens and captures the wearer's eye E as it is reflected in the mirror member 33 from below when the device is worn. The optical axis of the first camera 351 may be positioned in a direction that passes through the center of the wearer's eyeball and is inclined with respect to the normal direction of the mirror member 33. The first camera 351 is positioned in a manner that allows it to capture the eye E so that at least a portion of the wearer's pupil, iris, and cornea is included.

[0023] The second camera 352 is positioned below the lens and to the right of the first camera 351 (in this embodiment, left and right refer to the left and right directions from the wearer toward the display 32). The optical axis of the second camera 352 may be positioned to pass through the center of the wearer's eyeball and to be inclined with respect to the normal direction of the mirror member 33. Alternatively, the second camera 352 may be positioned so that its optical axis opens horizontally with respect to the optical axis of the first camera 351. The second camera 352 images the wearer's eye E from right to left. The second camera 352 images the eye E reflected in the mirror member 33 from the lower right to the upper left, as viewed from the wearer. The third camera 353 images at least a portion of the wearer's pupil, iris, and cornea from the left side.

[0024] The third camera 353 is positioned below the lens and to the left of the first camera 351. The optical axis of the third camera 353 may be positioned in a direction that passes through the center of the wearer's eyeball and is inclined with respect to the normal direction of the mirror member 33. The third camera 353 may be positioned so that its optical axis opens horizontally with respect to the optical axis of the first camera 351. The third camera 353 images the wearer's eye E from left to right. The third camera 353 images the eye E reflected in the mirror member 33 from the lower left to the upper right as seen from the wearer. The third camera 353 images at least a portion of the wearer's pupil, iris, and cornea from the left side.

[0025] The first camera 351, the second camera 352, and the third camera 353 each capture images of the wearer's eye E in different imaging directions (different positions and / or angles). The second camera 352 and the third camera 353 may be positioned near the first camera 351. Due to refraction by the lens 34, the second camera 352 and the third camera 353 can capture images of the eye E from angles of 45 degrees or more to the left and right of the imaging direction of the first camera 351.

[0026] The light source 36 emits infrared light. The light from the light source 36 is reflected by the surface of the eyeball (the surface of the cornea) of the eye E, and the reflected light (corneal reflection image) is reflected by the mirror member 33 and incident on each camera (351, 352, 353).

[0027] Figure 4 shows examples of images captured by the first camera 351, the second camera 352, and the third camera 353. As shown in Figure 4, the image 351i captured by the first camera 351, the image 352i captured by the second camera 352, and the image 353i captured by the third camera 353 are images of the same eye E from different angles. By capturing from different angles, bright spots that could not be captured by one camera may be captured by another camera. In the example in Figure 4, one bright spot in the upper left is not captured in the image 353i captured by the third camera 353. Also, in the image 352i captured by the second camera 352, parts of the two bright spots in the upper row are hidden by the eyelid and are not captured. However, in the image 351i from the first camera 351, all of these bright spots are captured. By arranging multiple cameras in this way, it becomes possible to compensate for parts that could not be captured by some cameras with other cameras.

[0028] The second camera 352 can be positioned to capture a portion of the eye E that the first camera 351 cannot capture when the pupil P of the wearer's eye E is located at one end of the eye E. More specifically, it can be positioned to capture a portion of the eye E that the first camera 351 cannot capture when the wearer's eye E is located at the right end in Figure 1. The second camera 352 can be positioned so that it can capture all bright spots reflected by the cornea of ​​the eye E when the pupil P is located in a position where the first camera 351 cannot capture all of the bright spots. The third camera 353 can be positioned to capture a portion of the eye E that neither the first camera 351 nor the second camera 352 can capture when the pupil P of the wearer's eye E is located at the other end of the eye E. The third camera 352 may be positioned such that it can capture all bright spots when the pupil P is located in a position where neither the first camera 351 nor the second camera 352 can capture all bright spots reflected by the cornea of ​​the eye E.

[0029] Referring to Figures 1 and 2, the moving mechanism 4 is a mechanism for moving the display module 3. The moving mechanism 4 moves the display module 3 relative to the housing 2. The moving mechanism 4 may include, for example, a motor (not shown), a shaft 41 attached to the motor, a gear 42 provided on the shaft 41, and a display-side gear 43 attached to the display module 3. Power from the motor rotates the shaft 41, and the display-side gear 43 rotates via the teeth of the gear 42 attached to the shaft 41. The rotation of the display-side gear 43 biases and moves the display module 3. The moving mechanism 4 can move the display module 3 at least in the horizontal direction (left and right direction).

[0030] For example, in the head-mounted display 1 shown in Figure 1, the right display module 3 is moved in the direction of arrow 51 (to the right). The right display module 3 is moved to a position corresponding to the center of the eye located on the right side of Figure 1 (the wearer's right eye), based on an image captured by at least one of the first camera 351, second camera 352, and third camera 353. The left display module 3 is then moved in the direction of arrow 52 (to the left). The left display module 3 is also moved to a position corresponding to the center of the eye located on the left side of Figure 1 (the wearer's left eye). As a result, the distance W1 between the left and right display modules can be widened to the distance W2 shown in Figure 2. Note that the distance between the display modules may widen as a result of moving the left and right display modules 3, and the distance between the left and right display modules 3 is not adjusted to match the distance between the wearer's eyes. In other words, the distance between the left and right display modules 3 can be changed by the movement mechanism 4, but in this embodiment, the main focus is not on changing the distance between the left and right display modules 3, but rather on positioning each of the left and right display modules 3 in the optimal position for the wearer's left and right eyes. The optimal position can be the position where the center of the pupil and the center of the lens, etc., coincide, but in this embodiment, it is determined based on the center of the eyeball. The center of the eyeball can be detected by various known methods. The center of the eyeball can also be calculated from the curvature of the surface of the eye. Alternatively, the center of the eyeball can be detected by a sensor. Furthermore, the configuration may be such that the wearer can adjust the position manually or by operating a button or the like.

[0031] Furthermore, the movement mechanism 4 may be configured to move the display module 3 in parallel not only horizontally but also vertically (up and down). The movement mechanism 4 may also be configured to rotate (tilt adjust) the display module 3 around a predetermined axis. Additionally, the movement mechanism 4 can operate independently on the left and right sides, and the direction and / or distance of movement of the left and right display modules 3 may differ. The left and right display modules 3 can be moved independently to align with the wearer's left and right eyes, respectively.

[0032] As the moving mechanism 4 moves the display module 3, the display module 3 is moved together with the imaging device 35.

[0033] The movement mechanism 4 can move the display module 3 so as to align the first camera 351 with the position of the wearer's eye E. The position of the wearer's eye E can be determined by the imaging device 35. The position of the wearer's eye E can be determined based on the image captured by the first camera 351. The position of the wearer's eye E may also be determined based on the image captured by the second camera 352 or the third camera 353, or it may be determined based on the images captured by at least two of the first camera 351, the second camera 352, or the third camera 353. Figure 5 is a diagram illustrating the alignment of the display module 3. As shown in Figure 5, the horizontal position of the first camera 351 (optical axis) can be aligned with the center of the wearer's eye E (center of the eyeball B). The center of the eyeball B can be calculated based on the curvature of the surface of the eye, or it can be detected using known means such as detection by a sensor. Note that the center of the eyeball B refers to a point that does not move even when the eyeball B rotates, and does not necessarily have to be the exact center, but may be the center of the curved surface calculated from the surface curvature of the eyeball B, or the center of curvature. Also, the first camera 351 does not need to be perfectly aligned with the center of the eyeball B, and may be positioned at a predetermined position within a predetermined distance from the center based on the detected center. When aligning with the pupil P, the alignment must be performed with the wearer facing directly forward, and if the wearer moves their gaze, for example, it will not be possible to align to the optimal position. For example, Figure 5 shows an example where the wearer is looking slightly to the left of Figure 5 rather than directly forward, and the pupil P is located to the left of the front position in Figure 5. In this case, the horizontal position of the center of the eyeball B (dotted line BC) and the horizontal position of the center of the pupil P (dotted line PC) will be misaligned, and if the first camera 351 is aligned with the horizontal position of the center of the pupil P, the display module 3 will be moved to the left in Figure 5. However, by aligning the first camera 351 with the center of the eyeball B, it becomes possible to position it in the same horizontal position as when the wearer is facing forward.Therefore, by aligning the display module 3 with the center of the eyeball B as the reference point, the optimal position can be achieved even if the wearer's gaze moves (the eyeball B rotates). Furthermore, since the human face is asymmetrical, by independently aligning the left and right display modules 3 to the horizontal position of the center of the wearer's left and right eyeballs B, the optimal position can be achieved for each of the left and right eyes.

[0034] The control unit is connected to the display module 3 and the moving mechanism 4.

[0035] The control unit controls the first camera 351, the second camera 352, and the third camera 353 to image the eye E (cornea). The control unit can, for example, cause the imaging device 35 to perform an imaging operation at the same time as or at a predetermined timing after the light source 36 is turned on.

[0036] The control unit can cause the first camera 351, the second camera 352, and the third camera 353 to perform imaging operations simultaneously (at the same timing). The control unit can control the first camera 351, the second camera 352, and the third camera 353 to perform exposure operations substantially simultaneously. Substantially simultaneous means that the exposure periods of the first camera 351, the second camera 352, and the third camera 353 overlap for a certain period of time or longer, and strict simultaneity is not required. Substantially simultaneous operation can be considered to be ensured if the difference in the exposure start timing of each imaging device is within a few milliseconds.

[0037] The control unit can determine the wearer's line of sight direction based on the images captured by the first camera 351, the second camera 352, and the third camera 353. The control unit detects the pupil center position of the eye E and the position of the corneal reflection image on the corneal surface from the images captured by each camera. Based on the three-dimensional geometric relationship between the offset vector of the pupil center position relative to the corneal reflection image obtained from the image captured by the first camera 351 and the offset vector of the pupil center position relative to the corneal reflection image obtained from the images captured by the second camera 352 and the third camera 353, the control unit can determine the wearer's eye rotation angle.

[0038] The control unit may control the movement mechanism 4 to move the display module 3 so that it aligns with the position of the wearer's eye E. The control unit can detect the position of the wearer's eye E based on the images captured by the first camera 351, the second camera 352, and the third camera 353, and control the position and / or orientation of the display module 3 so that its position aligns appropriately with the position of the eye E. The control unit can move the display module 3 by controlling the movement mechanism 4 so that the first camera 351 of the display module 3 is positioned directly below the wearer's eye E (so that the horizontal position of the first camera 351 aligns with the center of the eye E (eyeball B) when the wearer is facing forward). The control unit may also move the display module 3 so that, for example, the optical center (optical axis, etc.) of the lens 34 coincides with the center of the eye E (eyeball B) in the horizontal direction.

[0039] The control unit can perform calibration based on characteristic points of the eyeball detected by the first camera 351 (such as the pupil center and the centroid of the corneal reflection image). For example, if the characteristic points in the image from the first camera 351 when the wearer is fixating on a predetermined indicator are used as the reference position, and the characteristic points in the image from the first imaging device 351 shift from the reference position during wear, the control unit can use the images from the second imaging device 352 and the third imaging device 353 to correct the line of sight direction.

[0040] Although these embodiments have been described above, they are intended to facilitate understanding of the present invention and are not intended to limit its interpretation. The present invention can be modified and improved without departing from its spirit, and equivalents thereof are also included.

[0041] <Modification Example 1> In the above embodiment, an example of using three cameras was shown. However, the present invention is not limited to this, and four or more cameras may be used. For example, by adding a fourth camera at a symmetric position in the left-right direction and arranging these four cameras in a cross shape around the wearer's eyes, it becomes possible to accurately detect eye movements in both the horizontal and vertical directions. Further, by arranging six or more cameras radially around the eyes and imaging the eyes from multiple directions, it becomes possible to more accurately estimate the eye shape and calculate a more natural line of sight direction.

[0042] <Modification Example 2> Also, in the above embodiment, an example of using a light source that irradiates infrared light was shown. However, visible light may be used. When using visible light, it can also be combined with iris authentication. Further, a light source that switches between irradiating infrared light and visible light may be used.

[0043] <Modification Example 3> Also, in the above embodiment, instead of the display 32, a see-through type display through which the wearer's external scene can be seen may be used.

[0044] <Modification Example 4> When assuming use by multiple people, it is desirable that the positions and orientations of the cameras and light sources can be individually adjusted according to the positions of the eyes of each wearer. Therefore, for example, the imaging device 35 and the light source 36 may be configured to be movable or rotatable around the eyes. Further, by performing calibration of the line-of-sight detection for each wearer and storing the calibration data for each wearer, it becomes possible to quickly resume the line-of-sight detection even when the wearer changes.

[0045] In cases where multiple users share the eye-tracking device, the camera position may be automatically adjusted to match the position of each user's eyes. For example, a user identification means can be provided. As a user identification means, biometric authentication technologies such as facial recognition, iris recognition, and voice recognition can be used. When a user is positioned in front of the display, the user can be identified by the user identification means. In addition, a user information storage unit can be provided to store characteristic points of the eyeball (such as the center of the pupil and the centroid of the corneal reflection image) for each user. The control unit can read the characteristic points corresponding to the identified user from the user information storage unit and control the movement mechanism 4 to move the display module 3 by aligning the optical axis of the first camera 351 and the optical axis of the lens 34 with the read characteristic points.

[0046] <Modification 5> In the above embodiment, an example of applying the present invention to a head-mounted display was shown, but the present invention is not limited thereto. The present invention can be applied to various devices where eye-tracking input is useful, such as in-vehicle displays, digital signage, game machines, and medical devices.

[0047] <Disclosure Items> This disclosure also includes the following configurations: [Item 1] A gaze detection device comprising: a first imaging device that images at least a portion of one of the wearer's eyes; a second imaging device that images at least a portion of the wearer's eye from a direction different from that of the first imaging device; and a control unit that determines the wearer's gaze direction based on a first image captured by the first imaging device and a second image captured by the second imaging device. [Item 2] The gaze detection device according to Item 1, wherein the first imaging device and the second imaging device image at least one of the wearer's pupil or iris at the same time. [Item 3] The gaze detection device according to Item 1, wherein the second imaging device images at least one of the pupil or iris from the right or left side of the direction in which the first imaging device images at least one of the pupil or iris of the eye. [Item 4] A gaze detection device according to Item 1, comprising a plurality of light sources that irradiate the wearer's cornea with light, wherein the second imaging device is arranged such that it can capture all of the bright spots reflected by the cornea when the wearer's pupil is positioned in a location where the first imaging device cannot capture all of the bright spots reflected by the cornea. [Item 5] A gaze detection device according to Item 4, comprising a third imaging device that captures at least a portion of the wearer's eye from a direction different from that of the first and second imaging devices, wherein the control unit determines the wearer's gaze direction based on at least two of the first image captured by the first imaging device, the second image captured by the second imaging device, or the third image captured by the third imaging device. [Item 6] A gaze detection device according to Item 5, wherein the third imaging device images the pupil or iris of the eye from the left or right side in the direction in which the first imaging device images the pupil or iris of the eye.[Item 7] A gaze detection device according to Item 5, wherein the third imaging device is arranged such that it can capture all of the bright spots reflected by the cornea when the wearer's pupil is positioned so that neither the first imaging device nor the second imaging device can capture all of the bright spots reflected by the cornea. [Item 8] A gaze detection device according to Item 5, wherein the first imaging device, the second imaging device and the third imaging device capture at least one of the wearer's pupil or iris at the same time. [Item 9] A gaze detection device according to Item 5, comprising a display and a mirror member that transmits light from the display and reflects light from the eye, wherein the first imaging device, the second imaging device and the third imaging device capture the image of the eye reflected by the mirror member. [Item 10] A gaze detection device according to Item 9, characterized in that it comprises a moving mechanism for moving the first imaging device, the second imaging device and the third imaging device together with the display and the mirror member. [Item 11] A head-mounted display comprising the gaze detection device according to Item 1 and a display facing the wearer's eye when worn. [Item 12] A gaze detection method characterized in that a first imaging device images at least a portion of one of the wearer's eyes, a second imaging device images at least a portion of the wearer's eye from a direction different from that of the first imaging device, and a control unit determines the wearer's gaze direction based on a first image captured by the first imaging device and a second image captured by the second imaging device.

[0048] 1 Head-mounted display 2 Housing 3 Display module 4 Movement mechanism 5 Control unit 31 Frame 32 Display 33 Mirror member 34 Lens 35 Imaging device 36 Light source

Claims

1. A gaze detection device comprising: a first imaging device that images at least a portion of one of the wearer's eyes; a second imaging device that images at least a portion of the wearer's eye from a direction different from that of the first imaging device; and a control unit that determines the wearer's gaze direction based on a first image captured by the first imaging device and a second image captured by the second imaging device.

2. A gaze detection device according to claim 1, characterized in that the first imaging device and the second imaging device capture images of at least one of the wearer's pupil or iris at the same time.

3. A gaze detection device according to claim 1, wherein the second imaging device images the pupil or iris of the eye from the right or left side in the direction in which the first imaging device images the pupil or iris of the eye.

4. A gaze detection device according to claim 1, comprising a plurality of light sources that irradiate the cornea of ​​the wearer, wherein the second imaging device is arranged such that it can capture all of the bright spots reflected by the cornea when the wearer's pupil is positioned in a location where the first imaging device cannot capture all of the bright spots reflected by the cornea.

5. A gaze detection device according to claim 4, comprising a third imaging device that images at least a portion of the wearer's eyes from a direction different from that of the first imaging device and the second imaging device, wherein the control unit determines the wearer's gaze direction based on at least two of the first image captured by the first imaging device, the second image captured by the second imaging device, or the third image captured by the third imaging device.

6. A gaze detection device according to claim 5, wherein the third imaging device images the pupil or iris of the eye from the left or right side in the direction in which the first imaging device images the pupil or iris of the eye.

7. A gaze detection device according to claim 5, characterized in that the third imaging device is arranged such that it can image all of the bright spots reflected by the cornea when the wearer's pupil is positioned in a location where neither the first imaging device nor the second imaging device can image all of the bright spots reflected by the cornea.

8. A gaze detection device according to claim 5, characterized in that the first imaging device, the second imaging device, and the third imaging device capture images of at least one of the wearer's pupil or iris at the same time.

9. A gaze detection device according to claim 5, comprising: a display; and a mirror member that transmits light from the display and reflects light from the eye, wherein the first imaging device, the second imaging device, and the third imaging device capture images of the eye reflected by the mirror member.

10. A gaze detection device according to claim 9, characterized in that it comprises a moving mechanism for moving the first imaging device, the second imaging device and the third imaging device together with the display and the mirror member.

11. A head-mounted display comprising the gaze detection device described in claim 1 and a display that faces the wearer's eyes when worn.

12. A gaze detection method characterized by: a first imaging device imaging at least a portion of one of the wearer's eyes; a second imaging device imaging at least a portion of the wearer's eye from a direction different from that of the first imaging device; and a control unit determining the wearer's gaze direction based on a first image captured by the first imaging device and a second image captured by the second imaging device.

Images