Eye-tracking device and eye-tracking method

Abstract

To enable more reliable detection of gaze. [Solution] A gaze detection device comprising: a first imaging device that images at least a portion of one of the wearer's eyes; a second imaging device that images at least a portion of the wearer's eye from a direction different from that of the first imaging device; and a control unit that determines the wearer's gaze direction based on a first image captured by the first imaging device and a second image captured by the second imaging device.

Description

Technical Field

[0001] The present invention relates to a gaze detection device and a gaze detection method.

Background Art

[0002] A head-mounted display having a gaze detection function is known (see Patent Document 1).

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, there are cases where the gaze of the wearer cannot be detected because the wearer's eyes cannot be imaged.

[0005] The present invention has been made in view of such a background, and an object thereof is to provide a technique capable of more reliably detecting a gaze.

Means for Solving the Problems

[0006] The main invention of the present invention for solving the above problems is a gaze detection device, comprising: a first imaging device that images at least a part of one eye of a wearer; a second imaging device that images at least a part of the eye of the wearer from a direction different from the first imaging device; and a control unit that determines the gaze direction of the wearer based on a first image captured by the first imaging device and a second image captured by the second imaging device.

[0007] Regarding other problems disclosed in the present application and methods for solving them, they will be clarified by the embodiments of the invention and the drawings.

Effects of the Invention

[0008] According to the present invention, gaze can be detected more reliably. [Brief explanation of the drawing]

[0009] [Figure 1] This diagram illustrates the configuration of the head-mounted display 1 according to this embodiment. [Figure 2] This is a diagram illustrating the configuration of head-mounted display 1. [Figure 3] Figure 1 is an AA plan view of the head-mounted display 1. [Figure 4] This figure shows examples of images captured by the first camera 351, the second camera 352, and the third camera 353. [Figure 5] This diagram illustrates the alignment of the display module 3. [Modes for carrying out the invention]

[0010] <System Overview> The following describes a head-mounted display 1 according to one embodiment of the present invention. The head-mounted display 1 of this embodiment is a display device that displays images and is also a gaze detection device that detects gaze. As will be described later, the head-mounted display 1 of this embodiment is equipped with multiple cameras that capture images of the wearer's eyes from different directions, and each camera captures an image of the wearer's eyes, and the direction of the wearer's gaze is detected using the images from the multiple cameras. Because the direction of gaze is detected based on images of the eyes captured from different angles, the accuracy of gaze detection can be improved. In addition, the head-mounted display 1 is equipped with a movement mechanism that moves a module including a camera and a display for each of the left and right eyes, so that these modules can be moved to positions corresponding to the left and right eyes, respectively. At this time, the modules are not moved to positions corresponding to the pupils and irises of each eye, but rather to positions corresponding to the centers of each eye. This makes it possible to position the modules appropriately for the eyes even when the pupils and irises are off-center, for example, when the wearer is looking to the right relative to the direction of their face, and thus accurately detect the gaze. Even if the position of the pupil and iris changes, by photographing the eye from various angles, it becomes possible to compensate for the pupil and iris that could not be captured by one camera with another. This also improves the accuracy of eye tracking.

[0011] <Overall Structure> Figure 1 is a diagram illustrating the configuration of the head-mounted display 1 according to this embodiment. Figure 2 is a diagram illustrating the configuration of the head-mounted display 1. Figure 3 is an AA plan view of the head-mounted display 1 of Figure 1.

[0012] The head-mounted display 1 comprises a housing 2, two display modules 3 (left and right), a movement mechanism 4, and a control unit (not shown). The control unit may be located inside the housing 2, outside the housing 2, or it may be a separate unit connected to the head-mounted display 1 by wire or wireless connection.

[0013] The housing 2 is molded from resin or the like and covers a space inside which the display module 3, the moving mechanism 4, the control unit, etc., can be housed.

[0014] The display module 3, as shown in Figure 3, comprises a frame 31, a display 32, and a mirror member 33. The display module 3 also includes an optical system that directs the image from the display 32 to the wearer's eye E. The optical system includes a lens 34, which is positioned opposite the wearer's eye E. The display module 3 also comprises a plurality of imaging devices 35 and a light source 36 (see Figure 1). The display module 3 is positioned in front of the wearer's eye E.

[0015] The frame 31 may be made of resin or the like. The frame 31 holds the display 32, mirror member 33, lens 34, imaging device 35, and light source 36.

[0016] The display 32 displays an image. The display 32 is a flat plate-shaped component held by the frame 31. When the wearer wears the head-mounted display 1, the display 32 is positioned in front of the wearer's eyes E. The display 32 may be of any type, such as an LCD, organic EL display, mini OLED, micro OLED, or micro LED.

[0017] The mirror member 33 is held by the frame 31 and positioned between the display 32 and the wearer's eye E when worn. The mirror member 33 may be positioned at an angle that gradually approaches the display downwards. The mirror member 33 transmits light from the display 32 and reflects light from the wearer's eye E side as shown by the dotted arrow 40. The mirror member 33 may be a half mirror, hot mirror, or cold mirror. Note that the inclination angle of the mirror member is just an example, and other angles are possible, and it can also be positioned parallel to the display.

[0018] The lens 34 is formed of resin or the like and is held by the frame 31. The lens 34 is disposed closer to the wearer's eye E side than the mirror member 33 so as to face the wearer's eye E when the wearer is wearing it. The lens 34 may be a Fresnel lens having a spherical surface on the side facing the eye E.

[0019] The light source 36 irradiates light to the wearer's eye E. In the present embodiment, the light source 36 can irradiate infrared rays. A plurality of light sources 36 can be arranged around the lens 34. In the present embodiment, it is assumed that six light sources 36 are fixed to the frame 31, but the number may be six or more, or five or less.

[0020] The imaging device 35 can image the wearer's eye E. The imaging device 35 is fixed to the frame 31. The imaging device 35 is located below the lens 34 and can be arranged to image the mirror surface (the surface on the wearer's eye E side) of the mirror member 33. The imaging device 35 photographs the light (infrared rays) irradiated by the light source 36 that is reflected by the eye E (hereinafter referred to as a bright spot). The line-of-sight direction can be determined from the way the bright spot appears. In the present embodiment, it is configured to be fixed to the frame, but the present invention is not limited to this, and it may be configured to be indirectly fixed to the frame or fixed to other members.

[0021] The imaging device 35 includes a first camera (imaging device) 351, a second camera (imaging device) 352, and a third camera (imaging device) 353. Note that the imaging device 35 may be provided with two cameras, or may be provided with four or more cameras. The imaging device 35 only needs to be configured to image each eye with a plurality of cameras. The first camera 351, the second camera 352, and the third camera 353 are all disposed below the lens 34. The first camera 351, the second camera 352, and the third camera 353 image at least one of the pupil P or the iris of the wearer's eye E.

[0022] The first camera 351 is positioned below the optical center of the lens and captures the wearer's eye E as it is reflected in the mirror member 33 from below when the device is worn. The optical axis of the first camera 351 may be positioned to pass through the center of the wearer's eyeball and to be inclined with respect to the normal direction of the mirror member 33. The first camera 351 is positioned in a manner that allows it to capture the eye E so that at least a portion of the wearer's pupil, iris, and cornea is included.

[0023] The second camera 352 is positioned below the lens and to the right of the first camera 351 (in this embodiment, left and right refer to the left and right directions from the wearer toward the display 32). The optical axis of the second camera 352 may be positioned to pass through the center of the wearer's eyeball and to be inclined with respect to the normal direction of the mirror member 33. Alternatively, the second camera 352 may be positioned so that its optical axis opens horizontally with respect to the optical axis of the first camera 351. The second camera 352 images the wearer's eye E from right to left. The second camera 352 images the eye E reflected in the mirror member 33 from the lower right to the upper left, as viewed from the wearer. The third camera 353 images at least a portion of the wearer's pupil, iris, and cornea from the left side.

[0024] The third camera 353 is positioned below the lens and to the left of the first camera 351. The optical axis of the third camera 353 may be positioned to pass through the center of the wearer's eyeball and to be inclined with respect to the normal direction of the mirror member 33. The third camera 353 may be positioned so that its optical axis opens horizontally with respect to the optical axis of the first camera 351. The third camera 353 images the wearer's eye E from left to right. The third camera 353 images the eye E reflected in the mirror member 33 from the lower left to the upper right, as viewed from the wearer. The third camera 353 images at least a portion of the wearer's pupil, iris, and cornea from the left side.

[0025] The first camera 351, the second camera 352, and the third camera 353 each capture images of the wearer's eye E in different imaging directions (different positions and / or angles). The second camera 352 and the third camera 353 may be positioned near the first camera 351. Due to refraction by the lens 34, the second camera 352 and the third camera 353 can capture images of the eye E from angles of 45 degrees or more to the left and right of the imaging direction of the first camera 351.

[0026] The light source 36 emits infrared light. The light from the light source 36 is reflected by the surface of the eyeball (cornea) of the eye E, and the reflected light (corneal reflection image) is reflected by the mirror member 33 and incident on each camera (351, 352, 353).

[0027] Figure 4 shows examples of images captured by the first camera 351, the second camera 352, and the third camera 353. As shown in Figure 4, the image 351i captured by the first camera 351, the image 352i captured by the second camera 352, and the image 353i captured by the third camera 353 are images of the same eye E from different angles. By capturing from different angles, bright spots that could not be captured by one camera may be captured by another camera. In the example in Figure 4, one bright spot in the upper left is not captured in the image 353i captured by the third camera 353. Also, in the image 352i captured by the second camera 352, parts of the two bright spots in the upper row are hidden by the eyelid and are not captured. However, in the image 351i from the first camera 351, all of these bright spots are captured. By arranging multiple cameras in this way, it is possible to compensate for parts that could not be captured by some cameras with other cameras.

[0028] The second camera 352 can be positioned to image a portion of the eye E that the first camera 351 cannot image when the pupil P of the wearer's eye E is located at one end of the eye E. More specifically, it can be positioned to image a portion of the eye E that the first camera 351 cannot image when the wearer's eye E is located at the right end in Figure 1. The second camera 352 can be positioned so that it can image all bright spots reflected by the cornea of ​​the eye E when the pupil P is located in a position where the first camera 351 cannot image all of the bright spots. The third camera 353 can be positioned to image a portion of the eye E that neither the first camera 351 nor the second camera 352 can image when the pupil P of the wearer's eye E is located at the other end of the eye E. The third camera 352 may be positioned such that it can capture all bright spots when the pupil P is located in a position where neither the first camera 351 nor the second camera 352 can capture all bright spots reflected by the cornea of ​​the eye E.

[0029] Referring to Figures 1 and 2, the moving mechanism 4 is a mechanism for moving the display module 3. The moving mechanism 4 moves the display module 3 relative to the housing 2. The moving mechanism 4 may include, for example, a motor (not shown), a shaft 41 attached to the motor, a gear 42 provided on the shaft 41, and a display-side gear 43 attached to the display module 3. Power from the motor rotates the shaft 41, and the display-side gear 43 rotates via the teeth of the gear 42 attached to the shaft 41. The rotation of the display-side gear 43 biases and moves the display module 3. The moving mechanism 4 can move the display module 3 at least in the horizontal direction (left and right direction).

[0030] For example, in the head-mounted display 1 shown in Figure 1, the right display module 3 is moved in the direction of arrow 51 (to the right). The right display module 3 is moved to a position corresponding to the center of the eye located on the right side of Figure 1 (the wearer's right eye), based on the image captured by at least one of the first camera 351, the second camera 352, and the third camera 353. The left display module 3 is then moved in the direction of arrow 52 (to the left). The left display module 3 is also moved to a position corresponding to the center of the eye located on the left side of Figure 1 (the wearer's left eye). As a result, the distance W1 between the left and right display modules can be widened to the distance W2 shown in Figure 2. Note that the distance between the display modules may widen as a result of moving the left and right display modules 3, and the distance between the left and right display modules 3 is not adjusted to match the distance between the wearer's eyes. In other words, the movement mechanism 4 can change the distance between the left and right display modules 3, but in this embodiment, the main focus is not on changing the distance between the left and right display modules 3, but rather on positioning each of the left and right display modules 3 in the optimal position for the wearer's left and right eyes. The optimal position can be the position where the center of the pupil and the center of the lens, etc., coincide, but in this embodiment, it is determined based on the center of the eyeball. The center of the eyeball can be detected by various known methods. The center of the eyeball can also be calculated from the curvature of the surface of the eye. Alternatively, the center of the eyeball can be detected by a sensor. Furthermore, the configuration may be such that the wearer can adjust the position manually or by operating a button or the like.

[0031] Furthermore, the movement mechanism 4 may be configured to move the display module 3 in parallel not only horizontally but also vertically (up and down). The movement mechanism 4 may also be configured to rotate (tilt adjust) the display module 3 around a predetermined axis. Additionally, the movement mechanism 4 can operate independently on the left and right sides, and the direction and / or distance of movement of the left and right display modules 3 may differ. The left and right display modules 3 can be moved independently to align with the wearer's left and right eyes, respectively.

[0032] As the moving mechanism 4 moves the display module 3, the display module 3 is moved together with the imaging device 35.

[0033] The movement mechanism 4 can move the display module 3 so as to align the first camera 351 with the position of the wearer's eye E. The position of the wearer's eye E can be determined by the imaging device 35. The position of the wearer's eye E can be determined based on the image captured by the first camera 351. The position of the wearer's eye E may also be determined based on the image captured by the second camera 352 or the third camera 353, or it may be determined based on the images captured by at least two of the first camera 351, the second camera 352, or the third camera 353. Figure 5 is a diagram illustrating the alignment of the display module 3. As shown in Figure 5, the horizontal position of the first camera 351 (optical axis) can be aligned with the center of the wearer's eye E (center of the eyeball B). The center of the eyeball B can be calculated based on the curvature of the surface of the eye, or it can be detected using known means such as detection by a sensor. Note that the center of the eyeball B refers to a point that does not move even when the eyeball B rotates, and does not necessarily have to be the exact center, but may be the center of the curved surface calculated from the surface curvature of the eyeball B, or the center of curvature. Also, the first camera 351 does not need to be perfectly aligned with the center of the eyeball B, and may be positioned at a predetermined position within a predetermined distance from the center based on the detected center. When aligning with the pupil P, the alignment must be performed with the wearer facing directly forward, and if the wearer moves their gaze, for example, it will not be possible to align to the optimal position. For example, Figure 5 shows an example where the wearer is looking slightly to the left of Figure 5 rather than directly forward, and the pupil P is located to the left of the frontal position in Figure 5. In this case, the horizontal position of the center of the eyeball B (dotted line BC) and the horizontal position of the center of the pupil P (dotted line PC) will be misaligned, and if the first camera 351 is aligned with the horizontal position of the center of the pupil P, the display module 3 will be moved to the left in Figure 5. However, by aligning the first camera 351 with the center of the eyeball B, it becomes possible to position it in the same horizontal position as when the wearer is facing forward.Therefore, by aligning the display module 3 with the center of the eyeball B as the reference point, the optimal position can be achieved even if the wearer's gaze moves (the eyeball B rotates). Furthermore, since the human face is asymmetrical, by independently aligning the left and right display modules 3 to the horizontal position of the center of the wearer's left and right eyeballs B, the optimal position can be achieved for each of the left and right eyes.

[0034] The control unit is connected to the display module 3 and the moving mechanism 4.

[0035] The control unit controls the first camera 351, the second camera 352, and the third camera 353 to image the eye E (cornea). The control unit can, for example, cause the imaging device 35 to perform an imaging operation simultaneously with or at a predetermined timing after the light source 36 is turned on.

[0036] The control unit can cause the first camera 351, the second camera 352, and the third camera 353 to perform imaging operations simultaneously (at the same timing). The control unit can control the first camera 351, the second camera 352, and the third camera 353 to perform exposure operations substantially simultaneously. Substantially simultaneous means that the exposure periods of the first camera 351, the second camera 352, and the third camera 353 overlap for a certain period of time or longer; strict simultaneity is not required. Substantially simultaneous operation can be considered achieved if the difference in exposure start timing of each imaging device is within a few milliseconds.

[0037] The control unit can determine the wearer's line of sight direction based on the images captured by the first camera 351, the second camera 352, and the third camera 353. The control unit detects the pupil center position of eye E and the position of the corneal reflection image on the corneal surface from the images captured by each camera. Based on the three-dimensional geometric relationship between the offset vector of the pupil center position relative to the corneal reflection image obtained from the image captured by the first camera 351 and the offset vector of the pupil center position relative to the corneal reflection image obtained from the images captured by the second camera 352 and the third camera 353, the control unit can determine the wearer's eye rotation angle.

[0038] The control unit may move the display module 3 by controlling the movement mechanism 4 to align the display module 3 with the position of the wearer's eye E. The control unit can detect the position of the wearer's eye E based on the images captured by the first camera 351, the second camera 352, and the third camera 353, and control the position and / or orientation of the display module 3 to appropriately align its position with the position of the eye E. The control unit can move the display module 3 by controlling the movement mechanism 4 so that the first camera 351 of the display module 3 is positioned directly below the wearer's eye E (so that the horizontal position of the first camera 351 is aligned with the center of the eye E (eyeball B) when the wearer is facing forward). The control unit may also move the display module 3 so that, for example, the optical center (optical axis, etc.) of the lens 34 coincides with the center of the eye E (eyeball B) in the horizontal direction.

[0039] The control unit can perform calibration based on the characteristic points of the eyeball detected by the first camera 351 (such as the pupil center and the centroid of the corneal reflection image). For example, the control unit can use the characteristic points in the image from the first camera 351 when the wearer is fixating on a predetermined indicator as the reference position, and if the characteristic points in the image from the first imaging device 351 deviate from the reference position during wear, it can use the images from the second imaging device 352 and the third imaging device 353 to correct the line of sight direction.

[0040] Although these embodiments have been described above, they are intended to facilitate understanding of the present invention and are not intended to limit its interpretation. The present invention can be modified and improved without departing from its spirit, and equivalents thereof are also included.

[0041] <Example 1> Although the above embodiment shows an example using three cameras, the present invention is not limited thereto, and four or more cameras may be used. For example, by adding a fourth camera at a position symmetrical with respect to the left-right direction, and arranging these four cameras in a cross shape around the wearer's eyes, it becomes possible to accurately detect eye movements in both the horizontal and vertical directions. Furthermore, by arranging six or more cameras radially around the eyes and imaging the eyeball from multiple directions, it becomes possible to estimate the shape of the eyeball more accurately and calculate a more natural gaze direction.

[0042] <Modification 2> Furthermore, although the above embodiment shows an example using a light source that emits infrared light, visible light may also be used. When using visible light, it can be combined with iris recognition. Alternatively, a light source that switches between emitting infrared light and visible light may be used.

[0043] <Variation 3> Furthermore, in the above embodiment, a see-through display that allows the wearer's surroundings to be seen may be used instead of the display 32.

[0044] <Modification 4> When intended for use by multiple people, it is desirable to be able to individually adjust the position and orientation of the camera and light source to match the eye position of each wearer. For example, the imaging device 35 and light source 36 may be configured to be movable or rotatable around the eyes. Furthermore, by performing gaze detection calibration for each wearer and storing the calibration data for each wearer, it becomes possible to quickly resume gaze detection even when the wearer changes.

[0045] To address situations where multiple users share the eye-tracking device, the camera position may be automatically adjusted to match the position of each user's eyes. For example, a user identification means can be provided. As a user identification means, biometric authentication technologies such as facial recognition, iris recognition, or voice recognition can be used. When a user is positioned in front of the display, the user can be identified by the user identification means. A user information storage unit can also be provided to store characteristic points of the eyeball (such as the center of the pupil or the centroid of the corneal reflection image) for each user. The control unit can read the characteristic points corresponding to the identified user from the user information storage unit and control the movement mechanism 4 to move the display module 3 by aligning the optical axis of the first camera 351 and the optical axis of the lens 34 with the read characteristic points.

[0046] <Modification 5> Although the above embodiment shows an example of applying the present invention to a head-mounted display, the present invention is not limited thereto. The present invention can be applied to various devices where eye-tracking input is useful, such as in-vehicle displays, digital signage, gaming devices, and medical devices.

[0047] <Disclosure Items> Furthermore, this disclosure also includes the following configurations. [Item 1] A first imaging device that images at least a portion of one of the wearer's eyes, A second imaging device that images at least a portion of the wearer's eye from a different direction than the first imaging device, A control unit that determines the direction of the wearer's gaze based on a first image captured by the first imaging device and a second image captured by the second imaging device, A gaze detection device characterized by comprising the following features. [Item 2] The gaze detection device described in item 1, The first imaging device and the second imaging device capture images of at least one of the wearer's pupil or iris at the same time. A gaze detection device characterized by the following. [Item 3] The gaze detection device described in item 1, The second imaging device images at least one of the pupil or iris of the eye from the right or left side in the direction in which the first imaging device images at least one of the pupil or iris of the eye. A gaze detection device characterized by the following. [Item 4] The gaze detection device described in item 1, The system includes multiple light sources that irradiate the wearer's cornea with light, The second imaging device is positioned such that it can image all of the bright spots reflected by the cornea when the wearer's pupil is positioned in a location where the first imaging device cannot image all of the bright spots reflected by the cornea. A gaze detection device characterized by the following. [Item 5] The gaze detection device described in item 4, The system includes a third imaging device that images at least a portion of the wearer's eye from a different direction than the first and second imaging devices, The control unit determines the wearer's line of sight direction based on at least two of the first image captured by the first imaging device, the second image captured by the second imaging device, or the third image captured by the third imaging device. A gaze detection device characterized by the following. [Item 6] The gaze detection device described in item 5, The third imaging device images at least one of the pupil or iris of the eye from the left or right side in the direction in which the first imaging device images at least one of the pupil or iris of the eye. A gaze detection device characterized by the following. [Item 7] The gaze detection device described in item 5, The third imaging device is positioned such that it can image all of the bright spots reflected by the cornea when the wearer's pupil is positioned in a location where neither the first imaging device nor the second imaging device can image all of the bright spots reflected by the cornea. A gaze detection device characterized by the following. [Item 8] The gaze detection device described in item 5, The first imaging device, the second imaging device, and the third imaging device simultaneously image at least one of the wearer's pupil or iris. A gaze detection device characterized by the following. [Item 9] The gaze detection device described in item 5, The display and The system includes a mirror member that transmits light from the display and reflects light from the eye, The first imaging device, the second imaging device, and the third imaging device capture the image of the eye reflected by the mirror member. A gaze detection device characterized by the following. [Item 10] The gaze detection device described in item 9, The display and the mirror member are provided with a moving mechanism to move the first imaging device, the second imaging device and the third imaging device. A gaze detection device characterized by the following. [Item 11] The eye-tracking device described in item 1, The display that faces the wearer's eyes when worn A head-mounted display equipped with [features / equipment]. [Item 12] The first imaging device images at least a portion of one of the wearer's eyes, The second imaging device images at least a portion of the wearer's eye from a different direction than the first imaging device, The control unit determines the wearer's line of sight based on the first image captured by the first imaging device and the second image captured by the second imaging device. A gaze detection method characterized by the following. [Explanation of Symbols]

[0048] 1. Head-mounted display 2 cabinets 3 Display Modules 4 Moving mechanism 5. Control Unit 31 frames 32 displays 33 Mirror component 34 lenses 35 Imaging device 36 Light source

Claims

1. A first imaging device that images at least a portion of one of the wearer's eyes, A second imaging device that images at least a portion of the wearer's eye from a different direction than the first imaging device, A control unit that determines the direction of the wearer's gaze based on a first image captured by the first imaging device and a second image captured by the second imaging device, A gaze detection device characterized by comprising the following features.

2. A gaze detection device according to claim 1, The first imaging device and the second imaging device capture images of at least one of the wearer's pupil or iris at the same time. A gaze detection device characterized by the following.

3. A gaze detection device according to claim 1, The second imaging device images at least one of the pupil or iris of the eye from the right or left side in the direction in which the first imaging device images at least one of the pupil or iris of the eye. A gaze detection device characterized by the following.

4. A gaze detection device according to claim 1, The system includes multiple light sources that irradiate the wearer's cornea with light, The second imaging device is positioned such that it can image all of the bright spots reflected by the cornea when the wearer's pupil is positioned in a location where the first imaging device cannot image all of the bright spots reflected by the cornea. A gaze detection device characterized by the following.

5. A gaze detection device according to claim 4, The system includes a third imaging device that images at least a portion of the wearer's eye from a different direction than the first and second imaging devices, The control unit determines the wearer's line of sight direction based on at least two of the first image captured by the first imaging device, the second image captured by the second imaging device, or the third image captured by the third imaging device. A gaze detection device characterized by the following.

6. A gaze detection device according to claim 5, The third imaging device images at least one of the pupil or iris of the eye from the left or right side in the direction in which the first imaging device images at least one of the pupil or iris of the eye. A gaze detection device characterized by the following.

7. A gaze detection device according to claim 5, The third imaging device is positioned such that it can image all of the bright spots reflected by the cornea when the wearer's pupil is positioned in a location where neither the first imaging device nor the second imaging device can image all of the bright spots reflected by the cornea. A gaze detection device characterized by the following.

8. A gaze detection device according to claim 5, The first imaging device, the second imaging device, and the third imaging device capture images of at least one of the wearer's pupil or iris at the same time. A gaze detection device characterized by the following.

9. A gaze detection device according to claim 5, The display and The system includes a mirror member that transmits light from the display and reflects light from the eye, The first imaging device, the second imaging device, and the third imaging device capture the image of the eye reflected by the mirror member. A gaze detection device characterized by the following.

10. A gaze detection device according to claim 9, The display and the mirror member are provided with a moving mechanism to move the first imaging device, the second imaging device and the third imaging device. A gaze detection device characterized by the following.

11. The gaze detection device according to claim 1, The display that faces the wearer's eyes when worn A head-mounted display equipped with [features / equipment].

12. The first imaging device images at least a portion of one of the wearer's eyes, The second imaging device images at least a portion of the wearer's eye from a different direction than the first imaging device, The control unit determines the wearer's line of sight based on the first image captured by the first imaging device and the second image captured by the second imaging device. A gaze detection method characterized by the following.

Images