Line-of-sight detection device

Abstract

To provide a line-of-sight detection device capable of detecting a line of sight with high accuracy, while preventing increase in size.SOLUTION: A line-of-sight detection device has: a display device; an optical system for delivering first light of an image displayed by the display device to a user's eye along an optical axis; a first lighting device having a first light-emitting unit for applying second light to the user's eye; a first light shielding member having a first opening that limits an irradiation range of the second light irradiated from the first light-emitting unit onto the user's eye; and an imaging device for capturing an image of the user's eye on the basis of the second light reflected in the user's eye. A distance from a position of the first light-emitting unit to the optical axis is longer than a distance from a first intersection point between a plane orthogonal to the optical axis and passing through the position of the first light-emitting unit and a central axis of the first opening, to the optical axis.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to a gaze detection device. [Background technology]

[0002] In fields such as VR and AR, head-mounted displays that use the detected user's gaze point (the position of gaze) to realize functions such as menu selection have been put to practical use. Also, in fields such as cameras, products that select a focusing point based on the detected gaze direction have been put to practical use.

[0003] In gaze detection, the gaze sensor captures an image of the user's eyeball to detect the user's gaze point. At this time, lighting arranged around the eyepiece optical system irradiates the user's eyeball with light. Because the irradiated light is specularly reflected from the surface of the cornea, a corneal reflection image is captured in the image captured by the gaze sensor. The gaze sensor detects the coordinates of the corneal reflection image in the image. If aberration occurs in the corneal reflection image, an error will occur in the detection of the brightness center coordinate of the corneal reflection image, reducing the accuracy of gaze detection.

[0004] Countermeasures for correcting this aberration have been studied for some time. Patent Document 1 describes an example in which a prism for correcting the aberration is placed in front of the line-of-sight sensor. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Publication No. 8-234136 Summary of the Invention [Problem to be solved by the invention]

[0006] However, the technology described in Patent Document 1 requires a prism, which increases the size of the gaze detection device.

[0007] SUMMARY OF THE INVENTION It is therefore an object of the present invention to provide a gaze detection device that is capable of detecting the gaze with high accuracy while preventing an increase in size. [Means for solving the problem]

[0008] One aspect of the present invention is a method for producing a medicament for the treatment of a pulmonary arthritis. a display device; an optical system that delivers a first light of an image displayed by the display device to a user's eye along an optical axis; a first lighting device having a first light-emitting unit that irradiates the eye of the user with second light; a first light-blocking member having a first opening that limits an irradiation range of the second light irradiated from the first light-emitting unit to the eye of the user; an imaging device that captures an image of the user's eye based on the second light reflected by the user's eye; and a distance from the position of the first light-emitting unit to the optical axis is longer than a distance from a first intersection point between a plane that is perpendicular to the optical axis and that passes through the position of the first light-emitting unit and a central axis of the first opening to the optical axis; The gaze detection device is characterized by the above. [Effects of the Invention]

[0009] According to the present invention, it is possible to provide a gaze detection device that can detect the gaze with high accuracy while preventing an increase in size. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a central vertical cross-sectional view of a camera body according to a first embodiment. [Figure 2] FIG. 2 is a diagram illustrating a configuration related to the gaze sensor unit according to the first embodiment. [Figure 3] FIG. 1 is a diagram illustrating an EVF unit according to a first embodiment. [Figure 4] FIG. 2 is a diagram illustrating an apparatus as a comparative example of the first embodiment. [Figure 5] FIG. 2 is a diagram illustrating an apparatus as a comparative example of the first embodiment. [Figure 6] FIG. 2 is a diagram illustrating the positional relationship of components in the camera body according to the first embodiment. [Figure 7] FIG. 10 is a diagram showing the positional relationship of components in a camera body according to a second embodiment. [Figure 8] FIG. 10 is a diagram showing the positional relationship of components in a camera body according to a second embodiment. [Figure 9] FIG. 10 is a diagram showing the positional relationship of components in a camera body according to a third embodiment. [Figure 10] FIG. 10 is a diagram showing the positional relationship of components in a camera body according to a third embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] <Embodiment 1> An imaging device (gaze detection device) having a camera body 1 according to embodiment 1 will be described in detail. Here, when the camera body 1 is in the most basic standard position (so-called normal position), the optical axis of the optical system of the imaging optical system (not shown) is defined as the "Z axis," and the direction opposite to the vertical of the Z axis is defined as the "Y axis." The right-handed axis perpendicular to the Y axis and Z axis is defined as the "X axis."

[0012] 1 is a schematic diagram (so-called central vertical cross-sectional view) of a camera body 1 cut along a plane parallel to the Y-axis and Z-axis. The camera body 1 has a shutter 2, an image sensor 3, a rear monitor 4, an EVF (Electronic Viewfinder) unit 5, and a CPU 9.

[0013] The shutter 2 and the imaging sensor 3 are aligned in the Z-axis direction (the optical axis direction of the imaging optical system).

[0014] The rear monitor 4 is provided on the rear of the camera body 1. The rear monitor 4 displays menus and images to enable viewing and editing of images captured by the camera body 1. The rear monitor 4 has a backlit LCD panel or organic EL panel.

[0015] The EVF unit 5 includes a display unit 7, a display optical system 6, and an eye-gaze sensor unit 8. The EVF unit 5 is built into or attached to the camera body 1 so that a user using the camera body 1 can view the display surface of the display unit 7.

[0016] The display unit (display device) 7 is an EVF panel (such as a backlit organic EL panel or liquid crystal display panel) having an information display surface. In the first embodiment, the display surface of the display unit 7 faces in the negative direction of the Z axis.

[0017] The display optical system 6 is arranged in front of the display surface of the display unit 7. The display optical system 6 has one or more lenses arranged along an optical axis 11 of the display optical system 6 that extends in the negative Z-axis direction. The display optical system 6 delivers light (visible light) of an image displayed by the display unit (display device) 7 to the user's eyes along the optical axis 11. Each lens in the display optical system 6 is made of optical glass or transparent optical plastic. Each lens is manufactured by using "cutting and grinding" or "molding."

[0018] In the first embodiment, the display optical system 6 includes three optical lenses that transmit visible light, namely, a G1 lens and a The display optical system 6 has three lenses: G1 lens 12, G2 lens 13, and G3 lens 14. However, the number of lenses included in the display optical system 6 is not limited to three, and may be any number such as four or five. Therefore, the display optical system 6 can have an appropriate number of lenses to realize an enlarged display of the image displayed on the display unit 7.

[0019] The gaze sensor unit 8 is an eyeball imaging section (imaging device) that forms an image of the user's eyeball 10 looking into the EVF unit 5 on the gaze sensor chip 15. The gaze sensor unit 8 captures an image of the eyeball 10 (user's eye) by capturing an image of the infrared light reflected by the eyeball 10. In the gaze sensor unit 8, the gaze sensor lens 17 and the gaze sensor chip 15 are arranged on the optical axis 17a of the gaze sensor lens 17 inside the gaze sensor housing 16. The gaze sensor unit 8 is a compact camera on a module packaged in the gaze sensor housing 16. However, each component of the gaze sensor unit 8 does not need to be packaged.

[0020] The gaze sensor lens 17 is an optical system (optical lens) required to form an image of the eyeball 10 on the gaze sensor chip 15. For convenience, the gaze sensor lens 17 is represented by a single lens in FIG. 1, but the gaze sensor lens 17 may be configured using multiple lenses.

[0021] The gaze sensor chip 15 is an image sensor (eyeball imaging sensor) that performs A / D conversion (analog-to-digital conversion) of an image containing infrared components of the eyeball 10 and inputs the result to the CPU 9. The gaze sensor chip 15 uses a CMOS imaging sensor or a CCD matrix sensor.

[0022] The CPU 9 is a control unit that controls each component of the camera body 1. The CPU 9 performs input and output processing of various necessary information for the EVF unit 5, the display optical system 6, the shutter 2, and the rear monitor 4, just like a typical camera.

[0023] The configuration relating to the line-of-sight sensor unit 8 of the EVF unit 5 will be described in detail with reference to FIGS.

[0024] Fig. 2 is a schematic diagram showing the components related to the gaze sensor unit 8, with the EVF unit 5 extracted from the cross-sectional view of the camera body 1 shown in Fig. 1. Fig. 3 is a schematic diagram showing the EVF unit 5 as seen from the user's eyeball 10 side (i.e., the positive Z-axis direction).

[0025] When a user looks into the display screen of the display section 7 of the EVF unit 5, the user's eyeball 10 is positioned on the optical axis 11 near the G3 lens 14, as shown in Fig. 2. The eyeball 10 has an upper eyelid 18 and a lower eyelid 19. The cornea 20 is exposed between the two eyelids.

[0026] A plurality of illuminators 24 are arranged around the G3 lens 14. As shown in FIG. 3, the plurality of illuminators 24 are a plurality of illumination elements (illumination devices) such as IREDs (Infrared-Emitting Diodes) 25 to 34. The illuminator 24 includes a light-emitting unit 37, which is an IRED chip. The light-emitting unit 37 emits infrared light (infrared light) as illumination light to illuminate the eyeball 10. In the first embodiment, when the light-emitting unit 37 irradiates the eyeball 10 with illumination light, the illumination light is specularly reflected by the surface of the cornea 20. Then, a specular reflection image of the light-emitting unit 37 is captured by the gaze sensor chip 15, and the position of the luminance center of gravity of the captured specular reflection image is used for gaze detection calculation.

[0027] The infrared-transmitting cover 21 is made of a resin that absorbs visible light and transmits infrared light. The infrared-transmitting cover 21 is formed in a rectangular frame shape as shown in FIG. 3 and surrounds the periphery of the G3 lens 14. The infrared-transmitting cover 21 is a window that covers the lighting 24 so that it cannot be seen from the outside. The infrared-transmitting cover 21 is provided with an opening 22 (opening 22 for a user to view the display unit 7) that passes the effective luminous flux of visible light from the G3 lens 14. The opening 22 is not limited to a physical opening, and may be configured to transmit visible light. For example, the infrared-transmitting cover 21 may be formed by applying infrared-transmitting paint to the G3 lens 14. Furthermore, a portion of the G3 lens 14 that is not painted with infrared-transmitting paint may be provided, and this portion may be treated as the opening 22.

[0028] A light-shielding member 35 made of a material (resin or metal) that does not transmit infrared light is disposed between the lighting 24 and the infrared-transmitting cover 21. The light-shielding member 35 forms a substantially circular opening 36. The opening 36 regulates (limits) the luminous flux of light emitted from the light-emitting unit 37.

[0029] A proximity sensor 23 for detecting the proximity of the eyeball 10 is disposed around the G3 lens 14. The proximity sensor 23 is a unit having an infrared light emitting unit and an infrared light receiving unit. The proximity sensor 23 measures the distance between the G3 lens 14 and the eyeball 10, for example, using the reflection angle, time difference, and frequency of the infrared light emitted by the infrared light emitting unit. Information on the distance measured by the proximity sensor 23 (distance information) is sent to the CPU 9. The CPU 9 uses the distance information, for example, to control the lighting of the display unit 7 or the lighting 24. The proximity sensor 23 is hidden by the infrared-transparent cover 21 so that it cannot be seen by the user.

[0030] Optical axis 11 and optical axis 17a of gaze sensor lens 17 are not parallel but form an angle T510. Specifically, when camera body 1 is in the normal position, gaze sensor unit 8 is located on the negative Y-axis side of EVF unit 5. Furthermore, optical axis 17a of gaze sensor lens 17 faces in the positive Y-axis direction in the YZ plane, relative to optical axis 11 which extends in the Z-axis direction.

[0031] Ten IREDs (illuminators 24) are arranged around the periphery of the G3 lens 14. As shown in FIG. 3, IRED25, IRED26, IRED27, IRED28, IRED29, IRED30, IRED31, IRED32, IRED33, and IRED34 are arranged in clockwise order around the optical axis 11.

[0032] (Problems with the gaze detection device of the comparative example) Here, problems that arise in the gaze detection device of the comparative example will be described with reference to FIGS. 4A, 4B, 5A, and 5B.

[0033] First, we will explain the "aberration" that is dealt with in the first embodiment. The specularly reflected image of the light-emitting unit 37 that is projected onto the gaze sensor chip 15 may not be focused at a single point, but may instead be elongated in a specific direction. This image deviation is called "aberration." This aberration occurs when the axial symmetry of the gaze sensor lens 17 is lost, and is caused by factors such as non-uniformity in the lens material and insufficient precision in processing and assembly. If the aberration is large and the elongation of the image becomes significant, the position of the center of gravity of the image's luminance shifts, resulting in a deterioration in gaze detection accuracy.

[0034] Therefore, in the first embodiment, the opening 36 is provided to restrict the beam of light (luminous flux) emitted from the light-emitting unit 37, thereby reducing the elongation of the image. With this configuration, it is possible to reduce the influence of aberration-induced movement of the luminance center of gravity of the specular reflection image of the light-emitting unit 37 reflected on the gaze sensor chip 15. As a result, it is possible to suppress deterioration in gaze detection accuracy. The positional relationship between the opening 36 and the light-emitting unit 37 will be described in detail later.

[0035] 4A and 4B are both schematic diagrams showing the eye of a user looking at an optical image on the display surface of the display unit 7 and a comparative example of a gaze detection device. In both FIGS. 4A and 4B, the positional relationship between the components constituting the gaze detection device is the same, but the positional relationship between the gaze detection device and the eyeball is different. FIG. 4A shows an example in which the distance between the G3 lens 14 and the cornea 20 in the direction of the optical axis 11 (hereinafter referred to as the "corneal distance") is long. FIG. 4B shows an example in which the corneal distance is short.

[0036] In FIG. 4A, the entire area of ​​the cornea 20 is included in the illumination range 38 of the light emitted from the light-emitting unit 37 and passing through the opening 36. In other words, the light emitted from the light-emitting unit 37 can illuminate the entire area of ​​the cornea 20. With this configuration, an optical path along which the light emitted from the light-emitting unit 37 is specularly reflected from the surface of the cornea 20 and received by the gaze sensor chip 15 can be secured, and a specularly reflected image of the light-emitting unit 37 can be acquired. This allows for accurate gaze detection.

[0037] 4B, a portion of the cornea 20 is not included in the illumination range 38 of the light emitted from the light-emitting unit 37 and passing through the opening 36. In other words, the light emitted from the light-emitting unit 37 cannot illuminate a portion of the cornea 20. In this configuration, an optical path along which the light emitted from the light-emitting unit 37 is specularly reflected from the surface of the cornea 20 and received by the gaze sensor chip 15 cannot be secured, and a specularly reflected image of the light-emitting unit 37 cannot be obtained. Therefore, accurate gaze detection cannot be achieved.

[0038] For this reason, in the past, when the eye of a user looking at the optical image on the display surface of the display unit 7 moved to a certain extent, the light emitted from the light-emitting unit 37 could not illuminate the entire area of ​​the cornea 20.

[0039] In contrast, in FIG. 5A, the illuminator 24 and the light-shielding member 35 are moved in the positive Y-axis direction and the negative Z-axis direction compared to the arrangement shown in FIG. 4B. The angle formed between the light from the illuminator 24 and the optical axis 11 is also increased. This changes the illumination range 38, allowing the light emitted from the light-emitting unit 37 to illuminate the entire area of ​​the cornea 20 even if the cornea distance is short. This configuration makes it easy to ensure an optical path along which the light emitted from the light-emitting unit 37 is specularly reflected by the surface of the cornea 20 and received by the gaze sensor chip 15. This makes it easier to acquire a specularly reflected image of the light-emitting unit 37, ensuring robust gaze detection.

[0040] Figure 5A shows a schematic diagram when the corneal distance is short, while Figure 5B shows a schematic diagram when the corneal distance is long. In both Figures 5A and 5B, the positional relationship of the components constituting the gaze detection device is the same, but the positional relationship between the gaze detection device and the eyeball is different. With this configuration, even if the corneal distance is long, the light emitted from the light-emitting unit 37 can illuminate the entire area of ​​the cornea 20.

[0041] 5A and 5B, even if the eyeball of a user looking at the optical image on the display surface of the display unit 7 moves to some extent, the light emitted from the light-emitting unit 37 can illuminate the entire area of ​​the cornea 20. However, with such a configuration, components such as the illumination 24 and the light-shielding member 35 are close to the eyeball. In this case, even if the user tries to bring the eyeball closer to the display optical system 6, the face may come into contact with components such as the light-shielding member 35 and the infrared-transmitting cover 21, making it impossible to bring the eyeball closer to the display optical system 6.

[0042] (Regarding the camera body according to the first embodiment) 6A and 6B, the positional relationship between light-emitting unit 37 and opening 36 in camera body 1, which is the gaze detection device according to embodiment 1, will be described.

[0043] Fig. 6A shows the configuration of the camera body 1 according to embodiment 1. Fig. 6B shows in detail the positional relationship between the light emitting section 37 and the opening 36.

[0044] In the first embodiment, the "centroid position of the light-emitting area of ​​the light-emitting unit 37" is referred to as the "position of the light-emitting unit 37." In the first embodiment, the luminance centroid position of the specular reflection image of the light-emitting unit 37 received by the gaze sensor chip 15 is used for gaze detection calculation. For this reason, the centroid position of the light-emitting area is used as the representative position.

[0045] In the first embodiment, as shown in FIG. 6B , the "straight line that passes through the center of gravity of the opening shape of opening 36 and is perpendicular to the opening shape" is referred to as the "central axis 41 of the opening." Additionally, the "plane that is perpendicular to optical axis 11 and passes through the position of light-emitting unit 37" is referred to as the "plane 39." The "point where plane 39 and central axis 41 of the opening intersect" is referred to as the "intersection point 40." In this case, the distance L2 from the position of light-emitting unit 37 to optical axis 11 is longer than the distance L1 from intersection point 40 to optical axis 11.

[0046] 6A and 6B, compared to FIGS. 5A and 5B, the illumination 24 and the light-shielding member 35 can be positioned without facing in the negative Y-axis direction. Therefore, the light emitted from the light-emitting unit 37 can illuminate the entire area of ​​the cornea 20 without components such as the illumination 24 and the light-shielding member 35 protruding toward the user's eyeball. Because components such as the illumination 24 and the light-shielding member 35 do not protrude toward the user's eyeball, the user can bring their eyeball closer to the display optical system 6. Therefore, the influence of aberration of the corneal reflection image can be reduced without increasing the size of the gaze detection device (camera body 1), and the accuracy of gaze detection can also be ensured.

[0047] <Embodiment 2> The following describes the configuration of the camera body 1 when two lights 24 and two light blocking members 35 are provided. Note that a description of the same configuration as in the first embodiment will be omitted.

[0048] FIG. 7A shows an example in which two illuminators 24 and two light blocking members 35 are arranged, and the corneal distance (the distance in the direction of the optical axis 11 between the G3 lens 14 and the cornea 20) is short.

[0049] Of the two illuminators 24, the one with the longer distance between the position of the light-emitting unit 37 and the optical axis 11 is referred to as the "first illuminator 24a," and the one with the shorter distance between the position of the light-emitting unit 37 and the optical axis 11 is referred to as the "second illuminator 24b." The light-emitting unit 37 provided inside the first illuminator 24a is referred to as the "first light-emitting unit 37a." The light-emitting unit 37 provided inside the second illuminator 24b is referred to as the "second light-emitting unit 37b." Of the two light-shielding members 35, the one with the longer distance from the gaze sensor unit 8 is referred to as the "first light-shielding member 35a," and the one with the shorter distance from the gaze sensor unit 8 is referred to as the "second light-shielding member 35b." The opening 36 provided in the first light-shielding member 35a is referred to as the "first opening 36a." The opening 36 provided in the second light-shielding member 35b is referred to as the "second opening 36b." Moreover, the illumination area 38 of the light emitted from the first light-emitting element 37a is called the "first illumination area 38a," and the illumination area 38 of the light emitted from the second light-emitting element 37b is called the "second illumination area 38b."

[0050] FIG. 7B shows in detail the positional relationship between the first light-emitting portion 37a and the first opening 36a and the positional relationship between the second light-emitting portion 37b and the second opening 36b. The line passing through the center of gravity of the opening shape of the first opening 36a and perpendicular to the opening shape is referred to as the central axis 41a of the first opening. The line passing through the center of gravity of the opening shape of the second opening 36b and perpendicular to the opening shape is referred to as the central axis 41b of the second opening. Furthermore, the plane perpendicular to the optical axis 11 and passing through the first light-emitting portion 37a is referred to as the first plane 39a. The plane perpendicular to the optical axis 11 and passing through the second light-emitting portion 37b is referred to as the second plane 39b. The point at which the first plane 39a and the central axis 41a of the first opening intersect is referred to as the first intersection 40a. The "point where the second plane 39b and the central axis 41b of the second opening intersect" is called the "second intersection 40b." Also, the "distance from the position of the first light-emitting portion 37a to the first intersection 40a" is called the "distance L3a." The distance from the position of the second light-emitting portion 37b to the second intersection 40b is called "distance L3b."

[0051] In this case, as shown in FIG. 7B, in a configuration in which the distance from the optical axis 11 to the position of the first light-emitting unit 37a is longer than the distance from the optical axis 11 to the position of the second light-emitting unit 37b, the distance L3a is longer than the distance L3b.

[0052] The effect of adopting such a configuration will be explained using Figures 8A to 8C. Figures 8A to 8C all show schematic diagrams in which an eyeball with a long corneal distance and an eyeball with a short corneal distance are overlapped. In addition, the optical paths of light emitted from first illuminator 24a or second illuminator 24b, specularly reflected by the surface of cornea 20, and traveling toward gaze sensor chip 15 are overlapped.

[0053] 8A shows a configuration example in which distance L3a and distance L3b are equal and relatively long. In this example, when the corneal distance is long, the light emitted from second light-emitting unit 37b is blocked by second light-shielding member 35b, and therefore a specular reflection image of second light-emitting unit 37b cannot be acquired.

[0054] 8B shows a configuration example in which distance L3a and distance L3b are equal and relatively short. In this example, when the corneal distance is short, the light emitted from first light-emitting element 37a is blocked by first light-shielding member 35a, and therefore a specular reflection image of first light-emitting element 37a cannot be acquired.

[0055] 8C shows an example of a configuration in which distance L3a is longer than distance L3b. Fig. 8C is a diagram illustrating a configuration according to embodiment 1. With such a configuration, whether the corneal distance is short or long, specular reflection images of both the first light-emitting unit 37a and the second light-emitting unit 37b can be acquired, ensuring robustness of gaze detection.

[0056] 8C, robustness of gaze detection can be ensured without having to protrude components such as the illuminators 24 and the light blocking members 35 toward the user's eyeballs. This makes it possible to provide a camera body 1 that can reduce the effects of aberration in the corneal reflection image without increasing the size of the device.

[0057] As described above, the optimal distance from the position of the light-emitting unit 37 to the intersection 40 in each illuminator 24 depends on the distance between the optical axis 11 and the position of the light-emitting unit 37. Explaining this with reference to FIG. 3 , it is desirable to set the distance from the position of the light-emitting unit 37 to the intersection 40 short for IRED25, IRED29, IRED30, and IRED34, which are particularly close to the optical axis 11. On the other hand, it is desirable to set the distance from the position of the light-emitting unit 37 to the intersection 40 long for IRED26, IRED27, IRED32, and IRED33, which are particularly long from the optical axis 11.

[0058] <Embodiment 3> In the second embodiment, the positional relationship between the light-emitting unit 37 and the light-blocking member 35 is adjusted according to the distance between the optical axis 11 and the light-emitting unit 37. In the third embodiment, an example will be described in which the positional relationship between the light-emitting unit 37 and the light-blocking member 35 is adjusted according to the distance between the line-of-sight sensor unit 8 and the light-emitting unit 37.

[0059] 9A shows an example in which two illuminators 24 and two light blocking members 35 are arranged in the third embodiment, and shows an example in which the corneal distance (the distance in the direction of the optical axis 11 between the G3 lens 14 and the cornea 20) is short. Of the two illuminators 24, the one with the longer distance between the position of the light-emitting unit 37 and the gaze sensor unit 8 is called the "first illuminator 24a," and the one with the shorter distance between the position of the light-emitting unit 37 and the gaze sensor unit 8 is called the "second illuminator 24b."

[0060] At this time, as shown in FIG. 9B, the line-of-sight sensor unit 8 In a configuration in which the "distance to the position" is longer than the "distance from the line-of-sight sensor unit 8 to the position of the second light-emitting unit 37b," distance L3a is longer than distance L3b.

[0061] The effect of such a configuration will be described with reference to Figures 10A to 10C. Figures 10A to 10C all show schematic diagrams in which an eyeball with a long corneal distance and an eyeball with a short corneal distance are overlapped. In addition, the optical paths of light (infrared light) emitted from first illuminator 24a or second illuminator 24b, specularly reflected by the surface of cornea 20, and proceeding toward gaze sensor chip 15 are overlapped.

[0062] 10A shows a configuration example in which distance L3a and distance L3b are set to be equal and relatively long. In this example, when the corneal distance is long, the light emitted from second light-emitting unit 37b is blocked by second light-shielding member 35b, and therefore a specular reflection image of second light-emitting unit 37b cannot be acquired.

[0063] 10B shows a configuration example in which distance L3a and distance L3b are set to be equal and relatively short. In this example, when the corneal distance is short, the light emitted from first light-emitting element 37a is blocked by first light-shielding member 35a, and therefore a specular reflection image of first light-emitting element 37a cannot be obtained.

[0064] In contrast, Fig. 10C shows an example configuration in which distance L3a is longer than distance L3b. Fig. 10C is a diagram illustrating a configuration according to embodiment 3. With this configuration, whether the corneal distance is short or long, specular reflection images of both the first light-emitting unit 37a and the second light-emitting unit 37b can be acquired, ensuring robustness of gaze detection.

[0065] 10C ensures robustness of gaze detection without requiring components such as the illuminators 24 and the light blocking members 35 to protrude in the direction of the user's eyeballs. This makes it possible to provide a gaze detection device (camera body 1) that can reduce the influence of aberrations in the corneal reflection image without increasing the size of the gaze detection device.

[0066] As such, the optimal distance from the position of the light-emitting unit 37 to the intersection 40 for each illuminator 24 depends on the distance between the gaze sensor unit 8 and the position of the light-emitting unit 37. Explaining this with reference to FIG. 3, for IRED29 and IRED30, which are particularly close to the gaze sensor unit 8, it is desirable that the distance from the position of the light-emitting unit 37 to the intersection 40 be short. On the other hand, for IRED26 and IRED33, which are particularly far from the gaze sensor unit 8, it is desirable that the distance from the position of the light-emitting unit 37 to the intersection 40 be long.

[0067] Furthermore, in the above, "If A is greater than or equal to B, proceed to step S1; if A is less than (lower than) B, proceed to step S2" may be read as "If A is greater than (higher than) B, proceed to step S1; if A is less than or equal to B, proceed to step S2." Conversely, "If A is greater than (higher than) B, proceed to step S1; if A is less than (lower than) B, proceed to step S2" may be read as "If A is greater than (higher than) B, proceed to step S1; if A is less than (lower than) B, proceed to step S2." Therefore, unless a contradiction arises, "greater than or equal to A" may be read as "greater than (higher; longer; more) than A," and "less than or equal to A" may be read as "less than (lower; shorter; fewer) than A." Furthermore, "greater than (higher; longer; more) than A" may be read as "greater than or equal to A," and "less than (lower; shorter; fewer) than A" may be read as "less than or equal to A."

[0068] The various controls described above may or may not be performed by a single piece of hardware (e.g., a processor or a circuit). It is also possible for multiple pieces of hardware (e.g., multiple processors, multiple circuits, or a combination of one or more processors and one or more circuits) to share the processing. The entire device may be controlled by the controller.

[0069] The above processor is a processor in the broad sense, and includes general-purpose processors and dedicated processors. General-purpose processors include, for example, CPUs (Central Processing Units), MPUs (Micro Processing Units), and DSPs (Digital Signal Processors). Dedicated processors include, for example, GPUs (Graphics Processing Units), ASICs (Application Specific Integrated Circuits), and PLDs (Programmable Logic Devices). Programmable logic devices include, for example, FPGAs (Field Programmable Gate Arrays) and CPLDs (Complex Programmable Logic Devices).

[0070] Although the embodiments of the present invention have been described in detail, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Furthermore, each of the above-described embodiments merely represents one embodiment of the present invention, and each embodiment can be combined as appropriate.

[0071] In the above-described embodiment, the present invention has been described as being applied to an imaging device, but the present invention is not limited to this example and can be applied to any gaze detection device capable of gaze detection. The gaze detection device capable of gaze detection may be a computer, a smartphone, a tablet terminal, a digital camera, or a home appliance.

[0072] <Other embodiments> The present invention can also be realized by a process in which a program that realizes one or more functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in the computer of the system or device read and execute the program, or by a circuit that realizes one or more functions.

[0073] The disclosure of the above embodiment includes the following configurations. (Configuration 1) a display device; an optical system that delivers a first light of an image displayed by the display device to a user's eye along an optical axis; a first lighting device having a first light-emitting unit that irradiates the eye of the user with second light; a first light-blocking member having a first opening that limits an irradiation range of the second light irradiated from the first light-emitting unit to the eye of the user; an imaging device that captures an image of the user's eye based on the second light reflected by the user's eye; and a distance from the position of the first light-emitting unit to the optical axis is longer than a distance from a first intersection point between a plane that is perpendicular to the optical axis and that passes through the position of the first light-emitting unit and a central axis of the first opening to the optical axis; A gaze detection device characterized by: (Configuration 2) the first light is visible light, the second light is infrared light; 2. The gaze detection device according to configuration 1, (Configuration 3) a positional relationship between the first light-emitting unit and the first light-blocking member is set based on a distance between the optical axis and the first light-emitting unit; 3. The gaze detection device according to configuration 1 or 2. (Configuration 4) a positional relationship between the first light-emitting unit and the first light-blocking member is set based on a distance between the imaging device and the first light-emitting unit; 4. The gaze detection device according to any one of configurations 1 to 3. (Configuration 5) a second lighting device having a second light-emitting unit that irradiates the second light onto the user's eye; a second light-blocking member having a second opening that limits an irradiation range of the second light irradiated from the second light-emitting unit to the eye of the user; and a distance from the position of the second light-emitting unit to the optical axis is longer than a distance from a second intersection point between a plane that is perpendicular to the optical axis and that passes through the position of the second light-emitting unit and a central axis of the second opening to the optical axis; 5. The gaze detection device according to any one of configurations 1 to 4. (Configuration 6) When the distance between the optical axis and the first light-emitting unit is longer than the distance between the optical axis and the second light-emitting unit, the distance between the first light-emitting unit and the first intersection is longer than the distance between the second light-emitting unit and the second intersection. 6. The gaze detection device according to configuration 5, (Configuration 7) When the distance between the imaging device and the first light-emitting unit is longer than the distance between the imaging device and the second light-emitting unit, the distance between the first light-emitting unit and the first intersection is longer than the distance between the second light-emitting unit and the second intersection. 7. The gaze detection device according to configuration 5 or 6, [Explanation of symbols]

[0074] 1: camera body, 6: display optical system, 7: display unit, 8: gaze sensor unit, 10: eyeball, 11: optical axis, 24: lighting, 35: light blocking member, 36: opening, 37: light emitting part

Claims

1. a display device; an optical system that delivers a first light of an image displayed by the display device to a user's eye along an optical axis; a first lighting device having a first light-emitting unit that irradiates the eye of the user with second light; a first light-blocking member having a first opening that limits an irradiation range of the second light irradiated from the first light-emitting unit to the eye of the user; an imaging device that captures an image of the user's eye based on the second light reflected by the user's eye; and a distance from the position of the first light-emitting unit to the optical axis is longer than a distance from a first intersection point between a plane that is orthogonal to the optical axis and that passes through the position of the first light-emitting unit and a central axis of the first opening to the optical axis; A gaze detection device characterized by:

2. the first light is visible light, the second light is infrared light; 2. The gaze detection device according to claim 1.

3. a positional relationship between the first light-emitting unit and the first light-blocking member is set based on a distance between the optical axis and the first light-emitting unit; 2. The gaze detection device according to claim 1.

4. a positional relationship between the first light-emitting unit and the first light-blocking member is set based on a distance between the imaging device and the first light-emitting unit; 2. The gaze detection device according to claim 1.

5. a second lighting device having a second light-emitting unit that irradiates the second light onto the eye of the user; a second light-blocking member having a second opening that limits an irradiation range of the second light irradiated from the second light-emitting unit to the eye of the user; and a distance from the position of the second light-emitting unit to the optical axis is longer than a distance from a second intersection point between a plane that is orthogonal to the optical axis and that passes through the position of the second light-emitting unit and a central axis of the second opening to the optical axis; 5. The gaze detection device according to claim 1, wherein the gaze detection device is a gaze detection device for detecting a gaze direction of a subject.

6. When a distance between the optical axis and the first light-emitting unit is longer than a distance between the optical axis and the second light-emitting unit, a distance between the first light-emitting unit and the first intersection point is longer than a distance between the second light-emitting unit and the second intersection point.

6. The gaze detection device according to claim 5.

7. When a distance between the imaging device and the first light-emitting unit is longer than a distance between the imaging device and the second light-emitting unit, a distance between the first light-emitting unit and the first intersection is longer than a distance between the second light-emitting unit and the second intersection.

6. The gaze detection device according to claim 5.

Images