Eye tracking via light guide
By using transparent material light guide arrangement and filter layers in near-eye displays, the signal-to-noise ratio problems of optical aperture expansion and eye tracking are solved, and high-precision eye tracking and safe image projection are achieved.
Patent Information
- Application Number
- CN202380035575.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-04-24
- Filing Date
- 2023-04-24
- Publication Date
- 2024-12-06
AI Technical Summary
When existing near-eye displays realize the eye tracking function, it is difficult to effectively expand the optical aperture, resulting in a reduction in signal-to-noise ratio and an increase in optical noise when the eye tracking is realized, which affects the accuracy and safety of eye tracking.
The light guide arrangement made of transparent material guides light through internal reflection, and combines the coupling arrangement of visible images and invisible illumination. The reflector is limited by using the filter layer and the inner aperture in the plane, and the aperture of invisible illumination is defined to ensure visible light. Effectively coupled and invisible light sensing realizes eye gaze direction tracking.
Improves the accuracy and signal-to-noise ratio of eye tracking, reduces optical noise, ensures safe and effective image projection of the eyes, and realizes effective sensing of invisible lighting and derives information on the direction of gaze.
Smart Images

Figure CN119096179A_ABST
Abstract
Description
[0001] Technical field and background technology of the present invention
[0002] The present invention relates to near eye displays, and in particular to near eye displays employing light guide arrangements for both image display and for eye tracking.
[0003] Many near-eye display systems include a transparent light guide or "waveguide" placed in front of the user's eye, which transmits an image by internal reflection within the light guide and then couples the image out toward the user's eye through an appropriate output coupling mechanism. The output coupling mechanism can be based on embedded partially reflective surfaces or "facets", or a diffractive pattern can be used. The following description refers primarily to facet-based outcoupling arrangements, but it should be understood that certain features of the invention are also applicable to diffractive arrangements.
[0004] Some lightguide-based displays employ a lightguide arrangement that achieves expansion of the optical aperture of the image projector in two dimensions to provide a larger viewing area to the eye using a micro-projector. The two-dimensional expansion can be achieved by employing an additional set of embedded partially reflective surfaces within the same lightguide, for example, as disclosed in PCT Patent Application Publication No. WO 2020 / 049542 A1, or by employing a separate rectangular lightguide, for example, as disclosed in PCT Patent Application Publication No. WO 2018 / 065975 A1.
[0005] For many applications, it is desirable to track eye movements of a user while viewing a near-eye display. Summary of the invention
[0006] The present invention is a device for transmitting an image to a human eye and deriving the gaze direction of the human eye.
[0007] According to the teachings of an embodiment of the present invention, there is provided a device for transmitting an image to a human eye and deriving a gaze direction of the human eye, the device comprising: (a) an image output light guide, which is formed of a transparent material and has a pair of parallel surfaces for guiding light by internal reflection, one of the parallel surfaces being arranged to be in a facing relationship with the eye; (b) a visible image outcoupling arrangement, which is associated with the image output light guide and is constructed to couple visible light corresponding to a visible image propagating in the image output light guide from an image outcoupling region toward the eye for viewing by the eye; (c) an invisible illumination outcoupling arrangement, which is associated with the image output light guide and is constructed to couple invisible illumination of at least one wavelength propagating in the image output light guide from the illumination outcoupling region, a majority of the image outcoupling region being outside the illumination outcoupling region; and (d) a receiving light guide, which is formed of a transparent material and has a pair of parallel surfaces for guiding light by internal reflection, the receiving light guide being arranged to be parallel to the image output light guide and to be disposed in a direction parallel to the image output light guide. between the output light guide and the eye; (e) a coupling structure associated with the receiving light guide and configured to couple invisible illumination reflected from the eye to propagate within the receiving light guide; and (f) a filter layer extending parallel to the image output light guide and the receiving light guide, the filter layer blocking invisible light from at least a majority of the image outcoupling region of the image output light guide from being transmitted to the eye while allowing visible light from the image output light guide to reach the eye, the filter layer avoiding the illumination outcoupling region so that when a collimated visible image and invisible illumination of at least one wavelength are introduced into the image output light guide to propagate within the image output light guide, the visible image is coupled out by the visible image outcoupling arrangement and passes through the receiving light guide and the filter layer to be viewed by the eye, and the invisible illumination is coupled out by the invisible illumination outcoupling arrangement and transmitted to the eye via the receiving light guide, partially reflected by the eye, and coupled into the receiving light guide through the coupling structure to propagate within the receiving light guide to be sensed by a sensor to provide information for deriving a gaze direction of the human eye.
[0008] According to further features of embodiments of the invention, a filter layer is between the image output light guide and the receiving light guide.
[0009] According to further features of embodiments of the invention, the region avoided by the filter layer corresponds to the slit aperture.
[0010] According to further features of embodiments of the invention, the area avoided by the filter layer corresponds to an aperture, and the maximum dimension of the aperture is smaller than the minimum dimension of the image outcoupling area.
[0011] According to further features of an embodiment of the present invention, the coupling-in structure includes a surface within the receiving lightguide and inclined at an angle to a pair of major surfaces, the surface being transparent to visible light and partially reflecting invisible illumination of at least one wavelength, and wherein the invisible illumination coupling-out arrangement is deployed to couple the invisible illumination out of the image output lightguide to pass through the coupling-in structure.
[0012] According to the teachings of an embodiment of the present invention, there is also provided a device for transmitting an image to a human eye and deriving a gaze direction of the human eye, the device comprising: (a) an image output light guide, which is formed of a transparent material and has a pair of parallel surfaces for guiding light by internal reflection, one of the parallel surfaces being arranged to be in a facing relationship with the eye; (b) a visible image outcoupling arrangement, which is associated with the image output light guide and is constructed to couple visible light corresponding to the visible image propagating in the image output light guide from an image outcoupling region toward the eye for viewing by the eye; (c) an invisible illumination outcoupling arrangement, which is associated with the image output light guide and is constructed to couple invisible illumination of at least one wavelength propagating in the image output light guide from the illumination outcoupling region, a majority of the image outcoupling region being outside the illumination outcoupling region; and (d) a receiving light guide, which (e) an in-plane aperture-limiting reflector disposed perpendicular to the pair of principal surfaces of the receiving light guide, the in-plane aperture-limiting reflector reflecting the in-visible illumination of at least one wavelength, and the in-plane aperture-limiting reflector being disposed to redirect the in-visible illumination coupled into the receiving light guide by the in-coupling surface and propagating in the receiving light guide to propagate toward the sensor arrangement.
[0013] According to further features of embodiments of the invention, the in-plane aperture limiting reflector is located within the receiving light guide and the sensor arrangement is optically coupled to the receiving light guide.
[0014] According to further features of embodiments of the invention, the in-plane aperture limiting reflector is associated with a third light guide located adjacent to the receiving light guide, and wherein the sensor arrangement is optically coupled to the third light guide.
[0015] According to further features of an embodiment of the present invention, the third light guide is a rectangular light guide having a first pair of mutually parallel major surfaces and a second pair of mutually parallel major surfaces, the second pair of major surfaces being perpendicular to the first pair of major surfaces, and wherein an in-plane aperture limiting reflector is deployed to couple invisible illumination to propagate within the rectangular light guide by quadruple internal reflection at the first pair of major surfaces and the second pair of major surfaces.
[0016] According to the teachings of an embodiment of the present invention, there is also provided a device for transmitting an image to a human eye and deriving a gaze direction of the human eye, the device comprising: (a) a light guide arrangement formed of a transparent material, the light guide arrangement comprising: (i) a first light guide region having a pair of parallel surfaces for guiding light by internal reflection, the first light guide region comprising a first group of partially reflective inner surfaces, and (ii) a second light guide region having a pair of parallel surfaces for guiding light by internal reflection, the second light guide region comprising a second group of partially reflective inner surfaces; (b) an image projector optically coupled to the light guide arrangement and configured to inject visible light corresponding to a collimated image into the first light guide region, to propagate via internal reflection at a pair of parallel surfaces, to be gradually redirected by reflection at the first group of partially reflective inner surfaces, to propagate within the second light guide region by internal reflection at a pair of parallel surfaces, and to be gradually redirected by reflection at the second group of partially reflective inner surfaces to be emitted from the second light guide region. out for viewing by the eye; and (c) an optical sensor arrangement coupled to the first lightguide region and constructed to sense invisible light of at least one wavelength, wherein a single partially reflective inner surface or additional inner surfaces in the second group of partially reflective inner surfaces is an invisible light coupling-in surface, the invisible light coupling-in surface is constructed to at least partially reflect the invisible light so as to couple the invisible light reflected from the eye to propagate within the second lightguide region toward the first lightguide region, all of the second group of partially reflective inner surfaces except the invisible light coupling-in surface are transparent to the invisible light, and wherein a single partially reflective inner surface or additional inner surfaces in the first group of partially reflective inner surfaces are invisible light redirecting surfaces, the invisible light redirecting surfaces are constructed to at least partially reflect the invisible light so as to redirect the invisible light propagating within the first lightguide region toward the optical sensor arrangement, and all of the first group of partially reflective inner surfaces except the invisible light coupling-in surface are transparent to the invisible light.
[0017] According to further features of embodiments of the invention, the first lightguide region and the second lightguide region are regions of a single continuous lightguide.
[0018] According to further features of embodiments of the present invention, the first lightguide region further comprises a second pair of parallel surfaces perpendicular to the pair of parallel surfaces, thereby defining a rectangular lightguide that supports propagation by quadruple internal reflection.
[0019] According to the teachings of an embodiment of the present invention, there is also provided a device for transmitting an image to a human eye and deriving a gaze direction of the human eye, the device comprising: (a) a light guide arrangement formed of a transparent material, the light guide arrangement comprising: (i) a first light guide region having a pair of parallel surfaces for guiding light by internal reflection, the first light guide region comprising a first group of partially reflective inner surfaces, and (ii) a second light guide region having a pair of parallel surfaces for guiding light by internal reflection, the second light guide region comprising a second group of partially reflective inner surfaces; (b) an image projector optically coupled to the light guide arrangement and constructed to inject visible light corresponding to a collimated image into the first light guide region to propagate via internal reflection at a pair of parallel surfaces to gradually redirect the visible light by reflection at the first group of partially reflective inner surfaces to propagate within the second light guide region by internal reflection at a pair of parallel surfaces and to gradually redirect the visible light by reflection at the second group of partially reflective inner surfaces. oriented to couple out of the second lightguide region for viewing by the eye; (c) an optical sensor arrangement coupled to the first lightguide region and constructed to sense at least one wavelength of invisible light; and (d) a dichroic filter that is transparent to visible light and opaque to at least one wavelength of invisible light, the dichroic filter being disposed over a majority of the second lightguide region and avoiding the aperture region to define an invisible light entrance aperture, wherein at least one of the second set of partially reflective inner surfaces or an additional inner surface is constructed to at least partially reflect invisible light to couple invisible light reflected from the eye and incident on the invisible light entrance aperture to propagate within the second lightguide region toward the first lightguide region, and wherein at least most of the first set of partially reflective inner surfaces partially reflect invisible light to redirect invisible light propagating within the first lightguide region toward the optical sensor arrangement.
[0020] According to further features of embodiments of the invention, the first lightguide region and the second lightguide region are regions of a single continuous lightguide.
[0021] According to further features of embodiments of the present invention, the first lightguide region further comprises a second pair of parallel surfaces perpendicular to the pair of parallel surfaces, thereby defining a rectangular lightguide that supports propagation by quadruple internal reflection.
[0022] According to further features of embodiments of the present invention, there is also provided an illumination arrangement comprising at least one light source disposed to illuminate the eye with invisible illumination, the invisible illumination not passing through the second light guide region to reach the eye.
[0023] According to the teachings of an embodiment of the present invention, there is also provided a device for tracking the viewing direction of a human eye, the device comprising: (a) a transparent optical element, which is arranged to be in a facing relationship with the eye to allow viewing of a scene; (b) a dichroic rectangular light guide, which is embedded in the transparent optical element, the dichroic rectangular light guide comprising: a first pair of parallel dichroic reflectors, which reflect at least a first wavelength of invisible light and are transparent to visible light; and a second pair of parallel dichroic reflectors, which reflect at least a first wavelength of invisible light and are transparent to visible light, the second pair of parallel dichroic reflectors being perpendicular to the first pair of parallel reflectors. (c) a planar dichroic in-coupling reflector embedded in the transparent optical element and associated with the first end of the dichroic rectangular lightguide, the in-coupling reflector being inclined obliquely to both the first pair of parallel dichroic reflectors and the second pair of parallel dichroic reflectors and being constructed to in-couple invisible light reflected from the eye for propagation within the dichroic rectangular lightguide while being transparent to visible light; and (d) an optical sensing arrangement associated with the second end of the dichroic rectangular lightguide and deployed to sense the invisible light. BRIEF DESCRIPTION OF THE DRAWINGS
[0024] The invention is herein described, by way of example only, with reference to the accompanying drawings, in which:
[0025] Figure 1A and Figure 1B are schematic front and side views, respectively, of an apparatus for delivering an image to a human eye and deriving a gaze direction of the human eye, constructed and operative in accordance with an embodiment of the present invention, showing light rays corresponding to displaying a visible image and illuminating the eye with invisible illumination;
[0026] Figure 1C and Figure 1D They are similar to Figure 1A and Figure 1B Schematic front and side views of , showing light rays corresponding to invisible illumination received reflected from an eye;
[0027] Figure 1E Is from Figure 1A an alternative implementation of the optical arrangement of the device that allows the visible image projection, invisible illumination and sensing of invisible reflected light to be combined, all along a common axis;
[0028] Figure 2A and Figure 2B are optically equivalent to Figures 1A to 1D Schematic side view and top view of the device, showing the position of the effective aperture stop in the vertical and horizontal directions respectively;
[0029] Figure 2Cis with Figure 1C similar views showing variant implementations for defining an input aperture for receiving reflected invisible illumination;
[0030] Figure 2D Is from Figure 2C A schematic isometric view of a light-guiding portion of a device;
[0031] Figure 3A is a schematic side elevational view of an apparatus constructed and operative in accordance with another embodiment of the present invention for delivering an image to a human eye and deriving a gaze direction of the human eye, the apparatus employing a separate receiving light guide to receive invisible illumination reflected from the eye;
[0032] Figure 3B and Figure 3C are schematic isometric views showing two options for implementation of a filter layer defining an aperture for invisible illumination;
[0033] Figure 3D and Figure 3E are respectively corresponding to Figure 3B and Figure 3C Schematic elevation view of the device, showing the size of the corresponding aperture;
[0034] Figure 4A and Figure 4B is a schematic front view of an alternative embodiment of a receiving light guide for receiving reflected invisible light and directing the invisible light toward a sensor;
[0035] Figure 5A is a schematic front view of another alternative embodiment of a receiving light guide for receiving reflected invisible light and directing the invisible light toward a sensor using a rectangular light guide;
[0036] Figure 5B is a schematic front view of another alternative implementation of a receiving light guide for receiving reflected invisible light and directing the invisible light toward a sensor using an embedded rectangular light guide;
[0037] Fig. 6A and Figure 6B is a schematic front view of another alternative implementation of a receiving light guide for receiving reflected invisible light and having an internal redirecting reflector to direct the invisible light toward a sensor;
[0038] Fig. 7A is a schematic side view of a prism-based coupling arrangement for coupling an invisible illumination sensor to a receiving light guide;
[0039] Figure 7B is a schematic side view of a coupling arrangement without a coupling prism for coupling an invisible illumination sensor to a receiving light guide;
[0040] Figure 7C is a set of images corresponding to Fig. 7A The coupling arrangement, according to Figure 7B The coupling arrangement is for plate-type light guides and according to Figure 7B The coupling arrangement is directed to an output of an invisible illumination sensor generated by a rectangular light guide;
[0041] Fig.7D is a more detailed version of the image that corresponds to the Figure 7B an invisible illumination sensor output generated by a coupling arrangement for a rectangular light guide, showing regions that are included in or excluded from processing for deriving eye tracking data;
[0042] Fig. 8A is a partial schematic side view of an apparatus constructed and operative in accordance with an embodiment of the present invention, the apparatus employing a single scanning mirror to simultaneously scan an invisible illumination laser beam and a line of sight of an invisible light sensor, via two separate light guides, employing at least one beam splitter to derive a gaze direction of a human eye;
[0043] Figure 8B is a partial schematic side view of an apparatus constructed and operative in accordance with an embodiment of the present invention, the apparatus employing a single scanning mirror to synchronously scan an invisible illumination laser beam and a line of sight of an invisible light sensor, via two separate light guides, employing at least one beam splitter, and maintaining different optical paths for illumination and received reflected invisible light to derive the gaze direction of a human eye; and
[0044] Figure 8C and Fig.8D Two schemes for angle-selective partial reflection are shown, both of which are preferably used for Figure 8B in the device. DETAILED DESCRIPTION
[0045] The present invention is a device for transmitting an image to a human eye and deriving the gaze direction of the human eye.
[0046] The principles and operations of devices according to various embodiments of the present invention may be better understood with reference to the drawings and accompanying descriptions.
[0047] Now referring to the accompanying drawings, Figures 1A to 1D An arrangement for delivering an image to a human eye and deriving the gaze direction of the human eye is schematically shown.Both the image light and the eye tracking light are preferably delivered through the same two-dimensional aperture expansion light guide. Figure 1A and Figure 1BThe illumination light path is shown. Specifically, the figure shows a light guide arrangement formed of a transparent material, which includes: a first light guide region 10, which has a pair of parallel faces 11a, 11b for guiding light by internal reflection; and a first set of partially reflective internal surfaces 22H, 24H. The light guide arrangement also includes a second light guide region 20, which has a pair of parallel faces 12a, 12b for guiding light by internal reflection, and includes a second set of partially reflective internal surfaces 22V, 24V.
[0048] The image projector 102 is optically coupled to the lightguide arrangement and is configured to inject visible light corresponding to the collimated image into the first lightguide region 10 to propagate via internal reflection at the pair of parallel faces, to be gradually redirected by reflection at the first set of partially reflective internal surfaces 22H to propagate within the second lightguide region 20 by internal reflection at the pair of parallel faces, and to be gradually redirected by the second set of partially reflective internal surfaces 22V to be coupled out of the second lightguide region for viewing by the eye 30. An optical sensor arrangement 125 is coupled to the first lightguide region 10 and is configured to sense at least one wavelength of invisible light. The optical sensor arrangement 125 typically includes a focal plane array (FPA) sensor that is sensitive to the desired type of light (typically infrared), with suitable optics (lens 106) focusing the light on the FPA sensor, all of which are known in the art.
[0049] The projection of a visible image by the device is as follows. Light from the image projector 102 corresponding to the collimated image is coupled into the first lightguide region 10 to propagate via internal reflection at faces 11a and 11b, is gradually redirected by reflection at the partially reflective inner surface 22H to propagate as light 23 within the second lightguide region 20 at faces 12a and 12b by internal reflection, and is gradually redirected by the partially reflective inner surface 22V to be coupled out of the second lightguide region 20 as light 26 for viewing by the eye 30. In a first set of implementations, the first lightguide region 10 and the second lightguide region 20 are regions of a single continuous lightguide, in which case the optical design for image projection is substantially similar to the design disclosed in the above-mentioned PCT patent application publication No. WO 2020 / 049542 A1, and can be further understood by reference to the PCT patent application publication. In another set of implementations shown here, the first light guide region 10 also includes a second pair of parallel surfaces 11c and 11d perpendicular to the first pair of parallel surfaces 11a and 11b, thereby defining a rectangular light guide that supports propagation by quadruple internal reflection. In this case, the optical design for image projection is substantially similar to the design disclosed in the above-mentioned PCT patent application publication No. WO 2018 / 065975 A1, and can be further understood by reference to the PCT patent application publication.
[0050] The image projector 102 employed with the apparatus of the present invention is preferably configured to generate a collimated image, i.e., the light for each image pixel in the collimated image is a parallel beam of light that is collimated to infinity with an angular direction corresponding to the pixel position. Thus, the image illumination spans an angular range corresponding to a two-dimensional angular field of view.
[0051] The image projector 102 includes at least one light source that is typically deployed to illuminate a spatial light modulator, such as an LCOS chip. The spatial light modulator modulates the projected intensity of each pixel of the image, thereby generating an image. Alternatively, the image projector may include a scanning arrangement, typically implemented using a fast scanning mirror, that scans the illumination from a laser light source across the image plane of the projector, while the intensity of the beam changes synchronously with the pixel-by-pixel movement, thereby projecting the desired intensity for each pixel. In both cases, the collimating optics are arranged to generate an output projected image that is collimated to infinity. Some or all of the above components are typically arranged on the surface of one or more polarizing beam-splitter (PBS) cubes or other prism arrangements known in the art.
[0052] The optical coupling of the image projector 102 to the lightguide region 10 can be achieved by any suitable optical coupling, for example, via a coupling prism having an angled input surface, or via a reflective coupling arrangement, via one of the major outer surfaces and / or a side edge of the lightguide. Unless otherwise stated below, the details of the coupling configuration are generally not important to the present invention and are schematically shown in some embodiments as a non-limiting example of coupling via an angled side edge / end of the lightguide portion 10.
[0053] It will be appreciated that the near-eye display 10 includes various additional components, typically including a controller (not shown) for actuating the image projector 102, which typically uses power from a small onboard battery (not shown) or some other suitable power source. The controller includes all necessary electronic components, such as at least one processor or processing circuit for driving the image projector, all of which are known in the art.
[0054] In certain particularly preferred embodiments, this same projection arrangement is used to deliver invisible illumination to illuminate the eye for the purpose of eye tracking. Figure 1A and Figure 1C The light source for invisible illumination is not shown, but Figure 1E As shown, a light source for invisible illumination may be included by using an additional beam splitter 502 , and the beam splitter 502 combines the invisible light source 500 on the same optical axis as the sensor 125 .
[0055] Implementing an eye tracker in which light is collected by a light guide arrangement presents significant challenges. Specifically, the light guide arrangement is constructed to perform a two-dimensional aperture expansion of a collimated image for projection to the eye, while light reflected from the surface of the eye diverges from a point very close to the light guide. Furthermore, the light paths for different parts of the field and different spatial locations are very different. This is not a problem for propagation of a collimated output image, as collimated images are insensitive to differences in path length, but is very problematic for near-field imaging, as is often required for eye tracking.
[0056] According to certain aspects of the invention, sensing of reflected light for eye tracking is performed via a light guide arrangement by defining a relatively small aperture for receiving invisible illumination, without interfering with the much larger effective aperture from which a visible image is projected toward the eye. The small aperture acts as a kind of pinhole camera, and particularly when used with illumination via the same aperture, pupil tracking is greatly facilitated by retro-reflection of light focused on the retina by the eyepiece and reflected back (according to the same phenomenon responsible for the "red eye" effect in flash photography). Two different technical solutions for how to implement such a small aperture for receiving invisible light are discussed below.
[0057] According to the first method, a single partially reflective inner surface or an additional inner surface in the second group of partially reflective inner surfaces is an invisible light coupling-in surface 24V, which is constructed to at least partially reflect invisible light so as to couple invisible light reflected from the eye so as to propagate in the second lightguide region toward the first lightguide region. All of the second group of partially reflective inner surfaces 22V except the invisible light coupling-in surface 24V are preferably substantially transparent to invisible light. Depending on the image projection optical design, "substantially transparent" in this context refers to a surface designed to minimize infrared reflection, and although the surface has a more significant reflectivity for visible light (typically exceeding 10%), its infrared transmittance is typically above 90%, preferably above 95%, for the relevant wavelengths.
[0058] Likewise, according to this approach, a single partially reflective inner surface or an additional inner surface in the first set of partially reflective inner surfaces is an invisible light redirection surface 24H configured to at least partially reflect invisible light to redirect the invisible light propagating within the first lightguide region 10 toward the optical sensor arrangement 125. All of the first set of partially reflective inner surfaces 22H except the invisible light redirection surface 24H are preferably substantially transparent to invisible light.
[0059] In the case where the invisible illumination is delivered along the same path as the receiving invisible illumination, for example by using Figure 1EIn the arrangement, invisible light for the purpose of eye tracking is injected from a source 500 (preferably invisible light of at least one wavelength, most preferably infrared) and enters a first light guide region 10 (shown as a rectangular light guide in this example, but may alternatively be implemented as a continuation of the same light guide, as shown in the figure below). The light propagates along the light guide region 10 and is reflected by the internal partially reflective surface (facet) 22H ( Figure 1A 23) out of lightguide region 10 and into lightguide region 20 for vertical aperture expansion. Since facet 24H is designed to reflect specific IR, this reflection is depicted as thick arrow 25 and is the largest source of invisible illumination directed into second region 20. As previously discussed, the other facets 22H preferably have their multi-layer dielectric coatings designed to minimize reflection of invisible illumination, but there will typically be some residual partial reflections due to design limitations. As the light propagates within portion 20, some light rays 26 are reflected out of facet 22V, while other light rays 28 are reflected out of the lightguide by facet 24V. These light rays illuminate eye 30, with some of them reflected by iris 32 and some of them focused on retina 34 and reflected back in the same direction in a retroreflective ("red eye") effect.
[0060] Figure 1C and Figure 1D Light reflected from the retina 36 or from the iris 38 onto facet 24V is shown passing through light guide portion 20 onto portion 10 and then reflected by facet 24H along portion 10 onto receiver 125. Although the infrared reflectivity of the other facets 22V and 22H of the light guide arrangement is relatively small, in general, these facets typically couple out a large portion of the reflected light as light rays 40V and 40H, so that only a small portion (typically in the range of 5%-10%) of the light coupled in by facet 22H reaches the sensor.
[0061] Detection of eye orientation is typically accomplished by detecting the relative angle between the reflection from the eye and the position of the facet 24. Figure 2A and Figure 2B This method is described in .
[0062] Figure 2A The distance from the iris to the primary IR reflecting facet 24V is shown, which is schematically represented as an aperture (because only light falling on this facet is coupled into the light guide). The result is effectively a slit aperture that limits the vertical size of the reflected, invisible illumination coupled into the light guide. It is apparent that the facet 24V is located relatively close to the eye, so the angle 44V is large.
[0063] Figure 2BThe unfolded path of the beam path from the iris is schematically shown, i.e. reflected from facet 24V onto facet 24H, which effectively defines a second aperture limiting the portion of the in-plane field that reaches the invisible light sensor arrangement, corresponding to the horizontal aperture stop of the detection optics. (“Unfolded” in this context means a graphical representation in which each reflection of a light ray at one of the light guide faces or at one of the internal facets is represented as a straight-line continuation of that light ray). The angle 44H (orthogonal to 44V) defined by the line connecting the iris position and 24H with respect to the centre line is smaller than 44V because the angle 44H ... Figure 2A , the optical path is longer.
[0064] In general, according to Figure 2A and Figure 2B The receiving aperture method Figures 1A to 1D The embodiments of the invention effectively provide receiving aperture "stops" in both the horizontal and vertical directions, but these stops defined by facets 24H and 24V are at different optical path distances from the eye in different planes. The central position of the bright elliptical retroreflection from the pupil sensed by focal plane array sensor 125 allows geometric reconstruction of the horizontal and vertical position of the pupil 32 of the eye. In some cases, this information is supplemented by analysis of the elliptical shape of the pupil and / or other eye tracking algorithms known in the eye tracking art as an additional indication of eye orientation.
[0065] Now turn to Figure 2C and Figure 2D , Figure 2C and Figure 2D An alternative method of defining an aperture to sense invisible light reflected from the eye is shown. Structurally, the visible light image projection arrangement in this implementation is preferably the same as that in the embodiment described above with reference to Figure 1A and Figure 1B The arrangement described is substantially similar, wherein an image projector is optically coupled to the light guide arrangement and is configured to inject visible light corresponding to a collimated image into the first light guide region 10 to propagate via internal reflection at a pair of parallel faces 11a and 11b (or 4 faces in the case of a rectangular light guide). The visible light is reflected by the first set of partially reflective internal surfaces ( Figure 1A The light is gradually redirected by reflection at a surface 22H in the middle (not visible in these views) to propagate within the second lightguide region 20 by internal reflection at a pair of parallel faces 12a and 12b, and then gradually redirected by a second set of partially reflective internal surfaces 22V to be coupled out of the second lightguide region for viewing by the eye, all as described above with reference to Figure 1A and Figure 1B as described.
[0066] This embodiment differs from the above in that the aperture stop for the received reflected invisible light is at least partially defined by a dichroic filter 56b that is substantially transparent to visible light and substantially opaque (absorbs or reflects) to the wavelength of the invisible light used for eye tracking. The dichroic filter 56b is disposed over most of the second lightguide region 20 and avoids the aperture region to define an entrance aperture 57 for the invisible light.
[0067] At least one of the second set of partially reflective inner surfaces 22V or an additional inner surface is configured to at least partially reflect invisible light to couple the invisible light reflected from the eye 30 and incident on the invisible light entrance aperture 57 to propagate within the second lightguide region 20 toward the first lightguide region 10. In this embodiment, at least two of the facets 22V are preferably made partially reflective to invisible light to ensure that incident light passing through the aperture 57 at a wide range of angles is effectively coupled into the lightguide. Similarly, since the aperture defined herein is close to the eye, multiple and typically most of the partially reflective inner surfaces of the first set of partially reflective inner surfaces 22H are preferably made partially reflective to invisible light to redirect the invisible light propagating within the first lightguide region 10 toward the optical sensor arrangement 125 (e.g., Figure 1C or as shown in 1E).
[0068] As an alternative to, or in addition to, using a dichroic filter to define the two-dimensional aperture 57, a similar effect can be achieved by implementing the facet 52V as a short facet, wherein the extension length of the facet (i.e., the length of the facet parallel to the intersection line of the facet plane with the major surface of the light guide 50) is a small fraction (e.g., less than 20%, and preferably less than 10%) of the size of the image output area measured in the same direction. In this case, the facet 52V itself defines the aperture 57 in two dimensions.
[0069] Here you can use Figure 1EThe arrangement delivers illumination of invisible light for eye tracking via the light guide in a manner similar to the first embodiment. Alternatively, it may be particularly advantageous to provide an illumination arrangement comprising at least one light source (not shown) deployed to illuminate the eye with invisible illumination without the illumination passing through the second light guide region 20. This can be achieved, for example, by mounting one or more IR LEDs around an eyeglass frame or other head mounted support structure (not shown) that supports the display near the user's face. This, together with the presence of a dichroic filter, greatly reduces the amount of "noise" caused by scattering and / or reflections of the IR illumination within the light guide. When the illumination does not originate at (or near) the aperture for receiving the invisible illumination, retro-reflections of the red eye effect will not be directed towards the aperture, thereby producing a dark pupil image, for which the eye tracking algorithm must be adjusted accordingly, all of which is known in the art. Optionally, an additional dichroic filter 59, similar to filter 56b but without an aperture, may be deployed on the exterior face of light guide 20 to additionally block IR "noise" from the sun or other external sources from entering the light guide while still allowing the user to view an external scene.
[0070] Where illumination needs to be performed via a light guide (such as for bright pupil eye tracking), an alternative approach to improving the signal-to-noise ratio is to separate the illumination and reception functions into two separate light guides. FIG. 3A to FIG. 3C This approach is schematically shown in .
[0071] Therefore, in Figure 3A , a light guide arrangement of a device for transmitting an image to a human eye and deriving a gaze direction of the human eye is shown, wherein the arrangement of the first light guide region 10 and the second light guide region 20 is the same as that described above with reference to Figure 1A and Figure 1B The arrangement described is substantially similar, with visible images from an image projector (not shown here, but similar to projector 102 described above) being extended and coupled out at partially reflective surfaces 22H, 24H, 22V, and 24V, and invisible illumination being provided along similar optical paths to illuminate eye 30 for eye tracking, all as described above with reference to Figure 1A and Figure 1B Here, the lightguide region 10 can also be a separate rectangular lightguide from which light is coupled out into a separate plate-type lightguide 20, or the two lightguide regions can be integrated into a single two-dimensional extended lightguide. In this case, since the lightguide regions 10 and 20 are not used for sensing, the coupling in of the image and invisible illumination can be performed using a single dichroic beam combiner, using Figure 1E 500 replacements for lighting sources Figure 1AThe area from which the invisible illumination is coupled out is preferably smaller than the area from which the visible image is coupled out toward the eye, so that most of the image outcoupling area is outside the illumination outcoupling area. As described above, this can be achieved using different properties of partially reflective surfaces 24H and 24V compared to surfaces 22H and 22V and / or by using selectively deployed filter layers to block invisible light in certain areas, as described in further detail below.
[0072] To minimize optical "noise" in the sensing light path, the device preferably also includes an additional receiving light guide 50 formed of a transparent material and having a pair of parallel faces 51a and 51b for guiding light by internal reflection. The receiving light guide 50 is disposed in parallel with the light guide 20 (i.e., their major surfaces are parallel). In certain particularly preferred implementations, the receiving light guide 50 is specifically disposed between the light guide 20 and the eye 30. An in-coupling configuration, preferably implemented as a partially reflective dichroic inner surface 52V, is associated with the receiving light guide 50 and is configured to in-couple invisible illumination reflected from the eye to propagate within the receiving light guide 50. Most preferably, a filter layer 56 extends parallel to the light guide 20 and the receiving light guide 50 and is configured to block invisible light from at least a majority of the image out-coupling region of the light guide 20 to the eye while allowing visible light from the light guide 20 to reach the eye. The filter layer avoids the illumination out-coupling region, thereby allowing the invisible illumination to illuminate the eye.
[0073] Due to this structure, when the collimated visible image and invisible illumination are introduced into the light guides 10, 20 to propagate within the first light guide, the visible image is coupled out by the visible image coupling arrangement 22V and passes through the receiving light guide 50 and the filter layer 56 to be viewed by the eye 30, while the invisible illumination is coupled out by the invisible illumination coupling arrangement (surface 24V) and transmitted to the eye via the receiving light guide 50, is partially reflected by the eye, and is coupled into the receiving light guide by the coupling structure 52V to propagate within the receiving light guide 50 to be sensed by the sensor to provide information for deriving the gaze direction of the human eye.
[0074] The separation of the receiving function in a light guide separated from the image projection and eye illumination provides significant advantages. In such an eye tracking system, the limiting parameter is the intensity of the light illuminating the eye 30. For eye safety reasons, this intensity should be as low as possible. Figure 1A and Figure 1B ) can be easily compensated by a higher illumination power output of the invisible illumination source, as long as the desired low level of illumination intensity reaching the eye 30 is maintained. Figure 1C and Figure 1D) will reduce the signal to noise ratio (SNR) at the receiving sensor 125, thereby reducing the detection accuracy. In addition, the illumination light scattered within the light guide may be collected by the receiving sensor 125 and further reduce the detection SNR and quality. By separating the illumination function and the receiving function into two independent light guides, the number of components that may cause scattering within the receiving light guide can be minimized, and light scattered from the illumination path can be largely prevented from entering the receiving light guide.
[0075] exist Figure 3A In the embodiment of the invention, surface 52V in receiving light guide 50 preferably partially reflects IR, but transmits visible wavelengths. In this way, the visible image projected by light guides 10 and 20 is prevented from being corrupted. The IR light reflected by facet 24V partially passes through facet 52V to illuminate the eye, while part of the illumination (arrow 54) is reflected out of the system. This loss is not critical because, as described above, it can be compensated by high-power illumination from a non-visible illumination source.
[0076] An IR filter coating 56 (which is substantially transparent to visible wavelengths) is preferably applied between light guides 20 and 50 to prevent light 26 ( Figure 1B ) and ambient IR light from the scene illuminates the eye. Coating 56 has an opening in front of facet 52V so that light reflected by facet 24V can pass through to illuminate the eye. Light reflected from the eye (dashed arrows) strikes facet 52V, is partially reflected and coupled in, guided in light guide portion 50, while partially passing through (light ray 58) and being lost. In order to minimize such losses, it is preferred that facet 52V has a high reflectivity of more than 50%, and preferably in the 60%-80% in the IR range, while remaining transparent in the visible range.
[0077] After the invisible illumination is coupled into the receiving light guide 50, the optical arrangement of the receiving channel can be similar to Figure 1C and Figure 1D The receiving optical path shown in the embodiment is implemented using an additional receiving optical waveguide region 60, which can be a separate rectangular optical waveguide or can be a continuation of the optical waveguide 50, all according to the options detailed above, but here the optical waveguide regions 50 and 60 only include elements that are essential to the receiving optical elements, thereby minimizing the number of optical components in the receiving optical path and the corresponding possibility of light scattering. Alternatively, in some cases, the receiving channel can use a sensor arrangement 125 that is deployed to sense the invisible illumination coupled into the optical waveguide 50 without further redirection, such as using Figure 4A or Figure 4B as further described below.
[0078] There are many options regarding the location and configuration of the filter layer 56. In the particularly preferred implementation shown here, the filter layer 56 is located between the light guide 20 and the receiving light guide 50 (which may be referred to herein as the "image output light guide" and the receiving light guide, respectively, depending on the context). The filter layer is typically implemented in the form of a multilayer dielectric coating that is selectively applied directly to the face of one of the light guides. The light guides themselves are then assembled, with a small air gap, or more preferably directly attached using a low refractive index adhesive to maintain internal reflection conditions at their interface.
[0079] according to Figure 3B The option shown avoids the area of the filter layer corresponding to the slit aperture 57a in the filter layer implementation 56a. This option is particularly suitable for use in a similar manner to that described above with reference to Figure 2A and Figure 2B The optical arrangement described is one in which illumination and sensing are performed via facets 24V and 52V in length, respectively.
[0080] According to the image implementation method, such as Figure 3C As shown, the area avoided by the filter layer 56b corresponds to the aperture 57b, the maximum size of which is smaller than the minimum size of the image outcoupling area, similar to the above Figure 2C More preferably, each dimension of aperture 57b does not exceed about 20% of the smallest dimension of the image outcoupling region. When the filter layer is disposed between the two light guides as shown, preferably in order to minimize the scattered infrared illumination entering the receiving light guide 50, aperture 57 defines only the illumination aperture, while the receiving aperture is defined by facet 52V and any built-in light guide 60 (equivalent to Figure 2B 24H in FIG. 4 ) or in-plane aperture stop in the sensor arrangement 125 (in the case of an arrangement such as FIG. 4 ). Alternatively or additionally, a filter layer 56b or another similar layer may be disposed on the surface of the light guide 50 closer to the eye. In this case, the aperture 57b is defined in the same manner as above with reference to Figure 2C and Figure 2D A similar approach as described is also used for the aperture of the receiving light path.
[0081] In the context of the outcoupling region 53 from which the visible image is coupled out, the apertures 57a and 57b Figure 3D and Figure 3E The apertures 57a and 57b are shown in FIG. Figure 3C and Figure 3D In both cases, it can be seen that most of the image outcoupling region 53 is located outside the area of the aperture 57a or 57b. In the case of the aperture 57b, the maximum size of the aperture is smaller than the minimum size of the image outcoupling region 53.
[0082] Now turn to Figure 4A and Figure 4B , Figure 4A and Figure 4B A simple configuration according to this configuration is shown, whereby the reflected invisible light is detected by the receiver 125 after being reflected by the facet 52V and guided within the receiving light guide 50. FIG. 7A to FIG. 7D Various options for how to couple the receiver 125 to the light guide 50 are discussed further below. Figure 4A In some cases, the receiver is placed directly above the light guide 50. In some cases, for ergonomic considerations, it may be preferable to implement the facets 52V in a diagonal manner to reflect the received light in different directions, such that the reflection is toward the corner, e.g. Figure 4B In both cases, the receiver aperture is used to define an aperture stop in a plane, rather than Figure 2B As in the case of the light redirection required.
[0083] Figure 5A An alternative is shown where a rectangular guiding portion 60 is placed to collect light from portion 50 onto receiver 125. Reflector 52H (preferably a perfect mirror) reflects the received beam to be guided by portion 60. In this configuration, reflector 52H acts as Figure 2B Aperture stop in the plane shown in (corresponding to the horizontal direction).
[0084] Figure 5B An alternative implementation of a receiving optical device is shown, in which the element 50 is an inert transparent optical element that is disposed in a facing relationship with the eye to allow viewing of a scene, and wherein a dichroic rectangular light guide 60 is embedded in the transparent optical element 50. Specifically, the dichroic rectangular light guide 60 here includes: a first pair of parallel dichroic reflectors 61a and 61b that reflect invisible light of relevant wavelengths while being transparent to visible light; and a second pair of parallel dichroic reflectors (front and back surfaces are parallel to the front and back surfaces of the optical element 50) that reflect invisible light of relevant wavelengths while being transparent to visible light, the second pair of parallel dichroic reflectors being perpendicular to the first pair of parallel dichroic reflectors. Due to this structure, the dichroic rectangular light guide 60 supports the propagation of invisible light within the light guide by quadruple internal reflection while allowing visible light to pass (for displaying a visible image and / or for viewing an external scene). A planar dichroic in-coupling reflector 52H embedded in the transparent optical element 50 and associated with the first end of the dichroic rectangular light guide 60 is inclined obliquely to both the first pair of parallel dichroic reflectors and the second pair of parallel dichroic reflectors, and is configured to in-couple invisible light reflected from the eye to propagate within the dichroic rectangular light guide while being transparent to visible light. An optical sensing arrangement 125 is associated with the second end of the dichroic rectangular light guide and is deployed to sense invisible light.
[0085] Fig. 6AA configuration is shown where the side reflectors 62S are integrated into the same plate-type light guide portion as 52V. In the non-limiting but preferred case shown here, the directional reflectors 62S are relatively large and the aperture stop is defined by the entrance to the sensor arrangement 125. Alternatively, a smaller reflector 62S may be used to define an in-plane (horizontal) aperture stop, in which case a larger sensor arrangement aperture is used.
[0086] Figure 6B Shows Fig. 6A A variation of the implementation of the embodiment of the present invention, in which the reflector 62M is a plurality of reflectors that implement functions similar to those of the reflector 62S. In this case, it is preferred to use partial reflectors that are at least partially overlapped so that some light is partially reflected by more than one reflector 62M.
[0087] FIG. 7A to FIG. 7D The sensor / receiver is further elaborated, along with different options for how the sensor / receiver can be coupled to the light guide and receive a signal. Fig. 7A A schematic diagram of a light guide 70 (which may correspond to portion 50 or portion 60 in any of the aforementioned implementations) attached to a prism 72 is shown, which reflects light onto a receiver 125A. Variants and alternative implementations of the prism 72 are parallel to various different coupling configurations known in the art for coupling an image from an image projection into a light guide. For example, a prism may be placed above the light guide 70 and / or used to couple into a rectangular light guide, and the prism may include a corner reflector. The sensor / receiver 125A preferably includes focusing optics 74A and an FPA sensor matrix 76A. The matrix preferably converts the infrared light power falling on its pixels into digital signals for processing.
[0088] In this configuration, if the light guide 70 is a flat (plate-type) light guide, or if the light guide 70 is a rectangular light guide and the prisms 72 are corner prisms, all light beams propagating at the same angle in the light guide 70 will be focused into a single light spot, such as Figure 7C The output image 80A is schematically shown.
[0089] Figure 7B A more compact configuration is shown, where the receiver 125B is attached directly to one side or end of the light guide 70 without a coupling prism. In this case, the lens 74B is very small and the receiver 76B is also very small. However, if the light guide 70 is a flat (plate-type) light guide, the light beam propagation in the light guide will produce two light spots on the receiver 76B, located on opposite sides of the symmetry axis, such as Figure 7C If the light guide 70 is a rectangular light guide 60, the single beam direction will be split into four, as shown in output image 80C, with two orthogonal axes of symmetry.
[0090] Although the positions of the light spots are related to each other according to the symmetry of the light guide, the light spots in the output images 80B and 80C may have different power distributions (in Figure 7C ) and in some cases the power of some spots can be negligible. Therefore, it is best to take all corresponding spots into account when deriving the beam direction for eye tracking. This can be achieved, for example, by mirror summing of images on opposite sides of the mirror symmetry axis.
[0091] Depending on the exact deployment of the sensor, the coupling geometry, and the range of possible eye positions, not all light reaching the detector necessarily corresponds to an allowed light propagation path for light reflected from the eye. Preferably, light propagating at other angles that do not correspond to valid eye tracking reflections is excluded from the sensed image by electronic filtering and / or appropriate optical design.
[0092] Fig.7D Shows that from Figure 7B 80C. Here, the nominal range of suitable images expected to correspond to light reflected from the eye and coupled into the light guide is designated as 100A. Due to the tilt of the reflector surfaces 52H and 52V, the four images are offset from the center of the receiver. Any received pattern in the area designated 100B that falls closer to the center of the image is preferably electronically filtered out, i.e., ignored during subsequent processing. Larger off-axis angles will also be electronically filtered out and / or can be optically excluded by exceeding the total internal reflection (TIR) limit indicated by the margin 100C.
[0093] Additional optical filtering can be performed by using appropriate dielectric coating designs on reflectors 52V and 52H to reflect only the angles of interest (i.e., angles relevant to collecting reflections from the eye). By way of a non-limiting example, if the center of the eyeball is 30 mm from the waveguide and the expected range of motion of the pupil position ("eye box") is about 10 mm, then the angular range is about 10 degrees, and the inclination of the facets can be 60 degrees (for example). In this example, the reflective coating should preferably be optimized to reflect infrared of the relevant wavelength at an incident angle between 4 and 20 degrees from the normal to the facet, while having low reflectivity outside this range. Any residual reflections are preferably further electronically filtered as described above.
[0094] Now turn to FIG. 8A to FIG. 8D, a scanning laser that generates an infrared illumination beam of an allowed (eye-safe) intensity can be used to achieve a better signal-to-noise ratio in eye tracking, because the beam can be more effectively distinguished from scattered light. FIG8 shows the following implementation: a single scanning mirror scanning in one or two dimensions is used to simultaneously and synchronously scan the laser beam through the illumination light guide (image output light guide region 10 and / or 20) and scan the line of sight of the sensor via the light guide region 50 and / or 60.
[0095] therefore, Fig. 8A A light source (preferably an IR laser) 2 is shown, which illuminates a polarizing beam splitter (PBS) 82 and then is incident on a scanning mirror 84. The reflected and scanned light passes through another combiner (preferably another PBS) onto an illumination light guide 10 or 20. Visible light can be combined with this beam to generate a virtual image observed through the light guide.
[0096] The received beam from the light guide portion 50 or 60 is combined with the transmitted light at PBS 86. If the received light is unpolarized, 50% will be lost at this PBS. The received beam is "scanned" on the scanning mirror 84 and decoupled from the transmitted beam at PBS 82 to be detected by a single detector 88.
[0097] Figure 8B An alternative architecture is shown for using a single scanning mirror to achieve scanning of both the transmitted laser beam and the viewing direction of the detector without requiring the transmitted and received beams to travel along overlapping paths. In this case, the angular changes in the projected beam and the viewing direction are asymmetric relative to the light guide surface. Specifically, if the scanning mirror 84 is rotated clockwise when viewing, it will cause the transmitted beam to present a steeper inclination to the surface of the light guide 10 or 20, while the angle of the viewing direction of the sensor becomes shallower. However, this inverse angular relationship can be compensated by using diagonally selective reflective coatings for the out-coupling facets of the light guide 20 and the coupling-in surface of the light guide 50, as shown in reference Figure 8C and Fig.8D Explanatory.
[0098] Specifically, in the design of light guide based displays, it is well known that the internal partially reflective surfaces (facets) used to couple out the image towards the viewer's eyes should be implemented with angle-selective reflectivity. As the image propagates within the light guide 200, the main image and the inverted image coexist due to repeated reflections of the light at the front and rear surfaces 202, 204 of the light guide. In order to minimize the formation of ghost images and minimize energy losses, the facet 206 should be partially reflective within the angular range corresponding to the desired image, and should be substantially transparent within the angular range corresponding to the inverted image. (The "desired image" here refers to the image of the desired output image generated after coupling out). In the design of image display systems, this presents two different options, such as Figure 8C and Fig.8D As shown. Figure 8C In the case of , the facets shown are substantially transparent to the "upward" propagating image 208a (in the orientation shown), while being partially reflective for outcoupling the "downward" propagating image (as shown) 208b. In contrast, according to an alternative design shown in the image, Fig.8D The following is shown: the facets are implemented to be partially reflective to couple out the "upward" propagating image 208a, while being substantially transparent to the "downward" propagating image 208b. This angular selectivity is achieved by designing appropriate multilayer dielectric coatings, which is known in the art and applies to all of the above-mentioned embodiments.
[0099] exist Figure 8B In the context of a system of Fig.8D ) is compensated by using an outcoupling facet in the light guide 20, while the incoupling surface 52V is based on Figure 8C The result is to reverse the asymmetry created by the motion of the scanning mirror, thereby ensuring that the scanning beam output direction and the sensing direction aligned with the detector 88 remain synchronized throughout the motion of the scanning mirror.
[0100] Throughout the above description, all references to orientations for device use, such as "horizontal" or "vertical", are used only as non-limiting examples to facilitate understanding of the invention in the orientation shown. However, these devices can be used in any orientation that best suits a given application and set of design considerations, including situations where the orientation referred to as "horizontal" is deployed vertically or in any intermediate orientation.
[0101] Regardless of where the image is output from the light guide toward the observer's eye, it should be noted that an element with refractive optical power may be incorporated to limit the apparent viewing distance of all or part of the projected image and / or to provide refractive correction desired by the user. Deploying such a refractive element close to the light guide will generally not affect the operation of the eye tracking arrangement described herein.
[0102] It will be understood that the above description is intended to be exemplary only and that many other embodiments are possible within the scope of the invention as defined in the appended claims.
Claims
1. A device for delivering an image to a human eye and deriving a gaze direction of the human eye, the device comprising: (a) an image output light guide formed of a transparent material and having a pair of parallel faces for guiding light by internal reflection, one of the parallel faces being disposed in facing relationship with the eye; (b) a visible image outcoupling arrangement associated with the image output lightguide and configured to couple visible light corresponding to a visible image propagating within the image output lightguide out of an image outcoupling region toward the eye for viewing by the eye; (c) an invisible illumination outcoupling arrangement associated with the image output light guide and configured to couple at least one wavelength of invisible illumination propagating within the image output light guide out of an illumination outcoupling region, a majority of the image outcoupling region being outside of the illumination outcoupling region; (d) a receiving light guide formed of a transparent material and having a pair of parallel faces for guiding light by internal reflection, the receiving light guide being disposed parallel to the image output light guide and between the image output light guide and the eye; (e) a coupling structure associated with the receiving lightguide and configured to couple invisible illumination reflected from the eye for propagation within the receiving lightguide; and (f) a filter layer extending parallel to the image output lightguide and the receiving lightguide, the filter layer blocking at least a majority of the invisible light from the image outcoupling region of the image output lightguide from passing to the eye while allowing visible light from the image output lightguide to reach the eye, the filter layer avoiding the illumination outcoupling region, Such that when the collimated visible image and invisible illumination of at least one wavelength are introduced into the image output light guide to propagate within the image output light guide, the visible image is coupled out by the visible image coupling arrangement and passes through the receiving light guide and the filter layer to be viewed by the eye, and the invisible illumination is coupled out by the invisible illumination coupling arrangement and transmitted to the eye via the receiving light guide, partially reflected by the eye, and coupled into the receiving light guide by the coupling structure to propagate within the receiving light guide to be sensed by a sensor to provide information for deriving the gaze direction of the human eye.
2. The device according to claim 1, wherein: The filter layer is between the image output light guide and the receiving light guide.
3. The device according to claim 1, wherein: The area avoided by the filter layer corresponds to the slit aperture.
4. The device according to claim 1, wherein: The area avoided by the filter layer corresponds to an aperture, and the maximum size of the aperture is smaller than the minimum size of the image outcoupling area.
5. The device according to claim 1, wherein: The coupling-in structure includes a surface within the receiving light guide and inclined at an angle to the pair of major surfaces, the surface being transparent to visible light and partially reflective to invisible illumination of at least one wavelength, and wherein the invisible illumination out-coupling arrangement is disposed to couple the invisible illumination out of the image output light guide to pass through the coupling-in structure.
6. A device for delivering an image to a human eye and deriving a gaze direction of the human eye, the device comprising: (a) an image output light guide formed of a transparent material and having a pair of parallel faces for guiding light by internal reflection, one of the parallel faces being disposed in facing relationship with the eye; (b) a visible image outcoupling arrangement associated with the image output lightguide and configured to couple visible light corresponding to a visible image propagating within the image output lightguide out of an image outcoupling region toward the eye for viewing by the eye; (c) an invisible illumination outcoupling arrangement associated with the image output light guide and configured to couple at least one wavelength of invisible illumination propagating within the image output light guide out of an illumination outcoupling region, a majority of the image outcoupling region being outside of the illumination outcoupling region; (d) a receiving light guide formed of a transparent material and having a pair of parallel faces for guiding light by internal reflection, the receiving light guide being disposed parallel to the image output light guide; (e) an incoupling surface inside the receiving lightguide and inclined at an angle to the pair of major faces, the surface being transparent to visible light and at least partially reflective to the at least one wavelength of invisible illumination, the incoupling surface having a projection on one of the parallel faces having a length and a width, the length being at least 10 times the width; (f) a sensor arrangement for sensing the invisible illumination of the at least one wavelength; as well as (g) an in-plane aperture-limiting reflector perpendicular to the pair of major faces of the receiving lightguide, the aperture-limiting reflector reflecting the invisible illumination of the at least one wavelength and disposed to redirect the invisible illumination coupled into the receiving lightguide by the coupling surface and propagating within the receiving lightguide to propagate toward the sensor arrangement.
7. The device according to claim 6, wherein: The in-plane aperture limiting reflector is located within the receiving light guide, and the sensor arrangement is optically coupled to the receiving light guide.
8. The device according to claim 6, wherein: The in-plane aperture limiting reflector is associated with a third light guide located adjacent to the receiving light guide, and wherein the sensor arrangement is optically coupled to the third light guide.
9. The device according to claim 8, wherein: The third light guide is a rectangular light guide having a first pair of mutually parallel major surfaces and a second pair of mutually parallel major surfaces, the second pair of major surfaces being perpendicular to the first pair of major surfaces, and wherein the in-plane aperture limiting reflector is disposed to couple the invisible illumination to propagate within the rectangular light guide by quadruple internal reflection at the first pair of major surfaces and the second pair of major surfaces.
10. A device for delivering an image to a human eye and deriving a gaze direction of the human eye, the device comprising: (a) A light guide arrangement formed of a transparent material, the light guide arrangement comprising: (i) a first lightguide region having a pair of parallel faces for guiding light by internal reflection, said first lightguide region comprising a first set of partially reflective internal surfaces, and (ii) a second lightguide region having a pair of parallel faces for guiding light by internal reflection, said second lightguide region comprising a second set of partially reflective internal surfaces; (b) an image projector optically coupled to the lightguide arrangement and configured to inject visible light corresponding to a collimated image into the first lightguide region to propagate via internal reflection at the pair of parallel faces to be gradually redirected by reflection at the first set of partially reflective internal surfaces to propagate within the second lightguide region by internal reflection at the pair of parallel faces and to be gradually redirected by the second set of partially reflective internal surfaces to be coupled out of the second lightguide region for viewing by the eye; and (c) an optical sensor arrangement coupled to the first light-guiding region and configured to sense at least one wavelength of invisible light, wherein a single partially reflective inner surface or an additional inner surface in the second group of partially reflective inner surfaces is an invisible light coupling-in surface, the invisible light coupling-in surface is configured to at least partially reflect the invisible light so as to couple the invisible light reflected from the eye so as to propagate within the second lightguide region toward the first lightguide region, and all of the second group of partially reflective inner surfaces except the invisible light coupling-in surface are transparent to the invisible light, And wherein a single partially reflective inner surface or an additional inner surface in the first group of partially reflective inner surfaces is an invisible light redirection surface, the invisible light redirection surface is constructed to at least partially reflect the invisible light so as to redirect the invisible light propagating in the first lightguide region toward the optical sensor arrangement, and all of the first group of partially reflective inner surfaces except the invisible light coupling-in surface are transparent to the invisible light.
11. The device according to claim 10, wherein: The first lightguide region and the second lightguide region are regions of a single continuous lightguide.
12. The device according to claim 10, wherein: The first lightguide region also includes a second pair of parallel surfaces perpendicular to the pair of parallel surfaces, thereby defining a rectangular lightguide that supports propagation by quadruple internal reflection.
13. A device for delivering an image to a human eye and deriving a gaze direction of the human eye, the device comprising: (a) A light guide arrangement formed of a transparent material, the light guide arrangement comprising: (i) a first lightguide region having a pair of parallel faces for guiding light by internal reflection, said first lightguide region comprising a first set of partially reflective internal surfaces, and (ii) a second lightguide region having a pair of parallel faces for guiding light by internal reflection, said second lightguide region comprising a second set of partially reflective internal surfaces; (b) an image projector optically coupled to the lightguide arrangement and configured to inject visible light corresponding to a collimated image into the first lightguide region to propagate via internal reflection at the pair of parallel faces to be gradually redirected by reflection at the first set of partially reflective internal surfaces to propagate within the second lightguide region by internal reflection at the pair of parallel faces and to be gradually redirected by the second set of partially reflective internal surfaces to be coupled out of the second lightguide region for viewing by the eye; (c) an optical sensor arrangement coupled to the first light-guiding region and configured to sense at least one wavelength of invisible light; and (d) a dichroic filter that is transparent to visible light and opaque to at least one wavelength of invisible light, the dichroic filter being disposed over a majority of the second lightguide region and avoiding the aperture region to define an invisible light entrance aperture, wherein at least one partially reflective inner surface or an additional inner surface of the second set of partially reflective inner surfaces is configured to at least partially reflect the invisible light to couple into the invisible light reflected from the eye and incident on the invisible light entrance aperture to propagate within the second lightguide region toward the first lightguide region, And wherein at least a majority of the first set of partially reflective interior surfaces are partially reflective to the invisible light to redirect the invisible light propagating within the first lightguide region towards the optical sensor arrangement.
14. The device according to claim 13, wherein: The first lightguide region and the second lightguide region are regions of a single continuous lightguide.
15. The device according to claim 13, wherein: The first lightguide region also includes a second pair of parallel surfaces perpendicular to the pair of parallel surfaces, thereby defining a rectangular lightguide that supports propagation by quadruple internal reflection.
16. The device of claim 13, further comprising an illumination arrangement comprising at least one light source disposed to illuminate the eye with invisible illumination that does not pass through the second lightguide region to reach the eye.
17. A device for tracking the viewing direction of a human eye, the device comprising: (a) a transparent optical element disposed in facing relationship with the eye to allow viewing of a scene; (b) a dichroic rectangular light guide embedded in the transparent optical element, the dichroic rectangular light guide comprising: a first pair of parallel dichroic reflectors that reflect invisible light of at least a first wavelength while being transparent to visible light; and a second pair of parallel dichroic reflectors that reflect invisible light of the at least one first wavelength while being transparent to visible light, the second pair of parallel dichroic reflectors being perpendicular to the first pair of parallel dichroic reflectors to support the invisible light to propagate within the dichroic rectangular light guide by quadruple internal reflection; (c) a planar dichroic in-coupling reflector embedded in the transparent optical element and associated with a first end of the dichroic rectangular lightguide, the in-coupling reflector being obliquely inclined relative to both the first pair of parallel dichroic reflectors and the second pair of parallel dichroic reflectors and being configured to in-couple invisible light reflected from the eye for propagation within the dichroic rectangular lightguide while being transparent to visible light; and (d) an optical sensing arrangement associated with the second end of the dichroic rectangular light guide and disposed to sense the invisible light.
