Eye movement tracking system and near-eye display device

Abstract

Provided in the present application are an eye movement tracking system and a near-eye display device, relating to the technical field of display. The eye movement tracking system comprises a light source, a deflection structure, and acquisition modules. The light source, the deflection structure, and the acquisition modules form a plurality of different imaging channels. The eye movement tracking system is configured as: the light source emitting light rays towards an eyeball; the deflection structure acquiring reflected light reflected by the eyeball, and forming a plurality of different output light rays towards the plurality of acquisition modules; and the acquisition modules respectively acquiring corresponding output light rays, so as to form the plurality of different imaging channels. The present application can enable the brightness of eyeball images acquired by eye movement tracking systems to be more uniform, thereby improving the accuracy of eyeball images.

Description

Eye-tracking systems and near-eye display devices

[0001] This application claims priority to Chinese Patent Application No. 202410942645.0, filed on July 12, 2024, entitled "Eye Tracking System and Near-Eye Display Device", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of display technology, and more particularly to eye-tracking systems and near-eye display devices. Background Technology

[0003] Eye-tracking systems are a crucial component of near-eye display devices. They create a light spot on the user's cornea using a light source and acquire images of the user's eyes through an image acquisition module, thereby determining the user's gaze direction. However, eye-tracking systems often produce eye images with uneven brightness and poor accuracy. Summary of the Invention

[0004] This application provides an eye-tracking system and a near-eye display device to solve the problems of uneven brightness and poor accuracy of eye images acquired by the eye-tracking system.

[0005] In a first aspect, this application discloses an eye-tracking system, including a light source, a deflection structure, and an acquisition module, wherein the light source, the deflection structure, and the acquisition module form multiple different imaging channels, and the eye-tracking system is configured as follows:

[0006] The light source emits light toward the eyeball; the deflection structure acquires the reflected light after it passes through the eyeball and forms multiple different output light rays toward the multiple acquisition modules; each acquisition module acquires the corresponding output light ray to form multiple different imaging channels.

[0007] By adopting the above technical solution, the eye-tracking system of this application embodiment includes a light source, a deflection structure, and multiple acquisition modules. The light source, deflection structure, and multiple acquisition modules form multiple different imaging channels, thereby enabling the acquisition of eye images of the user from multiple angles through different imaging channels.

[0008] When determining the user's gaze direction through an eye-tracking system, the light source emits light towards the eyeball, allowing the light to be reflected by the eyeball to form reflected light. The deflection structure can capture the reflected light reflected by the eyeball and form multiple different output light rays towards multiple acquisition modules. Each acquisition module acquires the corresponding output light ray, thereby forming multiple eyeball images through different output light rays, making the brightness of the eyeball images acquired by the eye-tracking system more uniform.

[0009] Compared to the single imaging channel implementation in related technologies, the eye-tracking system of this application embodiment has multiple imaging channels, thereby enabling the acquisition of eye images from different angles through different output light from multiple imaging channels. This improves the angular accuracy of the eye images acquired by the eye-tracking system, realizes multi-angle imaging and stereoscopic imaging of the eye, and increases the shooting range of the eye by the eye-tracking system, thus improving the accuracy of the eye images.

[0010] In some possible implementations, in the plurality of imaging channels, at least two of the imaging channels have different wavelengths of output light;

[0011] And / or, in the plurality of imaging channels, at least two of the imaging channels have different off-axis angles for the output rays.

[0012] In some possible implementations, the deflection structure includes a deflection section for forming output light of different wavelengths, so that the output light in the plurality of imaging channels has different wavelengths.

[0013] In some possible implementations, the number of deflection sections is set to multiple, and the wavelength selectivity of the multiple deflection sections is different. The deflection sections are arranged one-to-one with the acquisition module to form the imaging channel.

[0014] In each of the imaging channels, the deflection unit acquires the reflected light reflected by the eyeball and forms the output light of the corresponding wavelength toward the corresponding acquisition module.

[0015] In some possible implementations, the deflection section is configured as a multi-wavelength deflection section, which generates multiple output beams of different wavelengths.

[0016] In some possible implementations, the deflection structure includes a deflection section for forming output rays with different off-axis angles, so that the off-axis angles of the output rays in the plurality of imaging channels are different.

[0017] In some possible implementations, the number of the deflection parts is set to multiple, the multiple deflection parts have different angle selectivity, and the deflection parts are set one-to-one with the acquisition module to form the imaging channel;

[0018] In each of the imaging channels, the deflection unit acquires the reflected light reflected by the eyeball and forms the output light with a corresponding off-axis angle toward the corresponding acquisition module.

[0019] In some possible implementations, the deflection structure further includes a waveguide structure, which is at least used to form the imaging channel;

[0020] In the imaging channel including the waveguide structure, the waveguide structure receives the output light from the deflection section, and the waveguide structure reflects the output light to the acquisition module;

[0021] The first surface of the waveguide structure is directed toward the eyeball and is connected to the deflection portion; and / or, the second surface of the waveguide structure is directed away from the eyeball and is connected to the deflection portion.

[0022] In some possible implementations, the deflection section is configured as a multi-wavelength deflection section, which forms multiple output beams of different wavelengths, and the multi-wavelength deflection section is disposed on the first or second surface of the waveguide structure;

[0023] Alternatively, the number of deflection sections can be set to multiple, with different wavelength selectivity for the multiple deflection sections, and the deflection sections can be arranged on the same side or opposite side of the waveguide structure.

[0024] Alternatively, the number of deflection sections can be set to multiple, with different angle selections for the multiple deflection sections, and the deflection sections can be arranged on the same side or opposite side of the waveguide structure.

[0025] In some possible implementations, the deflection portion is configured as an in-line holographic element; the eye-tracking system further includes an out-line holographic element, the in-line holographic element and the out-line holographic element forming the imaging channel, the out-line holographic element forming at least a portion of the propagation medium between the waveguide structure and the acquisition module;

[0026] In the imaging channel including the coupled-in holographic element and the coupled-out holographic element, the coupled-in holographic element couples reflected light from the eyeball into the waveguide structure so that the reflected light undergoes total internal reflection through the waveguide structure to form the output light; the coupled-out holographic element couples the output light from the waveguide structure to the acquisition module.

[0027] In some possible implementations, the number of the coupled holographic elements is set to multiple, and the coupled holographic elements are configured one-to-one with the acquisition module to form the imaging channel;

[0028] Alternatively, the number of the coupled holographic elements is set to one, and the coupled holographic elements form different output rays toward multiple acquisition modules to form multiple imaging channels.

[0029] In some possible implementations, the propagation medium between the waveguide structure and the acquisition module is set to air;

[0030] In the imaging channel including the waveguide structure, the output light reflected from the waveguide structure propagates through the air to the acquisition module.

[0031] In some possible implementations, the propagation medium between the deflection unit and the acquisition module is set to air;

[0032] In the imaging channel, the output light from the deflector propagates through the air to the acquisition module.

[0033] In some possible implementations, the plurality of acquisition modules are arranged on the same side of the eyeball; or, the plurality of acquisition modules are arranged on opposite sides of the eyeball.

[0034] The acquisition module includes one or more of a camera, scanner, and photoelectric sensor.

[0035] Secondly, this application discloses a near-eye display device, including the eye-tracking system described in any of the above claims.

[0036] Since the near-eye display device includes any of the above-mentioned eye-tracking systems, the advantages of including any of the above-mentioned eye-tracking systems can be found in the relevant descriptions above, and will not be repeated here. Attached Figure Description

[0037] Figure 1 is a schematic diagram of a near-eye display device including an eye-tracking system according to some embodiments of this application;

[0038] Figure 2 is a schematic diagram of some embodiments of this application, including two deflection sections and multiple imaging channels with different output light wavelengths;

[0039] Figure 3 is a schematic diagram of multiple imaging channels including a multi-wavelength deflection section and output light wavelengths of different embodiments of this application;

[0040] Figure 4 is a schematic diagram of some embodiments of this application, including two deflection parts and multiple imaging channels with different off-axis angles of the output light rays;

[0041] Figure 5 is a schematic diagram of an imaging channel in some embodiments of this application, in which one imaging channel has a waveguide structure and the other imaging channel does not have a waveguide structure.

[0042] Figure 6 is a schematic diagram of an imaging channel in some embodiments of this application, in which one imaging channel has a coupled holographic element and the other imaging channel does not have a coupled holographic element.

[0043] Figure 7 is a schematic diagram of multiple imaging channels including an integrated coupled holographic element according to some embodiments of this application;

[0044] Figure 8 is a schematic diagram of an imaging channel including a light source, an eyeball, a deflection part, a waveguide structure, a coupled holographic element, and an acquisition module, according to some embodiments of this application.

[0045] Figure 9 is a schematic diagram of an imaging channel including a light source, an eyeball, a deflection section, a waveguide structure, air, and an acquisition module, according to some embodiments of this application.

[0046] Figure 10 is a schematic diagram of an imaging channel including a light source, an eyeball, a deflection part, a waveguide structure, and an acquisition module, according to some embodiments of this application.

[0047] Figure 11 is a schematic diagram of an imaging channel including a light source, an eyeball, a deflection unit, air, and an acquisition module, according to some embodiments of this application;

[0048] Figure 12 is a schematic diagram of an eye-tracking system according to Embodiment 1 in some embodiments of this application;

[0049] Figure 13 is a schematic diagram of the eye-tracking system according to Embodiment 2 in some embodiments of this application;

[0050] Figure 14 is a schematic diagram of the eye-tracking system of Embodiment 3 in some embodiments of this application;

[0051] Figure 15 is a schematic diagram of the eye-tracking system of Embodiment 4 in some embodiments of this application;

[0052] Figure 16 is a schematic diagram of the eye-tracking system of Embodiment 5 in some embodiments of this application;

[0053] Figure 17 is a schematic diagram of the eye-tracking system of Embodiment 6 in some embodiments of this application;

[0054] Figure 18 is a schematic diagram of the eye-tracking system of Embodiment 7 in some embodiments of this application.

[0055] Explanation of reference numerals in the attached figures: 1. Eyeball; 2. Frame; 10. Imaging channel; 100. Light source; 200. Deflection structure; 210. Deflection part; 210a. First deflection part; 210b. Second deflection part; 210c. Multi-wavelength deflection part; 220. Waveguide structure; 300. Coupled-out holographic element; 300a. First coupled-out holographic element; 300b. Second coupled-out holographic element; 300c. Integrated coupled-out holographic element; 400. Acquisition module; 410. First acquisition element; 420. Second acquisition element; 421. Light sensor; 422. Scanner.

[0056] The accompanying drawings illustrate specific embodiments of this application, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concept of this application to those skilled in the art through reference to particular embodiments. Detailed Implementation

[0057] As described in the background section, eye-tracking systems use a light source to create a light spot on the user's cornea and acquire images of the user's eyes through an image acquisition module, thereby determining the user's gaze direction. However, since eye-tracking systems in related technologies are typically configured with a single imaging channel, when the user's eyes move, the pupil and the light spot shift due to the single imaging channel. This causes the imaging channel to be unable to acquire the optimal imaging angle for the eye image, resulting in poor accuracy of the eye image.

[0058] Furthermore, in order to ensure the display effect of near-eye display devices, the light source and acquisition module are usually set at a position that is off-axis from the user's visual axis. This results in a large off-axis angle for the eye tracking system, poor angular accuracy of the eye tracking system, and the angular accuracy of the off-axis eye tracking system is easily affected by the tilt of the light source, which causes uneven brightness in the eye image acquired by the image acquisition module.

[0059] To address the aforementioned technical problems, this application provides an eye-tracking system and a near-eye display device. The eye-tracking system includes a light source, a deflection structure, and an acquisition module. The light source, deflection structure, and acquisition module form multiple different imaging channels, thereby enabling the acquisition of eye images from multiple angles of the user through different imaging channels.

[0060] When determining the user's gaze direction using an eye-tracking system, a light source emits light towards the eyeball, allowing the light to be reflected by the eyeball to form reflected light. A deflection structure can capture the reflected light and direct it towards the acquisition module to form various different output light beams. Each acquisition module acquires its corresponding output light beam, thereby forming multiple eyeball images through different output light beams. In some embodiments, these differences may include, but are not limited to, different wavelengths, different off-axis angles, or both different wavelengths and off-axis angles.

[0061] Compared to the single imaging channel implementation in related technologies, the eye-tracking system of this application embodiment has multiple imaging channels, thereby enabling the acquisition of eye images from different angles through different output light from multiple imaging channels. This improves the angular accuracy of the eye images acquired by the eye-tracking system, realizes multi-angle imaging and stereoscopic imaging of the eye, and increases the shooting range of the eye by the eye-tracking system, thus improving the accuracy of the eye images.

[0062] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0063] The technical solution of this application and how the technical solution of this application solves the above-mentioned technical problems are described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. The embodiments of this application will now be described with reference to the accompanying drawings.

[0064] Referring to Figures 1 and 2, this application embodiment provides an eye-tracking system, including a light source 100, a deflection structure 200, and an acquisition module 400. The light source 100, the deflection structure 200, and the acquisition module 400 form multiple different imaging channels 10, thereby enabling the acquisition of eye images of the user from multiple angles through different imaging channels 10. In some embodiments, the multiple channels may be two, three, or more, depending on actual needs, which will not be elaborated here.

[0065] The eye-tracking system is configured such that when the user's gaze direction is determined by the eye-tracking system, the light source 100 emits light towards the eyeball 1, so that the light can be reflected by the eyeball 1 to form reflected light. The deflection structure 200 can acquire the reflected light reflected by the eyeball 1 and form a variety of different output light rays towards the acquisition module 400. The acquisition module 400 acquires the corresponding output light rays, thereby forming multiple eyeball images through different output light rays.

[0066] The eye image can also be an iris image. When multiple eye images are formed using different output light rays, some of the eye images can also be set as iris images to broaden the application of the eye-tracking system.

[0067] It should be noted that in some embodiments of this application, the multiple imaging channels 10 of the eye-tracking system are not simply achieved by increasing the number of light sources 100 and acquisition modules 400. For example, an eye-tracking system with multiple light sources 100 and multiple acquisition modules 400 can be compared with the eye-tracking system of the embodiments of this application in a comparative manner, as follows:

[0068] In the comparison method, multiple light sources 100 and multiple acquisition modules 400 can be matched one-to-one. The multiple acquisition modules 400 are set in different positions and face the eyeball 1 at different angles, so that the light from the light source 100 can be reflected by the eyeball 1 and enter the corresponding acquisition module 400, so as to acquire eyeball images at different angles through the cooperation of multiple light sources 100 and multiple acquisition modules 400.

[0069] In contrast, the eye-tracking system of this application fully utilizes the physical characteristics of the device and combines them with optical principles to form imaging channels with different optical performance to acquire multiple eye images. For example, by utilizing characteristics such as wavelength selectivity and off-axis angle of light, different imaging channels 10 output light with different optical performance, so that multiple imaging channels 10 form different eye images.

[0070] In some embodiments of this application, the light emitted by the light source 100 toward the eyeball 1 can be the same, so that the light can be reflected by the eyeball 1 to form reflected light. The deflection structure 200 can acquire the reflected light reflected by the eyeball 1 and form a variety of output light with different parameters toward the acquisition module 400, thereby acquiring eyeball images at different angles through different imaging channels 10 to realize optical functions such as stereoscopic imaging, gaze point tracking, and iris imaging of the eyeball 1.

[0071] It is easy to understand that, compared with the comparison method, the light source 100 used in the imaging channel 10 of this application embodiment can be the same or different, and the emission method of the light source 100 is more flexible.

[0072] In the comparison method, the propagation direction of light corresponding to different positions of the acquisition module 400 is different, and the light emission direction corresponding to each acquisition module 400 is different. When the wavelength of the light is constant, and the position of the light source 100 and the emission angle of the light are the same, the propagation path of the light is also the same. When the propagation direction of the light remains unchanged, the light always enters the acquisition module 400 at the same position.

[0073] In other words, even if a light source 100 can be used to emit light in multiple directions, the direction of light emission must correspond to the position of the acquisition module 400. The optical axis of the light must be determined according to the position of the acquisition module 400 in order to ensure that the light emitted by the light source 100 can enter the corresponding acquisition module 400 after being reflected by the eyeball 1.

[0074] It should be noted that in some embodiments of this application, the light wavelength of the multiple imaging channels 10, the off-axis angle of the deflection structure 200, and at least one of other imaging parameters affecting the imaging channels 10 are different.

[0075] In the comparison method, although multiple light sources 100 and acquisition modules 400 are set, the wavelength of light is not limited, the off-axis angle of the deflection structure 200 is not limited, and other imaging parameters that affect the imaging channel 10 are not limited. The comparison method forms an identical or nearly identical imaging channel 10, and cannot constitute multiple imaging channels 10.

[0076] The specific reason is as follows: Since the assembly space of the eye tracking system is limited, and the obstruction of the eyeball by the light source 100 and the acquisition module 400 should not be too large, when the number of light source 100 and acquisition module 400 is set to multiple in order to acquire eyeball images from different angles, the assembly space of multiple light source 100 and multiple acquisition module 400 will be further compressed, making it difficult for the eye tracking system to acquire eyeball images from some angles.

[0077] In other words, the assembly space of the eye-tracking system is limited, and the installation area available for the light source 100 and the acquisition module 400 is relatively limited. Within the limited installation area, the field of view and shooting range of the multiple acquisition modules 400 relative to the eyeball are small and relatively fixed, and the imaging angles of the acquisition modules 400 relative to different eye structures in the eyeball are not comprehensive enough.

[0078] For example, imaging parameters such as the optimal imaging angle and optimal imaging wavelength are usually different for different eye structures. An acquisition module that matches the optimal imaging angle for a certain eye structure may need to be placed in a non-installation area. This makes it impossible for the acquisition module 400 within the limited installation area to acquire the optimal eye image of the aforementioned eye structure. Therefore, increasing the number of light sources 100 and acquisition modules 400 within the limited installation area will not result in acquiring the optimal eye image of the aforementioned eye structure.

[0079] In some embodiments of this application, multiple imaging channels 10 are obtained by changing the parameters affecting the imaging channels 10, such as changing the wavelength of light and the off-axis angle of the deflection structure 200, to obtain eye images of multiple angles and multiple eye structures.

[0080] Although the acquisition modules 400 of multiple imaging channels 10 in some embodiments of this application are still arranged in the installation area, due to the change in the parameters of the imaging channels 10, the field of view and shooting range of at least some acquisition modules 400 relative to the eyeball will also change compared to the comparison method, so that at least some acquisition modules 400 have different and more flexible field of view and shooting range compared to the comparison method.

[0081] Compared to the comparative method where multiple acquisition modules 400 have a limited field of view and imaging range relative to the eyeball, the multiple acquisition modules 400 in some embodiments of this application have a more flexible field of view and imaging range, making it easier for the acquisition modules 400 arranged within the installation area to acquire optimal eyeball images of the eye structure. Therefore, the multiple imaging channels 10 in some embodiments of this application are different from those in the comparative method.

[0082] Furthermore, in some embodiments of this application, the number of multiple imaging channels 10 may be increased or reduced by little. In contrast, increasing the number of light sources 100 and acquisition modules 400 in the comparative method cannot achieve the function of multiple imaging channels 10 in some embodiments of this application, and therefore cannot be regarded as constituting multiple imaging channels 10.

[0083] Furthermore, eye-tracking systems are typically installed on mobile devices such as near-eye display devices. Since eye-tracking systems have multiple light sources 100, they will further increase the energy consumption of both the eye-tracking system and the near-eye display device, affecting the battery life of the near-eye display device.

[0084] In some embodiments of this application, multiple imaging channels 10 can achieve frontal imaging of the eyeball and iris, avoiding obstruction of the imaging image by other eye tissues, thus improving the integrity of the imaging image. At the same time, the frontal imaging effect also improves the accuracy of post-processing gaze point tracking and iris recognition, which is not available in the comparison method.

[0085] Referring to Figures 1 and 2, in some possible embodiments, the light source 100 may be disposed on structures such as the frame 2 and lenses. The light source 100 may be used to emit infrared light, which may be directed toward the eyeball 1 of the human eye.

[0086] Because the cornea and sclera of the human eye have different reflectivities for infrared light, with the cornea having a higher reflectivity and the sclera having a lower reflectivity, infrared light can be reflected only at the cornea to form a clear spot. Therefore, the position of the cornea can be determined by the infrared spot, and then the direction of the visual axis of the human eye, i.e. the direction of the human eye's line of sight, can be determined based on the position of the cornea.

[0087] The light source 100 may include one or more of a near-infrared illumination source 100, an infrared illumination source 100, and a vertical-cavity surface-emitting laser. The near-infrared illumination source 100 operates at a wavelength of 850 nm or 940 nm and may also employ a light-emitting diode (LED) to illuminate the eyeball 1, thereby providing supplemental illumination for the eye image. The infrared illumination source 100 uses a wavelength of 1350 nm, thereby providing supplemental illumination for the iris image.

[0088] In some possible implementations, at least two of the imaging channels 10 may have different wavelengths of output light.

[0089] Figures 2-7 are schematic diagrams of several imaging channels provided in the embodiments of this application. The dashed lines and arrows can be used to indicate light of one wavelength, while the solid lines and arrows can be used to indicate light of another wavelength, thus distinguishing between two different wavelengths of light.

[0090] Referring to Figures 2 and 3, in some possible embodiments, the light emitted by the light source 100 toward the eyeball 1 may have different wavelengths. Multiple wavelengths of light are mixed and enter the eyeball 1, and after being reflected by the eyeball 1, they enter the deflection structure 200.

[0091] The deflection structure 200 may include a deflection section 210. The deflection section 210 is capable of receiving light reflected from the eyeball 1. Since the reflected light entering the deflection section 210 contains light of various wavelengths, the deflection section 210 can select and output light of different wavelengths. The deflection section 210 can deflect light of different wavelengths in different directions, thereby making the output light wavelengths in the multiple imaging channels 10 different. The output light of different wavelengths in the imaging channels 10 can enter different acquisition modules 400 to form different eyeball images.

[0092] For example, the deflection unit 210 can be configured as a volume holographic optical element (VHOE). The volume holographic optical element has wavelength selectivity, that is, the volume holographic optical element can receive light of different wavelengths from the eyeball 1, and can perform off-axis propagation, off-axis imaging and light deflection on light of a specific wavelength, so that light of a specific wavelength can form output light.

[0093] Volume holographic optical elements are suitable for use in near-eye display devices such as Virtual Reality Head-Mounted Display (VR HMD), Augmented Reality Head-Mounted Display (AR HMD), and Mixed Reality Head-Mounted Display (MR HMD).

[0094] By setting the deflection unit 210 as a volume holographic optical element, it is possible to selectively deflect light of different wavelengths from the eyeball 1. Light of a specific wavelength can be deflected to a set position, thereby enabling the acquisition module 400 to be set at the set position so that light of a specific wavelength can be accurately incident at the set position, thus forming an eyeball image.

[0095] Alternatively, the deflection section 210 can be configured as one or more of the following devices: polarizer holographic optical element (PVH), meta surface / material device, surface relief grating (SRG), and coupling prism.

[0096] For example, the deflection section 210 can be configured as a volume holographic optical element. Volume holographic optical elements are characterized by their thinness and lightness, with a thickness of less than 20 micrometers, and have higher integration density compared to other coupled optical devices. Furthermore, by changing the dielectric constant of the volume holographic optical element, it can be made to have different wavelength selectivity, allowing the volume holographic light element to form output light of the corresponding wavelength towards the corresponding acquisition module 400.

[0097] Referring to Figure 2, by way of example, the number of deflection sections 210 can be set to multiple. The multiple deflection sections 210 have different wavelength selectivity, and the deflection sections 210 and the acquisition module 400 can be set one-to-one to form an imaging channel 10.

[0098] In each imaging channel 10, the deflection unit 210 acquires the reflected light reflected by the eyeball 1. The deflection unit 210 can propagate and refract light of a specific wavelength, thereby forming an output light of the corresponding wavelength toward the corresponding acquisition module 400, so that multiple imaging channels 10 can form multiple eyeball images at different angles.

[0099] For example, in an eye-tracking system, the number of imaging channels 10 can be set to two, with the output light wavelength of one imaging channel 10 being 850 nanometers and the output light wavelength of the other imaging channel 10 being 1350 nanometers.

[0100] The volume holographic optical element forming the deflection section 210 has wavelength selectivity. The spectral angle of the volume holographic optical element operating at 850 nm and 1350 nm in the visible light band does not cover the line of sight directly in front of the human eye. This allows the deflection section 210 to be placed on the front side of the eyeball, making the frontal image of the eyeball acquired by the eye-tracking system clearer, and without affecting the display effect of the near-eye display device.

[0101] The number of deflection units 210 can be set to two. One deflection unit 210 can be used to perform off-axis propagation, off-axis imaging and light deflection for light with a wavelength of 850 nanometers, and the other deflection unit 210 can be used to perform off-axis propagation, off-axis imaging and light deflection for light with a wavelength of 1350 nanometers.

[0102] It is easy to understand that the two imaging channels 10 can share the same light source 100. The same light source 100 can emit light towards the eyeball 1, and each imaging channel 10 has a deflection part 210. The deflection part 210 can deflect the output light of the corresponding imaging channel 10 so that the two imaging channels 10 do not interfere with each other and ensure the imaging effect of the eyeball image.

[0103] When determining the user's gaze direction through the eye-tracking system, the deflection structure 200 acquires the reflected light reflected by the eyeball 1. One deflection unit 210 can deflect light with a wavelength of 850 nanometers toward an acquisition module 400 to form one type of output light, and another deflection unit 210 can deflect light with a wavelength of 1350 nanometers toward an acquisition module 400 to form another type of output light. Each acquisition module 400 acquires the corresponding output light. The two types of output light with wavelengths of 850 nanometers and 1350 nanometers are respectively injected into an acquisition module 400, so that output light of different wavelengths can be formed through multiple deflection units 210 to form eyeball images at different angles.

[0104] Referring to Figure 3, the deflection section 210 can be configured as a multi-wavelength deflection section 210c, by way of example. The multi-wavelength deflection section 210c can generate output light with multiple wavelengths.

[0105] The multi-wavelength deflector 210c can be reused in multiple imaging channels 10 to improve the integration of the eye-tracking system. Compared with multiple deflectors used separately, it can also reduce the ambient light loss of the multi-wavelength deflector 210c (i.e., the in-line coupled optical element), thereby improving the clarity of the user's natural field of vision.

[0106] For example, the multi-wavelength deflection unit 210c can be used for off-axis propagation, off-axis imaging and light deflection of light with a wavelength of 850 nanometers, and can also be used for off-axis propagation, off-axis imaging and light deflection of light with a wavelength of 1350 nanometers.

[0107] The multi-wavelength deflection section 210c can be configured as a multiplexed structure. For example, multiple optical functions can be multiplexed using a single-layer volume holographic optical element.

[0108] In terms of device structure, this multiplexing is manifested in the localized complex three-dimensional spatial periodic structure of the dielectric constant distribution. In terms of optical effects, this multiplexing is manifested in the presence of multiple central propagation wavelengths, resulting in diffraction at multiple propagation angles, and the equivalent lens having multiple focal lengths, etc.

[0109] In terms of device functionality, a single device can achieve off-axis propagation imaging of 1850 nm eyeball images and 1350 nm iris images. It can also realize the multiplexing of transmissive and reflective volume holographic optical elements, and simultaneously achieve eye tracking under PSOG and video detection systems, realize off-axis lenses with different equivalent scaling ratios, and propagate images in different directions.

[0110] By configuring the multi-wavelength deflection section 210c as a multiplexing structure, the integration of the system can be effectively improved. Furthermore, the multiplexing structure can be integrated directly in front of the human eye, thereby enabling the acquisition of a clear image of the eyeball 1 and improving the accuracy of the eyeball image.

[0111] When determining the user's gaze direction through the eye-tracking system, the deflection structure 200 acquires the reflected light reflected by the eyeball 1. The multi-wavelength deflection unit 210c can deflect light with a wavelength of 850 nanometers toward an acquisition module 400 to form one output light. The multi-wavelength deflection unit 210c can deflect light with a wavelength of 1350 nanometers toward an acquisition module 400 to form another output light. Each acquisition module 400 acquires the corresponding output light. The two output lights with wavelengths of 850 nanometers and 1350 nanometers are respectively injected into an acquisition module 400, so that different wavelengths of output light can be formed by the multi-wavelength deflection unit 210c to form eyeball images at different angles.

[0112] By replacing multiple deflection sections with a multi-wavelength deflection section 210c (i.e., an ingress-coupled optical element), zoom imaging is achieved, thereby enabling simultaneous clear forward imaging of both the overall image of the human eye and the iris image. Compared to a non-multiplexed structure, this reduces the ambient light loss of the ingress-coupled optical element and improves the clarity of the user's natural field of vision. Referring to FIG4, in some possible embodiments, at least two of the imaging channels 10 may have different off-axis angles for their output rays, allowing the multiple imaging channels 10 to form multiple eye images at different angles.

[0113] For example, the deflection section 210 is used at least to form output light rays with different off-axis angles so that the off-axis angles of the output light rays in the plurality of imaging channels 10 are different.

[0114] The number of deflection sections 210 can be set to one or more. When there are multiple deflection sections 210, the angle selectivity of the multiple deflection sections 210 is different. The deflection sections 210 are set one-to-one with the acquisition module 400 to form the imaging channel 10.

[0115] In each imaging channel 10, the deflection unit 210 has different angle selectivity. The deflection unit 210 acquires the reflected light reflected by the eyeball 1 and forms an output light with a corresponding off-axis angle toward the corresponding acquisition module 400.

[0116] In some possible implementations, the deflection structure 200 may further include a waveguide structure 220. The waveguide structure 220 may at least be used to form the imaging channel 10. In the imaging channel 10, the waveguide structure 220 may form a propagation medium between the deflection section 210 and the acquisition module 400, that is, the output light from the deflection section 210 can propagate to the acquisition module 400 through the waveguide structure 220 to achieve off-axis propagation of the output light.

[0117] For example, in the imaging channel 10 including the waveguide structure 220, the waveguide structure 220 receives the output light from the deflection section 210 and reflects the output light to the acquisition module 400.

[0118] It should be noted that in the imaging channel 10 including the waveguide structure 220, the output light from the deflection section 210 can achieve total internal reflection within the waveguide structure 220, thereby propagating through the waveguide structure 220 to the acquisition module 400, so as to realize off-axis propagation of the output light.

[0119] The working medium of the waveguide structure 220 can be set as a high refractive index visible light transparent material such as glass or resin. The off-axis angle of the output light emitted from the refractive part needs to meet the total internal reflection condition in the waveguide, and the minimum off-axis angle of the output light needs to be greater than the total internal reflection condition of the waveguide structure 220.

[0120] Waveguide structure 220 can be used to connect to deflection section 210. For example, the first surface of waveguide structure 220 can be oriented towards eyeball 1, and the first surface of waveguide structure 220 can be connected to deflection section 210. And / or, the second surface of waveguide structure 220 can be away from eyeball 1, and the second surface of waveguide structure 220 can be connected to deflection section 210.

[0121] Referring to FIG3, in some possible embodiments, the number of deflection sections 210 may be set to one, and the deflection section 210 may be set to a multi-wavelength deflection section 210c.

[0122] The multi-wavelength deflection section 210c can be disposed on the first or second surface of the waveguide structure 220 so that the multi-wavelength deflection section 210c can be supported and installed by the waveguide structure 220, making the installation of the multi-wavelength deflection section 210c more convenient, and allowing the output light of different wavelengths from the multi-wavelength deflection section 210c to propagate to the corresponding acquisition module 400 after total reflection by the waveguide structure 220.

[0123] Referring to FIG2, in some other possible embodiments, the number of deflection sections 210 can be set to multiple, and the multiple deflection sections 210 have different wavelength selectivity. The deflection sections 210 can be arranged on the same side or opposite side of the waveguide structure 220.

[0124] Multiple deflection sections 210 with different wavelength selectivity can be arranged on the same side relative to the waveguide structure 220, and the multiple deflection sections 210 can be arranged on the first surface or the second surface of the waveguide structure 220.

[0125] Alternatively, multiple deflection sections 210 with different wavelength selectivity can be disposed on opposite sides of the waveguide structure 220, some of the multiple deflection sections 210 can be disposed on the first surface of the waveguide structure 220, and some of the multiple deflection sections 210 can be disposed on the second surface of the waveguide structure 220.

[0126] The waveguide structure 220 supports and installs multiple deflection sections 210 with different wavelength selectivity, making the installation of the deflection sections 210 more convenient, and allowing the output light of different wavelengths from different deflection sections 210 to propagate to the corresponding acquisition module 400 after total reflection by the waveguide structure 220.

[0127] In some other possible implementations, the number of deflection sections 210 is set to multiple, and the angle selectivity of the multiple deflection sections 210 is different. The deflection sections 210 can be arranged on the same side or opposite side of the waveguide structure 220.

[0128] The waveguide structure 220 supports multiple deflection sections 210 with different installation angles, making the installation of the deflection sections 210 more convenient and enabling the output light of different wavelengths from different deflection sections 210 to propagate to the corresponding acquisition module 400 after total reflection by the waveguide structure 220.

[0129] Multiple deflection sections 210 with different angle selectivity can be arranged on the same side relative to the waveguide structure 220, and the multiple deflection sections 210 can be arranged on the first surface or the second surface of the waveguide structure 220.

[0130] Alternatively, multiple deflection portions 210 with different angle selectivity can be arranged on opposite sides of the waveguide structure 220, some of the multiple deflection portions 210 can be arranged on the first surface of the waveguide structure 220, and some of the multiple deflection portions 210 can be arranged on the second surface of the waveguide structure 220.

[0131] It is easy to understand that the deflection part 210 can be disposed on the side of the waveguide structure 220 along the thickness direction to reduce the occupation of the deflection part 210 on the surface of the waveguide structure 220, so that the installation of the deflection part 210 will not affect the size of the lens, and further improve the display effect of the eye tracking system.

[0132] When the number of deflection parts 210 is set to one, the deflection part 210 can be located on the left or right side of the eyeball 1, or the deflection part 210 can also be located on the front side of the eyeball 1.

[0133] When the number of deflection parts 210 is set to multiple, the multiple deflection parts 210 can be arranged on the same side relative to the eyeball 1. For example, the multiple deflection parts 210 can be arranged on the left or right side of the eyeball 1.

[0134] Alternatively, the multiple deflection portions 210 may be arranged on opposite sides of the eyeball 1. For example, some of the multiple deflection portions 210 may be arranged on the left side of the eyeball 1, and the remaining deflection portions 210 may be arranged on the right side of the eyeball 1.

[0135] Alternatively, one of the multiple deflection portions 210 may be located on the front side of the eyeball 1, while the other deflection portions 210 may be located on the same side or opposite side of the eyeball 1.

[0136] In some possible implementations, the deflection section 210 may be configured as an embedded holographic element.

[0137] Referring to Figures 2 and 3, the eye-tracking system may further include an outgoing holographic element 300. The incoming holographic element and the outgoing holographic element 300 may form an imaging channel 10, and the outgoing holographic element 300 may form at least a portion of the propagation medium between the waveguide structure 220 and the acquisition module 400.

[0138] In the imaging channel 10, which includes an input holographic element and an output holographic element 300, the input holographic element couples reflected light from the eyeball 1 into the waveguide structure 220, so that the reflected light undergoes total internal reflection through the waveguide structure 220 to form an output light beam. The output holographic element 300 couples the output light beam from the waveguide structure 220 to the acquisition module 400, so that the output light beam enters the corresponding acquisition module 400.

[0139] The coupled holographic element 300 can be configured as one or more of the following: volume holographic optical element, polarizing volume holographic optical element, metasurface / material device, surface relief grating, and coupling prism.

[0140] For example, the number of outgoing holographic elements 300 can be set to multiple, and the outgoing holographic elements 300 are set one-to-one with the incoming holographic elements and the acquisition module 400 to form an imaging channel 10.

[0141] Alternatively, referring to Figure 5, the number of coupled holographic elements 300 is set to one, and the coupled holographic elements 300 form different output rays toward multiple acquisition modules 400 to form multiple imaging channels 10.

[0142] In multiple imaging channels 10 with different output light wavelengths, the coupled holographic element can couple the reflected light from the eyeball 1 into the waveguide structure 220, so that the reflected light undergoes total internal reflection through the waveguide structure 220 to form output light with different wavelengths. The corresponding coupled holographic element 300 couples the output light with different wavelengths from the waveguide structure 220 to the corresponding acquisition module 400, so that the output light enters the corresponding acquisition module 400.

[0143] In multiple imaging channels 10 with different off-axis angles of output light, the coupled holographic element can couple the reflected light from the eyeball 1 into the waveguide structure 220, so that the reflected light undergoes total internal reflection through the waveguide structure 220 to form output light with different off-axis angles. The corresponding coupled holographic element 300 couples the output light with different off-axis angles from the waveguide structure 220 to the corresponding acquisition module 400, so that the output light enters the corresponding acquisition module 400.

[0144] Referring to Figures 6 and 7, in some possible embodiments, the propagation medium between the waveguide structure 220 and the acquisition module 400 can be set to air. In the imaging channel 10 including the waveguide structure 220, the output light reflected from the waveguide structure 220 propagates through the air to the acquisition module 400.

[0145] In the imaging channel 10, where the output light wavelengths are different and air is the propagation medium, the deflection structure 200 acquires the reflected light reflected by the eyeball 1. The deflection part 210 can couple the reflected light from the eyeball 1 into the waveguide structure 220 so that the reflected light is totally internally reflected by the waveguide structure 220 to form output light with different wavelengths, so that the output light with different wavelengths can propagate through the air to the corresponding acquisition module 400.

[0146] In the imaging channel 10 where the off-axis angles of the output light rays are different and air is used as the propagation medium, the deflection structure 200 acquires the reflected light reflected by the eyeball 1, and the deflection part 210 can couple the reflected light from the eyeball 1 into the waveguide structure 220 so that the reflected light is totally internally reflected by the waveguide structure 220 to form output light rays with different off-axis angles, so that the output light rays with different off-axis angles can propagate through the air to the corresponding acquisition module 400.

[0147] The propagation medium between the deflection unit 210 and the acquisition module 400 can be set to air. In the imaging channel 10 with air as the propagation medium, the output light from the deflection unit 210 propagates through the air to the acquisition module 400.

[0148] It should be noted that the off-axis angle of the output light propagating in the air can be any value. For example, the off-axis angle of the output light in the air can generally be greater than 45°. This allows the output light propagating in the air to reach the acquisition module 400 without passing through the waveguide structure 220, thereby further reducing the number of components required for the eye tracking system and simplifying the structure of the eye tracking system.

[0149] Alternatively, no propagation medium may be provided between the waveguide structure 220 and the acquisition module 400, and the acquisition module 400 may be directly attached to the waveguide structure 220. In the imaging channel 10 including the waveguide structure 220, the output light reflected from the waveguide structure 220 propagates directly to the acquisition module 400, thereby simplifying the structure of the eye-tracking system.

[0150] In some possible implementations, the number of acquisition modules 400 can be set to multiple, and the multiple acquisition modules 400 can be arranged on the same side relative to the eyeball 1. For example, the multiple acquisition modules 400 can be arranged on the left or right side of the eyeball 1.

[0151] Alternatively, the multiple acquisition modules 400 can be arranged opposite to the eyeball 1. For example, some of the acquisition modules 400 can be arranged on the left side of the eyeball 1, and the remaining acquisition modules 400 can be arranged on the right side of the eyeball 1.

[0152] For example, the acquisition module 400 includes one or more of a camera, a scanner 422, and a photoelectric sensor.

[0153] For example, the acquisition module 400 may include a camera and a photodiode. The camera can be used to capture near-infrared images of the eye 1 and its surroundings for eye tracking and capturing eye expressions. The camera can also be used to capture near-infrared images of the iris for functions such as biometrics. The photodiode can be used to capture the intensity of scanning light reflected from the human eye.

[0154] For example, the light source 100 can be configured as a vertical-cavity surface-emitting laser (VCSEL), and the acquisition module 400 can be configured as a microelectromechanical galvanometer scanner 422 and a photoelectric sensor. The VCSEL works in conjunction with the microelectromechanical galvanometer scanner 422, and the light is deflected by the ingress-coupled optical element to scan the eye region 1. The photoelectric sensor measures the intensity of the reflected output light, thereby obtaining an image of the eye.

[0155] Furthermore, the acquisition module 400 can be set in the waveguide structure 220 or the frame 2, so that the installation of the acquisition module 400 will not occupy the display area of ​​the lens.

[0156] In some possible implementations, the eye-tracking system may include a processor. The processor is capable of receiving multiple different eye image signals from the acquisition module 400 and extracting sets of pixel coordinates of eye feature points from the multiple different eye images.

[0157] The processor can calculate the real-world coordinates of the eyeball feature points using binocular parallax algorithms and other methods. It can then correct and calculate the spatial position of the eye's gaze point in the display screen using the real-world coordinates. This allows it to perform functions such as gaze point rendering and eye tracking based on the spatial position of the eye's gaze point in the display screen.

[0158] Compared to eye-tracking systems in related technologies, the eye-tracking system of this application embodiment can accurately measure the gaze point information of the eyeball 1, thus improving the tolerance of the eye-tracking system to different working distances, i.e., the distance from the eyeball 1 to the waveguide structure 220; reducing the sensitivity of the system to environmental factors such as vibration; and improving the accuracy of the system in detecting the gaze point.

[0159] Figures 8-11 illustrate several possible implementations of the imaging channel. Specifically, Figure 8 is a schematic diagram of an imaging channel according to an embodiment of this application, including a light source, an eyeball, a deflection section, a waveguide structure, a coupled holographic element, and an acquisition module; Figure 9 is a schematic diagram of an imaging channel according to an embodiment of this application, including a light source, an eyeball, a deflection section, a waveguide structure, air, and an acquisition module; Figure 10 is a schematic diagram of an imaging channel according to an embodiment of this application, including a light source, an eyeball, a deflection section, a waveguide structure, and an acquisition module; and Figure 11 is a schematic diagram of an imaging channel according to an embodiment of this application, including a light source, an eyeball, a deflection section, air, and an acquisition module.

[0160] Referring to Figures 12-18, in some possible implementations, the specific structure of the eye-tracking system can be described in the following embodiments. It should be noted that the following embodiments are only used to illustrate the relative positional relationship between the deflection structure 200, the acquisition module 400 and the eyeball 1, and are not intended to limit the technical solution of this application to include only the following embodiments.

[0161] For example, in the following embodiments, the number of imaging channels 10 is set to two, and the deflection part 210 (i.e., the coupled holographic element) and the coupled holographic element 300 are both volume holographic light elements. The embodiments of this application will not be described in detail hereafter.

[0162] It is easy to understand that the number of imaging channels 10 can be three or more, and the deflection part 210 (i.e., the coupled holographic element) and the coupled holographic element 300 can also be selected from other structures. The following embodiments are described as examples.

[0163] Implementation Method 1

[0164] Referring to FIG12, an exemplary eye-tracking system includes a light source 100, a deflection structure 200, a coupled holographic element 300, and an acquisition module 400, wherein the propagation medium between the deflection structure 200 and the acquisition module 400 is configured as the coupled holographic element 300.

[0165] The deflection structure 200 includes two deflection sections 210 and a waveguide structure 220. The two deflection sections 210 can be divided into a first deflection section 210a (i.e., VHOE1 in Figure 12) and a second deflection section 210b (i.e., VHOE2 in Figure 12). The angle selectivity of the first deflection section 210a and the second deflection section 210b is different. Both the first deflection section 210a and the second deflection section 210b are disposed on the second surface of the waveguide structure 220, and are located on opposite sides of the eyeball 1.

[0166] The number of coupled holographic elements 300 is set to two, and the two coupled holographic elements 300 are disposed on the second surface of the waveguide structure 220. The two coupled holographic elements 300 are disposed on opposite sides of the eyeball 1.

[0167] The two coupled holographic elements 300 can be divided into a first coupled holographic element 300a (i.e., VHOE3 in Figure 12) and a second coupled holographic element 300b (i.e., VHOE4 in Figure 12). The first coupled holographic element 300a is disposed corresponding to the first deflection part 210a and is disposed on the side of the first deflection part 210a away from the second deflection part 210b. The second coupled holographic element 300b is disposed corresponding to the second deflection part 210b and is disposed on the side of the second deflection part 210b away from the first deflection part 210a.

[0168] The number of acquisition modules 400 is set to two. The two acquisition modules 400 can be divided into a first acquisition element 410 and a second acquisition element 420. The first acquisition element 410 is set to correspond to the first coupled-out holographic element 300a, and the second acquisition element 420 is set to correspond to the second coupled-out holographic element 300b.

[0169] In the first embodiment, the off-axis angles of the output light rays in the two imaging channels 10 are different. When the user's gaze direction is determined by the eye-tracking system, the light source 100 emits light rays toward the eyeball 1, so that the light rays can be reflected by the eyeball 1 to form reflected light. The reflected light propagates through the waveguide structure 220 to the first deflection part 210a and the second deflection part 210b, so that the first deflection part 210a and the second deflection part 210b can acquire the reflected light reflected by the eyeball 1.

[0170] The first deflection section 210a and the second deflection section 210b, which have different angle selectivity, can image the eyeball 1 at different angles and propagate off-axis at different angles. The first deflection section 210a and the second deflection section 210b cause light rays at different off-axis angles to undergo total internal reflection within the waveguide structure 220, so that the waveguide structure 220 can emit output light rays at different off-axis angles. The first acquisition element 410 acquires the output light rays from the first deflection section 210a, and the second acquisition element 420 acquires the output light rays from the second deflection section 210b, thereby enabling the formation of multiple eyeball images through different output light rays.

[0171] Implementation Method 2

[0172] Referring to FIG13, an exemplary eye-tracking system includes a light source 100, a deflection structure 200, a coupled holographic element 300, and an acquisition module 400, wherein the propagation medium between the deflection structure 200 and the acquisition module 400 is configured as the coupled holographic element 300.

[0173] The deflection structure 200 includes two deflection sections 210 and a waveguide structure 220. The two deflection sections 210 can be divided into a first deflection section 210a (i.e., VHOE1 in Figure 13) and a second deflection section 210b (i.e., VHOE2 in Figure 13). The wavelength selectivity of the first deflection section 210a is different from that of the second deflection section 210b.

[0174] The first deflection portion 210a is disposed on the second surface of the waveguide structure 220, the second deflection portion 210b is disposed on the first surface of the waveguide structure 220, and the first deflection portion 210a and the second deflection portion 210b are disposed on the front side of the eyeball 1.

[0175] The number of coupled holographic elements 300 is set to two, and the two coupled holographic elements 300 are disposed on the second surface of the waveguide structure 220. The two coupled holographic elements 300 are disposed on opposite sides of the eyeball 1.

[0176] The two coupled holographic elements 300 can be divided into a first coupled holographic element 300a (i.e., VHOE3 in Figure 13) and a second coupled holographic element 300b (i.e., VHOE4 in Figure 13). The first coupled holographic element 300a is disposed corresponding to the first deflection part 210a and is disposed to the left of the first deflection part 210a. The second coupled holographic element 300b is disposed corresponding to the second deflection part 210b and is disposed to the right of the first deflection part 210a.

[0177] The number of acquisition modules 400 is set to two. The two acquisition modules 400 can be divided into a first acquisition element 410 and a second acquisition element 420. The first acquisition element 410 is set to correspond to the first coupled-out holographic element 300a, and the second acquisition element 420 is set to correspond to the second coupled-out holographic element 300b.

[0178] In the second embodiment, the wavelengths of the output light in the two imaging channels 10 are different. When the user's gaze direction is determined by the eye-tracking system, the light source 100 emits light towards the eyeball 1, so that the light can be reflected by the eyeball 1 to form reflected light. The reflected light propagates through the second deflection part 210b and the waveguide structure 220 to the first deflection part 210a, so that the first deflection part 210a and the second deflection part 210b can acquire the reflected light reflected by the eyeball 1.

[0179] The first deflection section 210a and the second deflection section 210b, which have different wavelength selectivity, enable total internal reflection of light of different wavelengths within the waveguide structure 220. The first deflection section 210a allows light with a wavelength of 850 nm to enter the waveguide structure 220, while the second deflection section 210b allows light with a wavelength of 1350 nm to enter the waveguide structure 220. This allows the waveguide structure 220 to emit two types of output light with wavelengths of 850 nm and 1350 nm. The first acquisition element 410 acquires the output light with a wavelength of 850 nm from the first deflection section 210a, and the second acquisition element 420 acquires the output light with a wavelength of 1350 nm from the second deflection section 210b. Thus, multiple eye images can be formed through the output light with different wavelengths.

[0180] In the second embodiment, the spectral angular selectivity of the volume holographic optical element is utilized to achieve coupling of an 850 nm eye image and a 1350 nm iris image without affecting the user's line of sight. Specifically, the first deflection section 210a, the waveguide structure 220, and the first coupled-out holographic element 300a form one imaging channel 10 for detecting the 1850 nm eye image. The second deflection section 210b, the waveguide structure 220, and the second coupled-out holographic element 300b form another imaging channel 10 for detecting the 1350 nm eye image.

[0181] The second implementation method can achieve frontal imaging of the eyeball 1 and iris, avoiding obstruction of the imaging image by other eye tissues, thus improving the integrity of the imaging image. At the same time, the frontal imaging effect also improves the accuracy of post-processing gaze point tracking and iris recognition.

[0182] Implementation Method 3

[0183] Referring to FIG14, an exemplary eye-tracking system includes a light source 100, a deflection structure 200, a coupled holographic element 300, and an acquisition module 400, wherein the propagation medium between the deflection structure 200 and the acquisition module 400 is configured as the coupled holographic element 300.

[0184] The deflection structure 200 includes a multi-wavelength deflection section 210c (i.e., VHOE1 in FIG. 14) and a waveguide structure 220. The multi-wavelength deflection section 210c is disposed on the second surface of the waveguide structure 220 and is disposed on the front side of the eyeball 1.

[0185] The number of coupled holographic elements 300 is set to two, and the two coupled holographic elements 300 are disposed on the second surface of the waveguide structure 220. The two coupled holographic elements 300 are disposed on opposite sides of the eyeball 1.

[0186] The two coupled holographic elements 300 can be divided into a first coupled holographic element 300a (i.e., VHOE2 in Figure 14) and a second coupled holographic element 300b (i.e., VHOE3 in Figure 14). The first coupled holographic element 300a is disposed on the left side of the multi-wavelength deflection section 210c, and the second coupled holographic element 300b is disposed on the right side of the multi-wavelength deflection section 210c.

[0187] The number of acquisition modules 400 is set to two. The two acquisition modules 400 can be divided into a first acquisition element 410 and a second acquisition element 420. The first acquisition element 410 is set to correspond to the first coupled-out holographic element 300a, and the second acquisition element 420 is set to correspond to the second coupled-out holographic element 300b.

[0188] In the third embodiment, the wavelengths of the light output from the two imaging channels 10 are different. When the user's gaze direction is determined by the eye-tracking system, the light source 100 emits light towards the eyeball 1, so that the light can be reflected by the eyeball 1 to form reflected light. The reflected light propagates through the waveguide structure 220 to the multi-wavelength deflection section 210c, so that the multi-wavelength deflection section 210c can acquire the reflected light reflected by the eyeball 1.

[0189] The multi-wavelength deflection section 210c enables total internal reflection of light of different wavelengths within the waveguide structure 220, allowing light with a wavelength of 850 nm to enter the waveguide structure 220 and light with a wavelength of 1350 nm to enter the waveguide structure 220. This allows the waveguide structure 220 to emit two types of output light with wavelengths of 850 nm and 1350 nm. The first acquisition element 410 acquires the output light with a wavelength of 850 nm from the first coupled-out holographic element 300a, and the second acquisition element 420 acquires the output light with a wavelength of 1350 nm from the second coupled-out holographic element 300b. This allows multiple eyeball images to be formed using output light of different wavelengths.

[0190] In Embodiment 3, a multi-wavelength deflector 210c is used as an input coupling optical element to couple two light rays with operating wavelengths of 850 nm and 1350 nm. Furthermore, after the light rays with operating wavelengths of 850 nm and 1350 nm are coupled into the waveguide structure 220, they can propagate off-axis in different directions. The first acquisition element 410 acquires the output light ray with a wavelength of 850 nm from the first coupled-out holographic element 300a, and the second acquisition element 420 acquires the output light ray with a wavelength of 1350 nm from the second coupled-out holographic element 300b, thus forming two imaging channels 10.

[0191] By converting the multi-wavelength deflection section 210c (i.e., the ingress coupling optical element) into two equivalent deflection sections, zoom imaging is achieved, thereby enabling clear forward imaging of both the overall image of the human eye and the iris image simultaneously. Compared to a non-multiplexed structure, this reduces the ambient light loss of the ingress coupling optical element and improves the clarity of the user's natural field of vision.

[0192] Implementation Method 4

[0193] Referring to FIG15, an exemplary eye-tracking system includes a light source 100, a deflection structure 200, a coupled holographic element 300, and an acquisition module 400, wherein the propagation medium between the deflection structure 200 and the acquisition module 400 is configured as the coupled holographic element 300.

[0194] The deflection structure 200 includes a multi-wavelength deflection section 210c (i.e., VHOE1 in FIG. 15) and a waveguide structure 220. The multi-wavelength deflection section 210c is disposed on the second surface of the waveguide structure 220 and is disposed on the front side of the eyeball 1.

[0195] The number of coupled holographic elements 300 is set to two, and the two coupled holographic elements 300 are disposed on the second surface of the waveguide structure 220. The two coupled holographic elements 300 are disposed on the same side relative to the eyeball 1.

[0196] The two coupled holographic elements 300 can be divided into a first coupled holographic element 300a (i.e., VHOE2 in Figure 15) and a second coupled holographic element 300b (i.e., VHOE3 in Figure 15), wherein the first coupled holographic element 300a and the second coupled holographic element 300b are both disposed on the left side of the multi-wavelength deflection section 210c.

[0197] The number of acquisition modules 400 is set to two. The two acquisition modules 400 can be divided into a first acquisition element 410 and a second acquisition element 420. The first acquisition element 410 is set to correspond to the first coupled-out holographic element 300a, and the second acquisition element 420 is set to correspond to the second coupled-out holographic element 300b.

[0198] In embodiment four, the wavelengths of the light output from the two imaging channels 10 are different. When the user's gaze direction is determined by the eye-tracking system, the light source 100 emits light towards the eyeball 1, so that the light can be reflected by the eyeball 1 to form reflected light. The reflected light propagates through the waveguide structure 220 to the multi-wavelength deflection section 210c, so that the multi-wavelength deflection section 210c can acquire the reflected light reflected by the eyeball 1.

[0199] The multi-wavelength deflection section 210c enables total internal reflection of light of different wavelengths within the waveguide structure 220, allowing light with a wavelength of 850 nm to enter the waveguide structure 220 and light with a wavelength of 1350 nm to enter the waveguide structure 220. This allows the waveguide structure 220 to emit two types of output light with wavelengths of 850 nm and 1350 nm. The first acquisition element 410 acquires the output light with a wavelength of 850 nm from the first coupled-out holographic element 300a, and the second acquisition element 420 acquires the output light with a wavelength of 1350 nm from the second coupled-out holographic element 300b. This allows multiple eyeball images to be formed using output light of different wavelengths.

[0200] In embodiment four, a multi-wavelength deflector 210c is used as an input coupling optical element to couple two light rays with operating wavelengths of 850 nm and 1350 nm. Furthermore, after the light rays with operating wavelengths of 850 nm and 1350 nm are coupled into the waveguide structure 220, the light rays with operating wavelengths of 850 nm and 1350 nm can propagate off-axis in different directions. The first acquisition element 410 acquires the output light ray with a wavelength of 850 nm from the first coupled-out holographic element 300a, and the second acquisition element 420 acquires the output light ray with a wavelength of 1350 nm from the second coupled-out holographic element 300b, thereby forming two imaging channels 10.

[0201] By converting the multi-wavelength deflection section 210c (i.e., the ingress coupling optical element) into two equivalent deflection sections, zoom imaging is achieved, thereby enabling clear forward imaging of both the overall image of the human eye and the iris image simultaneously. Compared to a non-multiplexed structure, this reduces the ambient light loss of the ingress coupling optical element and improves the clarity of the user's natural field of vision.

[0202] Unlike embodiment three, the first detached holographic element 300a and the second detached holographic element 300b are arranged on the same side as the eyeball 1, which makes the arrangement of the two detached holographic elements more flexible. The first detached holographic element 300a and the second detached holographic element 300b can be flexibly adjusted according to the needs of the display area of ​​the near-eye display device, thereby making the layout of the eye-tracking system more reasonable.

[0203] The first coupled-out holographic element 300a and the second coupled-out holographic element 300b can be integrated into an integrated coupled-out holographic element 300c (i.e., VHOE2 in Figure 15). That is, the coupled-out holographic element 300c can achieve the coupling of output light with a wavelength of 850 nm and output light with a wavelength of 1350 nm, thereby further improving the integration level of the eye tracking system.

[0204] Implementation Method 5

[0205] Referring to FIG16, an exemplary eye-tracking system includes a light source 100, a deflection structure 200, a coupled holographic element 300, and an acquisition module 400, wherein the propagation medium between the deflection structure 200 and the acquisition module 400 is configured as the coupled holographic element 300.

[0206] The deflection structure 200 includes a multi-wavelength deflection section 210c (i.e., VHOE1 in FIG. 16) and a waveguide structure 220. The multi-wavelength deflection section 210c is disposed on the second surface of the waveguide structure 220 and is disposed on the front side of the eyeball 1.

[0207] Unlike embodiments three and four, the first coupled-out holographic element 300a in embodiment three may be omitted, while the second coupled-out holographic element 300b (i.e., VHOE2 in FIG16) may be retained.

[0208] This allows the output light with a wavelength of 850 nanometers to propagate directly from the waveguide structure 220 to the first acquisition element 410, and the output light with a wavelength of 1350 nanometers to be coupled out through the second coupled holographic element 300b, thereby further improving the integration level of the eye tracking system.

[0209] In embodiment five, the wavelengths of the output light in the two imaging channels 10 are different. When the user's gaze direction is determined by the eye-tracking system, the light source 100 emits light towards the eyeball 1, so that the light can be reflected by the eyeball 1 to form reflected light. The reflected light propagates through the waveguide structure 220 to the multi-wavelength deflection section 210c, so that the multi-wavelength deflection section 210c can acquire the reflected light reflected by the eyeball 1.

[0210] The multi-wavelength deflection section 210c enables total internal reflection of light of different wavelengths within the waveguide structure 220, allowing light with a wavelength of 850 nm and light with a wavelength of 1350 nm to enter the waveguide structure 220. This allows the waveguide structure 220 to emit two types of output light with wavelengths of 850 nm and 1350 nm. The second coupled holographic element 300b can couple out the two types of output light with a wavelength of 1350 nm, so that the first acquisition element 410 acquires the output light with a wavelength of 850 nm from the waveguide structure 220, and the second acquisition element 420 acquires the output light with a wavelength of 1350 nm from the second coupled holographic element 300b. This allows multiple eyeball images to be formed through output light with different wavelengths.

[0211] In Embodiment 5, a multi-wavelength deflector 210c is used as an input coupling optical element to couple two light rays with operating wavelengths of 850 nm and 1350 nm. Furthermore, after the light rays with operating wavelengths of 850 nm and 1350 nm are coupled into the waveguide structure 220, they can propagate off-axis in different directions. The first acquisition element 410 acquires the output light ray with a wavelength of 850 nm from the waveguide structure 220, and the second acquisition element 420 acquires the output light ray with a wavelength of 1350 nm from the second coupled-out holographic element 300b, thus forming two imaging channels 10.

[0212] By converting the multi-wavelength deflection section 210c (i.e., the ingress coupling optical element) into two equivalent deflection sections, zoom imaging is achieved, thereby enabling clear forward imaging of both the overall image of the human eye and the iris image simultaneously. Compared to a non-multiplexed structure, this reduces the ambient light loss of the ingress coupling optical element and improves the clarity of the user's natural field of vision.

[0213] It is easy to understand that the second coupled holographic element 300b can also be set as an output coupling prism to achieve the output of light with a wavelength of 1350 nanometers. Furthermore, the second acquisition element 420 can also be directly attached to the output coupling prism so that the output coupling prism can play a certain role in the installation and support of the second acquisition element 420.

[0214] Implementation Method Six

[0215] Referring to FIG17, an exemplary eye-tracking system includes a light source 100, a deflection structure 200, and an acquisition module 400, wherein the propagation medium between the deflection structure 200 and the acquisition module 400 is set to air.

[0216] The deflection structure 200 includes a multi-wavelength deflection section 210c (i.e., VHOE1 in FIG18). The multi-wavelength deflection section 210c is disposed on the second surface of the lens or waveguide structure 220 and is disposed on the front side of the eyeball 1.

[0217] The number of acquisition modules 400 is set to two. The two acquisition modules 400 can be divided into a first acquisition element 410 and a second acquisition element 420. The first acquisition element 410 and the second acquisition element 420 can be set on the frame 2 and other structures.

[0218] In embodiment six, the wavelengths of the output light in the two imaging channels 10 are different. When the user's gaze direction is determined by the eye-tracking system, the light source 100 emits light towards the eyeball 1, so that the light can be reflected by the eyeball 1 to form reflected light. The reflected light propagates through the waveguide structure 220 to the multi-wavelength deflection section 210c, so that the multi-wavelength deflection section 210c can acquire the reflected light reflected by the eyeball 1.

[0219] The multi-wavelength deflection unit 210c allows light with a wavelength of 850 nm to pass through the air into the first acquisition element 410 and light with a wavelength of 1350 nm to pass through the air into the second acquisition element 420. The first acquisition element 410 acquires the output light with a wavelength of 850 nm from the multi-wavelength deflection unit 210c through the air, and the second acquisition element 420 acquires the output light with a wavelength of 1350 nm from the multi-wavelength deflection unit 210c through the air, thereby enabling the formation of multiple eye images through output light with different wavelengths.

[0220] In Embodiment Six, a multi-wavelength deflector 210c is used as an input coupling optical element to couple two light rays with operating wavelengths of 850 nm and 1350 nm. Furthermore, after the light rays with operating wavelengths of 850 nm and 1350 nm are coupled into the waveguide structure 220, the light rays with operating wavelengths of 850 nm and 1350 nm can propagate off-axis in different directions. The first acquisition element 410 acquires the output light ray with a wavelength of 850 nm from the first coupled-out holographic element 300a, and the second acquisition element 420 acquires the output light ray with a wavelength of 1350 nm from the second coupled-out holographic element 300b, thereby forming two imaging channels 10.

[0221] By converting the multi-wavelength deflection section 210c (i.e., the ingress coupling optical element) into two equivalent deflection sections, zoom imaging is achieved, thereby enabling clear forward imaging of both the overall image of the human eye and the iris image simultaneously. Compared to a non-multiplexed structure, this reduces the ambient light loss of the ingress coupling optical element and improves the clarity of the user's natural field of vision.

[0222] Furthermore, by using air as the propagation medium between the multi-wavelength deflection section 210c and the acquisition module 400, the output light propagating in the air can be transmitted to the acquisition module 400 through the air without passing through the out-coupled optical element, thereby further reducing the number of components required for the eye-tracking system and simplifying the structure of the eye-tracking system.

[0223] Implementation Method Seven

[0224] Referring to FIG18, an exemplary eye-tracking system includes a light source 100, a deflection structure 200, a coupled holographic element, and an acquisition module 400, wherein the propagation medium between the deflection structure 200 and the acquisition module 400 is configured as air and the coupled holographic element.

[0225] The deflection structure 200 includes a multi-wavelength deflection section 210c (i.e., VHOE1 in FIG18) and a waveguide structure 220. The multi-wavelength deflection section 210c is disposed on the second surface of the waveguide structure 220 and is disposed on the front side of the eyeball 1.

[0226] Unlike embodiments three and four, the first coupled-out holographic element 300a between the waveguide structure 220 and the first acquisition element 410 may be omitted, and the propagation medium between the waveguide structure 220 and the first acquisition element 410 may be set to air, while retaining the second coupled-out holographic element 300b (i.e., VHOE2 in FIG18).

[0227] That is, the output light with a wavelength of 850 nanometers can be propagated between the waveguide structure 220 and the first acquisition element 410 through the air, and the output light with a wavelength of 1350 nanometers can be coupled out through the second coupled holographic element 300b, thereby further improving the integration level of the eye tracking system.

[0228] The acquisition module 400 may include a first acquisition element 410 and a second acquisition element 420, wherein the first acquisition element 410 may be configured as a camera, and the second acquisition element 420 may include a scanner 422 and a light sensor 421. The camera may be used to receive output light with a wavelength of 850 nanometers, and the scanner 422 and light sensor 421 may be used to acquire output light with a wavelength of 1350 nanometers.

[0229] In embodiment seven, the wavelengths of the light output from the two imaging channels 10 are different. When the user's gaze direction is determined by the eye-tracking system, the light source 100 emits light towards the eyeball 1, so that the light can be reflected by the eyeball 1 to form reflected light. The reflected light propagates through the waveguide structure 220 to the multi-wavelength deflection section 210c, so that the multi-wavelength deflection section 210c can acquire the reflected light reflected by the eyeball 1.

[0230] The multi-wavelength deflection section 210c enables total internal reflection of light of different wavelengths within the waveguide structure 220, allowing light with a wavelength of 850 nm and light with a wavelength of 1350 nm to enter the waveguide structure 220. This allows the waveguide structure 220 to emit two types of output light with wavelengths of 850 nm and 1350 nm. The second coupled holographic element 300b can couple out the two types of output light with a wavelength of 1350 nm, so that the first acquisition element 410 acquires the output light with a wavelength of 850 nm from the waveguide structure 220, and the second acquisition element 420 acquires the output light with a wavelength of 1350 nm from the second coupled holographic element 300b. This allows multiple eyeball images to be formed through output light with different wavelengths.

[0231] In Embodiment Seven, a multi-wavelength deflector 210c is used as an input coupling optical element to couple two light rays with operating wavelengths of 850 nm and 1350 nm. Furthermore, when the output light emitting at an operating wavelength of 850 nm is coupled into the waveguide structure 220, the first acquisition element 410 acquires the output light emitting at a wavelength of 850 nm from the first output holographic element 300a, and the first acquisition element 410 also acquires the output light emitting at a wavelength of 1350 nm from air.

[0232] By converting the multi-wavelength deflection section 210c (i.e., the ingress coupling optical element) into two equivalent deflection sections, zoom imaging is achieved, thereby enabling clear forward imaging of both the overall image of the human eye and the iris image simultaneously. Compared to a non-multiplexed structure, this reduces the ambient light loss of the ingress coupling optical element and improves the clarity of the user's natural field of vision.

[0233] Furthermore, by using air as the propagation medium between the multi-wavelength deflection section 210c and the acquisition module 400, the output light propagating in the air can be transmitted to the acquisition module 400 through the air without passing through the out-coupled optical element, thereby further reducing the number of components required for the eye-tracking system and simplifying the structure of the eye-tracking system.

[0234] In summary, when the eye-tracking system determines the user's gaze direction, the light source 100 emits light towards the eyeball 1, so that the light can be reflected by the eyeball 1 to form reflected light. The deflection structure 200 can acquire the reflected light reflected by the eyeball 1 and form a variety of different output light rays towards multiple acquisition modules 400. Each acquisition module 400 acquires the corresponding output light ray, thereby forming multiple eyeball images through different output light rays.

[0235] Compared to the implementation of a single imaging channel 10 in related technologies, the eye-tracking system of this application embodiment has multiple imaging channels 10, thereby enabling the acquisition of eye images from different angles through different output light from multiple imaging channels 10. This improves the angular accuracy of the eye images acquired by the eye-tracking system, realizes multi-angle imaging and stereoscopic imaging of the eye 1, and increases the shooting range of the eye 1 by the eye-tracking system, thereby improving the accuracy of the eye images.

[0236] This application provides a near-eye display device, including the eye-tracking system described in any of the above embodiments.

[0237] Since the near-eye display device includes the eye-tracking system of any of the above embodiments, the advantages of the near-eye display device including the eye-tracking system of any of the above embodiments can be specifically referred to in the relevant description above, and will not be repeated here.

[0238] In the description of this application, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings, and are only for the convenience of describing this application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of this application.

[0239] In the description of this application, it should be understood that the terms “comprising” and “having” as used herein, and any variations thereof, are intended to cover non-exclusive inclusion, for example, a process, method, system, product, or apparatus that includes a series of steps or units is not necessarily limited to those steps or units that are expressly listed, but may include other steps or units that are not expressly listed or that are inherent to such process, method, product, or apparatus.

[0240] Unless otherwise expressly specified and limited, the terms "installation," "connection," "linking," "fixing," etc., should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral part; they can refer to a direct connection or an indirect connection through an intermediate medium; they can refer to the connection within two components or the interaction between two components. Those skilled in the art can understand the specific meaning of the above terms in this application according to the specific circumstances. Furthermore, the terms "first," "second," etc., are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated.

[0241] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

Claims

1. An eye-tracking system, characterized in that, The eye-tracking system includes a light source (100), a deflection structure (200), and an acquisition module (400), which together form multiple different imaging channels (10). The eye-tracking system is configured as follows: The light source (100) emits light toward the eyeball (1); the deflection structure (200) acquires the reflected light reflected by the eyeball (1) and forms a variety of different output light rays toward the multiple acquisition modules (400); each acquisition module (400) acquires the corresponding output light rays to form a variety of different imaging channels (10).

2. The eye-tracking system according to claim 1, characterized in that, In the plurality of imaging channels (10), at least two of the imaging channels (10) have different wavelengths of output light; And / or, in the plurality of imaging channels (10), at least two of the imaging channels (10) have different off-axis angles for the output rays.

3. The eye-tracking system according to claim 1, characterized in that, The deflection structure (200) includes a deflection section (210) which is used to form output light of different wavelengths so that the wavelengths of the output light in the plurality of imaging channels (10) are different.

4. The eye-tracking system according to claim 3, characterized in that, The number of the deflection section (210) is set to multiple, and the wavelength selectivity of the multiple deflection sections (210) is different. The deflection section (210) is set one-to-one with the acquisition module (400) to form the imaging channel (10). In each of the imaging channels (10), the deflection unit (210) acquires the reflected light reflected by the eyeball (1) and forms the output light of the corresponding wavelength toward the corresponding acquisition module (400).

5. The eye-tracking system according to claim 3, characterized in that, The deflection section (210) is configured as a multi-wavelength deflection section (210c), which generates output light of various wavelengths.

6. The eye-tracking system according to claim 1, characterized in that, The deflection structure (200) includes a deflection section (210) which is at least used to form output light rays with different off-axis angles so that the off-axis angles of the output light rays in the plurality of imaging channels (10) are different.

7. The eye-tracking system according to claim 6, characterized in that, The number of the deflection section (210) is set to multiple, and the angle selection of the multiple deflection sections (210) is different. The deflection section (210) is set one-to-one with the acquisition module (400) to form the imaging channel (10); In each of the imaging channels (10), the deflection unit (210) acquires the reflected light reflected by the eyeball (1) and forms the output light with a corresponding off-axis angle toward the corresponding acquisition module (400).

8. The eye-tracking system according to any one of claims 3-7, characterized in that, The deflection structure (200) further includes a waveguide structure (220), which is at least used to form the imaging channel (10); In the imaging channel (10) including the waveguide structure (220), the waveguide structure (220) receives the output light from the deflection section (210) and reflects the output light to the acquisition module (400); The first surface of the waveguide structure (220) is directed toward the eyeball (1), and the first surface of the waveguide structure (220) is connected to the deflection part (210); and / or, the second surface of the waveguide structure (220) is directed away from the eyeball (1), and the second surface of the waveguide structure (220) is connected to the deflection part (210).

9. The eye-tracking system according to claim 8, characterized in that, The deflection section (210) is configured as a multi-wavelength deflection section (210c), which forms multiple output light rays with different wavelengths. The multi-wavelength deflection section (210c) is disposed on the first or second surface of the waveguide structure (220). Alternatively, the number of the deflection section (210) can be set to multiple, and the wavelength selectivity of the multiple deflection sections (210) can be different. The deflection sections (210) can be arranged on the same side or opposite side relative to the waveguide structure (220). Alternatively, the number of the deflection section (210) can be set to multiple, and the angle selection of the multiple deflection sections (210) can be different. The deflection sections (210) can be arranged on the same side or opposite side of the waveguide structure (220).

10. The eye-tracking system according to claim 8, characterized in that, The deflection section (210) is configured as an in-line holographic element; the eye-tracking system further includes an out-line holographic element (300), the in-line holographic element and the out-line holographic element (300) form the imaging channel (10), and the out-line holographic element (300) forms at least a portion of the propagation medium between the waveguide structure (220) and the acquisition module (400); In the imaging channel (10) including the coupled-in holographic element and the coupled-out holographic element (300), the coupled-in holographic element couples the reflected light from the eyeball (1) into the waveguide structure (220) so that the reflected light is totally internally reflected by the waveguide structure (220) to form the output light; the coupled-out holographic element (300) couples the output light from the waveguide structure (220) out to the acquisition module (400).

11. The eye-tracking system according to claim 10, characterized in that, The number of the coupled holographic elements (300) is set to multiple, and the coupled holographic elements (300) are arranged one-to-one with the acquisition module (400) to form the imaging channel (10); Alternatively, the number of the coupled holographic element (300) is set to one, and the coupled holographic element (300) forms different output rays toward the multiple acquisition modules (400) to form multiple imaging channels (10).

12. The eye-tracking system according to claim 8, characterized in that, The propagation medium between the waveguide structure (220) and the acquisition module (400) is set to air; In the imaging channel (10) including the waveguide structure (220), the output light reflected from the waveguide structure (220) propagates through the air to the acquisition module (400).

13. The eye-tracking system according to any one of claims 3-7, characterized in that, The propagation medium between the deflection unit (210) and the acquisition module (400) is set to air; In the imaging channel (10), the output light from the deflection unit (210) propagates through the air to the acquisition module (400).

14. The eye-tracking system according to claim 1, characterized in that, The plurality of acquisition modules (400) are arranged on the same side relative to the eyeball (1); or, the plurality of acquisition modules (400) are arranged on opposite sides relative to the eyeball (1); The acquisition module (400) includes one or more of a camera, a scanner (422), and a photoelectric sensor.

15. A near-eye display device, characterized in that, Including the eye-tracking system as described in any one of claims 1-14.

Images