Light source module for eyeball tracking and eyeball tracking system

By setting a light mask in the light source module, the light is ensured to illuminate only the same-side eye area, thus solving the problem of stray light in VR devices and improving the accuracy and efficiency of eye tracking.

CN122018144APending Publication Date: 2026-05-12BEIJING 7INVENSUN TECH +1
View PDF 0 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
BEIJING 7INVENSUN TECH
Filing Date
2024-11-12
Publication Date
2026-05-12

AI Technical Summary

Technical Problem

In existing VR devices, stray light from some of the light emitted by the light source enters the camera's field of view, resulting in reduced eye image quality and affecting the accuracy and efficiency of eye-tracking calculations.

Method used

A light mask is set in the light source module, including a light-transmitting element and a light-blocking element. The light-transmitting element forms a light-transmitting area to illuminate the same-side eyeball area, and the light-blocking element forms a light-blocking area to block the light, ensuring that the light only illuminates the same-side eyeball area and reducing stray light entering.

Benefits of technology

It improves the quality of eye images, reduces the impact of stray light spots, and enhances the accuracy and efficiency of eye-tracking calculations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122018144A_ABST
    Figure CN122018144A_ABST
Patent Text Reader

Abstract

The invention discloses a light source module for eyeball tracking and an eyeball tracking system, a light cover is arranged on a light path of a light source irradiating to an optical display system on the same side, and a light-transmitting area is arranged on the light cover, so that light of the light source can irradiate to an eyeball area on the same side through the light-transmitting area, and when the light-transmitting area is the eyeball area on the same side, light emitted by the light source is emitted to the eyeball area on the same side. The light of the light source can just completely illuminate the eyeball area on the same side, and due to the fact that the light of the light source cannot be reflected or scattered by the surfaces of other devices, no other stray light enters the eyeball area on the same side, too many stray light spots are prevented from appearing in the collected eye image, the eye image with the effective light spots and higher quality can be obtained, and the user experience is improved. And the eyeball tracking calculation precision and efficiency can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of eye-tracking technology, and more particularly to a light source module and an eye-tracking system for eye-tracking. Background Technology

[0002] As people learn about and understand near-eye display technology, near-eye display products have been applied in various industries. Among them, VR (Virtual Reality) and Augmented Reality technologies have been widely used.

[0003] Current VR devices typically include eye-tracking devices with eye-tracking capabilities. These devices usually employ the pupillary-corneal reflection method, where an infrared light source illuminates the user's eyes. An image sensor captures an image of the user's eyes showing a light spot, and eye-tracking calculations are performed using this image. Therefore, when configuring eye-tracking devices in VR devices, the light source used to illuminate the user's eyes is usually placed near the lens within the VR device for easy eye contact.

[0004] When tracking a specific eye gaze position, the light spot in the eye image should be formed by the reflection of light from the cornea in the eye. However, due to the compact design of near-eye display devices, some of the light generated by the light source can easily create irregular light paths within the VR device. This makes it impossible for the image acquisition device (such as a camera) to capture a high-quality eye image with a light spot, which adversely affects the eye tracking calculation. Summary of the Invention

[0005] This application provides a light source module and an eye tracking system for eye tracking, in order to solve the problem of stray light from some of the light generated by the light source entering the field of view of the camera in related technologies, improve the quality of the eye image used for eye tracking calculation, and improve the accuracy of eye tracking.

[0006] According to one aspect of this application, a light source module for eye tracking is provided, comprising: a light source and a light mask;

[0007] A portion of the light from the light source is directed onto the same-side eye region for supplemental illumination;

[0008] The light cover includes a light-transmitting element and a light-blocking element. The light-transmitting element is used to form a light-transmitting area and adjust the light illumination area of ​​the light source. The light-blocking element is used to form a light-blocking area to block light from passing through. The light-transmitting range of the light-transmitting area includes at least the ipsilateral eye region. The ipsilateral eye region is characterized as the area enclosed by the curved surface formed by all tangents from any point on the light source to the outermost surface of the ipsilateral eye region.

[0009] Optionally, the light-transmitting element directs the light emitted from the light source at the light transmission angle toward the ipsilateral eye region. The light transmission angle is the angle between the tangent Ta and the tangent Tb. The tangent Ta is the straight line with the smallest angle to the X-axis among all tangents made from a point on the light source to the surface of the ipsilateral eye region, and the tangent Tb is the straight line with the largest angle to the X-axis among all tangents made from a point on the light source to the surface of the ipsilateral eye region.

[0010] Optionally, it also includes a first preset center and a second preset center, wherein the first preset center is the intersection of the Z-axis and the X-axis passing through the center of the same-side optical display system, and the second preset center is the intersection of the Z-axis and the X-axis passing through the center of the opposite-side optical display system.

[0011] Optionally, with the first preset center as the origin, the coordinates of the tangent point Ta and the surface of the ipsilateral eye region are (0, 0, 8), and the coordinates of the tangent point Tb and the surface of the ipsilateral eye region are (6, 0, 11), the light transmission angle is not less than 10 degrees.

[0012] Optionally, with the first preset center as the origin, the coordinates of the tangent point Ta and the surface of the ipsilateral eye region are (-13, 0, 8), and the coordinates of the tangent point Tb and the surface of the ipsilateral eye region are (24, 0, 21), the light transmission angle is not less than 64 degrees.

[0013] Optionally, with the first preset center as the origin, the coordinates of the tangent point Ta and the surface of the ipsilateral eye region are (-13, 0, 8), and the coordinates of the tangent point Tb and the surface of the ipsilateral eye region are (24, 0, 42), the light transmission angle is not less than 70 degrees.

[0014] Optionally, the light-transmitting element is a notch or a light-transmitting component, etc.

[0015] Optionally, the light transmission range of the light-transmitting area is the difference between the light-diffusing area of ​​the light source and the light-blocking area.

[0016] Optionally, the light-shielding area is at least the light area where stray light rays are generated by the light source.

[0017] Optionally, the light-shielding element at least blocks the light emitted from the light source from the light-shielding angle, so that the light from the light source within the light-shielding angle cannot shine into the light-shielding area, and the light-transmitting area does not include the light emitted from the light source from the light-shielding angle.

[0018] Optionally, the light-shielding area includes a first light area, and the light-shielding element includes a first light-shielding element. The first light-shielding element is used to block the first light area. The first light area represents the light area illuminated by the light source onto the same-side optical display system. The same-side optical display system includes a lens group and a display screen arranged sequentially along a first direction. The first direction is the direction of the user's eye looking at the same-side optical display system.

[0019] Optionally, the light-blocking angle includes a first light-blocking angle, wherein the first light-blocking element at least blocks the light emitted from the light source at the first light-blocking angle. The first light-blocking angle is the angle between tangents T1 and T2. Tangent T1 is the straight line with the smallest angle to the X-axis among all tangents made from any point on the light source to the surface of the optical display system on the same side, and tangent T2 is the straight line with the smallest angle to the Z-axis among all tangents made from any point on the light source to the surface of the optical display system on the same side. The first light-blocking angle is not less than 80 degrees.

[0020] Optionally, the light-blocking area includes a second light area, and the light-blocking element includes a second light-blocking element for blocking the second light area. The second light area represents the light area illuminated by the light source to the contralateral eyeball region.

[0021] Optionally, the light-blocking angle includes a second light-blocking angle, wherein the second light-blocking element at least blocks the light emitted by the light source at the second light-blocking angle, and the second light-blocking angle is the angle between tangent T3 and tangent T4.

[0022] Optionally, the tangent T3 is the straight line with the smallest angle to the X-axis among all the tangents made from a point on the light source to the surface of the opposite eye region, and the tangent T4 is the straight line with the largest angle to the X-axis among all the tangents made from a point on the light source to the surface of the opposite eye region.

[0023] Optionally, the tangent T3 is the straight line with the smallest angle to the X-axis among all tangents made from a point on the light source to the surface of the same-side eye region, and the tangent T4 is the straight line with the smallest angle to the X-axis among all tangents made from a point on the light source to the surface of the opposite-side eye region.

[0024] Optionally, with the second preset center as the origin, the coordinates of the tangent point T3 and the surface of the opposite eye region are (13, 0, 8), and the coordinates of the tangent point T4 and the surface of the opposite eye region are (-24, 0, 42), and the second shading angle is not less than 27 degrees.

[0025] Optionally, with the second preset center as the origin, when the coordinates of the tangent T3 and the surface of the opposite eye region are (13, 0, 8) and the coordinates of the tangent T4 and the surface of the opposite eye region are (-24, 0, 42), the second shading angle is not less than 66 degrees.

[0026] Optionally, with the second preset center as the origin, the coordinates of the tangent point T3 and the surface of the opposite eye region are (0, 0, 8), and the coordinates of the tangent point T4 and the surface of the opposite eye region are (-6, 0, 11), the second shading angle is not less than 2 degrees.

[0027] Optionally, with the second preset center as the origin, the coordinates of the tangent point T3 and the surface of the opposite eye region are (0, 0, 8), and the coordinates of the tangent point T4 and the surface of the opposite eye region are (-6, 0, 11), the second shading angle is not less than 8 degrees.

[0028] Optionally, with the second preset center as the origin, when the coordinates of the tangent T3 and the surface of the opposite eye region are (13, 0, 8) and the coordinates of the tangent T4 and the surface of the opposite eye region are (-24, 0, 21), the second shading angle is not less than 13 degrees.

[0029] Optionally, with the second preset center as the origin, when the coordinates of the tangent T3 and the surface of the opposite eye region are (13, 0, 8) and the coordinates of the tangent T4 and the surface of the opposite eye region are (-24, 0, 21), the second shading angle is not less than 54 degrees.

[0030] Optionally, with the first preset center as the origin, the coordinates of the tangent T4 and the surface of the ipsilateral eye region are (13, 0, 8), and with the second preset center as the origin, the coordinates of the tangent T3 and the surface of the contralateral eye region are (13, 0, 8), the second shading angle is not less than 6 degrees.

[0031] Optionally, the light-shielding area includes a third light area, and the light-shielding element includes a third light-shielding element for blocking the third light area. The third light area represents the light area illuminated by the light source onto the opposite side optical display system.

[0032] Optionally, the light-blocking angle includes a third light-blocking angle, wherein the third light-blocking element at least blocks the light emitted from the light source at the third light-blocking angle. The third light-blocking angle is the angle between tangents T5 and T6. Tangent T5 is the straight line with the smallest angle to the X-axis among all tangents made from a point on the light source to the surface of the opposite-side optical display system, and tangent T6 is the straight line with the largest angle to the X-axis among all tangents made from a point on the light source to the surface of the opposite-side optical display system. Optionally, the same-side optical display system includes a lens group and a display screen arranged sequentially along a first direction. The light source is located between the lens group and the same-side eye region, and the first light-blocking element is used to block the light from the light source illuminating the lens group.

[0033] Optionally, the same-side optical display system includes a lens group and a display screen arranged sequentially along a first direction. The lens group includes at least a first lens group and a second lens group arranged along the first direction. The light source is located between the first lens group and the second lens group. The first light-shielding element is used to block the light from the light source from shining onto the second lens group.

[0034] Optionally, the same-side optical display system includes a lens group and a display screen arranged sequentially along a first direction, the light source is located between the lens group and the display screen, and the first light-shielding element is used to block the light from the light source from shining onto the display screen.

[0035] Optionally, the light-emitting area of ​​the light source is completely covered by the light-transmitting area and the light-shielding area.

[0036] According to another aspect of this application, an eye-tracking system is provided, including a light source module, an image acquisition unit, and at least one processor for eye tracking as described in any embodiment of this application;

[0037] The light source module is used to emit light into the same-side eye region;

[0038] The image acquisition unit is used to acquire images of the eye.

[0039] At least one processor is configured to determine eye features in the eye image and determine the user's gaze information based on the eye features.

[0040] The technical solution of this application embodiment has the following beneficial effects. According to the light source module and eye tracking system for eye tracking proposed in this application embodiment, by setting a light cover in the optical path from the light source to the same-side optical display system, and setting a light-transmitting area on the light cover, the light from the light source can pass through the light-transmitting area to illuminate the same-side eye region. When the light-transmitting area is the same as the same-side eye region, the light from the light source only illuminates the same-side eye region, and no other stray light enters the same-side eye region. Therefore, stray light spots on the eye image can be reduced, and a higher quality eye image can be obtained. This is beneficial for locating the tracked light spot, that is, the effective light spot, in the same-side eye region, and thus helps to reduce the impact of stray light spots on eye tracking calculation, and improve the accuracy and efficiency of eye tracking calculation.

[0041] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of this application, nor is it intended to limit the scope of this application. Other features of this application will become readily apparent from the following description. Attached Figure Description

[0042] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0043] Figure 1 This is a schematic diagram of the structure of the eye-tracking system provided in the embodiments of this application;

[0044] Figure 2 This is a schematic diagram of the eye movement surface of the tracked eye in the eye tracking system provided in this application embodiment;

[0045] Figure 3 This is a schematic diagram illustrating the positional relationship between the eye region and the same-side optical display system in the eye tracking system provided in this application embodiment;

[0046] Figure 4 This is a schematic diagram of the structure of the light source module proposed in the embodiments of this application;

[0047] Figure 5 This is a schematic diagram of the structure of a light source module according to an embodiment of this application;

[0048] Figure 6 This is a schematic diagram of the positional relationship between the bilateral eye regions and the optical display system in the eye tracking system proposed in this application embodiment;

[0049] Figures 7-8 This is a schematic diagram of the positional relationship between the X-axis and the Z-axis provided in an embodiment of this application;

[0050] Figures 9-10 This is a schematic diagram of the light transmission angle provided in the embodiments of this application;

[0051] Figure 11 This is a schematic diagram of the light transmission angle provided in another embodiment of this application;

[0052] Figure 12 This is a schematic diagram of the light transmission angle provided in another embodiment of this application;

[0053] Figure 13 This is a schematic diagram of the structure of a light source module according to another embodiment of this application;

[0054] Figure 14 This is a schematic diagram of the structure of an eye-tracking system provided in one embodiment of this application;

[0055] Figure 15 This is a schematic diagram of the light-shielding angle provided in the embodiments of this application;

[0056] Figure 16 This is a schematic diagram of the structure of a light source module according to another embodiment of this application;

[0057] Figure 17 This is a schematic diagram of the structure of a light source module proposed in another embodiment of this application;

[0058] Figure 18 This is a schematic diagram of the structure of a light source module according to another embodiment of this application;

[0059] Figure 19 This is a schematic diagram of the structure of a light source module according to another embodiment of this application;

[0060] Figure 20 This is a schematic diagram of the structure of a light source module proposed in another embodiment of this application;

[0061] Figure 21 This is a schematic diagram of the structure of an eye-tracking system provided in another embodiment of this application;

[0062] Figure 22 This is a schematic diagram of the structure of an eye-tracking system provided in another embodiment of this application;

[0063] Figure 23 This is a schematic diagram of the structure of an eye-tracking system provided in another embodiment of this application;

[0064] Figures 24-25 This is a schematic diagram of the light-shielding angle provided in another embodiment of this application;

[0065] Figures 26-27 This is a schematic diagram of the light-shielding angle provided in another embodiment of this application;

[0066] Figures 28-29 This is a schematic diagram of the light-shielding angle provided in another embodiment of this application;

[0067] Figure 30 This is a schematic diagram of the light-shielding angle provided in another embodiment of this application;

[0068] Figures 31-32 This is a schematic diagram of the light-shielding angle provided in another embodiment of this application;

[0069] Figure 33 This is a schematic diagram of the photomask structure of a light source module according to an embodiment of this application;

[0070] Figure 34 This is a schematic diagram of the photomask structure of a light source module according to another embodiment of this application;

[0071] Figure 35 This is a schematic diagram of the photomask structure of a light source module according to another embodiment of this application;

[0072] Figure 36 This is a schematic diagram of the photomask structure of a light source module according to another embodiment of this application;

[0073] Figure 37 This is a schematic diagram of the photomask structure of a light source module proposed in another embodiment of this application. Detailed Implementation

[0074] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort should fall within the scope of protection of the present application.

[0075] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion.

[0076] Figure 1 This is a schematic diagram of the eye-tracking system provided in an embodiment of this application. Figure 1 As shown, the eye-tracking system includes a light source 100 and an image acquisition unit (not shown in the figure).

[0077] The light source 100 can be an optical device including, but not limited to, an infrared light source, a semiconductor light-emitting diode (LED), a laser diode (LD), a photodiode (PIN), etc. There can be one or more light sources 100.

[0078] Image acquisition units may include, but are not limited to, panoramic cameras, dynamic vision cameras (DVS cameras), infrared cameras, and other image acquisition units capable of acquiring images of the user's eyes.

[0079] In this system, light emitted from light source 100 illuminates the ipsilateral eye region 200. The light emitted from light source 100 is reflected by the cornea in the ipsilateral eye region 200 and enters the image acquisition unit, enabling the image acquisition unit to acquire an eye image with an effective light spot. The effective light spot is a Purkinjet spot, which refers to the reflective spot produced when infrared light illuminates the cornea. The image acquisition unit acquires the eye image of the ipsilateral eye region 200 and can obtain the position of the Purkinjet spot on the eye image to calculate the gaze position of the ipsilateral eye region 200 on the virtual image plane formed by the ipsilateral optical display system 300.

[0080] The same-side optical display system 300 includes a display screen 302 and a lens group 301.

[0081] like Figure 1 As shown, the light divergence region 400 of the light source 100 refers to the area that the light emitted by the light source 100 can illuminate or cover when there is no obstruction or blockage. In other words, the light divergence region 400 refers to the area that the light emitted by the light source 100 can illuminate when there is no obstruction or blockage.

[0082] Specifically, light emitted from the light source 100 is present within the light divergence region 400. When the light from the light source 100 reaches the optical display system 300 on the same side, optical devices within the optical display system 300, such as the lens group 301 and the display screen 302, reflect or scatter the light from the light source 100. The light reflected or scattered by the optical display system 300 enters the image acquisition unit, causing stray light spots to appear in the eye image acquired by the image acquisition unit. Stray light spots refer to the light spots produced when the light from the light source 100 illuminates substances other than the cornea of ​​the eye to be tracked. Excessive stray light spots in the eye image acquired by the image acquisition unit will reduce the image quality of the eye image, affect the identification and positioning of the effective light spot, and reduce the accuracy and efficiency of eye tracking calculations.

[0083] For example, the light source module includes at least one light source 100. A light source 100 can be understood as a 360-degree emitting body, or a bare light source or light core. There can be one or more light sources 100. The light source module has multiple light sources 100, which can be arranged in a triangular or ring-like pattern. The following embodiment uses a single light source 100 as an example. In other embodiments where the light source module includes multiple light sources 100, each light source 100 should be shielded.

[0084] Specifically, the eyeball region can be represented as the movable area of ​​the eyeball, or the movable area formed by the eyeball's movable surface. The eyeball's movable surface is a surface formed by considering one or more factors, including the eyeball's own rotation, the translational error of the head-mounted display device relative to the eyeball when the user wears it (such as VR or AR devices), and the differences in interpupillary distance among different individuals. (Reference) Figure 2 , Figure 2 This is a schematic diagram of the eye movement surface of the tracked eye in the eye-tracking system provided in this application embodiment; the eye movement surface can be approximated as a plane, with a length ranging from 12-50 mm and a width ranging from 12-34 mm. For example, the plane has a length of 31 mm and a width of 23 mm.

[0085] Figure 3 This is a schematic diagram illustrating the positional relationship between the eye region and the ipsilateral optical display system in the eye-tracking system provided in this application embodiment; Reference Figure 3This indicates the positional relationship between the lens group on the same side as the eyeball and the eye region. The preset center O1 is the intersection of the X-axis and Z-axis. The Z-axis passes through the center of the optical display system and is perpendicular to the same-side optical display system. The X-axis is perpendicular to the Z-axis and passes through the center of the light source 100. Point O2 is the center of the eyeball movement surface. The first distance H1 is defined as the horizontal straight-line distance between points O1 and O2 when it is 8mm. The second distance H2 is defined as the horizontal straight-line distance between points O1 and O2 when it is 11mm, 21mm, 42mm, or 50mm. In other words, the first distance H1 and the second distance H2 are flexibly set according to the area where the user's eyeball may move during the actual design of the device. The area formed by the movement of the eyeball movement surface between the first distance H1 and the second distance H2 is the eye region 001. In other words, when the light source is turned on, the eye region on the same side as the light source will inevitably be illuminated. When infrared light illuminates the eye region on the same side as the light source, the image acquisition unit can capture an eye image with an effective light spot. Of course, the approximate dimensions of the eye movement surface and the data for the first distance H1 and the second distance H2 in this embodiment are merely examples. In actual applications, the approximate dimensions of the eye movement surface and the data for the first distance H1 and the second distance H2 may differ to some extent from the dimensions and data exemplified in this application.

[0086] Figure 4 This is a schematic diagram of the structure of the light source module proposed in the embodiments of this application. Figure 5 This is a schematic diagram of the structure of a light source module proposed in one embodiment of this application. Figure 4 and Figure 5 As shown, it includes: a light source 100 and a light mask 600; part of the light from the light source 100 illuminates the ipsilateral eye region 200 for supplementary lighting; the light mask 600 includes a light-transmitting element 101 and a light-blocking element 10. The light-transmitting element 101 allows the light from the light source 100 to illuminate the light-transmitting area 601, and the light-blocking element 10 blocks the light from illuminating the light-blocking area 602. The light-transmitting area 601 includes at least the ipsilateral eye region 501. The ipsilateral eye region 501 can be characterized as the area enclosed by the curved surface formed by all tangents from any point on the light source to the outermost surface of the ipsilateral eye region 200. That is, the ipsilateral eye region 501 is the light area formed when the light source just completely illuminates the ipsilateral eye region 200. Supplementary lighting refers to illuminating the ipsilateral eye region with the light source so that the ipsilateral eye region can reach a certain brightness, which is beneficial for the image acquisition unit to acquire eye images that can be used for analysis and calculation. It should be noted that... Figure 5This only means that the light-transmitting element 101 allows the light from the light source 100 to shine onto the light cover 600, and the light-shielding element 10 can block the light from the light source 100 from shining onto other areas outside the light-transmitting area 601. It does not mean that the light-shielding element 10 needs to block all the light from other areas outside the light-transmitting area 601.

[0087] The ipsilateral eye region 200 can be understood as the area of ​​the eye that is on the same side as the light source when the user wears the smart head-mounted device. In other words, it is the eye region on the same side as the light source 100. Conversely, the eccentric eye region 201 can be understood as the eye region on a different side from the light source 100. (Reference) Figure 6 For example, in region A, the eye region is on the same side as the light source 100, which is called ipsilateral eye region 200; in region B, the eye region is on the opposite side of the light source 100, which is called eccentric eye region 201.

[0088] Therefore, based on the above, this application proposes a light source module for eye tracking. By setting a light mask on the light source 100, the light from the light source 100 can be focused through the light-transmitting area to illuminate the ipsilateral eye region, ensuring that the ipsilateral eye region is illuminated, thereby obtaining an eye image with an effective light spot, which is beneficial to improving the accuracy and efficiency of eye tracking calculation.

[0089] In some embodiments, such as when the eye-tracking system uses the pupil-corneal reflex principle to determine the user's gaze information, or when the scheme for calculating the user's gaze information requires the use of effective light spot (Pulchin spot) information in the eye image, the image acquisition unit needs to acquire an eye image with an effective light spot (Pulchin spot). Therefore, part of the light from the light source 100 is irradiated onto the ipsilateral eye region 200 for supplementary lighting and to form an effective light spot.

[0090] In other embodiments, the image acquisition unit may acquire an image of the eye without an effective light spot. The user's gaze information in the eye image can be determined by a pre-trained deep learning model or other calculation methods that do not require an effective light spot. Therefore, part of the light from the light source 100 is illuminating the ipsilateral eye region 200 for supplementary lighting.

[0091] Figure 5The illustration shows an example where the light-transmitting area 601 of the photomask 600 is equal to the ipsilateral eye region 501. In other embodiments, the light-transmitting area 601 of the photomask 600 can be increased, but generally not to the point that the light from the light source 100 can illuminate the ipsilateral optical display system 300. This prevents the ipsilateral optical display system 300 from reflecting or scattering some of the light from the light source 100 into the image acquisition unit, causing stray light spots to form in the eye image captured by the image acquisition unit. Thus, the portion of the light from the light source 100 that illuminates the ipsilateral optical display system 300 is stray light, which is easily reflected into the image acquisition unit, forming stray light spots. The light-transmitting area 601 of the photomask 600 does not need to be equipped with any optical components; it only needs to be able to allow the light from the light source 100 to exit into the ipsilateral eye region 501.

[0092] In this context, the same-side optical display system 300 can be understood as an optical display system located on the same side as the light source, while the opposite-side optical display system 303 can be understood as an optical display system located on a different side from the light source. (Reference) Figure 6 , Figure 6 In region A, the optical display system is on the same side as the light source 100, and is called the same-side optical display system 300. In region B, the optical display system is on the opposite side of the light source 100, and is called the opposite-side optical display system 303.

[0093] Stray light can be understood as light from the light source 100 that, after shining on a region of the eye on the opposite side, is reflected or scattered and then enters the image acquisition unit. Alternatively, it can be understood as light from the light source shining on a region of the eye outside the same side that can be reflected or scattered. Stray light causes stray spots on the eye image acquired by the image acquisition unit. Stray light is a portion of the light from the light source 100 that shines on the same-side optical display system 300, which is easily reflected or scattered by the same-side optical display system 300 before entering the image acquisition unit.

[0094] Specifically, by setting the photomask 600, the light from the light source 100 can reach and be focused on the ipsilateral eye region 501, without illuminating the ipsilateral optical display system 300. Consequently, the ipsilateral optical display system 300 will no longer reflect or scatter the light from the light source 100, and it will not enter the ipsilateral eye region 200. In other words, when the photomask 600 is set with a light-transmitting area 601 and the light source 100 is turned on, it illuminates the ipsilateral eye region 200 but not the ipsilateral optical display system. The light will also not enter the image acquisition unit through reflection or scattering by the ipsilateral optical display system. Therefore, the number of stray light spots in the eye image acquired by the image acquisition unit can be reduced, the acquisition quality of the eye image can be improved, and the recognition and positioning accuracy of light spots in the eye image can be improved.

[0095] In this embodiment, Figures 7-8This is a schematic diagram illustrating the positional relationship between the X-axis and Z-axis, provided in an embodiment of this application. (Reference) Figure 7 The Z-axis passes through the center of the same-side optical display system 300 and is perpendicular to the same-side optical display system 300. The X-axis is perpendicular to the Z-axis passing through the center of the same-side optical display system 300 and parallel to the line connecting the center of the same-side optical display system 300 and the center of the opposite-side optical display system 303. The center of the light source 100 is located on the horizontal plane where the X-axis is located.

[0096] In this embodiment, reference Figure 8 Including the first preset center O1 ’ "Second preset center O1", where the first preset center O1 ’ The second preset center O1” is the intersection of the Z-axis and X-axis passing through the center of the same-side optical display system 300, and the second preset center O1” is the intersection of the Z-axis and X-axis passing through the center of the opposite-side optical display system 303. That is to say, the intersections of the X-axis with the Z-axis on both sides are O1' and O1”, respectively, and the vertical distance between the intersection of the X-axis and the Z-axis and the corresponding center of the optical display system is equal to the vertical distance from the center of the light source 100 to the horizontal plane where the center of the corresponding side optical display system is located.

[0097] refer to Figures 9-10 , Figures 9-10 This is a schematic diagram of the light transmission angle provided in an embodiment of this application. The light transmission element allows light emitted from the light source at the light transmission angle to illuminate the ipsilateral eye region. The light transmission angle is the angle between tangents Ta and Tb. Tangent Ta is the straight line with the smallest angle to the X-axis among all tangents drawn from a point on the light source to the surface of the ipsilateral eye region, and tangent Tb is the straight line with the largest angle to the X-axis among all tangents drawn from a point on the light source to the surface of the ipsilateral eye region. In other words, the light transmission area 601 at least includes light emitted from the light source 100 at the light transmission angle, and the light transmission element 101 needs to ensure that the light emitted from the light source 100 at the light transmission angle illuminates the light transmission area 601.

[0098] Optional, see reference Figures 9-10 With the first preset center O1 ’ When the origin is taken as the origin, the coordinates of the tangent point Ta and the surface of the ipsilateral eye region 200 are (0, 0, 8), and the coordinates of the tangent point Tb and the surface of the ipsilateral eye region 200 are (6, 0, 11), the light transmission angle A0 is not less than 10 degrees.

[0099] Specifically, let the ipsilateral eye region 200 have a length of 12mm in the X-axis direction and a height of 3mm in the Z-axis direction. A tangent is drawn from a point on the light source 100 to the ipsilateral eye region 200, forming tangents Ta and Tb. The angle between tangents Ta and Tb is taken as the light transmission angle A0. The light transmission angle A0 is not less than 10 degrees. That is to say, the light transmission element 101 can at least make the light emitted from the light source 100 at the light transmission angle A0 shine on the ipsilateral eye region 200.

[0100] Optional, see reference Figure 11 With the first preset center as the origin, the coordinates of the tangent point Ta and the surface of the ipsilateral eye region 200 are (-13, 0, 8), and the coordinates of the tangent point Tb and the surface of the ipsilateral eye region 200 are (24, 0, 21), the light transmission angle is not less than 64 degrees.

[0101] Specifically, let the ipsilateral eye region 200 have a length of 48mm in the X-axis direction and a height of 13mm in the Z-axis direction. A tangent is drawn from a point on the light source 100 to the ipsilateral eye region 200, forming tangents Ta and Tb. The angle between tangents Ta and Tb is taken as the light transmission angle A0. The light transmission angle A0 is not less than 64 degrees. That is to say, the light transmission element 101 can at least make the light emitted from the light source 100 at the light transmission angle A0 shine on the ipsilateral eye region 200.

[0102] Optional, see reference Figure 12 With the first preset center as the origin, the coordinates of the tangent point Ta and the surface of the ipsilateral eye region 200 are (-13, 0, 8), and the coordinates of the tangent point Tb and the surface of the ipsilateral eye region 200 are (24, 0, 42), the light transmission angle is not less than 70 degrees.

[0103] Specifically, let the ipsilateral eye region 200 have a length of 48mm in the X-axis direction and a height of 34mm in the Z-axis direction. A tangent is drawn from a point on the light source 100 to the ipsilateral eye region 200, forming tangents Ta and Tb. The angle between tangents Ta and Tb is taken as the light transmission angle A0. The light transmission angle A0 is not less than 70 degrees. That is to say, the light transmission element 101 can at least make the light emitted from the light source 100 at the light transmission angle A0 shine on the ipsilateral eye region 200.

[0104] It should be noted that since the surface of the user's eyeball is curved, the edge of the eyeball region formed based on the possible positions where the user's eyeball may move should also be curved. Therefore, when determining the intersection of the tangent Ta and the ipsilateral eyeball region 200, the intersection of the ipsilateral eyeball region 200 and Ta is generally: the corneal vertex coordinates of the eyeball position farthest from the light source 100 among several possible positions that the eyeball on the side closest to the ipsilateral optical display system 300 may move to. For details, please refer to the specification of this application. Figure 11 , Figure 12 , Figure 13 .

[0105] Optional, Figure 13 This is a schematic diagram of the structure of a light source module according to another embodiment of this application. Figure 13 As shown, the light-shielding element also includes a light-transmitting element 101; the light-transmitting element 101 is located in the light-transmitting area 601, and the light cover 600 covers the light source 100.

[0106] Understandably, the light cover 600 can cover the light source 100. When the light source 100 is a 360° light source, the light cover 600 can be a sphere, and a light-transmitting element 101 is provided on the light cover 600 so that light can be transmitted through the light-transmitting element 101 to the ipsilateral eye region 501. In addition, since the light cover 600 covers the light source 100, it can protect the light source 100.

[0107] Optionally, the light-transmitting element 101 may include a notch, a light-transmitting component, etc.

[0108] The notch can be a regular or irregular opening in the light-transmitting area 601 of the photomask 600, allowing the emitted light from the light source 100 to shine outwards through the notch. The light-transmitting element can be an anti-reflective film, made of materials such as magnesium fluoride, titanium oxide, lead sulfide, lead selenide, ceramic infrared anti-reflective film, or vinyl silsesquioxane hybrid film. The light-transmitting element can also be a sheet material that allows light to pass through, such as a glass sheet or a plastic sheet. This allows the light from the light source 100 to better pass through the light-transmitting element 101 in the light-transmitting area 601 and illuminate the ipsilateral eye region 200, thereby increasing the brightness of the effective light spot illuminating the ipsilateral eye region 200. When the light-transmitting element 101 is a light-transmitting element, the photomask 600 acts as a closed shell for the light source 100, preventing dust or moisture from falling onto the light source 100 and affecting its illumination.

[0109] In one embodiment, due to different requirements for the installation of components such as the ipsilateral optical display system 300, light source 100, and image acquisition unit within different head-mounted display devices, such as for aesthetic reasons or the need for more compact installation between components, the light source 100 may be installed between the lens group 301 and the ipsilateral eye region 200, or within the lens group 301, or between the lens group 301 and the display screen 302. When the light source 100 is located in different positions, the optical elements illuminated by the light from the light source 100 in the first direction F are different, resulting in different areas of the light-transmitting area 601.

[0110] Among them, the light-transmitting area 601, i.e., the ipsilateral eyeball region 501, includes the light-transmitting area 501a (e.g. Figure 21 As shown), the light-transmitting area is 501b (as shown). Figure 22 (as shown) and the three light-transmitting areas 501c (as shown) Figure 23(As shown). The light emitted from the light source 100 passes through the ipsilateral eye region 501 and illuminates the ipsilateral eye region 200. The ipsilateral eye region 200 reflects the light emitted from the light source 100 to the image acquisition unit, enabling the image acquisition unit to acquire an eye image with an effective light spot, that is, forming a Purkinje spot on the eye image. This ensures that the cornea within the ipsilateral eye region 200 can reflect the light emitted from the light source 100, guaranteeing that the image acquisition unit can acquire an eye image with an effective light spot. This application embodiment does not specifically limit the shape, light transmission principle, material, or arrangement of the light-transmitting element 101; the light-transmitting element 101 only needs to ensure that the light emitted from the light source 100 can cover the ipsilateral eye region 200. In other words, after setting the light-transmitting element 101, when the light source 100 is turned on, the ipsilateral eye region 200 will definitely be illuminated.

[0111] Optional, such as Figure 5 and Figure 13 As shown, the light mask 600 includes a light-shielding element, which is used to form a light-shielding area 602 to block light from passing through. The range of the light-transmitting area 601 is at most the difference between the light-diffusing area 400 of the light source 100 and the light-shielding area 602.

[0112] Optionally, the shading area 602 is at least the light area where stray light rays from the light source are generated.

[0113] In this context, the light zone refers to the area that light travels through as it propagates in space. Or, the light zone is the range or area covered by light.

[0114] Specifically, the light-shielding area 602 on the photomask 600 is provided to prevent light from the light source 100 from illuminating the same-side optical display system 300, the opposite-side optical display system 303, and the opposite-side eye region 201. When the light source 100 illuminates the same-side optical display system 300, the reflected or scattered light from the same-side optical display system 300 easily enters the image acquisition unit, resulting in numerous stray light spots on the eye image acquired by the image acquisition unit. This affects the identification and positioning of the effective light spot, and consequently, the accuracy and efficiency of the eye-tracking device in calculating user gaze information. Similarly, when the light source 100 illuminates the opposite-side optical display system 303, the reflected or scattered light from the opposite-side optical display system 303 easily enters the image acquisition unit, resulting in numerous stray light spots on the eye image acquired by the image acquisition unit. This also affects the identification and positioning of the effective light spot, and consequently, the accuracy and efficiency of the eye-tracking device in calculating user gaze information. When light source 100 illuminates the contralateral eye region 201, reflected or scattered light from the contralateral eye region 201 easily enters the image acquisition unit, resulting in numerous stray light spots on the eye image acquired by the image acquisition unit. This affects the identification and positioning of the effective light spot, and consequently impacts the accuracy and efficiency of the eye-tracking device's calculation of user gaze information. Therefore, a light-shielding area 602 needs to be provided on the light cover 600 to prevent light from light source 100 from illuminating the aforementioned location, thus affecting the accuracy and efficiency of gaze information calculation. (Reference) Figure 13 In one embodiment, the light-transmitting area 601 may include at least the ipsilateral eye region 501, which is used to illuminate the ipsilateral eye region 200 (see reference). Figure 6 The light-transmitting area 601 may at most include the difference between the light-diffusing area 400 and the light-shielding area 602, and the light-shielding area 602 may include at least one or more of the first light area 502, the second light area 504, and the third light area 503. (See reference) Figure 6 The first light zone 502 refers to the light zone formed when the light from the light source 100 shines on the same side optical display system 300, the third light zone 503 refers to the light zone formed when the light from the light source 100 shines on the opposite side optical display system 303, and the second light zone 504 refers to the light zone formed by the opposite eyeball region 201 of the second light zone 504.

[0115] In other words, the photomask 600 can control the light from the light source 100 to illuminate the light-transmitting area 601 and block the light from the light source to illuminate the light-shielding area 602. If the light source 100 is 360° and the photomask 600 is a sphere, the light-transmitting area 601 can be the same as the ipsilateral eye region 501, and the rest can be light-shielding areas 602. Alternatively, the area where the light from the light source 100 illuminates the ipsilateral optical display system 300, the contralateral optical display system 303, and the contralateral eye region 201 can be designated as the light-shielding area 602, while the rest can be light-transmitting areas 601. In this way, the light from the light source 100 can pass through the light-transmitting area 601 to illuminate the ipsilateral eye region 200 without illuminating other areas and creating stray light that would affect the quality of the eye image acquisition.

[0116] Stray light can be understood as light from light source 100 that, after being reflected or scattered, enters the image acquisition unit after hitting a region of the eye on the opposite side. Alternatively, it can be understood as light from the light source hitting a region of the eye outside the same side that can be reflected or scattered. Stray light causes stray spots on the eye image acquired by the image acquisition unit.

[0117] Optional, Figure 14 This is a schematic diagram of the structure of an eye-tracking system provided in one embodiment of this application, as shown below. Figure 14 As shown, the light-blocking area 602 includes a first light area 502, and the light-blocking element 10 includes a first light-blocking element 102. The first light-blocking element 102 is used to block the first light area 502. The first light area 502 represents the light area that the light source 100 illuminates on the optical display system 300 on the same side. The first direction F is the line of sight of the tracked eye 200.

[0118] The first light region 502 is the area illuminated by the light source 100 onto the optical display system 300 on the same side. It can be characterized as a cone-shaped area formed by the light source 100 illuminating the optical display system 300 on the same side and tangent to the edge of the optical display system 300. In other words, the first light region 502 is the area enclosed by the curved surface formed by all tangents from any point on the light source to the outermost surface of the optical display system 300 on the same side. The first light-shielding element 102 can be a light-shielding cover or a light-shielding film, such as a black film. The first light-shielding element 102 can be made of a material that does not transmit infrared light, or a material that does not transmit infrared light of a specific infrared band. It can be a shell, a coating, a tape, a sheet, a circuit board, or a carrier of an infrared lamp emitter, or any combination of the above materials, serving to block infrared light.

[0119] By configuring the first light-shielding element 102, the light originally intended to illuminate the same-side optical display system 300 from the light source 100 will no longer illuminate the same-side optical display system 300. Consequently, the same-side optical display system 300 will no longer reflect or scatter the light from the light source 100, and will not enter the same-side eye region 200. In other words, when the first light-shielding element 102 is configured on the light source 100, the same-side optical display system 300 in the first direction F will not be illuminated by the light source 100 when the light source 100 is turned on. This reduces the number of stray light spots in the eye image acquired by the image acquisition unit, improves the acquisition quality of the eye image, and thus improves the accuracy of spot recognition and positioning in the eye image.

[0120] When multiple LEDs are used as light sources 100, a first light-shielding element 102 can be provided for each cone-shaped area formed by the light rays from each LED illuminating the optical display system 300 on the same side. Alternatively, the first light-shielding element 102 can be configured as a single unit to shield multiple light sources. It is understood that the multiple LEDs are generally arranged along the edge of the optical display system 300 on the same side, for example, around or outside the lens of the head-mounted virtual reality display. They can be positioned above the surface near the edge of the lens, or near the outer edge of the lens, etc. This application embodiment does not specifically limit the arrangement position of the light sources 100. This application embodiment does not specifically limit the shape, light-shielding principle, light-shielding material, or arrangement position of the first light-shielding element 102. The first light-shielding element 102 simply prevents light within the first light area 502 from illuminating the optical display system 300 on the same side.

[0121] refer to Figure 15 , Figure 15 This is a schematic diagram of the light-shielding angle provided in one embodiment of this application. The first light-shielding element at least blocks the light emitted by the light source at the first light-shielding angle. The first light-shielding angle is the angle between tangents T1 and T2. Tangent T1 is the straight line with the smallest angle to the X-axis among all tangents made from any point on the light source to the surface of the optical display system on the same side, and tangent T2 is the straight line with the largest angle to the X-axis among all tangents made from any point on the light source to the surface of the optical display system on the same side. The first light-shielding angle is not less than 80 degrees. In other words, the first light area 502 contains at least the light emitted by the light source 100 at the first light-shielding angle, which needs to be blocked by the first light-shielding element 102. In some embodiments, the first light-shielding element 102 is not used to block the light emitted by the light source 100 that enters the optical display system 300 on the same side after being reflected by the user's face.

[0122] In this embodiment, the Z-axis passes through the center of the same-side optical display system 300 and is perpendicular to the same-side optical display system 300. The X-axis is perpendicular to the Z-axis passing through the center of the same-side optical display system 300 and parallel to the line connecting the center of the first light display system 300 and the center of the opposite-side optical display system 303. The center of the light source 100 is located on the horizontal plane where the X-axis is located.

[0123] A typical on-side optical display system 300 includes a lens group 301 and a display screen 302. The light source 100 can be positioned in front of the lens group 301, inside the lens group 301, or between the lens group 301 and the display screen 302. Therefore, when the light source 100 is positioned in front of the lens group 301, the surface of the on-side optical display system 300 refers to the surface of the lens group 301. When the light source 100 is positioned inside the lens group 301, the surface of the on-side optical display system 300 refers to the surface of the lens group 301 positioned behind the light source 100. When the light source 100 is positioned between the lens group 301 and the display screen 302, the surface of the on-side optical display system 300 refers to the surface of the display screen 302.

[0124] For example, the light source 100 is positioned in front of the optical display system 300 on the same side. A tangent line is drawn from any point on the light source 100 to the surface of the optical display system 300 on the same side, forming tangent line T1 and tangent line T2. The angle between tangent line T1 and tangent line T2 is a first light-blocking angle A1, which is not less than 80 degrees. Tangent line T1 is the straight line with the smallest angle to the X-axis among all tangent lines drawn from a point on the light source 100 to the surface of the optical display system 300 on the same side, and tangent line T2 is the straight line with the largest angle to the X-axis among all tangent lines drawn from a point on the light source 100 to the surface of the optical display system 300 on the same side. The first light-blocking element 101 at least blocks the light emitted from the light source 100 at the first light-blocking angle A1. The first light-blocking angle A1 is not less than 80 degrees; in some embodiments, the first light-blocking angle A1 is not less than 20 degrees.

[0125] In some specific embodiments, Figures 16 to 17 This is a schematic diagram of the structure of the light source module proposed in the embodiments of this application, as shown below. Figure 16 , Figure 17 and Figure 20 As shown, the photomask 600 includes a light-transmitting element 101 and a first light-blocking element 102. In other words, the photomask 600 has a notch in the light-transmitting area 601, and the notch is the light-transmitting element 101. Figure 18 and Figure 19 As shown, the photomask 600 includes a light-transmitting element 101 and a first light-blocking element 102. In other words, the photomask 600 is a closed photomask, with the light-transmitting element 101 arranged in the light-transmitting area 601. Figures 16 to 18 as well as Figure 20In this configuration, the first light-shielding element 102 only blocks light from the lens group 301 in the same-side optical display system 300, while not blocking light from other areas outside the same-side optical display system 300. Figure 19 The light-shielding area 602 where the first light-shielding element 102 is located is all areas of the light cover 600 except for the light-transmitting area 601. In other words, the first light-shielding element 102 blocks light from all areas except for the light-transmitting area 601, that is, it blocks light from the same-side optical display system 300, the opposite-side optical display system 303, and the opposite-side eyeball area 201.

[0126] Optional, Figure 21 This is a schematic diagram of the structure of an eye-tracking system provided in another embodiment of this application, as shown below. Figure 21 As shown, the same-side optical display system 300 includes a lens group 301 and a display screen 302 arranged sequentially along a first direction F. A light source 100 is located between the lens group 301 and the tracked eyeball 200. A first light-shielding element 102 is used to block the light from the light source 100 illuminating the lens group 301. The first light area 502 includes a sub-light area 502a. The first light-shielding element 102 can block the cone-shaped area of ​​light emitted from the light source 100 onto the lens group 301. In other words, the sub-light area 502a represents the area formed by the light emitted from the light source 100 illuminating the lens group 301. Specifically, it is the area enclosed by the curved surface formed by all tangents from any point on the light source to the outermost surface of the lens group 301. Therefore, the first light-shielding element 102 can block the cone-shaped area formed by the light from the light source 100 illuminating the lens group 301, preventing the light from the light source 100 from illuminating the lens group 301 and reflecting to form light that can enter the image acquisition unit.

[0127] Optional, Figure 22 This is a schematic diagram of the structure of an eye-tracking system provided in another embodiment of this application, as shown below. Figure 14 As shown, the same-side optical display system 300 includes a lens group 301 and a display screen 302 arranged sequentially along a first direction F. The lens group 301 includes at least a first lens group 3011 and a second lens group 3012 arranged along the first direction F. The light source 100 is located between the first lens group 3011 and the second lens group 3012. A first light-shielding element 102 is used to block the light from the light source 100 illuminating the second lens group 3012. The first light area 502 includes a sub-light area 502b. The first lens group 3011 includes at least an eyepiece, and the second lens group 3012 includes at least an objective lens. The sub-light area 502b is a conical region illuminating the second lens group 3012 from the light source 100. In other words, it is the region enclosed by the curved surface formed by all tangents from any point on the light source to the outermost surface of the second lens group 3012.

[0128] The first lens group 3011 includes at least one lens, and the second lens group 3012 includes at least one lens. Sub-light region 502b is a cone-shaped region formed by light rays from the light source 100 illuminating the second lens group 3012. Therefore, the first light-shielding element 102 can block this cone-shaped region, preventing light from the light source 100 from illuminating the second lens group 3012 and reflecting to form light rays that can enter the image acquisition unit.

[0129] Optional, Figure 23 This is a schematic diagram of the structure of an eye-tracking system provided in another embodiment of this application, as shown below. Figure 23 As shown, the same-side optical display system 300 includes a lens group 301 and a display screen 302 arranged sequentially along a first direction F. A light source 100 is located between the lens group 301 and the display screen 302. A first light-shielding element 102 is used to block the light from the light source 100 that illuminates the display screen 302. The first light region 502 includes a sub-light region 502c. The first light-shielding element 102 can block this conical region, preventing the light from the light source 100 from illuminating the display screen 302. In other words, it can block the area enclosed by the curved surface formed by all tangents from any point on the light source 100 to the outermost surface of the display screen 302.

[0130] The sub-light region 502c is a cone-shaped area formed by the light from the light source 100 illuminating the display screen 302. Therefore, the first light-shielding element 102 can block this cone-shaped area, preventing the light from the light source 100 from shining on the display screen 302 and preventing the light from the light source 100 from shining on the display screen 302 and reflecting to form stray light that can enter the cornea of ​​the human eye. In one embodiment, the display screen 302 may include, but is not limited to, a waveguide display device, a liquid crystal display screen, an organic light-emitting diode screen, a silicon-based liquid crystal microdisplay screen, a digital light projection microdisplay screen, etc.

[0131] Based on the above embodiments, the cone angle of the first light-shielding element 102 to the light-shielding cone region of the light source 100 can be obtained by optical software simulation or calculation during optical path design.

[0132] Therefore, by setting the first light-shielding element 102, the light originally illuminating the same-side optical display system 300 from the light source 100 will no longer illuminate the same-side optical display system 300. Consequently, the same-side optical display system 300 will no longer reflect or scatter the light from the light source 100, and the reflected light will not enter the image acquisition unit. In other words, when the first light-shielding element 102 is set on the light source 100, the same-side optical display system 300 in the first direction F will not be illuminated by the light source 100 when the light source 100 is turned on. Thus, the number of stray light spots in the eye image acquired by the image acquisition unit can be reduced, the acquisition quality of the eye image can be improved, and the recognition and positioning accuracy of light spots in the eye image can be improved.

[0133] Optional, continue to refer to Figure 14 , Figures 21 to 23 As shown, the light-blocking area 602 includes a second light area 504, and the light-blocking element 10 includes a second light-blocking element 104. The second light area 504 is provided with the second light-blocking element 104, which is used to block the second light area 504. The second light area 504 represents the light area illuminated by the light source 100 onto the opposite tracked eyeball 201.

[0134] The second light region 504 is the area illuminated by the light source 100 onto the contralateral eye region 201. In other words, the second light region 504 is the area enclosed by the curved surface formed by all tangents from any point on the light source to the outermost surface of the contralateral eye region. It should be noted that only after the light emitted by the light source 100 is reflected by the user's cornea on the same side and enters the image acquisition unit will an eye image with an effective light spot be formed. However, due to the close distance between the user's eyes, light emitted from one side of the light source 100 can easily illuminate the user's cornea on the other side, and the reflected light is easily captured by the image acquisition unit on the side of the light source 100. This results in stray light spots on the eye image due to the reflection of light from the light source 100 by the contralateral eye region 201. Under normal circumstances, the user's cornea within the contralateral eye region 201 should reflect light from the light source on the same side as it, and the resulting effective light spot should be captured by the image acquisition unit on the same side. Therefore, to prevent the user's cornea in the ectopic eye region 201 from reflecting light from the incorrectly positioned light source 100, thus creating stray spots on the eye image acquired by the image acquisition unit, it is necessary to block this portion of the light from the light source 100. This prevents light from the second light area 504 of the light source 100 from shining onto the ectopic eye region 201 and forming stray spots on the eye image, affecting the acquisition quality of the eye image. This is beneficial for improving the accuracy of identifying and locating effective light spots in the eye image.

[0135] By setting a second light-shielding element 104, the second light area 504 is blocked, preventing the light source 100 from illuminating the opposite eye region 201. In other words, when the second light-shielding element 104 is set, the opposite eye region 201 will not be illuminated by the light source 100 when the light source 100 is turned on. This helps to prevent the emitted light from the light source 100 from shining on the opposite eye region 201 and forming stray light spots on the eye image. The second light-shielding element 104 can be a light shield or a light-shielding film, etc. This application embodiment does not specifically limit the shape, light-shielding principle, light-shielding material, or arrangement position of the second light-shielding element 104, as long as the second light-shielding element 104 prevents the light in the second light area 504 from shining on the opposite eye region 201.

[0136] It should be noted that, due to the different positions of the light source 100, the second light region 504 includes a sub-light region 504a (e.g., Figure 21 (as shown), 504b of the two-sub-light region (as shown) Figure 22 (as shown) and the three-sub-light region 504c (as shown) Figure 23 (As shown). The cone angle of the second light-shielding element 104 on the light-shielding cone region of the light source 100 can be obtained by optical software simulation or mathematical calculation during optical path design.

[0137] In this embodiment, the second light source module for eye tracking at least blocks the light emitted by the light source at a second blocking angle, which is the angle between tangents T3 and T4. In other words, the second light area 504 contains at least the light emitted by the light source 100 at the second blocking angle, which needs to be blocked by the second blocking element 104.

[0138] In this embodiment, a first preset center O1 is included. ’ "Second preset center O1", where the first preset center O1 ’ The second preset center O1” is the intersection of the Z-axis and X-axis of the center of the same-side optical display system 300, and the second preset center O1” is the intersection of the Z-axis and X-axis of the center of the opposite-side optical display system 303.

[0139] Tangent T3 is the straight line with the smallest angle to the X-axis among all the tangents made from a point on the light source 100 to the surface of the opposite eye region 201, and tangent T4 is the straight line with the largest angle to the X-axis among all the tangents made from a point on the light source 100 to the surface of the opposite eye region 201.

[0140] Optional, see reference Figures 24-25 , Figures 24-25 This is a schematic diagram of the light-blocking angle provided in one embodiment of this application. With the second preset center O1” as the origin, when the coordinates of the tangent point T3 and the surface of the opposite eye region 201 are (13, 0, 8) and the coordinates of the tangent point T4 and the surface of the opposite eye region 201 are (-24, 0, 42), the second light-blocking angle A2 is not less than 27 degrees.

[0141] With the second preset center O1” as the origin, when the coordinates of the tangent T3 and the surface of the opposite eye region 201 are (13, 0, 8) and the coordinates of the tangent T4 and the surface of the opposite eye region 201 are (-24, 0, 42), the second light-blocking angle A2 is not less than 66 degrees.

[0142] Specifically, let the eccentric eye region 201 have a length of 48mm in the X-axis direction and a height of 34mm in the Z-axis direction. A tangent is drawn from a point on the light source 100 on the side away from the eccentric eye region 201 to the eccentric eye region 201, forming tangents T3 and T4. The angle between tangents T3 and T4 is taken as the second shading angle A2. The second shading angle A2 is not less than 27 degrees. That is to say, the second light source module 102 for eye tracking can at least block the light emitted from the light source 100 at the second shading angle A2. From a point on the light source 100 near the opposite eye region 201, draw a tangent line to the opposite eye region 201, forming tangent lines T3 and T4. The angle between tangent lines T3 and T4 is the second shading angle A2. The second shading angle A2 is not less than 66 degrees. That is to say, the second light source module 102 for eye tracking can at least block the light emitted from the light source 100 at the second shading angle A2.

[0143] Optional, see reference Figures 26-27 With the second preset center O1” as the origin, the coordinates of the tangent point T3 and the surface of the opposite eye region 201 are (0, 0, 8), and the coordinates of the tangent point T4 and the surface of the opposite eye region 201 are (-6, 0, 11), the second shading angle A2 is not less than 2 degrees.

[0144] With the second preset center O1” as the origin, the coordinates of the tangent point T3 and the surface of the opposite eye region 201 are (0, 0, 8), and the coordinates of the tangent point T4 and the surface of the opposite eye region 201 are (-6, 0, 11), the second shading angle A2 is not less than 8 degrees.

[0145] Specifically, let the eccentric eye region 201 have a length of 12mm in the X-axis direction and a height of 3mm in the Z-axis direction. A tangent is drawn from a point on the light source 100 on the side away from the eccentric eye region 201 to the eccentric eye region 201, forming tangents T3 and T4. The angle between tangents T3 and T4 is taken as the second shading angle A2. The second shading angle A2 is not less than 2 degrees. That is to say, the second light source module 102 for eye tracking can at least block the light emitted from the light source 100 at the second shading angle A2. From a point on the light source 100 near the opposite eye region 201, draw a tangent to the opposite eye region 201, forming tangents T3 and T4. The angle between tangents T3 and T4 is the second shading angle A2. The second shading angle A2 is not less than 8 degrees. That is to say, the second light source module 102 for eye tracking can at least block the light emitted from the light source 100 at the second shading angle A2.

[0146] Optional, see reference Figures 28-29With the second preset center O1” as the origin, the coordinates of the tangent point T3 and the surface of the opposite eye region 201 are (13, 0, 8), and the coordinates of the tangent point T4 and the surface of the opposite eye region 201 are (-24, 0, 21), the second shading angle A2 is not less than 13 degrees.

[0147] With the second preset center O1” as the origin, when the coordinates of the tangent point T3 and the surface 201 of the opposite eyeball region are (13, 0, 8), and the coordinates of the tangent point T4 and the surface 201 of the opposite eyeball region are (-24, 0, 21), the second shading angle A2 is not less than 54 degrees.

[0148] Specifically, let the eccentric eye region 201 have a length of 48mm in the X-axis direction and a height of 13mm in the Z-axis direction. A tangent is drawn from a point on the light source 100 on the side away from the eccentric eye region 201 to the eccentric eye region 201, forming tangents T3 and T4. The angle between tangents T3 and T4 is taken as the second shading angle A2. The second shading angle A2 is not less than 13 degrees. That is to say, the second light source module 102 for eye tracking can at least block the light emitted from the light source 100 at the second shading angle A2. From a point on the light source 100 near the opposite eye region 201, draw a tangent to the opposite eye region 201, forming tangents T3 and T4. The angle between tangents T3 and T4 is the second shading angle A2. The second shading angle A2 is not less than 54 degrees. That is to say, the second light source module 102 for eye tracking can at least block the light emitted from the light source 100 at the second shading angle A2.

[0149] In other embodiments, tangent T3 is the straight line with the smallest angle to the X-axis among all tangents made from a point on the light source 100 to the surface of the ipsilateral eye region 200, and tangent T4 is the straight line with the smallest angle to the X-axis among all tangents made from a point on the light source 100 to the surface of the eccentric eye region 201.

[0150] Optional, see reference Figure 30 With the first preset center O1 ’ With the origin as the tangent point T3 and the surface of the ipsilateral eye region 200 as the tangent point (13, 0, 8), and with the second preset center O1” as the origin, when the tangent point T4 and the surface of the eccentric eye region 201 are tangent at (13, 0, 8), the second shading angle A2 is not less than 6 degrees.

[0151] Specifically, let the ipsilateral eye region 200 and the contralateral eye region 201 both have a length of 48mm in the X-axis direction. A tangent T3 is formed by drawing a tangent from a point on the light source 100 on the side away from the contralateral eye region 201 to the ipsilateral eye region 201. A tangent T4 is also formed by drawing a tangent from a point on the light source 100 on the side away from the contralateral eye region 201 to the contralateral eye region 201. The angle between tangents T3 and T4 is taken as the second light-blocking angle A2. The second light-blocking angle A2 is not less than 6 degrees, which means that the second light source module 102 for eye tracking can at least block the light emitted from the light source 100 at the second light-blocking angle A2.

[0152] It should be noted that since the surface of the user's eyeball is curved, the edge of the eyeball region formed based on the possible positions where the user's eyeball may move should also be curved. Therefore, when determining the intersection of the tangent T3 and the contralateral eyeball region 201, the intersection of the contralateral eyeball region and T3 is generally: the corneal vertex coordinates of the eyeball position farthest from the light source 100 among several possible positions that the eyeball on the side closer to the contralateral optical display system 303 may move to. For details, please refer to the specification of this application. Figure 25 , Figure 27 , Figure 29 .

[0153] Optional, continue to refer to Figure 14 The light-shielding area 602 includes a third light area 503, and the light-shielding element 10 includes a third light-shielding element 103. The third light area 503 is provided with the third light-shielding element 103, which is used to block the third light area 503. The third light area 503 represents the light area that the light source 100 illuminates on the opposite side optical display system 303.

[0154] The third light region 503 is the area illuminated by the light source 100 onto the opposite optical display system 303, that is, the area enclosed by the curved surface formed by all tangents from any point on the light source to the outermost surface of the opposite optical display system 303.

[0155] Specifically, by setting a third light-shielding element 103, the third light area 503 is blocked to prevent the light source 100 from illuminating the optical display system 303 on the other side. In other words, when the third light-shielding element 103 is set, the optical display system 303 on the other side will not be illuminated by the light source 100 when the light source 100 is turned on.

[0156] Because the optical components in a head-mounted display device are installed and arranged compactly, light emitted from one light source 100 can easily illuminate the opposite optical display system 303. The opposite optical display system 303 will reflect or scatter the light from the light source 100, and this reflected or scattered light is easily captured by the image acquisition unit on the side of the light source 100, forming stray light spots on the eye image due to the reflection of light from the light source 100 by the opposite optical display system 303. Therefore, to avoid the opposite optical display system 303 reflecting light from the light source 100 and forming stray light spots on the eye image, it is necessary to block the third light area 503 of the light source 100 to prevent light from the third light area 503 of the light source 100 from illuminating the opposite optical display system 303 and ultimately forming stray light spots on the eye image, thus affecting the acquisition quality of the eye image and improving the recognition and positioning accuracy of the effective light spot in the eye image.

[0157] Because the positions of the light source 100 on the same-side optical display system 300 differ, the formation of the third light region 503 also differs. Furthermore, the closer the light source 100 is to the opposite-side optical display system 303, the easier it is to form the third light region 503; conversely, the farther the light source 100 is from the opposite-side optical display system 303, the less likely it is to form the third light region 503. The specific arrangement of the third light-shielding element 103 can be designed according to the specific position of the light source 100 and the requirements. This application embodiment does not specifically limit the shape, light-shielding principle, light-shielding material, or arrangement position of the third light-shielding element 103; the third light-shielding element 103 simply needs to prevent light from the third light region 503 from illuminating the same-side optical display system 300.

[0158] refer to Figures 31-32 This is a schematic diagram of the light-blocking angle provided in the embodiments of this application. The third light source module for eye tracking at least blocks the light emitted by the light source at the third light-blocking angle. The third light-blocking angle is the angle between tangents T5 and T6. Tangent T5 is the straight line with the smallest angle to the X-axis among all tangents made from a point on the light source to the surface of the opposite optical display system, and tangent T6 is the straight line with the largest angle to the X-axis among all tangents made from a point on the light source to the surface of the opposite optical display system. The third light-blocking angle is not less than 25 degrees. In other words, the third light area 503 contains at least the light emitted by the light source 100 at the third light-blocking angle, which needs to be blocked by the third light source module 103 for eye tracking.

[0159] Specifically, tangents T5 and T6 are drawn from any point on the light source 100 to the surface of the opposite optical display system 303. The angle between tangents T5 and T6 is the third shading angle A3, which is not less than 25 degrees. Tangent T5 is the straight line with the smallest angle to the X-axis among all tangents drawn from a point on the light source 100 to the surface of the opposite optical display system 303, and tangent T6 is the straight line with the largest angle to the X-axis among all tangents drawn from a point on the light source 100 to the surface of the opposite optical display system 303. The third light source module 103 for eye tracking at least blocks the light emitted from the light source 100 at the third shading angle A3. A tangent is drawn from a point on the light source 100 near the opposite optical display system 303 to the opposite optical display system 303, with the third shading angle A3 not less than 25 degrees. A tangent is drawn from a point on the light source 100 on the side away from the optical display system 303 to the optical display system 303 on the other side, and the third shading angle A3 is not less than 8 degrees.

[0160] The light-blocking element 10 at least blocks the light emitted from the light source 100 from the light-blocking angle, so that the light from the light source within the light-blocking angle cannot shine into the light-blocking area, and the light-transmitting area 601 does not include the light emitted from the light source from the light-blocking angle. The light-blocking angle includes a first light-blocking angle A1, a second light-blocking angle A2, and a third light-blocking angle A3.

[0161] In some embodiments, reference Figure 35 This is a schematic diagram of a photomask 600. The photomask 600 includes at least one of a first light-blocking element 102, a second light-blocking element 104, and a third light-blocking element 103, as well as a light-transmitting element 101. The photomask 600 may include an inner cover B and an outer cover A. The inner cover B covers the light source 100, and the outer cover A is disposed outside the inner cover B. The inner cover B includes the light-transmitting element 101 and at least one of the first light-blocking element 102, the second light-blocking element 104, and the third light-blocking element 103, or the outer cover A includes at least one of the first light-blocking element 102, the second light-blocking element 104, and the third light-blocking element 103. This ensures that light is not emitted from the first light area 502, the second light area 504, or the third light area 503.

[0162] refer to Figure 36 This is another structural schematic diagram of the photomask 600. The photomask 600 may only include an outer cover A, which covers the light source. The outer cover A includes at least one of a first light-blocking element 102, a second light-blocking element 104, and a third light-blocking element 103, as well as a light-transmitting element 101, to ensure that light is not emitted from the first light area 502, the second light area 504, or the third light area 503.

[0163] In some embodiments, reference Figure 35 , Figure 36The first light-shielding element 102, the second light-shielding element 104, and the third light-shielding element 103 can be integrally formed or separately disposed. For example, the first light-shielding element 102, the second light-shielding element 104, and the third light-shielding element 103 can be connected to each other to form a light cover 600. Alternatively, two of the first light-shielding elements 102, the second light-shielding element 104, and the third light-shielding element 103 can be connected to each other, while the third light-shielding element can be disposed separately from the other light-shielding elements to form a light cover 600. Or, the first light-shielding element 102, the second light-shielding element 104, and the third light-shielding element 103 can all be disposed separately without being connected to each other to form a light cover 600.

[0164] In some embodiments, reference Figure 36 If each light source 100 is equipped with an independent photomask 600 for light blocking, the photomask 600 typically consists of a first light-blocking element 102, a second light-blocking element 104, and a third light-blocking element 103. (Reference) Figure 35 When multiple light sources 100 are collectively shielded by a single photomask 600, the photomask 600 is generally composed of multiple first shielding elements 102, multiple second shielding elements 104, and multiple third shielding elements 103, forming a single shielding element, such as a ring covering the periphery of multiple LED lights. In other words, a structure independently covering each light source 100 can be considered a photomask 600, and a structure that collectively covers multiple light sources 100 in a device through one or more integral components can also be considered a photomask 600.

[0165] Optionally, the light-emitting area of ​​the light source 100 is completely covered by the light-transmitting area 601 and the light-shielding area 602.

[0166] In this design, the light-emitting region 400 of the light source 100 can be approximated as a sphere with a radius or diameter of X. The photomask 600 can be a spherical shell, rectangular shell, etc., surrounding the light source 100. When the photomask 600 is completely set as a light-blocking region 602, the light-emitting region 400 of the light source 100 is completely blocked, and the light source 100 cannot emit light outside the photomask 600. Similarly, when the photomask 600 is completely set as a light-transmitting region 601, the emitted light from the light source 100 can completely pass through the photomask 600. Therefore, the light-blocking region 602 and the light-transmitting region 601 on the photomask 600 constitute the light-emitting region of the light source 100. The photomask 600 and the light source 100 can form an integrated light source module.

[0167] Specifically, Figure 33 This is a schematic diagram of the photomask structure of a light source module proposed in one embodiment of this application. Figure 34 This is a schematic diagram of the photomask structure of a light source module according to another embodiment of this application. (Reference) Figure 33 and Figure 34 , Figure 33 The light cover 600, which uses an opaque housing to shield the light source 100, is mounted on the PCB circuit board 700 or on the housing near the edge of the lens group of the head-mounted device. Figure 34 The light shield 600, consisting of light-shielding devices 800 such as light-shielding sheets, coatings, or double-sided adhesive, surrounds the light source 100 and is mounted on the PCB circuit board 700 or on the housing near the edge of the lens assembly of the head-mounted device. Corresponding light-shielding elements are arranged on the light-shielding area 602 to block the light from the light source 100, preventing it from illuminating the same-side optical display system 300, the opposite-side optical display system 303, and the opposite-side eye region 201. The light-transmitting area 601 allows light from the light source 100 to pass through, ensuring that the transmitted light reaches at least the same-side eye region 200, so that the cornea within the same-side eye region 200 can reflect the light from the light source 100 to the image acquisition unit, forming an eye image with an effective light spot.

[0168] Optionally, the light-shielding area 602 is provided with a light-reflecting layer, which is used to reflect the light shining on the light-shielding area 602 and allow the light to exit from the light-transmitting area 601.

[0169] The light-reflecting layer can be an anti-reflective layer, which is a film layer that increases the reflection of light. Thus, through the function of the light-reflecting layer, the light shone from the light source 100 onto the light-blocking area 602 can be reflected to the light-transmitting area 601, which is used to irradiate the cornea of ​​the ipsilateral eye region 200, thereby increasing the light utilization rate of the light source 100.

[0170] In the above embodiments, the light-transmitting element 101, the first light-blocking element 102, the second light-blocking element 104, and the third light-blocking element 103 can use the photomask 600 as a carrier to sequentially transmit light to the light-transmitting area 501 and block light to the first light area 502, the second light area 504, and the third light area 503.

[0171] Therefore, by limiting the light source's illumination range through a shaded area, it's possible to prevent light from reflecting off other objects such as lenses on the same side, the eye on the other side, or other lenses on the other side, thus avoiding stray light in the captured image of the eye. This improves the image quality of the eye glare. Furthermore, it simplifies light source placement; only the location of the light source needs to be determined. A light source with a 360° illumination range can even be used. After determining the shaded area, only a suitable shade needs to be designed to limit light emission from the area requiring shade, eliminating the need for repeated adjustments to the light-shading angle and testing for the appropriate illumination range. Simultaneously, the minimum area that the light must illuminate can be directly determined based on the supplementary lighting area on the same side of the eye. By using shaded elements to control the light source's illumination range, the utilization efficiency of the light source is improved, saving energy.

[0172] This application also provides an eye-tracking system, including a light-shielding element, an image acquisition unit, and at least one processor, as described in any embodiment of this application.

[0173] The light source module is used to emit light into the same-side eye region.

[0174] The image acquisition unit is used to acquire eye images, wherein the eye images contain effective light spots formed by light from the corneal reflective light source module within the same side of the eyeball region.

[0175] At least one processor is configured to determine eye features in an eye image and to determine the user's gaze information based on those eye features.

[0176] In this embodiment, the image acquisition unit can be an infrared camera, an infrared image sensor, a camera or video camera, a DVS (Dynamic Vision Sensor), etc. The light source module can be the light source module described in the foregoing examples. The processor can be various general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of processors include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Eye features include, but are not limited to, pupil position, pupil shape, iris position, iris shape, limbal position, limbal boundary (the black and white boundary of the eyeball), eyelid position, canthus position, and spot (also known as Purkinje spot) position, etc.

[0177] Specifically, the light source module emits light into the ipsilateral eye region, and the cornea within that region reflects the light into the image acquisition unit, enabling the unit to capture an eye image with a valid light spot. At least one processor can perform computational processing on the eye image with the valid light spot to determine information about the valid light spot, such as its location and size. Based on this information, the processor calculates the user's gaze information, which includes, but is not limited to, the user's gaze direction and / or gaze point information.

[0178] By configuring the light source module in this embodiment, it is possible to prevent other surfaces besides the ipsilateral eyeball region from reflecting light from the light source to the image acquisition unit. This effectively prevents the image acquisition unit from acquiring eye images with many stray light spots, improving the acquisition quality of eye images and enhancing the accuracy of identifying and locating effective light spots in eye images. Figure 14As shown, the first light-blocking element 102, the second light-blocking element 104, and the third light-blocking element 103 sequentially block the same-side lens group 301, the opposite-side eye region 201, and the opposite-side optical display system 303, preventing the light source 100 from shining on their surfaces and causing light reflection into the image acquisition unit, thus preventing the formation of stray light spots in the eye image. Only light transmission to the light-transmitting area 601 is retained, avoiding excessive stray light spots in the eye image, which helps improve the recognition and positioning accuracy of effective light spots in the eye image.

[0179] In summary, the technical solutions of this application have the following beneficial effects. According to the light source module and eye tracking system for eye tracking proposed in this application, by setting a light cover in the optical path from the light source to the same-side optical display system, and setting a light-transmitting area on the light cover, the light from the light source can pass through the light-transmitting area to illuminate the same-side eye region. When the light-transmitting area is the same as the same-side eye region, the light from the light source only illuminates the same-side eye region, and no other stray light enters the same-side eye region. Therefore, stray light spots on the eye image can be reduced, and a higher quality eye image can be obtained. This is beneficial for locating the tracked light spot, i.e., the effective light spot, in the same-side eye region, thereby reducing the impact of stray light spots on eye tracking calculation and improving the accuracy and efficiency of eye tracking calculation.

[0180] An eye-tracking system is a system that utilizes the pupil-corneal reflection principle. It includes a light source module: the light source in the module is typically an infrared light source because infrared light does not affect the eye's vision; and multiple infrared light sources can be arranged in a predetermined pattern, such as a ring, a triangular pattern, or a straight line; it also includes an image acquisition unit: such as an infrared camera, an infrared image sensor, a camera or video camera, or a DVS (Dynamic Visual Sensor). The principle of the pupil-corneal reflection method is as follows: 1. Eye image acquisition: The light source shines on the eye, and the image acquisition unit captures an image of the eye, correspondingly capturing the reflection point of the light source on the cornea, i.e., the light spot (also called the Pulciens spot), thus acquiring an eye image with the light spot. 2. Gaze / fixation point estimation: As the eye moves, the relative positional relationship between the pupil center and the light spot changes accordingly. The acquired eye images with the light spot reflect this positional change relationship; gaze / fixation point estimation is performed based on this positional change relationship.

[0181] It should be understood that the various forms of processes shown above can be used to rearrange, add, or delete steps. For example, the steps described in this application can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this application can be achieved, and this is not limited herein.

[0182] The specific embodiments described above do not constitute a limitation on the scope of protection of this application. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this application should be included within the scope of protection of this application.

Claims

1. A light source module for eye tracking, characterized in that, include: A light source, wherein a portion of the light from the light source is directed onto the ipsilateral eye region for supplemental illumination; A light mask, comprising a light-transmitting element and a light-blocking element, wherein the light-transmitting element is used to allow light from the light source to shine into the light-transmitting area, and the light-blocking element is used to block light from shining into the light-blocking area. The light-transmitting range of the light-transmitting area includes at least the ipsilateral eye region, wherein the ipsilateral eye region is characterized as the area enclosed by the curved surface formed by all tangents from any point on the light source to the outermost surface of the ipsilateral eye region.

2. The light source module for eye tracking according to claim 1, characterized in that, The light-transmitting element directs the light emitted from the light source at the light transmission angle toward the ipsilateral eye region. The light transmission angle is the angle between the tangent Ta and the tangent Tb. The tangent Ta is the straight line with the smallest angle to the X-axis among all tangents made from a point on the light source to the surface of the ipsilateral eye region. The tangent Tb is the straight line with the largest angle to the X-axis among all tangents made from a point on the light source to the surface of the ipsilateral eye region.

3. The light source module for eye tracking according to claim 2, characterized in that, It also includes a first preset center and a second preset center, wherein the first preset center is the intersection of the Z-axis and the X-axis passing through the center of the same-side optical display system, and the second preset center is the intersection of the Z-axis and the X-axis passing through the center of the opposite-side optical display system.

4. The light source module for eye tracking according to claim 3, characterized in that, With the first preset center as the origin, when the coordinates of the tangent Ta and the tangent point on the surface of the same-side eyeball region are (0, 0, 8), and the coordinates of the tangent Tb and the tangent point on the surface of the same-side eyeball region are (6, 0, 11), the light transmission angle is not less than 10 degrees.

5. The light source module for eye tracking according to claim 3, characterized in that, With the first preset center as the origin, when the coordinates of the tangent point Ta and the surface of the same-side eyeball region are (-13, 0, 8), and the coordinates of the tangent point Tb and the surface of the same-side eyeball region are (24, 0, 21), the light transmission angle is not less than 64 degrees.

6. The light source module for eye tracking according to claim 3, characterized in that, With the first preset center as the origin, when the coordinates of the tangent point Ta and the surface of the ipsilateral eyeball region are (-13, 0, 8), and the coordinates of the tangent point Tb and the surface of the ipsilateral eyeball region are (24, 0, 42), the light transmission angle is not less than 70 degrees.

7. The light source module for eye tracking according to claim 1, characterized in that, The light-transmitting element is a notch or a light-transmitting component.

8. The light source module for eye tracking according to claim 1, characterized in that, The light transmission range of the light-transmitting area is at most the difference between the light diffusion area of ​​the light source and the light-blocking area.

9. The light source module for eye tracking according to claim 8, characterized in that, The light-shielding area is at least the area in which stray light rays are generated by the light source.

10. The light source module for eye tracking according to claim 8, characterized in that, The light-blocking element at least blocks the light emitted from the light source from the light-blocking angle, so that the light from the light source within the light-blocking angle cannot shine into the light-blocking area, and the light-transmitting area does not include the light emitted from the light source from the light-blocking angle.

11. The light source module for eye tracking according to claim 10, characterized in that, The light-shielding area includes a first light area, and the light-shielding element includes a first light-shielding element. The first light-shielding element is used to block the first light area. The first light area represents the light area illuminated by the light source onto the same-side optical display system. The same-side optical display system includes a lens group and a display screen arranged sequentially along a first direction. The first direction is the direction of the user's eye looking at the same-side optical display system.

12. The light source module for eye tracking according to claim 11, characterized in that, The light-blocking angle includes a first light-blocking angle, wherein the first light-blocking element at least blocks the light emitted from the light source at the first light-blocking angle. The first light-blocking angle is the angle between tangents T1 and T2. Tangent T1 is the straight line with the smallest angle to the X-axis among all tangents made from any point on the light source to the surface of the optical display system on the same side, and tangent T2 is the straight line with the smallest angle to the Z-axis among all tangents made from any point on the light source to the surface of the optical display system on the same side. The first light-blocking angle is not less than 80 degrees.

13. The light source module for eye tracking according to claim 10, characterized in that, The light-blocking area includes a second light area, and the light-blocking element includes a second light-blocking element. The second light-blocking element is used to block the second light area, and the second light area represents the light area of ​​the light source illuminating the opposite eyeball region.

14. The light source module for eye tracking according to claim 13, characterized in that, The light-blocking angle includes a second light-blocking angle, wherein the second light-blocking element at least blocks the light emitted from the light source at the second light-blocking angle, and the second light-blocking angle is the angle between tangent T3 and tangent T4.

15. The light source module for eye tracking according to claim 14, characterized in that, The tangent T3 is the straight line with the smallest angle to the X-axis among all the tangents made from a point on the light source to the surface of the opposite eye region, and the tangent T4 is the straight line with the largest angle to the X-axis among all the tangents made from a point on the light source to the surface of the opposite eye region.

16. The light source module for eye tracking according to claim 14, characterized in that, The tangent T3 is the straight line with the smallest angle to the X-axis among all the tangents made from a point on the light source to the surface of the same-side eye region, and the tangent T4 is the straight line with the smallest angle to the X-axis among all the tangents made from a point on the light source to the surface of the opposite-side eye region.

17. The light source module for eye tracking according to claim 15, characterized in that, With the second preset center as the origin, when the coordinates of the tangent T3 and the surface of the opposite eye region are (13, 0, 8), and the coordinates of the tangent T4 and the surface of the opposite eye region are (-24, 0, 42), the second shading angle is not less than 27 degrees.

18. The light source module for eye tracking according to claim 15, characterized in that, With the second preset center as the origin, when the coordinates of the tangent T3 and the surface of the opposite eye region are (13, 0, 8) and the coordinates of the tangent T4 and the surface of the opposite eye region are (-24, 0, 42), the second light-blocking angle is not less than 66 degrees.

19. The light source module for eye tracking according to claim 15, characterized in that, With the second preset center as the origin, when the coordinates of the tangent T3 and the surface of the opposite eyeball region are (0, 0, 8) and the coordinates of the tangent T4 and the surface of the opposite eyeball region are (-6, 0, 11), the second shading angle is not less than 2 degrees.

20. The light source module for eye tracking according to claim 15, characterized in that, With the second preset center as the origin, when the coordinates of the tangent T3 and the surface of the opposite eye region are (0, 0, 8), and the coordinates of the tangent T4 and the surface of the opposite eye region are (-6, 0, 11), the second shading angle is not less than 8 degrees.

21. The light source module for eye tracking according to claim 15, characterized in that, With the second preset center as the origin, when the coordinates of the tangent T3 and the surface of the opposite eyeball region are (13, 0, 8), and the coordinates of the tangent T4 and the surface of the opposite eyeball region are (-24, 0, 21), the second shading angle is not less than 13 degrees.

22. The light source module for eye tracking according to claim 15, characterized in that, With the second preset center as the origin, when the coordinates of the tangent T3 and the surface of the opposite eye region are (13, 0, 8) and the coordinates of the tangent T4 and the surface of the opposite eye region are (-24, 0, 21), the second shading angle is not less than 54 degrees.

23. The light source module for eye tracking according to claim 16, characterized in that, With the first preset center as the origin, the coordinates of the tangent T4 and the surface of the same-side eyeball region are (13, 0, 8). With the second preset center as the origin, the coordinates of the tangent T3 and the surface of the opposite-side eyeball region are (13, 0, 8). The second shading angle is not less than 6 degrees.

24. The light source module for eye tracking according to claim 8, characterized in that, The light-shielding area includes a third light area, and the light-shielding element includes a third light-shielding element. The third light-shielding element is used to block the third light area, and the third light area represents the light area illuminated by the light source onto the opposite side optical display system.

25. The light source module for eye tracking according to claim 24, characterized in that, The light-blocking angle includes a third light-blocking angle, wherein the third light-blocking element at least blocks the light emitted from the light source at the third light-blocking angle. The third light-blocking angle is the angle between tangent T5 and tangent T6. Tangent T5 is the straight line with the smallest angle to the X-axis among all tangents made from a point on the light source to the surface of the opposite optical display system. Tangent T6 is the straight line with the largest angle to the X-axis among all tangents made from a point on the light source to the surface of the opposite optical display system.

26. The light source module for eye tracking according to claim 10, characterized in that, The light source is located between the lens group and the same-side eyeball region, and the first light-blocking element is used to block the light from the light source from shining onto the lens group.

27. The light source module for eye tracking according to claim 10, characterized in that, The lens group includes at least a first lens group and a second lens group arranged along a first direction, the light source is located between the first lens group and the second lens group, and the first light-shielding element is used to block the light from the light source from shining onto the second lens group.

28. The light source module for eye tracking according to claim 10, characterized in that, The light source is located between the lens group and the display screen, and the first light-shielding element is used to block the light from the light source from shining onto the display screen.

29. The light source module for eye tracking according to claim 1, characterized in that, The light-emitting area of ​​the light source is completely covered by the light-transmitting area and the light-blocking area.

30. An eye-tracking system, characterized in that, Includes a light source module, an image acquisition unit, and at least one processor for eye tracking as described in any one of claims 1-29; The light source module is used to emit light into the same-side eye region; The image acquisition unit is used to acquire images of the eye. At least one processor is configured to determine eye features in the eye image and determine the user's gaze information based on the eye features.