Shading structure for eyeball tracking system and eyeball tracking system

Abstract

According to the shading structure for the eyeball tracking system and the eyeball tracking system, the first shading structure is arranged on the light path of the light source irradiating to the first optical display system, so that the light source can be prevented from irradiating to the first optical display system; and the first optical display system is effectively prevented from reflecting or scattering the light of the light source to form first stray light, so that the first stray light is prevented from entering the first eyeball area. Therefore, excessive stray light spots are prevented from appearing in the collected eye image, the eye image with higher quality and effective light spots can be obtained, and the eyeball tracking calculation precision and efficiency can be improved.

Description

Technical Field

[0001] This application relates to the field of eye-tracking technology, and more particularly to a light-shielding structure for an eye-tracking system and an eye-tracking system. Background Technology

[0002] As people learn about and understand near-eye display technology, near-eye display products have been applied in various industries. Among them, VR (Virtual Reality) and Augmented Reality technologies have been widely used.

[0003] Current VR devices typically include eye-tracking devices with eye-tracking capabilities. These devices usually employ the pupillary-corneal reflection method, where an infrared light source illuminates the user's eyes. An image sensor captures an image of the user's eyes showing a light spot, and eye-tracking calculations are performed using this image. Therefore, when configuring eye-tracking devices in VR devices, the light source used to illuminate the user's eyes is usually placed near the lens within the VR device for easy eye contact.

[0004] When tracking a specific eye gaze position, the light spots in the eye image should be formed by the reflection of light from the cornea. However, due to the compact design of near-eye display devices, some of the light generated by the light source can easily create irregular light paths within the VR device. Some light is reflected or scattered by other surfaces and eventually enters the camera's field of view, forming stray light spots in the image. This can easily lead to poor image quality and adversely affect eye tracking calculations. Summary of the Invention

[0005] This application provides a light-shielding structure and an eye-tracking system for use in an eye-tracking system, in order to solve the problem of stray light entering the field of view of the camera from some of the light generated by the light source in the related art, improve the quality of the eye image used for eye-tracking calculation, and improve the accuracy of eye-tracking.

[0006] According to one aspect of this application, a light-shielding structure for an eye-tracking system is provided, comprising: a light source and a light shield;

[0007] Part of the light from the light source illuminates the first eyeball area for supplemental lighting, and part of the light from the light source illuminates the first optical display system, which is capable of generating first stray light; wherein, the first optical display system includes a lens group and a display screen arranged sequentially along a first direction, and the first direction is the direction of the user's eye looking at the first optical display system;

[0008] The light cover includes a first light-shielding structure for blocking a first light area, wherein the first light area contains the first stray light.

[0009] Optionally, the first light-shielding structure at least blocks the light emitted by the light source at a first illumination angle, where the first illumination angle is the angle between tangent T1 and tangent T2. Tangent T1 is the straight line with the smallest angle to the X-axis among all tangents made from a point on the light source to the surface of the first optical display system, and tangent T2 is the straight line with the largest angle to the X-axis among all tangents made from a point on the light source to the surface of the first optical display system.

[0010] Optionally, the first light region includes a sub-light region one, the light source is located between the lens group and the first eyeball region, and the sub-light region one represents the light region illuminated by the light source onto the lens group. Optionally, the first light region includes a sub-light region two, the lens group includes at least a first lens group and a second lens group arranged along a first direction, the light source is located between the first lens group and the second lens group, and the sub-light region two represents the light region illuminated by the light source onto the second lens group.

[0011] Optionally, the first light area includes a third sub-light area, the light source is located between the lens group and the display screen, and the third sub-light area represents the light area illuminated by the light source onto the display screen.

[0012] Optionally, for an eye-tracking system, the light shield may further include a second light shield structure;

[0013] Part of the light from the light source shines onto the second eyeball region, forming a second stray light. The second light-blocking structure is used to block the second light region, wherein the second light region contains the second stray light.

[0014] Optionally, the second light-shielding structure at least blocks the light emitted by the light source at the second illumination angle, which is the angle between tangent T3 and tangent T4.

[0015] Optionally, it also includes a first preset center and a second preset center, wherein the first preset center is the intersection of the Z-axis and the X-axis passing through the center of the first optical display system, and the second preset center is the intersection of the Z-axis and the X-axis passing through the center of the second optical display system.

[0016] Optionally, the tangent T3 is the straight line with the smallest angle to the X-axis among all the tangents made from a point on the light source to the surface of the second eyeball region, and the tangent T4 is the straight line with the largest angle to the X-axis among all the tangents made from a point on the light source to the surface of the second eyeball region.

[0017] Optionally, the tangent T3 is the straight line with the smallest angle to the X-axis among all tangents made from a point on the light source to the surface of the first eyeball region, and the tangent T4 is the straight line with the smallest angle to the X-axis among all tangents made from a point on the light source to the surface of the second eyeball region.

[0018] Optionally, with the second preset center as the origin, the coordinates of the tangent point T3 and the surface of the second eyeball region are (13, 0, 8), and the coordinates of the tangent point T4 and the surface of the second eyeball region are (-24, 0, 42), the second irradiation angle is not less than 27 degrees.

[0019] Optionally, with the second preset center as the origin, the coordinates of the tangent point T3 and the surface of the second eyeball region are (13, 0, 8), and the coordinates of the tangent point T4 and the surface of the second eyeball region are (-24, 0, 42), the second irradiation angle is not less than 66 degrees.

[0020] Optionally, with the second preset center as the origin, the coordinates of the tangent point T3 and the surface of the second eyeball region are (0, 0, 8), and the coordinates of the tangent point T4 and the surface of the second eyeball region are (-6, 0, 11), the second irradiation angle is not less than 2 degrees.

[0021] Optionally, with the second preset center as the origin, the coordinates of the tangent point T3 and the surface of the second eyeball region are (0, 0, 8), and the coordinates of the tangent point T4 and the surface of the second eyeball region are (-6, 0, 11), the second irradiation angle is not less than 8 degrees.

[0022] Optionally, with the second preset center as the origin, the coordinates of the tangent point T3 and the surface of the second eyeball region are (13, 0, 8), and the coordinates of the tangent point T4 and the surface of the second eyeball region are (-24, 0, 21), the second irradiation angle is not less than 13 degrees.

[0023] Optionally, with the second preset center as the origin, the coordinates of the tangent point T3 and the surface of the second eyeball region are (13, 0, 8), and the coordinates of the tangent point T4 and the surface of the second eyeball region are (-24, 0, 21), the second irradiation angle is not less than 54 degrees.

[0024] Optionally, with the first preset center as the origin and the coordinates of the tangent T4 and the surface of the first eyeball region being (13, 0, 8), and with the second preset center as the origin and the coordinates of the tangent T3 and the surface of the second eyeball region being (13, 0, 8), the second irradiation angle is not less than 6 degrees.

[0025] Optionally, for an eye-tracking system, the light shield may further include a third light shielding structure;

[0026] Part of the light from the light source illuminates the second optical display system, which is capable of generating a third stray light. The third light-shielding structure is used to block the third light area, wherein the third light area contains the third stray light.

[0027] Optionally, the third light-shielding structure at least blocks the light emitted by the light source at the third illumination angle, where the third illumination angle is the angle between tangent T5 and tangent T6. Tangent T5 is the straight line with the smallest angle to the X-axis among all tangents made from a point on the light source to the surface of the second optical display system, and tangent T6 is the straight line with the largest angle to the X-axis among all tangents made from a point on the light source to the surface of the second optical display system.

[0028] Optionally, for an eye-tracking system, the light-shielding structure further includes a light-transmitting structure;

[0029] The light-transmitting structure can transmit infrared light to form a light-transmitting area, wherein the light-transmitting area is the area illuminated by the light source that forms supplementary light.

[0030] Optionally, a light-shielding structure for an eye-tracking system includes a light cover that encloses the light source. The light cover is used to adjust the light from the light source to illuminate a light-transmitting area, and to block the light from the light source from illuminating a light-shielding area, and to adjust or block the light from the light source from illuminating a non-fixed light area. The light-shielding area includes the first light area.

[0031] Optionally, the light-shielding area further includes a second light area and a third light area. Optionally, the light-diffusing area of ​​the light source is completely covered by the light-shielding area, the light-transmitting area, and the non-fixed light area.

[0032] According to another aspect of this application, an eye-tracking system is provided, including a light-shielding structure for an eye-tracking system as described in any embodiment of this application, an image acquisition unit, and at least one processor;

[0033] The light-shielding structure is used to emit light into the first eyeball region;

[0034] The image acquisition unit is used to acquire eye images, wherein the eye images have an effective light spot formed by the cornea reflecting light from the light-shielding structure within the first eyeball region;

[0035] At least one processor is configured to determine eye features in the eye image and determine the user's gaze information based on the eye features.

[0036] The technical solution of this application embodiment has the following beneficial effects. According to the light-shielding structure and eye-tracking system for eye-tracking system proposed in this application embodiment, by setting a first light-shielding structure in the optical path from the light source to the first optical display system, the light source can be prevented from shining on the first optical display system, thereby effectively preventing the first optical display system from reflecting or scattering the light from the light source to form first stray light, and thus preventing the first stray light from entering the first eye region. Therefore, stray light spots on the eye image can be reduced, resulting in a higher quality eye image, which is beneficial for locating the tracked light spot (i.e., the effective light spot) in the first eye region. This further helps to reduce the impact of stray light spots on eye-tracking calculations, improving the accuracy and efficiency of eye-tracking calculations.

[0037] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of this application, nor is it intended to limit the scope of this application. Other features of this application will become readily apparent from the following description. Attached Figure Description

[0038] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0039] Figure 1 This is a schematic diagram of the structure of the eye-tracking system provided in the embodiments of this application;

[0040] Figure 2 This is a schematic diagram of the eye movement surface of the tracked eye in the eye tracking system provided in the embodiments of this application;

[0041] Figure 3 This is a schematic diagram illustrating the positional relationship between the eye region and the first optical display system in the eye-tracking system provided in this application embodiment;

[0042] Figure 4 This is a schematic diagram of the structure of an eye-tracking system proposed in one embodiment of this application;

[0043] Figure 5 This is a schematic diagram of the light-shielding structure proposed in the embodiments of this application;

[0044] Figure 6 This is a schematic diagram showing the positional relationship between the bilateral eye regions and the optical display system in the eye-tracking system proposed in this application embodiment;

[0045] Figure 7 This is a schematic diagram of the light-shielding angle of the light-shielding structure proposed in the embodiments of this application;

[0046] Figure 8 This is a schematic diagram of the positional relationship between the X-axis and the Z-axis provided in an embodiment of this application;

[0047] Figure 9 This is a schematic diagram of the structure of an eye-tracking system proposed in another embodiment of this application;

[0048] Figure 10 This is a schematic diagram of the structure of an eye-tracking system proposed in another embodiment of this application;

[0049] Figure 11 This is a schematic diagram of the light-shielding structure proposed in one embodiment of this application;

[0050] Figures 12-13 This is a schematic diagram of the light-shielding angle of the light-shielding structure proposed in another embodiment of this application;

[0051] Figures 14-15 This is a schematic diagram of the light-shielding angle of the light-shielding structure proposed in another embodiment of this application;

[0052] Figures 16-17 This is a schematic diagram of the light-shielding angle of the light-shielding structure proposed in another embodiment of this application;

[0053] Figures 18-19 This is a schematic diagram of the light-shielding angle of the light-shielding structure proposed in another embodiment of this application;

[0054] Figure 20 This is a schematic diagram of the light-shielding structure proposed in another embodiment of this application;

[0055] Figure 21 This is a schematic diagram of the light-shielding angle of the light-shielding structure proposed in another embodiment of this application;

[0056] Figure 22 This is a schematic diagram of the light-shielding structure proposed in another embodiment of this application;

[0057] Figure 23 This is a schematic diagram of the light-shielding structure proposed in another embodiment of this application;

[0058] Figure 24 This is a schematic diagram of the light-shielding structure of a light-shielding structure proposed in one embodiment of this application;

[0059] Figure 25 This is a schematic diagram of the light-shielding structure proposed in another embodiment of this application;

[0060] Figure 26 This is a schematic diagram of the light-shielding structure proposed in a specific embodiment of this application;

[0061] Figure 27This is a schematic diagram of the light-shielding structure proposed in another specific embodiment of this application;

[0062] Figure 28 This is a schematic diagram of the light-shielding structure proposed in another specific embodiment of this application;

[0063] Figure 29 This is a schematic diagram of the light-shielding structure proposed in another specific embodiment of this application;

[0064] Figure 30 This is a schematic diagram of the light-shielding structure proposed in another specific embodiment of this application;

[0065] Figure 31 This is a schematic diagram of the light-shielding structure proposed in another specific embodiment of this application;

[0066] Figure 32 This is a schematic diagram of the light-shielding structure proposed in another specific embodiment of this application;

[0067] Figure 33 This is a schematic diagram of the light-shielding structure proposed in another specific embodiment of this application;

[0068] Figure 34 This is a schematic diagram of the light-shielding structure proposed in another specific embodiment of this application;

[0069] Figure 35 This is a schematic diagram of the light cover structure of another embodiment of the light-shielding structure proposed in this application;

[0070] Figure 36 This is a schematic diagram of the light cover structure of another embodiment of the light-shielding structure proposed in this application;

[0071] Figure 37 This is a schematic diagram of the light cover structure of another embodiment of the light-shielding structure proposed in this application. Detailed Implementation

[0072] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort should fall within the scope of protection of the present application.

[0073] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion.

[0074] Figure 1 This is a schematic diagram of the eye-tracking system provided in an embodiment of this application. Figure 1 As shown, the eye-tracking system includes a light source 100 and an image acquisition unit (not shown in the figure).

[0075] Light source 100 can be understood as a light-emitting body that emits light from 360 degrees, or a bare light source. Light source 100 can be an optical device including but not limited to infrared light sources, semiconductor light-emitting diodes (LEDs), laser diodes (LDs), and photodiodes (PINs). There can be one or multiple light sources 100.

[0076] The image acquisition unit may include, but is not limited to, panoramic cameras, dynamic vision cameras (DVS cameras), infrared cameras, and other image acquisition devices capable of acquiring images of the user's eyes.

[0077] In this system, light emitted from light source 100 illuminates the first ocular region 200. The light emitted from light source 100 is reflected by the cornea in the first ocular region 200 and enters the image acquisition device, enabling the image acquisition device to acquire an eye image with an effective light spot. The effective light spot is a Purkinjet spot, which refers to a reflective spot produced when infrared light illuminates the cornea. The image acquisition unit acquires the eye image of the first ocular region 200 and can obtain the position of the Purkinjet spot on the eye image to calculate the gaze position of the first ocular region 200 on the virtual image plane formed by the first optical display system 300.

[0078] The first optical display system 300 includes a display screen 302 and a lens group 301.

[0079] like Figure 1 As shown, the illumination range of the light source 100 is the light diffusion region 400. The light diffusion region 400 refers to the area that the light emitted by the light source 100 can illuminate or cover when there is no obstruction or blockage. In other words, the light diffusion region 400 refers to the area that the light emitted by the light source 100 can illuminate when there is no obstruction or blockage.

[0080] Specifically, light emitted from the light source 100 is present within the light divergence region 400. When the light from the light source 100 reaches the first optical display system 300, optical components within the first optical display system 300, such as the lens group 301 and the display screen 302, reflect or scatter the light from the light source 100. The light reflected or scattered by the first optical display system 300 enters the image acquisition unit, causing stray light spots to appear in the eye image acquired by the image acquisition unit. Stray light spots refer to the light spots produced when the light from the light source 100 illuminates substances other than the cornea of ​​the eye to be tracked. Excessive stray light spots in the eye image acquired by the image acquisition unit will reduce the image quality of the eye image, affect the identification and positioning of effective light spots, and reduce the accuracy and efficiency of eye tracking calculations.

[0081] For example, the light-shielding structure includes at least one light source 100. The light source 100 can be understood as a 360-degree emitting body, or a bare light source or light core. There can be one or more light sources 100. The light-shielding structure has multiple light sources 100, which can be arranged in a triangular or ring-like pattern. The following embodiment uses a single light source 100 as an example. In other embodiments where the light-shielding structure includes multiple light sources 100, each light source 100 should be light-shielded.

[0082] The first optical display system 300 can be understood as an optical display system located on the same side as the light source, while the second optical display system 303 can be understood as an optical display system located on a different side from the light source. (Reference) Figure 6 , Figure 6 In region A, the optical display system is on the same side as the light source 100 and is the first optical display system 300. In region B, the optical display system is on the opposite side of the light source 100 and is the second optical display system 303.

[0083] The first eye region 200 can be understood as the eye region on the same side as the light source 100, while the second eye region 201 can be understood as the eye region on the opposite side of the light source 100. (Reference) Figure 6 For example, in region A, the eye region is on the same side as the light source 100, which is the first eye region 200; in region B, the eye region is on the opposite side of the light source 100, which is the second eye region 201.

[0084] Specifically, the eyeball region can be represented as the movable area of ​​the eyeball, or the movable area formed by the eyeball's movable surface. The eyeball's movable surface is a surface formed by simultaneously considering one or more of the following factors: the rotation of the eyeball itself, the translational error of the head-mounted display device relative to the eyeball when the user wears it (such as VR or AR devices), and the differences in interpupillary distance among different individuals. (Reference) Figure 2 , Figure 2This is a schematic diagram of the eye movement surface of the tracked eye in the eye-tracking system provided in this application embodiment; the eye movement surface can be approximated as a plane, with a length ranging from 12-50 mm and a width ranging from 12-34 mm. For example, the plane has a length of 31 mm and a width of 23 mm.

[0085] Figure 3 This is a schematic diagram illustrating the positional relationship between the eye region and the first optical display system in the eye-tracking system provided in this application embodiment; Reference Figure 3 This indicates the positional relationship between the lens group on the same side as the eyeball and the eye region. The preset center O1 is the intersection of the X-axis and Z-axis. The Z-axis passes through the center of the optical display system and is perpendicular to the same-side optical display system. The X-axis is perpendicular to the Z-axis and passes through the center of the light source 100. Point O2 is the center of the eyeball movement surface. The first distance H1 is defined as the horizontal straight-line distance between points O1 and O2 when it is 8mm. The second distance H2 is defined as the horizontal straight-line distance between points O1 and O2 when it is 11mm, 21mm, 42mm, or 50mm. In other words, the first distance H1 and the second distance H2 are flexibly set according to the area where the user's eyeball may move during the actual design of the device. The area formed by the movement of the eyeball movement surface between the first distance H1 and the second distance H2 is the eye region 001. In other words, when the light source is turned on, the eye region on the same side as the light source will inevitably be illuminated. When infrared light illuminates the eye region on the same side as the light source, the image acquisition unit can capture an eye image with an effective light spot. Of course, the approximate dimensions of the eye movement surface and the data for the first distance H1 and the second distance H2 in this embodiment are merely examples. In actual applications, the approximate dimensions of the eye movement surface and the data for the first distance H1 and the second distance H2 may differ to some extent from the dimensions and data exemplified in this application.

[0086] When infrared light shines on the eye region on the same side as the light source, the image acquisition unit can capture an eye image with an effective light spot. Understandably, near-eye eye-tracking systems typically have two light-shielding structures: a left-side structure for illuminating the left eye region and a right-side structure for illuminating the right eye region.

[0087] Therefore, based on the above, this application proposes a light-shielding structure for an eye-tracking system. By cutting off the light path of the light source 100 illuminating the first optical display system 300, it prevents the light from the light source 100 from entering the first optical display system 300, thus eliminating the reflection or scattering of light from the light source 100 by the first optical display system 300 at its source. This helps reduce the formation of stray light spots on the eye image and improves the image quality acquired by the image acquisition unit.

[0088] Figure 4 This is a schematic diagram of the structure of an eye-tracking system proposed in one embodiment of this application. Figure 5 This is a schematic diagram of the light-shielding structure proposed in an embodiment of this application. For example... Figure 4 and Figure 5 As shown, the light-shielding structure includes a light source 100 and a light cover 600; part of the light from the light source 100 illuminates the first eye region 200 for supplemental lighting, and part of the light from the light source 100 illuminates the first optical display system 300 to form first stray light; wherein, the first optical display system 300 includes a lens group 301 and a display screen 302 arranged sequentially along a first direction F, the first direction F being the direction of the line of sight when the first eye region 200 looks at the first optical display system; the light cover 600 includes a first light-shielding structure 101, the first light-shielding structure 101 being used to block the first light region 500, wherein the first light region 500 contains the first stray light.

[0089] The light zone refers to the area that light travels through as it propagates in space. In other words, the light zone is the range or area covered by light.

[0090] In this embodiment, the first light region 500 is the area formed by the light rays emitted from the light source 100 onto the first optical display system 300, or, in other words, the first light region 500 is the area illuminated by the light source that forms the first stray light rays. It can be characterized as a cone-shaped area formed by the light rays emitted from the light source 100 that illuminate the first optical display system 300 and are tangent to the edge of the first optical display system 300. In other words, it is the area enclosed by the curved surface formed by all tangents from any point on the light source to the outermost surface of the first optical display system 300. Supplemental lighting refers to illuminating the first eye region with the light source so that the first eye region can achieve a certain brightness, which is beneficial for the image acquisition unit to acquire eye images that can be used for analysis and calculation.

[0091] The first light-shielding structure 101 can be a light-shielding sheet, a light-shielding ring, or a light-shielding film, such as a black film. The first light-shielding structure 101 can be made of a material that does not transmit infrared light or all light, or a material that does not transmit infrared light of a specific infrared band. It can be a shell, a coating, a tape, a sheet, a circuit board, or a carrier of an infrared lamp emitter, or any combination of the above materials, to serve to block infrared light.

[0092] Stray light can be understood as light from the light source 100 that, after being reflected or scattered, enters the image acquisition unit from areas outside the first eyeball region. Alternatively, it can be understood as light from the light source that reaches areas outside the first eyeball region that can be reflected or scattered. Stray light causes stray spots on the eye image acquired by the image acquisition unit. The first stray light is a portion of the light from the light source 100 that is incident on the first optical display system 300, and is reflected or scattered by the first optical display system 300.

[0093] Specifically, by setting the first light-shielding structure 101, the light originally illuminating the first optical display system 300 from the light source 100 will no longer illuminate the first optical display system 300. Consequently, the first optical display system 300 will no longer reflect or scatter the light from the light source 100, and it will not enter the first eye region 200. In other words, when the first light-shielding structure 101 is set on the light source 100, the first optical display system 300 in the first direction F will not be illuminated by the light source 100 when the light source 100 is turned on. Thus, the number of stray light spots in the eye image acquired by the image acquisition unit can be reduced, the acquisition quality of the eye image can be improved, and the recognition and positioning accuracy of light spots in the eye image can be improved.

[0094] When multiple LEDs are used as light sources 100, a first light-shielding structure 101 can be provided for each cone-shaped area formed by the light rays from each LED illuminating the first optical display system 300, or the first light-shielding structure 101 can be configured as a whole to shield multiple light sources. It is understood that the multiple LEDs are generally arranged along the edge of the first optical display system 300, for example, around or outside the lens of the head-mounted virtual reality display, or above the surface near the edge of the lens, or near the outer edge of the lens, etc. This application embodiment does not specifically limit the arrangement position of the light sources 100. This application embodiment does not specifically limit the shape, light-shielding principle, light-shielding material, or arrangement position of the first light-shielding structure 101; the first light-shielding structure 101 simply needs to prevent light within the first light area 500 from illuminating the first optical display system 300.

[0095] In one embodiment, due to different requirements for the installation of components such as the first optical display system 300, light source 100, and image acquisition unit within different head-mounted display devices—for example, considering aesthetics or the need for more compact installation between components—the light source 100 may be installed between the lens group 301 and the first eyeball region 200, or within the lens group 301, or between the lens group 301 and the display screen 302. When the light source 100 is located in different positions, the optical elements illuminated by the light from the light source 100 are different, resulting in variations in the area of ​​the first light region 500.

[0096] refer to Figure 7 , Figure 7 This is a schematic diagram of the light-shielding angle of the light-shielding structure proposed in this application embodiment. The first light-shielding structure 101 at least blocks the light emitted by the light source at a first illumination angle. The first illumination angle is the angle between tangents T1 and T2. Tangent T1 is the straight line with the smallest angle to the X-axis among all tangents made from any point on the light source to the surface of the first optical display system 300, and tangent T2 is the straight line with the largest angle to the X-axis among all tangents made from any point on the light source to the surface of the first optical display system 300. The first illumination angle is not less than 80 degrees. That is to say, the first light-shielding structure 101 can at least block the light emitted by the light source 100 from the first illumination angle, so that the light emitted by the light source 100 from the first illumination angle cannot illuminate the first optical display system 300. In other words, the first light area 500 contains at least the light emitted by the light source 100 at the first illumination angle, which needs to be blocked by the first light-shielding structure 101. In some embodiments, the first light-shielding structure 101 is not used to block the light emitted from the light source 100 that has been reflected by the user's face and then enters the first optical display system 300.

[0097] In this embodiment, reference Figures 7 to 8 , Figure 8 This is a schematic diagram illustrating the positional relationship between the X-axis and Z-axis provided in an embodiment of this application. The Z-axis passes through the center of the optical display system and is perpendicular to the optical display system. The optical display system can be either a first light-emitting display system 300 or a second optical display system 303. The X-axis is perpendicular to the Z-axis and parallel to the line connecting the center of the first light-emitting display system 300 and the center of the second optical display system 303. The center of the light source 100 is located on the horizontal plane containing the X-axis. That is, the intersection points of the X-axis and the two Z-axis are O1' and O1', respectively, and the vertical distance between the intersection point of the X-axis and the Z-axis and the corresponding center of the optical display system is equal to the vertical distance from the center of the light source 100 to the horizontal plane containing the center of the corresponding side of the optical display system.

[0098] The first optical display system 300 generally includes a lens group 301 and a display screen 302. The light source 100 can be located in front of the lens group 301, inside the lens group 301, or between the lens group 301 and the display screen 302. Therefore, when the light source 100 is located in front of the lens group 301, the surface of the first optical display system 300 refers to the surface of the lens group 301. When the light source 100 is located inside the lens group 301, the surface of the first optical display system 300 refers to the surface of the lens group 301 located behind the light source 100. When the light source 100 is located between the lens group 301 and the display screen 302, the surface of the first optical display system 300 refers to the surface of the display screen 302. In other words, the surface of the first optical display system 300 consists of various optical elements arranged behind the light source 100.

[0099] For example, refer to Figure 7 A light source 100 is positioned in front of the first optical display system 300. A tangent T1 and a tangent T2 are formed by drawing a tangent line from any point on the light source 100 to the surface of the first optical display system 300. The angle between tangent T1 and tangent T2 is the first illumination angle A1, which is not less than 80 degrees. Tangent T1 is the straight line with the smallest angle to the X-axis among all tangent lines drawn from a point on the light source 100 to the surface of the first optical display system 300, and tangent T2 is the straight line with the largest angle to the X-axis among all tangent lines drawn from a point on the light source 100 to the surface of the first optical display system 300. The first light-shielding structure 101 at least blocks the light emitted from the light source 100 at the first illumination angle A1. The first illumination angle A1 is not less than 80 degrees; in some embodiments, the first illumination angle A1 is not less than 20 degrees. Optionally, refer to... Figure 4 As shown, the first light region 500 includes a sub-light region 500a. The light source 100 is located between the lens group 301 and the first eyeball region 200. The sub-light region 500a represents the area formed by the light emitted from the light source 100 and illuminating the lens group 301. In other words, it is the area enclosed by the curved surface formed by all tangents from any point on the light source to the outermost surface of the lens group 301. Thus, the first light-shielding structure 101 can block the cone-shaped region 500a formed by the light from the light source 100 illuminating the lens group 301, preventing the light from the light source 100 from illuminating the lens group 301 and reflecting to form stray light that can enter the cornea of ​​the human eye.

[0100] Optional, Figure 9 This is a schematic diagram of the structure of an eye-tracking system according to another embodiment of this application. Figure 9As shown, the first light region 500 includes a second sub-light region 500b. The lens group 301 includes at least a first lens group 3011 and a second lens group 3012 arranged along a first direction F. The light source 100 is located between the first lens group 3011 and the second lens group 3012. The second sub-light region 500b represents the area formed by the light emitted from the light source 100 and illuminating the second lens group 3012. In other words, it is the area enclosed by the curved surface formed by all tangents from any point on the light source to the outermost surface of the second lens group 3012.

[0101] The first lens group 3011 includes at least one lens, and the second lens group 3012 includes at least one lens. Sub-light region 500b is a cone-shaped area formed by light rays from the light source 100 illuminating the second lens group 3012. Therefore, the first light-shielding structure 101 can block this cone-shaped area, preventing light from the light source 100 from illuminating the second lens group 3012 and reflecting to form stray light that can enter the cornea.

[0102] Optional, Figure 10 This is a schematic diagram of the structure of an eye-tracking system proposed in another embodiment of this application. Figure 10 As shown, the first light region 500 includes a sub-light region 500c. The light source 100 is located between the lens group 301 and the display screen 302. The sub-light region 500c represents the area formed by the light emitted from the light source 100 and illuminating the display screen 302. In other words, it is the area enclosed by the curved surface formed by all tangents from any point on the light source to the outermost surface of the display screen 302.

[0103] The sub-light region 500c is a cone-shaped area formed by the light from the light source 100 illuminating the display screen 302. Therefore, the first light-shielding structure 101 can block this cone-shaped area, preventing the light from the light source 100 from illuminating the display screen 302 and preventing the light from the light source 100 from illuminating the display screen 302 and reflecting to form stray light that can enter the cornea of ​​the human eye. In one embodiment, the display screen 302 may include, but is not limited to, a waveguide display device, a liquid crystal display screen, an organic light-emitting diode screen, a silicon-based liquid crystal microdisplay screen, a digital light projection microdisplay screen, etc.

[0104] Based on the above embodiments, the cone angle of the first light-shielding structure 101 to the light-shielding cone region of the light source 100 can be obtained by optical software simulation or mathematical calculation during optical path design.

[0105] Optional, Figure 11 This is a schematic diagram of a light-shielding structure proposed in one embodiment of this application. Figure 4 and Figure 11 As shown, the light-shielding structure for the eye-tracking system, the light cover 600 also includes a second light-shielding structure 102;

[0106] Part of the light from the light source 100 shines on the second eyeball region 201, forming a second stray light. The second light-blocking structure 102 is used to block the second light region 501, wherein the second light region 501 contains the second stray light.

[0107] It can be understood that the second light region 501 is the area formed by the light rays from the light source 100 illuminating the second eyeball region 201. In other words, the second light region 501 is the area illuminated by the light from the light source 100 that forms the second stray ray. Or, it is the area enclosed by the curved surface formed by all the tangents from any point on the light source to the outermost surface of the second eyeball region 201. The second stray ray is a portion of the light rays from the light source 100 illuminating the second eyeball region 201.

[0108] The light emitted by light source 100, after being reflected by the user's cornea on the same side, enters the image acquisition unit to form an eye image with an effective light spot. However, due to the close distance between the user's eyes, light emitted from one side of light source 100 can easily shine onto the user's cornea on the other side, and the reflected light is also easily captured by the image acquisition unit on the side of light source 100. This results in stray light spots on the eye image caused by the reflection of light from light source 100 by the second eye region 201. Therefore, to avoid the formation of stray light spots on the eye image caused by the reflection of light from light source 100 by the second eye region 201, it is necessary to block the second light region 501 of light source 100. This prevents light from the second light region 501 of light source 100 from shining onto the second eye region 201 and forming stray light spots on the eye image, thus affecting the acquisition quality of the eye image and improving the recognition and positioning accuracy of the effective light spot in the eye image.

[0109] In some embodiments, such as when the eye-tracking system uses the pupil-corneal reflex principle to determine the user's gaze information, or when the scheme for calculating the user's gaze information requires the use of effective light spot (Pulchin spot) information in the eye image, the image acquisition unit needs to acquire an eye image with an effective light spot (Pulchin spot). Therefore, part of the light from the light source 100 is irradiated onto the first eye region 200 for supplementary lighting and to form an effective light spot.

[0110] In other embodiments, the image acquisition unit may acquire an image of the eye without an effective light spot. The user's gaze information in the eye image can be determined by a pre-trained deep learning model or other calculation methods that do not require an effective light spot. Therefore, part of the light from the light source 100 is irradiated onto the first eyeball region 200 for supplementary lighting.

[0111] In this embodiment, by setting a second light-shielding structure 102, the second light area 501 is blocked, preventing the light source 100 from illuminating the second eye region 201. In other words, when the second light-shielding structure 102 is set, the second eye region 201 will not be illuminated by the light from the light source 100 when it is turned on. This helps to prevent the emitted light from the light source 100 from shining on the second eye region 201 and forming stray light spots on the eye image. The second light-shielding structure 102 can be a light-shielding sheet, a light-shielding ring, or a light-shielding film, etc. This application embodiment does not specifically limit the shape, light-shielding principle, light-shielding material, or arrangement position of the second light-shielding structure 102, as long as the second light-shielding structure 102 prevents the light in the second light area 501 from shining on the second eye region 201.

[0112] It should be noted that, due to the different positions of the light source 100, the second light region 501 includes a sub-light region 501a (e.g., Figure 4 As shown), the two-sub-light region 501b (as shown) Figure 9 (as shown) and the three-sub-light region 501c (as shown) Figure 10 (As shown). The cone angle of the second light-shielding structure 102 on the light-shielding cone region of the light source 100 can be obtained by optical software simulation or mathematical calculation during optical path design.

[0113] In this embodiment, the second light-shielding structure at least blocks the light emitted by the light source at the second illumination angle, which is the angle between tangents T3 and T4. In other words, the second light area 501 contains at least the light emitted by the light source 100 at the second illumination angle, which needs to be blocked by the second light-shielding structure 102.

[0114] In this embodiment, Figures 12-13 This is a schematic diagram of the light-shielding angle of the light-shielding structure proposed in the embodiments of this application. (Reference) Figure 13 Including the first preset center O1 ’ "Second preset center O1", where the first preset center O1 ’ The second preset center O1” is the intersection of the Z-axis and X-axis passing through the center of the first optical display system 300, and the second preset center O1” is the intersection of the Z-axis and X-axis passing through the center of the second optical display system 303.

[0115] Tangent T3 is the straight line with the smallest angle to the X-axis among all the tangents made from a point on the light source 100 to the surface of the second eyeball region 201, and tangent T4 is the straight line with the largest angle to the X-axis among all the tangents made from a point on the light source 100 to the surface of the second eyeball region 201.

[0116] Optional, see reference Figures 12-13With the second preset center O1” as the origin, the coordinates of the tangent point T3 and the surface of the second eyeball region 201 are (13, 0, 8), and the coordinates of the tangent point T4 and the surface of the second eyeball region 201 are (-24, 0, 42), the second irradiation angle A2 is not less than 27 degrees.

[0117] refer to Figures 12-13 With the second preset center O1” as the origin, the coordinates of the tangent point T3 and the surface of the second eye region 201 are (13, 0, 8), and the coordinates of the tangent point T4 and the surface of the second eye region 201 are (-24, 0, 42), the second irradiation angle A2 is not less than 66 degrees.

[0118] Specifically, let the second eye region 201 have a length of 48mm in the X-axis direction and a height of 34mm in the Z-axis direction. Tangents T3 and T4 are drawn from a point on the light source 100 away from the second eye region 201. The angle between tangents T3 and T4 is taken as the second illumination angle A2, which is not less than 27 degrees. This means the second light-blocking structure 102 can at least block the light emitted from the light source 100 at the second illumination angle A2. Similarly, tangents T3 and T4 are drawn from a point on the light source 100 closer to the second eye region 201. The angle between tangents T3 and T4 is taken as the second illumination angle A2, which is not less than 66 degrees. This means the second light-blocking structure 102 can at least block the light emitted from the light source 100 at the second illumination angle A2.

[0119] Optional, see reference Figures 14-15 With the second preset center O1” as the origin, the coordinates of the tangent point T3 and the surface of the second eyeball region 201 are (0, 0, 8), and the coordinates of the tangent point T4 and the surface of the second eyeball region 201 are (-6, 0, 11), the second irradiation angle A2 is not less than 2 degrees.

[0120] refer to Figures 14-15 With the second preset center O1” as the origin, the coordinates of the tangent point T3 and the surface of the second eyeball region 201 are (0, 0, 8), and the coordinates of the tangent point T4 and the surface of the second eyeball region 201 are (-6, 0, 11), the second irradiation angle A2 is not less than 8 degrees.

[0121] Specifically, let the second eye region 201 have a length of 12mm in the X-axis direction and a height of 3mm in the Z-axis direction. Tangents T3 and T4 are drawn from a point on the light source 100 away from the second eye region 201. The angle between tangents T3 and T4 is taken as the second illumination angle A2, which is not less than 2 degrees. This means the second light-blocking structure 102 can at least block the light emitted from the light source 100 at the second illumination angle A2. Similarly, tangents T3 and T4 are drawn from a point on the light source 100 closer to the second eye region 201. The angle between tangents T3 and T4 is taken as the second illumination angle A2, which is not less than 8 degrees. This means the second light-blocking structure 102 can at least block the light emitted from the light source 100 at the second illumination angle A2.

[0122] Optional, see reference Figures 16-17 With the second preset center O1” as the origin, the coordinates of the tangent point T3 and the surface of the second eyeball region 201 are (13, 0, 8), and the coordinates of the tangent point T4 and the surface of the second eyeball region 201 are (-24, 0, 21), the second irradiation angle A2 is not less than 13 degrees.

[0123] refer to Figures 16-17 With the second preset center O1” as the origin, when the coordinates of the tangent point T3 and the surface 201 of the second eyeball region are (13, 0, 8) and the coordinates of the tangent point T4 and the surface of the second eyeball region 201 are (-24, 0, 21), the second irradiation angle A2 is not less than 54 degrees.

[0124] Specifically, let the second eye region 201 have a length of 48mm in the X-axis direction and a height of 13mm in the Z-axis direction. Tangents T3 and T4 are drawn from a point on the light source 100 away from the second eye region 201. The angle between tangents T3 and T4 is taken as the second illumination angle A2, which is not less than 13 degrees. This means the second light-blocking structure 102 can at least block the light emitted from the light source 100 at the second illumination angle A2. Similarly, tangents T3 and T4 are drawn from a point on the light source 100 closer to the second eye region 201. The angle between tangents T3 and T4 is taken as the second illumination angle A2, which is not less than 54 degrees. This means the second light-blocking structure 102 can at least block the light emitted from the light source 100 at the second illumination angle A2.

[0125] In other embodiments, tangent T3 is the straight line with the smallest angle to the X-axis among all tangents made from a point on the light source 100 to the surface of the first eyeball region 200, and tangent T4 is the straight line with the smallest angle to the X-axis among all tangents made from a point on the light source 100 to the surface of the second eyeball region 201.

[0126] Optional, see reference Figures 18-19 With the first preset center O1 ’ With the origin as the origin, the coordinates of the tangent T3 and the surface of the first eye region 200 are (13, 0, 8). When the second preset center O1” is the origin and the coordinates of the tangent T4 and the surface of the second eye region 201 are (13, 0, 8), the second irradiation angle A2 is not less than 6 degrees.

[0127] Specifically, let the first eye region 200 and the second eye region 201 both have a length of 48mm in the X-axis direction. A tangent T3 is formed by drawing a tangent line from a point on the light source 100 away from the second eye region 201 to the first eye region 200. A tangent line T4 is also formed by drawing a tangent line from a point on the light source 100 away from the second eye region 201 to the second eye region 201. The angle between tangent lines T3 and T4 is taken as the second illumination angle A2. The second illumination angle A2 is not less than 6 degrees, that is, the second light-blocking structure 102 can at least block the light emitted from the light source 100 at the second illumination angle A2.

[0128] It should be noted that since the surface of the user's eyeball is curved, the edge of the eyeball region formed based on the possible positions where the user's eyeball may move should also be curved. Therefore, when determining the intersection of the tangent T3 and the second eyeball region 201, the intersection of the second eyeball region 201 and T3 is generally: the corneal vertex coordinates of the eyeball position farthest from the light source 100 among several possible positions where the eyeball may move to on the side closer to the second optical display system 303. For details, please refer to the specification of this application. Figure 13 , Figure 15 , Figure 17 .

[0129] Optional, Figure 20 This is a schematic diagram of a light-shielding structure proposed in another embodiment of this application. For example... Figure 20 As shown, the light-shielding structure for the eye-tracking system, the light cover 600 also includes a third light-shielding structure 103;

[0130] Part of the light from the light source 100 shines on the second optical display system 303, which can generate third stray light. The third light-shielding structure 103 is used to block the third light area 503, wherein the third light area 503 contains the third stray light.

[0131] It can be understood that the third light region 503 is the area formed by the light from the light source 100 illuminating the second optical display system 303. In other words, the third light region 503 is the area illuminated by the light from the light source 100 that forms the third stray ray. Or, it is the area enclosed by the curved surface formed by all the tangents from any point on the light source to the outermost surface of the second optical display system 303. The third stray ray is the ray formed by the reflection or scattering of a portion of the light from the light source illuminating the second optical display system 303 by the second optical display system 303.

[0132] Specifically, by setting a third light-shielding structure 103, the third light area 503 is blocked to prevent the light source 100 from illuminating the second optical display system 303. In other words, when the third light-shielding structure 103 is set, the second optical display system 303 will not be illuminated by the light source 100 when the light source 100 is turned on.

[0133] Because the optical components in the head-mounted display device are installed and arranged relatively compactly, light emitted from one side of the light source 100 can easily shine onto the second optical display system 303. The second optical display system 303 will reflect or scatter the light emitted from the light source 100, and the reflected or scattered light can easily be captured by the image acquisition unit on the side of the light source 100, forming stray light spots on the eye image due to the reflection of light from the light source 100 by the second optical display system 303. Therefore, in order to avoid the second optical display system 303 reflecting light from the light source 100 and forming stray light spots on the eye image, it is necessary to block the third light area 503 of the light source 100 to prevent light from the third light area 503 of the light source 100 from shining onto the second optical display system 303, ultimately forming stray light spots on the eye image, affecting the acquisition quality of the eye image, and thus improving the identification and positioning accuracy of the effective light spot in the eye image.

[0134] It should be noted that the formation of the third light region 503 varies depending on the position of the light source 100 on the first optical display system 300. Furthermore, the closer the light source 100 is to the second optical display system 303, the easier it is to form the third light region 503; conversely, the farther the light source 100 is from the second optical display system 303, the less likely it is to form the third light region 503. The specific design of the third light-shielding structure 103 can be tailored to the specific position of the light source 100 and the required specifications. This application embodiment does not specifically limit the shape, light-shielding principle, light-shielding material, or arrangement of the third light-shielding structure 103; the third light-shielding structure 103 simply needs to prevent light from the third light region 503 from reaching the first optical display system 300.

[0135] refer to Figure 21This is a schematic diagram of the light-shielding angle of another light-shielding structure proposed in one embodiment of this application. The third light-shielding structure at least blocks the light emitted by the light source at the third illumination angle. The third illumination angle is the angle between tangents T5 and T6. Tangent T5 is the straight line with the smallest angle to the X-axis among all tangents made from a point on the light source to the surface of the second optical display system, and tangent T6 is the straight line with the largest angle to the X-axis among all tangents made from a point on the light source to the surface of the second optical display system. The third illumination angle is not less than 25 degrees. In other words, the third light area 503 contains at least the light emitted by the light source 100 at the third illumination angle, which needs to be blocked by the third light-shielding structure 103.

[0136] Specifically, refer to Figure 21 A tangent is drawn from any point on the light source 100 to the surface of the second optical display system 303, forming tangents T5 and T6. The angle between tangents T5 and T6 is the third illumination angle A3, which is not less than 25 degrees. Tangent T5 is the straight line with the smallest angle to the X-axis among all tangents drawn from a point on the light source 100 to the surface of the second optical display system 303, and tangent T6 is the straight line with the largest angle to the X-axis among all tangents drawn from a point on the light source 100 to the surface of the second optical display system 303. The third light-shielding structure 103 at least blocks the light emitted from the light source 100 at the third illumination angle A3. A tangent is drawn from a point on the light source 100 closer to the second optical display system 303, with the third illumination angle A3 not less than 25 degrees. A tangent is drawn from a point on the light source 100 farther from the second optical display system 303, with the third illumination angle A3 not less than 8 degrees.

[0137] Optional, Figure 22 This is a schematic diagram of the light-shielding structure proposed in another embodiment of this application. Figure 23 This is a schematic diagram of the light-shielding structure proposed in another embodiment of this application. Figure 4 , Figure 9 , Figure 10 , Figure 22 and Figure 23 As shown, the light-shielding structure for the eye-tracking system, the light cover 600 also includes a light-transmitting structure 104;

[0138] The light-transmitting structure 104 is used to form the light-transmitting area 502, wherein the light-transmitting area 502 is the area illuminated by the light source of the supplementary light.

[0139] The light-transmitting structure 104 includes a notch and other light-transmitting elements. The notch can be a regular or irregular opening on the photomask 600, used to allow the light emitted from the light source 100 to shine outwards. The light-transmitting structure 104 can be a light-transmitting element or an anti-reflective film. The anti-reflective film can be made of materials such as magnesium fluoride, titanium dioxide, lead sulfide, lead selenide, ceramic infrared anti-reflective films, or vinyl silsesquioxane hybrid films. The light-transmitting element can also be a sheet material that can transmit light, such as glass or plastic. The light-transmitting area 502 is the area that the light from the light source 100 must illuminate, which is the ipsilateral ocular supplementary lighting area. In other words, it is the area enclosed by the curved surface formed by all tangents from any point on the light source to the outermost surface of the first ocular region 200.

[0140] It should be noted that, due to the different positions of the light source 100 in the first optical display system 300, the areas formed by the light-transmitting area 502 are also different. The light-transmitting area 502 includes the first light-transmitting area 502a (e.g., ...). Figure 4 As shown), the second light-transmitting area 502b (as shown) Figure 9 (as shown) and the third light-transmitting area 502c (as shown) Figure 10 (As shown). The light emitted from the light source 100 passes through the light-transmitting area 502 and illuminates the first eye region 200. The first eye region 200 reflects the light emitted from the light source 100 to the image acquisition unit, enabling the image acquisition unit to acquire an eye image with an effective light spot, that is, forming a Pulciens spot on the eye image. This ensures that the cornea within the first eye region 200 can reflect the light emitted from the light source 100, guaranteeing that the image acquisition unit can acquire an eye image with an effective light spot. This application embodiment does not specifically limit the shape, light-transmitting principle, material, or arrangement of the light-transmitting structure 104; the light-transmitting structure 104 only needs to ensure that the light emitted from the light source 100 can cover the first eye region 200. In other words, after setting the light-transmitting structure 104, the first eye region 200 will definitely be illuminated when the light source 100 is turned on.

[0141] Optional, continue to refer to Figure 22 and Figure 23 A light-shielding structure for an eye-tracking system includes a light cover 600 that encloses a light source 100. The light cover 600 is used to adjust the light from the light source 100 to illuminate the light-transmitting area 502, to block the light from the light source 100 from illuminating the light-shielding area 601, and to adjust or block the light from the light source 100 from illuminating the non-fixed light area 603. The light-shielding area 601 includes a first light area 500, and the first light-shielding structure 101 is located within the first light area 500.

[0142] Specifically, Figure 24 This is a schematic diagram of the light-shielding structure proposed in one embodiment of this application. Figure 25This is a schematic diagram of the photomask structure of another embodiment of the light-shielding structure proposed in this application. (Reference) Figure 24 and Figure 25 , Figure 24 The light cover 600, which uses an opaque housing to shield the light source 100, is mounted on the PCB circuit board 700 or on the housing near the edge of the lens group of the head-mounted device. Figure 25 The light shield 600, consisting of light-shielding devices 800 such as light-shielding sheets, coatings, or double-sided adhesive, surrounds the light source 100 and is mounted on the PCB circuit board 700 or on the housing near the edge of the lens assembly of the head-mounted device. A corresponding light-shielding structure is arranged on the light-shielding area 601 to block the light from the light source 100, preventing it from illuminating the first optical display system 300, the second optical display system 303, and the second eye region 201. The light-transmitting area 502 allows the light from the light source 100 to pass through and illuminate the first eye region 200, enabling the cornea within the first eye region 200 to reflect the light from the light source 100 to the image acquisition unit, forming an eye image with an effective light spot.

[0143] Optional, such as Figure 22 and Figure 23 As shown, the light-blocking area 601 also includes a second light area 501 and a third light area 503. The non-fixed light area 603 is used for light transmission or light blocking. For example, see reference... Figure 22 The areas between the first light area 500 and the third light area 503, between the third light area 503 and the second light area 501, between the second light area 501 and the light-transmitting area 502, and between the light-transmitting area 502 and the first light area 500 are all non-fixed light areas 603. Since the light from the light source 100 within the non-fixed light area 603 is generally not reflected or scattered by other surfaces into the image acquisition unit, or in other words, very little light can be reflected or scattered into the image acquisition unit within the non-fixed light area 603, the light within the non-fixed light area 603 can be either blocked or not blocked. Therefore, the non-fixed light area 603 can be defined as either a light-blocking area 601 with a light-blocking structure or a light-transmitting area 502 with a light-transmitting structure. Therefore, in this embodiment, there is no specific limitation on whether the non-fixed light area 603 is defined as a light-blocking area 601 or a light-transmitting area 502; that is, whether a light-blocking structure or a light-transmitting structure is provided within the non-fixed light area 603, it should fall within the protection scope of this application.

[0144] For example, the first light-blocking structure 101 is located in the first light area 500, the second light-blocking structure 102 is located in the second light area 501, the third light-blocking structure 103 is located in the third light area 503, and the light-transmitting structure 104 is located in the light-transmitting area 502. A light-transmitting structure or a light-blocking structure can be provided within the non-fixed light area 603. For instance, the non-fixed light area 603 between the first light-blocking structure 101 and the third light-blocking structure 103 can be set as a light-blocking area, the non-fixed light area 603 between the third light-blocking structure 103 and the second light-blocking structure 102 can be set as a light-blocking area, the non-fixed light area 603 between the second light-blocking structure 102 and the light-transmitting structure 104 can be set as a light-blocking area, and the non-fixed light area 603 between the light-transmitting structure 104 and the first light-blocking structure 101 can be set as a light-blocking area (e.g., ...). Figure 23 (As shown). Alternatively, the aforementioned non-fixed light area 603 can also be configured as a light-transmitting area. Or, the non-fixed light area 603 between the first light-shielding structure 101 and the third light-shielding structure 103 can be configured as a light-shielding area, the non-fixed light area 603 between the third light-shielding structure 103 and the second light-shielding structure 102 can be configured as a light-shielding area, the non-fixed light area 603 between the second light-shielding structure 102 and the light-transmitting structure 104 can be configured as a light-transmitting area, and the non-fixed light area 603 between the light-transmitting structure 104 and the first light-shielding structure 101 can be configured as a light-transmitting area. This increases the area of ​​the light-transmitting area 502 and the area of ​​the light-shielding area 601.

[0145] In some embodiments, reference Figure 35 This is a schematic diagram of a photomask 600. The photomask 600 includes at least one of a first light-shielding structure 101, a second light-shielding structure 102, and a third light-shielding structure 103, as well as a light-transmitting structure 104. The photomask 600 may include an inner cover B and an outer cover A. The inner cover B covers the light source 100, and the outer cover A is disposed outside the inner cover B. The inner cover B includes the light-transmitting structure 104, which includes at least one of the first light-shielding structure 101, the second light-shielding structure 102, and the third light-shielding structure 103. Alternatively, the outer cover A may include at least one of the first light-shielding structure 101, the second light-shielding structure 102, and the third light-shielding structure 103. This ensures that light is not emitted from the first light area 500, the second light area 501, or the third light area 503.

[0146] refer to Figure 36 The diagram shows another possible structure of the photomask 600. The photomask 600 may consist only of an outer cover A, which covers the light source. The outer cover A includes at least one of a first light-shielding structure 101, a second light-shielding structure 102, and a third light-shielding structure 103, as well as a light-transmitting structure 104, to ensure that light is not emitted from the first light area 500, the second light area 501, or the third light area 503.

[0147] In some embodiments, reference Figure 35 , Figure 36 The first light-shielding structure 101, the second light-shielding structure 102, and the third light-shielding structure 103 can be integrally formed or separately arranged. For example, the first light-shielding structure 101, the second light-shielding structure 102, and the third light-shielding structure 103 can be connected to each other to form a light cover 600. Alternatively, two of the first light-shielding structures 101, the second light-shielding structure 102, and the third light-shielding structure 103 can be connected to each other, while the third light-shielding structure can be separately arranged to form a light cover 600. Or, the first light-shielding structure 101, the second light-shielding structure 102, and the third light-shielding structure 103 can all be separately arranged without being connected to each other to form a light cover 600.

[0148] In some embodiments, reference Figure 36 If each light source 100 is equipped with an independent photomask 600 for light blocking, it generally consists of a first light-blocking structure 101, a second light-blocking structure 102, and a third light-blocking structure 103, which together form the light-blocking structure in the photomask 600. (Reference) Figure 35-26 When multiple light sources 100 are collectively shielded by a single photomask 600, the photomask 600 should generally consist of multiple first-shielding structures 101, multiple second-shielding structures 102, and multiple third-shielding structures 103, forming the overall shielding structure. For example, it could be a ring covering the periphery of multiple LED lights. In other words, a structure independently covering each light source 100 can be considered a photomask 600, as can a structure that collectively covers multiple light sources 100 in a device through one or more integral components.

[0149] Optionally, the light-emitting area of ​​the light source 100 is completely covered by the light-shielding area 601, the light-transmitting area 502, and the non-fixed light area 603.

[0150] It is understandable that the light-diffusing region 400 of the light source 100 can be approximated as a sphere with a radius or diameter of X. The photomask 600 can be a spherical shell, a rectangular shell, etc., surrounding the light source 100. When the photomask 600 is completely set as the light-blocking region 601, the light-diffusing region 400 of the light source 100 is completely blocked, and the light source 100 cannot emit light outside the photomask 600. Similarly, when the photomask 600 is completely set as the light-transmitting region 502, the emitted light from the light source 100 can completely pass through the photomask 600. Therefore, the light-blocking region 601, the light-transmitting region 502, and the non-fixed light region 603 on the photomask 600 constitute the light-diffusing region of the light source 100. The photomask 600 can form an integral light-blocking structure with the light source 100.

[0151] Optionally, the inner wall of the light-shielding area 601 of the photomask 600 is provided with a light-reflecting layer, which is used to reflect the emitted light from the light source 100 to the light-transmitting area 502.

[0152] It should be noted that the light-reflecting layer can be an anti-reflective layer, which refers to a film layer that increases the reflectivity of light. Thus, through the action of the light-reflecting layer, the light shone from the light source 100 onto the light-blocking area 601 can be reflected to the light-transmitting area 502, and used to illuminate the cornea of ​​the first eyeball area 200, thereby increasing the light utilization rate of the light source 100.

[0153] In the above embodiments, the first light-shielding structure 101, the second light-shielding structure 102, and the third light-shielding structure 103 can use the photomask 600 as a carrier, and the photomask 600 can be used to shield the first light area 500, the second light area 501, and the third light area 503 from light. Alternatively, when the positions are suitable and do not obstruct the display screen, the first light-shielding structure 101 and the third light-shielding structure 103 can also be directly mounted on the corresponding first optical display system, such as on a lens or lens group. (Refer to...) Figure 30 .

[0154] Taking the example where the light source 100 is located between the lens group 301 and the first eyeball region 200, and the first light-blocking structure 101 blocks the light from the light source 100 illuminating the lens group 301. Figure 26 As shown, the first ray 01 of the light source 100 is the line connecting any point of the light source 100 to the outermost vertex of the lens group 301, and the second ray 02 is the line connecting any point of the light source 100 to the outermost vertex of the lens group 301. The first light-blocking structure 101 is used to block the first light area 500 between the first ray 01 and the second ray 02.

[0155] In one embodiment, lens group 301 is a convex lens, such as... Figure 27 , Figure 28 , Figure 29 As shown, the first light-shielding structure 101 can be disposed on the photomask 600. For example... Figure 30 As shown, the first light-shielding structure 101 can be disposed on the lens group 301. For example... Figure 31 As shown, the first light-shielding structure 101 can be disposed on the photomask 600, and the photomask 600 only allows light to pass through the light-transmitting area 502, while the rest is light-shielded. Figure 32 As shown, the first light-shielding structure 101 can also be a reflecting prism, reflecting the light from the light source 100 that illuminates the lens group 301 to the light-transmitting area 502. The lens group 301 can also be a concave lens, such as... Figure 33 As shown, the first light-shielding structure 101 can be set on the photomask 600, which is an open ring that retains the light-transmitting gap of the light-transmitting area 502.

[0156] Therefore, by limiting the illumination range of the light source through a light-shielding structure, it is possible to prevent light from shining on other interfering objects such as lenses on the same side, the human eye on the other side, or other lenses on the other side, thus avoiding stray light spots in the captured image of the human eye. This improves the image quality of the eye-related light spot image. Furthermore, it simplifies the placement of the light source; only the placement position needs to be determined. The light source can even use a 360° illumination range. After determining the light-shielding area, only a suitable light shield needs to be designed to limit the light emission from the area that needs to be shielded, eliminating the need to repeatedly adjust the illumination angle of the light source and test the appropriate illumination range. At the same time, the minimum area that the light must illuminate can be directly determined based on the primary eyeball area. By using the light-shielding structure to control the reduction of the light source's illumination range, the utilization efficiency of the light source is improved, and energy consumption is saved.

[0157] This application also provides an eye-tracking system, including a light-shielding structure, an image acquisition unit, and at least one processor, as described in any embodiment of this application for an eye-tracking system.

[0158] The light-blocking structure is used to direct light towards the first eyeball area.

[0159] The image acquisition unit is used to acquire eye images, wherein the eye images contain effective light spots formed by light rays from the corneal reflective light-blocking structure within the first eyeball region.

[0160] At least one processor is configured to determine eye features in an eye image and to determine the user's gaze information based on those eye features.

[0161] In this embodiment, the image acquisition unit can be an infrared camera, an infrared image sensor, a camera or video camera, a DVS (Dynamic Visual Sensor), etc. The light-shielding structure can be the light-shielding structure described in the foregoing examples. The processor can be various general-purpose and / or dedicated processing components with processing and computing capabilities. Some examples of processors include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. Eye features include, but are not limited to, pupil position, pupil shape, iris position, iris shape, limbal position, limbal boundary (the black-and-white boundary of the eyeball), eyelid position, canthus position, and location of the light spot (also known as the Pulcyn spot), etc.

[0162] Specifically, the light-blocking structure emits light into the first eye region, and the cornea within the first eye region reflects the light into the image acquisition unit, enabling the image acquisition unit to acquire an eye image with a valid light spot. At least one processor can perform computational processing on the eye image with the valid light spot to determine the valid light spot information in the eye image, such as the position information and size information of the light spot. Based on the valid light spot information, the processor calculates the user's gaze information, which includes, but is not limited to, the user's gaze direction and / or gaze point information.

[0163] By setting the light-shielding structure in this embodiment, it is possible to prevent other surfaces besides the first eyeball area from reflecting light from the light source to the image acquisition unit, effectively preventing the image acquisition unit from acquiring eye images with many stray light spots, improving the acquisition quality of eye images, and helping to improve the recognition and positioning accuracy of effective light spots in eye images. Figure 34 As shown, the first light-shielding structure 101, the second light-shielding structure 102, and the third light-shielding structure 103 sequentially block the lens group 301 on the same side, the second eyeball region 201, and the optical display system 303 on the opposite side, preventing the light source 100 from shining on their surfaces and causing light reflection into the image acquisition unit, thus preventing the formation of stray light spots in the eye image. Only light transmission to the light-transmitting area 502 is retained, avoiding excessive stray light spots in the eye image, which helps improve the recognition and positioning accuracy of the effective light spot in the eye image.

[0164] In summary, the technical solutions of this application have the following beneficial effects. According to the light-shielding structure and eye-tracking system proposed in this application, by setting a first light-shielding structure in the optical path from the light source to the first optical display system, the light source can be prevented from shining onto the first optical display system. This effectively prevents stray light formed by the reflection or scattering of light from the light source by the first optical display system from entering the image acquisition unit. Consequently, it is possible to obtain eye images with fewer stray spots and higher quality, making the identification and positioning of effective spots in the eye image more convenient and accurate, thereby improving the accuracy and efficiency of eye-tracking calculations.

[0165] An eye-tracking system is a system that utilizes the pupil-corneal reflection principle. It includes a light-shielding structure: the light source within the light-shielding structure is typically an infrared light source because infrared light does not affect the eye's vision; and multiple infrared light sources can be arranged in a predetermined pattern, such as a ring, a triangular pattern, or a straight line; it also includes an image acquisition unit: such as an infrared camera, an infrared image sensor, a camera or video camera, or a DVS (Dynamic Visual Sensor). The principle of the pupil-corneal reflection method is as follows: 1. Eye image acquisition: A light source shines on the eye, and the image acquisition device captures an image of the eye, correspondingly capturing the reflection point of the light source on the cornea, i.e., the light spot (also called the Pulciens spot), thus acquiring an eye image with the light spot. 2. Gaze / fixation point estimation: As the eye moves, the relative positional relationship between the pupil center and the light spot changes accordingly. Several acquired eye images with the light spot reflect this positional change relationship; gaze / fixation point estimation is performed based on this positional change relationship.

[0166] It should be understood that the various forms of processes shown above can be used to rearrange, add, or delete steps. For example, the steps described in this application can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution of this application can be achieved, and this is not limited herein.

[0167] The specific embodiments described above do not constitute a limitation on the scope of protection of this application. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this application should be included within the scope of protection of this application.

Claims

1. A light-shielding structure for an eye-tracking system, characterized in that, include: Light source and light mask; Part of the light from the light source illuminates the first eyeball area for supplemental lighting, and part of the light from the light source illuminates the first optical display system to form first stray light; wherein, the first optical display system includes a lens group and a display screen arranged sequentially along a first direction, and the first direction is the direction of the user's eye looking at the first optical display system; The light cover includes a first light-shielding structure for blocking a first light area, wherein the first light area contains the first stray light.

2. The light-shielding structure for an eye-tracking system according to claim 1, characterized in that, The first light-shielding structure at least blocks the light emitted from the light source at a first illumination angle, where the first illumination angle is the angle between tangent T1 and tangent T2. Tangent T1 is the straight line with the smallest angle to the X-axis among all tangents made from a point on the light source to the surface of the first optical display system, and tangent T2 is the straight line with the largest angle to the X-axis among all tangents made from a point on the light source to the surface of the first optical display system.

3. The light-shielding structure for an eye-tracking system according to claim 1, characterized in that, The first light region includes a sub-light region one, and the light source is located between the lens group and the first eyeball region. The sub-light region one represents the light region on the lens group illuminated by the light source.

4. The light-shielding structure for an eye-tracking system according to claim 1, characterized in that, The first light region includes a second sub-light region, the lens group includes at least a first lens group and a second lens group arranged along a first direction, the light source is located between the first lens group and the second lens group, and the second sub-light region represents the light region illuminated by the light source onto the second lens group.

5. The light-shielding structure for an eye-tracking system according to claim 1, characterized in that, The first light area includes a third sub-light area. The light source is located between the lens group and the display screen. The third sub-light area represents the light area illuminated by the light source onto the display screen.

6. The light-shielding structure for an eye-tracking system according to claim 1, characterized in that, The light cover also includes a second light-shielding structure; Part of the light from the light source shines onto the second eyeball region, forming a second stray light ray. The second light-blocking structure is used to block the second light region, wherein the second light region contains the second stray light ray.

7. The light-shielding structure for an eye-tracking system according to claim 6, characterized in that, The second light-shielding structure at least blocks the light emitted from the light source at the second illumination angle, which is the angle between tangent T3 and tangent T4.

8. The light-shielding structure for an eye-tracking system according to claim 7, characterized in that, It also includes a first preset center and a second preset center, wherein the first preset center is the intersection of the Z-axis and the X-axis passing through the center of the first optical display system, and the second preset center is the intersection of the Z-axis and the X-axis passing through the center of the second optical display system.

9. The light-shielding structure for an eye-tracking system according to claim 8, characterized in that, The tangent T3 is the straight line with the smallest angle to the X-axis among all the tangents made from a point on the light source to the surface of the second eyeball region, and the tangent T4 is the straight line with the largest angle to the X-axis among all the tangents made from a point on the light source to the surface of the second eyeball region.

10. The light-shielding structure for an eye-tracking system according to claim 8, characterized in that, The tangent T3 is the straight line with the smallest angle to the X-axis among all the tangents made from a point on the light source to the surface of the first eyeball region, and the tangent T4 is the straight line with the smallest angle to the X-axis among all the tangents made from a point on the light source to the surface of the second eyeball region.

11. The light-shielding structure for an eye-tracking system according to claim 9, characterized in that, With the second preset center as the origin, when the coordinates of the tangent T3 and the surface of the second eyeball region are (13, 0, 8) and the coordinates of the tangent T4 and the surface of the second eyeball region are (-24, 0, 42), the second irradiation angle is not less than 27 degrees.

12. The light-shielding structure for an eye-tracking system according to claim 9, characterized in that, With the second preset center as the origin, when the coordinates of the tangent T3 and the surface of the second eyeball region are (13, 0, 8) and the coordinates of the tangent T4 and the surface of the second eyeball region are (-24, 0, 42), the second irradiation angle is not less than 66 degrees.

13. The light-shielding structure for an eye-tracking system according to claim 9, characterized in that, With the second preset center as the origin, when the coordinates of the tangent T3 and the surface of the second eyeball region are (0, 0, 8) and the coordinates of the tangent T4 and the surface of the second eyeball region are (-6, 0, 11), the second irradiation angle is not less than 2 degrees.

14. The light-shielding structure for an eye-tracking system according to claim 9, characterized in that, With the second preset center as the origin, when the coordinates of the tangent T3 and the surface of the second eyeball region are (0, 0, 8) and the coordinates of the tangent T4 and the surface of the second eyeball region are (-6, 0, 11), the second irradiation angle is not less than 8 degrees.

15. The light-shielding structure for an eye-tracking system according to claim 9, characterized in that, With the second preset center as the origin, when the coordinates of the tangent T3 and the surface of the second eyeball region are (13, 0, 8) and the coordinates of the tangent T4 and the surface of the second eyeball region are (-24, 0, 21), the second irradiation angle is not less than 13 degrees.

16. The light-shielding structure for an eye-tracking system according to claim 9, characterized in that, With the second preset center as the origin, when the coordinates of the tangent T3 and the surface of the second eyeball region are (13, 0, 8) and the coordinates of the tangent T4 and the surface of the second eyeball region are (-24, 0, 21), the second irradiation angle is not less than 54 degrees.

17. The light-shielding structure for an eye-tracking system according to claim 10, characterized in that, With the first preset center as the origin, the coordinates of the tangent T4 and the surface of the first eyeball region are (13, 0, 8). With the second preset center as the origin, the coordinates of the tangent T3 and the surface of the second eyeball region are (13, 0, 8). The second irradiation angle is not less than 6 degrees.

18. The light-shielding structure for an eye-tracking system according to claim 1, characterized in that, The light cover also includes a third light-shielding structure; Part of the light from the light source illuminates the second optical display system, which is capable of generating a third stray light. The third light-shielding structure is used to block the third light area, wherein the third light area contains the third stray light.

19. The light-shielding structure for an eye-tracking system according to claim 18, characterized in that, The third light-shielding structure at least blocks the light emitted from the light source at the third illumination angle, which is the angle between tangent T5 and tangent T6. Tangent T5 is the straight line with the smallest angle to the X-axis among all tangents made from a point on the light source to the surface of the second optical display system, and tangent T6 is the straight line with the largest angle to the X-axis among all tangents made from a point on the light source to the surface of the second optical display system.

20. The light-shielding structure for an eye-tracking system according to claim 1, characterized in that, The photomask also includes a light-transmitting structure; The light-transmitting structure can transmit infrared light and is used to form a light-transmitting area, wherein the light-transmitting area is the light-irradiated area of ​​the light source used to form supplementary light.

21. The light-shielding structure for an eye-tracking system according to claim 1, characterized in that, The light cover encloses the light source. The light cover is used to adjust the light from the light source to illuminate the light-transmitting area, to block the light from the light source from illuminating the light-shielding area, and to adjust or block the light from the light source from illuminating the non-fixed light area. The light-shielding area includes the first light area.

22. The light-shielding structure for an eye-tracking system according to claim 21, characterized in that, The light-shielding area also includes a second light area and a third light area.

23. The light-shielding structure for an eye-tracking system according to claim 21, characterized in that, The light-emitting area of ​​the light source is completely covered by the light-shielding area, the light-transmitting area, and the non-fixed light area.

24. An eye-tracking system, characterized in that, Includes a light-shielding structure, an image acquisition unit, and at least one processor for an eye-tracking system as described in any one of claims 1-23; The light-shielding structure is used to emit light into the first eyeball region; The image acquisition unit is used to acquire images of the eye. At least one processor is configured to determine eye features in the eye image and determine the user's gaze information based on the eye features.

Images