Eye tracking device and eye tracking method
By employing optical structures and photoelectric sensing components in the VR module, light from the center of the lens is received to reduce distortion, thus solving the eye-tracking error problem caused by lens distortion and improving the accuracy and precision of eye tracking.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- BOE TECHNOLOGY GROUP CO LTD
- Filing Date
- 2022-01-10
- Publication Date
- 2026-07-07
AI Technical Summary
In VR module structures, eye-tracking errors caused by lens distortion affect the accuracy and precision of eye-tracking.
An eye-tracking device is employed, comprising a light source, a photoelectric sensing component, and an optical structure. The optical structure is located between an optical lens and a display module, with the light-transmitting area corresponding one-to-one with the photoelectric sensing component, receiving light passing through the center of the lens to reduce distortion effects.
By reducing lens distortion, the precision and accuracy of eye tracking are improved, thus enhancing the eye tracking performance in VR environments.
Smart Images
Figure CN116745683B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of display product manufacturing technology, and more particularly to an eye-tracking device and an eye-tracking method. Background Technology
[0002] In a VR (virtual reality) module structure, a VR lens assembly exists between the eyes and the display screen. Diffuse light from the eyeball is refracted after passing through the lens assembly and reaches the sensor through the optical aperture. The sensor receives the signal light reflected from the eye and determines the eye's gaze position based on the signal strength. However, due to the material and curvature of the lenses themselves, and to maintain aesthetics and reduce product thickness, the number of lenses cannot be excessive. Therefore, in eye-tracking environments, lens distortion is prevalent, leading to errors in the signal received by the sensor. Summary of the Invention
[0003] To address the aforementioned technical problems, this disclosure provides an eye-tracking device and an eye-tracking method to resolve the eye-tracking error caused by optical distortion resulting from lenses.
[0004] To achieve the above objectives, the technical solution adopted in this disclosure embodiment is: an eye-tracking device applied to a near-eye display system, the near-eye display system including a display module and an optical lens located on the light-emitting side of the display module, the eye-tracking device comprising:
[0005] A light source, located on the light-emitting side of the display module, is used to provide the first light rays emitted to the human eye;
[0006] Multiple photoelectric sensing components are disposed in the non-display area of the display module to receive a second light source for determining the position of the human eye pupil;
[0007] An optical structure, located between the optical lens and the display module, includes multiple light-transmitting areas corresponding one-to-one with the multiple photoelectric sensing components, and each of the light-transmitting areas is used to transmit the second light to the corresponding photoelectric sensing component;
[0008] The second ray is the ray that passes through the center point of the optical lens after the first ray is reflected by the human eye.
[0009] Optionally, the center point of the human eye, the center point of the optical lens, and the center point of the display module are located on a first straight line, and the location of the photoelectric sensing component and the location of the corresponding human eye pupil are located on opposite sides of the first straight line.
[0010] Optionally, the non-display area includes a first region extending along a first direction, on which a plurality of the photoelectric sensing components are distributed at intervals along the first direction;
[0011] The optical structure includes a first portion extending along the first direction, and a plurality of light-transmitting areas are distributed at intervals along the first direction on the first portion.
[0012] The center point of the first part and the center point of the first region are located on the second straight line. The center point of each of the light-transmitting areas on the first part is located on the side of the corresponding center point of the photoelectric sensing component that is close to the second straight line.
[0013] Optionally, along the first direction, the first region is divided into multiple first sub-regions, and each first sub-region is provided with a photoelectric sensing component, and the area of the multiple first sub-regions increases sequentially from the middle to both ends;
[0014] Along the first direction, the first part is divided into multiple first sub-parts, and each first sub-part is provided with a light-transmitting area. The area of the multiple first sub-parts increases sequentially from the middle to both ends.
[0015] Optionally, the non-display area further includes a second region extending along the second direction, on which a plurality of the photoelectric sensing components are distributed at intervals along the second direction;
[0016] The optical structure includes a second portion extending along the second direction, and a plurality of light-transmitting areas are distributed at intervals along the second direction on the second portion.
[0017] The center point of the second part and the center point of the second region are located on the third straight line. The center point of each of the light-transmitting areas on the second part is located on the side of the center point of the corresponding photoelectric sensing component that is close to the third straight line.
[0018] The first direction and the second direction are intersecting.
[0019] Optionally, along the second direction, the second region is divided into multiple second sub-regions, and a photoelectric sensing component is disposed in each second sub-region. The area of the multiple second sub-regions increases sequentially from the middle to both ends.
[0020] Along the second direction, the second part is divided into multiple second sub-parts, and each second sub-part is provided with a light-transmitting area. The area of the multiple second sub-parts increases sequentially from the middle to both ends.
[0021] Optionally, the center point of the photoelectric sensing component is located on the side of the corresponding light-transmitting area that is away from the first straight line.
[0022] Optionally, the optical structure is ring-shaped, and its orthographic projection onto the display module is located in the non-display area of the display module.
[0023] Optionally, the optical structure is integrated with the display module, the display module including a frame, and through holes are formed on the frame to form the light-transmitting area.
[0024] Optionally, a light-shielding layer with a hollowed-out pattern is provided on the light-emitting surface of the display module to form the light-transmitting area.
[0025] Optionally, the non-display area includes a first region extending along a first direction and a second region extending along a second direction, the first direction and the second direction intersecting, and the plurality of photoelectric sensing components include a plurality of first photoelectric components distributed in the first region and a plurality of second photoelectric components distributed in the second region;
[0026] Along the first direction, the first region is divided into multiple first sub-regions, and a first photoelectric sensing component is provided in each first sub-region. The area of the multiple first sub-regions increases sequentially from the middle to both ends.
[0027] Along the second direction, the second region is divided into multiple second sub-regions, and a second photoelectric sensing component is provided in each second sub-region. The area of the multiple second sub-regions increases sequentially from the middle to both ends.
[0028] Optionally, the border includes a first border corresponding to the first region and a second border corresponding to the second region;
[0029] Along the first direction, the first frame is divided into multiple first sub-frames, and each first sub-frame is provided with a light-transmitting area. The area of the multiple first sub-frames increases sequentially from the center to both ends.
[0030] Along the second direction, the second frame is divided into multiple second sub-frames, each of which contains a light-transmitting area, and the area of the multiple second sub-frames increases sequentially from the center to both ends.
[0031] Optionally, the second light rays passing through the light-transmitting area have a Lambertian distribution, and the distribution width of the second light rays is smaller than the distance between two adjacent photoelectric sensing components.
[0032] Optionally, the light source includes a lamp ring surrounding the optical lens, and the lamp ring is provided with a plurality of infrared LED beads.
[0033] Optionally, the distance between the optical structure and the photoelectric sensing component is 500-700 μm.
[0034] This disclosure also provides an eye-tracking method applied to the aforementioned eye-tracking device, comprising:
[0035] It receives light emitted from multiple light sources reflected by the human eye;
[0036] Convert the received light into an electrical signal;
[0037] The position of the human eye pupil is determined based on the signal value of the electrical signal and the position of at least one photoelectric sensing component.
[0038] The beneficial effect of this disclosure is that the light-transmitting area transmits light rays that pass through the center of the optical lens, meaning that the light received by the photoelectric sensing component is collimated light rays that pass through the optical center of the optical lens. Compared to receiving light rays that pass through the edge of the lens, this structure reduces, or even eliminates, optical distortion caused by the lens, thereby improving the accuracy of eye tracking. Attached Figure Description
[0039] Figure 1 A schematic diagram representing a straight line signal passing through the center of the lens;
[0040] Figure 2 A schematic diagram illustrating the signal distortion that occurs after passing through the edge of a lens;
[0041] Figure 3 This diagram illustrates the optical path of eye-tracking in related technologies.
[0042] Figure 4 This diagram illustrates the eye-tracking optical path in this embodiment.
[0043] Figure 5 A schematic diagram showing the amount of signal received by a photoelectric sensing component;
[0044] Figure 6 This diagram illustrates a comparison between the signal received by the photoelectric sensing component in an eye-tracking device using related technologies and the signal received by the photoelectric sensing component in the eye-tracking device of this embodiment.
[0045] Figure 7 This is a schematic diagram of the eye-tracking device in this embodiment;
[0046] Figure 8 A schematic diagram showing the distribution of the light-transmitting areas;
[0047] Figure 9 A schematic diagram showing the distribution of the photoelectric sensing components;
[0048] Figure 10 A schematic diagram showing the light distribution through the light-transmitting area;
[0049] Figure 11 A schematic diagram showing the light-emitting angle of an LED bead;
[0050] Figure 12 This is a schematic diagram showing the structure of the display module in this embodiment. Detailed Implementation
[0051] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this disclosure. All other embodiments obtained by those skilled in the art based on the described embodiments of this disclosure are within the scope of protection of this disclosure.
[0052] In the description of this disclosure, it should be noted that the terms "center," "upper," "lower," "left," "right," "vertical," "horizontal," "inner," and "outer," etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings, and are only for the convenience of describing this disclosure and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of this disclosure. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.
[0053] Pupil-positioning technology: The pupil area of the human eye is black, which has a strong ability to absorb light and reflects less light, while other areas reflect more light. Figure 1 This represents a straight line signal at the center of the lens, which becomes a curve after passing the lens edge (barrel distortion). (See reference...) Figure 2 Optical distortion not only reduces image quality but also reduces the difference in signal received by the sensor, which is detrimental to the realization of eye tracking functionality.
[0054] like Figure 3 This is a schematic diagram of the eye-tracking optical path in the related technology. The optical path emits light from the edge of the optical lens 1, is received by the collimation structure, and the amount of signal received by the sensor on the display module 2 is affected by the distortion at the edge of the lens. Figure 5 This is a comparison chart showing the relationship between the amount of signals received by the sensor before and after eye movement. Figure 5The horizontal axis represents the sensor's position, and the vertical axis represents the amount of signal received by the sensor. Curve 20 shows the signal received by the sensor along the horizontal x-axis when the eye is focused on the center; it can be seen that the sensor at the center position receives the least signal. Curve 10 shows the signal received by the sensor along the x-axis when the eye's gaze moves to the left; it can be seen that the lowest point of signal intensity changes with eye movement. This is the recognition process of eye tracking. Lens distortion can lead to… Figure 5 The change in signal quantity at the highest point S2 and the lowest point S1 of each curve is ΔS = S2 - S1. In the process of eye movement recognition, the larger ΔS is, the more conducive it is to the recognition of the pupil fixation position. Lens distortion will reduce the signal quantity difference ΔS.
[0055] refer to Figure 7 To address the aforementioned problems, this embodiment provides an eye-tracking device applied to a near-eye display system. The near-eye display system includes a display module 21 and an optical lens 1 located on the light-emitting side of the display module 21. The eye-tracking device includes:
[0056] Light source 3, located on the light-emitting side of the display module 21, is used to provide the first light rays emitted to the human eye 100;
[0057] Multiple photoelectric sensing components 201 are disposed in the non-display area of the display module 21 to receive second light to determine the position of the human eye pupil;
[0058] The optical structure 22 is located between the optical lens 1 and the display module 21, and includes a plurality of light-transmitting areas 221 corresponding one-to-one with the plurality of photoelectric sensing components 201, and each of the light-transmitting areas 221 is used to transmit the second light to the corresponding photoelectric sensing component 201.
[0059] The second ray is the ray that, after being reflected by the human eye 100, passes through the center point of the optical lens 1 (which is located on the optical axis of the optical lens).
[0060] The light-transmitting area 221 corresponds one-to-one with the photoelectric sensing component 201. That is, one light-transmitting area 221 is used to transmit the transmitted second light to a corresponding photoelectric sensing component 201. Different photoelectric sensing components 201 correspond to different areas of the human eye 100. Therefore, the position of the human eye pupil can be determined by the position coordinates of the photoelectric sensing component 201.
[0061] Furthermore, in this embodiment, the above-described technical solution is adopted, where the light-transmitting area 221 transmits light rays passing through the center of the optical lens 1 (i.e., the second light ray), and the light received by the photoelectric sensing component 201 is collimated light rays passing through the optical center of the optical lens 1. Compared to receiving light rays passing through the lens edge, this structure reduces, or even eliminates, optical distortion caused by the lens, thereby improving the accuracy of eye tracking.
[0062] refer to Figure 4 In this embodiment, for example, the center point of the human eye 100, the center point of the optical lens 1, and the center point of the display module 21 are located on a first straight line, and the location of the photoelectric sensing component 201 and the location of the corresponding human eye pupil are located on opposite sides of the first straight line.
[0063] It should be understood that the center point of the human eye refers to the center point of the eyeball.
[0064] like Figure 4 As shown, the photoelectric sensing component 201 receives a signal in the opposite direction. That is, the rightmost photoelectric sensing component 201 receives the signal from the leftmost Eye Box region 200 (Eye Box is defined as the field of view area that the human eye can see on the screen in a VR environment), which corresponds to receiving the light signal reflected from the leftmost part of the human eye. The lower photoelectric sensing component 201 receives the signal from the upper part of the Eye Box region 200 (that is, receives the light signal reflected from the upper part of the human eye). In this structure, when the eye gazes to the left, the point with the smallest signal moves to the right, which is opposite to the direction of gaze. It should be noted that the direction of human gaze is determined by the position of the pupil, and the direction of movement of the gaze point is the direction of movement of the pupil.
[0065] Figure 6 In the diagram, the third curve (30) represents the signal quantity curve for the normal structure, with ΔS / S2 = (S2-S1) / S2 = 0.34. The fourth curve (40) represents the optimized ΔS / S2 = (S2-S1) / S2 = 0.69 (this data represents a relative value; the specific value may change when the structure or experimental conditions change). The signal quantity change in the pupil fixation area is increased, improving the distortion effect of Eye Tracking in the VR structure.
[0066] refer to Figure 4 , Figure 8 and Figure 9 For example, the non-display area includes along a first direction (reference). Figure 8 A first region 25 extending in the X direction, wherein a plurality of photoelectric sensing components 201 are distributed at intervals along the first direction on the first region 25;
[0067] The optical structure includes a first portion 23 extending along the first direction, and a plurality of light-transmitting areas 221 are distributed at intervals along the first direction on the first portion 23.
[0068] The center point of the first portion 23 and the center point of the first region 25 are located on the second straight line. The center point of each light-transmitting area 221 on the first portion 23 is located on the side of the corresponding center point of the photoelectric sensing component 201 closer to the second straight line. Figure 4 .
[0069] Figure 4 The image shows a photoelectric sensing component 201 positioned on the far right along the first direction, and a light-transmitting area 221 corresponding to this photoelectric sensing component. The photoelectric sensing component 201 receives light rays reflected from the leftmost part of the human eye (corresponding to the leftmost partition of the EyeBox area 200) and after passing through the optical lens 1. The photoelectric sensing component 201 is located to the right of the corresponding light-transmitting area 221 so that the second light rays passing through the center of the optical lens 1 can be received by the photoelectric sensing component 201.
[0070] For example, based on the same principle, the non-display area also includes an area extending along the second direction (see reference). Figure 8 The second region 26 (in the Y direction) has a plurality of photoelectric sensing components 201 distributed at intervals along the second direction in the second region 26;
[0071] The optical structure includes a second portion 24 extending along the second direction, and a plurality of light-transmitting areas 221 are distributed at intervals along the second direction on the second portion 24.
[0072] The center point of the second part 24 and the center point of the second region 26 are located on the third straight line. The center point of each of the light-transmitting areas 221 on the second part 24 is located on the side of the center point of the corresponding photoelectric sensing component 201 that is close to the third straight line.
[0073] The first direction and the second direction are intersecting.
[0074] refer to Figure 8 and Figure 9 The non-display area of the display module is annular, and the photoelectric sensing component 201 is provided on each of the four edges of the display module. The light-transmitting area 221 is also provided on each of the four edges of the corresponding optical structure.
[0075] The display module 21 is generally rectangular, with the first direction and the second direction being perpendicular to each other. In this case, a coordinate system is established with the display module 21 as the reference, and the position coordinates of each photoelectric sensing component 201 can be obtained. Thus, the position of the human eye pupil can be determined based on the amount of light signal absorbed by each photoelectric sensing component 201.
[0076] For example, the center point of the photoelectric sensing component 201 is located on the side of the corresponding center point of the light-transmitting area 221 that is away from the first straight line.
[0077] In order not to affect the normal display of the display module 21, the photoelectric sensing component 201 is disposed in the non-display area of the display module 21. The center point of the human eye, the center point of the optical lens 1 and the center point of the display module are located on a first straight line, and the first straight line is parallel to the light emission direction of the display module. The center point of the photoelectric sensing component 201 is located on the side of the corresponding center point of the light-transmitting area 221 away from the first straight line, so as to facilitate the reception of light by the photoelectric sensing component 201.
[0078] For example, along the first direction, the first region 25 is divided into a plurality of first sub-regions, and a photoelectric sensing component 201 is provided in each first sub-region. The area of the plurality of first sub-regions increases sequentially from the middle to both ends.
[0079] Along the first direction, the first part 23 is divided into a plurality of first sub-parts, and each first sub-part is provided with a light-transmitting area 221, and the area of the plurality of first sub-parts increases sequentially from the middle to both ends.
[0080] Along the second direction, the second region 26 is divided into multiple second sub-regions, and a photoelectric sensing component 201 is provided in each second sub-region. The area of the multiple second sub-regions increases sequentially from the middle to both ends.
[0081] For example, along the second direction, the second part 24 is divided into a plurality of second sub-parts, each of which is provided with a light-transmitting area 221, and the area of the plurality of second sub-parts increases sequentially from the middle to both ends.
[0082] Since the signal received by the photoelectric sensing components 201 located at both ends along the first direction fluctuates greatly, and the greater the distance from the center point, the greater the fluctuation of the received signal, which affects the determination of the pupil position, in this embodiment, the first region 25 is divided into multiple sub-regions, and the area of multiple sub-regions is increased from the middle to both ends in sequence to solve the problem that the large fluctuation of the signal received by the first photoelectric sensing components 2011 located at both ends affects the accuracy of pupil position determination.
[0083] Similarly, in the second direction, the signal received by the photoelectric sensing components 201 at both ends fluctuates greatly, and the farther away from the center point, the greater the fluctuation of the received signal, which affects the determination of the pupil position. Therefore, in this embodiment, the second region 26 is divided into multiple sub-regions, and the area of multiple sub-regions is increased from the middle to both ends in turn to solve the problem that the large fluctuation of the signal received by the second photoelectric sensing components 2012 at both ends affects the accuracy of pupil position determination.
[0084] In this embodiment, an LCD display module is used. In a VR display environment, the human eye needs to view the display screen through the square Eye Box area 200 in front. By detecting the position of the human eye on the Eye Box area 200, eye tracking can be achieved (see reference). Figure 3 and Figure 4 The Eye Box is defined as the field of view area that the human eye can see on the screen in a VR environment, with a size of 8*8mm. The Eye Box area is divided into 10*10 sections. When the human eye moves, the pupil will be in different sections. The photoelectric sensing components corresponding to different sections will receive different signal magnitudes, thereby determining the pupil position and thus the position of eye gaze. The light-transmitting area 221 is divided into sections corresponding to the Eye Box sections, and the photoelectric sensing components 201 are also divided into sections, as shown in the reference section. Figure 8 and Figure 9 The 10*10 partitions are unevenly distributed, i.e., along the first direction (reference). Figure 8 The partitions are divided in the X direction (as shown in the image), gradually increasing in size from the center to both ends, along the second direction (refer to the image). Figure 9 The partitioning (in the Y direction) gradually increases from the center to both ends for the following reasons: 1. In near-eye eye-tracking VR modules, the signal received by the photoelectric sensing components is at a low level. The signal strength of the light emitted from the Eye Box has a significant impact on the reception of the photoelectric sensing components, so it is necessary to ensure that the signal received by the photoelectric sensing components is equal under eye-free conditions; 2. Compared with the photoelectric sensing components in the middle position, the photoelectric sensing components at both ends have a longer optical path and stronger loss, so the partitioning position is larger to compensate; 3. Signal strength benchmark: Ensure that the difference in signal strength received by any two photoelectric sensing components is less than 10% to avoid excessive fluctuations affecting the judgment of pupil position.
[0085] In one specific embodiment of this example, the position coordinates of the light-transmitting areas 221 arranged along the first direction are shown in Table 1, and the position coordinates of the photoelectric sensing components 201 arranged along the first direction corresponding to the light-transmitting areas in Table 1 are shown in Table 2.
[0086] Table 1:
[0087]
[0088] Table 2:
[0089]
[0090] refer to Figure 7 and Figure 8 For example, the optical structure 22 is annular, and its orthographic projection on the display module is located in the non-display area of the display module.
[0091] The orthographic projection of the optical structure 22 onto the display module is located in the non-display area of the display module and will not affect the normal display of the display module.
[0092] For example, the optical structure 22 is integrated with the display module, the display module including a frame, and a through hole is formed on the frame to form the light-transmitting area 221.
[0093] refer to Figure 7 and Figure 12 For example, the display module 21 includes a display area 300 and a non-display area 400. A light-shielding layer 500 with a hollow pattern is provided on the light-emitting surface of the display module 21 to form the light-transmitting area 221. The light-shielding layer 500 is located in the non-display area 400, and the hollow pattern on the light-shielding layer 500 is the light-transmitting area 221.
[0094] The above technical solution simplifies the structural design.
[0095] For example, the second light rays passing through the light-transmitting area 221 have a Lambertian distribution, and the distribution width of the second light rays is smaller than the distance between two adjacent photoelectric sensing components.
[0096] A schematic diagram of the light distribution after passing through one of the aforementioned light-transmitting areas is shown below. Figure 10 As shown, the distribution width of the second light is smaller than the distance between two adjacent photoelectric sensing components, thus avoiding crosstalk between the light transmitted between adjacent light-transmitting areas.
[0097] For example, the display module used is a 3.5-inch square screen (62.856mm*62.856mm), divided into 10*10 sections, that is, 10 holes are opened on each side of the 6.2cm screen edge to form 10 light-transmitting areas 221. Each light-transmitting area 221 is a circular hole with a diameter of 10um. The illuminance of light after passing through the light-transmitting area 221 follows a Lambertian distribution, and the spectral lines are as follows. Figure 10As shown, the spectral linewidth is 23 μm (the linewidth occupied by 90% of the energy after passing through the light-transmitting region 221), and the minimum interval between adjacent light-transmitting regions 221 is 200 μm, so there is no crosstalk between adjacent light-transmitting regions 221.
[0098] refer to Figure 7 For example, the light source 3 includes a lamp ring surrounding the optical lens 1, and a plurality of infrared LED beads 31 are disposed on the lamp ring.
[0099] In this embodiment, a ring light source with 8 infrared LEDs is used. The ring diameter is 53.3mm, the LED bead size is 0.8mm, the luminous power of a single light source is 10.53mw, and the beam angle is as follows. Figure 11 As shown, other light sources with different incident angles and intensities can also be used, and are not limited to this.
[0100] The light source 3 can also be a laser light source, etc., and is not limited to those described above.
[0101] For example, the distance between the optical structure 22 and the photoelectric sensing component 201 is 500-700 μm.
[0102] In this embodiment, the optical lens 1 is a set of single lenses made of polymethyl methacrylate (PMMA), also known as acrylic glass or plexiglass, with a refractive index n = 1.49. The distance d1 from the eye to the first surface of the lens (the surface closest to the eye) is 14 mm, the lens thickness d2 is 14 mm, and the distance d3 between the second surface of the optical lens (the surface opposite to the first surface) and the display module is 33.7 mm. In this embodiment, the optical lens is an aspherical surface with a surface radius R1 = -75.072 for the first surface and a surface radius R2 = 22.861 for the second surface.
[0103] The table below shows the structural parameters of an eye-tracking device in one example. The eyes are of Asian descent, with black pupils and brown irises. Caucasians have lighter-colored eyes and poorer infrared diffuse reflectance; therefore, they are not considered in this example. The diffuse reflectance of the human eye to infrared light is: pupil 3-5%, iris 10-20%, sclera 70-80%.
[0104]
[0105] This disclosure also provides an eye-tracking method applied to the aforementioned eye-tracking device, comprising:
[0106] It receives light emitted from multiple light sources reflected by the human eye;
[0107] Convert the received light into an electrical signal;
[0108] The position of the human eye pupil is determined based on the signal value of the electrical signal and the position of at least one photoelectric sensing component.
[0109] It is understood that the above embodiments are merely exemplary embodiments used to illustrate the principles of this disclosure, and this disclosure is not limited thereto. For those skilled in the art, various modifications and improvements can be made without departing from the spirit and substance of this disclosure, and these modifications and improvements are also considered to be within the scope of protection of this disclosure.
Claims
1. An eye-tracking device for use in a near-eye display system, the near-eye display system comprising a display module and an optical lens located on the light-emitting side of the display module, wherein, The eye-tracking device includes: A light source, located on the light-emitting side of the display module, is used to provide the first light rays emitted to the human eye; Multiple photoelectric sensing components are disposed in the non-display area of the display module to receive a second light source for determining the position of the human eye pupil; An optical structure, located between the optical lens and the display module, includes multiple light-transmitting areas corresponding one-to-one with the multiple photoelectric sensing components, and each of the light-transmitting areas is used to transmit the second light to the corresponding photoelectric sensing component; The second ray is the ray that passes through the center point of the optical lens after the first ray is reflected by the human eye; The center point of the human eye, the center point of the optical lens, and the center point of the display module are located on a first straight line. The location of the photoelectric sensing component and the location of the corresponding human eye pupil are located on opposite sides of the first straight line. In the extension direction of the first straight line, the orthographic projection of the location of the photoelectric sensing component in the Eye Box area and the corresponding partition of the Eye Box area that provides reflected signals are located on opposite sides of the first straight line, so that the photoelectric sensing component receives a signal in the opposite direction. Furthermore, the movement direction of the human eye's gaze point is opposite to the movement direction of the point where the photoelectric sensing component receives the least signal.
2. The eye-tracking device according to claim 1, wherein, The non-display area includes a first region extending along a first direction, on which a plurality of the photoelectric sensing components are distributed at intervals along the first direction. The optical structure includes a first portion extending along the first direction, and a plurality of light-transmitting areas are distributed at intervals along the first direction on the first portion. The center point of the first part and the center point of the first region are located on the second straight line. The center point of each of the light-transmitting areas on the first part is located on the side of the corresponding center point of the photoelectric sensing component that is close to the second straight line.
3. The eye-tracking device according to claim 2, wherein, Along the first direction, the first region is divided into multiple first sub-regions, and a photoelectric sensing component is provided in each first sub-region. The area of the multiple first sub-regions increases sequentially from the middle to both ends. Along the first direction, the first part is divided into multiple first sub-parts, and each first sub-part is provided with a light-transmitting area. The area of the multiple first sub-parts increases sequentially from the middle to both ends.
4. The eye-tracking device according to claim 2, wherein, The non-display area further includes a second region extending along a second direction, on which a plurality of the photoelectric sensing components are distributed at intervals along the second direction; The optical structure includes a second portion extending along the second direction, and a plurality of light-transmitting areas are distributed at intervals along the second direction on the second portion. The center point of the second part and the center point of the second region are located on the third straight line. The center point of each of the light-transmitting areas on the second part is located on the side of the center point of the corresponding photoelectric sensing component that is close to the third straight line. The first direction and the second direction are intersecting.
5. The eye-tracking device according to claim 4, wherein, Along the second direction, the second region is divided into multiple second sub-regions, and a photoelectric sensing component is provided in each second sub-region. The area of the multiple second sub-regions increases sequentially from the middle to both ends. Along the second direction, the second part is divided into multiple second sub-parts, and each second sub-part is provided with a light-transmitting area. The area of the multiple second sub-parts increases sequentially from the middle to both ends.
6. The eye-tracking device according to claim 1, wherein, The center point of the photoelectric sensing component is located on the side of the corresponding center point of the light-transmitting area away from the first straight line.
7. The eye-tracking device according to claim 1, wherein, The optical structure is ring-shaped, and its orthographic projection onto the display module is located in the non-display area of the display module.
8. The eye-tracking device according to claim 7, wherein, The optical structure is integrated with the display module, which includes a frame with through holes to form the light-transmitting area.
9. The eye-tracking device according to claim 7, wherein, The light-emitting surface of the display module is provided with a light-shielding layer with a hollowed-out pattern to form the light-transmitting area.
10. The eye-tracking device according to claim 1, wherein, The second ray passing through the light-transmitting area has a Lambertian distribution, and the distribution width of the second ray is smaller than the distance between two adjacent photoelectric sensing components.
11. The eye-tracking device according to claim 1, wherein, The light source includes a lamp ring surrounding the optical lens, and the lamp ring is provided with multiple infrared LED beads.
12. The eye-tracking device according to claim 1, wherein, The distance between the optical structure and the photoelectric sensing component is 500-700 μm.
13. An eye-tracking method, applied to the eye-tracking device according to any one of claims 1-12, wherein, include: It receives light emitted from multiple light sources reflected by the human eye; Convert the received light into an electrical signal; The position of the human eye pupil is determined based on the signal value of the electrical signal and the position of at least one photoelectric sensing component.