Eye tracking optical system and display device

Abstract

The disclosure provides an eye tracking optical system and a display device. The eye tracking optical system comprises: an infrared light emitting device, a first lens group and an infrared imaging device. The infrared light emitting device is configured to emit infrared light to a human eye. The first lens group is configured to be arranged on the light emitting side of a display panel. The side of the first lens group away from the display panel is configured to converge the infrared light reflected by the human eye. The side of the first lens group close to the display panel is configured to diverge the infrared light deflected by the first lens group. The infrared imaging device is arranged on the side of the first lens group close to the display panel, and the imaging surface of the infrared imaging device faces the first lens group. The infrared light reflected by the human eye is deflected after passing through the first lens group and is incident on the infrared imaging device.

Description

Technical Field

[0001] The present disclosure relates to the field of display technology, and in particular to an eye-tracking optical system and a display device. Background Art

[0002] In the consumer electronics industry, some near-eye display technologies such as VR (Virtual Reality), AR (Augmented Reality) and XR (Extended Reality) have eye tracking functions. That is, the infrared light emitted by the infrared light emitting device is reflected by the human eye, and the eye information carried by the light is transmitted to the infrared imaging device, so that the user's eye gaze point on the screen can be obtained through data processing.

[0003] In related technologies, some eye-tracking display products place infrared light emitting devices and infrared imaging devices in front of the screen, and use a semi-reflective and semi-transparent flat panel placed in front of the screen to reflect infrared light and allow the infrared imaging device to receive it. However, the design of the semi-reflective and semi-transparent flat panel requires a large space for the display product. Summary of the Invention

[0004] A first aspect of the present disclosure provides an eye-tracking optical system, comprising:

[0005] an infrared light emitting device, the infrared light emitting device being used to emit infrared light toward human eyes;

[0006] a first lens group, the first lens group being configured to be disposed on a light-emitting side of the display panel, wherein a side of the first lens group away from the display panel is configured to converge infrared light reflected by the human eye, and a side of the first lens group close to the display panel is configured to diverge the infrared light deflected by the first lens group;

[0007] An infrared imaging device is arranged on a side of the first lens group close to the display panel, and the imaging surface of the infrared imaging device faces the first lens group. The infrared light reflected by the human eye is deflected after passing through the first lens group and is incident on the infrared imaging device.

[0008] Optionally, the infrared imaging device is configured to be arranged on a peripheral side of the display panel, and the imaging surface of the infrared imaging device is substantially located in the same plane as the display panel.

[0009] Optionally, a plane where the optical axis of the first lens group is located is perpendicular to the display panel;

[0010] The vertical distance h between the first end point of the infrared imaging device and the plane where the optical axis of the first lens group is located satisfies the following relationship: 10.5 mm <h<10.7mm,所述第一端点为所述红外成像装置中最靠近所述第一透镜组的光轴所在平面的点;

[0011] The vertical distance w between the second endpoint of the infrared imaging device and the target plane of the first lens group satisfies the following relationship: 4mm <w<5mm,所述第二端点为所述红外成像装置中最靠近所述目标平面的点,所述目标平面为所述第一透镜组中最靠近所述显示面板的点所在的平面,所述目标平面平行于所述显示面板。

[0012] Optionally, the infrared imaging device includes a second lens group;

[0013] A first endpoint of the second lens group has a vertical distance h from the plane where the optical axis of the first lens group lies, and a second endpoint of the second lens group has a vertical distance w from the object plane of the first lens group;

[0014] There is a set corresponding relationship between the emission position and emission angle of the infrared light on the side of the first lens group close to the display panel and the vertical distance h and the vertical distance w.

[0015] Optionally, the optical axis of the infrared imaging device is inclined toward the center of the display panel, and the optical axis of the infrared imaging device intersects with the optical axis of the first lens group.

[0016] Optionally, the angle α between the optical axis of the infrared imaging device and the optical axis of the first lens group is in the range of 3 degrees < α < 3.5 degrees.

[0017] Optionally, there are one or more infrared light emitting devices, and the one or more infrared light emitting devices are arranged on a side of the first lens group close to the display panel or a side away from the display panel; or

[0018] The first lens group includes a plurality of lenses, and the one or more infrared light emitting devices are located between two adjacent lenses among the plurality of lenses.

[0019] Optionally, the first lens group includes a first lens, a second lens, a third lens, a fourth lens, and a fifth lens arranged in sequence, the first lens is away from the display panel, and the fifth lens is close to the display panel;

[0020] The first lens has positive refractive power, and a side of the first lens away from the display panel and a side of the first lens close to the display panel are convex surfaces;

[0021] The second lens has negative focal power, and a side away from the display panel of the second lens is convex, and a side close to the display panel of the second lens is concave;

[0022] The third lens and the fourth lens have positive focal power, and a side away from the display panel and a side close to the display panel of the third lens and the fourth lens are convex;

[0023] The fifth lens has negative focal power, and a side away from the display panel and a side close to the display panel of the fifth lens are concave.

[0024] Optionally, the infrared imaging device comprises a second lens group, the second lens group comprising a sixth lens, a seventh lens and an eighth lens arranged in sequence, the sixth lens being close to the first lens group, and the eighth lens being away from the first lens group;

[0025] The sixth lens has negative focal power, and a side away from the first lens group of the sixth lens is convex, and a side close to the first lens group of the sixth lens is concave;

[0026] The seventh lens has positive focal power, and a side away from the first lens group of the seventh lens is convex, and a side close to the first lens group of the seventh lens is concave;

[0027] The eighth lens has negative focal power, and a side away from the first lens group and a side close to the first lens group of the eighth lens are concave.

[0028] Optionally, the infrared imaging device comprises a second lens group;

[0029] At least one of the first lens group and the second lens group comprises a single lens, a multi-lens or a cemented lens; and / or

[0030] The lens of at least one of the first lens group and the second lens group comprises a spherical surface, a cylindrical surface, a Fresnel surface or a free-form surface; and / or

[0031] The lens material of at least one of the first lens group and the second lens group comprises plastic, glass or a mixed material of plastic and glass; and / or

[0032] The lens surface of at least one of the first lens group and the second lens group is coated with an anti-reflection film.

[0033] Optionally, the first lens group comprises a first lens, a second lens, a third lens, a fourth lens and a fifth lens arranged in sequence, the first lens being away from the display panel, and the fifth lens being close to the display panel;

[0034] The following relationships are satisfied between the focal lengths of the first lens to the fifth lens:

[0035] 1 < (f11 + f12) x f1 / (f11 x f12) < 2;

[0036] 0.5 < (f12 + f13) x f1 / (f12 x f13) < 1;

[0037] 0.8 < (f13 + f14) x f1 / (f13 x f14) < 1;

[0038] 1 < (f14 + f15) x f1 / (f14 x f15) < 1.2;

[0039] wherein f11 represents the focal length of the first lens, f12 represents the focal length of the second lens, f13 represents the focal length of the third lens, f14 represents the focal length of the fourth lens, f15 represents the focal length of the fifth lens, and f1 represents the focal length of the first lens group.

[0040] Optionally, the first lens group comprises a first lens, a second lens, a third lens, a fourth lens and a fifth lens arranged in sequence, the first lens is away from the display panel, and the fifth lens is close to the display panel.

[0041] The following relationships are satisfied between the thicknesses of the first lens to the fifth lens in the direction of the optical axis of the first lens group:

[0042] 1.5 < d1 / d2 < 2;

[0043] 0 < d2 / d3 < 0.5;

[0044] 0.5 < d3 / d4 < 1;

[0045] 3 < d4 / d5 < 3.3;

[0046] wherein d1 represents the thickness of the first lens, d2 represents the thickness of the second lens, d3 represents the thickness of the third lens, d4 represents the thickness of the fourth lens, and d5 represents the thickness of the fifth lens.

[0047] Optionally, the first lens group comprises a first lens, a second lens, a third lens, a fourth lens and a fifth lens arranged in sequence, the first lens is away from the display panel, and the fifth lens is close to the display panel.

[0048] The following relationships are satisfied between the radii of curvature of the first lens to the fifth lens:

[0049] 9 < | (R11 - R12) / (R11 + R12) | < 9.5;

[0050] 0<|(R21-R22) / (R21+R22)|<0.5;

[0051] 11<|(R31-R32) / (R31+R32)|<12;

[0052] 1.5<|(R41-R42) / (R41+R42)|<2;

[0053] 7<|(R51-R52) / (R51+R52)|<7.5;

[0054] wherein R11 represents a radius of curvature of a side of the first lens away from the display panel, R12 represents a radius of curvature of a side of the first lens close to the display panel, R21 represents a radius of curvature of a side of the second lens away from the display panel, R22 represents a radius of curvature of a side of the second lens close to the display panel, R31 represents a radius of curvature of a side of the third lens away from the display panel, R32 represents a radius of curvature of a side of the third lens close to the display panel, R41 represents a radius of curvature of a side of the fourth lens away from the display panel, R42 represents a radius of curvature of a side of the fourth lens close to the display panel, R51 represents a radius of curvature of a side of the fifth lens away from the display panel, and R52 represents a radius of curvature of a side of the fifth lens close to the display panel.

[0055] Optionally, the infrared imaging device comprises a second lens group, the second lens group comprising a sixth lens, a seventh lens and an eighth lens arranged in sequence, the sixth lens being close to the first lens group, and the eighth lens being away from the first lens group.

[0056] The following relationships are satisfied between the focal lengths of the sixth lens to the eighth lens:

[0057] 21<(f26+f27)×f2 / (f26×f27)<21.5;

[0058] 20<(f27+f28)×f2 / (f27×f28)<20.5;

[0059] wherein f26 represents a focal length of the sixth lens, f27 represents a focal length of the seventh lens, f28 represents a focal length of the eighth lens, and f2 represents a focal length of the second lens group.

[0060] Optionally, the infrared imaging device comprises a second lens group, the second lens group comprising a sixth lens, a seventh lens and an eighth lens arranged in sequence, the sixth lens being close to the first lens group, and the eighth lens being away from the first lens group.

[0061] In the direction of the optical axis of the second lens group, the thicknesses of the sixth lens to the eighth lens satisfy the following relationship:

[0062] 2.5 < d6 / d7 < 3;

[0063] 2.5 < d7 / d8 < 3;

[0064] wherein d6 represents the thickness of the sixth lens, d7 represents the thickness of the seventh lens, and d8 represents the thickness of the eighth lens.

[0065] Optionally, the infrared imaging device comprises a second lens group, the second lens group comprising a sixth lens, a seventh lens and an eighth lens arranged in sequence, the sixth lens being close to the first lens group, and the eighth lens being away from the first lens group;

[0066] The radii of curvature of the sixth lens to the eighth lens satisfy the following relationship:

[0067] 0.1 < |(R61-R62) / (R61+R62)| < 0.5;

[0068] 0.5 < |(R71-R72) / (R71+R72)| < 1;

[0069] 0 < |(R81-R82) / (R81+R82)| < 0.5;

[0070] wherein R61 represents the radius of curvature of the side of the sixth lens close to the first lens group, R62 represents the radius of curvature of the side of the sixth lens away from the first lens group, R71 represents the radius of curvature of the side of the seventh lens close to the first lens group, R72 represents the radius of curvature of the side of the seventh lens away from the first lens group, R81 represents the radius of curvature of the side of the eighth lens close to the first lens group, and R82 represents the radius of curvature of the side of the eighth lens away from the first lens group.

[0071] Optionally, the first lens group comprises a first lens, a second lens, a third lens, a fourth lens and a fifth lens arranged in sequence, the first lens being away from the display panel, and the fifth lens being close to the display panel;

[0072] The infrared imaging device comprises a second lens group and a sensor, the second lens group comprising a sixth lens, a seventh lens and an eighth lens arranged in sequence, the sixth lens being close to the fifth lens, the eighth lens being away from the fifth lens, and the sensor being arranged on the side of the eighth lens away from the fifth lens;

[0073] In a direction perpendicular to the display panel, the air gaps of the first lens to the eighth lens satisfy the following relationships:

[0074] 0 < DT1 / DT2 < 0.1;

[0075] 0 < DT3 / DT4 < 0.5;

[0076] 0.1 < DT5 / DT6 < 0.2;

[0077] 1 < DT6 / DT7 < 1.2;

[0078] 2 < DT7 / DT8 < 2.5;

[0079] wherein DT1 represents the air gap between the first lens and the second lens, DT2 represents the air gap between the second lens and the third lens, DT3 represents the air gap between the third lens and the fourth lens, DT4 represents the air gap between the fourth lens and the fifth lens, DT5 represents the air gap between the fifth lens and the display panel, DT6 represents the air gap between the sixth lens and the seventh lens, DT7 represents the air gap between the seventh lens and the eighth lens, and DT8 represents the air gap between the eighth lens and the sensor.

[0080] A second aspect of the embodiments of the present disclosure provides a display device, comprising:

[0081] a display panel;

[0082] The eye tracking optical system according to any one of the first aspect.

[0083] Optionally, further comprising a housing, wherein the display panel, the first lens group, the infrared light emitting device, and the infrared imaging device are located in the housing;

[0084] An optical axis of the first lens group is perpendicular to the display panel and is located on a same straight line as a center of the display panel;

[0085] A vertical distance between a first end point of the infrared imaging device and a plane on which the optical axis of the first lens group is located is greater than half a height of the display panel, and a vertical distance between the infrared imaging device and the plane on which the optical axis of the first lens group is located is less than a vertical distance between a first side of the housing and the plane on which the optical axis of the first lens group is located;

[0086] A vertical distance between a second end point of the infrared imaging device and a target plane of the first lens group is less than a vertical distance between the target plane of the first lens group and a second side of the housing.

[0087] The technical solutions provided in the embodiments of the present disclosure have at least the following technical effects or advantages.

[0088] The eye tracking optical system provided by the embodiments of the present disclosure has the following advantages. The infrared light emitting device is used to emit infrared light to the human eye, the first lens group is arranged on the light emitting side of the display panel, the side of the first lens group away from the display panel is used to converge the infrared light reflected by the human eye, so as to reduce the light angle of the infrared light reflected by the human eye, and the side of the first lens group close to the display panel is used to diverge the infrared light, so as to improve the imaging clarity; the infrared imaging device is arranged on the side of the first lens group close to the display panel, and the imaging surface of the infrared imaging device faces the first lens group. The infrared light reflected by the human eye is deflected after passing through the first lens group and is incident on the infrared imaging device. In this way, by reasonably arranging the first lens group and the infrared imaging device, the volume of the eye tracking optical system is reduced, and the volume of the near-eye display product is thinned.

[0089] The above description is only a summary of the technical solutions provided by the embodiments of the present disclosure. In order to more clearly understand the technical means of the embodiments of the present disclosure, the embodiments of the present disclosure can be implemented according to the content of the specification, and in order to make the above and other purposes, features and advantages of the embodiments of the present disclosure more obvious and easy to understand, the following specific embodiments of the present disclosure are described. BRIEF DESCRIPTION OF DRAWINGS

[0090] Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The accompanying drawings are intended to only illustrate preferred embodiments and are not considered limiting of the present disclosure. Moreover, like reference numerals denote like parts throughout the several views in the drawings. In the drawings:

[0091] Figure 1 A structural schematic diagram of an eye tracking optical system according to an embodiment of the present disclosure is shown;

[0092] Figure 2 A positional relationship schematic diagram of an eye tracking optical system and a display panel according to an embodiment of the present disclosure is shown;

[0093] Figure 3 A light path schematic diagram of display light L1 according to an embodiment of the present disclosure is shown;

[0094] Figure 4 A light path schematic diagram of infrared light L2 of a display panel according to an embodiment of the present disclosure is shown;

[0095] Figure 5 A positional relationship schematic diagram of an infrared light emitting device and an infrared imaging device and a display panel according to an embodiment of the present disclosure is shown;

[0096] Figure 6A position diagram of an infrared light emitting device of an embodiment of the present disclosure is shown.

[0097] Figure 7 Another position diagram of an infrared light emitting device of an embodiment of the present disclosure is shown.

[0098] Figure 8 A structure diagram of a first lens group of an embodiment of the present disclosure is shown.

[0099] Figure 9 A structure diagram of a second lens group of an embodiment of the present disclosure is shown.

[0100] Figure 10 A structure diagram of a display device of an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0101] Exemplary embodiments of the present disclosure will be described more fully hereinafter with reference to the accompanying drawings. While example embodiments of the present disclosure are shown in the drawings, it is understood that the present disclosure can be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the present disclosure to those skilled in the art. It is noted that the phrase "a plurality of" includes two or more.

[0102] As used herein, "about," "substantially," "approximately," or "essentially" include the stated value and the average value within an acceptable range of deviation from the stated value, as determined by one of ordinary skill in the art considering the measurement in question and the error intended to be introduced by the particular quantity measured (i.e., the limitations of the measurement system).

[0103] As used herein, "parallel," "perpendicular," and "equal" include the stated condition and conditions approximating the stated condition within an acceptable range of deviation, as determined by one of ordinary skill in the art considering the measurement in question and the error intended to be introduced by the particular quantity measured (i.e., the limitations of the measurement system). For example, "parallel" includes absolute parallel and near parallel, where near parallel can have an acceptable range of deviation of, for example, within 5°; "perpendicular" includes absolute perpendicular and near perpendicular, where near perpendicular can also have an acceptable range of deviation of, for example, within 5°. "Equal" includes absolute equality and near equality, where near equality can have an acceptable range of deviation of, for example, a difference between the two of less than or equal to 5% of either.

[0104] In recent years, with the development of virtual reality, augmented reality, extended reality and other technologies, near-eye display devices (also known as head-mounted displays) have been widely used, for example, in the fields of military, gaming, film and television entertainment, live broadcast, real estate, retail, education and medical health.

[0105] Some near-eye display products have eye tracking function, that is, infrared light emitted by an infrared light emitting device is reflected by the human eye, and the eye information carried by the light is transmitted to an infrared imaging device, so as to obtain the gaze point of the user's eye in the screen through data processing. Therefore, only the area of the gaze point position in the display screen can be rendered, and the requirement of the device on hardware is reduced. In addition, the eye tracking function can also be used to create depth sensing to generate a better user interface.

[0106] In the related art, some products set the infrared light emitting device and the infrared imaging device in front of the screen, and set a tilted half-mirror plate between the display screen and the lens, and the half-mirror plate is coated with a hot mirror, so as to allow infrared light to be reflected and visible light to be transmitted. The reflected light is received by the infrared imaging device, but the design of the half-mirror plate has a large space requirement for the display product, and the adaptability in a compact optical system is poor. In addition, some products set the infrared imaging device close to the human eye to directly shoot the human eye, and the infrared light emitting device is also set close to the human eye. This method causes the infrared imaging device to be close to the human eye and may interfere with the human eye, affecting the user experience.

[0107] Therefore, the first aspect of the embodiments of the present disclosure provides an eye tracking optical system, so as to reduce the volume of the eye tracking optical system and realize the thinning of the near-eye display product.

[0108] The eye tracking optical system of the first aspect of the embodiments of the present disclosure will be described below in combination with specific drawings.

[0109] Referring to Figure 1 , a structural schematic diagram of the eye tracking optical system of the embodiments of the present disclosure is shown; and referring to Figure 2 , a positional relationship schematic diagram of the eye tracking optical system of the embodiments of the present disclosure and a display panel is shown.

[0110] As Figure 1 and Figure 2As shown, the eye tracking optical system 10 provided by the embodiment of the present disclosure includes: an infrared light emitting device 3 configured to emit infrared light to a human eye E; a first lens group 2 configured to be arranged on the light emitting side of a display panel 1, the side of the first lens group 2 away from the display panel 1 is configured to converge the infrared light reflected by the human eye E, and the side of the first lens group 2 close to the display panel 1 is configured to diverge the infrared light after being deflected by the first lens group; and an infrared imaging device 4 arranged on the side of the first lens group 2 close to the display panel 1, and the imaging surface of the infrared imaging device 4 faces the first lens group 2, the infrared light reflected by the human eye E is deflected after passing through the first lens group 2 and is incident on the infrared imaging device 4.

[0111] Referring to Figure 3 , a light path diagram of display light L1 of the embodiment of the present disclosure is shown; referring to Figure 4 , a light path diagram of infrared light L2 of the display panel 1 of the embodiment of the present disclosure is shown.

[0112] As an example, as shown in Figure 3 , the display light L1 of the display panel 1 is emitted from the light emitting side of the display panel 1, and L1 reaches the human eye E after being deflected by the first lens group 2, as shown in Figure 4 , the infrared light emitting device 3 emits infrared light L2 to the human eye, and the infrared light L2 reaches the side of the first lens group 2 away from the display panel 1 for light convergence, so as to reduce the light angle of the infrared light L2 reflected by the human eye, reduce the deflection pressure of the infrared light L2 after entering the first lens group 2, and the infrared light L2 reaches the side of the first lens group 2 close to the display panel 1 for light divergence. It can be understood that the divergent infrared light L2 can be further deflected by the infrared imaging device 4 when entering the infrared imaging device 4, so as to improve the imaging effect, and then the field of view angle range of the infrared light L2 entering the infrared imaging device 4 is received and imaged. Thus, the infrared light L2 deflected by the first lens group 2 is incident on the infrared imaging device 4, and subsequent data processing can be performed by the eye tracking algorithm in the related art to obtain the gaze point of the human eye E in the display panel 1. Therefore, by reasonably arranging the first lens group 2 and the infrared imaging device 4, the volume of the eye tracking optical system 10 is reduced, and the thinning of the near-eye display product is realized.

[0113] The embodiment of the present disclosure can reduce the volume of the eye tracking optical system 10 by reasonably designing the deflection light path of the first lens group 2 to the infrared light, so that the infrared imaging device 4 can directly receive the deflected infrared light of the first lens group 2 without setting a half-reflection half-transmission plate, thereby realizing the thinning of the volume of the near-eye display product. In addition, by arranging the infrared imaging device 4 on the side of the first lens group 2 close to the display panel 1, the infrared imaging device 4 is far away from the human eye, thereby avoiding the interference with the human eye and affecting the user experience.

[0114] In some embodiments, the display panel 1 can be an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), a MicroOLED, a Mini LED, or the like. The display screen size of the display panel 1 can be in the range of 0.39 inches to 1.35 inches, for example, 0.39 inches, 0.5 inches, 0.9 inches, 1.35 inches, etc. For example, the OLED display panel 1 adopts a 0.9-inch 4K display screen.

[0115] Optionally, the infrared imaging device 4 is arranged on the side of the display panel 1, and the imaging surface of the infrared imaging device 4 is substantially located on the plane of the display panel 1.

[0116] It can be understood that the infrared imaging device 4 is arranged close to the edge of the display panel 1, i.e., on the side of the display panel 1, and the imaging surface of the infrared imaging device 4 is substantially located on the plane of the display panel 1, so that the compactness of the optical system can be improved. Substantially located can mean that the imaging surface of the infrared imaging device 4 is parallel to the plane of the display panel 1, but there is a small gap between them, for example, 1 mm, 2 mm or 3 mm, etc. Alternatively, there is a small inclination angle between the imaging surface of the infrared imaging device 4 and the plane of the display panel 1, for example, 3 degrees, 4 degrees, 5 degrees, etc.

[0117] For example, the infrared imaging device 4 is an infrared camera, and the infrared camera is one or more, which can be arranged on the side of the display panel 1. As can be seen from the figure, in the direction perpendicular to the optical axis 21 of the first lens group, the height of the display panel 1 is less than the height of the first lens group 2, so when the one or more infrared cameras are arranged on the side of the display panel 1, the infrared cameras can be arranged as close to the display panel 1 as possible, so that the light emitted from the edge of the first lens group 2 can also enter the field of view of the infrared camera 2 on the basis of a certain distance between the infrared camera and the first lens group 2, thereby improving the imaging clarity.

[0118] In some embodiments, the plane in which the optical axis 21 of the first lens group is located is perpendicular to the display panel 1; the vertical distance h between the first endpoint a of the infrared imaging device 4 and the plane in which the optical axis 21 of the first lens group is located satisfies the following relationship: 10.5mm<h<10.7mm, the first endpoint being the point in the infrared imaging device 4 closest to the plane in which the optical axis 21 of the first lens group is located, for example, the vertical distance h can be 10.5mm, 10.6mm or 10.7mm, which can be reasonably set according to the actual eye tracking optical system 10.

[0119] The vertical distance w between the second endpoint of the infrared imaging device and the target plane of the first lens group 2 satisfies the following relationship: 4mm<w<5mm, the second endpoint being the point in the infrared imaging device 4 closest to the target plane, and the target plane being the plane in which the point in the first lens group 2 closest to the display panel 1 is located, the target plane being parallel to the display panel 1, for example, the vertical distance w can be 4mm, 4.2mm, 4.5mm, 4.8mm or 5mm, which can be reasonably set according to the actual eye tracking optical system 10.

[0120] Therefore, by describing the vertical distance between the infrared imaging device 4 and the optical axis and the first lens group 2 respectively, the position of the infrared imaging device 4 in the eye tracking optical system 10 can be located, and interference between the infrared imaging device 4 and the display panel 1 and the first lens group 2 can be avoided.

[0121] In some embodiments, the infrared imaging device 4 includes a second lens group;

[0122] The first endpoint of the second lens group has a vertical distance h from the plane in which the optical axis 21 of the first lens group is located, and the second endpoint of the second lens group has a vertical distance w from the target plane of the first lens group;

[0123] The infrared light has a set correspondence between the exit position and exit angle of the first lens group on the side close to the display panel and the vertical distance h and the vertical distance w.

[0124] It can be understood that the first end point of the second lens group and the first end point of the infrared imaging device 4 described above can be the same end point, and the second end point of the second lens group and the second end point of the infrared imaging device 4 can be the same end point.

[0125] It can be understood that the infrared imaging device 4 generally receives infrared light and images by using an internal sensor, and the second lens group can further fold the infrared light folded by the first lens group 2 to adapt to the imaging requirements of its own sensor. Therefore, after the model number and other parameters of the sensor are determined, the parameters of the second lens group can be set according to the parameters of the first lens group 2, including but not limited to lens shape, lens power, lens thickness, lens curvature radius, air gap between lenses, spatial position, etc. The following is an exemplary description of the correspondence between the spatial position of the second lens group and the first lens group.

[0126] It should be noted that based on the positional relationship of the infrared imaging device 4, the first lens group 2 and the display panel 1 described above, when the size, spatial position and other parameters of the display panel 1 are different, the spatial position of the infrared imaging device 4 will also be different, that is, the space of the second lens group will also be different. For example, if the height of the display panel 1 in the plane perpendicular to the optical axis 21 of the first lens group is greater, the vertical distance h between the first end point of the second lens group and the plane where the optical axis 21 of the first lens group is located will be greater. When the spatial position of the second lens group is different, the selection results of the light position and angle of the infrared light emitted from the first lens group by the second lens group can be different. For example: the human eye itself can reflect multiple light beams of different angles, such as reflecting multiple infrared light beams within the range of plus or minus 90 degrees relative to the center line of the human eye. Assuming that the second lens group has position a and selects the range of 0-5 degrees, the infrared light folded by the first lens group 2, assuming that the second lens group has position b and selects the range of 10-15 degrees, the infrared light folded by the first lens group 2. Among them, under the condition that the parameters of the first lens group 2 are determined, the exit position and exit angle of the infrared light of different angles on the side close to the display panel 1 of the first lens group 2 can also be determined. Thus, a set correspondence between the exit position and exit angle of the first lens group on the side close to the display panel and the vertical distance h and the vertical distance w can be established, for example, by data fitting to establish the correspondence.

[0127] Therefore, if the exit position and exit angle of the infrared light on the side of the first lens group 2 close to the display panel 1 changes, the vertical distance h and the vertical distance w can be compensated for parameters, so that the exit position and exit angle of the infrared light on the side of the first lens group 2 close to the display panel 1 and the vertical distance h and the vertical distance w still satisfy the set corresponding relationship, thereby not affecting the accuracy of the eye gaze point positioning result.

[0128] Of course, it can be understood that, in addition to establishing the corresponding relationship between the exit position and exit angle of the infrared light on the side of the first lens group close to the display panel and the vertical distance h and the vertical distance w in advance, the corresponding relationship between the exit position and exit angle of the infrared light on the side of the first lens group 2 close to the display panel 1 and the inclination angle between the optical axis of the second lens group and the optical axis of the first lens group 2 can also be established, and the principle is similar to the above, which will not be repeated here. Therefore, by establishing the corresponding relationship between the parameters of the first lens group and the parameters of the second lens group in advance, when any of the parameters of the first lens group and / or the parameters of the second lens group changes, the parameters are compensated based on the preset corresponding relationship, thereby not affecting the accuracy of the eye gaze point positioning result.

[0129] Referring to Figure 5 , a schematic diagram of the position relationship between the infrared light emitting device, the infrared imaging device and the display panel of the embodiment of the present disclosure is shown.

[0130] In some embodiments, the optical axis 41 of the infrared imaging device is inclined to the center of the display panel 1, and there is an intersection between the optical axis 41 of the infrared imaging device and the optical axis of the first lens group 2, so that the infrared light deflected by the first lens group 2 can better enter the infrared imaging device 4 for imaging, improving the imaging effect.

[0131] In some embodiments, the included angle a between the optical axis 41 of the infrared imaging device and the optical axis 21 of the first lens group is in the range of 3 degrees < a < 3.5 degrees, for example, 3 degrees, 3.2 degrees or 3.5 degrees; and / or the field of view angle of the infrared imaging device 4 is in the range of 10 degrees-30 degrees, for example, 10 degrees, 15 degrees, 20 degrees or 30 degrees.

[0132] In some embodiments, the light path field of view angle of the light emitted by the display panel 1 can be in the range of 50 degrees-60 degrees, for example, 50 degrees, 52 degrees, 55 degrees, 60 degrees, etc.

[0133] As Figure 5As shown, in some embodiments, the infrared light emitting device 3 is one or more, and the one or more infrared light emitting device 3 is arranged on the side of the first lens group 2 close to the display panel 1 or away from the display panel 1; or the first lens group 2 includes a plurality of lenses, and the one or more infrared light emitting device 3 is located between any two adjacent lenses in the plurality of lenses.

[0134] Referring to Figure 6 , a schematic diagram of a position of an infrared light emitting device according to an embodiment of the present disclosure is shown; referring to Figure 7 , another schematic diagram of a position of an infrared light emitting device according to an embodiment of the present disclosure is shown.

[0135] For example, the infrared light emitting device 3 can be an infrared LED lamp, and the infrared LED lamp can be multiple, for example, greater than or equal to 6, and the multiple infrared LED lamps can be arranged on the side of the display panel 1, or, as shown in Figure 1 , arranged on the side of the first lens group 2 close to the display panel 1, or, as shown in Figure 4 , arranged on the side of the first lens group 2 away from the display panel 1, or, as shown in Figure 6 and Figure 7 , arranged between any two lenses, and it can be understood that, in order not to affect the deflection function of the first lens group 2 to light, the LED lamp can be arranged on the edge of the first lens group 2. Thus, by uniformly emitting light through the multiple LED lamps, the human eye obtains uniform illumination.

[0136] Referring to Figure 8 , a structural schematic diagram of the first lens group according to an embodiment of the present disclosure is shown.

[0137] As shown in Figure 8As shown, in some embodiments, the first lens group 2 comprises a first lens 22, a second lens 23, a third lens 24, a fourth lens 25 and a fifth lens 26 arranged in sequence, the first lens 22 is away from the display panel 1, and the fifth lens 26 is close to the display panel 1; the first lens 22 has positive focal power, and the side (S1) away from the display panel 1 and the side (S2) close to the display panel 1 of the first lens 22 are convex; the second lens 23 has negative focal power, and the side (S3) away from the display panel 1 of the second lens 23 is convex, and the side (S4) close to the display panel 1 of the second lens 23 is concave; the third lens 24 and the fourth lens 25 have positive focal power, and the sides (S5 and S7) away from the display panel 1 and the sides (S6 and S8) close to the display panel 1 are convex; the fifth lens 26 has negative focal power, and the side (S9) away from the display panel 1 and the side (S10) close to the display panel 1 of the fifth lens 26 are concave.

[0138] It can be understood that the shapes of the lenses in the first lens group 2 interact with each other, the first lens 22 has positive focal power, so that the infrared light reflected by the human eye converges after reaching the first lens 22, thereby reducing the light angle of the infrared light reflected by the human eye; the second lens 23 has negative focal power, so that the infrared light deflected after passing through the first lens 22 diverges after reaching the second lens 23, thereby cooperating with the lenses behind to improve the imaging effect; the third lens 24 and the fourth lens 25 have positive focal power, so that the infrared light deflected after passing through the second lens 23 further converges after reaching the third lens 24 and the fourth lens 25, thereby correcting aberration; the fifth lens 26 has negative focal power, thereby realizing the divergence of light, meeting the imaging requirement, improving the imaging clarity, and being conducive to reducing the total length of the optical system and reducing the system volume. In addition, by reasonably designing the bending direction (i.e., convex or concave) of each lens of the first lens group 2, the angle turning difference of the infrared light after passing through adjacent lenses can be small, thereby making the tolerance of the entire optical system small, which is conducive to the assembly between the lenses.

[0139] Referring to Figure 9 , a structure schematic diagram of the second lens group of the embodiment of the present disclosure is shown.

[0140] As Figure 9In some embodiments, the infrared imaging device 4 comprises a second lens group, the second lens group comprises a sixth lens 42, a seventh lens 43 and an eighth lens 44 arranged in sequence, the sixth lens 42 is close to the first lens group 2, and the eighth lens 44 is away from the first lens group 2; the sixth lens 42 has a negative focal power, one side (S11) of the sixth lens 42 away from the first lens group 2 is convex, and one side (S12) of the sixth lens 42 close to the first lens group 2 is concave; the seventh lens 43 has a positive focal power, one side (S13) of the seventh lens 43 away from the first lens group 2 is convex, and one side (S14) of the seventh lens 43 close to the first lens group 2 is concave; the eighth lens 44 has a negative focal power, and one side (S15) of the eighth lens 44 away from the first lens group 2 and one side (S16) of the eighth lens 44 close to the first lens group 2 are concave.

[0141] It can be understood that the shapes of the lenses in the second lens group interact with each other, the sixth lens 42 has a negative focal power, so that the infrared light deflected by the fifth lens 26 is divergent after reaching the sixth lens 42, thereby cooperating with the lenses behind to improve the imaging effect; the seventh lens 43 has a positive focal power, which converges the infrared light deflected by the sixth lens 42, thereby reducing the angle of light; the eighth lens 44 has a negative focal power, which diverges the infrared light deflected by the seventh lens 43, thereby correcting aberration and improving imaging clarity.

[0142] In some embodiments, the infrared imaging device 4 comprises a second lens group; at least one of the first lens group 2 and the second lens group comprises a single lens, a multi-lens or a cemented lens, for example, the first lens group 2 and the second lens group comprise a multi-lens. And / or, the lenses of at least one of the first lens group 2 and the second lens group comprise a spherical surface, a cylindrical surface, a Fresnel surface or a free-form surface, for example, the S1 surface of the first lens 22 is a spherical surface or an aspherical surface, the S2 surface is a Fresnel surface, the S3 surface and the S4 surface of the second lens 23 are spherical surfaces or aspherical surfaces, the S5 surface and the S6 surface of the third lens 24 are spherical surfaces or aspherical surfaces, the S7 surface and the S8 surface of the fourth lens 25 are spherical surfaces or aspherical surfaces, and the S9 surface and the S10 surface of the fifth lens 26 are spherical surfaces or aspherical surfaces. And / or, the lens material of at least one of the first lens group 2 and the second lens group comprises plastic, glass or a mixed material of plastic and glass; and / or, the lens surface of at least one of the first lens group 2 and the second lens group is coated with an anti-reflection film.

[0143] In some embodiments, the first lens group 2 comprises a first lens 22, a second lens 23, a third lens 24, a fourth lens 25 and a fifth lens 26 arranged in sequence, the first lens 22 is away from the display panel 1, and the fifth lens 26 is close to the display panel 1; the focal lengths of the first lens 22 to the fifth lens 26 satisfy the following relationships:

[0144] 1<(f11+f12)×f1 / (f11×f12)<2;

[0145] 0.5<(f12+f13)×f1 / (f12×f13)<1;

[0146] 0.8<(f13+f14)×f1 / (f13×f14)<1;

[0147] 1<(f14+f15)×f1 / (f14×f15)<1.2;

[0148] Wherein, f11 represents the focal length of the first lens 22, f12 represents the focal length of the second lens 23, f13 represents the focal length of the third lens 24, f14 represents the focal length of the fourth lens 25, f15 represents the focal length of the fifth lens 26, and f1 represents the focal length of the first lens group 2.

[0149] For example, (f11+f12)×f1 / (f11×f12) can be any value in the range of (1, 2), for example, it can be 1.1, 1.2, 1.3, 1.4, 1.5, 1.6, 1.7, 1.8, 1.9, etc. (f12+f13)×f1 / (f12×f13) can be any value in the range of (0.5, 1), for example, it can be 0.6, 0.7, 0.8, 0.9, etc. (f13+f14)×f1 / (f13×f14) can be any value in the range of (0.8, 1), for example, it can be 0.85, 0.9, 0.95, etc. (f14+f15)×f1 / (f14×f15) can be any value in the range of (1, 2), for example, it can be 1.1, 1.3, 1.5, 1.7, 1.9, etc.

[0150] It can be understood that the focal length relationship between the lenses of the first lens group 2 affects the final imaging effect. By establishing the relationship between the focal lengths of the first lens 22 to the fifth lens 26, i.e. satisfying the conditional relationship, and reasonably configuring the focal lengths of the first lens 22 to the fifth lens 26, it is beneficial to correct aberration and mutual compensation, and can reduce lens sensitivity and lens processing difficulty.

[0151] In some embodiments, the first lens group 2 comprises a first lens 22, a second lens 23, a third lens 24, a fourth lens 25 and a fifth lens 26 arranged in sequence, the first lens 22 is away from the display panel 1, and the fifth lens 26 is close to the display panel 1; the thicknesses of the first lens 22 to the fifth lens 26 satisfy the following relationships in the direction of the optical axis 21 of the first lens group:

[0152] 1.5 < d1 / d2 < 2;

[0153] 0 < d2 / d3 < 0.5;

[0154] 0.5 < d3 / d4 < 1;

[0155] 3 < d4 / d5 < 3.3;

[0156] wherein d1 represents the thickness of the first lens 22, d2 represents the thickness of the second lens 23, d3 represents the thickness of the third lens 24, d4 represents the thickness of the fourth lens 25, and d5 represents the thickness of the fifth lens 26.

[0157] For example, d1 / d2 can be any value in the range of (1, 2), for example, it can be 1.1, 1.2, 1.3, 1.4, 1.5, 1.6, 1.7, 1.8, 1.9, etc. d2 / d3 can be any value in the range of (0, 0.5), for example, it can be 0.1, 0.2, 0.3, 0.4, etc. d3 / d4 can be any value in the range of (0.5, 1), for example, it can be 0.6, 0.7, 0.8, 0.9, etc. d4 / d5 can be any value in the range of (3, 3.3), for example, it can be 3.1, 3.2, etc.

[0158] It can be understood that the thickness relationship between the lenses of the first lens group 2 affects the total length of the system. By establishing the relationship between the thicknesses of the first lens 22 to the fifth lens 26, i.e. satisfying the conditional formula, and reasonably configuring the thicknesses of the first lens 22 to the fifth lens 26, it is beneficial to realize an optical system with a large field of view and a large exit pupil distance, and to reduce the total length of the optical system, thereby realizing the thinness and miniaturization of the near-eye display device.

[0159] In some embodiments, the first lens group 2 comprises a first lens 22, a second lens 23, a third lens 24, a fourth lens 25 and a fifth lens 26 arranged in sequence, the first lens 22 is away from the display panel 1, and the fifth lens 26 is close to the display panel 1; the radii of curvature of the first lens 22 to the fifth lens 26 satisfy the following relationships:

[0160] 9 < |(R11-R12) / (R11+R12)| < 9.5;

[0161] 0<|(R21-R22) / (R21+R22)|<0.5;

[0162] 11<|(R31-R32) / (R31+R32)|<12;

[0163] 1.5<|(R41-R42) / (R41+R42)|<2;

[0164] 7<|(R51-R52) / (R51+R52)|<7.5;

[0165] wherein R11 represents a radius of curvature of a side of the first lens 22 away from the display panel 1, R12 represents a radius of curvature of a side of the first lens 22 close to the display panel 1, R21 represents a radius of curvature of a side of the second lens 23 away from the display panel 1, R22 represents a radius of curvature of a side of the second lens 23 close to the display panel 1, R31 represents a radius of curvature of a side of the third lens 24 away from the display panel 1, R32 represents a radius of curvature of a side of the third lens 24 close to the display panel 1, R41 represents a radius of curvature of a side of the fourth lens 25 away from the display panel 1, R42 represents a radius of curvature of a side of the fourth lens 25 close to the display panel 1, R51 represents a radius of curvature of a side of the fifth lens 26 away from the display panel 1, and R52 represents a radius of curvature of a side of the fifth lens 26 close to the display panel 1.

[0166] For example, |(R11-R12) / (R11+R12)| can be any value in the range of (9, 9.5), for example, it can be 9.1, 9.2, 9.3, 9.4, etc. |(R21-R22) / (R21+R22)| can be any value in the range of (0, 0.5), for example, it can be 0.1, 0.2, 0.3, 0.4, etc. |(R31-R32) / (R31+R32)| can be any value in the range of (11, 12), for example, it can be 11.2, 11.3, 11.4, 11.6, 11.8, 11.9, etc. |(R41-R42) / (R41+R42)| can be any value in the range of (1.5, 2), for example, it can be 1.6, 1.7, 1.8, 1.9, etc.

[0167] It can be understood that the radius of curvature relationship between the lenses of the first lens group 2 affects the imaging effect. By establishing the relationship between the radii of curvature of the first lens 22 to the fifth lens 26, i.e. satisfying the condition formula, the radii of curvature of the first lens 22 to the fifth lens 26 are reasonably configured to achieve good imaging effect.

[0168] For the convenience of understanding, one of the parameter tables of the first lens group 2 of the embodiments of the present disclosure is shown in Table 1 below.

[0169] Table 1

[0170]

[0171] Exemplarily, the sag z of the aspherical surface of the optical lens can be represented by the following formula, but is not limited to only the following formula:

[0172]

[0173] wherein z is the sag of the aspherical surface at a position with a height of r along the optical axis direction from the vertex of the aspherical surface, c represents the curvature of the paraxial surface, ε represents the conic constant, ρ is the radius of the aspherical surface, and the value range of ρ is 0≤ρ≤ρ max , u=ρ / ρ max represents the normalized coordinate, -1≤u≤1, α m represents the high-order coefficient of the aspherical surface, α m =α1, α2, α3, represents the orthogonal polynomial, D con represents the set parameter, used for simplifying the expression, and M represents the set maximum coefficient.

[0174] Exemplarily, Table 2 is the high-order term data of the aspherical surface.

[0175] Table 2

[0176]

[0177] In some embodiments, the infrared imaging device 4 comprises a second lens group, the second lens group comprises a sixth lens 42, a seventh lens 43 and an eighth lens 44 arranged in sequence, the sixth lens 42 is close to the first lens group 2, and the eighth lens 44 is away from the first lens group 2; the focal lengths of the sixth lens 42 to the eighth lens 44 satisfy the following relationships:

[0178] 21<(f26+f27)×f2 / (f26×f27)<21.5;

[0179] 20<(f27+f28)×f2 / (f27×f28)<20.5;

[0180] wherein f26 represents the focal length of the sixth lens 42, f27 represents the focal length of the seventh lens 43, f28 represents the focal length of the eighth lens 44, and f2 represents the focal length of the second lens group.

[0181] For example, (f26+f27) x f2 / (f26 x f27) can be any value in the range of (21, 21.5), for example, can be 21.1, 21.2, 21.3, 21.4, etc. (f27+f28) x f2 / (f27 x f28) can be any value in the range of (20, 20.5), for example, can be 20.1, 20.2, 20.3, 20.4, etc.

[0182] It can be understood that the focal length relationship between the lenses of the second lens group affects the imaging effect. By establishing the relationship between the focal lengths of the sixth lens 42 to the eighth lens 44, i.e., satisfying the condition formula, and reasonably configuring the focal lengths of the sixth lens 42 to the eighth lens 44, it is beneficial to correct aberration and mutual compensation, and can reduce lens sensitivity and lens processing difficulty.

[0183] In some embodiments, the infrared imaging device 4 includes a second lens group, the second lens group includes a sixth lens 42, a seventh lens 43 and an eighth lens 44 arranged in sequence, the sixth lens 42 is close to the first lens group 2, and the eighth lens 44 is away from the first lens group 2; In the direction of the optical axis of the second lens group, the thicknesses of the sixth lens 42 to the eighth lens 44 satisfy the following relationships:

[0184] 2.5 < d6 / d7 < 3;

[0185] 2.5 < d7 / d8 < 3;

[0186] Wherein, d6 represents the thickness of the sixth lens 42, d7 represents the thickness of the seventh lens 43, and d8 represents the thickness of the eighth lens 44.

[0187] For example, d6 / d7 can be any value in the range of (2.5, 3), for example, can be 2.6, 2.7, 2.8, 2.9, etc. d7 / d8 can be any value in the range of (2.5, 3), for example, can be 2.6, 2.7, 2.8, 2.9, etc. It can be understood that the thickness relationship between the lenses of the second lens group affects the total length of the system. By establishing the relationship between the thicknesses of the sixth lens 42 to the eighth lens 44, i.e., satisfying the condition formula, and reasonably configuring the thicknesses of the sixth lens 42 to the eighth lens 44, it is beneficial to realize the optical system of large field of view and large exit pupil distance, and beneficial to reduce the total length of the optical system, and realize the thinness and miniaturization of the near-eye display device.

[0188] In some embodiments, the infrared imaging device 4 includes a second lens group, which includes a sixth lens 42, a seventh lens 43, and an eighth lens 44 arranged in sequence, the sixth lens 42 is close to the first lens group 2, and the eighth lens 44 is far away from the first lens group 2; the curvature radii of the sixth lens 42 to the eighth lens 44 satisfy the following relationship:

[0189] 0.1<|(R61-R62) / (R61+R62)|<0.5;

[0190] 0.5<|(R71-R72) / (R71+R72)|<1;

[0191] 0<|(R81-R82) / (R81+R82)|<0.5;

[0192] Among them, R61 represents the curvature radius of the sixth lens 42 on the side close to the first lens group 2, R62 represents the curvature radius of the sixth lens 42 on the side away from the first lens group 2, R71 represents the curvature radius of the seventh lens 43 on the side close to the first lens group 2, R72 represents the curvature radius of the seventh lens 43 on the side away from the first lens group 2, R81 represents the curvature radius of the eighth lens 44 on the side close to the first lens group 2, and R82 represents the curvature radius of the eighth lens 44 on the side away from the first lens group 2.

[0193] For example, |(R61-R62) / (R61+R62)| can be any value within the range of (0.1, 0.5), such as 0.2, 0.3, 0.4, etc. |(R71-R72) / (R71+R72) can be any value within the range of (0.5, 1), such as 0.6, 0.7, 0.8, etc. |(R81-R82) / (R81+R82)| can be any value within the range of (0, 0.5), such as 0.1, 0.2, 0.3, 0.4, etc.

[0194] It is understandable that the relationship between the curvature radii of the lenses of the second lens group affects the imaging effect. By establishing a relationship between the curvature radii of the sixth lens 42 to the eighth lens 44, that is, a relationship that satisfies a conditional expression, the curvature radii of the sixth lens 42 to the eighth lens 44 are reasonably configured to achieve a good imaging effect.

[0195] For ease of understanding, Table 3 below shows one parameter table of the second lens group of an embodiment of the present disclosure.

[0196]

[0197] For example, the spherical equation of an optical lens may be in the following form:

[0198]

[0199] Where Z(x) is the distance vector from the vertex of the sphere when the sphere is at a height of r along the optical axis, x represents the radius of the aspheric surface, c represents the curvature of the paraxial surface, and k represents the conic coefficient.

[0200] In some embodiments, the first lens group 2 includes a first lens 22, a second lens 23, a third lens 24, a fourth lens 25, and a fifth lens 26 arranged in sequence, wherein the first lens 22 is away from the display panel 1, and the fifth lens 26 is close to the display panel 1;

[0201] The infrared imaging device 4 includes a second lens group 23 and a sensor. The second lens group 23 includes a sixth lens 42, a seventh lens 43, and an eighth lens 44 arranged in sequence. The sixth lens 42 is close to the fifth lens 26, and the eighth lens 44 is far away from the fifth lens 26. The sensor is arranged on a side of the eighth lens 44 away from the fifth lens 26.

[0202] In a direction perpendicular to the display panel 1 , the air gap between the first lens 22 and the eighth lens 44 satisfies the following relationship:

[0203] 0 <DT1 / DT2<0.1;

[0204] 0 <DT3 / DT4<0.5;

[0205] 0.1 <DT5 / DT6<0.2;

[0206] 1 <DT6 / DT7<1.2;

[0207] 2 <DT7 / DT8<2.5;

[0208] Among them, DT1 represents the air gap between the first lens 22 and the second lens 23, DT2 represents the air gap between the second lens 23 and the third lens 24, DT3 represents the air gap between the third lens 24 and the fourth lens 25, DT4 represents the air gap between the fourth lens 25 and the fifth lens 26, DT5 represents the air gap between the fifth lens 26 and the display panel 1, DT6 represents the air gap between the sixth lens 42 and the seventh lens 43, DT7 represents the air gap between the seventh lens 43 and the eighth lens 44, and DT8 represents the air gap between the eighth lens 44 and the sensor.

[0209] For example, DT1 / DT2 can be any value in the range of (0, 0.1), such as 0.01, 0.02, 0.05, 0.08, 0.09, etc. DT3 / DT4 can be any value in the range of (0, 0.5), such as 0.1, 0.2, 0.3, 0.4, etc. DT5 / DT6 can be any value in the range of (0.1, 0.2), such as 0.12, 0.14, 0.15, 0.16, 0.18, 0.19, etc. DT6 / DT7 can be any value in the range of (1, 1.2), such as 1.05, 1.06, 1.08, 1.1, 1.15, etc.

[0210] It can be understood that by establishing an air gap relationship between the first lens group 2, the display panel 1, and the second lens group 23, that is, a relationship that satisfies the conditional expression, and rationally configuring the distance between two adjacent lenses from the first lens 22 to the eighth lens 44, it is beneficial to reduce the total length of the optical system and make the system miniaturized.

[0211] See also Figure 10 , which shows a schematic structural diagram of a display device 20 according to an embodiment of the present disclosure.

[0212] A second aspect of an embodiment of the present disclosure provides a display device 20 , comprising a display panel 1 and an eye-tracking optical system 10 as described in any one of the first aspects.

[0213] The display device 20 provided in the embodiment of the present application may be a VR, AR, MR, XR or other near-eye display device, and the embodiment of the present application does not specifically limit this.

[0214] In some embodiments, the display device 20 further includes a housing 201 , and the display panel 1 , the first lens group 2 , the infrared light emitting device 3 , and the infrared imaging device 4 are located in the housing 201 ;

[0215] The optical axis 21 of the first lens group is perpendicular to the display panel 1 and is located on the same straight line as the center of the display panel 1;

[0216] A vertical distance h between the first endpoint of the infrared imaging device 4 and the plane where the optical axis 21 of the first lens group is located is greater than half the height of the display panel 1, and a vertical distance h between the infrared imaging device 4 and the plane where the optical axis 21 of the first lens group is located is less than a vertical distance between the first side 202 of the housing 201 and the plane where the optical axis 21 of the first lens group is located;

[0217] The vertical distance w between the second end point of the infrared imaging device 4 and the target plane of the first lens group 2 is less than the vertical distance w between the target plane of the first lens group 2 and the second side 203 of the housing 201.

[0218] Therefore, by describing the positional relationship between the infrared imaging device 4 and the optical axis 21 of the first lens group, the first lens group 2 and the housing 201 respectively, the position of the infrared imaging device 4 in the eye tracking optical system 10 can be located, and interference between the infrared imaging device 4 and the display panel 1, the first lens group 2 and the housing 201 can be avoided.

[0219] The display device 20 provided by the embodiments of the present disclosure emits infrared light to the human eye through the infrared light emitting device 3, the first lens group 2 is arranged on the light emitting side of the display panel, the side of the first lens group 2 away from the display panel 1 is used to converge the infrared light reflected by the human eye, so as to reduce the light angle of the infrared light reflected by the human eye, and the side of the first lens group 2 close to the display panel 1 is used to diverge the infrared light, so as to improve the imaging clarity; the infrared imaging device 3 is arranged on the side of the first lens group 2 close to the display panel 1, and the imaging surface of the infrared imaging device 4 faces the first lens group 2, the infrared light reflected by the human eye is deflected after passing through the first lens group 2 and is incident on the infrared imaging device. Therefore, by reasonable arrangement of the first lens group 2 and the infrared imaging device 4, the volume of the eye tracking optical system 10 is reduced, and the thinning of the near-eye display product is realized.

[0220] In the above description, the technical details such as the arrangement of each layer of the product are not described in detail. However, those skilled in the art should understand that the layers, regions and the like with the required shape can be formed by various technical means. Although each embodiment is described above, this does not mean that the measures in each embodiment cannot be used advantageously in combination.

[0221] In addition, those skilled in the art should understand that the discussion of any of the above embodiments is only exemplary and is not intended to imply that the scope of the present disclosure is limited to these examples; under the idea of the present disclosure, the above embodiments or technical features between different embodiments can also be combined, the steps can be implemented in any order, and there are many other changes of different aspects of one or more embodiments of the present disclosure as described above. In order to be brief, they are not provided in detail.

[0222] Although the preferred embodiments of the present disclosure have been described, those skilled in the art can make further changes and modifications to these embodiments once they understand the basic creative concept. Therefore, the appended claims are intended to include the preferred embodiments and all changes and modifications falling within the scope of the present disclosure.

Claims

1. An eye tracking optical system, characterized in that: Comprising: An infrared light emitting device for emitting infrared light towards the human eye; A first lens group for being disposed on the light-emitting side of the display panel. The side of the first lens group away from the display panel is for converging the infrared light reflected by the human eye, and the side of the first lens group close to the display panel is for diverging the infrared light deflected by the first lens group; An infrared imaging device disposed on the side of the first lens group close to the display panel, and the imaging surface of the infrared imaging device faces the first lens group. The infrared light reflected by the human eye is deflected after passing through the first lens group and is incident on the infrared imaging device; The first lens group includes a first lens, a second lens, a third lens, a fourth lens, and a fifth lens arranged in sequence. The first lens is away from the display panel, and the fifth lens is close to the display panel; The first lens has a positive optical power, and both the side of the first lens away from the display panel and the side close to the display panel are convex surfaces; The second lens has a negative optical power, the side of the second lens away from the display panel is a convex surface, and the side of the second lens close to the display panel is a concave surface; The third lens and the fourth lens have positive optical powers, and both the side away from the display panel and the side close to the display panel are convex surfaces; The fifth lens has a negative optical power, and both the side of the fifth lens away from the display panel and the side close to the display panel are concave surfaces.

2. The eye-tracking optical system according to claim 1, wherein: The infrared imaging device is for being disposed on the periphery of the display panel, and the imaging surface of the infrared imaging device is substantially located in the same plane as the display panel.

3. The eye-tracking optical system according to claim 1, wherein: The plane where the optical axis of the first lens group is located is perpendicular to the display panel; The vertical distance h between the first end point of the infrared imaging device and the plane where the optical axis of the first lens group is located satisfies the following relationship: 10.5 mm < h < 10.7 mm. The first end point is the point on the infrared imaging device closest to the plane where the optical axis of the first lens group is located; The vertical distance w between the second end point of the infrared imaging device and the target plane of the first lens group satisfies the following relationship: 4 mm < w < 5 mm. The second end point is the point on the infrared imaging device closest to the target plane. The target plane is the plane where the point closest to the display panel in the first lens group is located, and the target plane is parallel to the display panel; 4. The eye-tracking optical system according to claim 1, wherein: The infrared imaging device includes a second lens group; There is a vertical distance h between the first end point of the second lens group and the plane where the optical axis of the first lens group is located, and there is a vertical distance w between the second end point of the second lens group and the target plane of the first lens group; There is a set corresponding relationship between the exit position and exit angle of the infrared light on the side of the first lens group close to the display panel and the vertical distance h and the vertical distance w.

5. The eye-tracking optical system according to claim 1, wherein: The optical axis of the infrared imaging device is tilted toward the center of the display panel, and the optical axis of the infrared imaging device intersects with the optical axis of the first lens group.

6. The eye-tracking optical system according to claim 5, wherein: The value range of the angle α between the optical axis of the infrared imaging device and the optical axis of the first lens group is: 3 degrees < α < 3.5 degrees.

7. The eye-tracking optical system according to claim 1, wherein: There are one or more infrared light emitting devices, and the one or more infrared light emitting devices are arranged on a side of the first lens group close to the display panel or a side away from the display panel; or The first lens group includes a plurality of lenses, and the one or more infrared light emitting devices are located between two adjacent lenses among the plurality of lenses.

8. The eye-tracking optical system according to claim 1, wherein: The infrared imaging device includes a second lens group, the second lens group includes a sixth lens, a seventh lens, and an eighth lens arranged in sequence, the sixth lens is close to the first lens group, and the eighth lens is far away from the first lens group; The sixth lens has negative optical power, a side of the sixth lens away from the first lens group is convex, and a side of the sixth lens close to the first lens group is concave; The seventh lens has positive refractive power, the side of the seventh lens away from the first lens group is convex, and the side of the seventh lens close to the first lens group is concave; The eighth lens has negative refractive power, and a side of the eighth lens away from the first lens group and a side of the eighth lens close to the first lens group are concave surfaces.

9. The eye-tracking optical system according to claim 1, wherein: The first lens group includes a first lens, a second lens, a third lens, a fourth lens, and a fifth lens arranged in sequence, the first lens is away from the display panel, and the fifth lens is close to the display panel; The focal lengths of the first lens to the fifth lens satisfy the following relationship: 1<(f11+f12)×f1 / (f11×f12)<2; 0.5<(f12+f13)×f1 / (f12×f13)<1; 0.8<(f13+f14)×f1 / (f13×f14)<1; 1<(f14+f15)×f1 / (f14×f15)<1.2; Among them, f11 represents the focal length of the first lens, f12 represents the focal length of the second lens, f13 represents the focal length of the third lens, f14 represents the focal length of the fourth lens, f15 represents the focal length of the fifth lens, and f1 represents the focal length of the first lens group.

10. The eye-tracking optical system according to claim 1, wherein: The first lens group includes a first lens, a second lens, a third lens, a fourth lens, and a fifth lens arranged in sequence, the first lens is away from the display panel, and the fifth lens is close to the display panel; Along the optical axis of the first lens group, the thicknesses of the first lens to the fifth lens satisfy the following relationship: 1.5 <d1 / d2<2; 0 <d2 / d3<0.5; 0.5 <d3 / d4<1; 3 <d4 / d5<3.3; Wherein, d1 represents the thickness of the first lens, d2 represents the thickness of the second lens, d3 represents the thickness of the third lens, d4 represents the thickness of the fourth lens, and d5 represents the thickness of the fifth lens.

11. The eye-tracking optical system according to claim 1, wherein: The first lens group includes a first lens, a second lens, a third lens, a fourth lens, and a fifth lens arranged in sequence, the first lens is away from the display panel, and the fifth lens is close to the display panel; The curvature radii of the first lens to the fifth lens satisfy the following relationship: 9<|(R11-R12) / (R11+R12)|<9.5; 0<|(R21-R22) / (R21+R22)|<0.5; 11<|(R31-R32) / (R31+R32)|<12; 1.5<|(R41-R42) / (R41+R42)|<2; 7<|(R51-R52) / (R51+R52)|<7.5; Among them, R11 represents the curvature radius of the first lens away from the display panel, R12 represents the curvature radius of the first lens close to the display panel, R21 represents the curvature radius of the second lens away from the display panel, R22 represents the curvature radius of the second lens close to the display panel, R31 represents the curvature radius of the third lens away from the display panel, R32 represents the curvature radius of the third lens close to the display panel, R41 represents the curvature radius of the fourth lens away from the display panel, R42 represents the curvature radius of the fourth lens close to the display panel, R51 represents the curvature radius of the fifth lens away from the display panel, and R52 represents the curvature radius of the fifth lens close to the display panel.

12. The eye tracking optical system according to any one of claims 1 to 11, wherein: The infrared imaging device includes a second lens group, the second lens group includes a sixth lens, a seventh lens, and an eighth lens arranged in sequence, the sixth lens is close to the first lens group, and the eighth lens is far away from the first lens group; The focal lengths of the sixth lens to the eighth lens satisfy the following relationship: 21<(f26+f27)×f2 / (f26×f27)<21.5; 20<(f27+f28)×f2 / (f27×f28)<20.5; Wherein, f26 represents the focal length of the sixth lens, f27 represents the focal length of the seventh lens, f28 represents the focal length of the eighth lens, and f2 represents the focal length of the second lens group.

13. The eye tracking optical system according to any one of claims 1 to 11, wherein: The infrared imaging device includes a second lens group, the second lens group includes a sixth lens, a seventh lens, and an eighth lens arranged in sequence, the sixth lens is close to the first lens group, and the eighth lens is far away from the first lens group; Along the optical axis direction of the second lens group, the thicknesses of the sixth lens to the eighth lens satisfy the following relationship: 2.5 <d6 / d7<3; 2.5 <d7 / d8<3; Wherein, d6 represents the thickness of the sixth lens, d7 represents the thickness of the seventh lens, and d8 represents the thickness of the eighth lens.

14. The eye-tracking optical system according to any one of claims 1 to 11, wherein: The infrared imaging device includes a second lens group, the second lens group includes a sixth lens, a seventh lens, and an eighth lens arranged in sequence, the sixth lens is close to the first lens group, and the eighth lens is far away from the first lens group; The curvature radii of the sixth lens to the eighth lens satisfy the following relationship: 0.1<|(R61-R62) / (R61+R62)|<0.5; 0.5<|(R71-R72) / (R71+R72)|<1; 0<|(R81-R82) / (R81+R82)|<0.5; Among them, R61 represents the curvature radius of the sixth lens close to the first lens group, R62 represents the curvature radius of the sixth lens away from the first lens group, R71 represents the curvature radius of the seventh lens close to the first lens group, R72 represents the curvature radius of the seventh lens away from the first lens group, R81 represents the curvature radius of the eighth lens close to the first lens group, and R82 represents the curvature radius of the eighth lens away from the first lens group.

15. The eye-tracking optical system according to claim 1, wherein: The first lens group includes a first lens, a second lens, a third lens, a fourth lens, and a fifth lens arranged in sequence, the first lens is away from the display panel, and the fifth lens is close to the display panel; The infrared imaging device includes a second lens group and a sensor, the second lens group includes a sixth lens, a seventh lens, and an eighth lens arranged in sequence, the sixth lens is close to the fifth lens, the eighth lens is far away from the fifth lens, and the sensor is arranged on a side of the eighth lens away from the fifth lens; In a direction perpendicular to the display panel, the air gap between the first lens and the eighth lens satisfies the following relationship: 0 <DT1 / DT2<0.1; 0 <DT3 / DT4<0.5; 0.1 <DT5 / DT6<0.2; 1 <DT6 / DT7<1.2; 2 <DT7 / DT8<2.5; Wherein, DT1 represents the air gap between the first lens and the second lens, DT2 represents the air gap between the second lens and the third lens, DT3 represents the air gap between the third lens and the fourth lens, DT4 represents the air gap between the fourth lens and the fifth lens, DT5 represents the air gap between the fifth lens and the display panel, DT6 represents the air gap between the sixth lens and the seventh lens, DT7 represents the air gap between the seventh lens and the eighth lens, and DT8 represents the air gap between the eighth lens and the sensor.

16. A display device, characterized in that: include: Display panel; An eye-tracking optical system according to any one of claims 1 to 15.

17. The display device according to claim 16, wherein: It also includes a housing, wherein the display panel, the first lens group, the infrared light emitting device and the infrared imaging device are located in the housing; The optical axis of the first lens group is perpendicular to the display panel and is located on the same straight line as the center of the display panel; A vertical distance between a first endpoint of the infrared imaging device and a plane on which the optical axis of the first lens group is located is greater than half the height of the display panel, and a vertical distance between the infrared imaging device and the plane on which the optical axis of the first lens group is located is less than a vertical distance between a first side of the housing and the plane on which the optical axis of the first lens group is located; A vertical distance between the second endpoint of the infrared imaging device and the target plane of the first lens group is smaller than a vertical distance between the target plane of the first lens group and the second side of the housing.

Images