Eyeball tracking optical system and display device

Abstract

The invention provides an eyeball tracking optical system and a display device. The eyeball tracking optical system comprises an infrared light emitting device, a first lens group and an infrared imaging device. Wherein the infrared light emitting device is used for emitting infrared light to human eyes; the first lens group is used for being arranged on the light emitting side of the display panel, the side, away from the display panel, of the first lens group is used for converging infrared light reflected by human eyes, and the side, close to the display panel, of the first lens group is used for diverging the infrared light deflected by the first lens group; the infrared imaging device is arranged on the side, close to the display panel, of the first lens set, and the imaging face of the infrared imaging device faces the first lens set. Infrared light reflected by human eyes is deflected after passing through the first lens group, and is incident to the infrared imaging device.

Description

Technical Field

[0001] The present disclosure relates to the field of display technology, and in particular to an eye-tracking optical system and a display device. Background Art

[0002] In the near-eye display technologies such as VR (Virtual Reality), AR (Augmented Reality) and XR (Extended Reality) in the consumer electronics industry, some display products have eye tracking functions, that is, the infrared light emitted by the infrared light emitting device is reflected by the human eye, and the eye information carried by the light is transmitted to the infrared imaging device, so that the user's eye gaze point on the screen is obtained through data processing.

[0003] In the related art, some eye tracking display products place an infrared light emitting device and an infrared imaging device in front of the screen, and use a semi-reflective and semi-transparent flat panel placed in front of the screen to reflect the infrared light and allow the infrared imaging device to receive it. However, the design of the semi-reflective and semi-transparent flat panel requires a larger space for the display product. Summary of the invention

[0004] A first aspect of the present disclosure provides an eye tracking optical system, comprising:

[0005] An infrared light emitting device, the infrared light emitting device is used to emit infrared light to human eyes;

[0006] a first lens group, the first lens group being used to be arranged on the light exiting side of the display panel, the side of the first lens group away from the display panel being used to converge the infrared light reflected by the human eye, and the side of the first lens group close to the display panel being used to diverge the infrared light deflected by the first lens group;

[0007] An infrared imaging device, wherein the infrared imaging device is arranged on a side of the first lens group close to the display panel, and the imaging surface of the infrared imaging device faces the first lens group, and the infrared light reflected by the human eye is deflected after passing through the first lens group and is incident on the infrared imaging device.

[0008] Optionally, the infrared imaging device is used to be arranged on the peripheral side of the display panel, and the imaging surface of the infrared imaging device is basically located in the same plane as the display panel.

[0009] Optionally, the plane where the optical axis of the first lens group is located is perpendicular to the display panel;

[0010] The vertical distance h between the first end point of the infrared imaging device and the plane where the optical axis of the first lens group is located satisfies the following relationship: 10.5 mm < h < 10.7 mm, and the first end point is the point on the infrared imaging device closest to the plane where the optical axis of the first lens group is located;

[0011] The vertical distance w between the second end point of the infrared imaging device and the target plane of the first lens group satisfies the following relationship: 4 mm < w < 5 mm. The second end point is the point on the infrared imaging device closest to the target plane, and the target plane is the plane where the point closest to the display panel in the first lens group is located, and the target plane is parallel to the display panel.

[0012] Optionally, the infrared imaging device includes a second lens group;

[0013] The first end point of the second lens group has a vertical distance h from the plane where the optical axis of the first lens group is located, and the second end point of the second lens group has a vertical distance w from the target plane of the first lens group;

[0014] There is a set corresponding relationship between the exit position and exit angle of the infrared light on the side of the first lens group close to the display panel and the vertical distance h and the vertical distance w.

[0015] Optionally, the optical axis of the infrared imaging device is inclined towards the center of the display panel, and there is an intersection between the optical axis of the infrared imaging device and the optical axis of the first lens group.

[0016] Optionally, the value range of the included angle α between the optical axis of the infrared imaging device and the optical axis of the first lens group is: 3 degrees < α < 3.5 degrees.

[0017] Optionally, the infrared light emitting device is one or more, and the one or more infrared light emitting devices are arranged on the side of the first lens group close to the display panel or on the side away from the display panel; or

[0018] The first lens group includes a plurality of lenses, and the one or more infrared light emitting devices are located between two adjacent lenses among the plurality of lenses.

[0019] Optionally, the first lens group includes a first lens, a second lens, a third lens, a fourth lens, and a fifth lens arranged in sequence. The first lens is away from the display panel, and the fifth lens is close to the display panel;

[0020] The first lens has a positive optical power, and both the side of the first lens away from the display panel and the side close to the display panel are convex surfaces;

[0021] The second lens has negative optical power, a side of the second lens away from the display panel is a convex surface, and a side of the second lens close to the display panel is a concave surface;

[0022] The third lens and the fourth lens have positive refractive power, and a side away from the display panel and a side close to the display panel are convex surfaces;

[0023] The fifth lens has negative optical power, and a side of the fifth lens away from the display panel and a side of the fifth lens close to the display panel are concave surfaces.

[0024] Optionally, the infrared imaging device includes a second lens group, the second lens group includes a sixth lens, a seventh lens and an eighth lens arranged in sequence, the sixth lens is close to the first lens group, and the eighth lens is far away from the first lens group;

[0025] The sixth lens has negative optical power, a side of the sixth lens away from the first lens group is a convex surface, and a side of the sixth lens close to the first lens group is a concave surface;

[0026] The seventh lens has positive refractive power, a side of the seventh lens away from the first lens group is convex, and a side of the seventh lens close to the first lens group is concave;

[0027] The eighth lens has negative refractive power, and a side of the eighth lens away from the first lens group and a side of the eighth lens close to the first lens group are concave surfaces.

[0028] Optionally, the infrared imaging device includes a second lens group;

[0029] At least one of the first lens group and the second lens group includes a single lens, a multi-lens, or a cemented lens; and / or

[0030] The lens of at least one of the first lens group and the second lens group comprises a spherical surface, a cylindrical surface, a Fresnel surface or a free-form surface; and / or

[0031] The lens material of at least one of the first lens group and the second lens group includes plastic, glass, or a mixed material of plastic and glass; and / or

[0032] An anti-reflection film is coated on a lens surface of at least one of the first lens group and the second lens group.

[0033] Optionally, the first lens group includes a first lens, a second lens, a third lens, a fourth lens and a fifth lens which are arranged in sequence, the first lens is far away from the display panel, and the fifth lens is close to the display panel;

[0034] The focal lengths of the first lens to the fifth lens satisfy the following relationship:

[0035] 1<(f11+f12)×f1 / (f11×f12)<2;

[0036] 0.5<(f12+f13)×f1 / (f12×f13)<1;

[0037] 0.8<(f13+f14)×f1 / (f13×f14)<1;

[0038] 1<(f14+f15)×f1 / (f14×f15)<1.2;

[0039] Among them, f11 represents the focal length of the first lens, f12 represents the focal length of the second lens, f13 represents the focal length of the third lens, f14 represents the focal length of the fourth lens, f15 represents the focal length of the fifth lens, and f1 represents the focal length of the first lens group.

[0040] Optionally, the first lens group includes a first lens, a second lens, a third lens, a fourth lens and a fifth lens which are arranged in sequence, the first lens is far away from the display panel, and the fifth lens is close to the display panel;

[0041] Along the optical axis direction of the first lens group, the thicknesses of the first lens to the fifth lens satisfy the following relationship:

[0042] 1.5 <d1 / d2<2;

[0043] 0 <d2 / d3<0.5;

[0044] 0.5 <d3 / d4<1;

[0045] 3 <d4 / d5<3.3;

[0046] Wherein, d1 represents the thickness of the first lens, d2 represents the thickness of the second lens, d3 represents the thickness of the third lens, d4 represents the thickness of the fourth lens, and d5 represents the thickness of the fifth lens.

[0047] Optionally, the first lens group includes a first lens, a second lens, a third lens, a fourth lens and a fifth lens which are arranged in sequence, the first lens is far away from the display panel, and the fifth lens is close to the display panel;

[0048] The curvature radii of the first lens to the fifth lens satisfy the following relationship:

[0049] 9<|(R11-R12) / (R11+R12)|<9.5;

[0050] 0<|(R21-R22) / (R21+R22)|<0.5;

[0051] 11<|(R31-R32) / (R31+R32)|<12;

[0052] 1.5<|(R41-R42) / (R41+R42)|<2;

[0053] 7<|(R51-R52) / (R51+R52)|<7.5;

[0054] Among them, R11 represents the curvature radius of the side of the first lens away from the display panel, R12 represents the curvature radius of the side of the first lens close to the display panel, R21 represents the curvature radius of the side of the second lens away from the display panel, R22 represents the curvature radius of the side of the second lens close to the display panel, R31 represents the curvature radius of the side of the third lens away from the display panel, R32 represents the curvature radius of the side of the third lens close to the display panel, R41 represents the curvature radius of the side of the fourth lens away from the display panel, R42 represents the curvature radius of the side of the fourth lens close to the display panel, R51 represents the curvature radius of the side of the fifth lens away from the display panel, and R52 represents the curvature radius of the side of the fifth lens close to the display panel.

[0055] Optionally, the infrared imaging device includes a second lens group, the second lens group includes a sixth lens, a seventh lens and an eighth lens arranged in sequence, the sixth lens is close to the first lens group, and the eighth lens is far away from the first lens group;

[0056] The focal lengths of the sixth lens to the eighth lens satisfy the following relationship:

[0057] 21<(f26+f27)×f2 / (f26×f27)<21.5;

[0058] 20<(f27+f28)×f2 / (f27×f28)<20.5;

[0059] Among them, f26 represents the focal length of the sixth lens, f27 represents the focal length of the seventh lens, f28 represents the focal length of the eighth lens, and f2 represents the focal length of the second lens group.

[0060] Optionally, the infrared imaging device includes a second lens group, the second lens group includes a sixth lens, a seventh lens and an eighth lens arranged in sequence, the sixth lens is close to the first lens group, and the eighth lens is far away from the first lens group;

[0061] Along the optical axis direction of the second lens group, the thicknesses of the sixth lens to the eighth lens satisfy the following relationship:

[0062] 2.5 <d6 / d7<3;

[0063] 2.5 <d7 / d8<3;

[0064] Wherein, d6 represents the thickness of the sixth lens, d7 represents the thickness of the seventh lens, and d8 represents the thickness of the eighth lens.

[0065] Optionally, the infrared imaging device includes a second lens group, the second lens group includes a sixth lens, a seventh lens and an eighth lens arranged in sequence, the sixth lens is close to the first lens group, and the eighth lens is far away from the first lens group;

[0066] The curvature radii of the sixth lens to the eighth lens satisfy the following relationship:

[0067] 0.1<|(R61-R62) / (R61+R62)|<0.5;

[0068] 0.5<|(R71-R72) / (R71+R72)|<1;

[0069] 0<|(R81-R82) / (R81+R82)|<0.5;

[0070] Among them, R61 represents the curvature radius of the sixth lens close to the first lens group, R62 represents the curvature radius of the sixth lens away from the first lens group, R71 represents the curvature radius of the seventh lens close to the first lens group, R72 represents the curvature radius of the seventh lens away from the first lens group, R81 represents the curvature radius of the eighth lens close to the first lens group, and R82 represents the curvature radius of the eighth lens away from the first lens group.

[0071] Optionally, the first lens group includes a first lens, a second lens, a third lens, a fourth lens and a fifth lens which are arranged in sequence, the first lens is far away from the display panel, and the fifth lens is close to the display panel;

[0072] The infrared imaging device comprises a second lens group and a sensor, the second lens group comprises a sixth lens, a seventh lens and an eighth lens arranged in sequence, the sixth lens is close to the fifth lens, the eighth lens is far away from the fifth lens, and the sensor is arranged on a side of the eighth lens far away from the fifth lens;

[0073] In a direction perpendicular to the display panel, the air gap between the first lens and the eighth lens satisfies the following relationship:

[0074] 0 <DT1 / DT2<0.1;

[0075] 0 <DT3 / DT4<0.5;

[0076] 0.1 <DT5 / DT6<0.2;

[0077] 1 <DT6 / DT7<1.2;

[0078] 2 <DT7 / DT8<2.5;

[0079] Among them, DT1 represents the air gap between the first lens and the second lens, DT2 represents the air gap between the second lens and the third lens, DT3 represents the air gap between the third lens and the fourth lens, DT4 represents the air gap between the fourth lens and the fifth lens, DT5 represents the air gap between the fifth lens and the display panel, DT6 represents the air gap between the sixth lens and the seventh lens, DT7 represents the air gap between the seventh lens and the eighth lens, and DT8 represents the air gap between the eighth lens and the sensor.

[0080] A second aspect of the present disclosure provides a display device, including:

[0081] Display panel;

[0082] An eye-tracking optical system as described in any one of the first aspects.

[0083] Optionally, it further comprises a housing, wherein the display panel, the first lens group, the infrared light emitting device and the infrared imaging device are located in the housing;

[0084] The optical axis of the first lens group is perpendicular to the display panel and is located on the same straight line as the center of the display panel;

[0085] A vertical distance between a first end point of the infrared imaging device and a plane where the optical axis of the first lens group is located is greater than half the height of the display panel, and a vertical distance between the infrared imaging device and a plane where the optical axis of the first lens group is located is less than a vertical distance between a first side of the housing and a plane where the optical axis of the first lens group is located;

[0086] A vertical distance between the second endpoint of the infrared imaging device and the target plane of the first lens group is smaller than a vertical distance between the target plane of the first lens group and the second side of the housing.

[0087] The technical solution provided in the embodiments of the present disclosure has at least the following technical effects or advantages:

[0088] In the eye-tracking optical system provided by the embodiment of the present disclosure, the infrared light emitting device is used to emit infrared light to the human eye, the first lens group is used to be arranged on the light-emitting side of the display panel, the side of the first lens group away from the display panel is used to converge the infrared light reflected by the human eye, thereby reducing the light angle of the infrared light reflected by the human eye, and the side of the first lens group close to the display panel is used to diverge the infrared light, thereby improving the imaging clarity; the infrared imaging device is arranged on the side of the first lens group close to the display panel, and the imaging surface of the infrared imaging device faces the first lens group, and the infrared light reflected by the human eye is deflected after passing through the first lens group and is incident on the infrared imaging device. Therefore, through the reasonable arrangement of the first lens group and the infrared imaging device, the volume of the eye-tracking optical system is reduced, and the volume of the near-eye display product is made thinner and lighter.

[0089] The above description is only an overview of the technical solution provided by the embodiment of the present disclosure. In order to more clearly understand the technical means of the embodiment of the present disclosure, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the embodiment of the present disclosure more obvious and easy to understand, the specific implementation method of the embodiment of the present disclosure is listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0090] Various other advantages and benefits will become apparent to those of ordinary skill in the art by reading the detailed description of the preferred embodiments below. The accompanying drawings are only for the purpose of illustrating the preferred embodiments and are not to be considered as limiting the present disclosure. Also, the same reference symbols are used throughout the accompanying drawings to represent the same components. In the accompanying drawings:

[0091] Figure 1 A schematic diagram showing the structure of an eye tracking optical system according to an embodiment of the present disclosure is shown;

[0092] Figure 2 A schematic diagram showing the positional relationship between the eye tracking optical system and the display panel according to an embodiment of the present disclosure is shown;

[0093] Figure 3 A schematic diagram of the optical path of the display light L1 according to an embodiment of the present disclosure is shown;

[0094] Figure 4 A schematic diagram showing the optical path of infrared light L2 of a display panel according to an embodiment of the present disclosure is shown;

[0095] Figure 5 A schematic diagram showing the positional relationship between the infrared light emitting device and the infrared imaging device and the display panel according to an embodiment of the present disclosure is shown;

[0096] Figure 6A schematic diagram showing the position of an infrared light emitting device according to an embodiment of the present disclosure is shown;

[0097] Figure 7 Another schematic diagram showing the position of the infrared light emitting device according to the embodiment of the present disclosure;

[0098] Figure 8 A schematic structural diagram of a first lens group according to an embodiment of the present disclosure is shown;

[0099] Fig. 9 A schematic diagram showing the structure of the second lens group in an embodiment of the present disclosure is shown;

[0100] Fig.10 A schematic structural diagram of a display device according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0101] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided in order to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art. It should be noted that the term "plurality" appearing herein includes two or more than two situations.

[0102] As used herein, "about," "approximately," "substantially" includes the stated value and the average value that is within an acceptable range of deviation from the particular value, where the acceptable range of deviation is determined by one of ordinary skill in the art taking into account the measurements in question and the errors associated with the measurement of the particular quantity (i.e., the limitations of the measurement system).

[0103] As used herein, "parallel", "perpendicular", and "equal" include the situations described and situations similar to the situations described, and the range of the similar situations is within the acceptable deviation range, wherein the acceptable deviation range is determined by a person of ordinary skill in the art taking into account the measurement in question and the errors associated with the measurement of a particular quantity (i.e., the limitations of the measurement system). For example, "parallel" includes absolute parallelism and approximate parallelism, wherein the acceptable deviation range of approximate parallelism may be, for example, a deviation within 5°; "perpendicular" includes absolute perpendicularity and approximate perpendicularity, wherein the acceptable deviation range of approximate perpendicularity may also be, for example, a deviation within 5°. "Equal" includes absolute equality and approximate equality, wherein the acceptable deviation range of approximate equality may be, for example, the difference between the two equalities is less than or equal to 5% of either one.

[0104] In recent years, with the development of technologies such as virtual reality, augmented reality, and extended reality, near-eye display devices (also known as helmet displays) have been widely used. For example, they have been widely used in military, games, film and television entertainment, live broadcasts, real estate, retail, education, and medical health.

[0105] Some near-eye display products have an eye tracking function, that is, the infrared light emitted by the infrared light emitting device is reflected by the human eye, and the eye information carried by the light is transmitted to the infrared imaging device, so that the user's eye gaze point on the screen can be obtained through data processing. As a result, only the gaze point location area can be fully rendered on the display screen, reducing the hardware requirements of the device; in addition, the eye tracking function can also be used to create depth sensing to generate a better user interface.

[0106] In the related art, some products place infrared light emitting devices and infrared imaging devices in front of the screen, place an inclined semi-reflective and semi-transparent flat plate between the display screen and the lens, and coat the flat plate with a thermal mirror, thereby allowing infrared light to be reflected and visible light to be transmitted. The reflected light is received by the infrared imaging device, but the design of the semi-reflective and semi-transparent flat plate requires a large space for the display product and has poor adaptability in compact optical systems. In addition, there are some products that place infrared imaging devices close to the human eye to directly shoot the human eye, and the infrared emitting device is also placed close to the human eye. This method causes the infrared imaging device to be close to the human eye and may interfere with the human eye, affecting the user experience.

[0107] In view of this, a first aspect of an embodiment of the present disclosure provides an eye-tracking optical system, thereby reducing the volume of the eye-tracking optical system and achieving a lightweight and thin near-eye display product.

[0108] The eye tracking optical system according to the first aspect of the embodiment of the present disclosure will be described below with reference to specific drawings.

[0109] See also Figure 1 , which shows a schematic diagram of the structure of the eye tracking optical system of an embodiment of the present disclosure; see Figure 2 , showing a schematic diagram of the positional relationship between the eye tracking optical system and the display panel in an embodiment of the present disclosure.

[0110] like Figure 1 and Figure 2As shown, an eye tracking optical system 10 provided by an embodiment of the present disclosure includes: an infrared light emitting device 3, the infrared light emitting device 3 is used to emit infrared light to a human eye E; a first lens group 2, the first lens group 2 is used to be arranged on the light emitting side of a display panel 1, the side of the first lens group 2 away from the display panel 1 is used to converge the infrared light reflected by the human eye E, and the side of the first lens group 2 close to the display panel 1 is used to diverge the infrared light after being deflected by the first lens group; an infrared imaging device 4, the infrared imaging device 4 is arranged on the side of the first lens group 2 close to the display panel 1, and the imaging surface of the infrared imaging device 4 faces the first lens group 2, the infrared light reflected by the human eye E is deflected after passing through the first lens group 2 and is incident on the infrared imaging device 4.

[0111] See also Figure 3 , which shows a schematic diagram of the optical path of the display light L1 according to an embodiment of the present disclosure; see Figure 4 , shows a schematic diagram of the optical path of the infrared light L2 of the display panel 1 of an embodiment of the present disclosure.

[0112] For example, Figure 3 As shown, the display light L1 of the display panel 1 is emitted from the light emitting side of the display panel 1, and L1 reaches the human eye E after being deflected by the first lens group 2, as shown in FIG. Figure 4 As shown, the infrared light emitting device 3 emits infrared light L2 to the human eye. The infrared light L2 reaches the side of the first lens group 2 far away from the display panel 1 for light convergence to reduce the light angle of the infrared light L2 reflected by the human eye and reduce the deflection pressure of the infrared light L2 after entering the first lens group 2. The infrared light L2 reaches the side of the first lens group 2 close to the display panel 1 for light divergence. It can be understood that when the diverged infrared light L2 enters the infrared imaging device 4, the infrared imaging device 4 can further deflect the infrared light L2 to improve the imaging effect. Then, the infrared light L2 enters the field of view of the infrared imaging device 4 and is received and imaged. Therefore, the infrared light L2 deflected by the first lens group 2 is incident on the infrared imaging device 4, and the eye tracking algorithm in the related technology can be used to perform data processing to obtain the gaze point of the human eye E in the display panel 1. Therefore, the embodiment of the present disclosure reduces the volume of the eye tracking optical system 10 through the reasonable arrangement of the first lens group 2 and the infrared imaging device 4, and realizes the thinness of the near-eye display product.

[0113] In the disclosed embodiment, the imaging surface of the infrared imaging device 4 is directed toward the first lens group 2, and the deflection optical path of the infrared light by the first lens group 2 is reasonably designed, so that the infrared imaging device 4 can directly receive the infrared light deflected by the first lens group 2, without the need to set a semi-reflective and semi-transparent plate, thereby reducing the volume of the eye tracking optical system 10 and achieving a thin and light near-eye display product. In addition, by setting the infrared imaging device 4 on the side of the first lens group 2 close to the display panel 1, the infrared imaging device 4 is at a greater distance from the human eye, thereby avoiding interference with the human eye and affecting the user experience.

[0114] In some embodiments, the display panel 1 can be LCD (Liquid Crystal Displacian), OLED (Organic Light-Emitting Diode), MicroOLED (micro organic light-emitting diode display panel 1), Mini LED (mini organic light-emitting diode display panel 1), etc. The display screen size of the display panel 1 can range from 0.39 inches to 1.35 inches, for example, 0.39 inches, 0.5 inches, 0.9 inches, 1.35 inches, etc. For example, the OLED display panel 1 uses a 0.9-inch 4K display screen.

[0115] Optionally, the infrared imaging device 4 is used to be arranged on the peripheral side of the display panel 1, and the imaging surface of the infrared imaging device 4 is basically located on the plane where the display panel 1 is located.

[0116] It is understandable that the infrared imaging device 4 is arranged close to the edge of the display panel 1, that is, arranged on the peripheral side of the display panel 1, and the imaging surface of the infrared imaging device 4 is basically located on the plane where the display panel 1 is located, so that the structural compactness of the optical system can be improved. Wherein, basically located can mean: the imaging surface of the infrared imaging device 4 is parallel to the plane where the display panel 1 is located, but there is a small spacing between the two, such as 1mm, 2mm or 3mm between the two planes; or, there is a small inclination angle between the imaging surface of the infrared imaging device 4 and the plane where the display panel 1 is located, such as 3 degrees, 4 degrees, 5 degrees, etc.

[0117] Exemplarily, the infrared imaging device 4 is an infrared camera, and there is one or more infrared cameras. One or more infrared cameras can be arranged on the periphery of the display panel 1. As can be seen from the figure, in the direction perpendicular to the optical axis 21 of the first lens group, the height of the display panel 1 is less than the height of the first lens group 2. Therefore, when one or more infrared cameras are arranged on the periphery of the display panel 1, the infrared cameras can be arranged as close to the display panel 1 as possible. Thus, on the basis that there is a certain distance between the infrared cameras and the first lens group 2, the light rays emitted from the edge of the first lens group 2 can also enter the field of view angle of the infrared camera 2, thereby improving the imaging clarity.

[0118] In some embodiments, the plane where the optical axis 21 of the first lens group is located is perpendicular to the display panel 1; the vertical distance h between the first end point a of the infrared imaging device 4 and the plane where the optical axis 21 of the first lens group is located satisfies the following relationship: 10.5 mm < h < 10.7 mm. The first end point is the point on the infrared imaging device 4 that is closest to the plane where the optical axis 21 of the first lens group is located. For example, the vertical distance h can be 10.5 mm, 10.6 mm, or 10.7 mm, and can be reasonably set according to the actual eye tracking optical system 10.

[0119] The vertical distance w between the second end point of the infrared imaging device and the target plane of the first lens group 2 satisfies the following relationship: 4 mm < w < 5 mm. The second end point is the point on the infrared imaging device 4 that is closest to the target plane. The target plane is the plane where the point closest to the display panel 1 in the first lens group 2 is located, and the target plane is parallel to the display panel 1. For example, the vertical distance w can be 4 mm, 4.2 mm, 4.5 mm, 4.8 mm, or 5 mm, and can be reasonably set according to the actual eye tracking optical system 10.

[0120] Thus, by describing the vertical distances between the infrared imaging device 4 and the optical axis and the first lens group 2 respectively, the position of the infrared imaging device 4 in the eye tracking optical system 10 can be positioned, and interference between the infrared imaging device 4 and the display panel 1 and the first lens group 2 can be avoided.

[0121] In some embodiments, the infrared imaging device 4 includes a second lens group;

[0122] The first end point of the second lens group has a vertical distance h from the plane where the optical axis 21 of the first lens group is located, and the second end point of the second lens group has a vertical distance w from the target plane of the first lens group;

[0123] There is a set corresponding relationship between the emission position and emission angle of the infrared light on the side of the first lens group close to the display panel and the vertical distance h and the vertical distance w.

[0124] It can be understood that the first endpoint of the second lens group and the first endpoint of the infrared imaging device 4 can be the same endpoint, and the second endpoint of the second lens group and the second endpoint of the infrared imaging device 4 can be the same endpoint.

[0125] It is understandable that the infrared imaging device 4 usually uses an internal sensor to receive infrared light and form an image, and the second lens group can further deflect the infrared light deflected by the first lens group 2 to adapt to the imaging requirements of its own sensor. Therefore, after the parameters such as the model of the sensor are determined, the parameters of the second lens group can be set according to the parameters of the first lens group 2, and the parameters include but are not limited to the lens shape, lens focal length, lens thickness, lens curvature radius, air gap between lenses, and spatial position, etc. The corresponding relationship between the spatial position of the second lens group and the first lens group is exemplified below.

[0126] It should be noted that, based on the above-mentioned positional relationship between the infrared imaging device 4, the first lens group 2 and the display panel 1, it can be known that when the size, spatial position and other parameters of the display panel 1 are different, the spatial position of the infrared imaging device 4 will also be different, that is, the space of the second lens group will also be different. For example, if the height of the display panel 1 on the plane perpendicular to the optical axis 21 of the first lens group is greater, the vertical distance h between the second lens group and the first end point of the second lens group and the plane where the optical axis 21 of the first lens group is located is greater. When the spatial position of the second lens group is different, the selection result of the second lens group for the position and angle of the infrared light emitted from the first lens group may be different. For example, the human eye itself can reflect multiple light beams at different angles, such as multiple infrared light beams within the range of positive and negative 90 degrees relative to the center line of the human eye. Assuming that the second lens group has a position a, the infrared light deflected by the first lens group 2 is selected in the range of 0-5 degrees. Assuming that the second lens group has a position b, the infrared light deflected by the first lens group 2 is selected in the range of 10-15 degrees. Among them, when the parameters of the first lens group 2 are determined, the emission positions and angles of infrared light beams of different angles on the side of the first lens group 2 close to the display panel 1 can also be determined, thereby, a corresponding relationship can be established between the emission position and angle of the infrared light on the side of the first lens group close to the display panel and the vertical distance h and the vertical distance w, for example, by establishing the corresponding relationship through data fitting.

[0127] Then, if the emission position and the emission angle of the infrared light on the side of the first lens group 2 close to the display panel 1 change, the vertical distance h and the vertical distance w can be parameter compensated, so that the emission position and the emission angle of the infrared light on the side of the first lens group 2 close to the display panel 1 and the vertical distance h and the vertical distance w still satisfy the set corresponding relationship, thereby not affecting the accuracy of the human eye gaze point positioning result.

[0128] Of course, it can be understood that in addition to pre-establishing the correspondence between the emission position and the emission angle of the infrared light on the side of the first lens group close to the display panel and the vertical distance h and the vertical distance w, it is also possible to establish a correspondence between the emission position and the emission angle of the infrared light on the side of the first lens group 2 close to the display panel 1 and the inclination angle between the optical axis of the second lens group and the optical axis of the first lens group 2. The principle is similar to the above and will not be repeated here. Therefore, by pre-establishing the correspondence between the parameters of the first lens group and the parameters of the second lens group, when any of the parameters of the first lens group and / or the parameters of the second lens group changes, parameter compensation is performed based on the preset correspondence, thereby not affecting the accuracy of the human eye gaze point positioning result.

[0129] See also Figure 5 , shows a schematic diagram of the positional relationship between the infrared light emitting device and the infrared imaging device and the display panel of an embodiment of the present disclosure.

[0130] In some embodiments, the optical axis 41 of the infrared imaging device is inclined toward the center of the display panel 1, and there is an intersection between the optical axis 41 of the infrared imaging device and the optical axis of the first lens group 2, so that the infrared light deflected by the first lens group 2 can better enter the infrared imaging device 4 for imaging, thereby improving the imaging effect.

[0131] In some embodiments, the angle α between the optical axis 41 of the infrared imaging device and the optical axis 21 of the first lens group is in the range of 3 degrees <α <3.5 degrees, for example, 3 degrees, 3.2 degrees or 3.5 degrees; and / or, the field of view angle of the infrared imaging device 4 is in the range of 10 degrees to 30 degrees, for example, 10 degrees, 15 degrees, 20 degrees or 30 degrees.

[0132] In some embodiments, the field angle range of the optical path of the light emitted by the display panel 1 may be 50 degrees to 60 degrees, such as 50 degrees, 52 degrees, 55 degrees, 60 degrees, etc.

[0133] like Figure 5As shown, in some embodiments, the infrared light emitting device 3 is one or more, and the one or more infrared light emitting devices 3 are arranged on a side of the first lens group 2 close to the display panel 1 or a side away from the display panel 1; or the first lens group 2 includes a plurality of lenses, and the one or more infrared light emitting devices 3 are located between two adjacent lenses among the plurality of lenses.

[0134] See also Figure 6 , showing a schematic diagram of the position of the infrared light emitting device of the embodiment of the present disclosure; see Figure 7 , showing another position schematic diagram of the infrared light emitting device of an embodiment of the present disclosure.

[0135] Exemplarily, the infrared light emitting device 3 may be an infrared LED lamp, and the infrared LED lamp may be multiple, for example, greater than or equal to 6, and the multiple infrared LED lamps may be arranged on the peripheral side of the display panel 1, or, as shown in FIG. Figure 1 As shown, it is arranged on the side of the first lens group 2 close to the display panel 1, or, as shown Figure 4 As shown, it is arranged on the side of the first lens group 2 away from the display panel 1, or, as shown Figure 6 and Figure 7 As shown, it is arranged between any two lenses. It can be understood that in order not to affect the deflection function of the first lens group 2 on light, the LED lamp can be arranged at the edge of the first lens group 2. Thus, multiple LED lamps emit light evenly, so that the human eye obtains uniform illumination.

[0136] See also Figure 8 , shows a schematic structural diagram of the first lens group in an embodiment of the present disclosure.

[0137] like Figure 8As shown, in some embodiments, the first lens group 2 includes a first lens 22, a second lens 23, a third lens 24, a fourth lens 25 and a fifth lens 26 arranged in sequence, the first lens 22 is far away from the display panel 1, and the fifth lens 26 is close to the display panel 1; the first lens 22 has positive focal length, and the side (S1) of the first lens 22 far away from the display panel 1 and the side (S2) close to the display panel 1 are convex; the second lens 23 has negative focal length, the side of the second lens 23 far away from the display panel 1 is convex (S3), and the side (S4) of the second lens 23 close to the display panel 1 is concave; the third lens 24 and the fourth lens 25 have positive focal length, and the side (S5 and S7) far away from the display panel 1 and the side (S6 and S8) close to the display panel 1 are convex; the fifth lens 26 has negative focal length, and the side (S9) of the fifth lens 26 far away from the display panel 1 and the side (S10) close to the display panel 1 are concave.

[0138] It can be understood that the shapes of the lenses in the first lens group 2 affect each other. The first lens 22 has a positive focal length, so that the infrared light reflected by the human eye converges after reaching the first lens 22, thereby reducing the angle of the infrared light reflected by the human eye; the second lens 23 has a negative focal length, so that the infrared light deflected by the first lens 22 diverges after reaching the second lens 23, thereby cooperating with the subsequent lenses to improve the imaging effect; the third lens 24 and the fourth lens 25 have positive focal lengths, so that the infrared light deflected by the second lens 23 further converges after reaching the third lens 24 and the fourth lens 25, thereby correcting the aberration; the fifth lens 26 has a negative focal length, thereby achieving the divergence of light, meeting the imaging requirements, improving the imaging clarity, and helping to reduce the total length of the optical system and the volume of the system. In addition, by reasonably designing the bending direction of each lens of the first lens group 2 (i.e., presenting a convex or concave surface), the angle turning difference of the infrared light after passing through the adjacent lenses can be made smaller, thereby making the tolerance of the entire optical system smaller, which is conducive to the assembly between lenses.

[0139] See also Fig. 9 , shows a schematic structural diagram of the second lens group in an embodiment of the present disclosure.

[0140] like Fig. 9As shown, in some embodiments, the infrared imaging device 4 includes a second lens group, the second lens group includes a sixth lens 42, a seventh lens 43 and an eighth lens 44 arranged in sequence, the sixth lens 42 is close to the first lens group 2, and the eighth lens 44 is far away from the first lens group 2; the sixth lens 42 has a negative optical focal length, the side (S11) of the sixth lens 42 away from the first lens group 2 is a convex surface, and the side (S12) of the sixth lens 42 close to the first lens group 2 is a concave surface; the seventh lens 43 has a positive optical focal length, the side of the seventh lens 43 away from the first lens group 2 is a convex surface (S13), and the side of the seventh lens 43 close to the first lens group 2 is a concave surface (S14); the eighth lens 44 has a negative optical focal length, and the side (S15) of the eighth lens 44 away from the first lens group 2 and the side (S16) of the eighth lens 44 close to the first lens group 2 are concave surfaces.

[0141] It can be understood that the shapes of the lenses in the second lens group influence each other. The sixth lens 42 has a negative focal length, so that the infrared light deflected by the fifth lens 26 is diverged after reaching the sixth lens 42, thereby cooperating with the subsequent lenses to improve the imaging effect; the seventh lens 43 has a positive focal length, which converges the infrared light deflected by the sixth lens 42, thereby reducing the angle of the light; the eighth lens 44 has a negative focal length, which diverges the infrared light deflected by the seventh lens 43, thereby correcting aberrations and improving imaging clarity.

[0142] In some embodiments, the infrared imaging device 4 includes a second lens group; at least one of the first lens group 2 and the second lens group includes a single lens, a plurality of lenses, or a cemented lens, for example, the first lens group 2 and the second lens group include a plurality of lenses. And / or, the lens of at least one of the first lens group 2 and the second lens group includes a spherical surface, a cylindrical surface, a Fresnel surface, or a free-form surface, for example, the S1 surface of the first lens 22 is a spherical surface or an aspherical surface, the S2 surface is a Fresnel surface, the S3 surface and the S4 surface of the second lens 23 are spherical surfaces or aspherical surfaces, the S5 surface and the S6 surface of the third lens 24 are spherical surfaces or aspherical surfaces, the S7 surface and the S8 surface of the fourth lens 25 are spherical surfaces or aspherical surfaces, and the S9 surface and the S10 surface of the fifth lens 26 are spherical surfaces or aspherical surfaces. And / or, the lens material of at least one of the first lens group 2 and the second lens group includes plastic, glass or a mixed material of plastic and glass; and / or, the lens surface of at least one of the first lens group 2 and the second lens group is coated with an anti-reflection film.

[0143] In some embodiments, the first lens group 2 includes a first lens 22, a second lens 23, a third lens 24, a fourth lens 25, and a fifth lens 26 arranged in sequence, the first lens 22 is far away from the display panel 1, and the fifth lens 26 is close to the display panel 1; the focal lengths of the first lens 22 to the fifth lens 26 satisfy the following relationship:

[0144] 1<(f11+f12)×f1 / (f11×f12)<2;

[0145] 0.5<(f12+f13)×f1 / (f12×f13)<1;

[0146] 0.8<(f13+f14)×f1 / (f13×f14)<1;

[0147] 1<(f14+f15)×f1 / (f14×f15)<1.2;

[0148] Among them, f11 represents the focal length of the first lens 22, f12 represents the focal length of the second lens 23, f13 represents the focal length of the third lens 24, f14 represents the focal length of the fourth lens 25, f15 represents the focal length of the fifth lens 26, and f1 represents the focal length of the first lens group 2.

[0149] Exemplarily, (f11+f12)×f1 / (f11×f12) can be any value in the range of (1, 2), for example, 1.1, 1.2, 1.3, 1.4, 1.5, 1.6, 1.7, 1.8, 1.9, etc. (f12+f13)×f1 / (f12×f13) can be any value in the range of (0.5, 1), for example, 0.6, 0.7, 0.8, 0.9, etc. (f13+f14)×f1 / (f13×f14) can be any value in the range of (0.8, 1), for example, 0.85, 0.9, 0.95, etc. (f14+f15)×f1 / (f14×f15) can be any value in the range of (1, 2), for example, 1.1, 1.3, 1.5, 1.7, 1.9, etc.

[0150] It can be understood that the focal length relationship between the lenses of the first lens group 2 affects the final imaging effect. By establishing the relationship between the focal lengths of the first lens 22 to the fifth lens 26, that is, a relationship that satisfies the conditional expression, the focal lengths of the first lens 22 to the fifth lens 26 are reasonably configured, which is beneficial to correcting aberrations and mutual compensation, and can reduce the lens sensitivity and the difficulty of lens processing.

[0151] In some embodiments, the first lens group 2 includes a first lens 22, a second lens 23, a third lens 24, a fourth lens 25 and a fifth lens 26 arranged in sequence, the first lens 22 is far away from the display panel 1, and the fifth lens 26 is close to the display panel 1; along the optical axis 21 of the first lens group, the thicknesses of the first lens 22 to the fifth lens 26 satisfy the following relationship:

[0152] 1.5 <d1 / d2<2;

[0153] 0 <d2 / d3<0.5;

[0154] 0.5 <d3 / d4<1;

[0155] 3 <d4 / d5<3.3;

[0156] Wherein, d1 represents the thickness of the first lens 22 , d2 represents the thickness of the second lens 23 , d3 represents the thickness of the third lens 24 , d4 represents the thickness of the fourth lens 25 , and d5 represents the thickness of the fifth lens 26 .

[0157] Exemplarily, d1 / d2 can be any value in the range of (1, 2), for example, 1.1, 1.2, 1.3, 1.4, 1.5, 1.6, 1.7, 1.8, 1.9, etc. d2 / d3 can be any value in the range of (0, 0.5), for example, 0.1, 0.2, 0.3, 0.4, etc. d3 / d4 can be any value in the range of (0.5, 1), for example, 0.6, 0.7, 0.8, 0.9, etc. d4 / d5 can be any value in the range of (3, 3.3), for example, 3.1, 3.2, etc.

[0158] It can be understood that the thickness relationship between the lenses of the first lens group 2 affects the overall length of the system. By establishing the relationship between the thicknesses of the first lens 22 to the fifth lens 26, that is, a relationship that satisfies the conditional formula, the thicknesses of the first lens 22 to the fifth lens 26 are reasonably configured, which is beneficial to achieving an optical system with a large field of view and a large exit pupil distance, and is beneficial to reducing the overall length of the optical system, thereby achieving lightweight and miniaturized near-eye display devices.

[0159] In some embodiments, the first lens group 2 includes a first lens 22, a second lens 23, a third lens 24, a fourth lens 25, and a fifth lens 26 arranged in sequence, the first lens 22 is far away from the display panel 1, and the fifth lens 26 is close to the display panel 1; the curvature radii of the first lens 22 to the fifth lens 26 satisfy the following relationship:

[0160] 9<|(R11-R12) / (R11+R12)|<9.5;

[0161] 0<|(R21-R22) / (R21+R22)|<0.5;

[0162] 11<|(R31-R32) / (R31+R32)|<12;

[0163] 1.5<|(R41-R42) / (R41+R42)|<2;

[0164] 7<|(R51-R52) / (R51+R52)|<7.5;

[0165] Among them, R11 represents the curvature radius of the side of the first lens 22 away from the display panel 1, R12 represents the curvature radius of the side of the first lens 22 close to the display panel 1, R21 represents the curvature radius of the side of the second lens 23 away from the display panel 1, R22 represents the curvature radius of the side of the second lens 23 close to the display panel 1, R31 represents the curvature radius of the side of the third lens 24 away from the display panel 1, R32 represents the curvature radius of the side of the third lens 24 close to the display panel 1, R41 represents the curvature radius of the side of the fourth lens 25 away from the display panel 1, R42 represents the curvature radius of the side of the fourth lens 25 close to the display panel 1, R51 represents the curvature radius of the side of the fifth lens 26 away from the display panel 1, and R52 represents the curvature radius of the side of the fifth lens 26 close to the display panel 1.

[0166] Exemplarily, |(R11-R12) / (R11+R12)| can be any value in the range of (9, 9.5), for example, 9.1, 9.2, 9.3, 9.4, etc. |(R21-R22) / (R21+R22)| can be any value in the range of (0, 0.5), for example, 0.1, 0.2, 0.3, 0.4, etc. |(R31-R32) / (R31+R32)| can be any value in the range of (11, 12), for example, 11.2, 11.3, 11.4, 11.6, 11.8, 11.9, etc. |(R41-R42) / (R41+R42)| can be any value in the range of (1.5, 2), for example, 1.6, 1.7, 1.8, 1.9, etc.

[0167] It can be understood that the relationship between the curvature radii of the lenses of the first lens group 2 affects the imaging effect. By establishing the relationship between the curvature radii of the first lens 22 to the fifth lens 26, that is, a relationship that satisfies the conditional expression, the curvature radii of the first lens 22 to the fifth lens 26 are reasonably configured to achieve a good imaging effect.

[0168] For ease of understanding, Table 1 below shows one parameter table of the first lens group 2 according to an embodiment of the present disclosure.

[0169] Table 1

[0170]

[0171] Exemplarily, the aspheric surface profile z of the optical lens can be expressed by the following formula, but is not limited to the following formula:

[0172]

[0173] Where z is the distance vector height from the vertex of the aspheric surface when the aspheric surface is at a height of r along the optical axis, c represents the curvature of the paraxial surface, ε represents the conic curve parameter, ρ is the radius of the aspheric surface, and the value range of ρ is 0≤ρ≤ρ max , u=ρ / ρ max represents the normalized coordinates, -1≤u≤1, α m Represents the high-order coefficient of the aspheric surface, α m =α1, α2, α3, represents an orthogonal polynomial, D con Represents the setting parameters, which are used to simplify the expression, and M represents the maximum coefficient of the setting.

[0174] Exemplarily, Table 2 shows the data of aspheric high-order items.

[0175] Table 2

[0176]

[0177] In some embodiments, the infrared imaging device 4 includes a second lens group, the second lens group includes a sixth lens 42, a seventh lens 43 and an eighth lens 44 arranged in sequence, the sixth lens 42 is close to the first lens group 2, and the eighth lens 44 is far away from the first lens group 2; the focal lengths of the sixth lens 42 to the eighth lens 44 satisfy the following relationship:

[0178] 21<(f26+f27)×f2 / (f26×f27)<21.5;

[0179] 20<(f27+f28)×f2 / (f27×f28)<20.5;

[0180] Wherein, f26 represents the focal length of the sixth lens 42, f27 represents the focal length of the seventh lens 43, f28 represents the focal length of the eighth lens 44, and f2 represents the focal length of the second lens group.

[0181] Exemplarily, (f26+f27)×f2 / (f26×f27) can be any value in the range of (21, 21.5), for example, 21.1, 21.2, 21.3, 21.4, etc. (f27+f28)×f2 / (f27×f28) can be any value in the range of (20, 20.5), for example, 20.1, 20.2, 20.3, 20.4, etc.

[0182] It can be understood that the focal length relationship between the lenses of the second lens group affects the imaging effect. By establishing the relationship between the focal lengths of the sixth lens 42 to the eighth lens 44, that is, a relationship that satisfies the conditional expression, the focal lengths of the sixth lens 42 to the eighth lens 44 are reasonably configured, which is beneficial to correcting aberrations and mutual compensation, and can reduce the sensitivity of the lens and the difficulty of lens processing.

[0183] In some embodiments, the infrared imaging device 4 includes a second lens group, the second lens group includes a sixth lens 42, a seventh lens 43 and an eighth lens 44 arranged in sequence, the sixth lens 42 is close to the first lens group 2, and the eighth lens 44 is far away from the first lens group 2; along the optical axis direction of the second lens group, the thicknesses of the sixth lens 42 to the eighth lens 44 satisfy the following relationship:

[0184] 2.5 <d6 / d7<3;

[0185] 2.5 <d7 / d8<3;

[0186] Wherein, d6 represents the thickness of the sixth lens 42 , d7 represents the thickness of the seventh lens 43 , and d8 represents the thickness of the eighth lens 44 .

[0187] Exemplarily, d6 / d7 can be any value in the range of (2.5, 3), for example, 2.6, 2.7, 2.8, 2.9, etc. d7 / d8 can be any value in the range of (2.5, 3), for example, 2.6, 2.7, 2.8, 2.9, etc. It can be understood that the thickness relationship between the lenses of the second lens group affects the total length of the system. By establishing the relationship between the thicknesses of the sixth lens 42 to the eighth lens 44, that is, the relationship that satisfies the conditional formula, the thicknesses of the sixth lens 42 to the eighth lens 44 are reasonably configured, which is conducive to realizing an optical system with a large field of view and a large exit pupil distance, and is conducive to reducing the total length of the optical system, and realizing the thinness and miniaturization of the near-eye display device.

[0188] In some embodiments, the infrared imaging device 4 includes a second lens group, the second lens group includes a sixth lens 42, a seventh lens 43 and an eighth lens 44 arranged in sequence, the sixth lens 42 is close to the first lens group 2, and the eighth lens 44 is far away from the first lens group 2; the curvature radii of the sixth lens 42 to the eighth lens 44 satisfy the following relationship:

[0189] 0.1<|(R61-R62) / (R61+R62)|<0.5;

[0190] 0.5<|(R71-R72) / (R71+R72)|<1;

[0191] 0<|(R81-R82) / (R81+R82)|<0.5;

[0192] Among them, R61 represents the curvature radius of the sixth lens 42 close to the first lens group 2, R62 represents the curvature radius of the sixth lens 42 away from the first lens group 2, R71 represents the curvature radius of the seventh lens 43 close to the first lens group 2, R72 represents the curvature radius of the seventh lens 43 away from the first lens group 2, R81 represents the curvature radius of the eighth lens 44 close to the first lens group 2, and R82 represents the curvature radius of the eighth lens 44 away from the first lens group 2.

[0193] Exemplarily, |(R61-R62) / (R61+R62)| can be any value in the range of (0.1, 0.5), for example, 0.2, 0.3, 0.4, etc. |(R71-R72) / (R71+R72) can be any value in the range of (0.5, 1), for example, 0.6, 0.7, 0.8, etc. |(R81-R82) / (R81+R82)| can be any value in the range of (0, 0.5), for example, 0.1, 0.2, 0.3, 0.4, etc.

[0194] It can be understood that the relationship between the curvature radii of the lenses of the second lens group affects the imaging effect. By establishing the relationship between the curvature radii of the sixth lens 42 to the eighth lens 44, that is, a relationship that satisfies the conditional expression, the curvature radii of the sixth lens 42 to the eighth lens 44 are reasonably configured to achieve a good imaging effect.

[0195] For ease of understanding, Table 3 below shows one parameter table of the second lens group of an embodiment of the present disclosure.

[0196]

[0197] Exemplarily, the spherical equation of an optical lens may be in the following form:

[0198]

[0199] Among them, Z(x) is the distance vector height from the vertex of the spherical surface when the spherical surface is at a height of r along the optical axis, x represents the radius of the aspherical surface, c represents the curvature of the paraxial surface, and k represents the cone coefficient.

[0200] In some embodiments, the first lens group 2 includes a first lens 22, a second lens 23, a third lens 24, a fourth lens 25, and a fifth lens 26 arranged in sequence, the first lens 22 is far away from the display panel 1, and the fifth lens 26 is close to the display panel 1;

[0201] The infrared imaging device 4 includes a second lens group 23 and a sensor, the second lens group 23 includes a sixth lens 42, a seventh lens 43 and an eighth lens 44 arranged in sequence, the sixth lens 42 is close to the fifth lens 26, the eighth lens 44 is far away from the fifth lens 26, and the sensor is arranged on a side of the eighth lens 44 far away from the fifth lens 26;

[0202] In a direction perpendicular to the display panel 1, the air gap between the first lens 22 and the eighth lens 44 satisfies the following relationship:

[0203] 0 <DT1 / DT2<0.1;

[0204] 0 <DT3 / DT4<0.5;

[0205] 0.1 <DT5 / DT6<0.2;

[0206] 1 <DT6 / DT7<1.2;

[0207] 2 <DT7 / DT8<2.5;

[0208] Among them, DT1 represents the air gap between the first lens 22 and the second lens 23, DT2 represents the air gap between the second lens 23 and the third lens 24, DT3 represents the air gap between the third lens 24 and the fourth lens 25, DT4 represents the air gap between the fourth lens 25 and the fifth lens 26, DT5 represents the air gap between the fifth lens 26 and the display panel 1, DT6 represents the air gap between the sixth lens 42 and the seventh lens 43, DT7 represents the air gap between the seventh lens 43 and the eighth lens 44, and DT8 represents the air gap between the eighth lens 44 and the sensor.

[0209] Exemplarily, DT1 / DT2 can be any value in the range of (0, 0.1), for example, 0.01, 0.02, 0.05, 0.08, 0.09, etc. DT3 / DT4 can be any value in the range of (0, 0.5), for example, 0.1, 0.2, 0.3, 0.4, etc. DT5 / DT6 can be any value in the range of (0.1, 0.2), for example, 0.12, 0.14, 0.15, 0.16, 0.18, 0.19, etc. DT6 / DT7 can be any value in the range of (1, 1.2), for example, 1.05, 1.06, 1.08, 1.1, 1.15, etc.

[0210] It can be understood that by establishing an air gap relationship between the first lens group 2, the display panel 1 and the second lens group 23, that is, a relationship that satisfies the conditional expression, and reasonably configuring the distance between two adjacent lenses from the first lens 22 to the eighth lens 44, it is beneficial to reduce the total length of the optical system and make the system miniaturized.

[0211] See also Fig.10 , which shows a schematic structural diagram of a display device 20 according to an embodiment of the present disclosure.

[0212] A second aspect of an embodiment of the present disclosure provides a display device 20, comprising a display panel 1 and an eye-tracking optical system 10 as described in any one of the first aspects.

[0213] The display device 20 provided in the embodiment of the present application may be a VR, AR, MR, XR or other near-eye display device, and the embodiment of the present application does not make any specific limitation.

[0214] In some embodiments, the display device 20 further includes a housing 201, and the display panel 1, the first lens group 2, the infrared light emitting device 3 and the infrared imaging device 4 are located in the housing 201;

[0215] The optical axis 21 of the first lens group is perpendicular to the display panel 1 and is located on the same straight line as the center of the display panel 1;

[0216] A vertical distance h between the first end point of the infrared imaging device 4 and the plane where the optical axis 21 of the first lens group is located is greater than half the height of the display panel 1, and a vertical distance h between the infrared imaging device 4 and the plane where the optical axis 21 of the first lens group is located is less than a vertical distance between the first side 202 of the housing 201 and the plane where the optical axis 21 of the first lens group is located;

[0217] A vertical distance w between the second endpoint of the infrared imaging device 4 and the target plane of the first lens group 2 is smaller than a vertical distance w between the target plane of the first lens group 2 and the second side 203 of the housing 201 .

[0218] Therefore, by describing the positional relationship between the infrared imaging device 4 and the optical axis 21 of the first lens group, the first lens group 2 and the shell 201 respectively, the position of the infrared imaging device 4 in the eye tracking optical system 10 can be positioned to avoid interference between the infrared imaging device 4 and the display panel 1, the first lens group 2 and the shell 201.

[0219] The display device 20 provided in the embodiment of the present disclosure emits infrared light to the human eye through the infrared light emitting device 3. The first lens group 2 is arranged on the light emitting side of the display panel. The side of the first lens group 2 away from the display panel 1 is used to converge the infrared light reflected by the human eye, thereby reducing the light angle of the infrared light reflected by the human eye. The side of the first lens group 2 close to the display panel 1 is used to diverge the infrared light, thereby improving the imaging clarity. The infrared imaging device 3 is arranged on the side of the first lens group 2 close to the display panel 1, and the imaging surface of the infrared imaging device 4 faces the first lens group 2. The infrared light reflected by the human eye is deflected after passing through the first lens group 2 and is incident on the infrared imaging device. Therefore, through the reasonable arrangement of the first lens group 2 and the infrared imaging device 4, the volume of the eye tracking optical system 10 is reduced, and the volume of the near-eye display product is reduced.

[0220] In the above description, the technical details such as the composition of each layer of the product are not described in detail. However, those skilled in the art should understand that various technical means can be used to form layers, regions, etc. of desired shapes. Although each embodiment is described separately above, it does not mean that the measures in each embodiment cannot be used in combination to advantage.

[0221] In addition, those skilled in the art should understand that the discussion of any of the above embodiments is merely illustrative and is not intended to imply that the scope of the present disclosure is limited to these examples. Based on the concept of the present disclosure, the technical features in the above embodiments or different embodiments may be combined, the steps may be implemented in any order, and there are many other variations of different aspects of one or more embodiments of the present disclosure as described above, which are not provided in detail for the sake of simplicity.

[0222] Although the preferred embodiments of the present disclosure have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of the present disclosure.

Claims

1. An eye tracking optical system, characterized in that: Comprising: An infrared light emitting device for emitting infrared light towards a human eye; A first lens group for being disposed on the light emitting side of a display panel, with the side of the first lens group away from the display panel for converging the infrared light reflected by the human eye, and the side of the first lens group close to the display panel for diverging the infrared light deflected by the first lens group; An infrared imaging device disposed on the side of the first lens group close to the display panel, and with the imaging surface of the infrared imaging device facing the first lens group, and the infrared light reflected by the human eye is deflected after passing through the first lens group and is incident on the infrared imaging device.

2. The eye-tracking optical system according to claim 1, wherein: The infrared imaging device is for being disposed on the periphery of the display panel, and the imaging surface of the infrared imaging device is substantially located in the same plane as the display panel.

3. The eye-tracking optical system according to claim 1, wherein: The plane where the optical axis of the first lens group is located is perpendicular to the display panel; The vertical distance h between the first end point of the infrared imaging device and the plane where the optical axis of the first lens group is located satisfies the following relationship: 10.5 mm < h < 10.7 mm, and the first end point is the point on the infrared imaging device closest to the plane where the optical axis of the first lens group is located; The vertical distance w between the second end point of the infrared imaging device and the target plane of the first lens group satisfies the following relationship: 4 mm < w < 5 mm, and the second end point is the point on the infrared imaging device closest to the target plane, and the target plane is the plane where the point closest to the display panel in the first lens group is located, and the target plane is parallel to the display panel.

4. The eye-tracking optical system according to claim 1, wherein: The infrared imaging device includes a second lens group; The first end point of the second lens group has a vertical distance h from the plane where the optical axis of the first lens group is located, and the second end point of the second lens group has a vertical distance w from the target plane of the first lens group; There is a set corresponding relationship between the exit position and exit angle of the infrared light on the side of the first lens group close to the display panel and the vertical distance h and the vertical distance w.

5. The eye-tracking optical system according to claim 1, wherein: The optical axis of the infrared imaging device is inclined towards the center of the display panel, and there is an intersection between the optical axis of the infrared imaging device and the optical axis of the first lens group.

6. The eye-tracking optical system according to claim 5, characterized in that: The value range of the included angle α between the optical axis of the infrared imaging device and the optical axis of the first lens group is: 3 degrees < α < 3.5 degrees.

7. The eye-tracking optical system according to claim 1, wherein: The infrared light emitting device is one or more, and the one or more infrared light emitting devices are disposed on the side of the first lens group close to the display panel or away from the display panel; or The first lens group includes multiple lenses, and the one or more infrared light emitting devices are located between two adjacent lenses among the multiple lenses.

8. The eye-tracking optical system according to claim 1, wherein: The first lens group includes a first lens, a second lens, a third lens, a fourth lens, and a fifth lens arranged in sequence, with the first lens away from the display panel and the fifth lens close to the display panel; The first lens has positive optical power, and a side of the first lens away from the display panel and a side of the first lens close to the display panel are convex surfaces; The second lens has negative optical power, a side of the second lens away from the display panel is a convex surface, and a side of the second lens close to the display panel is a concave surface; The third lens and the fourth lens have positive refractive power, and a side away from the display panel and a side close to the display panel are convex surfaces; The fifth lens has negative optical power, and a side of the fifth lens away from the display panel and a side of the fifth lens close to the display panel are concave surfaces.

9. The eye-tracking optical system according to claim 1, wherein: The infrared imaging device comprises a second lens group, wherein the second lens group comprises a sixth lens, a seventh lens and an eighth lens arranged in sequence, wherein the sixth lens is close to the first lens group, and the eighth lens is far away from the first lens group; The sixth lens has negative optical power, a side of the sixth lens away from the first lens group is a convex surface, and a side of the sixth lens close to the first lens group is a concave surface; The seventh lens has positive refractive power, a side of the seventh lens away from the first lens group is convex, and a side of the seventh lens close to the first lens group is concave; The eighth lens has negative refractive power, and a side of the eighth lens away from the first lens group and a side of the eighth lens close to the first lens group are concave surfaces.

10. The eye-tracking optical system according to claim 1, wherein: The first lens group includes a first lens, a second lens, a third lens, a fourth lens and a fifth lens which are arranged in sequence, the first lens is far away from the display panel, and the fifth lens is close to the display panel; The focal lengths of the first lens to the fifth lens satisfy the following relationship: 1<(f11+f12)×f1 / (f11×f12)<2; 0.5<(f12+f13)×f1 / (f12×f13)<1; 0.8<(f13+f14)×f1 / (f13×f14)<1; 1<(f14+f15)×f1 / (f14×f15)<1.2; Among them, f11 represents the focal length of the first lens, f12 represents the focal length of the second lens, f13 represents the focal length of the third lens, f14 represents the focal length of the fourth lens, f15 represents the focal length of the fifth lens, and f1 represents the focal length of the first lens group.

11. The eye-tracking optical system according to claim 1, wherein: The first lens group includes a first lens, a second lens, a third lens, a fourth lens and a fifth lens which are arranged in sequence, the first lens is far away from the display panel, and the fifth lens is close to the display panel; Along the optical axis direction of the first lens group, the thicknesses of the first lens to the fifth lens satisfy the following relationship: 1.5 <d1 / d2<2; 0 <d2 / d3<0.5; 0.5 <d3 / d4<1; 3 <d4 / d5<3.3; Wherein, d1 represents the thickness of the first lens, d2 represents the thickness of the second lens, d3 represents the thickness of the third lens, d4 represents the thickness of the fourth lens, and d5 represents the thickness of the fifth lens.

12. The eye-tracking optical system according to claim 1, wherein: The first lens group includes a first lens, a second lens, a third lens, a fourth lens and a fifth lens which are arranged in sequence, the first lens is far away from the display panel, and the fifth lens is close to the display panel; The curvature radii of the first lens to the fifth lens satisfy the following relationship: 9<|(R11-R12) / (R11+R12)|<9.5; 0<|(R21-R22) / (R21+R22)|<0.5; 11<|(R31-R32) / (R31+R32)|<12; 1.5<|(R41-R42) / (R41+R42)|<2; 7<|(R51-R52) / (R51+R52)|<7.5; Among them, R11 represents the curvature radius of the side of the first lens away from the display panel, R12 represents the curvature radius of the side of the first lens close to the display panel, R21 represents the curvature radius of the side of the second lens away from the display panel, R22 represents the curvature radius of the side of the second lens close to the display panel, R31 represents the curvature radius of the side of the third lens away from the display panel, R32 represents the curvature radius of the side of the third lens close to the display panel, R41 represents the curvature radius of the side of the fourth lens away from the display panel, R42 represents the curvature radius of the side of the fourth lens close to the display panel, R51 represents the curvature radius of the side of the fifth lens away from the display panel, and R52 represents the curvature radius of the side of the fifth lens close to the display panel.

13. The eye tracking optical system according to any one of claims 1 to 12, characterized in that: The infrared imaging device comprises a second lens group, wherein the second lens group comprises a sixth lens, a seventh lens and an eighth lens arranged in sequence, wherein the sixth lens is close to the first lens group, and the eighth lens is far away from the first lens group; The focal lengths of the sixth lens to the eighth lens satisfy the following relationship: 21<(f26+f27)×f2 / (f26×f27)<21.5; 20<(f27+f28)×f2 / (f27×f28)<20.5; Among them, f26 represents the focal length of the sixth lens, f27 represents the focal length of the seventh lens, f28 represents the focal length of the eighth lens, and f2 represents the focal length of the second lens group.

14. The eye tracking optical system according to any one of claims 1 to 12, characterized in that: The infrared imaging device comprises a second lens group, wherein the second lens group comprises a sixth lens, a seventh lens and an eighth lens arranged in sequence, wherein the sixth lens is close to the first lens group, and the eighth lens is far away from the first lens group; Along the optical axis direction of the second lens group, the thicknesses of the sixth lens to the eighth lens satisfy the following relationship: 2.5 <d6 / d7<3; 2.5 <d7 / d8<3; Wherein, d6 represents the thickness of the sixth lens, d7 represents the thickness of the seventh lens, and d8 represents the thickness of the eighth lens.

15. The eye tracking optical system according to any one of claims 1 to 12, characterized in that: The infrared imaging device comprises a second lens group, wherein the second lens group comprises a sixth lens, a seventh lens and an eighth lens arranged in sequence, wherein the sixth lens is close to the first lens group, and the eighth lens is far away from the first lens group; The curvature radii of the sixth lens to the eighth lens satisfy the following relationship: 0.1<|(R61-R62) / (R61+R62)|<0.5; 0.5<|(R71-R72) / (R71+R72)|<1; 0<|(R81-R82) / (R81+R82)|<0.5; Among them, R61 represents the curvature radius of the sixth lens close to the first lens group, R62 represents the curvature radius of the sixth lens away from the first lens group, R71 represents the curvature radius of the seventh lens close to the first lens group, R72 represents the curvature radius of the seventh lens away from the first lens group, R81 represents the curvature radius of the eighth lens close to the first lens group, and R82 represents the curvature radius of the eighth lens away from the first lens group.

16. The eye-tracking optical system according to claim 1, wherein: The first lens group includes a first lens, a second lens, a third lens, a fourth lens and a fifth lens which are arranged in sequence, the first lens is far away from the display panel, and the fifth lens is close to the display panel; The infrared imaging device comprises a second lens group and a sensor, the second lens group comprises a sixth lens, a seventh lens and an eighth lens arranged in sequence, the sixth lens is close to the fifth lens, the eighth lens is far away from the fifth lens, and the sensor is arranged on a side of the eighth lens far away from the fifth lens; In a direction perpendicular to the display panel, the air gap between the first lens and the eighth lens satisfies the following relationship: 0 <DT1 / DT2<0.1; 0 <DT3 / DT4<0.5; 0.1 <DT5 / DT6<0.2; 1 <DT6 / DT7<1.2; 2 <DT7 / DT8<2.5; Among them, DT1 represents the air gap between the first lens and the second lens, DT2 represents the air gap between the second lens and the third lens, DT3 represents the air gap between the third lens and the fourth lens, DT4 represents the air gap between the fourth lens and the fifth lens, DT5 represents the air gap between the fifth lens and the display panel, DT6 represents the air gap between the sixth lens and the seventh lens, DT7 represents the air gap between the seventh lens and the eighth lens, and DT8 represents the air gap between the eighth lens and the sensor.

17. A display device, characterized in that: include: Display panel; An eye tracking optical system as claimed in any one of claims 1 to 16.

18. The display device according to claim 17, characterized in that: It also includes a housing, wherein the display panel, the first lens group, the infrared light emitting device and the infrared imaging device are located in the housing; The optical axis of the first lens group is perpendicular to the display panel and is located on the same straight line as the center of the display panel; A vertical distance between a first end point of the infrared imaging device and a plane where the optical axis of the first lens group is located is greater than half the height of the display panel, and a vertical distance between the infrared imaging device and a plane where the optical axis of the first lens group is located is less than a vertical distance between a first side of the housing and a plane where the optical axis of the first lens group is located; A vertical distance between the second endpoint of the infrared imaging device and the target plane of the first lens group is smaller than a vertical distance between the target plane of the first lens group and the second side of the housing.

Images