Eye tracking system and head-mounted device

By adding an enhanced film on the eyepiece of the virtual reality device, the problem of infrared light cannot pass is solved, the imaging effect of the image acquisition device is improved, accurate tracking of the user's eye sight/focus point, and the eye tracking system is improved sensitivity and accuracy.

WO2024240061A1PCT designated stage expired Publication Date: 2024-11-28BEIJING 7INVENSUN TECH
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/093805
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-19
Filing Date
2024-05-17
Publication Date
2024-11-28

AI Technical Summary

Technical Problem

In virtual reality devices, the properties of multiple films cause infrared light to be incident on the image acquisition device smoothly through the eyepiece, affecting the sensitivity and accuracy of eye tracking.

Method used

The plating of the amplicon enhances the transmissive film on the outer and/or the inner side of the eyepiece to improve the light transmittance and ensure that infrared light can effectively pass through the eyepiece group, thereby improving the imaging effect of the image acquisition device and realizing the vision/focus of the user's eyes Accurate tracking.

Benefits of technology

Through the use of the amplicon membrane, the transmittance of infrared light is improved, the imaging effect of the image acquisition device is improved, the eye tracking system's ability to estimate the user's eye line of sight/focus point, and the tracking accuracy is improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024093805_28112024_PF_FP_ABST
    Figure CN2024093805_28112024_PF_FP_ABST
Patent Text Reader

Abstract

Provided are an eye tracking system and a head-mounted device. The system comprises a light source (1), an eyepiece group (2), a reflective component (3), and an image acquisition device (4). The eyepiece group (2) comprises an eyepiece (20) and an anti-reflective film (21). The anti-reflective film (21) is located on an outer side surface of the eyepiece (20) and / or an inner side surface of the eyepiece (20). The light source (1) is located at an edge of the outer side surface of the eyepiece (20), and the light source (1) is configured to emit light. The reflective component (3) is located on the side of the eyepiece group (2) away from the light source (1), and the reflective component (3) is located on a primary optical axis of the light. The light, after being reflected by the eyes of a user, passes through the eyepiece group (2), is reflected by the reflective component (3), and then enters the image acquisition device (4), and the image acquisition device (4) is configured to photograph images of the eyes of the user.
Need to check novelty before this filing date? Find Prior Art

Description

Eye tracking systems and head-mounted devices

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on May 19, 2023, with application number 202310573274.9, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of eye tracking technology, for example, to an eye tracking system and a head-mounted device. Background Art

[0003] Eye tracking, also known as gaze tracking, is a technology that estimates the eye's line of sight and / or gaze point by measuring eye movement. With the rapid development of computer vision, artificial intelligence, and digital technologies, eye tracking has become a hot research area with widespread applications in human-computer interaction, such as assisted driving, virtual reality, and the diagnosis of cognitive impairment.

[0004] For virtual reality (VR) devices with eye-tracking capabilities, various films are usually attached to the VR eyepieces to improve optical path folding and compress the volume of the optical module. However, the properties of these films act on the entire wavelength band, which prevents infrared light from passing through the eyepiece and entering the image acquisition device. This affects the imaging effect of image acquisition and ultimately affects the sensitivity and accuracy of eye tracking.

[0005] Summary of the Invention

[0006] The present application provides an eye-tracking system and a head-mounted device, which increase the transmittance of light through the eyepiece assembly by adding a layer of anti-reflection film on the outer side and / or inner side of the eyepiece, thereby improving the imaging effect of the image acquisition device, making it easier for the eye-tracking system to estimate the user's line of sight / gaze point and achieve eye tracking of the user.

[0007] The embodiment of the present application provides an eye tracking system, comprising a light source, an eyepiece assembly, a reflective component, and an image acquisition device;

[0008] The eyepiece assembly includes an eyepiece and an anti-reflection film, wherein the anti-reflection film is located on the outer side surface of the eyepiece and / or the inner side surface of the eyepiece;

[0009] The light source is located at the edge of the outer side of the eyepiece, and the light source is configured to emit light; the reflective component is located on the side of the eyepiece group away from the light source, and the reflective component is located on the main optical axis of the light; the light is reflected by the user's eyes, passes through the eyepiece group, and then enters the image acquisition device after being reflected by the reflective component, and the image acquisition device is configured to capture the user's eye image.

[0010] In one or more embodiments, the eyepiece assembly further includes a semi-transparent and semi-reflective membrane, which is located on the inner side of the eyepiece.

[0011] In one or more embodiments, the effective action wavelength range of the semi-transparent and semi-reflective film is less than 810 nm and / or the effective action wavelength range of the semi-transparent and semi-reflective film is greater than 1000 nm.

[0012] In one or more embodiments, the anti-reflection film includes a first anti-reflection film; the first anti-reflection film is located on the side of the semi-transparent and semi-reflective film close to the inner side of the eyepiece; or, the first anti-reflection film is located on the side of the semi-transparent and semi-reflective film away from the inner side of the eyepiece.

[0013] In one or more embodiments, the light source includes an infrared light source, and the wavelength range of the infrared light source is 810nm to 1000nm.

[0014] In one or more embodiments, the infrared light source emits light at a wavelength of 850 nm or 940 nm.

[0015] In one or more embodiments, the anti-reflection wavelength range of the anti-reflection film is 810nm to 1000nm.

[0016] In one or more embodiments, the reflection wavelength range of the reflective component is 810nm to 1000nm.

[0017] In one or more embodiments, the image acquisition device is located at the edge of the inner side of the eyepiece; or, the image acquisition device is located outside the structure of the eyepiece group.

[0018] In one or more embodiments, the eyepiece assembly further includes a polarizer, a reflective polarizer, and a 1 / 4 phase delay plate; the anti-reflection film further includes a second anti-reflection film;

[0019] Along the first direction, the second antireflection film, the polarizer, the reflective polarizer, and the quarter phase retarder are sequentially arranged on the outer side of the eyepiece; or the polarizer, the second antireflection film, the reflective polarizer, and the quarter phase retarder are sequentially arranged on the outer side of the eyepiece; or the polarizer, the reflective polarizer, the second antireflection film, and the quarter phase retarder are sequentially arranged on the outer side of the eyepiece; or the polarizer, the reflective polarizer, the quarter phase retarder, and the second antireflection film are sequentially arranged on the outer side of the eyepiece;

[0020] The first direction is the direction from the outer side of the eyepiece to the inner side.

[0021] An embodiment of the present application also provides a head-mounted device, including a head-mounted device and the above-mentioned eye tracking system. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] FIG1 is a schematic diagram of the structure of an eye tracking system provided in an embodiment of the present application;

[0023] FIG2 is a schematic diagram of the structure of another eye tracking system provided in an embodiment of the present application;

[0024] FIG3 is a schematic diagram of the structure of another eye tracking system provided in an embodiment of the present application;

[0025] FIG4 is a schematic diagram of the structure of another eye tracking system provided in an embodiment of the present application;

[0026] FIG5 is a partial enlarged schematic diagram of area A in FIG4 ;

[0027] FIG6 is a partial enlarged schematic diagram of area A in FIG4 ;

[0028] FIG7 is a partial enlarged schematic diagram of area A in FIG4 ;

[0029] FIG8 is a partial enlarged schematic diagram of area A in FIG4 ;

[0030] FIG9 is a partial enlarged schematic diagram of area A in FIG4 ;

[0031] FIG10 is a partial enlarged schematic diagram of area A in FIG4 ;

[0032] FIG11 is a schematic diagram of the structure of another eye tracking system provided in an embodiment of the present application;

[0033] FIG12 is a schematic structural diagram of a head-mounted device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0034] The present application is described below in conjunction with the accompanying drawings and embodiments. The embodiments described herein are intended only to explain the present application and are not intended to limit the present application. For ease of description, the accompanying drawings only show portions related to the present application, not all structures.

[0035] The eye tracking method of the present application is an optical recording method: a camera or a video camera is used to record the eye movement of the subject, that is, to obtain an eye image reflecting the eye movement, and to extract eye features from the obtained eye image for establishing a line of sight / gaze point estimation model. Among them, eye features may include: pupil position, pupil shape, iris position, iris shape, eyelid position, eye corner position, light spot (also known as Purkinje spot) position, etc. In the optical recording method, the most mainstream eye tracking method is called Pupil Center Cornea Reflection (PCCR).

[0036] FIG1 is a schematic diagram of the structure of an eye-tracking system provided in an embodiment of the present application; FIG2 is a schematic diagram of the structure of another eye-tracking system provided in an embodiment of the present application; and FIG3 is a schematic diagram of the structure of another eye-tracking system provided in an embodiment of the present application. As shown in FIG1 and FIG3 , the eye-tracking system provided in an embodiment of the present application includes a light source 1, an eyepiece assembly 2, a reflective component 3, and an image capture device 4. The eyepiece assembly 2 includes an eyepiece 20 and an anti-reflection coating 21, the anti-reflection coating 21 being located on the outer side M1 and / or the inner side M2 ​​of the eyepiece 20. The light source 1 is located at the edge of the outer side M1 of the eyepiece 20 and is configured to emit light S. The reflective component 3 is located on the side of the eyepiece assembly 2 away from the light source 1 and is located on the principal optical axis of the light S. After being reflected by the user's eye, the light S passes through the eyepiece assembly 2 and is reflected by the reflective component 3 before entering the image capture device 4, which is configured to capture an image of the user's eye. The reflective component 3 is located on the side of the eyepiece assembly 20 away from the human eye. The light source 1 can also be located on the side of the eyepiece 20 away from the human eye.

[0037] In one or more embodiments, the eyepiece assembly 2 further includes a semi-transparent and semi-reflective membrane 25 ; the semi-transparent and semi-reflective membrane 25 is located on the inner side M2 ​​of the eyepiece 20 .

[0038] In one or more embodiments, the anti-reflection wavelength range of the anti-reflection film 21 is 810 nm to 1000 nm.

[0039] In one or more embodiments, the reflection wavelength range of the reflective component 3 is 810 nm to 1000 nm.

[0040] In one or more embodiments, the eye tracking system provided in the embodiments of the present application further includes a mounting frame (not shown in the figure). As shown in Figures 1 to 3, the light source 1, the eyepiece group 2, and the image acquisition device 4 are fixedly arranged in the mounting frame. The light source 1 includes at least one light emitting light source, which is arranged on the eyepiece 20 or on the edge of the eyepiece 20, close to the side of the human eye. The outer surface M1 of the eyepiece 20 refers to the side surface facing the user's eye, and the inner surface of the eyepiece 20 refers to the side surface away from the user's eye. Among them, the term edge is a range value. In this embodiment, it is assumed that the maximum diameter of the eyepiece 20 is but All belong to the edge of the eyepiece 20.

[0041] The light source 1 can emit light S of a preset wavelength that can be received and reflected by the eyes, such as light in the visible light band, infrared band, etc. The light S emitted by the light source 1 is directed toward the user's eyes. Considering that infrared light will not affect the vision of the eyes, the light source 1 provided in the embodiment of the present application adopts an infrared light source, and the wavelength range of the infrared light source is 810nm to 1000nm, for example, the wavelength can be in the two bands of 850nm and 940nm. Among them, the light source 1 can also be a plurality of infrared light sources arranged and combined in a predetermined manner, such as a circular ring, a semicircular ring, an elliptical ring, a herringbone ring, a straight line ring, etc. The wavelength emitted by the infrared light source is 850nm or 940nm.

[0042] In order to improve the transmittance of the light S emitted by the light source 1 through the eyepiece group 2, an anti-reflection film 21 is added on the outer side surface of the eyepiece 20; or an anti-reflection film 21 is added on the inner side surface M2 of the eyepiece 20; or an anti-reflection film 21 is added on both the outer and inner side surfaces of the eyepiece 20. The light transmission wavelength range of the anti-reflection film 21 at least covers the wavelength range of the light S, which is beneficial to improving the imaging effect of the image acquisition device 4.

[0043] As an example, when an infrared light source is selected, the anti-reflection wavelength range of the anti-reflection film 21 is 810 nm to 1000 nm.

[0044] As an example, the image acquisition device 4 includes at least one image acquisition device 4, such as an infrared camera device, an infrared image sensor, a camera or a video camera, etc. The figure only shows one image acquisition device 4 and the position structure. More structural settings are not shown here one by one.

[0045] As an example, the reflective component 3 can be a reflector. Light S emitted by the light source 1 shines toward the user's eye, reflects from the user's eye, passes through the eyepiece assembly 2, and then reflects from the reflective component 3 before entering the image capture device 4. The image capture device 4 then captures the eye, capturing the reflection point of the light source on the cornea, i.e., the light spot (also known as the Purkinje spot), thereby acquiring an eye image with the light spot. As the eyeball rotates, the relative positional relationship between the pupil center and the light spot changes accordingly. The one or more eye images with the light spot captured by the image capture device 4 reflect this positional change relationship. Based on the captured positional change relationship, the line of sight / gaze point can be estimated to achieve eye tracking of the user.

[0046] In summary, the eye tracking system provided in the embodiment of the present application, by adding a layer of anti-reflection film 21 on the outer surface M1 and / or the inner surface M2 of the eyepiece 20, is beneficial to improving the transmittance of light S through the eyepiece group 2, thereby improving the imaging effect of the image acquisition device 4, facilitating the eye tracking system to estimate the line of sight / gaze point of the user's eyes and realize eye tracking of the user.

[0047] FIG4 is a schematic diagram of the structure of another eye tracking system provided in an embodiment of the present application; FIG5 is a schematic diagram of a partial enlargement of area A in FIG4; FIG6 is a schematic diagram of a partial enlargement of area A in FIG4;

[0048] FIG. 7 is a partial enlarged schematic diagram of area A in FIG. 4 ; FIG. 8 is a partial enlarged schematic diagram of area A in FIG. 4 .

[0049] To reduce the size of VR devices' optical modules, an ultra-short-throw (Pancake) optical solution is often used in the optical structure. Based on the principles of polarized light, the Pancake optical solution utilizes the selective reflection and projection properties of a reflective polarizer for different polarizations. In conjunction with a quarter-wave plate, the polarized light is adjusted to achieve back-and-forth reflection between a half-mirror lens and the reflective polarizer, ultimately transmitting through the reflective polarizer.

[0050] On the basis of the above embodiment, the eyepiece group 2 further includes a polarizer 22, a reflective polarizer 23 and a quarter phase retarder 24; the anti-reflection film 21 includes a second anti-reflection film 211; along a first direction (as shown by the X direction in the figure), the second anti-reflection film 211, the polarizer 22, the reflective polarizer 23, and the quarter phase retarder 24 are sequentially arranged on the outer side surface M1 of the eyepiece 20; or, the polarizer 22, the second anti-reflection film 211, the reflective polarizer 23, and the quarter phase retarder 24 are sequentially arranged on the outer side surface M1 of the eyepiece 20; or, the polarizer 22, the reflective polarizer 23, the second anti-reflection film 211, and the quarter phase retarder 24 are sequentially arranged on the outer side surface M1 of the eyepiece 20; or, the polarizer 22, the reflective polarizer 23, the quarter phase retarder 24, and the second anti-reflection film 211 are sequentially arranged on the outer side surface M1 of the eyepiece 20; wherein the first direction (as shown by the X direction in the figure) is the direction from the outer side surface M1 of the eyepiece 20 to the inner side surface M2. On the basis of the above embodiment, in combination with Figures 4 to 8, the eyepiece assembly 2 further includes a polarizer 22, a reflective polarizer 23, a 1 / 4 phase delay plate 24 and a semi-transparent and semi-reflective film 25; the semi-transparent and semi-reflective film 25 is located on the inner side M2 ​​of the eyepiece 20. The anti-reflection film 21 includes a second anti-reflection film 211; along a first direction (as shown by the X direction in the figure), the second anti-reflection film 211, the polarizer 22, the reflective polarizer 23, and the 1 / 4 phase delay plate 24 are sequentially arranged on the outer side surface M1 of the eyepiece 20; or, the polarizer 22, the second anti-reflection film 211, the reflective polarizer 23, and the 1 / 4 phase delay plate 24 are sequentially arranged on the outer side surface M1 of the eyepiece 20; or, the polarizer 22, the reflective polarizer 23, the second anti-reflection film 211, and the 1 / 4 phase delay plate 24 are sequentially arranged on the outer side surface M1 of the eyepiece 20; or, the polarizer 22, the reflective polarizer 23, the 1 / 4 phase delay plate 24, and the second anti-reflection film 211 are sequentially arranged on the outer side surface M1 of the eyepiece 20; wherein the first direction (as shown by the X direction in the figure) is the direction from the outer side surface M1 of the eyepiece 20 to the inner side surface M2.

[0051] As an example, in combination with Figures 4 to 8, the VR optical structure provided in the embodiment of the present application can adopt a one-piece Pancake optical solution. In the Pancake optical solution, a polarizer 22, a reflective polarizer 23, and a 1 / 4 phase delay plate 24 are respectively provided on the outer side M1 of the eyepiece 20 (i.e., the side of the eyepiece 20 close to the human eye), and a semi-transparent and semi-reflective film 25 is provided on the inner side M2 ​​of the eyepiece 20 (i.e., the side of the eyepiece 20 away from the human eye). The Pancake optical solution utilizes the characteristics of the reflective polarizer 23 that selectively reflects and projects light of different polarizations, and cooperates with the 1 / 4 phase delay plate 24 to adjust the polarization shape of the light s0 (external ambient light) or the light s0 emitted by the display screen (not shown in the figure) to reflect back and forth between the semi-transparent and semi-reflective film 25 and the reflective polarizer 23, and finally transmits through the polarizer 22 and is perceived by the eye. The functional advantage of the Pancake optical solution is that the optical path is folded, and the volume of the optical module is greatly reduced, making the VR device lighter and thinner, and improving the user's comfort and immersion. However, when the VR device adopts a one-piece Pancake optical solution, since multiple films are attached to the eyepiece 20 and the properties of the films act on the entire band, the infrared light cannot pass through the eyepiece 20 smoothly and enter the image acquisition device 4.

[0052] Based on this, the present application combines the Pancake optical solution in FIG. to add a second antireflection film 211 on the outer surface of the eyepiece 20. For example, an infrared light source is selected, and the antireflection wavelength range of the second antireflection film 211 is 810nm to 1000nm. The second antireflection film 211 can be set in various positions on the outer surface M1 of the eyepiece 20.

[0053] A feasible implementation is shown in FIG5 , in which a second antireflection film 211 , a polarizer 22 , a reflective polarizer 23 , and a quarter phase retarder 24 are sequentially attached to the outer surface M1 of the eyepiece 20 along the X direction in the figure.

[0054] In this way, the light S emitted by the light source 1 is reflected by the eye and then filtered by the second anti-reflection film 211. It then passes through the polarizer 22, the reflective polarizer 23, the 1 / 4 phase delay plate 24 and the semi-transparent and semi-reflective film 25 in sequence, and then enters the image acquisition device 4 after being reflected by the reflective component 3. By adding the second anti-reflection film 211, the light in the infrared band is selectively increased in transmittance, thereby improving the transmittance of the infrared light and improving the imaging effect of the image acquisition device 4.

[0055] Another feasible implementation, as shown in FIG6 , is to arrange a polarizer 22 , a second antireflection film 211 , a reflective polarizer 23 , and a 1 / 4 phase retarder 24 sequentially attached to the outer surface M1 of the eyepiece 20 along the X direction in the figure.

[0056] Another feasible implementation, as shown in FIG7 , is to arrange a polarizer 22 , a reflective polarizer 23 , a second antireflection film 211 , and a quarter phase retarder 24 sequentially attached to the outer surface M1 of the eyepiece 20 along the X direction in the figure.

[0057] Another feasible implementation is as shown in FIG8 , in which a polarizer 22 , a reflective polarizer 23 , a quarter phase retarder 24 , and a second antireflection film 211 are sequentially attached to the outer side surface M1 of the eyepiece 20 along the X direction in the figure.

[0058] With the above film layer arrangement, the second antireflection film 211 can selectively enhance the transmittance of the light S emitted by the light source 1 , thereby increasing the transmittance of infrared light and improving the imaging effect of the image acquisition device 4 .

[0059] Among them, in the present application, the polarizer 22 is configured to convert the incident light into linearly polarized light, and the 1 / 4 phase delay plate 24 is configured to convert the incident light into circularly polarized light; the 1 / 4 phase delay plate 24, the reflective polarizer 23 and the polarizer 22 are attached to the eyepiece 20, which are respectively configured to generate different polarized light, transmit or reflect different polarized light, and filter stray light to ensure that linearly polarized light is emitted.

[0060] Figure 9 is a partial enlarged schematic diagram of area A in Figure 4; Figure 10 is a partial enlarged schematic diagram of area A in Figure 4; Figure 11 is a structural schematic diagram of another eye tracking system provided in an embodiment of the present application.

[0061] Optionally, in combination with Figures 9 to 11, the anti-reflection film 21 includes a first anti-reflection film 212; the first anti-reflection film 212 is located on the side of the semi-transparent and semi-reflective film 25 close to the inner side surface M2 of the eyepiece 20; or, the first anti-reflection film 212 is located on the side of the semi-transparent and semi-reflective film 25 away from the inner side surface M2 of the eyepiece 20.

[0062] In one or more embodiments, as shown in FIG. 9 and FIG. 10 , a first antireflection film 212 may be further provided on the inner side surface M2 of the eyepiece 20 to increase the transmittance of the light S (which may be infrared light).

[0063] In a feasible implementation, as shown in FIG9 , a first antireflection film 212 is attached to the inner side surface M2 of the eyepiece 20 , and a semi-transparent and semi-reflective film 25 is attached to the surface of the first antireflection film 212 .

[0064] In another feasible implementation, as shown in FIG. 10 , a semi-transparent and semi-reflective film 25 is attached to the inner side surface M2 of the eyepiece 20 , and a first anti-reflective film 212 is attached to the surface of the semi-transparent and semi-reflective film 25 .

[0065] Based on the above embodiment, as shown in FIG11 , a second antireflection film 211 may be added to the outer surface M1 of the eyepiece 20, and a first antireflection film 212 may be added to the inner surface M2 of the eyepiece 20. By adding two layers of transmissive films, the transmittance of the light S is increased, thereby improving the imaging effect of the image acquisition device 4.

[0066] The position of the second anti-reflection film 211 on the outer side surface M1 of the eyepiece 20 in Figures 5 to 8 and the position of the first anti-reflection film 212 on the inner side surface M2 of the eyepiece 20 in Figures 9 to 10 can be freely matched. Figure 11 only shows a feasible film layer design structure, and more film layer design structures are not shown here one by one.

[0067] The operating wavelength range of the semi-transparent and semi-reflective film 25 is less than 810 nm and / or the operating wavelength range of the semi-transparent and semi-reflective film 25 is greater than 1000 nm.

[0068] Based on the above embodiments, as shown in conjunction with FIG9 , FIG10 , and FIG11 , the effective operating wavelength range of the translucent and semi-reflective film 25 is less than 810 nm and / or the effective operating wavelength range of the translucent and semi-reflective film 25 is greater than 1000 nm. That is, the translucent and semi-reflective film 25 is operative within the wavelength range less than 810 nm and / or greater than 1000 nm, but is inoperative within the wavelength range of 810 nm to 1000 nm. Light with a wavelength of 810 nm to 1000 nm can directly pass through the translucent and semi-reflective film 25 without being reflected.

[0069] As an example, a film layer with a light transmission wavelength range greater than 810nm and less than 1000nm can be added to the surface of the semi-transparent and semi-reflective film 25 to ensure that infrared light with a wavelength of 810nm to 1000nm can pass through, thereby improving the transmittance of infrared light.

[0070] Based on the above embodiment, in combination with Figures 1 to 4 and 11, the image acquisition device 4 is located at the edge of the inner side M2 ​​of the eyepiece 20; or, the image acquisition device 4 is located outside the structure of the eyepiece assembly 2. The term "edge" is a range value. In this embodiment, it is assumed that the maximum diameter of the eyepiece 20 is but They all belong to the edge portion of the inner side surface of the eyepiece 20.

[0071] In VR products, the image acquisition device 4 can be arranged as a built-in reflective device or an external direct-view camera. The infrared light source is typically located on the outside of the lens, near the eye. Therefore, the infrared light is reflected by the eye, refracted by the eyepiece assembly 2, and reflected by the reflective component 3 before being captured by the image acquisition device 4.

[0072] 1 to 4 and 11 , by flexibly setting the position of the image acquisition device 4 in the built-in reflective optical path for capturing eye images in the image acquisition device 4, the position of the image acquisition device 4 in the eyepiece group 2 can be saved, the volume of the eye tracking optical system can be compressed, and the structural design requirements of compact eye tracking can be met.

[0073] Based on the same application concept, an embodiment of the present application provides a head-mounted device, including a head-mounted device 5 and the eye tracking system provided in the above embodiment, which can be used in user-wearable eye tracking and iris recognition applications. The head-mounted device can be a virtual reality device, an augmented reality device, or a mixed reality device. As shown in Figure 12, the eyepiece group 2 and the light source 1 in the eye tracking system can be located in the head-mounted device 5. Optionally, the head-mounted device also includes a display screen (not shown in the figure); the display screen is located on the side of the eyepiece group away from the user's eyes, and the display screen is a multi-dimensional display screen, which is configured to display multi-dimensional images.

[0074] In one or more embodiments, the display screen can be an organic light emitting diode (OLED) display screen, a light emitting diode (LED) display screen, a micro light emitting diode (MicroLED) display screen, etc., to display color or black and white images. The multi-dimensional image light emitted by the display screen passes through the eyepiece assembly and reaches the user's eyes to form an image.

Claims

1. An eye tracking system, comprising a light source, an eyepiece assembly, a reflective component, and an image acquisition device; The eyepiece assembly comprises an eyepiece and an anti-reflection film, wherein the anti-reflection film is located at least one of the following: an outer side surface of the eyepiece, or an inner side surface of the eyepiece; The light source is located at the edge of the outer side of the eyepiece, and the light source is configured to emit light; the reflective component is located on a side of the eyepiece group away from the light source, and the reflective component is located on the main optical axis of the light; the light is reflected by the user's eyes, passes through the eyepiece group, and enters the image acquisition device after being reflected by the reflective component, and the image acquisition device is configured to acquire the user's eye image.

2. The system according to claim 1, wherein: The eyepiece assembly further comprises a semi-transparent and semi-reflective membrane, and the semi-transparent and semi-reflective membrane is located on the inner side of the eyepiece.

3. The system according to claim 2, wherein: The effective action wavelength range of the semi-transparent and semi-reflective film is less than 810nm or the effective action wavelength range of the semi-transparent and semi-reflective film is greater than 1000nm, or the effective action wavelength range of the semi-transparent and semi-reflective film is less than 810nm and the effective action wavelength range of the semi-transparent and semi-reflective film is greater than 1000nm.

4. The system according to claim 2, wherein: The anti-reflection film includes a first anti-reflection film, which is located on a side of the semi-transparent and semi-reflective film close to the inner side of the eyepiece; or, the first anti-reflection film is located on a side of the semi-transparent and semi-reflective film away from the inner side of the eyepiece.

5. The system according to claim 1, wherein: The light source comprises an infrared light source, and the wavelength range of the infrared light source is 810nm to 1000nm.

6. The system according to claim 5, wherein: The infrared light source emits an emission wavelength of 850nm or 940nm.

7. The system according to claim 1, wherein: The anti-reflection wavelength range of the anti-reflection film is 810nm to 1000nm.

8. The system according to claim 1, wherein: The reflection wavelength range of the reflective component is 810nm to 1000nm.

9. The system according to claim 1, wherein: The image acquisition device is located at the edge of the inner side of the eyepiece; or, the image acquisition device is located outside the structure of the eyepiece group.

10. The system according to claim 1 or 2, wherein: The eyepiece assembly further includes a polarizing plate, a reflective polarizing plate and a 1 / 4 phase delay plate; the anti-reflection film further includes a second anti-reflection film; Along the first direction, the second anti-reflection film, the polarizer, the reflective polarizer, and the 1 / 4 phase delay plate are sequentially arranged on the outer side of the eyepiece; or the polarizer, the second anti-reflection film, the reflective polarizer, and the 1 / 4 phase delay plate are sequentially arranged on the outer side of the eyepiece; or The polarizer, the reflective polarizer, the second anti-reflection film, and the 1 / 4 phase delay plate are sequentially arranged on the outer side of the eyepiece; or the polarizer, the reflective polarizer, the 1 / 4 phase delay plate, and the second anti-reflection film are sequentially arranged on the outer side of the eyepiece; The first direction is the direction from the outer side of the eyepiece to the inner side.

11. A head-mounted device, comprising a head-mounted device and the eye tracking system according to any one of claims 1 to 10.

Citation Information

Patent Citations

  • Eye tracking optical system, headset device and imaging method

    CN109725416A

  • Near-to-eye display optical system for eyeball tracking

    CN111766702A

  • Eyeball tracking optical device, optical system, display device, and display system

    CN114019678A

  • Optical imaging system

    CN115857175A

  • Eyeball tracking module and head-mounted display equipment

    CN209117975U