Eye tracking device and smart glasses

Abstract

The application discloses an eye movement tracking device and smart glasses, and belongs to the technical field of communication. The eye movement tracking device comprises a light supplementing light source, which is used for irradiating a first light supplementing light with a first preset central wavelength or a second light supplementing light with a second preset central wavelength to a human eye based on the ambient light intensity where the human eye is located, the solar spectrum illuminance corresponding to the first preset central wavelength and the second preset central wavelength is less than a preset threshold, and the wavelength range of the first light supplementing light is different from that of the second light supplementing light; a camera is used for collecting a pupil image formed when the first light supplementing light or the second light supplementing light irradiates the human eye; and a processor is used for determining the movement of the human eye according to the pupil image, and the camera tracks the movement of the human eye.

Description

Technical Field

[0001] This application belongs to the field of communication technology, specifically relating to an eye-tracking device and smart glasses. Background Technology

[0002] Eye-tracking technology, used in smart glasses including VR / AR / MR, refers to tracking eye movements by measuring the position of the user's gaze point or the movement of the eyeballs relative to the head. The purpose is to monitor the user's eye movements and gaze direction when looking at a specific target.

[0003] Typically, eye-tracking devices use corneal reflection. An infrared light source illuminates the user's eye, creating a blinking dot on the cornea. This blinking dot is produced by the reflection of light entering the pupil onto the outer surface of the cornea. The reflection, along with an image of the pupil, is captured by a camera sensitive to the infrared spectrum. Image processing techniques are used to calculate the pupil center and measure the relative motion between the pupil and the corneal reflection, thereby estimating the user's gaze point.

[0004] All related eye-tracking devices are based on near-infrared (NIR) optical systems, using light-emitting diodes (LEDs) as supplementary lights. The center wavelength of these lights is typically 850nm or 940nm. However, when smart glasses are used outdoors, strong sunlight interference causes a decrease in image quality. To improve image quality, the power of the supplementary lights needs to be increased. However, increasing the power of the supplementary lights not only increases power consumption but also increases the harm to the eyes, causing visual fatigue and even cataracts and retinal burns. Summary of the Invention

[0005] The purpose of this application is to provide an eye-tracking device and smart glasses that can solve the problem of high power consumption and eye damage caused by the supplementary lighting in existing eye-tracking devices in order to improve outdoor image quality.

[0006] In a first aspect, embodiments of this application provide an eye-tracking device, which includes:

[0007] A supplementary light source is used to irradiate the human eye with a first supplementary light ray having a first preset center wavelength or a second supplementary light ray having a second preset center wavelength based on the ambient light intensity of the human eye. The solar spectral illuminance corresponding to the first preset center wavelength and the second preset center wavelength is less than a preset threshold, and the wavelength range of the first supplementary light ray is different from that of the second supplementary light ray.

[0008] A camera is used to capture a pupil image formed when the first or second supplementary light beam illuminates the human eye; a processor is used to determine the movement of the human eye based on the pupil image, and the camera tracks the movement of the human eye.

[0009] Secondly, embodiments of this application provide an eye-tracking method applied to the eye-tracking device as described in the first aspect, comprising:

[0010] Based on the ambient light intensity of the human eye, a first supplementary light ray with a first preset center wavelength or a second supplementary light ray with a second preset center wavelength is shone onto the human eye. The solar spectral illuminance corresponding to the first preset center wavelength and the second preset center wavelength is less than a preset threshold. The wavelength range of the first supplementary light ray is different from that of the second supplementary light ray.

[0011] Acquire a pupil image formed when the first supplementary light or the second supplementary light shines on the human eye;

[0012] The movement of the human eye is determined based on the pupil image.

[0013] Thirdly, embodiments of this application provide a smart glasses, including a light intensity sensor, the processor, and an eye-tracking device as described in the first aspect. The eye-tracking device is disposed on the smart glasses at a position corresponding to the human eye. The light intensity sensor is connected to the processor and is used to detect the ambient light intensity where the human eye is located and transmit it to the processor. The processor is used to drive the supplementary light source to illuminate the human eye with the first supplementary light ray or the second supplementary light ray based on the comparison result between the ambient light intensity and the preset light intensity threshold.

[0014] In this embodiment, the eye-tracking device includes a supplementary light source used to illuminate the human eye with supplementary light having a first preset center wavelength or a second preset center wavelength, based on the ambient light intensity. The solar spectral illuminance corresponding to the first and second preset center wavelengths is less than a preset threshold. The wavelength range of the supplementary light with the first preset center wavelength is different from that of the supplementary light with the second preset center wavelength. A camera is used to capture the pupil image formed when the supplementary light illuminates the human eye and transmit it to a processor. The processor determines the movement of the human eye based on the pupil image, and the camera tracks the movement of the human eye. Thus, by illuminating supplementary light with a center wavelength corresponding to a solar spectral illuminance less than the preset threshold, even in strong outdoor light conditions, sunlight has minimal or almost no interference with the supplementary light illuminating the human eye. Therefore, this supplementary light can form a pupil image with a high signal-to-noise ratio, improving the pupil image quality. Simultaneously, it avoids the increased power consumption and potential harm to the human eye caused by increasing the power of the supplementary light to improve pupil image quality. Furthermore, by irradiating the human eye with supplementary light of different wavelengths based on the ambient light intensity, and switching between different supplementary light sources according to different ambient light intensities, the power consumption of the eye-tracking device can be reduced and the working efficiency of the eye-tracking device can be improved. Attached Figure Description

[0015] Figure 1 This is a structural block diagram of the eye-tracking device according to an embodiment of this application.

[0016] Figure 2 This is a schematic diagram of the solar spectrum composition.

[0017] Figure 3 This is one of the structural schematic diagrams of the eye-tracking device according to an embodiment of this application.

[0018] Figure 4 This is the second schematic diagram of the eye-tracking device according to an embodiment of this application.

[0019] Figure 5 This is the third schematic diagram of the eye-tracking device according to an embodiment of this application.

[0020] Figure 6 This is a flowchart illustrating the eye-tracking method according to an embodiment of this application.

[0021] Figure 7 This is a schematic diagram of the structure of the smart glasses according to an embodiment of this application. Detailed Implementation

[0022] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0023] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0024] The eye-tracking device and smart glasses provided in this application will be described in detail below with reference to the accompanying drawings, through specific embodiments and application scenarios.

[0025] In one embodiment, an eye-tracking device is provided, comprising: a supplementary light source, the supplementary light source being used to illuminate the human eye with a first supplementary light ray having a first preset center wavelength or a second supplementary light ray having a second preset center wavelength based on the ambient light intensity of the human eye, wherein the solar spectral illuminance corresponding to the first preset center wavelength and the second preset center wavelength is less than a preset threshold, and the wavelength range of the first supplementary light ray is different from that of the second supplementary light ray; a camera, used to acquire a pupil image formed when the first supplementary light ray or the second supplementary light ray illuminates the human eye; and a processor, used to determine the movement of the human eye based on the pupil image, wherein the camera tracks the movement of the human eye.

[0026] Figure 1 This is a schematic diagram of the structure of an eye-tracking device according to an embodiment of this application. The eye-tracking device 100 of this application embodiment can be installed on smart glasses to collect pupil images of users wearing smart glasses.

[0027] like Figure 1 As shown, the eye-tracking device 100 includes a supplementary light source 10 and a camera 20. The supplementary light source 10 is used to illuminate the eyes of a user wearing smart glasses. Illumination means that the light emitted by the supplementary light source 10 directly illuminates the eyes without passing through any other medium except air. The light entering the pupil is reflected on the outer surface of the cornea of ​​the eye to produce a flashing point.

[0028] In this embodiment, the supplementary light source 10 can illuminate the human eye with one of two supplementary light rays having different center wavelengths, depending on the ambient light intensity. Specifically, it can provide a first supplementary light ray with a first preset center wavelength or a second supplementary light ray with a second preset center wavelength. When the user is indoors, the ambient light intensity may be determined by the intensity of artificial light and / or sunlight illuminating the room; when the user is outdoors during the day, the ambient light intensity is typically determined by the intensity of sunlight.

[0029] Furthermore, the solar spectral illuminance corresponding to the first and second preset center wavelengths is less than a preset threshold, which can be close to zero. Also, the two types of light have different wavelength ranges, meaning their wavelength ranges do not overlap. The wavelength range is determined based on the center wavelength and wavelength bandwidth; for example, if the center wavelength is 'a' and the wavelength bandwidth is 'b', then the wavelength range is 'a±b'.

[0030] The supplementary light source illuminates the center wavelength of the solar spectrum with an illuminance close to zero. Even when the smart glasses are used outdoors in strong light, the interference of ambient sunlight on the supplementary light is minimal or non-existent. The signal-to-noise ratio of the pupil image formed by the human eye reflection is high, and it does not cause a decrease in image quality.

[0031] The choice between illuminating a supplementary light source 10 with a first preset center wavelength or a second preset center wavelength, based on the ambient light intensity at which the human eye is located, will be described in detail below. However, regardless of the type of supplementary light illuminating, the solar spectral illuminance corresponding to the center wavelength of the supplementary light must be less than the aforementioned preset threshold.

[0032] Optionally, the first preset center wavelength is between 1119-1121nm, and the second preset center wavelength is between 1370-1390nm; or the first preset center wavelength is between 1370-1390nm, and the second preset center wavelength is between 1370-1390nm; the wavelength range of the supplementary light of the first preset center wavelength is determined according to the first preset center wavelength and the preset wavelength bandwidth, and the wavelength range of the supplementary light of the second preset center wavelength is determined according to the second preset center wavelength and the preset wavelength bandwidth, wherein the preset wavelength bandwidth is between 20nm-50nm.

[0033] refer to Figure 2 As shown in the schematic diagram of the solar spectrum composition, wavelengths around 1120nm and 1380nm have near-zero solar spectral illuminance, and near-infrared light is invisible. Furthermore, photons at wavelengths around 1120nm and 1380nm have lower energy and are less harmful to the human eye, especially at 1380nm where photon energy is significantly attenuated by the time it reaches the retina.

[0034] Therefore, when the supplementary lighting source illuminates with supplementary light rays with a center wavelength between 1119-1121 nm or between 1370-1390 nm, and the solar spectral illuminance of the supplementary light rays is close to zero, the ambient sunlight has almost no interference with the supplementary light rays, and the supplementary light rays will not cause a decrease in the quality of the pupil image reflected by the human eye outdoors. At the same time, because the photon energy of the supplementary light rays with the aforementioned center wavelengths is low, it also reduces the harm to the human eye.

[0035] The wavelengths around 1120nm and 1380nm refer to wavelengths with a bandwidth greater than 20nm and less than 50nm. For example, around 1380nm, it is preferred to use 1380nm±20nm, with a wavelength bandwidth of 40nm; around 1120nm, it is preferred to use 1120nm±10nm, with a wavelength bandwidth of 20nm.

[0036] Camera 20 tracks the movement of the human eye and is used to capture the pupil image formed by the reflection of supplementary light when the human eye is illuminated, and transmits it to processor 30. Processor 30 determines the movement of the human eye based on the pupil image.

[0037] As described above, the supplementary light source 10 can illuminate the human eye with supplementary light of either a first preset center wavelength or a second preset center wavelength. That is, a dual-wavelength supplementary light system is adopted, with supplementary light of corresponding center wavelengths illuminating the eye from two different light sources.

[0038] Optionally, the supplementary light source includes a first supplementary light source and a second supplementary light source. The first supplementary light source is used to illuminate the human eye with the first supplementary light when the ambient light intensity is not greater than a preset light intensity threshold. The second supplementary light source is used to illuminate the human eye with the second supplementary light when the ambient light intensity is greater than the preset light intensity threshold. The wavelength range of the second supplementary light is greater than that of the first supplementary light.

[0039] Figure 3 This is a schematic diagram of the structure of the eye-tracking device according to an embodiment of this application, as shown below. Figure 3 As shown, the supplementary light source 10 includes a first supplementary light source 12 and a second supplementary light source 14, which can be two light source chips.

[0040] Optionally, the supplementary light source includes a vertical cavity surface-emitting laser (VCSEL) source.

[0041] For example, both light source chips use vertical cavity surface-emitting lasers (VCSELs).

[0042] In this embodiment, the wavelength range of the second supplementary light irradiated by the second supplementary light source 14 is greater than the wavelength range of the first supplementary light irradiated by the first supplementary light source 12.

[0043] The larger the wavelength range, the lower the luminous efficiency. The first supplementary light source 12 has a higher electro-optical conversion efficiency than the second supplementary light source 14.

[0044] For example, the first preset center wavelength is between 1119-1121 nm, and the second preset center wavelength is between 1370-1390 nm. Correspondingly, the first supplementary light source 12 has a higher electro-optical conversion efficiency than the second supplementary light source 14, thus eliminating sunlight interference in indoor environments and offering the advantage of lower power consumption. Under strong outdoor light, the second supplementary light source 14 corresponds to a lower solar spectral illuminance than the first supplementary light source 12, resulting in no sunlight interference, higher signal purity, and lower photon energy, thus offering the advantages of lower power consumption and less harm to the human eye.

[0045] The preset light intensity threshold is a threshold that distinguishes between indoor and outdoor environments. It can be detected by the light intensity sensor set on the smart glasses, and the detection result is transmitted to the processor 30. The processor 30 then controls the corresponding supplementary light source to light up, so as to send supplementary light of the corresponding center wavelength.

[0046] Therefore, when the ambient light intensity is not greater than the preset light intensity threshold, i.e., in an indoor environment, the first supplementary light source can be lit to illuminate the human eye with the first supplementary light of the first preset center wavelength; when the ambient light intensity is greater than the preset light intensity threshold, i.e., in an outdoor environment, the second supplementary light source can be lit to illuminate the human eye with the second supplementary light of the second preset center wavelength.

[0047] like Figure 3 As shown, a diffuser 16 is placed above the two supplementary light sources. The diffuser 16 modulates the Gaussian-distributed light field emitted by the VCSEL supplementary light source into a uniformly distributed light field to provide uniform illumination. At the same time, it increases the emission angle, for example, the emission angle in both the horizontal and vertical directions is 40°-60°, to uniformly illuminate the entire human eye. The supplementary light rays that illuminate the human eye are reflected to form a pupil image, which is then captured by a camera.

[0048] When the center wavelength of the supplementary light source is different, cameras with different filtering effects are required. Optionally, the camera includes a first camera and a second camera, wherein the first camera is used to capture the pupil image formed when the first supplementary light shines on the human eye, and the second camera is used to capture the pupil image formed when the second supplementary light shines on the human eye.

[0049] like Figure 3As shown, the eye-tracking device includes a first supplementary light source 12 and a second supplementary light source 14, and correspondingly includes a first camera 22 and a second camera 24. The first camera 22 is used to capture the pupil image formed when the first supplementary light source 12 illuminates the human eye, and the second camera 24 is used to capture the pupil image formed when the second supplementary light source 14 illuminates the human eye.

[0050] The first supplementary light source 12, the second supplementary light source 14 PCB board, the first camera 22 and the second camera 24 are disposed on the printed circuit board 40.

[0051] Optionally, the camera includes a receiver and an image sensor stacked together. The receiver is used to receive a fourth light ray, which is a third light ray reflected by the human eye when the first or second supplementary light ray illuminates the human eye, and the third light ray has the same wavelength as the illuminating supplementary light ray. The image sensor is used to convert the optical signal of the fourth light ray into an electrical signal.

[0052] The receiving device includes a lens and a filter layer. Supplemental light shines onto the human eye and is reflected to form a pupil image. This pupil image is emitted along with ambient light. The receiving device, through the lens and filter layer, filters and collects light from various wavelengths that contain the supplemental light band, thus obtaining the imaging light signal corresponding to the pupil image. The camera's image sensor receives this light signal, converts it into an electrical signal, and transmits it to the processor 30 for image processing and eye tracking.

[0053] Optionally, the image sensor includes a colloidal quantum dot sensor.

[0054] The camera's image sensor uses a colloidal quantum dot (CQD) sensor, which can respond at both 1120nm and 1380nm. The CQD sensor's photosensitive material is colloidal quantum dots.

[0055] In one embodiment, the receiving device may optionally include a receiving lens and a filter stacked together, the receiving lens being a plastic aspherical structure for converging the third light ray; the filter being for allowing the fourth light ray in the converged third light ray to pass through.

[0056] like Figure 4 As shown, the receiving device of the first camera 22 includes a receiving lens 222 and a filter 2241. The receiving lens 222 can be made of two plastic aspherical surfaces to converge the third light reflected by the human eye. The filter 2241 is disposed below the receiving lens 222 to allow the fourth light in the converged third light to pass through, that is, to allow the light in the third light with the same wavelength as the first supplementary light to pass through and enter the image sensor 226 below.

[0057] Similarly, as Figure 4 As shown, the receiving device of the second camera 24 includes a receiving lens 222 and a filter 2242. The receiving lens 222 also uses two plastic aspherical surfaces to converge the light reflected from the human eye. The filter 2242 is located below the receiving lens 222 to allow the fourth light in the converged third light to pass through, that is, to allow the light in the third light that has the same wavelength as the second supplementary light to pass through and enter the image sensor 226 below.

[0058] Taking the first camera 22 acquiring light from the first supplementary light source 12 with a center wavelength of 1120nm as an example, the filter 2241 only allows light with a wavelength near 1120nm to pass through. The filter 2241 is, for example, a narrowband filter. The passband of a narrowband filter is relatively narrow, generally less than 5% of the center wavelength.

[0059] Taking the second camera 24 acquiring light from the second supplementary light source 14 with a center wavelength of 1380nm as an example, the filter 2242 only allows light with a wavelength near 1380nm to pass through. The filter 2242 is, for example, a narrowband filter.

[0060] The filtered light is processed by an image sensor 226 located below the filter, which will not be described in detail here.

[0061] In another embodiment, optionally, the receiving device is a superlens, the superlens comprising a glass substrate, a filter layer stacked on a first surface of the glass substrate near the human eye, and microstructures stacked on a second surface of the glass substrate away from the human eye; the filter layer is used to allow the fourth ray in the third ray to pass through; the microstructures are used to converge the fourth ray.

[0062] like Figure 5 As shown, the receiving device of the first camera 22 is a superlens, which includes a glass substrate 2224, a filter layer 2221 stacked on the upper surface of the glass substrate 2224 near the human eye, and a microstructure 2225 stacked on the lower surface of the glass substrate 2224 away from the human eye.

[0063] The filter layer 2221 on the upper surface is used to allow the fourth light ray in the converged third light ray to pass through, that is, to allow the light ray in the third light ray with the same wavelength as the first supplementary light ray to pass through and enter the microstructure 2225 below. The microstructure 2225 is used to converge the light reflected by the human eye and emit the converged light to the image sensor 226 below.

[0064] Similarly, as Figure 5As shown, the receiving device of the second camera 24 is a superlens, which includes a glass substrate 2224, a filter layer 2222 stacked on the upper surface of the glass substrate 2224 near the human eye, and a microstructure 2226 stacked on the lower surface of the glass substrate 2224 away from the human eye.

[0065] The filter layer 2222 on the upper surface is used to allow the fourth ray in the converged third ray to pass through, that is, to allow the ray in the third ray with the same wavelength as the second supplementary ray to pass through and enter the microstructure 2226 below. The microstructure 2226 is used to converge the light reflected by the human eye and emit the converged light to the image sensor 226 below.

[0066] Taking the first camera 22 collecting light from the first supplementary light source 12 with a center wavelength of 1120nm as an example, the filter layer 2221 only allows light with a wavelength near 1120nm to pass through. The filter 2221 is, for example, a narrowband filter layer.

[0067] Taking the second camera 24 acquiring light from the second supplementary light source 14 with a center wavelength of 1380nm as an example, the filter layer 2222 only allows light with a wavelength near 1380nm to pass through, and the filter 2242 is, for example, a narrowband filter layer.

[0068] In the above embodiments, the receiving devices of the first camera 22 and the second camera 24 can adopt the same structure or different structures, preferably the same structure.

[0069] In this embodiment, the eye-tracking device includes a supplementary light source used to illuminate the human eye with a first supplementary light beam having a first preset center wavelength or a second supplementary light beam having a second preset center wavelength, based on the ambient light intensity. The solar spectral illuminance corresponding to the first and second preset center wavelengths is less than a preset threshold. The wavelength range of the first supplementary light beam is different from that of the second supplementary light beam. A camera tracks the movement of the human eye and captures a pupil image formed when the supplementary light beam illuminates the eye, transmitting it to a processor. The processor then determines the movement of the human eye based on the pupil image. By illuminating supplementary light beams with a center wavelength corresponding to a solar spectral illuminance less than a preset threshold, even in strong outdoor light conditions, sunlight has minimal or almost no interference with the supplementary light beam illuminating the eye. Therefore, this supplementary light beam can form a pupil image with a high signal-to-noise ratio, improving the pupil image quality. Simultaneously, it avoids the increased power consumption and potential harm to the human eye caused by increasing the power of the supplementary light to improve pupil image quality. Furthermore, by irradiating the human eye with supplementary light of different wavelengths based on the ambient light intensity, and switching between different supplementary light sources according to different ambient light intensities, the power consumption of the eye-tracking device can be reduced and the working efficiency of the eye-tracking device can be improved.

[0070] Optionally, such as Figure 6 As shown in the embodiments of this application, an eye-tracking method is also provided, applied to the method described above. Figures 1 to 5 The eye-tracking device 100 described in any of the embodiments, Figure 6 This is a flowchart illustrating the eye-tracking method according to an embodiment of this application.

[0071] The method includes the following steps:

[0072] Step 202: Irradiate the human eye with a first supplementary light ray having a first preset center wavelength or a second supplementary light ray having a second preset center wavelength based on the ambient light intensity of the human eye. The solar spectral illuminance corresponding to the first preset center wavelength and the second preset center wavelength is less than a preset threshold. The wavelength range of the first supplementary light ray is different from that of the second supplementary light ray.

[0073] Step 204: Acquire a pupil image formed when the first supplementary light or the second supplementary light illuminates the human eye;

[0074] Step 206: Determine the movement of the human eye based on the pupil image.

[0075] Optionally, irradiating the human eye with a first supplementary light having a first preset center wavelength or a second supplementary light having a second preset center wavelength based on the ambient light intensity, includes:

[0076] When the ambient light intensity is not greater than a preset light intensity threshold, a first supplementary light ray with the first preset center wavelength is shone onto the human eye.

[0077] When the ambient light intensity is greater than the preset light intensity threshold, a second supplementary light ray with the second preset center wavelength is shone onto the human eye, wherein the wavelength range of the second supplementary light ray is greater than the wavelength range of the first supplementary light ray.

[0078] Optionally, the first preset center wavelength is located between 1119-1121 nm, and the second preset center wavelength is located between 1370-1390 nm; or

[0079] The first preset center wavelength is between 1370-1390nm, and the second preset center wavelength is between 1370-1390nm;

[0080] The wavelength range of the supplementary light with the first preset center wavelength is determined based on the first preset center wavelength and the preset wavelength bandwidth. The wavelength range of the supplementary light with the second preset center wavelength is determined based on the second preset center wavelength and the preset wavelength bandwidth, wherein the preset wavelength bandwidth is between 20nm and 50nm.

[0081] In this embodiment, a first supplementary light with a first preset center wavelength or a second supplementary light with a second preset center wavelength is irradiated onto the human eye based on the ambient light intensity. The solar spectral illuminance corresponding to the first and second preset center wavelengths is less than a preset threshold. The wavelength range of the first and second supplementary light differs from that of the second supplementary light. The movement of the human eye is tracked, and a pupil image formed when the supplementary light irradiates the eye is acquired. The movement of the human eye is determined based on the pupil image. Therefore, by irradiating supplementary light with a center wavelength corresponding to a solar spectral illuminance less than the preset threshold, even in strong outdoor light conditions, sunlight has minimal or almost no interference with the supplementary light irradiating the human eye. Thus, a pupil image with a high signal-to-noise ratio can be formed using this supplementary light, improving the quality of the pupil image. Simultaneously, it avoids the increased power consumption and potential harm to the human eye caused by increasing the power of the supplementary light to improve pupil image quality. Furthermore, by irradiating the human eye with supplementary light of different wavelengths based on the ambient light intensity, and switching between different supplementary light sources according to different ambient light intensities, the power consumption of the eye-tracking device can be reduced and the working efficiency of the eye-tracking device can be improved.

[0082] Optionally, such as Figure 7 As shown, this application embodiment also provides smart glasses, including a light intensity sensor 50, a processor 30, and as described above. Figures 1 to 5 The eye-tracking device 100 described in any embodiment is disposed on the smart glasses at a position corresponding to the human eye 140; the light intensity sensor 50 is connected to the processor 30, and the light intensity sensor 50 is used to detect the ambient light intensity where the human eye 140 is located and transmit it to the processor 30; the processor 30 is used to drive the supplementary light source 10 to irradiate the human eye 140 with the first supplementary light or the second supplementary light according to the comparison result between the ambient light intensity and the preset light intensity threshold.

[0083] The eye-tracking device 100 is located on the side of the smart glasses and is tilted at a certain angle to the human eye 140 so that the light emitted by the supplementary light source can illuminate the human eye 140.

[0084] The smart glasses also include a display source 60 for providing virtual images. The human eye 140 can see the virtual images from the display source and the real images of the external environment through the viewing window area. The temples of the smart glasses house at least a processor 30, a display source 60, and a light intensity sensor 50.

[0085] The light intensity sensor 50 is a near-infrared sensor used to detect ambient light intensity by detecting the infrared component of ambient light. The light intensity sensor 50 can be an 850nm or 940nm sensor. Taking a 940nm near-infrared sensor as an example, in an indoor environment, the wavelength component of ambient light at 940nm is very small, and the output value of the near-infrared sensor is very small. Under strong outdoor light, the near-infrared sensor saturates and outputs a maximum value A at 940nm.

[0086] The preset light intensity threshold is used to determine whether to switch the supplementary light source to illuminate the human eye with supplementary light of different center wavelengths. For example, the switching conditions for the first preset center wavelength supplementary light and the second preset center wavelength supplementary light are as follows: when the output value of the light intensity sensor 50 is less than or equal to the preset light intensity threshold, the first supplementary light source works and illuminates the first preset center wavelength supplementary light for eye tracking; when the output value of the light intensity sensor 50 is greater than the preset light intensity threshold, the second supplementary light source works and illuminates the second preset center wavelength supplementary light for eye tracking.

[0087] Taking a first preset center wavelength of 1120 nm and a second preset center wavelength of 1380 nm as an example, when the output value of the light intensity sensor 50 is >0.5 A, the processor 30 transmits a signal to the eye-tracking device 100 to illuminate only the supplementary light source corresponding to the 1380 nm center wavelength; when the output value of the light intensity sensor 50 is ≤0.5 A, the processor 30 transmits a signal to the eye-tracking device 100 to illuminate only the supplementary light source corresponding to the 1200 nm center wavelength.

[0088] In this embodiment of the application, the smart glasses include a light intensity sensor for detecting the ambient light intensity of the human eye and transmitting it to a processor. The processor includes a processor for driving the supplementary light source to illuminate the human eye with supplementary light rays having a first preset center wavelength or a second preset center wavelength based on the comparison result between the ambient light intensity and a preset light intensity threshold. This allows for switching between different supplementary light sources based on different ambient light intensities, thereby reducing the power consumption of the eye-tracking device and improving its working efficiency.

[0089] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0090] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. An eye-tracking device, characterized in that, include: A supplementary light source is used to irradiate the human eye with a first supplementary light ray having a first preset center wavelength or a second supplementary light ray having a second preset center wavelength based on the ambient light intensity at which the human eye is located. The solar spectral illuminance corresponding to the first preset center wavelength and the second preset center wavelength is less than a preset threshold. The wavelength range of the first supplementary light ray is different from that of the second supplementary light ray. The wavelength range of the first supplementary light ray and the wavelength range of the second supplementary light ray are the wavelength ranges corresponding to near-infrared light. The camera is used to capture the pupil image formed when the first supplementary light or the second supplementary light shines on the human eye; The processor determines the movement of the human eye based on the pupil image, and the camera tracks the movement of the human eye.

2. The apparatus according to claim 1, characterized in that, The supplementary lighting source includes a first supplementary lighting source and a second supplementary lighting source. The first supplementary light source is used to illuminate the human eye with the first supplementary light when the ambient light intensity is not greater than a preset light intensity threshold. The second supplementary light source is used to illuminate the human eye with the second supplementary light when the ambient light intensity is greater than the preset light intensity threshold, wherein the wavelength range of the second supplementary light is greater than the wavelength range of the first supplementary light.

3. The apparatus according to claim 1 or 2, characterized in that, The supplementary light source includes a vertical cavity surface-emitting laser (VCSEL) source.

4. The apparatus according to claim 2, characterized in that, The camera includes a first camera and a second camera. The first camera is used to capture the pupil image formed when the first supplementary light shines on the human eye, and the second camera is used to capture the pupil image formed when the second supplementary light shines on the human eye.

5. The apparatus according to claim 1, characterized in that, The camera includes a stacked receiver and an image sensor. The receiving device is used to receive a fourth light ray, which is a third light ray reflected by the human eye when the first or second supplementary light ray illuminates the human eye, and the light ray has the same wavelength as the illuminating supplementary light ray. The image sensor is used to convert the optical signal of the fourth ray into an electrical signal.

6. The apparatus according to claim 5, characterized in that, The receiving device includes stacked receiving lenses and filters. The receiving lens is a plastic aspherical structure used to converge the third light beam; The filter is used to allow the fourth ray in the converged third ray to pass through.

7. The apparatus according to claim 5, characterized in that, The receiving device is a superlens, which includes a glass substrate, a filter layer stacked on a first surface of the glass substrate near the human eye, and microstructures stacked on a second surface of the glass substrate away from the human eye. The filter layer is used to allow the fourth ray in the third ray to pass through; The microstructure is used to converge the fourth ray.

8. The apparatus according to any one of claims 5 to 7, characterized in that, The image sensor includes a colloidal quantum dot sensor.

9. The apparatus according to claim 1, characterized in that, The first preset center wavelength is between 1119-1121 nm, and the second preset center wavelength is between 1370-1390 nm; or The first preset center wavelength is between 1370-1390nm, and the second preset center wavelength is between 1370-1390nm; The wavelength range of the supplementary light with the first preset center wavelength is determined based on the first preset center wavelength and the preset wavelength bandwidth. The wavelength range of the supplementary light with the second preset center wavelength is determined based on the second preset center wavelength and the preset wavelength bandwidth, wherein the preset wavelength bandwidth is between 20nm and 50nm.

10. An eye-tracking method, applied to the eye-tracking device according to any one of claims 1 to 9, characterized in that, include: Based on the ambient light intensity of the human eye, a first supplementary light ray with a first preset center wavelength or a second supplementary light ray with a second preset center wavelength is shone onto the human eye. The solar spectral illuminance corresponding to the first preset center wavelength and the second preset center wavelength is less than a preset threshold. The wavelength range of the first supplementary light ray is different from that of the second supplementary light ray. Acquire a pupil image formed when the first supplementary light or the second supplementary light shines on the human eye; The movement of the human eye is determined based on the pupil image.

11. The method according to claim 10, characterized in that, Irradiating the human eye with a first supplementary light ray having a first preset center wavelength or a second supplementary light ray having a second preset center wavelength based on the ambient light intensity, including: When the ambient light intensity is not greater than a preset light intensity threshold, a first supplementary light ray with the first preset center wavelength is shone onto the human eye. When the ambient light intensity is greater than the preset light intensity threshold, a second supplementary light ray with the second preset center wavelength is shone onto the human eye, wherein the wavelength range of the second supplementary light ray is greater than the wavelength range of the first supplementary light ray.

12. The method according to claim 10, characterized in that, The first preset center wavelength is between 1119-1121 nm, and the second preset center wavelength is between 1370-1390 nm; or The first preset center wavelength is between 1370-1390nm, and the second preset center wavelength is between 1370-1390nm; The wavelength range of the supplementary light with the first preset center wavelength is determined based on the first preset center wavelength and the preset wavelength bandwidth. The wavelength range of the supplementary light with the second preset center wavelength is determined based on the second preset center wavelength and the preset wavelength bandwidth, wherein the preset wavelength bandwidth is between 20nm and 50nm.

13. A type of smart glasses, characterized in that, Includes a light intensity sensor, the processor, and the eye-tracking device as described in any one of claims 1 to 9. The eye-tracking device is installed on the smart glasses at a position corresponding to the human eye. The light intensity sensor is connected to the processor, and the light intensity sensor is used to detect the ambient light intensity where the human eye is located and transmit it to the processor. The processor is configured to drive the supplementary light source to illuminate the human eye with the first supplementary light or the second supplementary light based on the comparison result between the ambient light intensity and the preset light intensity threshold.

Images