Processing method and apparatus for eyeball tracking, device, and storage medium

By selecting appropriate camera output modes and light source wavelengths for different eye-tracking scenarios, the problem of insufficient accuracy and applicability in existing eye-tracking technologies has been solved, achieving higher accuracy and adaptability.

WO2024230660A1PCT designated stage expired Publication Date: 2024-11-14BEIJING 7INVENSUN TECH

Patent Information

Application Number
PCT/CN2024/091311
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-08
Filing Date
2024-05-07
Publication Date
2024-11-14

AI Technical Summary

Technical Problem

In existing eye-tracking technologies, the wavelength of the infrared light source and the image output mode of the camera are limited, resulting in poor eye-tracking accuracy and applicability, making it unsuitable for various application scenarios.

Method used

The camera output mode and light source wavelength are selected according to different eye tracking scenarios, including full-pixel output mode, ROI output mode, downsampling output mode and ROI overlay downsampling output mode, as well as first and second wavelength light sources, which are used for wearable device wearing, biometric registration, eye tracking calibration and first and second eye tracking scenarios, respectively.

Benefits of technology

It improves the accuracy and adaptability of eye tracking, meets the data processing needs of different scenarios, and optimizes the accuracy and efficiency of device wearing and biometric registration.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024091311_14112024_PF_FP_ABST
    Figure CN2024091311_14112024_PF_FP_ABST
Patent Text Reader

Abstract

A processing method and apparatus for eyeball tracking, a device, and a storage medium. The method comprises: determining a current eyeball tracking related scenario (S110); determining a camera image output mode and a light source wavelength according to the eyeball tracking related scenario, wherein the camera image output mode comprises at least one of the following modes: a full-pixel image output mode, a region-of-interest (ROI) image output mode, a down-sampling image output mode, and an ROI superimposed down-sampling image output mode, and the light source wavelength comprises a first wavelength and a second wavelength (S120); and processing data in the eyeball tracking related scenario on the basis of the camera image output mode and the light source wavelength (S130).
Need to check novelty before this filing date? Find Prior Art

Description

Eye tracking processing method, device, equipment and storage medium

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on May 8, 2023, with application number 202310512179.8, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of eye tracking technology, for example, to a processing method, device, equipment and storage medium for eye tracking. Background Art

[0003] In eye tracking technology, the wavelength of the infrared light source and the camera output mode used to capture the user's eye image are relatively simple. This method cannot be applied to the various use cases of eye tracking, not only affecting the accuracy of eye tracking, but also making eye tracking less applicable.

[0004] Summary of the Invention

[0005] The present application provides an eye tracking processing method, apparatus, device and storage medium, which selects corresponding camera output modes and / or light source wavelengths in different eye tracking scenarios, which can not only improve the accuracy of eye tracking, but also increase the adaptability of eye tracking.

[0006] The present invention provides an eye tracking processing method, including:

[0007] Determining a current eye tracking-related scenario, wherein the eye tracking-related scenario includes at least one of the following: a wearable eye tracking device wearing scenario, a biometric registration scenario, an eye tracking calibration scenario, a first eye tracking scenario, a second eye tracking scenario, and a third eye tracking scenario;

[0008] Determining a camera output mode and a light source wavelength according to the eye tracking-related scene, wherein the camera output mode includes at least one of the following: a full-pixel output mode, a region-of-interest (ROI) output mode, a downsampling output mode, and a ROI-overlay downsampling output mode, and the light source wavelength includes a first wavelength and a second wavelength;

[0009] The data in the eye tracking related scene is processed based on the camera output mode and the light source wavelength.

[0010] The present application also provides an eye tracking processing device, including:

[0011] an eye tracking-related scenario determination module, configured to determine a current eye tracking-related scenario, wherein the eye tracking-related scenario includes at least one of the following: a wearable eye tracking device wearing scenario, a biometric registration scenario, an eye tracking calibration scenario, a first eye tracking scenario, a second eye tracking scenario, and a third eye tracking scenario;

[0012] a camera output mode and light source wavelength determination module, configured to determine the camera output mode and light source wavelength according to the eye tracking-related scene, wherein the camera output mode includes at least one of the following: a full-pixel output mode, a region of interest (ROI) output mode, a downsampling output mode, and an ROI superimposed downsampling output mode, and the light source wavelength includes a first wavelength and a second wavelength;

[0013] The data processing module is configured to process the data in the eye tracking related scene based on the camera output mode and the light source wavelength.

[0014] An embodiment of the present application further provides an electronic device, comprising:

[0015] at least one processor; and

[0016] a memory communicatively connected to the at least one processor; wherein,

[0017] The memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the eye tracking processing method described in the embodiment of the present application.

[0018] An embodiment of the present application further provides a computer-readable storage medium, which stores computer instructions, and the computer instructions are used to enable a processor to implement the eye tracking processing method described in the embodiment of the present application when executed. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] FIG1 is a flow chart of an eye tracking processing method in Example 1 of the present application;

[0020] FIG2 is a flowchart of data processing in a scenario where a wearable eye tracking device is worn in Example 1 of the present application;

[0021] FIG3 is a data processing flow chart for a biometric registration scenario in Example 1 of the present application;

[0022] FIG4 is a data processing flow chart of an eye tracking calibration scenario in Example 1 of the present application;

[0023] FIG5 is a data processing flow chart of a first eye tracking scenario in Example 1 of the present application;

[0024] FIG6 is a data processing flow chart of a second eye tracking scenario in Example 1 of the present application;

[0025] FIG7 is a data processing flow chart of a third eye tracking scenario in Example 1 of the present application;

[0026] FIG8 is a schematic diagram of the structure of an eye tracking processing device in Example 2 of the present application;

[0027] FIG9 is a schematic structural diagram of an electronic device in Embodiment 3 of the present application. DETAILED DESCRIPTION

[0028] The present application is described below in conjunction with the accompanying drawings and embodiments. The embodiments described herein are intended only to explain the present application and are not intended to limit the present application. For ease of description, the accompanying drawings only show portions related to the present application, not all structures.

[0029] Eye tracking technology can be implemented using optical recording methods. The principle of the optical recording method is to use an image acquisition device to record the test subject's eye movements, that is, to obtain eye images that can reflect eye movements, and then extract eye features from the acquired eye images to establish a line of sight estimation model. Among them, eye features may include: pupil position, pupil shape, iris position, iris shape, limbus position, limbus (the black and white boundary of the eye), eyelid position, canthus position, light spot position (or Purkinje spot), etc.

[0030] Optical recording methods include the pupil-corneal reflection method. The principle of the pupil-corneal reflection method is that a near-infrared light source is directed at the eye, and the image acquisition device captures the eye and simultaneously captures the light spot where the light source is reflected on the outer surface of the cornea, thereby acquiring an eye image with the light spot.

[0031] As the eyeball rotates, the relative positional relationship between the pupil center and the corneal limbus boundary center and the position coordinates of the light spot in the image changes accordingly. The corresponding collected eye images with light spots reflect such position changes between the pupil and the light spot or the corneal limbus and the light spot; the line of sight / gaze point is estimated based on the pupil and light spot or the corneal limbus and the light spot positions.

[0032] Example 1

[0033] FIG1 is a flowchart of an eye tracking processing method provided in Example 1 of the present application. This embodiment is applicable to processing eye tracking data. The method can be executed by an eye tracking processing device, which can be implemented in the form of software and / or hardware. Optionally, it can be implemented by an electronic device, such as a mobile terminal, a personal computer (PC), or a server. The method includes the following steps.

[0034] S110: Determine the current eye tracking related scene.

[0035] Among them, eye tracking related scenarios include at least one of the following: a wearable eye tracking device wearing scenario, a biometric registration scenario, an eye tracking calibration scenario, a first eye tracking scenario, a second eye tracking scenario, and a third eye tracking scenario.

[0036] In this embodiment, eye-tracking scenarios can be selected based on the user's actual needs for the eye-tracking device. If this is the user's first time using an eye-tracking device, the user will need to sequentially enter the wearable eye-tracking device wearing scenario, biometric registration scenario, and eye-tracking calibration scenario. After calibration is complete, the user can select the first eye-tracking scenario, the second eye-tracking scenario, or the third eye-tracking scenario to perform eye tracking. In each eye-tracking scenario, the corresponding camera output mode and light source wavelength can be selected to meet the data processing requirements of the current eye-tracking scenario.

[0037] The wearable eye tracking device wearing scenario can be understood as the scenario in which the eye tracking device is adjusted while being worn. The biometric registration scenario can be understood as the process of storing the user's biometrics in a database. The eye tracking calibration scenario can be understood as the process of obtaining the user's calibration coefficients. The first eye tracking scenario can be understood as a normal-precision eye tracking scenario. The second eye tracking scenario can be understood as a higher-precision eye tracking scenario. The third eye tracking scenario can be understood as a low-power, low-precision eye tracking scenario.

[0038] S120: Determine the camera output mode and light source wavelength according to the eye tracking-related scene.

[0039] Among them, the camera output mode includes at least one of the following: full pixel output mode, region of interest (ROI) output mode, downsampling output mode, ROI superimposed downsampling output mode; the light source wavelength includes a first wavelength and a second wavelength.

[0040] Full-pixel output mode can be understood as outputting all pixels captured by the camera. In this mode, the output image has the highest pixel count. For example, the output image can be 15 megapixels. ROI output mode uses a box, circle, ellipse, or irregular polygon to outline the area to be processed, called the region of interest (ROI), and outputs the image corresponding to the ROI. The output image in ROI output mode has fewer pixels than in full-pixel output mode. For example, the output image can be 1.6 megapixels. Downsampling output modes can be binning or skipping. Binning mode sums the charges sensed by adjacent pixels and reads them out as a single pixel. Binning is divided into horizontal binning and vertical binning. Horizontal binning sums the charges of adjacent rows, while vertical binning sums the charges of adjacent columns. Skipping mode extracts specific pixels for output. The output image in downsampling output mode has fewer pixels than in full-pixel output mode. For example, the output image can be 1.6 megapixels. The ROI superimposed downsampling output mode can be understood as using two output modes (downsampling output mode and ROI output mode) at the same time to produce a superimposed effect. The image output by this output mode has smaller pixels and smaller data volume. It is generally used for low-power and low-precision eye tracking.

[0041] In this embodiment, the first wavelength and the second wavelength range from 800 nm to 1000 nm. The first wavelength and the second wavelength can be the same or different. Both the first wavelength and the second wavelength can meet the technical requirements of eye tracking and biometric recognition. However, the first wavelength can be smaller than the second wavelength. For example, the first wavelength can be 810 nm or 850 nm, and the second wavelength can be 940 nm. The first wavelength and the second wavelength can also have other values.

[0042] In one or more embodiments, the process of determining the camera output mode and the light source wavelength according to the eye tracking related scene can be: if the eye tracking related scene is a wearable eye tracking device wearing scene, the determined camera output mode is the downsampling output mode, and the determined light source wavelength is the second wavelength (i.e., 940nm). If the eye tracking related scene is a biometric registration scene, the determined camera output mode is the full pixel output mode or the ROI output mode, and the determined light source wavelength is the first wavelength (i.e., 810nm or 850nm). If the eye tracking related scene is an eye tracking calibration scene, the determined camera output mode is the ROI output mode or the full pixel output mode, and the determined light source wavelength is the first wavelength. If the eye tracking related scene is the first eye tracking scene, the determined camera output mode is the ROI output mode and the downsampling output mode, and the determined light source wavelength is the first wavelength and the second wavelength. If the eye tracking related scene is the second eye tracking scene, the determined camera output mode is the ROI output mode, and the determined light source wavelength is the first wavelength and the second wavelength. If the eye tracking related scene is the third eye tracking scene, the determined camera output mode is the ROI output mode and the ROI superposition downsampling output mode, and the determined light source wavelength is the first wavelength or the first wavelength and the second wavelength.

[0043] S130: Processing data in eye tracking related scenarios based on the camera output mode and the light source wavelength.

[0044] In this embodiment, in different eye-tracking related scenarios, the selected camera output modes and light source wavelengths are different. The data in the eye-tracking related scenarios are processed based on the determined camera output modes and light source wavelengths to realize the functions in the eye-tracking related scenarios.

[0045] Optionally, if the eye tracking-related scenario is a scenario in which a wearable eye tracking device is worn, the method for processing data in the eye tracking-related scenario based on the camera output mode and the light source wavelength can be: collecting a first eye image of the user based on the downsampling output mode and the second wavelength light source; and adjusting the position and / or pupil distance of the wearable eye tracking device based on the first eye image.

[0046] Among them, collecting the first eye image of the user based on the downsampling output mode and the light source of the second wavelength can be understood as: controlling the light source of the second wavelength to illuminate the user's eyes, controlling the camera to collect the user's eye image, and outputting the eye image according to the downsampling output mode, thereby obtaining the first eye image. Adjusting the position of the wearable eye tracking device may include adjusting the up and down position and left and right position of the wearable eye tracking device or adjusting it in other directions. Adjusting the pupil distance of the wearable eye tracking device may include adjusting the horizontal distance between the eyepieces of the wearable eye tracking device. The adjustment of the horizontal distance between the eyepieces can be understood as taking the center line of the two eyepieces as the reference and adjusting the distance symmetrically toward the center line or both sides at the same time. The horizontal distance adjustment of the eyepieces includes automatic adjustment and manual knob adjustment.

[0047] In this embodiment, during the wearing process of the wearable eye tracking device, if the wearable eye tracking device needs to be adjusted, the required resolution of the eye image can be relatively low. Therefore, selecting a second wavelength light source of 940nm and a downsampling output mode can meet the wearing requirements of the wearable eye tracking device and save energy.

[0048] The process of adjusting the position and / or pupil distance of the wearable eye tracking device based on the eye image can be: determining first eye feature data based on the first eye image; determining first adjustment information and / or second adjustment information based on the first eye feature data; guiding the user to adjust the position of the wearable eye tracking device based on the first adjustment information, and / or adjusting the pupil distance of the wearable eye tracking device based on the second adjustment information.

[0049] In one or more embodiments, the process of adjusting the position and / or pupil distance of the wearable eye tracking device based on the eye image may be: determining first eye feature data based on the first eye image; determining first adjustment information and second adjustment information based on the first eye feature data; guiding the user to adjust the position of the wearable eye tracking device based on the first adjustment information, and adjusting the pupil distance of the wearable eye tracking device based on the second adjustment information.

[0050] Among them, the first eye feature data includes at least one of the following: pupil position, pupil shape, eyelid position, eye corner position, and may also include line of sight direction. The line of sight direction here is an approximate line of sight direction, which is roughly determined based on the position of the pupil and the pupil shape at the upper and lower eyelids and the inner and outer corners of the eyes. Because when wearing a wearable eye tracking device, it is most accurate to adjust the position and pupil distance of the device when the user is looking directly in front of the screen. Therefore, after roughly determining the user's line of sight direction, if the user is not looking directly in front of the screen, a first prompt message will be issued to prompt the user to look directly in front of the screen (which can be a voice prompt or a text prompt). This step is to prepare for the subsequent adjustment of the device position.

[0051] In order to better perform eye tracking and user experience, the wearable eye tracking device can set an optimal wearing position range. When the user's eyes fall within the optimal wearing position range, it means that the optimal wearing position requirements have been met. This optimal wearing position range may not be displayed on the screen. The system determines whether the user's eye position meets the optimal wearing position requirements based on the first eye feature data, and prompts the user to adjust the position (i.e., the first adjustment information) in the form of voice or text; in another embodiment, the optimal wearing position range can also be displayed on the device screen (for example, two circles representing the left eye and the right eye, or a rectangular frame range, etc.), and the user's eye image will also be displayed in real time on the device screen. The user can adjust the position of the device according to the image information on the screen. In this embodiment, the first adjustment information is the image information displayed on the screen. The second adjustment information is information related to the user's pupil distance adjustment.

[0052] In one or more embodiments, after obtaining the first eye feature data, it is determined whether the user's eyes fall within the optimal wearing position range and whether the pupil distance of the wearable eye tracking device matches the user's pupil distance based on the first eye feature data. If the pupil distance of the wearable eye tracking device does not match the user's pupil distance, first adjustment information and second adjustment information are generated, and the user is guided to adjust the position of the wearable eye tracking device based on the first adjustment information, and the pupil distance of the wearable eye tracking device is adjusted based on the second adjustment information, so that the user's eyes fall within the optimal wearing position range and the pupil distance of the wearable eye tracking device matches the user's pupil distance, that is, it meets the wearing requirements. Exemplarily, Figure 2 is the data processing process in the wearable eye tracking device wearing scenario of this embodiment. As shown in Figure 2, after the user wears the wearable eye tracking device, the wearable eye tracking device is turned on; the 940nm light source is turned on to illuminate the eyes, and the eye tracking camera is started to shoot the user's eyes, and the eye image is output in a downsampling output mode; the eye feature data is determined according to the eye image, and based on the eye feature data, the user is guided to adjust the position of the wearable eye tracking device and / or adjust the pupil distance of the wearable eye tracking device.

[0053] The position adjustment and pupil distance adjustment of the wearable eye tracking device can be a unified adjustment process, that is, the position adjustment of the wearable eye tracking device is performed first and then the pupil distance of the wearable eye tracking device is adjusted; or they can be two independent adjustment processes.

[0054] Optionally, if the eye tracking related scene is a biometric registration scene, the process of processing the data in the eye tracking related scene based on the camera output mode and the light source wavelength can be: based on the full-pixel output mode or the ROI output mode and the first wavelength of the light source, collecting eye images of the user when looking in different directions to obtain multiple second eye images; extracting local biometric features from the multiple second eye images respectively; splicing the multiple local biometric features to obtain the target biometric features; and storing the target biometric features.

[0055] The local biometric features and target biometric features include at least one of the following: iris features, fundus features, retinal vascular features, vascular features on the sclera of the eye stripes, and eye shape. In biometric registration scenarios, in order to extract high-precision biometric features of the user, high accuracy requirements are placed on the eye image and ambient brightness. Therefore, the wavelength of the light source is selected to be 810 / 850 nm. The infrared light in this wavelength band is brighter than the infrared light at 940 nm. The camera output mode is selected to be full-pixel output mode or ROI output mode. In one or more embodiments, guide points are displayed in different directions on the display interface (user interface (UI)) of the wearable eye tracking device to guide the user to rotate their eyes to gaze in different directions. Eye images of the user while gazing at the guide points are captured to obtain multiple second eye images. The user's local biometric features are extracted from the multiple second eye images, and the multiple local biometric features are spliced ​​together to obtain the target biometric feature. The target biometric feature is then stored to complete biometric registration.

[0056] Exemplarily, Figure 3 is the data processing process in the biometric registration scenario. As shown in Figure 3, the process is: the user completes the wearing adjustment of the wearable eye tracking device and meets the wearing requirements; turns on the 810 / 850nm light source to illuminate the eyes, and starts the eye tracking camera to shoot the user's eyes, and outputs the eye image in full-pixel output mode; guides the user to rotate the eyeballs to look in different directions through the UI interface, and collects eye images when the user looks in different directions; extracts local biometric features of the eye data in different directions, splices multiple local biometric features to obtain the target biometric features; stores the target biometric features, and completes the biometric registration.

[0057] Optionally, if the eye tracking related scene is an eye tracking calibration scene, the method of processing the data in the eye tracking related scene based on the camera output mode and the light source wavelength can be: based on the ROI output mode or the full-pixel output mode and the first wavelength of the light source, a third eye image of the user looking at the set calibration point is collected; and the calibration coefficient is determined based on the third eye image.

[0058] Capturing the third eye image of the user gazing at the set calibration point using the ROI output mode or the full-pixel output mode and the first wavelength light source can be understood as controlling the first wavelength light source to illuminate the user's eye, controlling the camera to capture the user's eye image, and outputting the eye image using the ROI output mode or the full-pixel output mode, thereby obtaining the third eye image. In this embodiment, if the ROI output mode is used, it is not necessary to analyze the entire eye image during eye tracking calibration; only the region of interest within the eye image needs to be analyzed. Therefore, using the ROI output mode and the 810 / 850nm light source not only does not affect calibration accuracy but also reduces computational complexity.

[0059] In one or more embodiments, the process of determining a calibration coefficient based on a third eye image may include: determining second eye feature data based on the third eye image; and determining a calibration coefficient based on the second eye feature data. The method may further include: determining a biometric characteristic of the user based on the third eye image. Accordingly, after determining the calibration coefficient based on the third eye image, the method may further include the step of binding the calibration coefficient and the biometric characteristic and storing the resultant data. The biometric characteristic is a biometric characteristic of the user. The biometric characteristic may include at least one of the following: iris characteristics, fundus characteristics, retinal vascular characteristics, vascular characteristics of the sclera and eye pattern, and eye shape.

[0060] The second eye feature data includes at least one of the following: fundus data, pupil position, pupil shape, iris position, iris shape, eyelid position, canthus position, and light spot position. In this embodiment, a set calibration point is displayed on the display interface of the wearable eye tracking device. A third eye image is captured of the user gazing at the set calibration point based on the ROI output mode or the full-pixel output mode and a light source of the first wavelength. Eye feature data such as fundus data, pupil position, pupil shape, iris position, iris shape, eyelid position, canthus position, and light spot position are extracted from the third eye image. A calibration coefficient corresponding to each set calibration point is determined based on the eye feature data, and the calibration coefficient is bound to the biometric feature and stored. The set calibration point can be one or more.

[0061] Exemplarily, FIG4 is a data processing flow in the eye tracking calibration scenario of this embodiment. As shown in FIG4 , the flow is: the user completes the wearing adjustment of the wearable eye tracking device, turns on the 810 / 850nm light source to illuminate the eyes, and starts the eye tracking camera to shoot the user's eyes, and outputs the eye image in ROI output mode; the set calibration point is displayed to collect the eye image of the user looking at the set calibration point, and the fundus data, pupil position, pupil shape, iris position, iris shape, eyelid position, canthus position, light spot position and other eye feature data in the eye image are extracted; the calibration coefficient corresponding to each set calibration point is determined based on the eye feature data; the calibration coefficient is bound to the biometric feature and stored to complete the calibration.

[0062] Optionally, if the eye tracking related scenario is the first eye tracking scenario, which is a normal precision eye tracking scenario, the process of processing the data in the eye tracking related scenario based on the camera output mode and the light source wavelength can be: based on the ROI output mode and the first wavelength of the light source, collecting the user's fourth eye image; determining the user's biometrics based on the fourth eye image; obtaining the pre-stored user's calibration coefficient based on the biometrics; switching the camera output mode to the downsampling output mode, and switching the light source wavelength to the second wavelength; collecting the user's fifth eye image based on the downsampling output mode and the second wavelength of the light source; and performing eye tracking on the user based on the fifth eye image and the calibration coefficient.

[0063] In this embodiment, eye tracking requires acquiring the user's biometrics to retrieve the user's pre-stored calibration coefficients from a database based on these biometrics. High eye image accuracy is required, so ROI output mode and a light source with the first wavelength are selected for eye image capture. After obtaining the calibration coefficients, if eye tracking is performed based on these calibration coefficients and the accuracy requirement is lower, the camera output mode can be switched to downsampling mode and the light source wavelength can be switched to the second wavelength for eye tracking.

[0064] The method of tracking the user's eyes based on the fifth eye image and the calibration coefficient can refer to the relevant gaze point or gaze direction estimation algorithm, which is not limited here.

[0065] Exemplarily, Figure 5 is the data processing process in the first eye tracking scenario of this embodiment, which includes: the user completes the wearing adjustment of the wearable eye tracking device; turns on the 810 / 850nm light source to illuminate the eyes, and starts the eye tracking camera to shoot the user's eyes, and outputs the eye image in ROI output mode; determines the user's biometrics based on the eye image, and obtains the pre-stored user calibration coefficient based on the biometrics; switches the camera output mode to the downsampling output mode, switches the light source wavelength to 940nm, and collects the user's eye image again; performs eye tracking based on the eye image and the calibration coefficient.

[0066] If the first wavelength and the second wavelength are equal, then there is no need to switch the light source.

[0067] Optionally, if the eye tracking related scenario is the second eye tracking scenario, which is a high-precision eye tracking scenario, the process of processing the data in the eye tracking related scenario based on the camera output mode and the light source wavelength can be: based on the ROI output mode and the first wavelength of the light source, a sixth eye image of the user is collected; based on the sixth eye image, the user's biometrics is determined; based on the biometrics, a pre-stored calibration coefficient of the user is obtained; the light source wavelength is switched to the second wavelength, and the seventh eye image of the user is collected based on the ROI output mode and the second wavelength of the light source; and eye tracking of the user is performed based on the seventh eye image and the calibration coefficient.

[0068] In this embodiment, eye tracking requires obtaining the user's biometrics to retrieve the user's pre-stored calibration coefficients from a database based on the biometrics. This requires high accuracy for eye images, so the ROI output mode and a light source with a first wavelength are selected for eye image capture. After obtaining the calibration coefficients, if higher accuracy is required for eye tracking, the ROI output mode is continued, and a light source with a second wavelength is used to capture eye images. Eye tracking is then performed based on the newly captured eye images and the calibration coefficients.

[0069] For example, Figure 6 illustrates the data processing process for the second eye tracking scenario in this embodiment. This process includes: the user completes the wearable eye tracking device's adjustment; illuminates the eye with an 810 / 850nm light source, activates the eye tracking camera to capture the user's eye, and outputs the eye image in ROI output mode; determines the user's biometrics based on the eye image, and obtains the user's pre-stored calibration coefficients based on the biometrics; switches the light source wavelength to 940nm and captures the user's eye image again; and performs eye tracking based on the eye image and calibration coefficients. If the first and second wavelengths are equal, switching the light source is not necessary.

[0070] Optionally, if the eye tracking related scenario is a third eye tracking scenario, which is a low-power and low-precision eye tracking scenario, the process of processing the data in the eye tracking related scenario based on the camera output mode and the light source wavelength may be: based on the ROI output mode and the light source of the first wavelength, an eighth eye image of the user is collected; the user's biometric characteristics are determined based on the eighth eye image; the user's pre-stored calibration coefficient is obtained based on the biometric characteristics; the camera output mode is switched to the ROI overlay downsampling output mode, and the light source wavelength is switched to the second wavelength or still uses the first wavelength; based on the ROI overlay downsampling output mode and the light source of the first wavelength or the second wavelength, a ninth eye image of the user is collected; and the user's eye is tracked based on the ninth eye image and the calibration coefficient.

[0071] In this embodiment, when performing eye tracking, the user's biometrics must be acquired to retrieve the user's pre-stored calibration coefficients from a database based on the biometrics. High accuracy is required for eye images, so the ROI output mode and a light source with a first wavelength are selected for eye image capture. After obtaining the calibration coefficients, eye tracking is performed based on the calibration coefficients. Because this mode is a low-power, low-precision eye tracking mode, the camera output mode can be switched to the ROI stacked downsampling output mode. The light source wavelength remains unchanged or is switched to the second wavelength for eye tracking. This reduces power consumption because the output eye image has fewer pixels and transmits less data.

[0072] The method of tracking the user's eyes based on the ninth eye image and the calibration coefficient can refer to the relevant gaze point or gaze direction estimation algorithm, which is not limited here.

[0073] Exemplarily, Figure 7 is the data processing process in the third eye tracking scenario of this embodiment, which includes: the user completes the wearing adjustment of the wearable eye tracking device; turns on the 810 / 850nm light source to illuminate the eyes, and starts the eye tracking camera to shoot the user's eyes, and outputs the eye image in ROI output mode; determines the user's biometrics based on the eye image, and obtains the pre-stored user calibration coefficient based on the biometrics; switches the camera output mode to ROI superposition downsampling output mode, keeps the light source wavelength unchanged or switches the light source wavelength to 940nm, and collects the user's eye image; performs eye tracking based on the eye image and the calibration coefficient.

[0074] If the first wavelength and the second wavelength are equal, then there is no need to switch the light source.

[0075] The technical solution of this embodiment determines the current eye-tracking-related scenario; wherein the eye-tracking-related scenario includes at least one of the following: a wearable eye-tracking device wearing scenario, a biometric registration scenario, an eye-tracking calibration scenario, a first eye-tracking scenario, a second eye-tracking scenario, and a third eye-tracking scenario; determines the camera output mode and the light source wavelength according to the eye-tracking-related scenario; wherein the camera output mode includes: a full-pixel output mode, a region-of-interest (ROI) output mode, a downsampling output mode, and a ROI superimposed downsampling output mode; the light source wavelength includes a first wavelength and a second wavelength; and processes the data in the eye-tracking-related scenario based on the camera output mode and the light source wavelength. The eye-tracking processing method provided in the embodiment of the present application selects the corresponding camera output mode and / or light source wavelength in different eye-tracking scenarios, which can not only improve the accuracy of eye tracking, but also increase the adaptability of eye tracking.

[0076] Example 2

[0077] FIG8 is a schematic diagram of the structure of an eye tracking processing device provided in Example 2 of the present application. As shown in FIG8 , the device includes:

[0078] An eye tracking related scenario determination module 810 is configured to determine a current eye tracking related scenario; wherein the eye tracking related scenario includes at least one of the following: a wearable eye tracking device wearing scenario, a biometric registration scenario, an eye tracking calibration scenario, a first eye tracking scenario, a second eye tracking scenario, and a third eye tracking scenario;

[0079] The image output mode and light source wavelength determination module 820 is configured to determine the camera image output mode and light source wavelength based on the eye tracking-related scene; wherein the camera image output mode includes at least one of the following: full pixel image output mode, region of interest (ROI) image output mode, downsampling image output mode, and ROI stacked downsampling image output mode; and the light source wavelength includes a first wavelength and a second wavelength;

[0080] The data processing module 830 is configured to process data in eye tracking related scenarios based on the camera output mode and the light source wavelength.

[0081] Optionally, the image output mode and light source wavelength determination module 820 is set to:

[0082] If the eye tracking-related scenario is a wearable eye tracking device wearing scenario, the determined camera image output mode is the downsampling image output mode, and the determined light source wavelength is the second wavelength;

[0083] Optionally, the data processing module 830 is configured to:

[0084] Capturing a first eye image of the user based on a downsampling output mode and a light source of a second wavelength;

[0085] A position and / or pupil distance of the wearable eye tracking device is adjusted based on the first eye image.

[0086] Optionally, the data processing module 830 is configured to:

[0087] Determining first eye feature data based on the first eye image; wherein the first eye feature data includes at least one of the following: pupil position, pupil shape, eyelid position, and eye corner position;

[0088] determining first adjustment information and / or second adjustment information according to the first eye feature data;

[0089] The user is guided to adjust the position of the wearable eye tracking device according to the first adjustment information, and / or the pupil distance of the wearable eye tracking device is adjusted according to the second adjustment information.

[0090] Optionally, the image output mode and light source wavelength determination module 820 is set to:

[0091] If the eye tracking related scene is a biometric registration scene, the determined camera output mode is the full pixel output mode or the ROI output mode, and the determined light source wavelength is the first wavelength;

[0092] Optionally, the data processing module 830 is configured to:

[0093] Capturing eye images of the user when they gaze in different directions based on a full-pixel image output mode or a ROI image output mode and a light source of the first wavelength to obtain a plurality of second eye images;

[0094] extracting local biometric features from the plurality of second eye images respectively;

[0095] Splicing multiple local biometric features to obtain target biometric features;

[0096] The target biometric features are stored; wherein the biometric features include at least one of the following: iris features, fundus features, retinal blood vessel features, blood vessel features on the eye stripes and sclera, and eye shape.

[0097] Optionally, the image output mode and light source wavelength determination module 820 is set to:

[0098] If the eye tracking related scene is an eye tracking calibration scene, the determined camera output mode is the ROI output mode or the full pixel output mode, and the determined light source wavelength is the first wavelength;

[0099] Optionally, the data processing module 830 is configured to:

[0100] Capturing a third eye image of the user gazing at the set calibration point based on the ROI output mode or the full-pixel output mode and the light source of the first wavelength;

[0101] Calibration coefficients are determined based on the third eye image.

[0102] Optionally, the data processing module 830 is configured to:

[0103] Determining second eye feature data based on the third eye image; wherein the second eye feature data includes at least one of the following: fundus data, pupil position, pupil shape, iris position, iris shape, eyelid position, eye corner position, and light spot position;

[0104] determining a calibration coefficient based on the second eye feature data;

[0105] determining a biometric characteristic of the user based on the third eye image;

[0106] The calibration coefficients are bound to the biometric features and stored.

[0107] Optionally, the image output mode and light source wavelength determination module 820 is set to:

[0108] If the eye tracking related scene is the first eye tracking scene, the determined camera output mode is the ROI output mode and the downsampling output mode, and the determined light source wavelength is the first wavelength and the second wavelength;

[0109] Optionally, the data processing module 830 is configured to:

[0110] Capturing a fourth eye image of the user based on the ROI output mode and the light source of the first wavelength;

[0111] determining a biometric characteristic of the user based on the fourth eye image;

[0112] Obtaining pre-stored user calibration coefficients based on biometrics;

[0113] Switch the camera output mode to downsampling output mode and switch the light source wavelength to the second wavelength;

[0114] Capturing a fifth eye image of the user based on a downsampling output mode and a light source of a second wavelength;

[0115] Eye tracking of the user is performed based on the fifth eye image and the calibration coefficients.

[0116] Optionally, the image output mode and light source wavelength determination module 820 is set to:

[0117] If the eye tracking related scene is the second eye tracking scene, the determined camera output mode is the ROI output mode, and the determined light source wavelength is the first wavelength;

[0118] Optionally, the data processing module 830 is configured to:

[0119] Capturing a sixth eye image of the user based on the ROI output mode and the light source of the first wavelength;

[0120] determining a biometric characteristic of the user based on the sixth ocular image;

[0121] Obtaining pre-stored user calibration coefficients based on biometrics;

[0122] Capturing a seventh eye image of the user based on the ROI output mode and the light source of the second wavelength;

[0123] Eye tracking of the user is performed based on the seventh eye image and the calibration coefficient.

[0124] Optionally, the image output mode and light source wavelength determination module 820 is set to:

[0125] If the eye tracking related scene is the third eye tracking scene, the determined camera output mode is the ROI output mode and the ROI superposition downsampling output mode, and the determined light source wavelength is the first wavelength or the first wavelength and the second wavelength;

[0126] Optionally, the data processing module 830 is configured to:

[0127] Capturing an eighth eye image of the user based on the ROI output mode and the light source of the first wavelength;

[0128] determining a biometric characteristic of the user based on an eighth eye image;

[0129] Obtaining pre-stored user calibration coefficients based on biometrics;

[0130] Switching the camera output mode to the ROI superposition downsampling output mode, and switching the light source wavelength to the second wavelength or still using the first wavelength;

[0131] Capturing a ninth eye image of the user based on the ROI superimposed downsampling output mode and the light source of the first wavelength or the second wavelength;

[0132] Eye tracking of the user is performed based on the ninth eye image and the calibration coefficient.

[0133] The above device can execute the methods provided by all the above embodiments of this application, and has the corresponding functional modules and beneficial effects of executing the above methods. For technical details not fully described in this embodiment, please refer to the methods provided by all the above embodiments of this application.

[0134] Example 3

[0135] FIG9 shows a block diagram of an electronic device 10 that can be used to implement an embodiment of the present application. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, extended reality (XR) glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present application described and / or required herein.

[0136] As shown in Figure 9, the electronic device 10 includes at least one processor 11 and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by the at least one processor, and the processor 11 can perform a variety of appropriate actions and processes according to the computer program stored in the ROM 12 or the computer program loaded from the storage unit 18 into the RAM 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, ROM 12 and RAM 13 are connected to each other via a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0137] Multiple components in the electronic device 10 are connected to the I / O interface 15, including an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a magnetic disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0138] Processor 11 can be a variety of general-purpose and / or specialized processing components with processing and computing capabilities. Some examples of processor 11 include a central processing unit (CPU), a graphics processing unit (GPU), various specialized artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any other suitable processor, controller, microcontroller, etc. Processor 11 executes the various methods and processes described above, such as the eye tracking processing method.

[0139] In some embodiments, the eye tracking processing method can be implemented as a computer program tangibly embodied in a computer-readable storage medium, such as storage unit 18. In some embodiments, part or all of the computer program can be loaded and / or installed on electronic device 10 via ROM 12 and / or communication unit 19. When the computer program is loaded into RAM 13 and executed by processor 11, one or more steps of the eye tracking processing method described above can be performed. Alternatively, in other embodiments, processor 11 can be configured to execute the eye tracking processing method in any other suitable manner (e.g., via firmware).

[0140] Various embodiments of the systems and techniques described herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard parts (ASSPs), system on chips (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include being implemented in one or more computer programs that are executable and / or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0141] Computer programs for implementing the methods of the present application may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when the computer program is executed by the processor, the functions / operations specified in the flowcharts and / or block diagrams are implemented. The computer program may be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0142] In the context of the present application, a computer-readable storage medium can be a tangible medium that can contain or store a computer program for use by an instruction execution system, device or equipment or used in combination with an instruction execution system, device or equipment. A computer-readable storage medium can include electronic, magnetic, optical, electromagnetic, infrared or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium can be a machine-readable signal medium. A machine-readable storage medium includes an electrical connection based on one or more lines, a portable computer disk, a hard disk, RAM, ROM, an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device or any suitable combination of the foregoing. The storage medium can be a non-transitory storage medium.

[0143] To provide interaction with a user, the systems and techniques described herein can be implemented on an electronic device having: a display device (e.g., a cathode ray tube (CRT) or a liquid crystal display (LCD) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0144] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with embodiments of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0145] A computing system may include a client and a server. The client and server are generally remote from each other and typically interact via a communication network. The client-server relationship arises through computer programs running on the respective computers and establishing a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, a host product within a cloud computing service ecosystem that addresses the management difficulties and limited scalability of traditional physical hosts and virtual private server (VPS) services.

[0146] The various forms of processes shown above can be used to reorder, add, or delete steps. For example, the multiple steps described in this application can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solution of this application can be achieved. This document is not limited here.

[0147] The above embodiments do not limit the scope of protection of this application. Various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors.

Claims

1. A processing method for eye tracking, include: Determine a current eye tracking related scenario, wherein the eye tracking related scenario includes at least one of the following: a wearable eye tracking device wearing scenario, a biometric registration scenario, an eye tracking calibration scenario, a first eye tracking scenario, a second eye tracking scenario, and a third eye tracking scenario; Determine a camera output mode and a light source wavelength according to the eye tracking related scene, wherein the camera output mode includes at least one of the following: a full pixel output mode, a region of interest ROI output mode, a downsampling output mode, and a ROI superimposed downsampling output mode, and the light source wavelength includes a first wavelength and a second wavelength; The data in the eye tracking related scene is processed based on the camera output mode and the light source wavelength.

2. The method according to claim 1, in, The determining of the camera output mode and the light source wavelength according to the eye tracking related scene includes: When the eye tracking related scene is a wearing scene of the wearable eye tracking device, the determined camera image output mode is the downsampling image output mode, and the determined light source wavelength is the second wavelength; The processing of the data in the eye tracking related scene based on the camera output mode and the light source wavelength includes: Collecting a first eye image of the user based on the downsampling image output mode and the light source of the second wavelength; Based on the first eye image, at least one of the following of the wearable eye tracking device is adjusted: position, or pupil distance.

3. The method according to claim 2, in, The adjusting at least one of the following of the wearable eye tracking device based on the first eye image: position, or pupil distance, comprises: Determining first eye feature data according to the first eye image, wherein the first eye feature data includes at least one of the following: pupil position, pupil shape, eyelid position, and eye corner position; determining at least one of the following according to the first eye feature data: first adjustment information, or second adjustment information; Guiding the user to adjust the position of the wearable eye tracking device according to the first adjustment information, or adjusting the pupil distance of the wearable eye tracking device according to the second adjustment information, or guiding the user to adjust the position of the wearable eye tracking device according to the first adjustment information and adjusting the pupil distance of the wearable eye tracking device according to the second adjustment information.

4. The method according to claim 1, in, The determining of the camera image output mode and the light source wavelength according to the eye tracking related scene includes: In a case where the eye tracking related scene is the biometric registration scene, the determined camera image output mode is the full pixel image output mode or the ROI image output mode, and the determined light source wavelength is the first wavelength; The processing of the data in the eye tracking related scene based on the camera output mode and the light source wavelength includes: Based on the full-pixel image output mode or the ROI image output mode and the light source of the first wavelength, eye images of the user when the user is gazing in different directions are collected to obtain a plurality of second eye images; respectively extracting local biological features from the plurality of second eye images; splicing the plurality of local biometric features to obtain a target biometric feature; The target biometric feature is stored, wherein the local biometric feature and the target biometric feature include at least one of the following: iris feature, fundus feature, retinal vascular feature, vascular feature on eye pattern sclera, and eye shape.

5. The method according to claim 1, in, The determining of the camera output mode and the light source wavelength according to the eye tracking related scene includes: When the eye tracking related scene is the eye tracking calibration scene, the determined camera image output mode is the ROI image output mode or the full pixel image output mode, and the determined light source wavelength is the first wavelength; The processing of the data in the eye tracking related scene based on the camera output mode and the light source wavelength includes: Based on the ROI image output mode or the full-pixel image output mode and the light source of the first wavelength, a third eye image of the user gazing at a set calibration point is collected; Calibration coefficients are determined based on the third eye image.

6. The method according to claim 5, in, The determining of the calibration coefficient based on the third eye image comprises: Determine second eye feature data according to the third eye image, wherein the second eye feature data includes at least one of the following: fundus data, pupil position, pupil shape, iris position, iris shape, eyelid position, eye corner position, and light spot position; The calibration coefficient is determined based on the second eye feature data.

7. The method according to claim 6, further comprising: include: determining a biometric feature of the user based on the third eye image; After determining the calibration coefficient based on the third eye image, the method further includes: The number is bound to the biometric feature and stored.

8. The method according to claim 1, in, The determining of the camera output mode and the light source wavelength according to the eye tracking related scene includes: When the eye tracking related scene is the first eye tracking scene, the determined camera image output mode is the ROI image output mode and the downsampling image output mode, and the determined light source wavelength is the first wavelength and the second wavelength; The processing of the data in the eye tracking related scene based on the camera output mode and the light source wavelength includes: Collecting a fourth eye image of the user based on the ROI output mode and the light source of the first wavelength; determining a biometric feature of the user based on the fourth eye image; Acquire a pre-stored calibration coefficient of the user according to the biometric feature; Switching the camera image output mode to the downsampling image output mode, and switching the light source wavelength to the second wavelength; Collecting a fifth eye image of the user based on the downsampling image output mode and the light source of the second wavelength; Eye tracking of the user is performed based on the fifth eye image and the calibration coefficient.

9. The method according to claim 1, in, The determining of the camera image output mode and the light source wavelength according to the eye tracking related scene includes: When the eye tracking related scene is the second eye tracking scene, the determined camera output mode is the ROI output mode, and the determined light source wavelength is the first wavelength and the second wavelength; The processing of the data in the eye tracking related scene based on the camera output mode and the light source wavelength includes: Collecting a sixth eye image of the user based on the ROI output mode and the light source of the first wavelength; determining a biometric feature of the user based on the sixth eye image; Acquire a pre-stored calibration coefficient of the user according to the biometric feature; Switching the wavelength of the light source to the second wavelength; Collecting a seventh eye image of the user based on the ROI output mode and the light source of the second wavelength; Eye tracking of the user is performed based on the seventh eye image and the calibration coefficient.

10. The method according to claim 1, in, The determining of the camera image output mode and the light source wavelength according to the eye tracking related scene includes: When the eye tracking related scene is the third eye tracking scene, the determined camera image output mode is the ROI image output mode and the ROI superposition downsampling image output mode, and the determined light source wavelength is the first wavelength or the first wavelength and the second wavelength; The processing of the data in the eye tracking related scene based on the camera output mode and the light source wavelength includes: Collecting an eighth eye image of the user based on the ROI output mode and the light source of the first wavelength; determining a biometric feature of the user based on the eighth eye image; Acquire a pre-stored calibration coefficient of the user according to the biometric feature; Switch the camera image output mode to the ROI superposition downsampling image output mode, and switch the light source wavelength to the second wavelength or still use the first wavelength; Collecting a ninth eye image of the user based on the ROI superimposed downsampling image output mode and the light source of the first wavelength or the second wavelength; Eye tracking of the user is performed based on the ninth eye image and the calibration coefficient.

11. An eye tracking processing device, include: An eye tracking related scene determination module is configured to determine a current eye tracking related scene, wherein the eye tracking related scene includes at least one of the following: a wearable eye tracking device wearing scene, a biometric registration scene, an eye tracking calibration scene, a first eye tracking scene, a second eye tracking scene, and a third eye tracking scene; An image output mode and light source wavelength determination module is configured to determine a camera image output mode and a light source wavelength according to the eye tracking related scene, wherein the camera image output mode includes at least one of the following: a full pixel image output mode, a region of interest ROI image output mode, a downsampling image output mode, and a ROI superimposed downsampling image output mode, and the light source wavelength includes a first wavelength and a second wavelength; The data processing module is configured to process the data in the eye tracking related scene based on the camera output mode and the light source wavelength.

12. An electronic device, include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, wherein the computer program is executed by the at least one processor so that the at least one processor can execute the claim. A method for processing eye tracking according to any one of 1 to 10 is sought.

13. A computer-readable storage medium, in, The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the eye tracking processing method according to any one of claims 1 to 10 when executed.

Citation Information

Patent Citations

  • Eye ground picture and image intelligent obtaining and recognizing system

    CN105411525A

  • Wearable equipment, parameter adjusting method and device thereof and storage medium

    CN108828771A

  • Eyeball tracking calibration method and device, equipment and storage medium

    CN110427101A

  • Method and system for splicing multiple eye fundus images

    CN112164043A

  • Line-of-sight detector and line-of-sight detection method

    US20170344110A1

Cited By

  • Head-mounted device, photographing method and device of head-mounted device, and medium

    CN121209108A