Eye movement data processing method, device, equipment and readable storage medium

By identifying and preprocessing eye movement states, the eye movement data is optimized, solving the problems of fluctuation and abrupt changes in eye movement data, and improving the stability of the displayed image and the user experience.

CN118262403BActive Publication Date: 2024-11-19BEIJING OPTIX LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410360185.0
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-03-27
Publication Date
2024-11-19
Estimated Expiration
2044-03-27

AI Technical Summary

Technical Problem

In existing technologies, eye-tracking data is volatile and prone to sudden changes, resulting in unstable display images and a poor user experience.

Method used

By identifying eye movement states, including fixation, saccades, tracking, and blinking, the eye movement data is preprocessed using methods such as noise reduction, smoothing, and correction to optimize the data.

Benefits of technology

It reduces the volatility and variability of eye-tracking data, improves the stability of the displayed image, and enhances the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118262403B_ABST
    Figure CN118262403B_ABST
Patent Text Reader

Abstract

The present disclosure relates to an eye movement data processing method, device, equipment and readable storage medium. By acquiring the eye movement data of the current user, identifying the movement state of the eyeball of the current user according to the eye movement data of the current user, and pre-processing the eye movement data of the current user according to the movement state of the eyeball, the target eye movement data of the current user is obtained. Compared with the eye movement data collected in the prior art, there is a certain volatility and mutation. The embodiment of the present disclosure acquires the eye movement data of the current user, identifies the movement state of the eyeball of the current user according to the eye movement data of the current user, and then pre-processes the eye movement data of the current user based on the movement state of the eyeball to obtain the target eye movement data of the current user. The collected eye movement data can be optimized through pre-processing, and the volatility and mutation of the eye movement data can be reduced, which can facilitate the subsequent improvement of the stability of the display screen and enhance the user experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of data processing technology, and in particular to an eye movement data processing method, device, equipment and readable storage medium. Background Art

[0002] Although it is possible to track the real-time state of the eyeball through devices such as cameras and sensors, due to the physiological characteristics of the human eye and the physical properties of the sensor, the eyeball may be in a state of motion, such as staring, scanning, following, blinking, etc., and the eye movement data in these states will inevitably fluctuate and mutate.

[0003] For some display devices, the screen display of the device will determine the direction of the user's line of sight based on the user's eye movement data, and adjust the display screen in real time based on the line of sight, thereby ensuring the user's visual experience. In the related art, the picture is adjusted directly using these raw eye movement data, so that the picture display is always unstable, which contradicts the expectation that the display device picture is stable. For example, when the user's eyes are looking at an object in the picture, the picture should be displayed stably and the distortion correction function should be fixed, so that the user's picture is stable, but the eyeball itself has eye vibration, which causes the real-time state of the eyeball to fluctuate within a small range at this time. This fluctuation will cause the line of sight to always fluctuate; when the user's eyes are scanning, the eyeball moves quickly. Because the eyeball moves too fast, at a conventional image sampling rate (for example, 120Hz), the shape of the eyeball is deformed in the picture due to the movement during the exposure period, resulting in the real-time eyeball model estimate calculated directly from the image being easily contained. Relatively large errors and mutations; during smooth tracking, even if the user's eyes follow an object moving in a straight line, the rotation of the eyeball is not an ideal smooth rotation, and the trajectory of the line of sight will not be in an ideal spatial plane, resulting in the calculated line of sight trajectory being a jittery curve along the ideal straight line; during blinking, the data will change dramatically. When the eyeball is not completely closed, sufficient features can still be extracted to calculate the eyeball model and estimate the line of sight, but the eye movement data will have a relatively obvious jump at this time. When the eyes are completely closed, the eye movement data of this time period will also be missing.

[0004] In the prior art, the raw eye movement data collected has certain volatility and mutation. If the original eye movement data is directly used to adjust the picture, the fluctuation and mutation of the real-time state of the eyeball will lead to unstable display and poor user experience. Therefore, how to reduce the volatility and mutation of eye movement data has become an urgent problem to be solved. Summary of the invention

[0005] In order to solve the above technical problems or at least partially solve the above technical problems, the present disclosure provides an eye movement data processing method, device, equipment and readable storage medium.

[0006] In a first aspect, an embodiment of the present disclosure provides an eye movement data processing method, the method comprising:

[0007] Get the current user's eye movement data;

[0008] According to the eye movement data of the current user, identifying the movement state of the eyeball of the current user, the movement state of the eyeball at least includes a gaze state, a scan state, a tracking state, and a blink state;

[0009] The eye movement data of the current user is preprocessed according to the movement state of the eyeball to obtain the target eye movement data of the current user.

[0010] In a second aspect, an embodiment of the present disclosure provides an eye movement data processing device, the device comprising:

[0011] The acquisition module is used to obtain the eye movement data of the current user;

[0012] An identification module, used to identify the movement state of the eyeball of the current user according to the eye movement data of the current user, wherein the movement state of the eyeball at least includes a gaze state, a scan state, a tracking state, and a blink state;

[0013] A processing module is used to pre-process the eye movement data of the current user according to the movement state of the eyeball to obtain the target eye movement data of the current user.

[0014] In a third aspect, an embodiment of the present disclosure provides an electronic device, including:

[0015] Memory;

[0016] Processor; and

[0017] Computer programs;

[0018] The computer program is stored in the memory and is configured to be executed by the processor to implement the method as described in the first aspect.

[0019] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program is executed by a processor to implement the method as described in the first aspect.

[0020] In a fifth aspect, an embodiment of the present disclosure further provides a computer program product, which includes a computer program or instructions, and when the computer program or instructions are executed by a processor, the method described in the first aspect is implemented.

[0021] The eye movement data processing method, device, equipment and readable storage medium provided by the embodiments of the present disclosure obtain the eye movement data of the current user, identify the eye movement state of the current user according to the eye movement data of the current user, and the eye movement state includes at least gaze state, saccade state, follow-up state and blink state, and pre-process the eye movement data of the current user according to the eye movement state to obtain the target eye movement data of the current user. Compared with the eye movement data collected in the prior art, which has certain volatility and mutation, the embodiments of the present disclosure obtain the eye movement data of the current user, identify the eye movement state of the current user according to the eye movement data of the current user, and then pre-process the eye movement data of the current user according to the eye movement state to obtain the target eye movement data of the current user, and pre-process the eye movement data of the current user based on the eye movement state. The collected eye movement data can be optimized through pre-processing, and the volatility and mutation of the eye movement data can be reduced, which can facilitate the subsequent improvement of the stability of the display screen and enhance the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0023] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0024] Figure 1 A flow chart of the eye movement data processing method provided in the embodiment of the present disclosure;

[0025] Figure 2 A flow chart of an eye movement data processing method provided by another embodiment of the present disclosure;

[0026] Figure 3 A flow chart of an eye movement data processing method provided by another embodiment of the present disclosure;

[0027] Figure 4 A schematic diagram of the structure of an eye movement data processing device provided in an embodiment of the present disclosure;

[0028] Figure 5 A schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0029] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.

[0030] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.

[0031] In the prior art, since the collected raw eye movement data has certain volatility and mutation, if the raw eye movement data is directly used to adjust the picture, the fluctuation and mutation of the real-time state of the eyeball will cause the display picture to be unstable and the user experience to be poor. Therefore, how to reduce the volatility and mutation of eye movement data has become an urgent problem to be solved. In response to this problem, the embodiment of the present disclosure provides an eye movement data processing method, which is introduced in conjunction with a specific embodiment below.

[0032] Figure 1 A flow chart of the eye movement data processing method provided in the embodiment of the present disclosure. The executor of the method is an electronic device, which may be a portable mobile device such as a smart phone, a tablet computer, a laptop computer, a car navigation device, an intelligent sports equipment, or a fixed device such as a personal computer, a smart home appliance, or a server, wherein the server may be a single server or a server cluster, and the server cluster may be a distributed cluster or a centralized cluster. The method can be applied to the scenario of processing eye movement data, and can reduce the volatility and mutation of eye movement data. It can be understood that the eye movement data processing method provided in the embodiment of the present disclosure can also be applied in other scenarios.

[0033] Below Figure 1 The eye movement data processing method shown in the figure is introduced, and the specific steps of the method are as follows:

[0034] S101. Obtain eye movement data of the current user.

[0035] In this step, the electronic device obtains the eye movement data of the current user. Specifically, the electronic device collects the eyeball images of the current user at various times through a camera or sensor, and obtains the eye movement data of the current user based on the eyeball images of the current user at various times. Optionally, the eye movement data of the current user includes the position information of the sight point at various times.

[0036] S102. Identify the eye movement state of the current user according to the eye movement data of the current user, where the eye movement state at least includes a gaze state, a scan state, a follow state, and a blink state.

[0037] In this step, after acquiring the eye movement data of the current user, the electronic device identifies the movement state of the eyeball of the current user according to the eye movement data of the current user. Optionally, the movement state of the eyeball includes, but is not limited to, a gaze state, a scan state, a tracking state, and a blink state. For example, the eye movement data of the current user includes the line of sight landing position information at each moment. If the line of sight landing position information at each moment is the same position information, the current user is identified as being in a gaze state; if the line of sight landing position information at each moment changes evenly with time, the current user is identified as being in a tracking state; if the line of sight landing position information at each moment changes significantly with time, the current user is identified as being in a scan state; if the line of sight landing position information at a certain moment or several moments suddenly disappears, the current user is identified as being in a blink state.

[0038] S103 . Preprocess the eye movement data of the current user according to the movement state of the eyeball to obtain target eye movement data of the current user.

[0039] In this step, the electronic device can preprocess the eye movement data of the current user according to the movement state of the eyeball to obtain the target eye movement data of the current user. Optionally, the preprocessing includes but is not limited to denoising, smoothing, etc. The collected eye movement data can be optimized through preprocessing, and the volatility and mutation of the eye movement data can be reduced. Different processing strategies are adopted for different eye movement states. When tracking the eye state in real time, the captured eye movement data is first preprocessed. Through data preprocessing, the instability of the picture caused by the natural movement of the eyeball (such as eye vibration) or rapid movement (such as scanning) can be reduced, and the stability of the displayed picture is improved. This stability is achieved by optimizing the line of sight direction through an algorithm and smoothing the fluctuations caused by eye movement, thereby ensuring the continuity and stability of the displayed picture.

[0040] The disclosed embodiment obtains the eye movement data of the current user, identifies the eye movement state of the current user according to the eye movement data of the current user, and the eye movement state includes at least a gaze state, a saccade state, a tracking state, and a blink state. The eye movement data of the current user is preprocessed according to the eye movement state to obtain the target eye movement data of the current user. Compared with the eye movement data collected in the prior art, which has certain volatility and mutation, the disclosed embodiment obtains the eye movement data of the current user, identifies the eye movement state of the current user according to the eye movement data of the current user, and then preprocesses the eye movement data of the current user according to the eye movement state to obtain the target eye movement data of the current user. The eye movement data of the current user is preprocessed based on the eye movement state. The collected eye movement data can be optimized through preprocessing, and the volatility and mutation of the eye movement data can be reduced, which can facilitate the subsequent improvement of the stability of the display screen and enhance the user experience. The disclosed embodiments can effectively identify and adapt to different eye movement states and adopt corresponding processing strategies, which can effectively reduce the errors in eye movement data caused by sudden changes in eye states and ensure the accuracy and reliability of the data.

[0041] Figure 2 A flow chart of an eye movement data processing method provided by another embodiment of the present disclosure, such as Figure 2 As shown, the method includes the following steps:

[0042] S201. Obtain eye movement data of the current user.

[0043] Specifically, the implementation process and principle of S201 and S101 are the same, and will not be repeated here.

[0044] S202. Obtain characteristic data of the eye movement of the current user according to the eye movement data of the current user, wherein the characteristic data includes linear velocity, angular velocity, acceleration, and period of the eye movement.

[0045] In this step, the electronic device can obtain the characteristic data of the eye movement of the current user based on the eye movement data of the current user, and the characteristic data includes but is not limited to the linear velocity, angular velocity, acceleration, movement cycle, etc. of the eye movement, so as to accurately distinguish different movement states of the eye.

[0046] S203: Identify the movement state of the eyeballs of the current user according to the feature data of the eyeball movement.

[0047] After obtaining the characteristic data of the eye movement of the current user, the electronic device can identify the movement state of the eye of the current user according to the characteristic data of the eye movement. For example, this can be achieved through a machine learning algorithm, and a large amount of sample data of different eye movement states needs to be input when the algorithm is trained. The characteristic data of the eye movement of the current user is input into a pre-trained machine learning model, and the movement state of the eye of the current user is identified through the machine learning model.

[0048] S204 , performing denoising processing on the eye movement data of the current user according to the movement state of the eyeball to obtain denoised eye movement data.

[0049] In this step, the electronic device performs denoising on the eye movement data of the current user according to the eye movement state to obtain denoised eye movement data, removing noise frequency components that do not match the eye movement characteristics, which may be caused by external environmental factors or noise generated by the device itself.

[0050] S205 , performing smoothing processing on the denoised eye movement data to obtain smoothed eye movement data.

[0051] In this step, the electronic device will smooth the denoised eye movement data to obtain smoothed eye movement data. Optionally, the smoothing process can be performed by a moving average method, which can effectively reduce short-term fluctuations by calculating the moving average of the eye movement data points to smooth the data.

[0052] Optionally, the moving average can be calculated using the following methods:

[0053] 1) Simple Moving Average (SMA):

[0054] The simple moving average method is the most basic moving average calculation method. This method can calculate the arithmetic mean of a fixed number of sample points. For example, a 10-point simple moving average is the average of the current point and the 9 points before the current point.

[0055] The calculation formula for simple moving average is:

[0056]

[0057] Among them, P 1、 P2, ..., P n Represents n consecutive data points.

[0058] 2) Weighted Moving Average (WMA):

[0059] In the weighted moving average method, different data points have different weights. Generally, the closer the data point is to the current time point, the greater the weight will be.

[0060] The calculation formula of weighted moving average is:

[0061]

[0062] Among them, P 1、 P2, ..., P n represents n data points, w1, w2, ..., w n Respectively represent P 1、 P2, ..., P n The corresponding weight.

[0063] 3) Exponential Moving Average (EMA):

[0064] The exponential moving average method gives higher weight to data points that are closer to the current time point, and the weight decreases exponentially over time. Therefore, EMA is more sensitive to the latest data changes. The exponential moving average method calculates the smoothing result of the current data point based on a set number of data points.

[0065] The formula for calculating the exponential moving average is:

[0066] EMA n =α×P n +(1-α)×EMA n-1

[0067] Among them, α represents the smoothing coefficient, P n Represents the nth data point.

[0068] In some embodiments, the calculation method of the moving average can be selected according to the specific application scenario and the data characteristics that need to be emphasized. Optionally, if you want to pay more attention to the recent changes in data points and maintain the sensitivity to changes in eye movement data, such as when the application scenario is a game screen, you can choose an exponential moving average or a weighted moving average; if you want to smooth the data over a period of time and improve the stability of the screen, such as when the application scenario is a movie or video screen, you can choose a simple moving average.

[0069] In some embodiments, the calculation method of the moving average value can be selected based on the movement state of the eyeball, for example, a simple moving average is selected in the gaze state, a weighted moving average is selected in the tracking state, and an exponential moving average is selected in the scanning state, which is not specifically limited here.

[0070] S206: Correct the smoothed eye movement data to obtain target eye movement data of the current user.

[0071] In this step, the electronic device will correct the smoothed eye movement data to obtain the target eye movement data of the current user to reduce data fluctuations. Specifically, the electronic device will perform outlier detection and correct the detected outliers.

[0072] In some embodiments, statistical methods such as standard deviation, interquartile range (IQR), etc. can be used to detect or identify outliers. In some embodiments, if any data point is outside the normal range, the data point is determined to be an outlier.

[0073] After detecting an outlier, different correction strategies may be adopted. In some embodiments, the outlier may be replaced by the average of its neighboring values, or the outlier may be corrected predictively based on historical data trends, which are not specifically limited here.

[0074] In some embodiments, a correction strategy corresponding to the movement state of the eyeball can be used to correct the data. For example, in the gaze state, the outlier can be replaced by the average value of the outlier's adjacent values; in the glance state, a high-order polynomial can be fitted based on the data before the outlier, and the high-order polynomial can be used to predict the normal value, and the outlier can be replaced by the normal value; in the following state, the normal value can be linearly predicted and estimated based on the adjacent data, and the outlier can be replaced by the normal value; in the blink state, data prediction is performed based on the state before blinking. If it was in the gaze state before, the outlier can be replaced by the data in the gaze state. If it is in the glance or following state, the normal value can be predicted based on the existing data, and the outlier can be replaced by the normal value.

[0075] S207, determining the sight direction of the current user according to the target eye movement data, optimizing and correcting the sight direction based on the eyeball images collected at each moment, to obtain an optimized sight direction.

[0076] In this step, the sight line direction can be optimized and corrected by a preset algorithm to obtain an optimized sight line direction, wherein the preset algorithm includes but is not limited to a sight line stabilization algorithm, which can smooth the picture fluctuations caused by eye movement, especially smooth the picture fluctuations caused by rapid eye movement and blinking. The algorithm can effectively reduce picture jitter and visual discomfort by adjusting the sight line direction using the previous eye position and the predicted eye movement trend.

[0077] In some embodiments, the sight line direction may be optimized and corrected based on the movement state of the eyeball to obtain an optimized sight line direction.

[0078] For example, 1) during the gaze process, the deviation between the original data of the current frame and the optimized result value can be calculated. When the deviation between the original data of the current frame and the optimized result value is less than a preset multiple of the standard deviation, the previous frame data is used to replace the original data of the current frame, so as to achieve the optimization and correction processing of the line of sight direction in the gaze state;

[0079] 2) During the scanning process, the direction of the eye's scanning is theoretically a straight line from the current position of the eye toward the expected target position. In the initial stage, the eye movement accelerates slowly, and the degree of motion blur of the collected eye image is relatively small. The straight line direction corresponding to the eye scanning trajectory can be collected more accurately. However, when the eye accelerates faster, the degree of motion blur of the collected eye image is larger. Due to calculation errors, the eye's direction may be wrong, and the speed and direction of the eye's scanning may be obviously abnormal, so optimization is needed. Optionally, the position of the eye during the scanning process can be predicted based on the direction data collected in the slow acceleration stage and the theoretical speed of the eye's scanning movement, so as to optimize and correct the line of sight direction during the scanning state;

[0080] 3) During the tracking process, the deviation of the trajectory of the preprocessed data compared to the target trajectory will switch between positive and negative. In this embodiment, the range of the deviation value of the existing data in the preset time window can be calculated. If the deviation of the data of the current frame in the preset time window is within the range of the range, the linear prediction value of the previous frame data is used, and the linear prediction value is used to replace the original data of the current frame, so as to achieve the optimization and correction of the line of sight direction in the tracking state;

[0081] 4) During the blinking process, blinking is more likely to cause obvious data fluctuations, because the characteristic areas of the eye direction will change significantly when blinking, such as the pupil, iris, sclera, light spot and other characteristic areas. At this time, the eye direction at this time can be predicted based on the eye movement data before the blinking state, so as to complete the missing data and replace the original data of the current frame with the eye movement data before the blinking state, so as to achieve optimization and correction of the line of sight direction when blinking.

[0082] S208. Optimize the target eye movement data based on the optimized sight line direction to obtain optimized eye movement data of the current user.

[0083] Further, the electronic main device optimizes the target eye movement data based on the optimized sight line direction to obtain the optimized eye movement data of the current user.

[0084] In some embodiments, after obtaining the optimized eye movement data of the current user, the method further includes: performing deep learning on the optimized eye movement data of the current user to obtain eye movement feature information of the current user's eyes in various movement states, and adaptively adjusting the optimized eye movement data of the current user according to the eye movement feature information to obtain the adjusted eye movement data of the current user.

[0085] The disclosed embodiment obtains the eye movement data of the current user, obtains the characteristic data of the eye movement of the current user according to the eye movement data of the current user, and the characteristic data includes the linear velocity, angular velocity, acceleration, and period of the eye movement. According to the characteristic data of the eye movement, the movement state of the eye of the current user is identified. Further, the eye movement data of the current user is denoised according to the movement state of the eye to obtain the denoised eye movement data, the denoised eye movement data is smoothed to obtain the smoothed eye movement data, and the smoothed eye movement data is corrected to obtain the target eye movement data of the current user. Then, the sight direction of the current user is determined according to the target eye movement data, the sight direction is optimized and corrected based on the eye images collected at each moment to obtain the optimized sight direction, and the target eye movement data is optimized based on the optimized sight direction to obtain the optimized eye movement data of the current user. Through this method, the collected eye movement data is optimized, the volatility and mutation of the eye movement data can be reduced, and then it can be convenient to improve the stability of the display screen and enhance the user experience.

[0086] Figure 3 A flow chart of an eye movement data processing method provided by another embodiment of the present disclosure, such as Figure 3 As shown, the method includes the following steps:

[0087] S301: Obtain eye movement data of the current user.

[0088] Specifically, the implementation process and principle of S301 and S101 are the same, and will not be repeated here.

[0089] S302: Identify the eye movement state of the current user according to the eye movement data of the current user, where the eye movement state at least includes a gaze state, a scan state, a follow state, and a blink state.

[0090] Specifically, the implementation process and principle of S302 and S102 are the same, and will not be repeated here.

[0091] S303: Perform Fourier transform on the eye movement data of the current user to obtain eye movement frequency domain data.

[0092] In this step, the eye movement data is Fourier transformed to convert the time series data into the frequency domain, so as to analyze the intensity of each frequency component in the eye movement data. In the frequency domain, the distribution of each frequency component can be clearly seen. These frequency components include the main frequency of eye movement (such as the characteristic frequency of fixation, saccade, etc.), as well as possible noise frequencies (such as equipment noise, environmental interference, etc.).

[0093] S304 , identifying and removing noise frequency domain data in the eye movement frequency domain data according to the movement state of the eyeball, to obtain denoised eye movement frequency domain data.

[0094] In this step, the electronic device will identify and eliminate the frequency components that do not match the eye movement characteristics to obtain denoised eye movement frequency domain data.

[0095] In some embodiments, S304 includes but is not limited to S3041, S3042, S3043, S3044:

[0096] S3041. If the movement state of the eyeball is a fixation state, the eye movement frequency domain data whose frequency value of the frequency domain component in the eye movement frequency domain data is greater than a preset frequency threshold is eliminated to obtain denoised eye movement frequency domain data.

[0097] When in the fixation state, the physiological characteristics of the eyeball are: the eyeball moves continuously when fixating, generally about ±5 degrees, and can reach ±30 degrees.

[0098] It contains three sub-movements: 1) tremor: movement caused by the inability to fully and accurately control the eye muscles (30-100 Hz, <0.008°); 2) slow drift: tiny movements caused by binocular fusion (1-5 Hz, 0.017-0.083°); 3) micro saccades: movements made to maintain objects in the field of vision. Micro saccadic movements also help correct the line of sight deviation caused by slow drift (1-2 Hz, 0.017-0.416°).

[0099] In the fixation state, the frequency domain distribution mainly contains many low-intensity signals of different frequencies. At this time, the main motion components that need to be eliminated are micro-movements and slow drifts. The eye movement frequency domain data whose frequency values ​​of the frequency domain components are greater than the preset frequency threshold are eliminated to obtain the denoised eye movement frequency domain data. Specifically, this can be achieved by deleting the frequency domain components in the eye movement data that are higher than the preset frequency threshold, such as 2Hz.

[0100] S3042: If the movement state of the eyeball is a scanning state, the eye movement frequency domain data whose intensity value of the frequency domain component is less than a first preset intensity threshold is eliminated to obtain denoised eye movement frequency domain data.

[0101] When in the scanning state, the physiological characteristics of the eyeball are: the scanning speed can reach 700 degrees / second, and the error when scanning the target is about 0.25 to 3 degrees.

[0102] In the scanning state, the frequency domain distribution mainly contains a low-frequency high-intensity signal and many low-intensity noise signals. At this time, the main motion component that needs to be eliminated is the random error in the scanning process. The eye movement frequency domain data whose intensity value of the frequency domain component is less than the first preset intensity threshold is eliminated to obtain the denoised eye movement frequency domain data. Specifically, it can be achieved by deleting the frequency domain component whose signal intensity is lower than the first preset intensity threshold.

[0103] S3043. If the movement state of the eyeball is a following state, the eye movement frequency domain data whose intensity value of the frequency domain component is less than a second preset intensity threshold is eliminated to obtain denoised eye movement frequency domain data.

[0104] In the tracking state, the physiological characteristics of the eyeball are: the tracking speed is slower than the saccadic movement, about 100 degrees / second. When the speed is greater than 100 degrees / second, the accuracy decreases.

[0105] In the following state, the frequency domain distribution at this time mainly contains a low-frequency signal with high intensity and many low-intensity high-frequency noise signals. What needs to be eliminated at this time is the random error in the following process, and the eye movement frequency domain data whose intensity value of the frequency domain component in the eye movement frequency domain data is less than the second preset intensity threshold is eliminated to obtain the denoised eye movement frequency domain data. Specifically, this can be achieved by deleting the frequency domain component whose signal intensity is lower than the second preset intensity threshold.

[0106] S3044. If the movement state of the eyeball is a blinking state, the eye movement frequency domain data in the blinking state is discarded, and the eye movement frequency domain data before the blinking state is used to replace the eye movement frequency domain data in the blinking state to obtain the denoised eye movement frequency domain data.

[0107] When blinking, the physiological characteristics of the eyeball are: the blinking frequency is about 12 to 15 times per minute, and the duration is about 100 to 400ms.

[0108] In the blinking state, it is possible to determine whether the eye is blinking based on the eyeball images collected at each moment. At this time, it is necessary to remove the data during the blinking state, and use the eye movement frequency domain data before the blinking state to replace the eye movement frequency domain data during the blinking state, that is, continue to use the eye movement frequency domain data before the blinking state to obtain the denoised eye movement frequency domain data.

[0109] S305 , performing inverse Fourier transform on the denoised eye movement frequency domain data to obtain denoised eye movement data.

[0110] In this step, the electronics convert the data from the frequency domain back to the time domain using an inverse Fourier transform. The signal after denoising will be smoother and will not contain those noise frequency components.

[0111] In some embodiments, after obtaining the denoised eye movement data, the electronic device can perform frequency domain characteristic analysis on the denoised eye movement data to ensure that the filtered out frequency components are indeed noise and not an important part of the eye movement data, thereby further maintaining the integrity and accuracy of the data.

[0112] S306: Smoothing the denoised eye movement data to obtain smoothed eye movement data.

[0113] Specifically, the implementation process and principle of S306 and S205 are the same, and will not be repeated here.

[0114] S307: Correct the smoothed eye movement data to obtain target eye movement data of the current user.

[0115] Specifically, the implementation process and principle of S307 and S206 are the same, and will not be repeated here.

[0116] S308. Perform deep learning on the target eye movement data of the current user to obtain eye movement feature information of the current user's eyes in various movement states, and adaptively adjust the eye movement data of the current user according to the eye movement feature information to obtain adjusted eye movement data of the current user.

[0117] In the aforementioned steps, a series of processing is performed on the eye movement data of the current user to obtain target eye movement data. Through these processing, the collected eye movement data can be optimized, and the data quality of the obtained target eye movement data is better, which can reduce the volatility and mutation of the eye movement data.

[0118] Through deep learning algorithms, it is possible to learn the characteristic information of the current user in different eye movement states. For example, in the gaze state, it is possible to learn the gaze characteristic information such as the intensity and period of each characteristic component in the eye movement; in the saccade state, it is possible to learn the saccade characteristic information such as the saccade speed, acceleration, saccade start delay, and degree of oversaccade at the end of the saccade; in the tracking state, it is possible to learn the tracking characteristic information such as the delay of eye movement and the tracking error when the direction changes suddenly; in the blinking state, it is possible to learn the blinking characteristic information such as the blinking frequency and the process of eye occlusion during the blinking process. Furthermore, it is possible to make some adaptive adjustments to the eye movement data of the current user for the current user.

[0119] In some optional embodiments, since the target eye movement data has good data quality, prediction can be performed based on the target eye movement data with good data quality. Specifically, the target eye movement data can be used for deep learning to adaptively adjust the eye movement data of the current user to obtain the adjusted eye movement data of the current user, and further, based on the adjusted eye movement data of the current user, data after several frames is predicted to replace the current frame data.

[0120] In some embodiments, due to delays in image acquisition, screen display, etc., the data after several frames can be predicted based on the adjusted eye movement data of the current user and used as the current frame data to avoid delays. A deep learning algorithm is introduced. The deep learning algorithm can be an adaptive learning algorithm without limitation. By continuously learning the user's eye movement pattern, the algorithm can be continuously optimized and adjusted to adapt to the eye movement characteristics of different users, and personalized adjustments can be made for different users, so that the eye tracking data is more accurate, so as to provide a more personal visual experience when displaying the screen.

[0121] The disclosed embodiment obtains the eye movement data of the current user, and identifies the movement state of the eyeball of the current user according to the eye movement data of the current user, wherein the movement state of the eyeball at least includes the gaze state, the saccade state, the tracking state, and the blink state. Further, the eye movement data of the current user is Fourier transformed to obtain the eye movement frequency domain data, and the noise frequency domain data in the eye movement frequency domain data is identified and eliminated according to the movement state of the eyeball to obtain the denoised eye movement frequency domain data, and the denoised eye movement frequency domain data is inversely Fourier transformed to obtain the denoised eye movement data. Then, the denoised eye movement data is smoothed to obtain the smoothed eye movement data, and the smoothed eye movement data is corrected to obtain the target eye movement data of the current user. Next, the target eye movement data of the current user is deeply learned to obtain the eye movement feature information of the current user's eyeball in various movement states, and the eye movement data of the current user is adaptively adjusted according to the eye movement feature information to obtain the adjusted eye movement data of the current user. Through this method, the collected eye movement data is optimized, which can reduce the volatility and mutation of the eye movement data, and thus facilitate the subsequent improvement of the stability of the display image and enhance the user experience.

[0122] Figure 4 Schematic diagram of the structure of the eye movement data processing device provided in the embodiment of the present disclosure. The eye movement data processing device may be the electronic device as described in the above embodiment, or the eye movement data processing device may be a component or assembly in the electronic device. The eye movement data processing device provided in the embodiment of the present disclosure may execute the processing flow provided in the eye movement data processing method embodiment, such as Figure 4As shown, the eye movement data processing device 40 includes: an acquisition module 41, an identification module 42, and a processing module 43; wherein the acquisition module 41 is used to acquire the eye movement data of the current user; the identification module 42 is used to identify the eye movement state of the current user according to the eye movement data of the current user, and the eye movement state at least includes a gaze state, a scan state, a tracking state, and a blink state; the processing module 43 is used to pre-process the eye movement data of the current user according to the eye movement state to obtain the target eye movement data of the current user.

[0123] Optionally, when the recognition module 42 identifies the movement state of the eye of the current user based on the eye movement data of the current user, it is specifically used to: obtain characteristic data of the eye movement of the current user based on the eye movement data of the current user, the characteristic data including linear velocity, angular velocity, acceleration, and period of the eye movement; and identify the movement state of the eye of the current user based on the characteristic data of the eye movement.

[0124] Optionally, the processing module 43 pre-processes the eye movement data of the current user according to the movement state of the eyeball to obtain the target eye movement data of the current user, and is specifically used to: denoise the eye movement data of the current user according to the movement state of the eyeball to obtain denoised eye movement data; smooth the denoised eye movement data to obtain smoothed eye movement data; and correct the smoothed eye movement data to obtain the target eye movement data of the current user.

[0125] Optionally, the processing module 43 denoises the eye movement data of the current user according to the movement state of the eyeball, and when obtaining the denoised eye movement data, it is specifically used to: perform Fourier transform on the eye movement data of the current user to obtain eye movement frequency domain data; identify and eliminate noise frequency domain data in the eye movement frequency domain data according to the movement state of the eyeball to obtain denoised eye movement frequency domain data; perform inverse Fourier transform on the denoised eye movement frequency domain data to obtain denoised eye movement data.

[0126] Optionally, the processing module 43 identifies and removes the noise frequency domain data in the eye movement frequency domain data according to the movement state of the eyeball, and when obtaining the denoised eye movement frequency domain data, it is specifically used to: if the movement state of the eyeball is a gaze state, then remove the eye movement frequency domain data whose frequency value of the frequency domain component in the eye movement frequency domain data is greater than a preset frequency threshold, and obtain the denoised eye movement frequency domain data; if the movement state of the eyeball is a glance state, then remove the eye movement frequency domain data whose frequency value of the frequency domain component in the eye movement frequency domain data is less than a first preset intensity threshold, and obtain the denoised eye movement frequency domain data. The eye movement frequency domain data below a preset intensity threshold are eliminated to obtain denoised eye movement frequency domain data; if the movement state of the eyeball is a following state, the eye movement frequency domain data whose intensity value of the frequency domain component is less than a second preset intensity threshold are eliminated to obtain denoised eye movement frequency domain data; if the movement state of the eyeball is a blinking state, the eye movement frequency domain data in the blinking state are eliminated, and the eye movement frequency domain data before the blinking state are used to replace the eye movement frequency domain data in the blinking state to obtain denoised eye movement frequency domain data.

[0127] Optionally, after preprocessing the eye movement data of the current user according to the movement state of the eyeball to obtain the target eye movement data of the current user, the device 40 also includes: an obtaining module 44 and an optimization module 45; the obtaining module 44 is used to determine the line of sight direction of the current user according to the target eye movement data, and optimize and correct the line of sight direction based on the eyeball images collected at each moment to obtain the optimized line of sight direction; the optimization module 45 is used to optimize the target eye movement data based on the optimized line of sight direction to obtain the optimized eye movement data of the current user.

[0128] Optionally, after preprocessing the eye movement data of the current user according to the movement state of the eyeball to obtain the target eye movement data of the current user, the device 40 also includes: an adjustment module 46; the adjustment module 46 is used to perform deep learning on the target eye movement data of the current user to obtain the eye movement feature information of the current user's eyes in various movement states, and adaptively adjust the eye movement data of the current user according to the eye movement feature information to obtain the adjusted eye movement data of the current user.

[0129] Figure 4 The eye movement data processing device of the illustrated embodiment can be used to execute the technical solution of the above-mentioned method embodiment. Its implementation principle and technical effects are similar and will not be repeated here.

[0130] Figure 5 Schematic diagram of the structure of an electronic device in the embodiment of the present disclosure. Figure 5 , which shows a structural schematic diagram of an electronic device 600 suitable for implementing the embodiments of the present disclosure. Figure 5The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0131] like Figure 5 As shown, the electronic device 600 may include a processing device (e.g., a central processing unit, a graphics processor, etc.) 601, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 602 or a program loaded from a storage device 608 to a random access memory (RAM) 603 to implement the eye movement data processing method of the embodiment described in the present disclosure. In the RAM 603, various programs and data required for the operation of the electronic device 600 are also stored. The processing device 601, the ROM 602, and the RAM 603 are connected to each other via a bus 604. An input / output (I / O) interface 605 is also connected to the bus 604.

[0132] Typically, the following devices may be connected to the I / O interface 605: an input device 606 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 607 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 608 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 609. The communication device 609 may allow the electronic device 600 to communicate with other devices wirelessly or by wire to exchange data. Although Figure 5 The electronic device 600 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0133] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program contains a program code for executing the method shown in the flowchart, thereby implementing the eye movement data processing method as described above. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 609, or installed from the storage device 608, or installed from the ROM 602. When the computer program is executed by the processing device 601, the above functions defined in the method of the embodiment of the present disclosure are executed.

[0134] It should be noted that the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried. This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. The computer readable signal medium may also be any computer readable medium other than a computer readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0135] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0136] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0137] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device:

[0138] Get the current user's eye movement data;

[0139] According to the eye movement data of the current user, identifying the movement state of the eyeball of the current user, the movement state of the eyeball at least includes a gaze state, a scan state, a tracking state, and a blink state;

[0140] The eye movement data of the current user is preprocessed according to the movement state of the eyeball to obtain the target eye movement data of the current user.

[0141] Optionally, when the above one or more programs are executed by the electronic device, the electronic device may also execute other steps described in the above embodiments.

[0142] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including, but not limited to, object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0143] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0144] The units involved in the embodiments described in the present disclosure may be implemented by software or hardware, wherein the name of a unit does not, in some cases, limit the unit itself.

[0145] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0146] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0147] The above description is only a preferred embodiment of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, the above features are replaced with the technical features with similar functions disclosed in the present disclosure (but not limited to) by each other to form a technical solution.

[0148] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0149] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims

1. A method for processing eye movement data, characterized in that: The method comprises: Get the current user's eye movement data; According to the eye movement data of the current user, identifying the movement state of the eyeball of the current user, the movement state of the eyeball at least includes a gaze state, a scan state, a tracking state, and a blink state; Preprocessing the eye movement data of the current user according to the movement state of the eyeball to obtain target eye movement data of the current user; The preprocessing of the eye movement data of the current user according to the movement state of the eyeball includes: Performing denoising on the eye movement frequency domain data according to the movement state of the eyeball to obtain denoised eye movement frequency domain data, wherein the eye movement frequency domain data is obtained by transforming the eye movement data of the current user; The step of performing denoising on the eye movement frequency domain data according to the movement state of the eyeball to obtain denoised eye movement frequency domain data includes: If the movement state of the eyeball is a fixation state, the eye movement frequency domain data whose frequency value of the frequency domain component in the eye movement frequency domain data is greater than a preset frequency threshold is removed to obtain denoised eye movement frequency domain data; If the movement state of the eyeball is a saccade state, the eye movement frequency domain data whose intensity value of the frequency domain component in the eye movement frequency domain data is less than a first preset intensity threshold is eliminated to obtain denoised eye movement frequency domain data; If the movement state of the eyeball is a following state, the eye movement frequency domain data whose intensity value of the frequency domain component is less than a second preset intensity threshold is eliminated to obtain denoised eye movement frequency domain data; If the movement state of the eyeball is a blinking state, the eye movement frequency domain data in the blinking state is discarded, and the eye movement frequency domain data before the blinking state is used to replace the eye movement frequency domain data in the blinking state to obtain the denoised eye movement frequency domain data.

2. The method according to claim 1, characterized in that The step of identifying the movement state of the eyeball of the current user according to the eye movement data of the current user includes: Obtaining feature data of the eye movement of the current user according to the eye movement data of the current user, wherein the feature data includes linear velocity, angular velocity, acceleration, and period of the eye movement; The movement state of the eyeball of the current user is identified according to the feature data of the eyeball movement.

3. The method according to claim 1, characterized in that The preprocessing of the eye movement data of the current user according to the movement state of the eyeball to obtain the target eye movement data of the current user includes: Performing denoising on the eye movement data of the current user according to the movement state of the eyeball to obtain denoised eye movement data; Smoothing the denoised eye movement data to obtain smoothed eye movement data; The smoothed eye movement data is corrected to obtain the target eye movement data of the current user.

4. The method according to claim 3, characterized in that The denoising process is performed on the eye movement data of the current user according to the movement state of the eyeball to obtain the denoised eye movement data, including: Performing Fourier transform on the eye movement data of the current user to obtain eye movement frequency domain data; Identifying and removing noise frequency domain data in the eye movement frequency domain data according to the movement state of the eyeball, to obtain denoised eye movement frequency domain data; Performing an inverse Fourier transform on the denoised eye movement frequency domain data to obtain denoised eye movement data.

5. The method according to claim 1, characterized in that After preprocessing the eye movement data of the current user according to the movement state of the eyeball to obtain the target eye movement data of the current user, the method further includes: Determine the sight direction of the current user according to the target eye movement data, and optimize and correct the sight direction based on the eyeball images collected at each moment to obtain an optimized sight direction; The target eye movement data is optimized based on the optimized sight line direction to obtain the optimized eye movement data of the current user.

6. The method according to claim 1, characterized in that After preprocessing the eye movement data of the current user according to the movement state of the eyeball to obtain the target eye movement data of the current user, the method further includes: Deep learning is performed on the target eye movement data of the current user to obtain eye movement feature information of the current user's eyeballs in various movement states, and the eye movement data of the current user is adaptively adjusted according to the eye movement feature information to obtain adjusted eye movement data of the current user.

7. An eye movement data processing device, characterized in that: include: The acquisition module is used to obtain the eye movement data of the current user; An identification module, used to identify the movement state of the eyeball of the current user according to the eye movement data of the current user, wherein the movement state of the eyeball at least includes a gaze state, a scan state, a tracking state, and a blink state; A processing module, used for pre-processing the eye movement data of the current user according to the movement state of the eyeball to obtain the target eye movement data of the current user; When the processing module pre-processes the eye movement data of the current user according to the movement state of the eyeball, it is specifically used to: Performing denoising on the eye movement frequency domain data according to the movement state of the eyeball to obtain denoised eye movement frequency domain data, wherein the eye movement frequency domain data is obtained by transforming the eye movement data of the current user; The processing module performs denoising on the eye movement frequency domain data according to the movement state of the eyeball to obtain the denoised eye movement frequency domain data, specifically for: If the movement state of the eyeball is a fixation state, the eye movement frequency domain data whose frequency value of the frequency domain component in the eye movement frequency domain data is greater than a preset frequency threshold is removed to obtain denoised eye movement frequency domain data; If the movement state of the eyeball is a saccade state, the eye movement frequency domain data whose intensity value of the frequency domain component in the eye movement frequency domain data is less than a first preset intensity threshold is eliminated to obtain denoised eye movement frequency domain data; If the movement state of the eyeball is a following state, the eye movement frequency domain data whose intensity value of the frequency domain component is less than a second preset intensity threshold is eliminated to obtain denoised eye movement frequency domain data; If the movement state of the eyeball is a blinking state, the eye movement frequency domain data in the blinking state is discarded, and the eye movement frequency domain data before the blinking state is used to replace the eye movement frequency domain data in the blinking state to obtain the denoised eye movement frequency domain data.

8. An electronic device, characterized in that: include: Memory; processor; as well as Computer programs; The computer program is stored in the memory and is configured to be executed by the processor to implement the method according to any one of claims 1 to 6.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.