Delay detection method, device and equipment for eye movement equipment and storage medium

Abstract

The invention relates to a delay detection method, device and equipment for eye movement equipment and a storage medium. The method comprises the steps of performing time synchronization processing on a first camera module and a second camera module; the first camera module is an eye movement tracking module in the eye movement equipment; using the first camera module and the second camera module after time synchronization processing to detect movement information of a fixation point of human eyes moving along a preset track; the movement information at least comprises a movement position and timestamp information corresponding to the movement position; and determining the processing delay of the first camera module according to the movement information detected by the first camera module and the movement information detected by the second camera module.

Description

Technical Field

[0001] The present disclosure relates to the field of intelligent terminals, and particularly to a method, device, equipment and storage medium for detecting the delay of an eye movement device. Background Art

[0002] An eye movement device can track the gaze focus of a human eye in real time and has a wide range of applications in devices with technologies such as Augmented Reality (AR) and Virtual Reality (VR). The performance of the eye movement device, especially the latency of the device and algorithm, has a crucial impact on the user experience.

[0003] In order to ensure that the performance of the eye movement device meets the expectations, in the related art, by setting a mechanical eye, the human eye is made to move in real time following the mechanical eye, and then by comparing the spatial position of the gaze focus of the human eye output by the eye movement device with the actual spatial position of the mechanical eye, the delay of the eye movement device is determined. Summary of the Invention

[0004] To overcome the problems existing in the related art, the present disclosure provides a method, device, equipment and storage medium for detecting the delay of an eye movement device.

[0005] In a first aspect of the present disclosure, there is provided a method for detecting the delay of an eye movement device, the method comprising:

[0006] Performing time synchronization processing on a first camera module and a second camera module; the first camera module is an eye movement tracking module in the eye movement device;

[0007] Detecting movement information of the gaze point of the human eye moving along a preset trajectory by using the first camera module and the second camera module after time synchronization processing; the movement information at least includes: a movement position and timestamp information corresponding to the movement position;

[0008] Determining the processing delay of the first camera module according to the movement information detected by the first camera module and the movement information detected by the second camera module.

[0009] Optionally, the detecting movement information of the gaze point of the human eye moving along a preset trajectory by using the first camera module and the second camera module after time synchronization processing includes:

[0010] Adjusting the acquisition frame rate of the second camera module based on the acquisition frame rate of the first camera module; the adjusted acquisition frame rate of the second camera module is the same as the acquisition frame rate of the first camera module;

[0011] During the process that the fixation point of the human eye moves from the first marked point to the second marked point, the first camera module is used to perform eye movement tracking on the fixation point of the human eye to obtain multiple human eye fixation positions and the first timestamp information corresponding to the human eye fixation positions;

[0012] The second camera module is used to collect the human eye to obtain multiple human eye movement images and the second timestamp information corresponding to the human eye movement images.

[0013] Optionally, the determining the processing delay of the first camera module according to the movement information detected by the first camera module and the movement information detected by the second camera module includes:

[0014] According to the multiple human eye fixation positions collected by the first camera module and the first timestamp information corresponding to the human eye fixation positions, determine the first movement duration required for the fixation point of the human eye to move from the first marked point to the second marked point;

[0015] According to the multiple human eye movement images collected by the second camera module and the second timestamp information corresponding to the human eye movement images, determine the second movement duration required for the fixation point of the human eye to move from the first marked point to the second marked point;

[0016] According to the first movement duration and the second movement duration, determine the processing delay of the first camera module.

[0017] Optionally, the determining the processing delay of the first camera module according to the movement information detected by the first camera module and the movement information detected by the second camera module includes:

[0018] According to the first timestamp information of each human eye fixation position in the multiple human eye fixation positions and the second timestamp information of the corresponding human eye movement image, determine the time difference corresponding to each human eye fixation position;

[0019] Based on the average value of the multiple time differences corresponding to the multiple human eye fixation positions, determine the processing delay of the first camera module.

[0020] Optionally, the determining the processing delay of the first camera module according to the movement information detected by the first camera module and the movement information detected by the second camera module includes:

[0021] Determine the average time interval between multiple human eye fixation positions collected by the first camera module;

[0022] Obtain the first timestamp information when the human eye fixation position is at the first marked point;

[0023] Determine the third timestamp information corresponding to the multiple human eye fixation positions based on the first timestamp information corresponding to the first marked point and the average time interval.

[0024] Determine the processing delay of the first camera module according to the third timestamp information of any one of the multiple human eye fixation positions and the second timestamp information of the corresponding human eye movement image.

[0025] Optionally, the determining the average time interval between multiple human eye fixation positions collected by the first camera module includes:

[0026] Determine the first movement duration required for the fixation point of the human eye to move from the first marked point to the second marked point according to the multiple human eye fixation positions collected by the first camera module and the first timestamp information corresponding to the human eye fixation positions.

[0027] Determine the average time interval between multiple human eye fixation positions collected by the first camera module according to the number of human eye fixation positions collected by the first camera module and the first movement duration.

[0028] Optionally, the method further includes:

[0029] Perform delay correction on the first camera module based on the processing delay of the first camera module.

[0030] In a second aspect of the present disclosure, there is provided a delay detection device for an eye movement device, the device includes:

[0031] A processing module, configured to perform time synchronization processing on a first camera module and a second camera module; the first camera module is an eye movement tracking module in the eye movement device;

[0032] A detection module, configured to detect movement information of the fixation point of the human eye moving along a preset trajectory by using the first camera module and the second camera module after time synchronization processing; the movement information at least includes: movement position and the timestamp information corresponding to the movement position;

[0033] A determination module, configured to determine the processing delay of the first camera module according to the movement information detected by the first camera module and the movement information detected by the second camera module.

[0034] Optionally, the detection module is further configured to:

[0035] Adjust the acquisition frame rate of the second camera module based on the acquisition frame rate of the first camera module; the adjusted acquisition frame rate of the second camera module is the same as the acquisition frame rate of the first camera module;

[0036] During the process that the fixation point of the human eye moves from the first marked point to the second marked point, the first camera module is used to perform eye movement tracking on the fixation point of the human eye, and multiple human eye fixation positions and first timestamp information corresponding to the human eye fixation positions are obtained;

[0037] The second camera module is used to collect the human eye, and multiple human eye movement images and second timestamp information corresponding to the human eye movement images are obtained.

[0038] Optionally, the determining module is further configured to:

[0039] According to the multiple human eye fixation positions collected by the first camera module and the first timestamp information corresponding to the human eye fixation positions, determine a first movement duration required for the fixation point of the human eye to move from the first marked point to the second marked point;

[0040] According to the multiple human eye movement images collected by the second camera module and the second timestamp information corresponding to the human eye movement images, determine a second movement duration required for the fixation point of the human eye to move from the first marked point to the second marked point;

[0041] According to the first movement duration and the second movement duration, determine a processing delay of the first camera module.

[0042] Optionally, the determining module is further configured to:

[0043] According to the first timestamp information of each human eye fixation position among the multiple human eye fixation positions and the second timestamp information of the corresponding human eye movement image, determine a time difference corresponding to each human eye fixation position;

[0044] Based on an average value of the multiple time differences corresponding to the multiple human eye fixation positions, determine a processing delay of the first camera module.

[0045] Optionally, the determining module is further configured to:

[0046] Determine an average time interval between multiple human eye fixation positions collected by the first camera module;

[0047] Obtain the first timestamp information when the human eye fixation position is at the first marked point;

[0048] Based on the first timestamp information corresponding to the first marked point and the average time interval, determine third timestamp information corresponding to the multiple human eye fixation positions;

[0049] Determine the processing delay of the first camera module according to the third timestamp information of any one of the multiple human eye fixation positions and the second timestamp information of the corresponding human eye movement image.

[0050] Optionally, the determining module is further configured to:

[0051] Determine the first movement duration required for the fixation point of the human eye to move from the first marked point to the second marked point according to the multiple human eye fixation positions collected by the first camera module and the first timestamp information corresponding to the human eye fixation positions;

[0052] Determine the average time interval between the multiple human eye fixation positions collected by the first camera module according to the number of the human eye fixation positions collected by the first camera module and the first movement duration.

[0053] Optionally, the device further includes:

[0054] A calibration module, configured to perform delay calibration on the first camera module based on the processing delay of the first camera module.

[0055] In a third aspect of the present disclosure, a terminal device is provided, including:

[0056] A memory for storing instructions executable by a processor;

[0057] A processor, connected to the memory;

[0058] Wherein, the processor is configured to execute the delay detection method of the eye movement device according to any one of the embodiments in the first aspect of the present disclosure.

[0059] In a fourth aspect of the present disclosure, a non-transitory computer-readable storage medium is provided. When the instructions in the storage medium are executed by a processor of a terminal device, the terminal device can execute the delay detection method of the eye movement device according to any one of the embodiments in the first aspect of the present disclosure.

[0060] The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects:

[0061] In the embodiment of the present disclosure, by performing time synchronization processing on the first camera module in the eye movement device and the second camera module in other devices, the first camera module and the second camera module can be aligned in time; by detecting the movement position and the corresponding timestamp information of the fixation point of the human eye during the movement along the preset trajectory by the first camera module and the second camera module with aligned time, the movement process of the fixation point of the human eye recorded by the first camera module and the second camera module can be obtained; furthermore, by comparing the movement processes of the fixation point of the human eye recorded by the two camera modules, the processing delay of the first camera module relative to the second camera module can be determined. In this process, by directly comparing the detection results of the two camera modules, the delay of the eye movement device can be quickly obtained, so that there is no need to go through complex mechanical eye settings, nor the step of calculating the spatial position of the human eye's focus point by the eye movement device, effectively reducing the complexity of detecting the processing delay of the eye movement device.

[0062] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0063] The accompanying drawings herein are incorporated into the specification and form a part of the specification, showing embodiments consistent with the present disclosure, and are used together with the specification to explain the principles of the present disclosure.

[0064] Figure 1 is a flowchart showing a method for detecting the delay of an eye movement device according to an exemplary embodiment of the present disclosure Figure 1 .

[0065] Figure 2 is a flowchart showing a method for detecting the delay of an eye movement device according to an exemplary embodiment of the present disclosure Figure 2 .

[0066] Figure 3 is a flowchart showing a method for detecting the delay of an eye movement device according to an exemplary embodiment of the present disclosure Figure 3 .

[0067] Figure 4 is a schematic diagram showing a delay detection process according to an exemplary embodiment of the present disclosure.

[0068] Figure 5 is a flowchart showing a method for detecting the delay of an eye movement device according to an exemplary embodiment of the present disclosure Figure 4 .

[0069] Figure 6 is a flowchart showing a method for detecting the delay of an eye movement device according to an exemplary embodiment of the present disclosure Figure 5 .

[0070] Figure 7 It is a schematic structural diagram of a delay detection device for an eye movement device shown according to an exemplary embodiment of the present disclosure.

[0071] Figure 8 It is a block diagram of a terminal device shown according to an exemplary embodiment of the present disclosure. Detailed implementation manners

[0072] Here, the exemplary embodiments will be described in detail, and the examples are shown in the drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementation manners described in the following exemplary embodiments do not represent all implementation manners consistent with the present disclosure. On the contrary, they are merely examples of devices consistent with some aspects of the present disclosure as detailed in the appended claims.

[0073] In the related art, it is necessary to set up a rotating mechanical eye device to determine the delay of the eye movement device. This solution not only has certain requirements for the distance and rotation speed of the mechanical eye device, resulting in poor precision controllability, but also requires the use of a space mapping algorithm, with a complex process and a large amount of calculation.

[0074] The present disclosure provides a method for detecting the delay of an eye movement device. Figure 1 It is a flowchart of a method for detecting the delay of an eye movement device shown according to an exemplary embodiment of the present disclosure. Figure 1 As Figure 1 shown, the method includes:

[0075] Step S101, perform time synchronization processing on the first camera module and the second camera module; the first camera module is the eye movement tracking module in the eye movement device.

[0076] Step S102, use the first camera module and the second camera module after time synchronization processing to detect the movement information of the fixation point of the human eye moving along a preset trajectory; the movement information at least includes: the movement position and the timestamp information corresponding to the movement position.

[0077] Step S103, determine the processing delay of the first camera module according to the movement information detected by the first camera module and the movement information detected by the second camera module.

[0078] In the embodiment of the present disclosure, by performing time synchronization processing on the first camera module and the second camera module, the time of the first camera module and the second camera module can be kept consistent.

[0079] Among them, the first camera module can be an eye movement tracking module in an eye movement device. The eye movement tracking module collects image data of the human eye and processes the collected image data to achieve real-time tracking of the gaze focus of the human eye. That is to say, the image data collected by the first camera module needs to be processed before it can be used by the eye movement device. Therefore, the first camera module has a certain processing delay.

[0080] The second camera module can be a camera module not provided in the eye movement device.

[0081] In some embodiments, the second camera module can be a high-speed camera module with a delay value of the processing delay less than a preset threshold.

[0082] The process of time synchronization processing can be selected according to actual needs, and the embodiments of the present disclosure do not make specific limitations on this.

[0083] Exemplarily, the first camera module and the second camera module can be connected to a time synchronization device, and complete the time synchronization processing by receiving the instructions sent by the time synchronization device.

[0084] In step S102, after completing the time synchronization processing of the first camera module and the second camera module, the first camera module and the second camera module with synchronized time can be used to simultaneously detect the movement information of the gaze point of the human eye moving along a preset trajectory.

[0085] Here, the preset trajectory can be generated by guiding the human eye to complete the gaze point transfer through the eye movement device.

[0086] Exemplarily, the eye movement device can display a moving icon to the human eye, and the focus of the human eye changes following the moving icon, completing the movement of the gaze point of the human eye along the preset trajectory.

[0087] The movement information at least includes: the movement position and the timestamp information corresponding to the movement position.

[0088] The movement position can be the position of the current gaze point of the human eye on the preset trajectory.

[0089] It can be understood that the camera module can collect the position of the pupil of the human eye, and further, based on the position of the pupil of the human eye, obtain the orientation of the gaze point of the human eye and the position of the gaze point of the human eye on the preset trajectory.

[0090] The timestamp information corresponding to the movement position can indicate the time value when the gaze point of the human eye is detected at this movement position.

[0091] It should be noted that in the embodiments of the present disclosure, the first camera module and the second camera module are used to simultaneously detect the movement information of the fixation point of the human eye moving along a preset trajectory, that is, the movement information detected by the first camera module and the movement information detected by the second camera module can be obtained.

[0092] It is worth noting that due to the different processing delays of the first camera module and the second camera module, the movement information detected by the first camera module and the movement information detected by the second camera module are different; that is, the timestamp information corresponding to the same movement position detected by the first camera module and the second camera module may be different.

[0093] In step S103, after obtaining the movement information of the fixation point of the human eye moving along a preset trajectory detected by the first camera module and the second camera module, the processing delay of the first camera module can be determined according to the movement information.

[0094] It can be understood that since the movement information obtained by the first camera module is different from the movement information obtained by the second camera module, the processing delay of the first camera module can be determined by comparing the movement information.

[0095] In some embodiments, the processing delay of the first camera module can be determined by comparing the different timestamp information corresponding to the first camera module and the second camera module when the same movement position is output.

[0096] Exemplarily, when the fixation point of the human eye moves from the starting point of the preset trajectory to the first position in the preset trajectory (i.e., the movement position is the first position), the timestamp information corresponding to the first position obtained by the first camera module is S1, and the timestamp information corresponding to the first position obtained by the second camera module is S2. When S1 is different from S2, the difference between S1 and S2 can represent the processing delay when the fixation point of the human eye collected by the first camera module moves from the starting point of the preset trajectory to the first position.

[0097] In the embodiments of the present disclosure, by performing time synchronization processing on the first camera module in the eye movement device and the second camera module in other devices, the first camera module and the second camera module can be aligned in time; by detecting the moving position and the time stamp information corresponding to the moving position during the movement of the fixation point of the human eye along a preset trajectory through the first camera module and the second camera module with aligned time, the movement process of the fixation point of the human eye recorded by the first camera module and the second camera module can be obtained; furthermore, by comparing the movement processes of the fixation point of the human eye recorded by the two camera modules, the processing delay of the first camera module relative to the second camera module can be determined. In this process, through the direct comparison of the detection results of the two camera modules, the delay of the eye movement device can be quickly obtained, so that there is no need to go through complex mechanical eye settings, nor to go through the step of calculating the spatial position of the human eye's focus of attention by the eye movement device, effectively reducing the complexity of detecting the processing delay of the eye movement device.

[0098] Optionally, Figure 2 is a flowchart showing a method for detecting the delay of an eye movement device according to an exemplary embodiment of the present disclosure Figure 2 , such as Figure 2 shown, the using the first camera module and the second camera module after time synchronization processing in step S102 to detect the movement information of the fixation point of the human eye moving along a preset trajectory includes:

[0099] Step S201, adjusting the acquisition frame rate of the second camera module based on the acquisition frame rate of the first camera module; the adjusted acquisition frame rate of the second camera module is the same as the acquisition frame rate of the first camera module;

[0100] Step S202, during the process of the fixation point of the human eye moving from the first marked point to the second marked point, using the first camera module to perform eye movement tracking on the fixation point of the human eye to obtain multiple human eye fixation positions and the first time stamp information corresponding to the human eye fixation positions;

[0101] Step S203, using the second camera module to collect the human eye to obtain multiple human eye movement images and the second time stamp information corresponding to the human eye movement images.

[0102] In the embodiments of the present disclosure, after performing time synchronization processing on the first camera module and the second camera module, the movement information of the fixation point of the human eye moving along a preset trajectory can be detected by executing steps S201 to S203.

[0103] In step S201, first, the acquisition frame rate of the second camera module can be adjusted based on the acquisition frame rate of the first camera module, so that the adjusted acquisition frame rate of the second camera module is the same as the acquisition frame rate of the first camera module.

[0104] Among them, the acquisition frame rate of the first camera module can be obtained according to the configuration parameters of the eye movement device. The acquisition frame rate of the first camera module can also be obtained by other means, and the embodiments of the present disclosure do not make specific limitations on this.

[0105] It should be noted that if the first camera module and the second camera module are time-synchronized and have the same acquisition frame rate, then the number of acquired images of the first camera module and the second camera module is the same, and the image acquisition time of each image is the same.

[0106] In step S202, after synchronizing the acquisition frame rates of the first camera module and the second camera module, the fixation point of the human eye can be guided to move from the first marked point to the second marked point; during the process of the fixation point of the human eye moving from the first marked point to the second marked point, the first camera module can be used to take multiple pictures of the human eye to realize eye movement tracking of the fixation point of the human eye, and multiple human eye fixation positions and the first timestamp information corresponding to the human eye fixation positions are obtained.

[0107] Among them, the first timestamp information can be the timestamp information when the first camera module determines and outputs the human eye fixation position based on the acquired human eye image.

[0108] It can be understood that after the first camera module takes pictures of the human eye, the acquired data also needs to be processed to obtain the human eye fixation position corresponding to the fixation point of the human eye; for example, based on the acquired human eye image, the rotation direction and rotation angle of the human eye are determined; and based on the rotation direction and rotation angle of the human eye, the position where the fixation point of the human eye is located is determined. The first camera module can output the fixation position and simultaneously mark the first timestamp information, and each timestamp information corresponds to each human eye fixation position.

[0109] It should be noted that since there may be a certain delay in the process of the first camera module processing data, the first timestamp information will be slightly later than the image acquisition time of the first camera module.

[0110] The first marked point and the second marked point can be two position points arbitrarily selected in the preset trajectory during the process of the fixation point of the human eye moving along the preset trajectory.

[0111] In some embodiments, the first marked point can be the starting point of the preset trajectory; the second marked point can be the ending point of the preset trajectory.

[0112] In step S203, after synchronizing the acquisition frame rates of the first camera module and the second camera module, the second camera module can be used to acquire the human eye, obtaining multiple human eye movement images and second timestamp information corresponding to the human eye movement images.

[0113] Wherein, the second timestamp information is the timestamp information when the second camera module outputs the multiple human eye movement images.

[0114] The fixation points of the human eyes in each human eye movement image are different. The fixation points of the human eyes in multiple consecutive human eye movement images can move from the first annotation point to the second annotation point.

[0115] It can be understood that when the second camera module generates the multiple human eye movement images, it can also annotate timestamps on the multiple human eye movement images; based on the timestamps, the second timestamp information corresponding to the human eye movement images can be obtained.

[0116] It should be noted that since the delay value of the second camera module processing delay is less than the processing delay of the first camera module, the second timestamp information can be closer to the image acquisition time of the second camera module.

[0117] In the embodiments of the present disclosure, by synchronizing the acquisition frequencies of the first camera module and the second camera module, the first camera module and the second camera module can have the same acquisition conditions. Thus, under the same acquisition conditions, the first camera module and the second camera module can simultaneously detect the movement information of the fixation point of the human eye moving from the first annotation point to the second annotation point, obtaining comparable acquisition results, so as to determine the processing delay of the first camera module according to the acquisition results of the first camera module and the second camera module.

[0118] Optionally, Figure 3 is a flowchart illustration of a method for detecting the delay of an eye movement device according to an exemplary embodiment of the present disclosure Figure 3 , as Figure 3 shown, determining the processing delay of the first camera module according to the movement information detected by the first camera module and the movement information detected by the second camera module in step S103 includes:

[0119] Step S301, determining a first movement duration required for the fixation point of the human eye to move from the first annotation point to the second annotation point according to the multiple human eye fixation positions acquired by the first camera module and the first timestamp information corresponding to the human eye fixation positions;

[0120] Step S302: Determine a second moving duration required for the fixation point of the human eye to move from the first marked point to the second marked point according to the multiple human eye movement images collected by the second camera module and the second timestamp information corresponding to the human eye movement images.

[0121] Step S303: Determine the processing delay of the first camera module according to the first moving duration and the second moving duration.

[0122] In the embodiment of the present disclosure, after detecting the movement information of the fixation point of the human eye moving along a preset trajectory by using Steps S201 to S203, Steps S301 to S303 may be executed to determine the processing delay of the first camera module.

[0123] In Step S301, a first moving duration required for the fixation point of the human eye to move from the first marked point to the second marked point may be determined according to the multiple human eye fixation positions collected by the first camera module in Step S202 and the first timestamp information corresponding to the human eye fixation positions.

[0124] It can be understood that the multiple human eye fixation positions are collected based on the process of the fixation point of the human eye moving from the first marked point to the second marked point. Therefore, the first human eye fixation position among the multiple human eye fixation positions may be the first marked point; the last human eye fixation position among the multiple human eye fixation positions may be the second marked point.

[0125] After determining the first marked point and the second marked point among the multiple human eye fixation positions, the first timestamp information corresponding to the first marked point and the second marked point can be obtained correspondingly; based on the first timestamp information corresponding to the first marked point and the second marked point, the first moving duration required for the fixation point of the human eye to move from the first marked point to the second marked point can be determined.

[0126] Exemplarily, assume that the timestamp when the human eye fixation position is the first marked point is S1; the timestamp when the human eye fixation position is the second marked point is S2. Then the first moving duration required for the fixation point of the human eye to move from the first marked point to the second marked point is S2 - S1.

[0127] It should be noted that the first moving duration is the total duration required for the human eye fixation position collected by the first camera module to move from the first marked point to the second marked point; it can be understood that it is the total eye movement time of the human eye collected by the first camera module.

[0128] In step S302, the second moving duration required for the fixation point of the human eye to move from the first annotation point to the second annotation point can be determined according to the multiple human eye movement images collected by the second camera module in step S203 and the second timestamp information corresponding to the human eye movement images.

[0129] It can be understood that the acquisition conditions of the second camera module and the first camera module are the same. The multiple human eye movement images are collected based on the process of the fixation point of the human eye moving from the first annotation point to the second annotation point. Therefore, the human eye fixation position represented by the first human eye movement image in the multiple human eye movement images can be the first annotation point; the human eye fixation position represented by the last human eye movement image in the multiple human eye movement images can be the second annotation point.

[0130] After determining the human eye movement images with the human eye fixation positions being the first annotation point and the second annotation point in the multiple human eye movement images, the second timestamp information corresponding to the human eye fixation positions being the first annotation point and the second annotation point can be obtained according to the second timestamp information corresponding to the human eye movement images; based on the second timestamp information corresponding to the first annotation point and the second annotation point, the second moving duration required for the fixation point of the human eye to move from the first annotation point to the second annotation point can be determined.

[0131] Exemplarily, assume that the timestamp when the human eye fixation position of the human eye movement image is the first annotation point is S3; the timestamp when the human eye fixation position of the human eye movement image is the second annotation point is S4. Then the second moving duration required for the fixation point of the human eye to move from the first annotation point to the second annotation point is S4 - S3.

[0132] It should be noted that the second moving duration is the total duration required for the human eye fixation position collected by the second camera module to move from the first annotation point to the second annotation point; it can be understood that it is the total eye movement time of the human eye collected by the second camera module.

[0133] In step S303, based on the total eye movement time of the human eye collected by the first camera module and the total eye movement time of the human eye collected by the second camera module, the processing delay of the human eye fixation point collected by the first camera module moving from the first annotation point to the second annotation point can be determined.

[0134] Exemplarily, Figure 4 is a schematic diagram of a delay detection process shown according to an exemplary embodiment of the present disclosure. As Figure 4 shown, a first camera module 10 and a second camera module 20 are set to detect the human eye 30.

[0135] Before detection, it is first necessary to initialize the first camera module 10 and the second camera module 20 to align the time of the first camera module 10 and the second camera module 20 and synchronize the timestamps.

[0136] During detection, the position of the pupil of the guiding human eye 30 is changed, and the fixation point of the human eye moves from the first marked point to the second marked point. The first camera module 10 outputs multiple human eye fixation positions and the first timestamps corresponding to the fixation positions. The second camera module 20 captures multiple human eye movement images and marks the second timestamps on the images. Moreover, based on the multiple first timestamps, the first movement duration of the first camera module 10 can be obtained, and based on the multiple second timestamps, the second movement duration of the second camera module 20 can be obtained.

[0137] In some embodiments, after determining the total processing delay of the first camera module, the unit processing delay of the first camera module can also be determined based on the ratio of the total processing delay to the actual movement duration of the human eye.

[0138] It can be understood that the actual movement duration of the human eye can be determined according to the second movement duration of the second camera module.

[0139] It can also be understood that the actual movement duration of the human eye can also be determined by subtracting the total processing delay from the first movement duration of the first camera module.

[0140] In the embodiments of the present disclosure, by obtaining the first movement duration of the first camera module and the second movement duration of the second camera module, the processing delay of the first camera module can be determined during the process of outputting that the fixation point of the human eye moves from the first marked point to the second marked point. This method is simple to operate, easy to implement, and has a small amount of calculation and high accuracy.

[0141] Optionally, Figure 5 is a flowchart showing a method for detecting the delay of an eye movement device according to an exemplary embodiment of the present disclosure Figure 4 , as Figure 5 shown, determining the processing delay of the first camera module according to the movement information detected by the first camera module and the movement information detected by the second camera module in step S103 includes:

[0142] Step S501, determining the time difference corresponding to each human eye fixation position according to the first timestamp information of each human eye fixation position among the multiple human eye fixation positions and the second timestamp information of the corresponding human eye movement image;

[0143] Step S502, determining the processing delay of the first camera module based on the average value of the multiple time differences corresponding to the multiple human eye fixation positions.

[0144] In an embodiment of the present disclosure, after detecting the movement information of the fixation point of the human eye moving along a preset trajectory by using steps S201 to S203, steps S501 to S502 may be executed to determine the processing delay of the first camera module.

[0145] In step S501, the first timestamp information of each human eye fixation position among the multiple human eye fixation positions can be obtained, as well as the second timestamp information of each human eye movement image among the multiple human eye movement images. Based on the first timestamp information of each human eye fixation position and the second timestamp information of the human eye movement image corresponding to this human eye fixation position, the time difference corresponding to each human eye fixation position can be determined.

[0146] Exemplarily, the first camera module outputs 3 consecutive human eye fixation positions, and the timestamps corresponding to the 3 human eye fixation positions are t1, t2, and t3 respectively. Since the acquisition frame rate of the second camera module is the same as that of the first camera module, and the second camera module and the first camera module collect the human eye simultaneously; the second camera module can output 3 consecutive human eye movement images, and the positions of the fixation points of the human eye corresponding to the 3 human eye movement images are the same as the 3 human eye fixation positions. The timestamps corresponding to the 3 human eye movement images are t4, t5, and t6 respectively. It can be determined that the time difference corresponding to the first human eye fixation position is t4 - t1; the time difference corresponding to the second human eye fixation position is t5 - t2; the time difference corresponding to the first human eye fixation position is t6 - t3.

[0147] In step S502, the processing delay of the first camera module can be determined based on the average value of the multiple time differences corresponding to the multiple human eye fixation positions.

[0148] It can be understood that the time difference corresponding to each human eye fixation position can respectively reflect the processing delay of the first camera module when the fixation point of the human eye is at the current fixation position; the multiple time differences corresponding to the multiple human eye fixation positions can reflect the processing delay of the first camera module at the multiple human eye fixation positions.

[0149] By accumulating the processing delays of the first camera module at the multiple human eye fixation positions and taking the ratio with the number of human eye fixation positions, the average processing delay corresponding to the first camera module for processing one human eye fixation position can be obtained.

[0150] In some embodiments, based on the second movement duration and the acquisition frame rate of the third camera module, the number of human eye fixation positions can be determined.

[0151] It should be noted that the processing delay of the first camera module for each human eye fixation position can be a uniform delay or a non-uniform delay, and the embodiments of the present disclosure do not make specific limitations on this.

[0152] When the processing delay of the first camera module is in the case of non-uniform delay, by performing the steps S501 to S502, the processing delay of the first camera module when processing each human eye fixation position can be determined more accurately, which helps to better obtain the processing delay of the first camera module.

[0153] In the embodiments of the present disclosure, by obtaining the time difference between the first camera module and the second camera module at each human eye fixation position, the processing delay of the first camera module when processing each human eye fixation position can be determined, so that the processing delay of the first camera module can be obtained more accurately.

[0154] Optionally, Figure 6 is a schematic flowchart of a method for detecting the delay of an eye movement device shown according to an exemplary embodiment of the present disclosure Figure 5 , as Figure 6 shown, determining the processing delay of the first camera module according to the movement information detected by the first camera module and the movement information detected by the second camera module in step S103 includes:

[0155] Step S601, determining the average time interval between multiple human eye fixation positions collected by the first camera module;

[0156] Step S602, obtaining the first timestamp information when the human eye fixation position is at the first marked point;

[0157] Step S603, determining the third timestamp information corresponding to the multiple human eye fixation positions based on the first timestamp information corresponding to the first marked point and the average time interval;

[0158] Step S604, determining the processing delay of the first camera module according to the third timestamp information of any one of the multiple human eye fixation positions and the second timestamp information of the corresponding human eye movement image.

[0159] In the embodiments of the present disclosure, after detecting the movement information of the human eye fixation point moving along the preset trajectory by using steps S201 to S203, steps S601 to S604 can be executed to determine the processing delay of the first camera module.

[0160] In step S601, the average time interval between multiple human eye fixation positions collected by the first camera module can be determined.

[0161] It can be understood that by obtaining the first timestamps corresponding to any two adjacent human eye fixation positions among the multiple human eye fixation positions, the time interval between the any two adjacent human eye fixation positions is determined; based on the time interval between any two human eye fixation positions, the average time interval between the multiple human eye fixation positions is determined.

[0162] It should be noted that since each first timestamp information output by the first camera module contains the delay of the first camera module, the average time interval determined from the first timestamp information can reflect the average time when the first camera module processes each human eye fixation position.

[0163] In step S602, by acquiring the data when the human eye fixation position is at the first marked point, the first timestamp information when the human eye fixation position is at the first marked point can be acquired.

[0164] In step S603, based on the first timestamp information corresponding to the first marked point and the average time interval, the third timestamp information corresponding to each human eye fixation position among the multiple human eye fixation positions can be determined.

[0165] It can be understood that each human eye fixation position among the multiple human eye fixation positions has first timestamp information; according to the first timestamp information, the multiple human eye fixation positions can be sorted to obtain the order of each human eye fixation position among the multiple human eye fixation positions. Furthermore, based on the order of each human eye fixation position, the position interval between each human eye fixation position and the human eye fixation position corresponding to the first marked point can be determined; based on the position interval and the average time interval corresponding to each position interval, the third timestamp information corresponding to each human eye fixation position among the multiple human eye fixation positions can be determined.

[0166] Exemplarily, the first camera module outputs 3 consecutive human eye fixation positions. Among them, the timestamps of the human eye fixation position corresponding to the first marked point (the first human eye fixation position) are t1 respectively, the average time interval is s1, the third timestamp corresponding to the second human eye fixation position is t1 + s1; the third timestamp corresponding to the third human eye fixation position is t1 + 2 * s1.

[0167] In step S604, the processing delay of the first camera module can be determined according to the third timestamp information of any human eye fixation position among the multiple human eye fixation positions and the second timestamp information of the corresponding human eye movement image.

[0168] It can be understood that the third timestamp information is the timestamp information determined based on the average time interval, and the difference between the third timestamp information and the corresponding second timestamp information can be understood as the average processing delay of the first camera module; that is, the processing delay determined based on the third timestamp information of each human eye fixation position and the second timestamp information of the corresponding human eye movement image is the same.

[0169] On this basis, it is not necessary to process the first timestamp information of each human eye fixation position collected by the first camera module and the second timestamp information of the corresponding human eye movement image; the average processing delay of the first camera module can be directly determined according to the third timestamp information of any one of the multiple human eye fixation positions and the second timestamp information of the corresponding human eye movement image, greatly reducing the amount of data to be processed and improving the processing efficiency.

[0170] In the embodiments of the present disclosure, by obtaining the average time interval between multiple human eye fixation positions, and according to the average time interval and the first timestamp information corresponding to the first annotation point, the third timestamp information corresponding to multiple human eye fixation positions in the case where the processing delay of the first camera module is evenly distributed can be determined. In this way, the average processing delay of the first camera module can be directly determined by the third timestamp information corresponding to any one of the multiple human eye fixation positions and the second timestamp information of the corresponding human eye movement image, improving the determination efficiency.

[0171] Optionally, the determining the average time interval between multiple human eye fixation positions collected by the first camera module in step S601 includes:

[0172] According to the multiple human eye fixation positions collected by the first camera module and the first timestamp information corresponding to the human eye fixation position, determine the first movement duration required for the fixation point of the human eye to move from the first annotation point to the second annotation point;

[0173] According to the number of human eye fixation positions collected by the first camera module and the first movement duration, determine the average time interval between multiple human eye fixation positions collected by the first camera module.

[0174] In the embodiments of the present disclosure, the first movement duration required for the fixation point of the human eye to move from the first annotation point to the second annotation point can be determined first.

[0175] Here, the method for obtaining the first movement duration can refer to the description in step S301. For the sake of brevity of the specification, it will not be elaborated here.

[0176] After obtaining the first moving duration, the average time interval between multiple human eye fixation positions collected by the first camera module can be determined according to the number of human eye fixation positions collected by the first camera module and the first moving duration.

[0177] It can be understood that if the first camera module collects N human eye fixation positions during the process of the fixation point of the human eye moving from the first marked point to the second marked point, the average time interval between any two of the multiple human eye fixation positions can be determined as T / (N - 1) according to the first moving duration T required for the fixation point of the human eye to move from the first marked point to the second marked point.

[0178] Exemplarily, the first camera module outputs 3 consecutive human eye fixation positions, and the timestamps corresponding to the 3 human eye fixation positions are t1, t2, and t3 respectively. It can be determined that the average time interval between the multiple human eye fixation positions is (t3 - t1) / 2.

[0179] In the embodiments of the present disclosure, the average time interval can be directly determined based on the relationship between the first moving duration of the first camera module and the acquisition quantity, so that there is no need to obtain the interval between the multiple human eye fixation positions and then calculate the average time interval, which can effectively reduce the calculation amount and improve the efficiency of obtaining the processing delay of the first camera module.

[0180] Optionally, the method further includes:

[0181] Performing delay correction on the first camera module based on the processing delay of the first camera module.

[0182] In the embodiments of the present disclosure, after determining the processing delay of the first camera module, delay correction can also be performed on the first camera module.

[0183] Here, the method of performing delay correction is adapted to the obtained processing delay to eliminate the processing delay and improve the processing efficiency of the first camera module.

[0184] Exemplarily, after obtaining the total processing delay of the first camera module based on steps S301 to S303, that is, after obtaining the total delay when the fixation point of the human eye moves along the preset trajectory, the preset trajectory can be determined as a moving unit. Thus, every time the fixation point of the human eye moves one unit, the first camera module performs a correction according to the total delay.

[0185] Exemplarily, after obtaining the processing delay of the first camera module when processing each human eye fixation position based on steps S501 to S502, the time for the first camera module to process each human eye fixation position can be corrected according to the processing delay at each human eye fixation position.

[0186] In an embodiment of the present disclosure, by correcting the processing delay of the first camera module, the position of the focus of the human eye output by the first camera module can be made closer to the actual position of the focus of the human eye, thereby effectively improving the accuracy of the eye movement device and enhancing the user experience.

[0187] An embodiment of the present disclosure provides a delay detection device for an eye movement device. Figure 7 FIG. is a schematic structural diagram of a delay detection device for an eye movement device according to an exemplary embodiment of the present disclosure, as Figure 7 shown, the delay detection device 700 of the eye movement device includes:

[0188] A processing module 701, configured to perform time synchronization processing on a first camera module and a second camera module; the first camera module is an eye movement tracking module in the eye movement device.

[0189] A detection module 702, configured to detect movement information of the fixation point of the human eye moving along a preset trajectory by using the first camera module and the second camera module after time synchronization processing; the movement information at least includes: a movement position and timestamp information corresponding to the movement position.

[0190] A determination module 703, configured to determine the processing delay of the first camera module according to the movement information detected by the first camera module and the movement information detected by the second camera module.

[0191] Optionally, the detection module 702 is further configured to:

[0192] Adjust the acquisition frame rate of the second camera module based on the acquisition frame rate of the first camera module; the adjusted acquisition frame rate of the second camera module is the same as the acquisition frame rate of the first camera module.

[0193] During the process that the fixation point of the human eye moves from a first marked point to a second marked point, perform eye movement tracking on the fixation point of the human eye by using the first camera module to obtain multiple human eye fixation positions and first timestamp information corresponding to the human eye fixation positions.

[0194] Collect the human eye by using the second camera module to obtain multiple human eye movement images and second timestamp information corresponding to the human eye movement images.

[0195] Optionally, the determination module 703 is further configured to:

[0196] Determine a first movement duration required for the fixation point of the human eye to move from the first marked point to the second marked point according to the multiple human eye fixation positions collected by the first camera module and the first timestamp information corresponding to the human eye fixation positions.

[0197] Based on the multiple human eye movement images collected by the second camera module and the second timestamp information corresponding to the human eye movement images, determine a second movement duration required for the fixation point of the human eye to move from the first marked point to the second marked point;

[0198] Based on the first movement duration and the second movement duration, determine the processing delay of the first camera module.

[0199] Optionally, the determining module 703 is further configured to:

[0200] Based on the first timestamp information of each human eye fixation position among the multiple human eye fixation positions and the second timestamp information of the corresponding human eye movement image, determine a time difference corresponding to each human eye fixation position;

[0201] Based on the average value of the multiple time differences corresponding to the multiple human eye fixation positions, determine the processing delay of the first camera module.

[0202] Optionally, the determining module 703 is further configured to:

[0203] Determine an average time interval between multiple human eye fixation positions collected by the first camera module;

[0204] Obtain the first timestamp information when the human eye fixation position is at the first marked point;

[0205] Based on the first timestamp information corresponding to the first marked point and the average time interval, determine third timestamp information corresponding to the multiple human eye fixation positions;

[0206] Based on the third timestamp information of any human eye fixation position among the multiple human eye fixation positions and the second timestamp information of the corresponding human eye movement image, determine the processing delay of the first camera module.

[0207] Optionally, the determining module 703 is further configured to:

[0208] Based on the multiple human eye fixation positions collected by the first camera module and the first timestamp information corresponding to the human eye fixation positions, determine a first movement duration required for the fixation point of the human eye to move from the first marked point to the second marked point;

[0209] Based on the number of human eye fixation positions collected by the first camera module and the first movement duration, determine an average time interval between the multiple human eye fixation positions collected by the first camera module.

[0210] Optionally, the apparatus further includes:

[0211] A calibration module, configured to perform delay calibration on the first camera module based on the processing delay of the first camera module.

[0212] Figure 8 FIG. is a block diagram of a terminal device according to an exemplary embodiment of the present disclosure. For example, the terminal device may be a computer, a tablet computer, etc.

[0213] Referring to Figure 8 , the terminal device 80 may include one or more of the following components: a processing component 83, a memory 84, a power component 85, a multimedia component 86, an audio component 87, an input / output (I / O) interface 88, a sensor component 89, and a communication component 810.

[0214] The processing component 83 generally controls the overall operation of the terminal device 80, such as operations associated with display, telephone calls, data communication, camera operations, and recording operations. The processing component 83 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above methods. In addition, the processing component 83 may include one or more modules to facilitate the interaction between the processing component 83 and other components. For example, the processing component 83 may include a multimedia module to facilitate the interaction between the multimedia component 86 and the processing component 83.

[0215] The memory 84 is configured to store various types of data to support the operation of the terminal device 80. Examples of such data include instructions for any application or method operating on the terminal device 80, contact data, phone book data, messages, pictures, videos, etc. The memory 84 may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, a magnetic disk, or an optical disk.

[0216] The power component 85 provides power to various components of the terminal device 80. The power component 85 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the terminal device 80.

[0217] The multimedia component 86 includes a screen that provides an output interface between the terminal device 80 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors can sense not only the boundaries of the touch or swipe actions, but also detect the duration and pressure associated with the touch or swipe operation. In some embodiments, the multimedia component 86 includes a front camera and / or a rear camera. When the terminal device 80 is in an operation mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each of the front camera and the rear camera can be a fixed optical lens system or have a focal length and optical zoom capabilities.

[0218] The audio component 87 is configured to output and / or input audio signals. For example, the audio component 87 includes a microphone (MIC) that is configured to receive external audio signals when the terminal device 80 is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals can be further stored in the memory 84 or transmitted via the communication component 810. In some embodiments, the audio component 87 further includes a speaker for outputting audio signals.

[0219] The I / O interface 88 provides an interface between the processing component 83 and a peripheral interface module, and the peripheral interface module can be a keyboard, a click wheel, buttons, etc. These buttons can include, but are not limited to: a home button, a volume button, a power button, and a lock button.

[0220] The sensor component 89 includes one or more sensors for providing status assessments of various aspects of the terminal device 80. For example, the sensor component 89 can detect the on / off state of the terminal device 80, the relative positioning of components, such as the display and keypad of the terminal device 80. The sensor component 89 can also detect a change in the position of the terminal device 80 or a component of the terminal device 80, the presence or absence of user contact with the terminal device 80, the orientation or acceleration / deceleration of the terminal device 80, and the temperature change of the terminal device 80. The sensor component 89 can include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor component 89 can also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 89 can further include an acceleration sensor, a gyro sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0221] The communication component 810 is configured to facilitate communication between the terminal device 80 and other devices in a wired or wireless manner. The terminal device 80 can access a wireless network based on a communication standard, such as Wi-Fi, 4G, or 5G, or a combination thereof. In an exemplary embodiment, the communication component 810 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 810 further includes a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on Radio Frequency Identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0222] In an exemplary embodiment, the terminal device 80 can be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components for performing the above method.

[0223] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 84 including instructions, and the above instructions can be executed by a processor 820 of the terminal device 80 to complete the above method. For example, the non-transitory computer-readable storage medium can be a ROM, Random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0224] Those skilled in the art will readily conceive of other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include known common knowledge or conventional technical means in the technical field not disclosed herein. The specification and embodiments are to be considered exemplary only, and the true scope and spirit of the present disclosure are pointed out by the following claims.

[0225] It should be understood that the present disclosure is not limited to the exact structures described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present disclosure is only limited by the appended claims.

Claims

1. A delay detection method for an eye movement device, It is characterized in that The method comprises: Performing time synchronization processing on a first camera module and a second camera module; the first camera module is an eye tracking module in the eye movement device; Using the first camera module and the second camera module after time synchronization processing to detect movement information of the gaze point of the human eye moving along a preset trajectory; the movement information at least includes: a movement position and a timestamp information corresponding to the movement position; A processing delay of the first camera module is determined according to the movement information detected by the first camera module and the movement information detected by the second camera module.

2. The method according to claim 1, It is characterized in that The detecting of movement information of a gaze point of a human eye moving along a preset trajectory by using the first camera module and the second camera module after time synchronization processing includes: Based on the acquisition frame rate of the first camera module, adjusting the acquisition frame rate of the second camera module; the adjusted acquisition frame rate of the second camera module is the same as the acquisition frame rate of the first camera module; In the process of the gaze point of the human eye moving from the first marked point to the second marked point, using the first camera module to perform eye tracking on the gaze point of the human eye to obtain a plurality of gaze positions of the human eye and first timestamp information corresponding to the gaze positions of the human eye; The second camera module is used to capture the human eye to obtain a plurality of human eye movement images and second timestamp information corresponding to the human eye movement images.

3. The method according to claim 2, It is characterized in that The determining, according to the movement information detected by the first camera module and the movement information detected by the second camera module, a processing delay of the first camera module includes: Determine, according to the plurality of eye gaze positions collected by the first camera module and first timestamp information corresponding to the eye gaze positions, a first moving time required for the eye gaze point to move from the first marked point to the second marked point; Determine, according to the plurality of human eye movement images collected by the second camera module and second timestamp information corresponding to the human eye movement images, a second movement time required for the gaze point of the human eye to move from the first marked point to the second marked point; A processing delay of the first camera module is determined according to the first movement duration and the second movement duration.

4. The method according to claim 2, It is characterized in that The determining, according to the movement information detected by the first camera module and the movement information detected by the second camera module, a processing delay of the first camera module includes: Determine a time difference corresponding to each eye gaze position according to the first timestamp information of each eye gaze position among the multiple eye gaze positions and the second timestamp information of the corresponding eye movement image; The processing delay of the first camera module is determined based on the average of multiple time differences corresponding to the multiple eye gaze positions.

5. The method according to claim 2, It is characterized in that The determining, according to the movement information detected by the first camera module and the movement information detected by the second camera module, a processing delay of the first camera module includes: Determine an average time interval between multiple eye gaze positions captured by the first camera module; Acquire the first timestamp information when the gaze position of the human eye is at the first marked point; Determine third timestamp information corresponding to the plurality of eye gaze positions based on the first timestamp information corresponding to the first marked point and the average time interval; The processing delay of the first camera module is determined according to the third timestamp information of any eye gaze position among the multiple eye gaze positions and the corresponding second timestamp information of the eye movement image.

6. The method according to claim 5, It is characterized in that The determining an average time interval between multiple eye gaze positions collected by the first camera module includes: Determine, according to the plurality of eye gaze positions collected by the first camera module and first timestamp information corresponding to the eye gaze positions, a first moving time required for the eye gaze point to move from the first marked point to the second marked point; According to the number of eye gaze positions collected by the first camera module and the first movement duration, an average time interval between multiple eye gaze positions collected by the first camera module is determined.

7. The method according to any one of claims 1 to 6, It is characterized in that The method further comprises: Based on the processing delay of the first camera module, delay correction is performed on the first camera module.

8. A time delay detection device for an eye movement device, It is characterized in that include: A processing module, used for performing time synchronization processing on the first camera module and the second camera module; The first camera module is an eye tracking module in the eye movement device; A detection module, used to detect movement information of a gaze point of a human eye moving along a preset trajectory using the first camera module and the second camera module after time synchronization processing; The movement information includes at least: a movement position and timestamp information corresponding to the movement position; A determination module is used to determine a processing delay of the first camera module according to the movement information detected by the first camera module and the movement information detected by the second camera module.

9. A terminal device, It is characterized in that include: a memory for storing processor-executable instructions; A processor connected to the memory; The processor is configured to execute the delayed detection method of the eye movement device as described in any one of claims 1 to 7.

10. A non-transitory computer-readable storage medium, It is characterized in that When the instructions in the storage medium are executed by a processor of a computer, the terminal device is enabled to execute the delay detection method of the eye movement device according to any one of claims 1 to 7.

Images