Eye movement correction method, device and system and computer equipment

Abstract

The invention relates to an eye movement correction method, device and system and computer equipment, and the method comprises the steps: obtaining eye movement information of a user, the eye movement information comprises multiple pieces of position information and eye states when the user watches a corrected object; determining correction information according to the multiple pieces of position information and the position information of the correction object under the condition that the multiple pieces of position information are in the preset position range and the eye state shows that the eyes of the user are in an open state; and performing eye movement correction on the user according to the correction information. By using the eye correction method provided by the invention, the accuracy of eye movement correction can be improved.

Description

Technical Field

[0001] The present application relates to the field of eye tracking technology, and in particular to an eye movement correction method, device, system and computer equipment. Background Art

[0002] Eye tracking technology is a technology that estimates the coordinates of the user's gaze point through software and hardware systems. Eye tracking technology helps provide a more immersive and interactive virtual reality experience, and in the medical industry, using eye tracking technology for visual field testing can help doctors diagnose visual problems and develop corresponding treatment plans.

[0003] In traditional technology, VR (Virtual Reality) devices use eye tracking models to perform eye movement correction. However, eye movement correction using traditional technical methods is inaccurate. Summary of the invention

[0004] Based on this, it is necessary to provide an eye movement correction method, device, system and computer equipment that can improve the accuracy of eye movement correction in response to the above technical problems.

[0005] In a first aspect, the present application provides an eye movement correction method, the method comprising:

[0006] Acquire the user's eye movement information; the eye movement information includes multiple position information and eye states when the user looks at the calibration object;

[0007] When the plurality of position information are all within a preset position range and the eye state indicates that the user's eyes are open, determining the correction information according to the plurality of position information and the position information of the correction object;

[0008] Perform eye movement correction on the user according to the correction information.

[0009] In one embodiment, the method further comprises:

[0010] Determining whether the calibration information is abnormal;

[0011] If it is determined that the correction information is abnormal, the process returns to the step of obtaining the user's eye movement information.

[0012] In one embodiment, determining whether the calibration information is abnormal includes:

[0013] Receiving user feedback information on an interference object; the interference object is an object displayed in a target area on the display interface that the user is looking at;

[0014] Determine whether the correction information is abnormal based on the feedback information.

[0015] In one embodiment, determining whether the correction information is abnormal according to the feedback information includes:

[0016] If the feedback information indicates that the number of times the user has observed the interference object reaches a preset number, it is determined that the correction information is abnormal.

[0017] In one embodiment, determining whether the calibration information is abnormal includes:

[0018] Based on the eye movement information, determine whether the correction information is abnormal.

[0019] In one embodiment, determining whether the correction information is abnormal based on the eye movement information includes any of the following:

[0020] If it is determined that within the first preset time period, the plurality of position information are all outside the preset position range, then it is determined that the correction information is abnormal;

[0021] If it is determined that within the second preset time period, the eye state is used to indicate that the user's eyes are in a closed state, then determining that the correction information is abnormal;

[0022] If it is determined that the eye movement information is invalid information within the third preset time period, the correction information is determined to be abnormal.

[0023] In one embodiment, determining the calibration information according to the plurality of position information and the position information of the calibration object includes:

[0024] determining an average of the plurality of position information;

[0025] The calibration information is determined based on the average value and the position information of the calibration object.

[0026] In a second aspect, an embodiment of the present application provides an eye movement correction device, the device comprising:

[0027] An acquisition module, used to acquire the user's eye movement information; the eye movement information includes a plurality of position information and eye states when the user is gazing at the calibration object;

[0028] a determination module, configured to determine the correction information according to the plurality of position information and the position information of the correction object when the plurality of position information are all within a preset position range and the eye state indicates that the user's eyes are in an open state;

[0029] The correction module is used to correct the user's eye movement according to the correction information.

[0030] In a third aspect, an embodiment of the present application provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the steps of the method provided in the first aspect are implemented.

[0031] In a fourth aspect, an embodiment of the present application provides an eye movement correction system, including a computer device and a detection device, wherein the detection device is communicatively connected to the computer device; the detection device is used to display a correction object, and the computer device is used to execute the steps of the method provided in the first aspect above;

[0032] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps of the method provided in the first aspect above are implemented.

[0033] In a sixth aspect, an embodiment of the present application further provides a computer program product, including a computer program, which implements the steps of the method provided in the first aspect above when executed by a processor.

[0034] The above-mentioned eye movement correction method, device, system and computer equipment obtain the user's eye movement information; the eye movement information includes multiple position information and eye status of the user's gaze at the correction object; when the multiple position information are all within the preset position range and the eye status indicates that the user's eyes are in an open state, the correction information is determined according to the multiple position information and the position information of the correction object; the user's eye movement correction is performed according to the correction information. In this embodiment, when the multiple position information obtained are all within the preset position range and the eyes are in an open state, the correction information can be determined directly according to the multiple position information obtained and the position information of the correction object, so as to perform eye movement correction. In this way, it is only necessary to obtain the user's eye movement information to determine the correction information for eye movement correction, which can improve the accuracy of eye movement correction compared with the existing use of eye tracking models to predict the user's gaze point. In addition, when using the eye movement correction method provided by the present application, the user does not need to remove the glasses, so that the eye movement correction method has higher practicality. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 A diagram showing an application environment of an eye movement correction method in an embodiment;

[0036] Figure 2 A schematic diagram of a step flow of an eye movement correction method in one embodiment;

[0037] Figure 3 A schematic diagram of a flow chart of steps of an eye movement correction method in another embodiment;

[0038] Figure 4 A schematic diagram of a flow chart of steps of an eye movement correction method in another embodiment;

[0039] Figure 5 A schematic diagram of a flow chart of steps of an eye movement correction method in another embodiment;

[0040] Figure 6A schematic diagram of a flow chart of steps of an eye movement correction method in another embodiment;

[0041] Figure 7 A schematic diagram of a flow chart of steps of an eye movement correction method in another embodiment;

[0042] Figure 8 Schematic diagram of the structure of an eye movement correction device in one embodiment. DETAILED DESCRIPTION

[0043] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0044] The serial numbers assigned to the components in this article, such as "first", "second", etc., are only used to distinguish the objects described and do not have any order or technical meaning.

[0045] First of all, before specifically introducing the technical solutions of the embodiments disclosed in the present application, the background technology or technical evolution context on which the embodiments of the present application are based is introduced. Eye tracking technology is a technology that estimates the coordinates of the user's gaze point through a software and hardware system. In daily life, eye tracking technology helps to provide a more immersive and interactive virtual reality experience. In the medical industry, the use of eye tracking technology for visual field detection is an important means of evaluating and detecting visual function, which can help doctors diagnose visual problems and develop corresponding treatment plans. In actual applications, VR (Virtual Reality) devices use eye tracking technology to determine the user's gaze point, so as to detect the user's gaze in the visual field detection, determine whether the patient is looking at the target gaze object throughout the process, and avoid inaccurate test results.

[0046] However, in scenarios such as hospitals or physical examination centers where users need to be changed frequently, each user is only tested once, and for each test, the detection equipment needs to re-calibrate the eye movements of each user. This not only wastes time, but for users who wear glasses, the correction results will be inaccurate due to the refraction of the glasses. In addition, if the frame of the glasses worn by the user is too thick, it is likely to block the camera required for detection by the detection equipment, making it impossible to successfully perform the correction, resulting in failure of the visual field detection. Although the glasses can be removed during the correction process to avoid the problem of occlusion, during the visual field detection process, after putting on the glasses again, the relative position of the user and the detection equipment changes, which will cause inaccurate correction results.

[0047] In conventional technology, a pre-trained eye tracking model is used to predict the user's gaze point based on the acquired eye image and the user's visual field image to achieve eye tracking. However, the method using the eye tracking model requires acquiring eye images and using images, and the predicted user's gaze point is inaccurate. In response to this, the present application provides an eye movement correction method.

[0048] The technical solution of the present application and how the technical solution of the present application solves the technical problem are described in detail below with specific embodiments.

[0049] The eye movement correction method provided in the present application can be applied to an eye movement correction system. The eye movement correction system includes a computer device and a detection device, and the computer device is communicatively connected to the detection device. The detection device is used to display the correction object required when executing the eye movement correction method, and the user wears the detection device. The detection device can be a VR device, and the correction object is displayed on the display interface (virtual display interface) of the VR device. This embodiment does not limit the specific structure of the detection device, as long as it can achieve its function. The computer device can be, but is not limited to, an industrial computer, a laptop computer, and a tablet computer. The internal results of the computer device are as follows Figure 1 As shown, the computer device includes a processor, a memory, a communication interface, a display screen and an input device connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be achieved through WIFI, a mobile cellular network, NFC (near field communication) or other technologies. When the computer program is executed by the processor, an eye movement correction method is implemented. The display screen of the computer device can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device can be a touch layer covered on the display screen, or a key, trackball or touchpad set on the computer device shell, or an external keyboard, touchpad or mouse.

[0050] In one embodiment, Figure 2 As shown, an eye movement correction method is provided. This embodiment uses the method applied to a computer device as an example. In this embodiment, the method includes the following steps:

[0051] Step 200: Obtain the user's eye movement information; the eye movement information includes a plurality of position information and eye states when the user is gazing at the calibration object.

[0052] The user wears a detection device, which includes a display interface. A calibration object is displayed on the display interface. The calibration object can be located at a central position set on the display interface, or can be set at other positions on the display interface. The calibration object can be a bright spot, or an animation, text, or pattern, etc. This embodiment does not limit the type of the calibration object, and the display position, as long as its function can be achieved.

[0053] After the user wears the detection device, the operator will prompt the user to look at the calibration object displayed on the display interface, so that the user can look at the calibration object. The operator's prompt to the user can be a voice prompt, such as "please look at the bright spot on the display interface". The operator's prompt to the user can also be any of the following: changing the size of the calibration object within a preset range, making a bouncing change to the calibration object, and flashing the calibration object (for example: the calibration object changes from bright to dark for 1 second, and then from dark to bright for 1 second), so that the user can look at the calibration object.

[0054] The user's eye movement information may include multiple position information and eye states when the user is looking at the calibration object. The multiple position information when the user is looking at the calibration object refers to the position information where the user's eyes are actually looking when the operator prompts the user to look at the calibration object. The position information may be the position coordinates of the target that the user is actually looking at. The eye state refers to whether the eyes of the current user are in an open state, or whether the eyes of the current user are in a closed state. The judgment of the eye state may be to determine whether the eyes are in an open state or a closed state by judging the percentage of eye opening. Exemplarily, if the percentage of eye opening is greater than or equal to 50%, it is determined that the eyes are in an open state; if the percentage of eye opening is less than 50%, it is determined that the eyes are in a closed state.

[0055] The computer device obtains the user's eye movement information when the user is gazing at the calibration object. The eye movement information may be information collected by the detection device within a preset time period when the user is gazing at the calibration object. After collecting the eye movement information, the detection device transmits the eye movement information to the computer device in real time.

[0056] In an optional embodiment, the detection device is initially calibrated when it leaves the factory or after restoring the factory settings. The initial calibration of the detection device is a self-calibration process of the detection device. In other words, the detection device is equipped with an eye movement calibration program, and self-calibration can be achieved by starting the calibration program. The self-calibration includes multiple groups of calibration points such as the center and the four corners.

[0057] Step 210: When the plurality of position information are all within a preset position range and the eye state indicates that the user's eyes are open, determine the correction information according to the plurality of position information and the position information of the correction object.

[0058] The preset position range may be pre-set by an operator and stored in the computer device. The position information of the calibration object may be acquired by the operator when setting the calibration object and stored in the computer device.

[0059] After obtaining the user's eye movement information, the computer device will determine whether the multiple position information of the user when looking at the calibration object and the eye state included in the eye movement information meet the preset conditions to determine whether the obtained eye movement information can be used for eye movement correction by the user. The preset conditions include that the multiple position information are all within the preset position range, and the eye state indicates that the user's eyes are open.

[0060] In other words, after obtaining the user's eye movement information, the computer device will compare the multiple position information collected during the preset time period when the user gazes at the calibration object with the preset position range to determine whether the multiple position information are all within the preset position range. The computer device will also judge the eye state collected during the preset time period to determine whether the user's eyes are open. The computer device may first judge the multiple position information with the preset position range, or may first judge the eye state, or may simultaneously judge the multiple position information with the preset position range and the eye state, and this embodiment does not limit this.

[0061] If the computer device determines that the multiple position information are all within the preset position range, and the eye state indicates that the user's eyes are in an open state, indicating that the acquired eye movement information is valid, then the correction information is determined according to the multiple position information and the position information of the correction object. If the computer device determines that the position information is not within the preset position range, or the eye state indicates that the user's eyes are in a closed state, indicating that the acquired eye movement information is invalid, then the step of acquiring the user's eye movement information is returned.

[0062] In an optional embodiment, if the acquired eye movement information still does not meet the preset conditions after a preset maximum time period, the process of determining the correction information is skipped, and the subsequent eye movement correction process is performed, and a prompt message is sent to the operator at the same time.

[0063] Step 220: Perform eye movement correction on the user according to the correction information.

[0064] After determining the correction information, the computer device uses the correction information to perform eye movement correction on the user. That is, when the eye movement information is subsequently used, the eye movement information can be corrected according to the correction information.

[0065] For example, when a visual field test or a dark adaptation test is subsequently performed, the determined correction information may be used to correct the eye movement information obtained during the test.

[0066] The eye movement correction method provided in the embodiment of the present application obtains the user's eye movement information; the eye movement information includes multiple position information and eye states of the user's gaze at the correction object; when the multiple position information are all within the preset position range and the eye state indicates that the user's eyes are in an open state, the correction information is determined according to the multiple position information and the position information of the correction object; and the user's eye movement correction is performed according to the correction information. In this embodiment, when the multiple position information obtained are all within the preset position range and the eyes are in an open state, the correction information can be determined directly according to the multiple position information obtained and the position information of the correction object, so as to perform eye movement correction. In this way, it is only necessary to obtain the user's eye movement information to determine the correction information for eye movement correction, which can improve the accuracy of eye movement correction compared with the existing use of eye tracking models to predict the user's gaze point. In addition, when using the eye movement correction method provided by the present application, the user does not need to remove the glasses, so that the eye movement correction method has higher practicality.

[0067] In addition, the eye movement correction method provided in the present application is applicable to a fixation test scenario, that is, a scenario in which the user is required to focus on a fixed point, and eye movement correction can be quickly achieved in this test scenario.

[0068] In one embodiment, Figure 3 As shown, an implementation method for determining correction information based on multiple position information and position information of a correction object, the steps of the implementation method include:

[0069] Step 300: Determine an average value of multiple position information.

[0070] After obtaining a plurality of position information when the user gazes at the calibration object within a preset time period, the computer device calculates an average value of the plurality of position information.

[0071] Step 310: Determine the calibration information according to the average value and the position information of the calibration object.

[0072] After obtaining the average value of the plurality of position information, the computer device determines the correction information according to the average value and the position information of the calibration object. Specifically, the computer device calculates the difference between the average value and the position information of the calibration object to obtain the correction information.

[0073] In this embodiment, the correction information is determined directly according to the average value of a plurality of position information and the position information of the calibration object. This method of determining the correction information is fast and easy to implement.

[0074] In one embodiment, after the computer device determines the correction information, if the correction information is needed in the subsequent eye movement correction process (i.e., visual field detection or dark adaptation detection), it is necessary to perform real-time detection on whether the correction information is abnormal in the subsequent eye movement correction process. Figure 4As shown, the steps of the eye movement correction method also include:

[0075] Step 400: Determine whether the calibration information is abnormal.

[0076] After determining the correction information, the computer device detects whether the correction information is abnormal during the subsequent eye movement correction process. This embodiment does not limit the specific method of determining whether the correction information is abnormal, as long as its function can be achieved.

[0077] Step 410: If it is determined that the correction information is abnormal, return to the step of obtaining the user's eye movement information.

[0078] If the computer device determines that the correction information is abnormal, the process returns to step 200 and step 210 to obtain new correction information. If the computer device determines that the correction information is normal, the eye movement correction is continued.

[0079] In this embodiment, after the correction information is determined, it is subsequently determined whether the correction information is abnormal, and when it is determined that the correction information is abnormal, new correction information is obtained. This ensures that the correction information used in the subsequent eye movement correction process is accurate, thereby improving the accuracy of the eye movement correction.

[0080] In one embodiment, Figure 5 As shown, an implementation method for determining whether correction information is abnormal is provided, and the steps of the implementation method include:

[0081] Step 500: Receive user feedback information on an interference object; an interference object is an object displayed in a target area on a display interface that the user is gazing at.

[0082] Interference objects refer to objects that interfere with the user when the user is looking at the calibration object. The types of interference objects and calibration objects may be the same or different. For the description of interference objects, please refer to the specific description of calibration objects mentioned above. The target area refers to the area that the user cannot see on the display interface when the user is looking at the display interface, that is, the blind area of ​​the user's field of vision.

[0083] The interference object is displayed in the target area (blind area) on the display interface of the detection device. The operator will ask the user several times whether the interference object can be observed (the user should look at the correction object at this time). After receiving the user's feedback information, the operator uploads the feedback information to the computer device. The computer device can receive the user's feedback information on the interference object. The user's feedback information on the interference object is used to indicate whether the user can observe the interference object.

[0084] Step 510: Determine whether the correction information is abnormal based on the feedback information.

[0085] After obtaining the user's feedback information on the interference object, the computer device determines whether the correction information is abnormal based on the feedback information.

[0086] In this embodiment, the user's feedback information on the interference is obtained through human-computer interaction to detect whether the correction information is abnormal. This can improve the accuracy of detecting the correction information abnormality and has higher flexibility, thereby achieving the accuracy of eye movement correction.

[0087] In one embodiment, an implementation method of determining whether correction information is abnormal according to feedback information includes:

[0088] If the feedback information indicates that the number of times the user has observed the interference object reaches a preset number, it is determined that the correction information is abnormal.

[0089] The preset number of times may be pre-set by the operator and stored in the computer device. After receiving the user's feedback information on the interference object, the computer device judges the feedback information. If the feedback information shows that the number of times the user has observed the interference object reaches the preset number of times, in other words, when the operator asks the user whether the interference object is observed for multiple times (preset number of times), the user's feedback is that the interference object can be observed, indicating that the user did not follow the operator's prompt to look at the calibration object, and the calibration information determined when the user looked at the calibration object cannot be used, then it is determined that the calibration information is abnormal.

[0090] In an optional embodiment, if the feedback information indicates that the number of times the user observes the interference object is less than a preset number, then it is determined that the correction information is normal.

[0091] In this embodiment, the number of times the user observes the distractor in the feedback information received from the user about the distractor is compared with the preset number of times to determine whether the correction information is abnormal. This method of determining whether the correction information is abnormal is quick and easy to implement, and can improve the practicality of the eye movement correction method.

[0092] In an optional embodiment, another implementation method of determining whether the correction information is abnormal according to the feedback information includes:

[0093] The feedback information is input into a pre-trained first anomaly detection model to obtain a first detection result; the first detection result includes whether the correction information is abnormal or the correction information is normal.

[0094] The first anomaly detection model can be obtained by training a neural network according to feedback information samples. After obtaining the feedback information, the computer device inputs the feedback information into the first anomaly detection model, and the anomaly detection model analyzes the feedback information to obtain a first detection result.

[0095] In one embodiment, another implementation method of determining whether correction information is abnormal includes:

[0096] Based on the eye movement information, determine whether the correction information is abnormal.

[0097] In determining the correction information and the subsequent eye movement correction process, the detection device can obtain the user's eye movement information in real time and transmit the obtained eye movement information to the computer device. In the subsequent eye movement correction process, the computer device detects whether the correction information is abnormal based on the obtained eye movement information.

[0098] In this embodiment, the correction information is checked for abnormality through eye movement information, that is, the acquired eye movement information can not only be used to determine the correction information, but also to detect whether the correction information is abnormal; and after determining that the correction information is abnormal, new correction information can also be determined based on the eye movement information. This makes the eye movement information more practical and can improve the practicality of the eye movement correction method.

[0099] In an optional embodiment, an implementation method of determining whether correction information is abnormal based on eye movement information includes:

[0100] Input the eye movement information into a second abnormality detection model to obtain a second detection result; and determine whether the correction information is abnormal according to the second detection result; the second detection result includes that the user removes or adjusts the detection device or the user does not remove and adjust the detection device;

[0101] The second abnormality detection model can be obtained by training a neural network based on eye movement information samples. After obtaining the eye movement information, the computer device inputs the eye movement information into the second abnormality detection model, and detects through the second abnormality detection model to determine whether the user has removed or adjusted the detection device. If the second detection result is that the user has removed or adjusted the detection device, it is determined that the correction information is abnormal; if the second detection result is that the user has not removed the detection device and has not adjusted the detection device, it is determined that the correction information is normal.

[0102] In one embodiment, Figure 6 As shown, based on the eye movement information, determining whether the correction information is abnormal can be implemented by selecting any of the following methods.

[0103] Step 600: If it is determined that within the first preset time period, the plurality of position information are all outside the preset position range, then it is determined that the correction information is abnormal.

[0104] The first preset time period may be preset by an operator and stored in the computer device. The description of the preset position range may refer to the specific description in the above embodiment, and is not limited here.

[0105] A first implementation method for determining whether correction information is abnormal based on eye movement information includes: after obtaining the eye movement information, the computer device obtains multiple position information of the user when looking at the correction object in the eye movement information, and determines whether the multiple position information are all within a preset position range within a first preset time period, that is, determines whether the user's gaze is within the preset position range when the user looks at the correction object within the first preset time period.

[0106] If the computer device determines that within the first preset time period, multiple position information are outside the preset position range, indicating that the user did not look at the calibration object according to the operator's prompts within the first preset time period, or the user adjusted the worn detection device, then the calibration information is determined to be abnormal.

[0107] If the computer device determines that the plurality of position information are all within the preset range within the first preset time period, it is determined that the correction information is normal.

[0108] Step 610: If it is determined that within the second preset time period, the eye state is used to indicate that the user's eyes are in a closed state, then it is determined that the calibration information is abnormal.

[0109] The first preset time period may be preset by an operator and stored in the computer device.

[0110] A second implementation method for determining whether correction information is abnormal based on eye movement information includes: after obtaining the eye movement information, the computer device obtains the eye state in the eye movement information, and determines whether the eye state indicates that the user's eyes are in a closed state within a second preset time period, that is, determines whether the user's eyes have been in a closed state within the second preset time period.

[0111] If the computer device determines that within the second preset time period, the eye state indicates that the user's eyes are closed, that is, the user did not look at the calibration object within the second preset time period, or the user took off the worn detection device, then the calibration information is determined to be abnormal.

[0112] If the computer device determines that within the second preset time period, the eye state indicates that the user's eyes are open, then it is determined that the correction information is normal.

[0113] Step 620: If it is determined that the eye movement information is invalid within the third preset time period, then it is determined that the correction information is abnormal.

[0114] The third preset time period may be preset by an operator and stored in the computer device.

[0115] The third implementation of determining whether the correction information is abnormal based on the eye movement information includes: after obtaining the eye movement information, the computer device determines whether the eye movement information is valid. If the computer device determines that the eye movement information is invalid information within the third preset time period, the correction information is determined to be abnormal; if the computer device determines that the eye movement information is valid information within the third preset time period, the correction information is determined to be normal.

[0116] In an optional embodiment, the method for determining whether the eye movement information is invalid includes: a pre-trained detection model is stored in the computer device. After acquiring the eye movement information, the computer device inputs the eye movement information into the detection model, detects the eye movement information through the detection model, and outputs a third detection result. The third detection result includes whether the eye movement information is valid or invalid.

[0117] In another optional embodiment, the method for determining whether the eye movement information is invalid further includes: after collecting the eye movement information, the detection device directly detects whether the eye movement information is valid, and sends a third detection result to the computer device. The third detection result includes whether the eye movement information is valid or invalid.

[0118] In this embodiment, three implementation methods are provided for determining whether the correction information is abnormal according to the eye movement information, and the user can select one according to the actual application requirements, which can improve the practicality of the eye movement correction method.

[0119] like Figure 7 As shown, the present application provides an eye movement correction method, the steps of the method comprising:

[0120] Step 700: obtaining the user's eye movement information; the eye movement information includes a plurality of position information and eye states when the user is gazing at the calibration object;

[0121] Step 710: if it is determined that the plurality of position information are all within the preset position range, and the eye state indicates that the user's eyes are open, determine an average value of the plurality of position information;

[0122] Step 720, determining calibration information according to the average value and the position information of the calibration object;

[0123] Step 730: If it is determined that the location information is not within the preset location range, or the eye status indicates that the user's eyes are open, return to step 700;

[0124] Step 740: During the eye movement correction process, receiving user feedback information on interference objects; interference objects are objects displayed in a target area on the display interface that the user is gazing at;

[0125] Step 750: If the feedback information indicates that the number of times the user has observed the interference object reaches a preset number, then return to step 700;

[0126] Step 760: If it is determined based on the eye movement information that the correction information is abnormal, then return to step 700.

[0127] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0128] Based on the same inventive concept, the embodiment of the present application also provides an eye movement correction device for implementing the eye movement correction method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in one or more eye movement correction device embodiments provided below can refer to the limitations of the eye movement correction method above, and will not be repeated here.

[0129] In one embodiment, the present application provides an eye movement correction system, including a computer device and a detection device, wherein the detection device is communicatively connected to the computer device; the detection device is used to display the correction object, and the computer device is used to execute the steps of the eye movement correction method provided in the above embodiment.

[0130] The computer device included in the eye movement correction system provided in this embodiment is used to execute the steps of the eye movement correction method provided in the above embodiment. Therefore, the eye movement correction system has all the beneficial effects of the above eye movement correction method, which will not be repeated here.

[0131] In one embodiment, Figure 8 As shown, an eye movement correction device 10 is provided, comprising: an acquisition module 11, a determination module 12 and a correction module 13, wherein:

[0132] The acquisition module 11 is used to acquire the user's eye movement information; the eye movement information includes a plurality of position information and eye states when the user is gazing at the calibration object.

[0133] The determination module 12 is used to determine the correction information according to the plurality of position information and the position information of the correction object when the plurality of position information are all within a preset position range and the eye state indicates that the user's eyes are open.

[0134] The correction module 13 is used to perform eye movement correction on the user according to the correction information.

[0135] In one embodiment, the eye movement correction device 10 further includes an abnormality determination module. The abnormality determination module is used to determine whether the correction information is abnormal; if the correction information is determined to be abnormal, the acquisition module 11 and the determination module 12 are returned to acquire new correction information.

[0136] In one embodiment, the abnormality determination module includes a first determination subunit. The first determination subunit is used to receive user feedback information on an interference object; the interference object is an object displayed in a target area on the display interface that the user is looking at; and determine whether the correction information is abnormal according to the feedback information.

[0137] In one embodiment, the first determination subunit is specifically configured to determine that the correction information is abnormal if the feedback information indicates that the number of times the user has observed the interference object has reached a preset number.

[0138] In one embodiment, the abnormality determination module further includes a second determination subunit, and the second determination subunit is used to determine whether the correction information is abnormal based on the eye movement information.

[0139] In one embodiment, the second determination subunit is specifically used to perform any of the following steps: if it is determined that within a first preset time period, multiple position information are outside the preset position range, then the correction information is determined to be abnormal; if it is determined that within a second preset time period, the eye state is used to indicate that the user's eyes are in a closed state, then the correction information is determined to be abnormal; if it is determined that within a third preset time period, the eye movement information is invalid information, then the correction information is determined to be abnormal.

[0140] In one embodiment, the determination module 12 is specifically used to determine an average value of a plurality of position information; and determine the correction information according to the average value and the position information of the correction object.

[0141] Each module in the above eye movement correction device can be implemented in whole or in part by software, hardware, or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute the operations corresponding to each module.

[0142] In one embodiment, a computer device is provided, whose internal structure diagram can be as follows: Figure 1 As shown. Those skilled in the art can understand that Figure 1The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0143] In one embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the following steps are implemented:

[0144] Acquire the user's eye movement information; the eye movement information includes multiple position information and eye states when the user looks at the calibration object;

[0145] When the plurality of position information are all within a preset position range and the eye state indicates that the user's eyes are open, determining the correction information according to the plurality of position information and the position information of the correction object;

[0146] Perform eye movement correction on the user according to the correction information.

[0147] In one embodiment, when the processor executes the computer program, the processor further implements the following steps: determining whether the correction information is abnormal; if it is determined that the correction information is abnormal, returning to the step of obtaining the user's eye movement information.

[0148] In one embodiment, when the processor executes the computer program, the following steps are also implemented: receiving user feedback information on the interference object; the interference object is an object displayed in the target area on the display interface that the user is gazing at; and determining whether the correction information is abnormal based on the feedback information.

[0149] In one embodiment, when the processor executes the computer program, the following steps are further implemented: if the feedback information indicates that the number of times the user has observed the interference object reaches a preset number, then determining that the correction information is abnormal.

[0150] In one embodiment, when the processor executes the computer program, the following steps are further implemented: determining whether the correction information is abnormal based on the eye movement information.

[0151] In one embodiment, the processor also implements the following steps when executing the computer program: if it is determined that within a first preset time period, multiple position information are outside the preset position range, then the correction information is determined to be abnormal; if it is determined that within a second preset time period, the eye state is used to indicate that the user's eyes are in a closed state, then the correction information is determined to be abnormal; if it is determined that within a third preset time period, the eye movement information is invalid information, then the correction information is determined to be abnormal.

[0152] In one embodiment, when the processor executes the computer program, the following steps are further implemented: determining an average value of a plurality of position information; and determining correction information according to the average value and the position information of the correction object.

[0153] In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:

[0154] Acquire the user's eye movement information; the eye movement information includes multiple position information and eye states when the user looks at the calibration object;

[0155] When the plurality of position information are all within a preset position range and the eye state indicates that the user's eyes are open, determining the correction information according to the plurality of position information and the position information of the correction object;

[0156] Perform eye movement correction on the user according to the correction information.

[0157] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: determining whether the correction information is abnormal; if it is determined that the correction information is abnormal, returning to the step of obtaining the user's eye movement information.

[0158] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: receiving user feedback information on the interference object; the interference object is an object displayed in the target area on the display interface that the user is gazing at; and determining whether the correction information is abnormal based on the feedback information.

[0159] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: if the feedback information indicates that the number of times the user has observed the interference object reaches a preset number, then determining that the correction information is abnormal.

[0160] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: determining whether the correction information is abnormal based on the eye movement information.

[0161] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: if it is determined that within a first preset time period, multiple position information are outside the preset position range, then the correction information is determined to be abnormal; if it is determined that within a second preset time period, the eye state is used to indicate that the user's eyes are in a closed state, then the correction information is determined to be abnormal; if it is determined that within a third preset time period, the eye movement information is invalid information, then the correction information is determined to be abnormal.

[0162] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: determining an average value of multiple position information; and determining correction information based on the average value and the position information of the calibration object.

[0163] In one embodiment, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the following steps:

[0164] Obtaining the user's eye movement information; the eye movement information includes multiple position information and eye states when the user is looking at the calibration object;

[0165] When the plurality of position information are all within a preset position range and the eye state indicates that the user's eyes are open, determining the correction information according to the plurality of position information and the position information of the correction object;

[0166] Perform eye movement correction on the user according to the correction information.

[0167] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: determining whether the correction information is abnormal; if it is determined that the correction information is abnormal, returning to the step of obtaining the user's eye movement information.

[0168] In one embodiment, when the computer program is executed by a processor, the following steps are also implemented:

[0169] Receive user feedback information on the interference object; the interference object is an object displayed in the target area on the display interface that the user is looking at; determine whether the correction information is abnormal based on the feedback information.

[0170] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: if the feedback information indicates that the number of times the user has observed the interference object reaches a preset number, then determining that the correction information is abnormal.

[0171] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: determining whether the correction information is abnormal based on the eye movement information.

[0172] In one embodiment, when the computer program is executed by the processor, the following steps are also implemented: if it is determined that within a first preset time period, multiple position information are outside the preset position range, then the correction information is determined to be abnormal; if it is determined that within a second preset time period, the eye state is used to indicate that the user's eyes are in a closed state, then the correction information is determined to be abnormal; if it is determined that within a third preset time period, the eye movement information is invalid information, then the correction information is determined to be abnormal.

[0173] In one embodiment, when the computer program is executed by the processor, the following steps are further implemented: determining an average value of multiple position information; and determining correction information based on the average value and the position information of the calibration object.

[0174] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.

[0175] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0176] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. An eye movement correction method, characterized in that: The method comprises: Acquiring eye movement information of the user; the eye movement information includes a plurality of position information and eye states of the user when gazing at the calibration object; When the plurality of position information are all within a preset position range and the eye state indicates that the user's eyes are open, determining the correction information according to the plurality of position information and the position information of the correction object; Perform eye movement correction on the user according to the correction information.

2. The method according to claim 1, characterized in that The method further comprises: determining whether the calibration information is abnormal; If it is determined that the correction information is abnormal, the process returns to the step of obtaining the user's eye movement information.

3. The method according to claim 2, characterized in that The determining whether the correction information is abnormal includes: receiving feedback information from the user on an interference object; the interference object is an object displayed in a target area on the display interface that the user is gazing at; Determine whether the correction information is abnormal according to the feedback information.

4. The method according to claim 3, characterized in that The determining whether the correction information is abnormal according to the feedback information includes: If the feedback information indicates that the number of times the user has observed the interference object reaches a preset number, it is determined that the correction information is abnormal.

5. The method according to claim 3, characterized in that: The determining whether the correction information is abnormal includes: It is determined whether the correction information is abnormal according to the eye movement information.

6. The method according to claim 5, characterized in that The determining, based on the eye movement information, whether the correction information is abnormal includes any one of the following: If it is determined that within the first preset time period, the plurality of position information are all outside the preset position range, then it is determined that the correction information is abnormal; If it is determined that within the second preset time period, the eye state is used to indicate that the user's eyes are in a closed state, then determining that the correction information is abnormal; If it is determined that the eye movement information is invalid information within the third preset time period, then the correction information is determined to be abnormal.

7. The method according to claim 1, characterized in that The determining the calibration information according to the plurality of position information and the position information of the calibration object comprises: determining an average value of the plurality of position information; The correction information is determined based on the average value and the position information of the calibration object.

8. An eye movement correction device, characterized in that: The device comprises: An acquisition module, used to acquire eye movement information of the user; the eye movement information includes a plurality of position information and eye states of the user when gazing at the calibration object; a determination module, configured to determine correction information according to the plurality of position information and the position information of the correction object when the plurality of position information are all within a preset position range and the eye state indicates that the user's eyes are in an open state; A correction module is used to perform eye movement correction on the user according to the correction information.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. An eye movement correction system, characterized in that: The method comprises a computer device and a detection device, wherein the detection device is communicatively connected to the computer device; the detection device is used to display a calibration object, and the computer device is used to execute the steps of the method as described in any one of claims 1 to 7.

Images