Eye movement tracking data collection method and apparatus, and device, storage medium and product

Abstract

Provided in the embodiments of the present disclosure are an eye movement tracking data collection method and apparatus, and a device, a readable storage medium and a product. The eye movement tracking data collection method comprises: displaying a preset eye movement tracking data collection page, wherein the eye movement tracking data collection page comprises a content display area and a preset direction determination control; in response to an eye movement tracking data collection operation triggered by a user, displaying a preset gaze area at a random position in the content display area, and displaying indication information of a random direction at a random time frame in the process of displaying the gaze area; acquiring at least one piece of feedback information input by the user by means of the direction determination control, wherein the feedback information is direction information generated by the user on the basis of direction indication information; and when the feedback information meets a preset collection condition, performing a collection operation on eye movement tracking data of the user.

Description

Eye tracking data collection method, device, equipment, storage medium and product

[0001] This application claims priority to Chinese patent application No. 202311801095.2 filed on December 25, 2023, and the contents of the above-mentioned Chinese patent application disclosure are hereby incorporated by reference in their entirety as a part of this application. Technical Field

[0002] Embodiments of the present disclosure relate to an eye tracking data collection method, apparatus, device, storage medium, and product. Background Art

[0003] With the continuous development of science and technology, eye tracking data is increasingly being used in fields such as virtual reality and psychology. Therefore, how to collect eye tracking data has become an urgent problem to be solved. Summary of the Invention

[0004] Embodiments of the present disclosure provide an eye tracking data collection method, apparatus, device, storage medium, and product.

[0005] In a first aspect, an embodiment of the present disclosure provides an eye tracking data collection method, comprising:

[0006] Displaying a preset eye tracking data collection page, wherein the eye tracking data collection page includes a content display area and a preset direction determination control;

[0007] In response to an eye tracking data collection operation triggered by a user, displaying a preset gaze area at a random position within the content display area, and displaying indication information of a random direction at a random time frame during the display of the gaze area;

[0008] Acquire at least one piece of feedback information input by the user through the direction determination control, wherein the feedback information is direction information generated by the user based on the direction indication information;

[0009] When the feedback information meets a preset collection condition, an operation is performed on collecting the eye tracking data of the user.

[0010] In a second aspect, an embodiment of the present disclosure provides an eye tracking data acquisition device, comprising:

[0011] a display module configured to display a preset eye tracking data collection page, wherein the eye tracking data collection page includes a content display area and a preset direction determination control;

[0012] a processing module configured to, in response to an eye tracking data collection operation triggered by a user, display a preset gaze area at a random position within the content display area, and display indication information of a random direction at a random time frame during the display of the gaze area;

[0013] an acquisition module configured to acquire at least one piece of feedback information input by the user through the direction determination control, wherein the feedback information is direction information generated by the user based on the direction indication information;

[0014] The collection module is configured to collect the eye tracking data of the user when the feedback information meets the preset collection conditions.

[0015] In a third aspect, an embodiment of the present disclosure provides an electronic device, including: a processor and a memory;

[0016] The memory stores computer-executable instructions;

[0017] The processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the eye tracking data collection method as described in the first aspect and various possible designs of the first aspect.

[0018] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions. When a processor executes the computer-executable instructions, the eye tracking data collection method described in the first aspect and various possible designs of the first aspect is implemented.

[0019] In a fifth aspect, an embodiment of the present disclosure provides a computer program product, including a computer program, which, when executed by a processor, implements the eye tracking data collection method described in the first aspect and various possible designs of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, a brief introduction will be given below to the drawings required for use in the description of the embodiments. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0021] FIG1 is a flow chart of an eye tracking data collection method according to an embodiment of the present disclosure;

[0022] FIG2 is a schematic diagram of a display interface provided by an embodiment of the present disclosure;

[0023] FIG3 is a flow chart of an eye tracking data collection method according to another embodiment of the present disclosure;

[0024] FIG4 is a schematic diagram of an interface interaction provided by an embodiment of the present disclosure;

[0025] FIG5 is a flowchart of an eye tracking data collection method according to another embodiment of the present disclosure;

[0026] FIG6 is a flowchart of an eye tracking data collection method according to another embodiment of the present disclosure;

[0027] FIG7 is a schematic diagram of eye tracking data provided by an embodiment of the present disclosure;

[0028] FIG8 is a schematic diagram of the structure of an eye tracking data acquisition device provided by an embodiment of the present disclosure; and

[0029] FIG9 is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0030] To make the objectives, technical solutions, and advantages of the embodiments of the present disclosure more clear, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present disclosure without making any creative efforts shall fall within the scope of protection of the present disclosure.

[0031] It is understandable that before using the technical solutions disclosed in the various embodiments of this disclosure, the type, scope of use, usage scenarios, etc. of the personal information involved in this disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0032] For example, in response to a user's active request, a prompt message is sent to the user to clearly inform the user that the operation requested will require the acquisition and use of the user's personal information. This allows the user to independently choose whether to provide personal information to the electronic device, application, server, storage medium, or other software or hardware that performs the operations of the disclosed technical solution based on the prompt message.

[0033] As an optional but non-limiting implementation, in response to receiving a user's active request, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. Furthermore, the pop-up window may also contain a selection control for the user to select "agree" or "disagree" to provide personal information to the electronic device.

[0034] It is understandable that the above notification and user authorization process are merely illustrative and do not limit the implementation of the present disclosure. Other methods that comply with relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0035] In order to solve the technical problem that the eye tracking data collected by the eye tracking data collection method is not accurate, the present disclosure provides an eye tracking data collection method, device, equipment, storage medium and product.

[0036] It should be noted that the eye tracking data collection method, device, equipment, storage medium and product provided by the present disclosure can be applied in any eye tracking data collection scenario.

[0037] When a person's eyes look in different directions, there will be subtle changes in the eyes. These changes will produce extractable features. Computers can extract these features through image capture or scanning, thereby tracking changes in the eyes in real time, predicting the user's status and needs, and responding to achieve the purpose of controlling the device with the eyes.

[0038] For example, after collecting eye-tracking data, a preset gaze estimation model can be trained based on the eye-tracking data with annotated directions as training samples to obtain a trained gaze estimation model. This trained gaze estimation model can then be used to accurately track changes in the user's eyes, enabling device control and other operations based on the tracking results. The higher the accuracy of the eye-tracking data, the higher the data processing accuracy of the gaze estimation model obtained based on the training data. Therefore, improving the accuracy of collected eye-tracking data has become an urgent issue to be addressed.

[0039] In related technologies, the eye tracking data collection method generally involves collecting the user's eye image during the display of the gaze area after the gaze area is displayed on the display interface of the virtual reality device, and collecting eye tracking data based on the eye image and the orientation of the gaze area.

[0040] However, when using the above method to collect eye tracking data, the user is required to actively check the gaze area. If the user does not check the gaze area during the collection process, the collected eye tracking data is often inaccurate.

[0041] In the process of solving the above technical problems, the inventors of the present disclosure discovered through research that in order to improve the accuracy of eye tracking data, after the gaze area is displayed in the data collection page of the virtual reality device, data collection operations can be performed when the user gazes at the gaze area.

[0042] Optionally, a content display area can be set on the data collection page, and the gaze area can be displayed at a random position in the content display area. Indication information in a random direction can also be displayed at random time frames during the gaze area display process. Feedback information input by the user based on the indication information can be obtained, and when the feedback information meets the preset collection conditions, the user's eye tracking data can be collected.

[0043] As an implementable method, indication information of a random direction can be briefly displayed in a certain time frame during the display of the gaze area. If the feedback information generated by the user based on the indication information meets the preset collection conditions, it can be represented that the user has actually viewed the gaze area. At this time, the position of the user's eyes in the collected eye tracking data can match the display position of the gaze area, thereby improving the accuracy of the eye tracking data.

[0044] The system architecture underlying the present disclosure includes at least a virtual reality device and a server. The virtual reality device can display a gaze area, and a user can input feedback information using a controller associated with the virtual reality device. The server can verify the user's input feedback information based on random direction indication information displayed in the gaze area, and collect eye tracking data when the feedback information meets preset collection conditions.

[0045] FIG1 is a flow chart of an eye tracking data collection method provided by an embodiment of the present disclosure. As shown in FIG1 , the eye tracking data collection method includes:

[0046] Step 101: Display a preset eye tracking data collection page, wherein the eye tracking data collection page includes a content display area and a preset direction determination control.

[0047] The embodiment of the present invention is implemented by an eye-tracking data acquisition device. The eye-tracking data acquisition device can be coupled to a virtual reality device to collect eye-tracking data based on feedback information generated by the user according to the indication information displayed in the gaze area.

[0048] In this embodiment, to collect eye tracking data, a preset eye tracking data collection page can be displayed on the display interface of a virtual reality device or other terminal device. The eye tracking data collection page includes a content display area and a preset direction determination control. The content display area can be used to display the gaze area, and the user can input a direction displayed in the gaze area based on the direction determination control to generate feedback information.

[0049] Optionally, the content display area can be displayed on the left side of the eye tracking data collection page, and the preset direction determination control can be displayed on the right side of the eye tracking data collection page. Alternatively, the user can adjust the display position and display size of the content display area and the preset direction determination control according to actual needs.

[0050] Step 102: In response to the eye tracking data collection operation triggered by the user, a preset gaze area is displayed at a random position in the content display area, and indication information of a random direction is displayed at a random time frame during the display of the gaze area.

[0051] In this embodiment, the user can trigger the eye tracking data collection operation by triggering the collection control preset in the eye tracking data collection page, or the user can trigger the eye tracking data collection operation based on the trigger operation of the preset control on the remote control terminal, or the user can trigger the eye tracking data collection operation by generating voice commands. The present disclosure does not impose any restrictions on this.

[0052] In response to the eye tracking data collection operation, a preset gaze area may be displayed within the content display area. The gaze area may be displayed at a random location within the content display area. The gaze area may be a circular area, a square area, or the like. The display size of the gaze area may be a preset size, or the display size of the gaze area may switch from a first size to a second size over time, which is not limited in this disclosure.

[0053] Furthermore, to ensure that the user is actually viewing the gaze area, indication information in a random direction can be displayed on the gaze area. During the gaze area display process, the indication information can be displayed within a random time frame. By increasing the difficulty of viewing the indication information, it can be further ensured that the feedback information generated by the user is after viewing the gaze area.

[0054] Step 103: Acquire at least one piece of feedback information input by the user through the direction determination control, wherein the feedback information is direction information generated by the user based on the direction indication information.

[0055] In this embodiment, after viewing the gaze area, the user may determine the control input feedback information based on a preset direction, wherein the feedback information is generated by the user based on the indication information displayed in the gaze area.

[0056] For example, if the gaze area indicates the right side, the user can view this indication and then, based on the direction, input feedback to the right side of the control. If the two match, the user generated the feedback after viewing the gaze area. Otherwise, the user may not be viewing the gaze area. This improves the accuracy of eye tracking data.

[0057] Step 104: When the feedback information meets the preset collection conditions, the user's eye tracking data is collected.

[0058] In this embodiment, after obtaining the feedback information generated by the user, it can be detected whether the feedback information meets the preset collection conditions. When the feedback information meets the preset collection conditions, the eye tracking data collection operation is performed.

[0059] Among them, the preset collection conditions include but are not limited to the feedback information being consistent with the indication information, the number of times the feedback information matches the indication information exceeds a preset threshold, the feedback information is consistent with the indication information and the feedback time is within a preset time range, etc. Users can set the preset collection conditions according to actual needs, and this disclosure does not impose any restrictions on this.

[0060] Figure 2 is a schematic diagram of a display interface provided by an embodiment of the present disclosure. As shown in Figure 2, the eye tracking data collection page 21 includes a content display area 22 and a direction determination control 23. A gaze area 24 can be displayed at a random position in the content display area 22. During the display of the gaze area 24, indication information of a random direction can be displayed in the gaze area 24 within a certain time frame. After viewing the indication information, the user can input feedback information based on the direction determination control 23.

[0061] Optionally, based on any of the above embodiments, step 104 includes:

[0062] If the feedback information matches the indication information of the random direction, the user's eye tracking data is collected.

[0063] In this embodiment, it is possible to detect whether the feedback information matches the random direction indication information. If so, it can be determined that the user inputted the feedback information after viewing the gaze area. In this case, the user's eye tracking data can be collected. Otherwise, it indicates that the user is not currently viewing the gaze area. In this case, the accuracy of the eye tracking data collected is not high. Therefore, the next gaze area can be switched to display, and a new round of gaze operation can be started.

[0064] Optionally, when multiple indication information is displayed on the gaze area, it is possible to detect whether each feedback information is consistent with its matching indication information. If so, it can be determined that the user input the feedback information after viewing the gaze area. At this time, the user's eye tracking data can be collected.

[0065] The eye tracking data collection method provided in this embodiment displays a gaze area at a random location within a preset content display area on an eye tracking data collection page, and displays at least one direction indicator at random intervals within the gaze area. This allows the accuracy of user feedback input to be determined based on the at least one direction indicator. Eye tracking data is collected when the feedback meets preset collection conditions. This ensures that eye tracking data is collected when the user is viewing the gaze area, improving the quality of the collected eye tracking data.

[0066] FIG3 is a flowchart of an eye tracking data collection method according to another embodiment of the present disclosure. Based on any of the above embodiments, as shown in FIG3 , after step 102, the method further includes:

[0067] Step 301: In a first random time frame during the display process of the gaze area, first indication information of a random direction is displayed in the gaze area.

[0068] Step 302: Obtain first feedback information input by the user in response to the first indication information.

[0069] Step 303: If the first feedback information matches the first indication information, display the second indication information in the gaze area within a second random time frame.

[0070] Step 304: If the first feedback information does not match the first indication information, switch to display the next gaze area.

[0071] Step 305: Obtain second feedback information input by the user in response to the second indication information.

[0072] Step 306: If the second feedback information matches the second indication information, a prompt message is displayed in the content display area, and the user's eye tracking data is collected. The prompt message is used to prompt the user that the feedback information currently input matches the indication information.

[0073] Step 307: If the second feedback information does not match the second indication information, switch to display the next gaze area.

[0074] The second random time frame is later than the first random time frame.

[0075] In this embodiment, the same gaze area may display different indication information at different random time frames, and the user may generate feedback information for each indication information.

[0076] Optionally, during the first random time frame of the gaze area display process, first indication information in a random direction can be displayed in the gaze area. First feedback information input by the user based on the first indication information is obtained. A check is performed to determine whether the first feedback information matches the first indication information. If so, it indicates that the user is currently viewing the gaze area, and second indication information can be displayed in the gaze area during a second random time frame. Otherwise, it indicates that the user may not be viewing the gaze area. To ensure the validity of the eye tracking data, the next gaze area can be displayed at a random position.

[0077] Furthermore, after presenting the second indication information, second feedback information generated by the user based on the second indication information can be obtained. A test is performed to determine whether the first feedback information matches the first indication information. If so, this indicates that the user is currently viewing the gaze area, and eye tracking data can be collected. Otherwise, this indicates that the user may not be viewing the gaze area. To ensure the validity of the eye tracking data, the next gaze area can be displayed at a random position. The second random time frame is later than the first random time frame. By sequentially presenting two different indication information, the validity of the collected eye tracking data can be ensured.

[0078] FIG4 is a schematic diagram of an interface interaction provided by an embodiment of the present disclosure. As shown in FIG4 , an eye tracking data collection page 41 includes a content display area 42 and a direction determination control 43. A gaze area 44 can be displayed at a random location within the content display area 42. Indication information 45 can be displayed within the gaze area 44. In the current time frame, the direction indicated by the indication information 45 can be the right. The user can generate feedback information based on the direction determination control 43. When the feedback information generated by the user does not match the indication information 45, for example, the feedback information input by the user can be the left, the next gaze area can be switched to another location for display.

[0079] The eye tracking data collection method provided in this embodiment switches the next gaze area when it detects that the user's currently input feedback information does not match the indicated information. This allows the user to more intuitively view the gaze area through the change in display position. By collecting eye tracking data only when both feedback information matches the indicated information, eye tracking data is collected when the user views the gaze area. In this case, the position of the user's eyes in the eye tracking data matches the displayed position of the gaze area, thereby improving the accuracy of the eye tracking data.

[0080] FIG5 is a flow chart of an eye tracking data collection method according to another embodiment of the present disclosure. Based on any of the above embodiments, the number of random time frames is at least two. As shown in FIG5 , after step 104, the method further includes:

[0081] Step 501: Obtain at least two eye images when the user inputs feedback information.

[0082] Step 502: Perform an identification operation on the validity of the eye tracking data based on at least two eye images.

[0083] In this embodiment, during the display of the gaze area, different direction indication information may be displayed on the gaze area within two random time frames. For example, the right direction may be displayed in the first random time frame, and the upward direction may be displayed in the second random time frame. This allows the user to input feedback information based on the two displayed indication information.

[0084] It's understandable that since the location of the gaze area doesn't change between the two displays of the indication information, when the user is viewing the gaze area and generating feedback information, their eyes are always looking at the same display location. This means that the difference between the eye images collected when generating feedback information is small. Therefore, the validity of the eye tracking data can be verified based on the similarity between the eye images collected when generating feedback information twice to ensure that the currently collected eye tracking data was generated when the user was viewing the gaze area.

[0085] Optionally, at least two eye images may be obtained when the user inputs feedback information, and the validity of the eye tracking data may be identified based on the at least two eye images.

[0086] The eye tracking data collection method provided in this embodiment compares at least two eye images when the user inputs feedback information, thereby accurately identifying the validity of the eye tracking data based on the comparison results, thereby further improving the accuracy of eye tracking data collection.

[0087] Further, based on any of the above embodiments, step 502 includes:

[0088] A similarity between at least two eye images is determined.

[0089] If the similarity exceeds a preset similarity threshold, the eye tracking data is determined to be valid.

[0090] If the similarity is lower than a preset similarity threshold, the eye tracking data is determined to be invalid.

[0091] In this embodiment, after obtaining at least two eye images when the user inputs feedback information, the similarity between the at least two eye images can be determined. The similarity can be calculated using any method, which is not limited by this disclosure. If the similarity exceeds a preset similarity threshold, the eye tracking data is determined to be valid. If the similarity is lower than the preset similarity threshold, the eye tracking data is determined to be invalid.

[0092] Alternatively, a pixel difference between the two eye images may be calculated. If the pixel difference exceeds a preset difference threshold, the eye tracking data is determined to be invalid. If the pixel difference is below a preset difference threshold, the eye tracking data is determined to be valid.

[0093] As an implementable method, after obtaining feedback information generated by the user for two indication information respectively, at least two eye images when the user inputs the feedback information can be obtained, and the similarity or pixel difference between the at least two eye images can be determined. If the similarity is greater than a preset similarity threshold or the pixel difference is less than a preset difference threshold, eye tracking data can be generated based on the collected eye area image and the display position of the gaze area. Otherwise, the next gaze area can be displayed.

[0094] The eye tracking data collection method provided in this embodiment determines that the eye tracking data is invalid when the similarity between at least two eye images is lower than a preset threshold, thereby accurately filtering out low-quality eye tracking data and improving the data quality of the collected eye tracking data.

[0095] Optionally, based on any of the above embodiments, the gaze area is displayed according to the first size. After step 102, the following steps are further included:

[0096] The gaze area is controlled to switch a display size from a first size to a preset second size within a preset time interval.

[0097] The first size is greater than the second size.

[0098] In this embodiment, in order to enable the user to perform a focusing operation more quickly when viewing the gaze area, the display size of the gaze area may be controlled to be transformed.

[0099] Optionally, after the user triggers the eye tracking data collection operation, the gaze area can be displayed at a random location within the content display area at a preset first size. The display size of the gaze area can be controlled to switch from the first size to a preset second size within a preset time interval.

[0100] It should be noted that, in order to enable the user to more intuitively locate the gaze area and achieve focusing, the first size may be larger than the second size.

[0101] The eye tracking data collection method provided in this embodiment controls the display size of the gaze area to switch from a first size to a preset second size within a preset time interval, thereby facilitating the user to perform focusing operations while viewing the gaze area, thereby improving the efficiency of eye tracking data collection.

[0102] Optionally, based on any of the above embodiments, after step 102, the method further includes:

[0103] Displaying a preset pattern in the gaze area, wherein the preset pattern is displayed in a rotating manner in the gaze area according to preset display parameters;

[0104] And / or, after displaying a preset gaze area at a random position within the content display area, the method further includes:

[0105] The display background within the gaze area is switched based on at least two preset display backgrounds at preset time intervals.

[0106] In this embodiment, in order to relieve the user's eye fatigue during the eye tracking data collection process, the display content or display background in the gaze area can be switched.

[0107] Optionally, when no indication information is displayed within the gaze area, a preset pattern may be displayed within the gaze area. The preset pattern may be, for example, a cross star pattern. Furthermore, to further enrich the displayed content within the gaze area, the preset pattern may be rotated within the gaze area according to preset display parameters. The preset display parameters include, but are not limited to, the display size, display position, rotation speed, and rotation direction of the preset pattern.

[0108] Optionally, a preset display background may also be displayed within the gaze area. To enrich the display content within the gaze area, at least two preset display backgrounds may be pre-set. The display background within the gaze area may be switched at preset time intervals. The preset display backgrounds include, but are not limited to, solid color backgrounds, patterned backgrounds, and the like. For example, the display background may include a black background and a white background, and the black background and the white background may be switched at preset time intervals.

[0109] As an implementable approach, the indication information within the gaze area can be displayed at a random depth. This can improve the richness of the collected eye tracking data during data collection based on the indication information at random depths. Furthermore, the gaze estimation model trained with this rich eye tracking data can be more accurate and stable.

[0110] The eye tracking data collection method provided in this embodiment can effectively alleviate the user's eye fatigue during the eye tracking data collection process by embedding a rotating cross star pattern in the display area, or switching the black and white background in the display area, thereby improving the efficiency of eye tracking data collection and improving the accuracy of the collected eye tracking data.

[0111] FIG6 is a flowchart of an eye tracking data collection method according to another embodiment of the present disclosure. Based on any of the above embodiments, as shown in FIG6 , step 104 includes:

[0112] Step 601: Obtain an eye image when the user inputs feedback information.

[0113] Step 602: Annotate the eye image based on the displayed position of the gaze area to obtain eye tracking data.

[0114] In this embodiment, when the feedback information input by the user is consistent with the direction of the indication information displayed in the gaze area, that is, when it is determined that the user is viewing the gaze area, the eye image of the user when inputting the feedback information can be captured.

[0115] After capturing the eye image, the eye image can be annotated based on the displayed location of the gaze area to obtain eye tracking data. For example, if the gaze area is displayed on the upper right side of the screen, the eye can be annotated based on the direction from the eyeball to the upper right side of the screen to obtain eye tracking data.

[0116] FIG7 is a schematic diagram of eye tracking data provided by an embodiment of the present disclosure. As shown in FIG7 , an eye image 71 may be directionally annotated 72 according to the display position of the gaze area to obtain eye tracking data 73 .

[0117] The eye tracking data collection method provided in this embodiment can accurately obtain eye tracking data by labeling eye images collected when the user views the focus point based on the position of the gaze area.

[0118] FIG8 is a schematic diagram of the structure of an eye tracking data collection device provided by an embodiment of the present disclosure. As shown in FIG8 , the device includes: a display module 81, a processing module 82, an acquisition module 83, and an acquisition module 84. Display module 81 is configured to display a preset eye tracking data collection page, wherein the eye tracking data collection page includes a content display area and a preset direction determination control. Processing module 82 is configured to, in response to a user-triggered eye tracking data collection operation, display a preset gaze area at a random location within the content display area, and display random direction indication information at random time frames during the gaze area display process. Acquisition module 83 is configured to acquire at least one piece of feedback information input by the user via the direction determination control, wherein the feedback information is direction information generated by the user based on the direction indication information. Acquisition module 84 is configured to collect the user's eye tracking data when the feedback information meets preset collection conditions.

[0119] Furthermore, based on any of the above embodiments, the collection module is configured to: if the feedback information matches the indication information of the random direction, collect the user's eye tracking data.

[0120] Furthermore, based on any of the above embodiments, the eye tracking data acquisition device further includes: a display module configured to display first indication information of a random direction in the gaze area during a first random time frame of the gaze area display process; an acquisition module configured to obtain first feedback information input by a user in response to the first indication information; the display module configured to display second indication information in the gaze area within a second random time frame if the first feedback information matches the first indication information; and a switching module configured to switch to displaying the next gaze area if the first feedback information does not match the first indication information. The second random time frame is later than the first random time frame.

[0121] Furthermore, based on any of the above embodiments, the eye tracking data collection device further includes: an acquisition module configured to obtain second feedback information input by the user in response to the second indication information. The acquisition module is configured to display a prompt message in the content display area and collect the user's eye tracking data if the second feedback information matches the second indication information, where the prompt message indicates to the user that the currently input feedback information matches the indication information. The switching module is configured to switch to displaying the next gaze area if the second feedback information does not match the second indication information.

[0122] Furthermore, based on any of the above embodiments, the number of random time frames is at least two. The eye tracking data acquisition device further includes: an acquisition module configured to acquire at least two eye images when the user inputs feedback information; and an identification module configured to identify the validity of the eye tracking data based on the at least two eye images.

[0123] Furthermore, based on any of the above embodiments, the recognition module is configured to: determine a similarity between at least two eye images; if the similarity exceeds a preset similarity threshold, determine that the eye tracking data is valid; if the similarity is lower than the preset similarity threshold, determine that the eye tracking data is invalid.

[0124] Furthermore, based on any of the above embodiments, the gaze area is displayed at a first size. The eye tracking data acquisition device further includes a control module configured to control the gaze area to switch its display size from the first size to a preset second size within a preset time interval. The first size is larger than the second size.

[0125] Furthermore, based on any of the above embodiments, the eye tracking data acquisition device also includes: a switching module, configured to display a preset pattern in the gaze area, wherein the preset pattern is displayed in a rotation manner in the gaze area according to preset display parameters; and / or, the eye tracking data acquisition device also includes: a switching module, configured to switch the display background in the gaze area according to a preset time interval based on at least two preset display backgrounds.

[0126] Furthermore, based on any of the above embodiments, the acquisition module is configured to: obtain an eye image of the user when inputting feedback information, and annotate the eye image based on the displayed position of the gaze area to obtain eye tracking data.

[0127] The device provided in this embodiment can be used to execute the technical solution of the above method embodiment. Its implementation principle and technical effects are similar and will not be described in detail in this embodiment.

[0128] In order to implement the above embodiments, the embodiments of the present disclosure further provide a computer-readable storage medium, in which computer-executable instructions are stored. When a processor executes the computer-executable instructions, the eye tracking data collection method as in any of the above embodiments is implemented.

[0129] In order to implement the above embodiments, the embodiments of the present disclosure further provide a computer program product, including a computer program, which, when executed by a processor, implements the eye tracking data collection method as described in any of the above embodiments.

[0130] In order to implement the above embodiment, the present disclosure further provides an electronic device, including: a processor and a memory;

[0131] Memory stores computer-executable instructions;

[0132] The processor executes the computer-executable instructions stored in the memory, so that the processor performs the eye tracking data collection method as described in any of the above embodiments.

[0133] FIG9 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure. The electronic device 900 may be a terminal device or a server. The terminal device may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, personal digital assistants (PDAs), tablet computers (Portable Android Devices, PADs), portable multimedia players (PMPs), vehicle-mounted terminals (e.g., vehicle-mounted navigation terminals), and fixed terminals such as digital TVs and desktop computers. The electronic device shown in FIG9 is merely an example and should not limit the functions and scope of use of the embodiments of the present disclosure.

[0134] As shown in Figure 9, the electronic device 900 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 901, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage device 908 into a random access memory (RAM) 903. Various programs and data required for the operation of the electronic device 900 are also stored in the RAM 903. The processing device 901, the ROM 902, and the RAM 903 are connected to each other via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0135] Typically, the following devices may be connected to the I / O interface 905: an input device 906 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 907 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 908 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 909. The communication device 909 may allow the electronic device 900 to communicate with other devices wirelessly or by wire to exchange data. Although FIG9 shows an electronic device 900 with various devices, it should be understood that it is not required to implement or have all of the devices shown. More or fewer devices may be implemented or have alternatively.

[0136] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network via the communication device 909, or installed from the storage device 908, or installed from the ROM 902. When the computer program is executed by the processing device 901, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

[0137] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0138] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0139] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device executes the method shown in the above embodiment.

[0140] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet Service Provider).

[0141] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0142] The units involved in the embodiments described in this disclosure may be implemented in software or hardware. In some cases, the name of a unit does not limit the unit itself. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses."

[0143] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0144] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0145] In a first aspect, according to one or more embodiments of the present disclosure, a method for collecting eye tracking data is provided, comprising:

[0146] Displaying a preset eye tracking data collection page, wherein the eye tracking data collection page includes a content display area and a preset direction determination control;

[0147] In response to an eye tracking data collection operation triggered by a user, a preset gaze area is displayed at a random position within the content display area, and indication information of a random direction is displayed at a random time frame during the display of the gaze area;

[0148] Acquiring at least one piece of feedback information input by a user through a direction determination control, wherein the feedback information is direction information generated by the user based on the direction indication information;

[0149] When the feedback information meets the preset collection conditions, the user's eye tracking data is collected.

[0150] According to one or more embodiments of the present disclosure, when the feedback information meets the preset collection conditions, the user's eye tracking data is collected, including:

[0151] If the feedback information matches the indication information of the random direction, the user's eye tracking data is collected.

[0152] According to one or more embodiments of the present disclosure, after displaying a preset gaze area at a random position within the content display area, the method further includes:

[0153] During a first random time frame of the gaze area display process, first indication information of a random direction is displayed in the gaze area;

[0154] Obtaining first feedback information input by the user in response to the first instruction information;

[0155] If the first feedback information matches the first indication information, displaying the second indication information in the gaze area within a second random time frame;

[0156] If the first feedback information does not match the first indication information, switching to display the next gaze area;

[0157] The second random time frame is later than the first random time frame.

[0158] According to one or more embodiments of the present disclosure, after displaying the second indication information in the gaze area within the second random time frame, the method further includes:

[0159] Obtaining second feedback information input by the user in response to the second indication information;

[0160] If the second feedback information matches the second indication information, a prompt message is displayed in the content display area, and the user's eye tracking data is collected. The prompt message is used to remind the user that the feedback information currently input matches the indication information;

[0161] If the second feedback information does not match the second indication information, the display switches to the next gaze area.

[0162] According to one or more embodiments of the present disclosure, the number of random time frames is at least two; after collecting the user's eye tracking data based on the feedback information, the method further includes:

[0163] Obtain at least two eye images when the user inputs feedback information;

[0164] An operation of identifying validity of the eye tracking data is performed based on at least two eye images.

[0165] According to one or more embodiments of the present disclosure, the operation of identifying the validity of eye tracking data based on at least two eye images includes:

[0166] determining a similarity between at least two eye images;

[0167] If the similarity exceeds a preset similarity threshold, the eye tracking data is determined to be valid;

[0168] If the similarity is lower than a preset similarity threshold, the eye tracking data is determined to be invalid.

[0169] According to one or more embodiments of the present disclosure, the gaze area is displayed according to a first size; after the preset gaze area is displayed at a random position within the content display area, the method further includes:

[0170] Controlling the gaze area to switch a display size from a first size to a preset second size within a preset time interval;

[0171] The first size is greater than the second size.

[0172] According to one or more embodiments of the present disclosure, after displaying a preset gaze area at a random position within the content display area, the method further includes:

[0173] Displaying a preset pattern in the gaze area, wherein the preset pattern is displayed in a rotating manner in the gaze area according to preset display parameters;

[0174] And / or, after displaying a preset gaze area at a random position within the content display area, the method further includes:

[0175] The display background within the gaze area is switched based on at least two preset display backgrounds at preset time intervals.

[0176] According to one or more embodiments of the present disclosure, collecting user eye tracking data includes:

[0177] Obtain eye images when the user inputs feedback information;

[0178] The eye image is annotated based on the displayed position of the gaze area to obtain eye tracking data.

[0179] In a second aspect, according to one or more embodiments of the present disclosure, an eye tracking data acquisition device is provided, comprising:

[0180] A display module is configured to display a preset eye tracking data collection page, wherein the eye tracking data collection page includes a content display area and a preset direction determination control;

[0181] a processing module configured to, in response to an eye tracking data collection operation triggered by a user, display a preset gaze area at a random position within the content display area, and display indication information of a random direction at a random time frame during the display of the gaze area;

[0182] an acquisition module configured to acquire at least one feedback information input by a user through a direction determination control, wherein the feedback information is direction information generated by the user based on the direction indication information;

[0183] The collection module is configured to collect the user's eye tracking data when the feedback information meets the preset collection conditions.

[0184] According to one or more embodiments of the present disclosure, the acquisition module is configured to:

[0185] If the feedback information matches the indication information of the random direction, the user's eye tracking data is collected.

[0186] According to one or more embodiments of the present disclosure, the eye tracking data collection device further includes:

[0187] A display module is configured to display first indication information of a random direction in the gaze area during a first random time frame of the gaze area display process;

[0188] An acquisition module is configured to acquire first feedback information input by a user in response to the first indication information;

[0189] a display module configured to display second indication information in the gaze area within a second random time frame if the first feedback information matches the first indication information;

[0190] a switching module, configured to switch to displaying a next gaze area if the first feedback information does not match the first indication information;

[0191] The second random time frame is later than the first random time frame.

[0192] According to one or more embodiments of the present disclosure, the eye tracking data collection device further includes:

[0193] an acquisition module configured to acquire second feedback information input by the user in response to the second indication information;

[0194] a collection module configured to display a prompt message in the content display area and collect the user's eye tracking data if the second feedback information matches the second indication information, wherein the prompt message is used to prompt the user that the feedback information currently input matches the indication information;

[0195] The switching module is configured to switch to displaying the next gaze area if the second feedback information does not match the second indication information.

[0196] According to one or more embodiments of the present disclosure, the number of random time frames is at least two; and the eye tracking data acquisition device further includes:

[0197] an acquisition module, configured to acquire at least two eye images when the user inputs feedback information;

[0198] The recognition module is configured to perform a recognition operation on the validity of the eye tracking data based on at least two eye images.

[0199] According to one or more embodiments of the present disclosure, the identification module is configured to:

[0200] determining a similarity between at least two eye images;

[0201] If the similarity exceeds a preset similarity threshold, the eye tracking data is determined to be valid;

[0202] If the similarity is lower than a preset similarity threshold, the eye tracking data is determined to be invalid.

[0203] According to one or more embodiments of the present disclosure, the gaze area is displayed according to a first size; and the eye tracking data collection device further includes:

[0204] A control module configured to control the gaze area to switch the display size from a first size to a preset second size within a preset time interval;

[0205] The first size is greater than the second size.

[0206] According to one or more embodiments of the present disclosure, the eye tracking data acquisition device further includes: a switching module configured to display a preset pattern in the gaze area, wherein the preset pattern is displayed in a rotation manner in the gaze area according to preset display parameters; and / or, the eye tracking data acquisition device further includes: a switching module configured to switch the display background in the gaze area according to a preset time interval based on at least two preset display backgrounds.

[0207] According to one or more embodiments of the present disclosure, the acquisition module is configured to:

[0208] Obtain eye images when the user inputs feedback information;

[0209] The eye image is annotated based on the displayed position of the gaze area to obtain eye tracking data.

[0210] In a third aspect, according to one or more embodiments of the present disclosure, there is provided an electronic device, comprising: at least one processor and a memory;

[0211] Memory stores computer-executable instructions;

[0212] At least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the eye tracking data collection method as described in the first aspect and various possible designs of the first aspect.

[0213] In a fourth aspect, according to one or more embodiments of the present disclosure, a computer-readable storage medium is provided, in which computer-executable instructions are stored. When a processor executes the computer-executable instructions, the eye tracking data collection method as described in the first aspect and various possible designs of the first aspect are implemented.

[0214] In a fifth aspect, according to one or more embodiments of the present disclosure, a computer program product is provided, including a computer program, which, when executed by a processor, implements the eye tracking data collection method as described in the first aspect and various possible designs of the first aspect.

[0215] The above description is merely a preferred embodiment of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above-mentioned technical features, but also includes other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned disclosed concepts. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in this disclosure.

[0216] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details have been included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0217] Although the subject matter has been described in language specific to structural features and / or methodological logical acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

1. An eye movement tracking data acquisition method, comprising: Displaying a preset eye movement tracking data acquisition page, wherein the eye movement tracking data acquisition page includes a content display area and a preset direction determination control; In response to an eye movement tracking data acquisition operation triggered by a user, displaying a preset fixation area at a random position within the content display area, and displaying indication information in a random direction at a random time frame during the display process of the fixation area; Obtaining at least one feedback information input by the user through the direction determination control, wherein the feedback information is direction information generated by the user based on the direction indication information; When the feedback information meets a preset acquisition condition, performing an acquisition operation on the user's eye movement tracking data.

2. The method according to claim 1, wherein The performing an acquisition operation on the user's eye movement tracking data when the feedback information meets a preset acquisition condition includes: If the feedback information matches the indication information in the random direction, performing an acquisition operation on the user's eye movement tracking data.

3. The method according to claim 1, wherein After displaying the preset fixation area at a random position within the content display area, further comprising: At a first random time frame during the display process of the fixation area, displaying first indication information in a random direction within the fixation area; Obtaining first feedback information input by the user for the first indication information; If the first feedback information matches the first indication information, then within a second random time frame, displaying second indication information within the fixation area; If the first feedback information does not match the first indication information, then switching to display the next fixation area; wherein the second random time frame is later than the first random time frame.

4. The method according to claim 3, wherein After displaying the second indication information within the fixation area within the second random time frame, further comprising: Obtaining second feedback information input by the user for the second indication information; If the second feedback information matches the second indication information, then displaying a prompt information within the content display area and performing an acquisition operation on the user's eye movement tracking data, the prompt information being used to prompt the user that the currently input feedback information matches the indication information; If the second feedback information does not match the second indication information, then switching to display the next fixation area.

5. The method according to claim 1, wherein The number of the random time frames is at least two; after performing the acquisition operation on the user's eye movement tracking data based on the feedback information, further comprising: Obtaining at least two eye images when the user inputs the feedback information; Performing an identification operation on the validity of the eye movement tracking data based on the at least two eye images.

6. The method according to claim 5, wherein, The performing an identification operation on the validity of the eye movement tracking data based on the at least two eye images includes: Determining the similarity between the at least two eye images; If the similarity exceeds a preset similarity threshold, determining that the eye movement tracking data is valid; If the similarity is lower than the preset similarity threshold, determining that the eye movement tracking data is invalid.

7. The method according to any one of claims 1-6, wherein The fixation area is displayed according to a first size; After displaying a preset fixation area at a random position within the content display area, the following steps are further included: Controlling the display size of the fixation area to be switched from a first size to a preset second size within a preset time interval; Wherein, the first size is larger than the second size.

8. The method according to any one of claims 1-6, wherein, After displaying a preset fixation area at a random position within the content display area, the following steps are further included: Displaying a preset pattern within the fixation area, wherein the preset pattern is rotated and displayed within the fixation area according to preset display parameters; And / or, after displaying a preset fixation area at a random position within the content display area, the following steps are further included: Performing a switching operation on the display background within the fixation area according to at least two preset display backgrounds at a preset time interval.

9. The method according to any one of claims 1-6, wherein, The operation of collecting the user's eye movement tracking data includes: Obtaining an eye image of the user when the user inputs the feedback information; Performing an annotation operation on the eye image based on the display position of the fixation area to obtain the eye movement tracking data.

10. An eye movement tracking data collection device, comprising: A display module configured to display a preset eye movement tracking data collection page, wherein the eye movement tracking data collection page includes a content display area and a preset direction determination control; A processing module configured to, in response to an eye movement tracking data collection operation triggered by a user, display a preset fixation area at a random position within the content display area, and display indication information in a random direction at a random time frame during the display process of the fixation area; An acquisition module configured to acquire at least one feedback information input by the user through the direction determination control, wherein the feedback information is direction information generated by the user based on the direction indication information; and A collection module configured to perform an operation of collecting the user's eye movement tracking data when the feedback information meets a preset collection condition.

11. An electronic device, comprising: A processor and a memory; Wherein, the memory stores computer execution instructions; The processor executes the computer execution instructions stored in the memory, so that the processor executes the eye movement tracking data collection method according to any one of claims 1 to 9.

12. A computer-readable storage medium, wherein, Computer execution instructions are stored in the computer-readable storage medium, and when the processor executes the computer execution instructions, the eye movement tracking data collection method according to any one of claims 1 to 9 is implemented.

13. A computer program product comprising a computer program, wherein, When the computer program is executed by the processor, the method for collecting eye movement tracking data according to any one of claims 1 to 9 is implemented.

Images