Eye movement training method, head-mounted display device and storage medium

Abstract

The embodiment of the invention provides an eye movement training method and device and a storage medium, and belongs to the field of eye movement tracking. The method comprises the following steps: displaying a target guide path for eye movement training, wherein the target guide path is used for guiding a wearer of the head-mounted display equipment to perform eye movement training according to the target guide path; according to the eyeball fixation point of the wearer, a guide identifier is displayed on the target guide path, and the guide identifier is used for indicating the target movement direction of the eyeballs; and under the condition of determining that the eyeball fixation point moves along the target movement direction, controlling the guide identifier to move along the target guide path according to the target movement direction, so that the distance between the guide identifier and the eyeball fixation point is kept as a target distance. According to the technical scheme, the user can be accurately guided to carry out eye movement training, the effect and convenience of eye movement training are improved, the effectiveness of eye movement training is guaranteed, and the user experience is good.

Description

Technical Field

[0001] This invention relates to the field of eye-tracking technology, and more particularly to an eye-tracking training method, a head-mounted display device, and a storage medium. Background Technology

[0002] With the widespread use of electronic devices such as smartphones, tablets, and smartwatches, the barrier to entry for using these devices is low, making them accessible to both adults and children. However, prolonged use of electronic devices can easily lead to decreased vision. Currently, some head-mounted displays have the function of guiding users in eye-tracking training, but they generally use methods such as slideshow animations for guidance, making it difficult for users to effectively conduct eye-tracking training and resulting in a poor user experience. Summary of the Invention

[0003] This invention provides an eye-tracking training method, a head-mounted display device, and a storage medium, aiming to accurately guide users in eye-tracking training and improve the effectiveness of eye-tracking training.

[0004] In a first aspect, embodiments of the present invention provide an eye-tracking training method, comprising:

[0005] The target guidance path for eye-tracking training is displayed, which is used to guide the wearer of the head-mounted display device to perform eye-tracking training according to the target guidance path;

[0006] Based on the wearer's eye gaze point, a guide mark is displayed on the target guidance path, the guide mark being used to indicate the target movement direction of the eye;

[0007] When it is determined that the eye gaze point moves along the target movement direction, the guide icon is controlled to move along the target guidance path in the target movement direction so that the distance between the guide icon and the eye gaze point is maintained at the target distance.

[0008] In a second aspect, embodiments of the present invention also provide a head-mounted display device, the head-mounted display device including a display device, a processor, a memory, a computer program stored in the memory and executable by the processor, and a data bus for realizing communication between the display device, the processor and the memory, wherein when the computer program is executed by the processor, it implements the eye-tracking training method as described in the first aspect.

[0009] Thirdly, embodiments of the present invention also provide a storage medium for computer-readable storage, wherein the storage medium stores one or more programs that can be executed by one or more processors to implement the eye-tracking training method as described in the first aspect.

[0010] This invention provides an eye-tracking training method, a head-mounted display device, and a storage medium. The method involves displaying a target guidance path for eye-tracking training to guide the wearer of the head-mounted display device to perform eye-tracking training along this path. Then, based on the wearer's eye fixation point, a guide marker is displayed on the target guidance path to indicate the target direction of eye movement, guiding the wearer to rotate their eyes along this direction. Furthermore, when the wearer's eye fixation point is determined to be moving along the target direction, the guide marker is controlled to move along the target guidance path in the same direction, maintaining the distance between the guide marker and the eye fixation point at the target distance. This achieves the effect of the eye fixation point chasing the guide marker, accurately guiding the user during eye-tracking training, improving the effectiveness and convenience of eye-tracking training, ensuring its effectiveness, and providing a good user experience. Attached Figure Description

[0011] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0012] Figure 1 This is a schematic block diagram of the structure of a head-mounted display device provided in an embodiment of the present invention;

[0013] Figure 2 This is a schematic diagram of the steps of an eye-tracking training method provided in an embodiment of the present invention;

[0014] Figure 3 This is an example diagram of the target guidance path and guidance identifier in an embodiment of the present invention;

[0015] Figure 4 This is another example diagram of the target guidance path and guidance identifier in an embodiment of the present invention;

[0016] Figure 5 This is another example diagram of the target guidance path and guidance identifier in an embodiment of the present invention;

[0017] Figure 6 This is another example diagram of the target guidance path and guidance identifier in an embodiment of the present invention;

[0018] Figure 7 This is another example diagram of the target guidance path and guidance identifier in an embodiment of the present invention;

[0019] Figure 8 This is another example diagram of the target guidance path and guidance identifier in an embodiment of the present invention;

[0020] Figure 9 This is another example diagram of the target guidance path and guidance identifier in an embodiment of the present invention;

[0021] Figure 10 This is a schematic diagram of the steps of another eye-tracking training method provided in an embodiment of the present invention. Detailed Implementation

[0022] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0023] The flowchart shown in the attached diagram is for illustrative purposes only and does not necessarily include all content and operations / steps, nor does it necessarily have to be performed in the order described. For example, some operations / steps can be broken down, combined, or partially merged, so the actual execution order may change depending on the actual situation.

[0024] It should be understood that the terminology used in this specification is for the purpose of describing particular embodiments only and is not intended to limit the invention. As used in this specification and the appended claims, the singular forms “a,” “an,” and “the” are intended to include the plural forms unless the context clearly indicates otherwise.

[0025] With the widespread use of electronic devices such as smartphones, tablets, and smartwatches, the barrier to entry for using these devices is low, making them accessible to both adults and children. However, prolonged use of electronic devices can easily lead to decreased vision. Currently, some head-mounted displays have the function of guiding users in eye-tracking training, but they generally use methods such as slideshow animations for guidance, making it difficult for users to effectively conduct eye-tracking training and resulting in a poor user experience.

[0026] To address the aforementioned problems, embodiments of the present invention provide an eye-tracking training method, a head-mounted display device, and a storage medium. This eye-tracking training method displays a target guidance path for eye-tracking training to guide the wearer of the head-mounted display device to perform eye-tracking training along this path. Then, based on the wearer's eye fixation point, a guide marker is displayed on the target guidance path to indicate the target direction of eye movement, guiding the wearer to rotate their eyes along this direction. Furthermore, when it is determined that the wearer's eye fixation point is moving along the target direction, the guide marker is controlled to move along the target guidance path in the same direction, ensuring that the distance between the guide marker and the eye fixation point remains at the target distance. This achieves the effect of the eye fixation point chasing the guide marker, thereby accurately guiding the user during eye-tracking training, improving the effectiveness and convenience of eye-tracking training, ensuring its effectiveness, and providing a good user experience.

[0027] The following detailed description of some embodiments of the present invention is provided in conjunction with the accompanying drawings. Unless otherwise specified, the following embodiments and features can be combined with each other.

[0028] Please see Figure 1 , Figure 1 This is a schematic block diagram of the structure of a head-mounted display device provided in an embodiment of the present invention.

[0029] like Figure 1 As shown, the head-mounted display device 100 includes a processor 101, a memory 102, and a display device 103. The processor 101, memory 102, and display device 103 are connected via a bus 104, such as an I2C (Inter-integrated Circuit) bus. The head-mounted display device 100 may include devices such as augmented reality (AR) glasses, virtual reality (VR) glasses, mixed reality (MR) glasses, AR helmets, VR helmets, and MR helmets.

[0030] Specifically, processor 101 provides computing and control capabilities to support the operation of the entire head-mounted display device. Processor 101 can be a Central Processing Unit (CPU), but it can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor.

[0031] Specifically, the memory 102 can be a Flash chip, a read-only memory (ROM) disk, an optical disk, a USB flash drive, or a portable hard drive, etc.

[0032] Those skilled in the art will understand that Figure 1 The structures shown are merely block diagrams of some structures related to the embodiments of the present invention, and do not constitute a limitation on the head-mounted display devices on which the embodiments of the present invention are applied. Specific head-mounted display devices may include more or fewer components than those shown in the figures, or combine certain components, or have different component arrangements.

[0033] The processor 101 is used to run a computer program stored in the memory 102, and implements any of the eye-tracking training methods provided in the embodiments of the present invention when executing the computer program.

[0034] In one embodiment, the processor 101 is configured to run a computer program stored in a memory, and when executing the computer program, perform the following steps:

[0035] The target guidance path for eye-tracking training is displayed by the display device 103, and the target guidance path is used to guide the wearer of the head-mounted display device to perform eye-tracking training according to the target guidance path.

[0036] Based on the wearer's eye gaze point, a guide mark is displayed on the target guidance path, the guide mark being used to indicate the target movement direction of the eye;

[0037] When it is determined that the eye gaze point moves along the target movement direction, the guide icon is controlled to move along the target guidance path in the target movement direction so that the distance between the guide icon and the eye gaze point is maintained at the target distance.

[0038] In one embodiment, when the processor 101 displays a guide marker on the target guide path based on the wearer's eye gaze point, it is configured to:

[0039] The path point on the target guidance path that is closest to the eye fixation point is determined as the starting point of eye movement training;

[0040] A guidance marker is displayed at the starting point of the eye-tracking training along the target guidance path.

[0041] In one embodiment, the target guidance path includes multiple guidance path segments, and the processor 101, when displaying guidance markers on the target guidance path based on the wearer's eye gaze point, is configured to:

[0042] The guide path segment closest to the wearer's eye gaze point is identified as the target guide path segment;

[0043] Any path point in the target guidance path segment is determined as the starting point of eye movement training, or the path point in the target guidance path segment that is closest to the eye fixation point is determined as the starting point of eye movement training.

[0044] A guidance marker is displayed at the starting point of the eye-tracking training along the target guidance path.

[0045] In one embodiment, when the processor 101 displays a guidance marker at the eye-tracking training starting point on the target guidance path, it is configured to:

[0046] The wearer's visual acuity is obtained, and the target size of the guide sign is determined based on the visual acuity.

[0047] A guide marker indicating the target size is displayed at the starting point of the eye-tracking training along the target guidance path.

[0048] In one embodiment, after controlling the guide icon to move along the target guide path in the target motion direction, the processor 101 is further configured to:

[0049] During the movement of the guide sign along the target guide path, it is determined whether the eye gaze point changes from a moving state to a stationary state;

[0050] When the eye's gaze point changes from a moving state to a stationary state, the guide marker is controlled to remain stationary on the target guide path.

[0051] In one embodiment, after the processor 101 controls the guide identifier to remain stationary on the target guide path, it is further configured to:

[0052] If the duration of the eye's gaze remaining stationary exceeds a preset time threshold, the guiding icon is hidden.

[0053] In one embodiment, after controlling the guide icon to move along the target guide path in the target motion direction, the processor 101 is further configured to:

[0054] When the eye-tracking training reaches the preset termination condition, the actual movement trajectory of the wearer's eye gaze point is obtained;

[0055] Based on the actual movement trajectory and the target guidance path, the wearer's eye-tracking training evaluation score is determined and displayed.

[0056] In one embodiment, the target guidance path includes multiple guidance path segments of equal length. When the processor 101 determines the wearer's eye-tracking training evaluation score based on the actual motion trajectory and the target guidance path, it is configured to:

[0057] Based on the actual motion trajectory, determine the number of guide path segments that the eye fixation point completely traverses;

[0058] The wearer's eye movement training evaluation score is obtained by multiplying the number of guided path segments that the eye fixation point completely traverses by a preset score.

[0059] It should be noted that those skilled in the art will understand that, for the sake of convenience and brevity, the specific working process of the head-mounted display device described above can be referred to the corresponding process in the following eye-tracking training method embodiments, and will not be repeated here.

[0060] The following will combine Figure 1 The head-mounted display device described in the present invention provides a detailed explanation of the eye-tracking training method according to embodiments of the invention. It should be noted that... Figure 1 The head-mounted display device mentioned is only used to explain the eye-tracking training method provided in the embodiments of the present invention, but does not constitute a limitation on the application scenarios of the eye-tracking training method provided in the embodiments of the present invention.

[0061] Please see Figure 2 , Figure 2 This is a schematic diagram of the steps of an eye-tracking training method provided in an embodiment of the present invention.

[0062] like Figure 2 As shown, the eye-tracking training method includes steps S101 to S103.

[0063] Step S101: Display the target guidance path for eye-tracking training. The target guidance path is used to guide the wearer of the head-mounted display device to perform eye-tracking training according to the target guidance path.

[0064] In this embodiment, the target guidance path can be any guidance path selected by the wearer of the head-mounted display device from multiple guidance paths, and the multiple guidance paths are of different types. For example, the multiple guidance paths include a first guidance path, a second guidance path, a third guidance path, and a fourth guidance path. The first guidance path is a circular or elliptical guidance path, the second guidance path is a rectangular guidance path, the third guidance path is a straight guidance path, and the fourth guidance path is a Z-shaped guidance path.

[0065] In some embodiments, the target guidance path includes at least one of the following: a circular guidance path, an elliptical guidance path, a rectangular guidance path, a straight guidance path, a cross-shaped guidance path, and a Z-shaped guidance path. The circular, elliptical, and rectangular guidance paths are used to guide the wearer in eye rotation training; the straight guidance path is used to guide the wearer in eye movement training in a preset direction, such as guiding the wearer to move the eye upwards, downwards, leftwards, or rightwards; the cross-shaped guidance path is used to guide the wearer in eye movement training in upwards, downwards, leftwards, and rightwards; and the Z-shaped guidance path is used to guide the wearer in Z-shaped eye movement training.

[0066] In some embodiments, the geometric center of the target guide path is the same as the center of the display screen of the head-mounted display device, and the size of the target guide path is related to the length of the short side of the display screen of the head-mounted display device. Further, the center of the circular guide path, elliptical guide path, rectangular guide path, straight guide path, cross-shaped guide path, or Z-shaped guide path is the center of the display screen of the head-mounted display device, and the diameter of the circular guide path is less than or equal to the length of the short side of the display screen of the head-mounted display device; the minor axis length of the elliptical guide path is less than or equal to the length of the short side of the display screen of the head-mounted display device; the side length of the short side of the rectangular guide path is less than or equal to the length of the short side of the display screen of the head-mounted display device; the length of the straight guide path is less than or equal to the length of the short side of the display screen of the head-mounted display device; the cross-shaped guide path includes two intersecting guide paths, each with a length less than or equal to the length of the short side of the display screen of the head-mounted display device; and the diameter of the circumcircle of the Z-shaped guide path is less than or equal to the length of the short side of the display screen of the head-mounted display device.

[0067] In some embodiments, the width (thickness) of the displayed target guidance path is related to the visual acuity of the wearer of the head-mounted display device. Specifically, displaying the target guidance path for eye-tracking training may include: acquiring the visual acuity of the wearer of the head-mounted display device; determining the target width of the target guidance path based on the wearer's visual acuity; and displaying the target guidance path for eye-tracking training according to the target width. The wearer's visual acuity can be configured in advance by the wearer based on actual conditions and can be directly used when eye-tracking training is needed. This embodiment displays the target guidance path with a width matching the wearer's visual acuity, ensuring the clarity of the displayed target guidance path in the wearer's eyes and facilitating eye-tracking training.

[0068] In some embodiments, determining the target width of the target guidance path based on the wearer's visual acuity may include: determining a preset visual acuity range within which the wearer's visual acuity falls; querying a table showing the relationship between path width and visual acuity range, and determining the width corresponding to the preset visual acuity range as the target width of the target guidance path. The table showing the relationship between path width and visual acuity range includes the matching relationship between each preset visual acuity range and the path width, and this table can be preset based on actual conditions. This embodiment allows for quick lookup of the path width matching the wearer's visual acuity using a preset path width table, improving processing speed.

[0069] In some embodiments, the head-mounted display device may support eye-tracking training for only one wearer or for different wearers. Specifically, obtaining the visual acuity of the wearer of the head-mounted display device may include: obtaining the wearer's iris information and / or fingerprint information; and determining the visual acuity corresponding to the wearer's iris information and / or fingerprint information as the wearer's visual acuity. An eye acuity chart may be pre-stored or configured, storing the iris information and / or fingerprint information of different users and their corresponding visual acuity. During eye-tracking training, the wearer's iris information and / or fingerprint information can be obtained in real time, and then the eye acuity chart can be queried to obtain the wearer's visual acuity.

[0070] Step S102: Based on the wearer's eye gaze point, display guidance marks on the target guidance path. The guidance marks are used to indicate the target movement direction of the eyeball.

[0071] In this embodiment, the wearer's gaze point can be detected by an eye-tracking sensor in the head-mounted display device. The display style of the guidance markers can be set based on actual conditions, or a default display style and distance can be used. This embodiment of the invention does not specifically limit this. For example, Figure 3As shown, the display screen 11 shows a circular target guidance path 12, and a guidance mark 13 is displayed on the target guidance path 12. The guidance mark 13 is displayed in a triangular pattern, and at this time, the guidance mark 13 indicates that the direction of eye movement is counterclockwise from the target guidance path 12. For example, as... Figure 4 As shown, the display style of the guide mark 13 is a combination of a circle and an arrow. At this time, the guide mark 13 indicates that the target movement direction of the eyeball is clockwise along the target guidance path 12.

[0072] In some embodiments, the target guidance path includes multiple guidance path segments. Displaying guidance markers on the target guidance path based on the wearer's eye fixation point may include: determining the path point on the target guidance path closest to the eye fixation point as the eye-tracking training starting point; and displaying a guidance marker at the eye-tracking training starting point on the target guidance path. Alternatively, the guidance path segment closest to the wearer's eye fixation point may be determined as the target guidance path segment; any path point within the target guidance path segment may be determined as the eye-tracking training starting point, or the path point within the target guidance path segment closest to the eye fixation point may be determined as the eye-tracking training starting point; and a guidance marker may be displayed at the eye-tracking training starting point on the target guidance path. This embodiment can accurately determine the eye-tracking training starting point on the target guidance path based on the wearer's eye fixation point and display a guidance marker at the eye-tracking training starting point, effectively and accurately guiding the wearer to perform eye-tracking training.

[0073] For example, such as Figure 5 As shown, the circular target guidance path 12 includes a first guidance path segment 121, a second guidance path segment 122, a third guidance path segment 123, a fourth guidance path segment 124, a fifth guidance path segment 125, a sixth guidance path segment 126, a seventh guidance path segment 127, and an eighth guidance path segment 128, totaling eight guidance path segments. These eight guidance path segments are arc-shaped, and each guidance path segment has an equal arc length. Since the second guidance path segment 122 is closest to the wearer's eye fixation point, any path point in the second guidance path segment 122 can be determined as the starting point for eye movement training, or the path point in the second guidance path segment 122 that is closest to the eye fixation point can be determined as the starting point for eye movement training. A guidance mark 13 is displayed at the starting point for eye movement training on the target guidance path 12.

[0074] In some embodiments, the size of the guide marker is related to the wearer's visual acuity. Specifically, displaying the guide marker at the starting point of eye-tracking training on the target guide path includes: obtaining the wearer's visual acuity and determining the target size of the guide marker based on the visual acuity; and displaying the guide marker of the target size at the starting point of eye-tracking training on the target guide path. This may involve obtaining the wearer's iris information and / or fingerprint information, and determining the visual acuity corresponding to the iris information and / or fingerprint information as the wearer's visual acuity.

[0075] In some embodiments, determining the target size of the guide sign based on visual acuity may include: determining a preset visual acuity range within which the wearer's visual acuity falls; querying a table relating visual acuity to display size, and determining the width corresponding to the preset visual acuity range as the target width of the target guide path. The table relating visual acuity to display size includes the matching relationship between each of a plurality of preset visual acuity ranges and the display size. This table can be set based on actual conditions, and this embodiment of the invention does not impose specific limitations on it.

[0076] Step S103: When it is determined that the eye gaze point moves along the target movement direction, control the guide sign to move along the target guidance path in the target movement direction so that the distance between the guide sign and the eye gaze point is maintained at the target distance.

[0077] In this embodiment, when the eye fixation point is detected to move along the target movement direction, it can be determined that the wearer has started eye-tracking training. At this time, the guide sign is controlled to move along the target guidance path in the target movement direction so that the distance between the guide sign and the eye fixation point is maintained at the target distance. This achieves the effect of the eye fixation point chasing the guide sign, thereby accurately guiding the user to perform eye-tracking training, improving the effectiveness and convenience of eye-tracking training, ensuring the effectiveness of eye-tracking training, and providing a good user experience.

[0078] The target distance can be set by the user before eye-tracking training. If the user does not set a target distance before eye-tracking training, a default distance can be used as the target distance. This embodiment of the invention does not specifically limit this. For example, the target distance can be 1cm or 2cm. Figure 6 As shown, when it is detected that the eye gaze point 14 moves clockwise along the target guidance path 12, the guide sign 13 is controlled to move clockwise along the target guidance path 12, so that the distance between the eye gaze point 14 and the guide sign 13 (the length of the arc segment between the eye gaze point 14 and the guide sign 13) remains at the target distance.

[0079] In some embodiments, during the movement of the guide icon along the target guide path, it is determined whether the eye fixation point changes from a moving state to a stationary state; if the eye fixation point changes from a moving state to a stationary state, the guide icon is controlled to remain stationary on the target guide path. Furthermore, if the time the eye fixation point remains stationary exceeds a preset time threshold, the guide icon is hidden, i.e., not displayed. The preset time threshold can be set by the user based on actual conditions, or a default value can be used; this embodiment does not specifically limit this. This embodiment, by adaptively displaying or hiding the guide icon based on whether the eye fixation point is in a moving or stationary state during eye-tracking training, can reduce power consumption, extend the usage time of the head-mounted display device, and thus improve the battery life of the head-mounted display device.

[0080] In some embodiments, when the eye gaze point switches from a static state to a moving state, the guide marker is redisplayed on the target guide path according to the wearer's eye gaze point, and the guide marker continues to move along the target guide path in the target motion direction. For example, as Figure 7 As shown, the guide marker 13 remains stationary on the target guide path 12, as... Figure 8 As shown, if the duration of the eye's gaze remaining stationary exceeds a preset time threshold, the guide icon 13 is hidden. After a period of time, as... Figure 9 As shown, the eye gaze point switches from a static state to a moving state. At this time, based on the wearer's eye gaze point, the guide mark 13 is re-displayed on the target guide path 12, and the guide mark 13 continues to move along the target guide path 12.

[0081] In some embodiments, such as Figure 10 As shown, after step S103, the eye-tracking training method further includes:

[0082] Step S104: After determining that the eye-tracking training has reached the preset end condition, obtain the actual movement trajectory of the wearer's eye gaze point.

[0083] In this embodiment, the preset termination condition can be set by the user or a default eye-tracking training termination condition can be used; this embodiment of the invention does not impose specific limitations on this. For example, the preset termination condition includes the wearer's eye-tracking training duration reaching a preset duration threshold and / or the wearer's eye fixation point completely traversing the target guidance path a preset number of times thresholds are reached.

[0084] In some embodiments, after step S103, the eye-tracking training method further includes: obtaining the duration of the wearer's eye-tracking training and / or the number of times the wearer's eye gaze point completely traverses the target guidance path; determining that the eye-tracking training has reached a preset end condition when the duration of the eye-tracking training reaches a preset duration threshold and / or the number of times the wearer's eye gaze point completely traverses the target guidance path reaches a preset number threshold; and determining that the eye-tracking training has not reached the preset end condition when the duration of the eye-tracking training has not reached the preset duration threshold and / or the number of times the wearer's eye gaze point completely traverses the target guidance path has not reached the preset number threshold.

[0085] Step S105: Determine the wearer's eye-tracking training evaluation score based on the actual motion trajectory and target guidance path, and display the eye-tracking training evaluation score.

[0086] In this embodiment, the eye-tracking training evaluation score is used to assess the wearer's completion rate of the current eye-tracking training session. A higher score indicates a higher completion rate and better training effect, while a lower score indicates a lower completion rate and worse training effect. This embodiment provides a better user experience by promptly outputting the eye-tracking training evaluation score after the training session, allowing the user to immediately know their completion level.

[0087] In some embodiments, the target guidance path includes multiple guidance path segments of equal length. Determining the wearer's eye-tracking training evaluation score based on the actual motion trajectory and the target guidance path may include: determining the number of guidance path segments completely traversed by the eye fixation point based on the actual motion trajectory; multiplying the number of guidance path segments completely traversed by the eye fixation point by a preset score to obtain the wearer's eye-tracking training evaluation score. The preset score can be set by the user or a default value can be used; this embodiment of the invention does not specifically limit this. This embodiment determines the number of guidance path segments completely traversed by the eye fixation point and the corresponding score through the actual motion trajectory, which can accurately determine the wearer's eye-tracking training evaluation score.

[0088] For example, the actual movement trajectory of the eye's fixation point is determined by... Figure 5 The target guidance path 12 is formed by the overlap of three complete target guidance paths 12. Each target guidance path 12 includes eight guidance path segments of equal length. Therefore, the number of guidance path segments completely traversed by the eye fixation point is 24. Assuming a preset score of 5, the wearer's eye movement training evaluation score is 24 * 5 = 120 points. For example, the actual movement trajectory of the eye fixation point is... Figure 5The two complete target guidance paths 12 and half of the target guidance path 12 overlap. Therefore, the number of guidance path segments that the eye fixation point completely passes through is 20. Assuming the preset score is 5 points, the wearer's eye movement training evaluation score is 20*5=100 points.

[0089] This invention also provides an eye-tracking training device, which includes:

[0090] The display module is used to display the target guidance path for eye-tracking training, and the target guidance path is used to guide the wearer of the head-mounted display device to perform eye-tracking training according to the target guidance path.

[0091] The display module is also configured to display a guide mark on the target guidance path according to the wearer's eye gaze point, the guide mark being used to indicate the target movement direction of the eyeball;

[0092] The control module is further configured to, when determining that the eye gaze point is moving along the target movement direction, control the guide icon to move along the target guidance path in the target movement direction, so that the distance between the guide icon and the eye gaze point is maintained at the target distance.

[0093] In some embodiments, the display module is further configured to:

[0094] The path point on the target guidance path that is closest to the eye fixation point is determined as the starting point of eye movement training;

[0095] A guidance marker is displayed at the starting point of the eye-tracking training along the target guidance path.

[0096] In some embodiments, the target boot path includes multiple boot path segments, and the display module is further configured to:

[0097] The guide path segment closest to the wearer's eye gaze point is identified as the target guide path segment;

[0098] Any path point in the target guidance path segment is determined as the starting point of eye movement training, or the path point in the target guidance path segment that is closest to the eye fixation point is determined as the starting point of eye movement training.

[0099] A guidance marker is displayed at the starting point of the eye-tracking training along the target guidance path.

[0100] In some embodiments, the display module is further configured to:

[0101] The wearer's visual acuity is obtained, and the target size of the guide sign is determined based on the visual acuity.

[0102] A guide marker indicating the target size is displayed at the starting point of the eye-tracking training along the target guidance path.

[0103] In some embodiments, the eye-tracking training device further includes:

[0104] The determination module is used to determine whether the eye gaze point changes from a moving state to a stationary state during the movement of the guide icon along the target guide path;

[0105] The control module is also used to control the guide marker to remain stationary on the target guide path when the eye gaze point switches from a moving state to a stationary state.

[0106] In some embodiments, the control module is further configured to hide the guidance identifier if the duration of the eye gaze point remaining stationary exceeds a preset time threshold.

[0107] In some embodiments, the eye-tracking training device further includes:

[0108] The acquisition module is used to acquire the actual movement trajectory of the wearer's eye gaze point when the eye-tracking training reaches the preset end condition.

[0109] The determination module is used to determine the wearer's eye-tracking training evaluation score based on the actual motion trajectory and the target guidance path;

[0110] The display module is also used to display the eye-tracking training evaluation score.

[0111] It should be noted that those skilled in the art will understand that, for the sake of convenience and brevity, the specific working process of the eye-tracking training device described above can be referred to the corresponding process in the aforementioned eye-tracking training method embodiments, and will not be repeated here.

[0112] This invention also provides a storage medium for computer-readable storage, wherein the storage medium stores one or more programs that can be executed by one or more processors to implement any of the eye-tracking training methods provided in the specification of this invention.

[0113] The storage medium can be the internal storage unit of the head-mounted display device described in the foregoing embodiments, such as the hard drive or memory of the head-mounted display device. Alternatively, the storage medium can be an external storage device of the head-mounted display device, such as a plug-in hard drive, Smart Media Card (SMC), Secure Digital (SD) card, or Flash Card equipped on the head-mounted display device.

[0114] It will be understood by those skilled in the art that all or some of the steps, systems, or apparatuses disclosed above, and their functional modules / units, can be implemented as software, firmware, hardware, or suitable combinations thereof. In hardware embodiments, the division between functional modules / units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may be performed collaboratively by several physical components. Some or all physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application-specific integrated circuit. Such software may be distributed on a computer-readable medium, which may include computer storage media (or non-transitory media) and communication media (or transient media). As is known to those skilled in the art, the term computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information (such as computer-readable instructions, data structures, program modules, or other data). Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disc (DVD) or other optical disc storage, magnetic cartridges, magnetic tape, disk storage or other magnetic storage devices, or any other medium that can be used to store desired information and can be accessed by a computer. Furthermore, it is well known to those skilled in the art that communication media typically contain computer-readable instructions, data structures, program modules, or other data in modulated data signals such as carrier waves or other transmission mechanisms, and may include any information delivery medium.

[0115] It should be understood that the term "and / or" as used in this specification and the appended claims refers to any combination and all possible combinations of one or more of the associated listed items, and includes such combinations. It should be noted that, herein, the terms "comprising," "including," or any other variations thereof are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element.

[0116] The sequence numbers of the above embodiments of the present invention are merely for descriptive purposes and do not represent the superiority or inferiority of the embodiments. The above descriptions are only specific embodiments of the present invention, but the scope of protection of the present invention is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in the present invention, and these modifications or substitutions should all be covered within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be determined by the scope of the claims.

Claims

1. An eye-tracking training method, characterized in that, include: The target guidance path for eye-tracking training is displayed, which is used to guide the wearer of the head-mounted display device to perform eye-tracking training according to the target guidance path; Based on the wearer's gaze point, a guide marker is displayed on the target guidance path, the guide marker being used to indicate the target movement direction of the eye; When it is determined that the eye gaze point moves along the target movement direction, the guide icon is controlled to move along the target guidance path in the target movement direction so that the distance between the guide icon and the eye gaze point is maintained at the target distance.

2. The eye-tracking training method according to claim 1, characterized in that, The step of displaying guidance markers on the target guidance path based on the wearer's eye gaze point includes: The path point on the target guidance path that is closest to the eye fixation point is determined as the starting point of eye movement training; A guidance marker is displayed at the starting point of the eye-tracking training along the target guidance path.

3. The eye-tracking training method according to claim 1, characterized in that, The target guidance path includes multiple guidance path segments, and the step of displaying guidance markers on the target guidance path according to the wearer's eye gaze point includes: The guide path segment closest to the wearer's eye gaze point is identified as the target guide path segment; Any path point in the target guidance path segment is determined as the starting point of eye movement training, or the path point in the target guidance path segment that is closest to the eye fixation point is determined as the starting point of eye movement training. A guidance marker is displayed at the starting point of the eye-tracking training along the target guidance path.

4. The eye-tracking training method according to claim 2 or 3, characterized in that, Displaying a guidance marker at the eye-tracking training starting point along the target guidance path includes: The wearer's visual acuity is obtained, and the target size of the guide sign is determined based on the visual acuity. A guide marker indicating the target size is displayed at the starting point of the eye-tracking training along the target guidance path.

5. The eye-tracking training method according to any one of claims 1-3, characterized in that, After controlling the guide icon to move along the target guide path in the target movement direction, the method further includes: During the movement of the guide sign along the target guide path, it is determined whether the eye gaze point changes from a moving state to a stationary state; When the eye's gaze point changes from a moving state to a stationary state, the guide marker is controlled to remain stationary on the target guide path.

6. The eye-tracking training method according to claim 5, characterized in that, The control of the guidance identifier after it has come to a standstill on the target guidance path includes: If the eye remains stationary at the fixation point for a period exceeding a preset time threshold, the guidance marker is hidden.

7. The eye-tracking training method according to any one of claims 1-3, characterized in that, After controlling the guide icon to move along the target guide path in the target movement direction, the method further includes: When the eye-tracking training reaches the preset termination condition, the actual movement trajectory of the wearer's eye gaze point is obtained; Based on the actual movement trajectory and the target guidance path, the wearer's eye-tracking training evaluation score is determined and displayed.

8. The eye-tracking training method according to claim 7, characterized in that, The target guidance path includes multiple guidance path segments of equal length. Determining the wearer's eye-tracking training evaluation score based on the actual motion trajectory and the target guidance path includes: Based on the actual motion trajectory, determine the number of guide path segments that the eye fixation point completely traverses; The wearer's eye movement training evaluation score is obtained by multiplying the number of guided path segments that the eye fixation point completely traverses by a preset score.

9. A head-mounted display device, characterized in that, The head-mounted display device includes a display device, a processor, a memory, a computer program stored in the memory and executable by the processor, and a data bus for enabling communication between the display device, the processor, and the memory, wherein the computer program, when executed by the processor, implements the eye-tracking training method as described in any one of claims 1 to 8.

10. A storage medium for computer-readable storage, characterized in that, The storage medium stores one or more programs, which can be executed by one or more processors to implement the eye-tracking training method according to any one of claims 1 to 8.

Images