Eye tracking test system, eye tracking test method and program

Abstract

To clearly determine a movement direction of a visual target in a visual target tracking inspection.SOLUTION: A visual target tracking inspection system comprises a visual target image capturing unit which captures a visual target image including a visual target used in a visual target tracking inspection of a subject, and a calculation device. The calculation device acquires the visual target image, specifies a two-dimensional region corresponding to the visual target included in the visual target image by using an object recognition algorithm, calculates the position of the visual target on the basis of the specified two-dimensional region, corrects the calculated position of the visual target, calculates a position vector of the visual target on the basis of the corrected position of the visual target, decomposes the calculated position vector of the visual target into a longitudinal direction component and a vertical direction component, and determines whether a movement direction of the visual target included in the visual target image is the movement direction corresponding to any of a first movement, a second movement, a third movement, a fourth movement, a fifth movement, a sixth movement, a seventh movement, and an eighth movement on the basis of the longitudinal direction component and the vertical direction component of the decomposed position vector of the visual target.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an eye-tracking test system, an eye-tracking test method, and a program. [Background technology]

[0002] Conventionally, a nystagmus analysis system comprising VOG (Video-oculography) goggles, an analysis unit, an input unit, an output unit, and a database has been known (see Patent Document 1). In the technology described in Patent Document 1, the VOG goggles include a camera, a microphone, and a head position sensor. The VOG goggles include a hot mirror, a camera lens, and a camera body as the camera. Furthermore, the VOG goggles include a CMOS (Complementary Metal-Oxide Semiconductor) substrate as an imaging IC (Integrated Circuit) and an infrared LED (Light Emitting Diode) as a light source. Incidentally, the technology described in Patent Document 1 can analyze whether or not a subject has nystagmus, but cannot perform an eye-tracking test on the subject.

[0003] Furthermore, video nystagmus measurement devices capable of performing eye tracking tests on subjects have been known (see, for example, the URL below). https: / / www.0c7.co.jp / products / interacoustics /

[0004] However, in the above-mentioned video nystagmus measuring device, a target displayed on a display is used as the target. Therefore, when the video nystagmus measuring device is installed in an ophthalmology examination room, there is a risk that it will take up space in the ophthalmology examination room. Furthermore, since many of the subjects who require eye tracking tests are children with eye movement disorders, there is a risk that the subjects (children) will not be able to track the eye targets when eye targets displayed on a display are used. Furthermore, when a visual target displayed on a display is used, the movement of the visual target is preset, so it is not possible to respond flexibly, for example, by presenting the visual target according to the subject's situation.

[0005] On the other hand, in the conventional technology in which a real target is used instead of a target displayed on a display, a qualitative eye-tracking test can be performed, but a quantitative eye-tracking test cannot be performed. Furthermore, if the process of identifying the position of the target contained in each of the many still images that make up a moving image of an actual target captured during an eye tracking test is performed manually by an examiner (e.g., a medical technician, doctor, etc.), it will take an enormous amount of time to identify the position of the target. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Publication No. 2020-018704 Summary of the Invention [Problem to be solved by the invention]

[0007] Therefore, the inventors disclosed the details of their invention at the 74th Annual Meeting of the Japanese Society of Clinical Ophthalmology, in which they published an abstract of a research presentation entitled "Development of an automatic measuring device for smooth pursuit eye movement by combining SSD (Single Shot MultiBox Detector) and VOG" and the research presentation data, regarding a technology that can identify the position of an eye target contained in each of the many still images that make up a video of an actual eye target captured during an eye tracking test, on the URL for public viewing of the conference on the online viewing system "MICEnavi" at the address below. https: / / www.micenavi.jp / 74ringan / search / detail_session / id:10135 https: / / www.micenavi.jp / 74ringan / search / detail_program / id:425

[0008] In the eye-tracking test, the eye target is moved from a reference position (a position corresponding to the front of the subject) to a first position (a position corresponding to the left front of the subject) which is a position on one side of the reference position in the left-right direction, and then a first movement of the eye target is performed by the examiner from the first position to the reference position.In the eye-tracking test, the eye target is moved from the reference position to a second position (a position corresponding to the right front of the subject) which is a position on the other side of the reference position in the left-right direction, and then a second movement of the eye target is performed by the examiner from the second position to the reference position. In addition, in the eye tracking test, the examiner moves the eye target from the reference position to a third position (a position corresponding to the upper front of the subject), which is a position on one side of the reference position in the vertical direction, and then moves it from the third position to the reference position (third movement of the eye target); moves the eye target from the reference position to a fourth position (a position corresponding to the upper left front of the subject), which is a position on one side of the reference position in the horizontal direction and on one side of the vertical direction, and then moves it from the fourth position to the reference position (fourth movement of the eye target); and moves the eye target from the reference position to a fifth position (a position corresponding to the upper right front of the subject), which is a position on the other side of the reference position in the horizontal direction and on one side of the vertical direction, and then moves it from the fifth position to the reference position (fifth movement of the eye target). Furthermore, in the eye tracking test, the examiner moves the eye target from the reference position to a sixth position (a position corresponding to the lower front of the subject), which is a position on the other side of the reference position in the vertical direction, and then moves it from the sixth position to the reference position (a sixth movement of the eye target); moves the eye target from the reference position to a seventh position (a position corresponding to the lower left front of the subject), which is a position on one side of the reference position in the horizontal direction and on the other side in the vertical direction, and then moves it from the seventh position to the reference position (a seventh movement of the eye target); and moves the eye target from the reference position to an eighth position (a position corresponding to the lower right front of the subject), which is a position on the other side of the reference position in the horizontal direction and on the other side in the vertical direction, and then moves it from the eighth position to the reference position (an eighth movement of the eye target).

[0009] Incidentally, each of the first to eighth movements of the target is manually performed by the examiner. Therefore, it has been found that variations occur between the reference positions of the target at the start of each of the first to eighth movements of the target and the reference positions of the target at the end of each of the first to eighth movements of the target. It has also been found that variations occur between the angle between the direction of the third movement of the target and the direction of the fourth movement of the target, the angle between the direction of the third movement of the target and the direction of the fifth movement of the target, the angle between the direction of the sixth movement of the target and the direction of the seventh movement of the target, and the angle between the direction of the sixth movement of the target and the direction of the eighth movement of the target. In other words, by using SSD, it was found that simply identifying the trajectory of the target's position from an image of the target can make it difficult to determine, for example, whether the target is making a fourth movement, a first movement, or a third movement.

[0010] In view of the above-mentioned problems, an object of the present invention is to provide an eye-tracking test system, an eye-tracking test method, and a program that can clearly determine the direction of movement of an eye target during an eye-tracking test. [Means for solving the problem]

[0011] One aspect of the present invention is an eye-tracking test system including an eye-target image capturing unit that captures an eye-target image including an eye-target used in an eye-tracking test of a subject, and a computing device, wherein the eye-target is moved from a reference position of the eye-target to a first position that is a position on one side of the reference position in the left-right direction, and then moved from the first position to the reference position; a first movement of the eye-target, in which the eye-target is moved from the reference position to a second position that is a position on the other side of the reference position in the left-right direction, and then moved from the second position to the reference position; a second movement of the visual target in which the visual target is moved from the reference position to a third position which is a position on one side in the vertical direction from the reference position, and then moved from the third position to the reference position; a fourth movement of the visual target in which the visual target is moved from the reference position to a fourth position which is a position on one side in the horizontal direction and on one side in the vertical direction from the reference position, and then moved from the fourth position to the reference position; and a fourth movement of the visual target in which the visual target is moved from the reference position to a fourth position which is a position on one side in the horizontal direction and on one side in the vertical direction from the reference position, and then moved from the fourth position to the reference position. a fifth movement of the visual target, in which the visual target is moved to a fifth position, which is a position on the other side and one side in the vertical direction, and then moved from the fifth position to the reference position; a sixth movement of the visual target, in which the visual target is moved from the reference position to a sixth position, which is a position on the other side in the vertical direction from the reference position, and then moved from the sixth position to the reference position; and a sixth movement of the visual target, in which the visual target is moved from the reference position to a seventh position, which is a position on one side in the left-right direction and the other side in the vertical direction from the reference position, and then moved from the seventh position to the reference position. a seventh movement of the visual target, in which the visual target is moved from the reference position to an eighth position that is on the other side in the left-right direction and on the other side in the up-down direction from the reference position, and then an eighth movement of the visual target, in which the visual target is moved from the eighth position to the reference position; and the arithmetic device includes a visual target image acquisition unit that acquires the visual target image captured by the visual target image capture unit, and a two-dimensional area identification unit that uses an object recognition algorithm to identify a two-dimensional area corresponding to the visual target included in the visual target image acquired by the visual target image acquisition unit.a target position calculation unit that calculates the position of the target based on the two-dimensional area specified by the two-dimensional area specification unit, a target position correction unit that corrects the position of the target calculated by the target position calculation unit, a target position vector calculation unit that calculates a position vector of the target based on the position of the target corrected by the target position correction unit, a target position vector decomposition unit that decomposes the position vector of the target calculated by the target position vector calculation unit into a left-right component and an up-down component, and a target movement direction discrimination unit that determines whether the movement direction of the target included in the target image acquired by the target image acquisition unit corresponds to the first movement, the second movement, the third movement, the fourth movement, the fifth movement, the sixth movement, the seventh movement, or the eighth movement, based on the left-right component of the position vector of the target and the up-down component of the position vector of the target decomposed by the target position vector decomposition unit.

[0012] One aspect of the present invention is a method for an eye-tracking test, comprising: an eye-target image capturing step of capturing an eye-target image including an eye-target used in an eye-tracking test of a subject; and a calculation step, wherein the eye-target is moved from a reference position of the eye-target to a first position, which is a position on one side of the reference position in the left-right direction, and then moved from the first position to the reference position; a first movement of the eye-target, which is moved from the reference position to a second position, which is a position on the other side of the reference position in the left-right direction, and then moved from the second position to the front; a second movement of the visual target to the reference position; a third movement of the visual target to be moved from the reference position to a third position which is a position on one side in the vertical direction from the reference position, and then from the third position to the reference position; a fourth movement of the visual target to be moved from the reference position to a fourth position which is a position on one side in the horizontal direction and on one side in the vertical direction from the reference position, and then from the fourth position to the reference position; and a fourth movement of the visual target to be moved from the reference position to a fourth position which is a position on the other side in the horizontal direction from the reference position and a fifth movement of the visual target in which the visual target is moved to a fifth position, which is a position on one side in the vertical direction, and then moved from the fifth position to the reference position; a sixth movement of the visual target in which the visual target is moved from the reference position to a sixth position, which is a position on the other side in the vertical direction from the reference position, and then moved from the sixth position to the reference position; and a seventh movement of the visual target in which the visual target is moved from the reference position to a seventh position, which is a position on one side in the horizontal direction and on the other side in the vertical direction from the reference position, and then moved from the seventh position to the reference position. a seventh movement, in which the visual target is moved from the reference position to an eighth position, which is a position on the other side in the left-right direction and the other side in the up-down direction from the reference position, and then an eighth movement of the visual target is performed, in which the visual target is moved from the eighth position to the reference position; and the calculation step includes a visual target image acquisition step of acquiring the visual target image captured in the visual target image capturing step, and a two-dimensional area identification step of identifying a two-dimensional area corresponding to the visual target included in the visual target image acquired in the visual target image acquisition step by using an object recognition algorithm.a target position calculation step of calculating a position of the target based on the two-dimensional area specified in the two-dimensional area specification step, a target position correction step of correcting the position of the target calculated in the target position calculation step, a target position vector calculation step of calculating a position vector of the target based on the position of the target corrected in the target position correction step, a target position vector decomposition step of decomposing the position vector of the target calculated in the target position vector calculation step into a left-right component and an up-down component, and a target movement direction determination step of determining whether the movement direction of the target included in the target image acquired in the target image acquisition step corresponds to the first movement, the second movement, the third movement, the fourth movement, the fifth movement, the sixth movement, the seventh movement, or the eighth movement, based on the left-right component of the position vector of the target decomposed in the target position vector decomposition step and the up-down component of the position vector of the target.

[0013] In one aspect of the present invention, in an eye-tracking test for a subject, a visual target used in the eye-tracking test is moved from a reference position of the visual target to a first position that is a position on one side of the reference position in a left-right direction, and then moved from the first position to the reference position; a second movement of the visual target is moved from the reference position to a second position that is a position on the other side of the reference position in the left-right direction, and then moved from the second position to the reference position; and a third movement of the visual target is moved from the reference position to a first position that is a position on one side of the reference position in a left-right direction, and then moved from the second position to the reference position. a third movement of the visual target, in which the visual target is moved to a third position, which is a position on one side of the reference position in the left-right direction and one side in the up-down direction, and then moved from the third position to the reference position; a fourth movement of the visual target, in which the visual target is moved from the reference position to a fourth position, which is a position on one side of the reference position in the left-right direction and one side in the up-down direction, and then moved from the fourth position to the reference position; and a fifth movement of the visual target, in which the visual target is moved from the reference position to a fifth position, which is a position on the other side of the reference position in the left-right direction and one side in the up-down direction, and then moved from the fifth position to the reference position. a fifth movement of the target, in which the target is moved from the reference position to a sixth position which is a position on the other side in the vertical direction from the reference position, and then moved from the sixth position to the reference position; a seventh movement of the target, in which the target is moved from the reference position to a seventh position which is a position on one side in the horizontal direction from the reference position and on the other side in the vertical direction, and then moved from the seventh position to the reference position; and an eighth movement of the target, in which the target is moved from the reference position to a position on the other side in the horizontal direction from the reference position and on the other side in the vertical direction from the reference position. an eighth movement of the target, in which the target is moved to a target position, and then moved from the eighth position to the reference position; a target image acquisition step in which a target image is acquired in a computer, the target image being an image including the target photographed by a target image photographing unit; a two-dimensional area identification step in which a two-dimensional area corresponding to the target included in the target image acquired in the target image acquisition step is identified by an object recognition algorithm; and a target position calculation step in which a position of the target is calculated based on the two-dimensional area identified in the two-dimensional area identification step.a target position correction step of correcting the position of the target calculated in the target position calculation step; a target position vector calculation step of calculating a position vector of the target based on the position of the target corrected in the target position correction step; a target position vector decomposition step of decomposing the position vector of the target calculated in the target position vector calculation step into a left-right component and an up-down component; and a target movement direction determination step of determining whether the movement direction of the target included in the target image acquired in the target image acquisition step corresponds to the first movement, the second movement, the third movement, the fourth movement, the fifth movement, the sixth movement, the seventh movement, or the eighth movement, based on the left-right component of the position vector of the target and the up-down component of the position vector of the target decomposed in the target position vector decomposition step. [Effects of the Invention]

[0014] According to the present invention, it is possible to provide an eye-tracking test system, an eye-tracking test method, and a program that can clearly determine the moving direction of the eye target during an eye-tracking test. [Brief explanation of the drawings]

[0015] [Figure 1] FIG. 1 is a diagram illustrating an example of the configuration of an eye-tracking test system according to a first embodiment. [Figure 2] FIG. 1 is a diagram showing an example of an eye target used in an eye-tracking test of a subject. [Figure 3] FIG. 1 is a diagram for explaining the direction of movement of an eye target in an eye-tracking test. [Figure 4] 10 is a diagram showing an example of the relationship between a target image (an image including a target) captured by a target image capturing unit and a two-dimensional area identified by a two-dimensional area identifying unit. FIG. [Figure 5] 10A and 10B are diagrams for explaining an example of correction of the position of the target during an eye-tracking test, which is performed by the target position correction unit. [Figure 6]FIG. 10 is a diagram for explaining an example of a position vector of a target calculated by a target position vector calculation unit. [Figure 7] FIG. 7 is a diagram for explaining an example in which the target movement direction discrimination unit determines that the movement direction of the target during the period from approximately 10 seconds to 17 seconds on the horizontal axis in FIG. 6 is the movement direction corresponding to the "second movement." [Figure 8] FIG. 10 is a diagram illustrating an example of the relationship between the maximum and minimum values ​​of the time waveform of the left-right component of the position vector of the target, and the maximum and minimum values ​​of the time waveform of the up-down component of the position vector of the target, and the position of the target. [Figure 9] FIG. 10 is a diagram for explaining calculation of peak latency by a peak latency calculation unit. [Figure 10] 10A and 10B are diagrams illustrating an example of a gain calculated by a gain calculation unit. [Figure 11] 4 is a flowchart showing an example of processing executed in the eye-tracking test system of the first embodiment. [Figure 12] FIG. 1 is a diagram showing equipment used as part of the eye-tracking test system of the first embodiment in the examples. [Figure 13] FIG. 13 is an enlarged view of the camera module shown in FIG. 12. [Figure 14] FIG. 1 is a diagram for explaining an SSD used in an example. [Figure 15] 15 is a diagram for explaining source 1 (38×38), source 5 (3×3), and source 6 (1×1) shown in FIG. 14. FIG. [Figure 16] FIG. 1 is a diagram for explaining SSD training. [Figure 17] FIG. 10 is a diagram illustrating an example of the configuration of an eye-tracking test system according to a fourth embodiment. [Figure 18] FIG. 18 is a diagram for explaining and comparing the peak latency calculation method by the peak latency calculation unit 13K of the eye-tracking test system 1 of the first embodiment shown in FIG. 1 with the latency calculation method by the latency calculation unit 13M of the eye-tracking test system 1 of the fourth embodiment shown in FIG. 17. [Figure 19]FIG. 10 is a diagram showing an example of a comparison result between the peak latency calculated by the peak latency calculation unit 13K of the eye-tracking test system 1 of the first embodiment and the latency calculated by the latency calculation unit 13M of the eye-tracking test system 1 of the fourth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0016] Hereinafter, an embodiment of an eye-tracking test system, an eye-tracking test method, and a program according to the present invention will be described with reference to the drawings.

[0017] [First embodiment] FIG. 1 is a diagram showing an example of the configuration of an eye-tracking test system 1 according to the first embodiment. In the example shown in Fig. 1, an eye tracking test system 1 of the first embodiment includes an eye image capturing unit 11, an eye target image capturing unit 12, and a computing device 13. The eye image capturing unit 11 captures an eye image that is an image of the subject's eye. The eye target image capturing unit 12 captures an eye target image that is an image including an eye target 10 (see Fig. 2) used in the eye target tracking test of the subject.

[0018] FIG. 2 is a diagram showing an example of an eye target 10 used in an eye tracking test of a subject. In the example shown in FIG. 2, a 10 cm×10 cm character fixation target is used as the visual target 10 in the eye-tracking test. In another example, the examiner's fingertip, a pen, or the like may be used as the target 10 in an eye-tracking test.

[0019] FIG. 3 is a diagram for explaining the direction of movement of the target 10 in an eye-tracking test. 3, in the eye-tracking test, the eye target 10 is moved from a reference position 10P0 of the eye target 10 (a position corresponding to the front of the subject) to a first position 10P1 (a position corresponding to the left front of the subject) which is a position on one side of the reference position 10P0 in the left-right direction, and then a first movement of the eye target 10 is performed by the examiner from the first position 10P1 to the reference position 10P0. Also, in the eye-tracking test, the eye target 10 is moved from the reference position 10P0 to a second position 10P2 (a position corresponding to the right front of the subject) which is a position on the other side of the reference position 10P0 in the left-right direction, and then a second movement of the eye target 10 is performed by the examiner from the second position 10P2 to the reference position 10P0.

[0020] In the eye tracking test, the eye target 10 is moved from the reference position 10P0 to a third position 10P3 (a position corresponding to the upper front of the subject) which is a position on one side of the reference position 10P0 in the vertical direction, and then moved from the third position 10P3 to the reference position 10P0. Then, the eye target 10 is moved from the reference position 10P0 to a fourth position (a position corresponding to the upper left front of the subject) which is a position on one side of the reference position 10P0 in the horizontal direction and on one side of the vertical direction. The examiner performs a fourth movement of the visual target 10, in which the visual target 10 is moved to a fourth position 10P4 (position where the visual target 10 is located) and then moved from the fourth position 10P4 to the reference position 10P0. The examiner also performs a fifth movement of the visual target 10, in which the visual target 10 is moved from the reference position 10P0 to a fifth position 10P5 (a position corresponding to the upper right front of the subject), which is a position on the other side of the reference position 10P0 in the left-right direction and on one side of the reference position 10P0 in the up-down direction, and then moved from the fifth position 10P5 to the reference position 10P0. Furthermore, in the eye tracking test, the eye target 10 is moved from the reference position 10P0 to a sixth position 10P6 (a position corresponding to the lower front of the subject) which is a position on the other side of the reference position 10P0 in the vertical direction, and then moved from the sixth position 10P6 to the reference position 10P0 (a sixth movement of the eye target 10). The eye target 10 is then moved from the sixth position 10P6 to the reference position 10P0. The eye target 10 is then moved from the reference position 10P0 to a seventh position (a position corresponding to the lower left front of the subject) which is a position on one side of the reference position 10P0 in the horizontal direction and on the other side in the vertical direction. The examiner performs a seventh movement of the visual target 10, in which the visual target 10 is moved to a seventh position 10P7 (a position where the visual target 10 is located) and then moved from the seventh position 10P7 to the reference position 10P0. The examiner also performs an eighth movement of the visual target 10, in which the visual target 10 is moved from the reference position 10P0 to an eighth position 10P8 (a position corresponding to the lower right front of the subject), which is a position on the other side of the reference position 10P0 in the left-right direction and on the other side in the up-down direction, and then moved from the eighth position 10P8 to the reference position 10P0.

[0021] In another example, the order in which the first to eighth movements of the visual target 10 are performed may be different from the example shown in FIG. In still another example, all of the first to eighth movements of the target 10 do not necessarily have to be performed in the eye-tracking test.

[0022] In the example shown in FIG. 1, the calculation device 13 includes an eye image acquisition unit 13A, a gaze position measurement unit 13B, a target image acquisition unit 13C, a two-dimensional area identification unit 13D, a target position calculation unit 13E, a target position correction unit 13F, a target position vector calculation unit 13G, a target position vector decomposition unit 13H, a target movement direction discrimination unit 13I, a merge processing unit 13J, a peak latency calculation unit 13K, and a gain calculation unit 13L. The eye image acquiring unit 13A acquires the eye image (image of the subject's eye) captured by the eye image capturing unit 11. The gaze position measuring unit 13B uses VOG (Video-oculography) to measure the gaze position of the subject based on the eye images (images of the subject's eyes) acquired by the eye image acquiring unit 13A. VOG is a technology that irradiates both eyes of the subject with near-infrared light and acquires gaze information of the subject from the relative positional relationship between the corneal reflex and the pupil. VOG can quantify and visualize the eye movement of the subject.

[0023] The target image acquiring unit 13C acquires the target image (image including the target 10) photographed by the target image photographing unit 12. The two-dimensional area specifying unit 13D uses an object recognition algorithm to specify a two-dimensional area 10A (see FIG. 4) corresponding to the visual target 10 included in the visual target image acquired by the visual target image acquiring unit 13C.

[0024] FIG. 4 is a diagram showing an example of the relationship between the target image (image including the target 10) photographed by the target image photographing unit 12 and the two-dimensional area 10A identified by the two-dimensional area identifying unit 13D. The two-dimensional region identification unit 13D identifies which region on the target image is the two-dimensional region 10A corresponding to the target 10. The two-dimensional region identification unit 13D uses SSD (Single Shot MultiBox Detector) as an object recognition algorithm. SSD is an object recognition deep learning algorithm that predicts what objects are contained in an image and outputs the region of the object and the predicted value. The two-dimensional region 10A identified by the two-dimensional region identification unit 13D is a rectangular region called a "bounding box." In the example shown in Figure 4, the two-dimensional region 10A (bounding box) is a rectangular region (a rectangular region circumscribing the visual target 10 on the visual target image) that surrounds the visual target 10 (see Figure 2) on the visual target image, but in other examples, the visual target 10 on the visual target image may extend beyond the two-dimensional region 10A (bounding box).

[0025] 1, the target position calculation unit 13E calculates the position of the target 10 (the position of the target 10 on the target image) based on the two-dimensional area 10A identified by the two-dimensional area identification unit 13D. In detail, the target position calculation unit 13E calculates the position of the center of gravity of the bounding box as the position of the target 10. In another example, the target position calculation unit 13E may calculate the position of the target 10 on the target image by using a moving average, a moving median, or the like.

[0026] In the example shown in FIG. 1, the target position correcting section 13F corrects the position of the target 10 calculated by the target position calculating section 13E.

[0027] FIG. 5 is a diagram for explaining an example of correction of the position of the target 10 during the target tracking test, which is performed by the target position correction unit 13F. 5(A) shows the trajectory of the position of the target 10 during the eye-tracking test calculated by the eye-target position calculation unit 13E. In FIG. 5(A), "Target" shows the trajectory of the position of the target 10 during the eye-tracking test calculated by the eye-target position calculation unit 13E, "LE" shows the trajectory of the gaze position of the subject's left eye during the eye-tracking test measured by the gaze position measurement unit 13B, and "RE" shows the trajectory of the gaze position of the subject's right eye during the eye-tracking test measured by the gaze position measurement unit 13B. FIG. 5(B) shows the trajectory of the position of the target 10 during the target tracking test, corrected by the target position correcting unit 13F.

[0028] The target position correction unit 13F corrects the position of the target 10 so that the reference position 10P0 (see Figure 3) of the target 10 included in the target image acquired by the target image acquisition unit 13C roughly coincides with the center position of the target image, which is the center of the target image in the horizontal direction and the center of the target image in the vertical direction. In the example shown in Figure 5, the target position correction unit 13F moves the trajectory of the position of the target 10 during the target tracking test, shown as "Target" in Figure 5(A), downward and left in Figures 5(A) and 5(B), so that the part of the trajectory of the position of the target 10 during the target tracking test, shown as "Target" in Figure 5, that corresponds to the reference position 10P0 of the target 10 roughly coincides with the center of the target image in the left-right direction (horizontal position is 0 [deg]) and the center of the target image in the up-down direction (vertical position is 0 [deg]).

[0029] In the example shown in FIG. 5, in order to check the tracking ability of the gaze positions of the subject's left and right eyes in response to the first to eighth movements of the eye target 10 during the eye-tracking test, the eye target position correction unit 13F moves the trajectory of the position of the eye target 10 during the eye-tracking test, indicated by "Target" in FIG. 5(A), downward and left in FIGS. 5(A) and 5(B). At the same time, the trajectory of the gaze position of the subject's left eye during the eye-tracking test, indicated by "LE" in FIG. 5(A), and the trajectory of the gaze position of the subject's right eye during the eye-tracking test, indicated by "RE" in FIG. 5(A), are moved downward and left in FIGS. 5(A) and 5(B), similarly to the trajectory of the position of the eye target 10 during the eye-tracking test, indicated by "Target" in FIG. 5(A).

[0030] In the example shown in FIG. 1, the target position vector calculation unit 13G calculates the position vector of the target 10 based on the position of the target 10 corrected by the target position correction unit 13F.

[0031] FIG. 6 is a diagram for explaining an example of the position vector of the target 10 calculated by the target position vector calculation unit 13G. In detail, Figure 6(A) shows the time waveform of the magnitude of the position vector of the target 10 calculated by the target position vector calculation unit 13G based on the position of the target 10 corrected by the target position correction unit 13F (the trajectory of the corrected position of the target 10 shown as "Target" in Figure 5(B)). In the examples shown in Figures 5(B) and 6(A), the magnitude of the position vector of the target 10 calculated by the target position vector calculation unit 13G (the value on the vertical axis in Figure 6(A)) indicates the distance between the center position of the target image shown in Figure 5(B) (the position where the horizontal position is 0 [deg] and the vertical position is 0 [deg]) and the position of the target 10 corrected by the target position correction unit 13F (the corrected position of the target 10 shown as "Target" in Figure 5(B)).

[0032] In the examples shown in Figures 5(B) and 6(A), at the start of the first movement of the target 10 (see Figure 3) (when the value on the horizontal axis in Figure 6(A) is approximately 2 seconds), the position of the corrected target 10 shown as "Target" in Figure 5(B) roughly coincides with the center position of the target image, and the magnitude of the position vector of the target 10 (the value on the vertical axis in Figure 6(A)) becomes zero. Next, when the value on the horizontal axis in Figure 6(A) is approximately 6 [seconds], the position of the corrected target 10 shown as "Target" in Figure 5(B) is a horizontal position of approximately 9 [deg] and a vertical position of approximately 0 [deg], and the magnitude of the position vector of target 10 (the value on the vertical axis in Figure 6(A)) is approximately 9.

[0033] Next, at the end of the first movement of the target 10 and the start of the second movement of the target 10 (see Figure 3) (when the value on the horizontal axis in Figure 6(A) is approximately 10 seconds), the position of the corrected target 10 shown as "Target" in Figure 5(B) roughly coincides with the center position of the target image, and the magnitude of the position vector of the target 10 (the value on the vertical axis in Figure 6(A)) becomes zero. Next, when the value on the horizontal axis in Figure 6(A) is approximately 14 [seconds], the position of the corrected target 10 shown as "Target" in Figure 5(B) is approximately -12 [deg] in the horizontal direction and approximately 0 [deg] in the vertical direction, and the magnitude of the position vector of target 10 (value on the vertical axis in Figure 6(A)) is approximately 12. Next, at the end of the second movement of the target 10 and the start of the third movement of the target 10 (see Figure 3) (when the value on the horizontal axis in Figure 6(A) is approximately 17 seconds), the position of the corrected target 10 shown as "Target" in Figure 5(B) roughly coincides with the center position of the target image, and the magnitude of the position vector of the target 10 (the value on the vertical axis in Figure 6(A)) becomes approximately 1. Next, when the value on the horizontal axis in Figure 6(A) is approximately 20 [seconds], the position of the corrected target 10 shown as "Target" in Figure 5(B) is approximately -1 [deg] in the horizontal direction and approximately 12 [deg] in the vertical direction, and the magnitude of the position vector of target 10 (value on the vertical axis in Figure 6(A)) is approximately 12.

[0034] Next, at the end of the third movement of the target 10 and the start of the fourth movement of the target 10 (see Figure 3) (when the value on the horizontal axis in Figure 6(A) is approximately 23 seconds), the position of the corrected target 10 shown as "Target" in Figure 5(B) roughly coincides with the center position of the target image, and the magnitude of the position vector of the target 10 (the value on the vertical axis in Figure 6(A)) becomes zero. Next, when the value on the horizontal axis in Figure 6(A) is approximately 26 [seconds], the position of the corrected target 10 shown as "Target" in Figure 5(B) is approximately 8 [deg] horizontally and approximately 8 [deg] vertically, and the magnitude of the position vector of target 10 (value on the vertical axis in Figure 6(A)) is approximately 11. Next, at the end of the fourth movement of the target 10 and the start of the fifth movement of the target 10 (see Figure 3) (when the value on the horizontal axis in Figure 6(A) is approximately 29 seconds), the position of the corrected target 10 shown as "Target" in Figure 5(B) roughly coincides with the center position of the target image, and the magnitude of the position vector of the target 10 (the value on the vertical axis in Figure 6(A)) becomes zero. Next, when the value on the horizontal axis in Figure 6(A) is approximately 32 [seconds], the position of the corrected target 10 shown as "Target" in Figure 5(B) is approximately -11 [deg] in the horizontal direction and approximately 7 [deg] in the vertical direction, and the magnitude of the position vector of target 10 (value on the vertical axis in Figure 6(A)) is approximately 13.

[0035] Next, at the end of the fifth movement of the target 10 and the start of the sixth movement of the target 10 (see Figure 3) (when the value on the horizontal axis in Figure 6(A) is approximately 36 seconds), the position of the corrected target 10 shown as "Target" in Figure 5(B) roughly coincides with the center position of the target image, and the magnitude of the position vector of the target 10 (the value on the vertical axis in Figure 6(A)) becomes approximately 2. Next, when the value on the horizontal axis in Figure 6(A) is approximately 40 [seconds], the position of the corrected target 10 shown as "Target" in Figure 5(B) is a horizontal position of approximately 0 [deg] and a vertical position of approximately -14 [deg], and the magnitude of the position vector of target 10 (the value on the vertical axis in Figure 6(A)) is approximately 14. Next, at the end of the sixth movement of the target 10 and the start of the seventh movement of the target 10 (see Figure 3) (when the value on the horizontal axis in Figure 6(A) is approximately 43 seconds), the position of the corrected target 10 shown as "Target" in Figure 5(B) roughly coincides with the center position of the target image, and the magnitude of the position vector of the target 10 (the value on the vertical axis in Figure 6(A)) becomes approximately 1. Next, when the value on the horizontal axis in Figure 6(A) is approximately 47 [seconds], the position of the corrected target 10 shown as "Target" in Figure 5(B) is a horizontal position of approximately 8 [deg] and a vertical position of approximately -9 [deg], and the magnitude of the position vector of the target 10 (the value on the vertical axis in Figure 6(A)) is approximately 12.

[0036] Next, at the end of the seventh movement of the target 10 and the start of the eighth movement of the target 10 (see Figure 3) (when the value on the horizontal axis in Figure 6(A) is approximately 50 seconds), the position of the corrected target 10 shown as "Target" in Figure 5(B) roughly coincides with the center position of the target image, and the magnitude of the position vector of the target 10 (the value on the vertical axis in Figure 6(A)) becomes approximately 1. Next, when the value on the horizontal axis in Figure 6(A) is approximately 53 [seconds], the position of the corrected target 10 shown as "Target" in Figure 5(B) is approximately -10 [deg] in the horizontal direction and approximately -10 [deg] in the vertical direction, and the magnitude of the position vector of the target 10 (value on the vertical axis in Figure 6(A)) is approximately 14. Next, at the end of the eighth movement of the target 10 (when the value on the horizontal axis in Figure 6(A) is approximately 56 seconds), the position of the corrected target 10, shown as "Target" in Figure 5(B), roughly coincides with the center position of the target image, and the magnitude of the position vector of the target 10 (the value on the vertical axis in Figure 6(A)) becomes approximately 2.

[0037] Figure 6(B) shows the time waveform of the magnitude of the position vector of the target 10 during the period from approximately 10 seconds to approximately 17 seconds on the horizontal axis of Figure 6(A), with the time axis (horizontal axis) enlarged more than in Figure 6(A). In Fig. 6(B), "LE" indicates the distance between the gaze position of the subject's left eye during the eye-tracking test (i.e., the gaze position of the subject's left eye corrected in the same way as the position of the eye target 10) whose trajectory is indicated by "LE" in Fig. 5(B) and the center position of the eye target image (a position where the horizontal position is 0 [deg] and the vertical position is 0 [deg]) shown in Fig. 5(B. "RE" indicates the distance between the gaze position of the subject's right eye during the eye-tracking test (i.e., the gaze position of the subject's right eye corrected in the same way as the position of the eye target 10) whose trajectory is indicated by "RE" in Fig. 5(B) and the center position of the eye target image shown in Fig. 5(B).

[0038] In the example shown in FIG. 1, the target position vector decomposition unit 13H decomposes the position vector of the target 10 calculated by the target position vector calculation unit 13G into a left-right component and an up-down component. The target movement direction discrimination unit 13I determines whether the movement direction of the target 10 included in the target image acquired by the target image acquisition unit 13C corresponds to one of the ``first movement,'' ``second movement,'' ``third movement,'' ``fourth movement,'' ``fifth movement,'' ``sixth movement,'' ``seventh movement,'' or ``eighth movement'' shown in Figure 3, based on the left-right component of the position vector of the target 10 and the up-down component of the position vector of the target 10 decomposed by the target position vector decomposition unit 13H. The period from the time corresponding to the first minimum value of the time waveform (see Figure 6) of the magnitude of the position vector of the target 10 calculated by the target position vector calculation unit 13G (for example, when the value on the horizontal axis in Figure 6 is approximately 10 seconds) to the time corresponding to the second minimum value adjacent to the first minimum value (for example, when the value on the horizontal axis in Figure 6 is approximately 17 seconds) is the period for which the target movement direction discrimination unit 13I discriminates the movement direction of the target 10.

[0039] Fig. 7 is a diagram for explaining an example in which the target movement direction discrimination unit 13I determines that the movement direction of the target 10 during the period from approximately 10 seconds to 17 seconds on the horizontal axis in Fig. 6 is the movement direction corresponding to the "second movement." In detail, Fig. 7(A) shows the time waveform of the left-right component of the position vector of the target 10 during the period from approximately 10 seconds to 17 seconds on the horizontal axis in Fig. 6. Fig. 7(B) shows the time waveform of the up-down component of the position vector of the target 10 during the period from approximately 10 seconds to 17 seconds on the horizontal axis in Fig. 6.

[0040] In the example shown in Figure 1, the target movement direction discrimination unit 13I determines whether the movement direction of the target 10 corresponds to any of the "first movement," "second movement," "third movement," "fourth movement," "fifth movement," "sixth movement," "seventh movement," and "eighth movement" shown in Figure 3, based on the maximum and / or minimum values ​​of the time waveform of the left-right component of the position vector of the target 10 during the period to be discriminated for the movement direction of the target 10, and the maximum and / or minimum values ​​of the time waveform of the up-down component of the position vector of the target 10 during the period to be discriminated for the movement direction of the target 10. In detail, if the maximum value of the time waveform of the left-right component of the position vector of the target 10 exists in the middle of the period to be determined for the direction of movement of the target 10, and the maximum value and minimum value of the time waveform of the up-down component of the position vector of the target 10 do not exist during the period to be determined for the direction of movement of the target 10, the target movement direction determination unit 13I determines that the direction of movement of the target 10 is the movement direction corresponding to the ``first movement'' shown in Figure 3. If the minimum value of the time waveform of the left-right component of the position vector of the target 10 exists in the middle of the period to be determined for the direction of movement of the target 10, and the maximum and minimum values ​​of the time waveform of the up-down component of the position vector of the target 10 do not exist during the period to be determined for the direction of movement of the target 10, the target movement direction determination unit 13I determines that the direction of movement of the target 10 is the movement direction corresponding to the ``second movement'' shown in Figure 3.

[0041] If the maximum and minimum values ​​of the time waveform of the left-right component of the position vector of the target 10 do not exist during the period to be determined for the direction of movement of the target 10, and the maximum value of the time waveform of the up-down component of the position vector of the target 10 exists in the middle of the period to be determined for the direction of movement of the target 10, the target movement direction determination unit 13I determines that the direction of movement of the target 10 is the movement direction corresponding to the ``third movement'' shown in Figure 3. If the maximum value of the time waveform of the left-right component of the position vector of the target 10 exists in the middle of the period to be determined for the direction of movement of the target 10, and if the maximum value of the time waveform of the up-down component of the position vector of the target 10 exists in the middle of the period to be determined for the direction of movement of the target 10, the target movement direction determination unit 13I determines that the direction of movement of the target 10 is the movement direction corresponding to the "fourth movement" shown in Figure 3. If the minimum value of the time waveform of the left-right component of the position vector of the target 10 exists in the middle of the period to be determined for the direction of movement of the target 10, and the maximum value of the time waveform of the up-down component of the position vector of the target 10 exists in the middle of the period to be determined for the direction of movement of the target 10, the target movement direction determination unit 13I determines that the direction of movement of the target 10 is the movement direction corresponding to the ``fifth movement'' shown in Figure 3.

[0042] If the maximum and minimum values ​​of the time waveform of the left-right component of the position vector of the target 10 do not exist during the period to be determined for the movement direction of the target 10, and the minimum value of the time waveform of the up-down component of the position vector of the target 10 exists in the middle of the period to be determined for the movement direction of the target 10, the target movement direction determination unit 13I determines that the movement direction of the target 10 is the movement direction corresponding to the ``sixth movement'' shown in Figure 3. If the maximum value of the time waveform of the left-right component of the position vector of the target 10 exists in the middle of the period to be determined for the direction of movement of the target 10, and the minimum value of the time waveform of the up-down component of the position vector of the target 10 exists in the middle of the period to be determined for the direction of movement of the target 10, the target movement direction determination unit 13I determines that the direction of movement of the target 10 is the movement direction corresponding to the ``seventh movement'' shown in Figure 3. If the minimum value of the time waveform of the left-right component of the position vector of the target 10 exists in the middle of the period to be determined for the direction of movement of the target 10, and if the minimum value of the time waveform of the up-down component of the position vector of the target 10 exists in the middle of the period to be determined for the direction of movement of the target 10, the target movement direction determination unit 13I determines that the direction of movement of the target 10 is the movement direction corresponding to the "eighth movement" shown in Figure 3.

[0043] In the example shown in FIG. 7, as shown in FIG. 7(A), the minimum value of the time waveform of the left-right direction component of the position vector of the target 10 exists in the middle of the period to be determined for the moving direction of the target 10 (the period from about 10 seconds to 17 seconds on the horizontal axis in FIG. 7). Furthermore, as shown in Figure 7(B), the maximum and minimum values ​​of the time waveform of the vertical component of the position vector of the target 10 do not exist during the period for determining the direction of movement of the target 10 (the period from approximately 10 seconds to 17 seconds on the horizontal axis in Figure 7). Therefore, in the example shown in FIG. 7, the target movement direction determining unit 13I determines that the movement direction of the target 10 is the movement direction corresponding to the "second movement" shown in FIG.

[0044] In the example shown in Figure 7, considering that the influence of the "first movement" of the target 10 may affect the time waveforms of the left-right and up-down components of the position vector of the target 10 immediately after the start of the period for determining the movement direction of the target 10 (for example, between the value on the horizontal axis in Figure 7 of approximately 10 [seconds] and approximately 11 [seconds]), the time waveforms of the left-right and up-down components of the position vector of the target 10 between the value on the horizontal axis in Figure 7 of approximately 10 [seconds] and approximately 11 [seconds] are not used to determine the movement direction of the target 10 by the target movement direction determination unit 13I. Similarly, in consideration of the fact that the influence of the "third movement" of the target 10 may affect the time waveforms of the left-right and up-down components of the position vector of the target 10 just before the end of the period for determining the movement direction of the target 10 (for example, between approximately 16 [seconds] and approximately 17 [seconds] on the horizontal axis in Figure 7), the time waveforms of the left-right and up-down components of the position vector of the target 10 between approximately 16 [seconds] and approximately 17 [seconds] on the horizontal axis in Figure 7 are not used to determine the movement direction of the target 10 by the target movement direction determination unit 13I.

[0045] Figure 8 is a diagram illustrating an example of the relationship between the maximum and minimum values ​​of the time waveform of the left-right component of the position vector of the target 10, and the maximum and minimum values ​​of the time waveform of the up-down component of the position vector of the target 10, and the position of the target 10. In the example shown in Fig. 8, three points (positions of three targets 10) included in circle CR1 correspond to the maximum values ​​of the time waveform of the left-right component of the position vector of the target 10. Three points (positions of three targets 10) included in circle CR2 correspond to the minimum values ​​of the time waveform of the left-right component of the position vector of the target 10. The three points (positions of the three targets 10) included in the circle CR3 correspond to the maximum values ​​of the time waveform of the vertical component of the position vector of the target 10. The three points (positions of the three targets 10) included in the circle CR4 correspond to the minimum values ​​of the time waveform of the vertical component of the position vector of the target 10.

[0046] 1, the merging processing unit 13J merges the gaze position of the subject measured by the gaze position measuring unit 13B, which is the gaze position of the subject at the time when the gaze image acquired by the gaze target image acquiring unit 13C was photographed by the gaze target image photographing unit 12, into the gaze image. As a result, it becomes possible to compare, on the gaze target image, the position of the gaze target 10 on the gaze target image with the gaze position of the subject at the time when the gaze image was photographed (the gaze position of the subject tracking the gaze target 10). In detail, the target image into which the subject's gaze position is merged by the merge processing unit 13J is a target image in which the position of the target 10 has not been corrected by the target position correction unit 13F (i.e., a target image corresponding to Figure 5(A), not a target image corresponding to Figure 5(B)).

[0047] In the example shown in Figure 1, the peak latency calculation unit 13K calculates the peak latency, which is the delay time from the time corresponding to the maximum value of the time waveform of the magnitude of the position vector of the target 10 to the time corresponding to the maximum value of the time waveform of the magnitude of the subject's gaze position vector.

[0048] FIG. 9 is a diagram for explaining the calculation of the peak latency by the peak latency calculation unit 13K. Fig. 9(A) shows a time waveform of the magnitude of the position vector of the visual target 10. In Fig. 9(A), "Target" shows the time waveform (raw data) of the magnitude of the position vector of the visual target 10, "LE" shows the time waveform (raw data) of the distance between the gaze position of the subject's left eye and the center position of the visual target image shown in Fig. 5(B), and "RE" shows the time waveform (raw data) of the distance between the gaze position of the subject's right eye and the center position of the visual target image shown in Fig. 5(B). Figure 9(B) shows an example of peak fitting with a cubic function, and Figure 9(C) shows an example of peak fitting (matching) to raw data.

[0049] In the example shown in FIG. 1, the gain calculation unit 13L calculates a gain that is the ratio of the slope of the time waveform of the magnitude of the gaze position vector of the subject to the slope of the time waveform of the magnitude of the position vector of the target 10.

[0050] FIG. 10 is a diagram for explaining an example of the gain calculated by the gain calculation unit 13L. In the example shown in Figure 10, the peak of the time waveform of the magnitude of the position vector of the target 10 is defined as the maximum value (local maximum value), and the peak of the time waveform of the magnitude of the gaze position vector of the subject's left eye and right eye is defined as the maximum value (local maximum value). The gain calculation unit 13L searches for a measurement point corresponding to 25% to 75% of the peak of the time waveform of the magnitude of the position vector of the target 10, and searches for a measurement point corresponding to 25% to 75% of the peak of the time waveform of the magnitude of the gaze position vector of the subject's left eye and right eye. In addition, the gain calculation unit 13L calculates an approximate straight line of the measurement points corresponding to 25% to 75% of the peak of the time waveform of the magnitude of the position vector of the target 10 using the least squares method, and calculates an approximate straight line of the measurement points corresponding to 25% to 75% of the peak of the time waveform of the magnitude of the gaze position vector of the subject's left eye and right eye using the least squares method. Furthermore, the gain calculation unit 13L calculates a gain, which is the ratio of the slope of the approximate line of the time waveform of the magnitude of the gaze position vector of the subject's left eye and right eye to the slope of the approximate line of the time waveform of the magnitude of the position vector of the target 10.

[0051] FIG. 11 is a flowchart showing an example of processing executed in the eye-tracking test system 1 of the first embodiment. In the example shown in FIG. 11, in step S11, the eye image capturing unit 11 captures an eye image that is an image of the subject's eye. In step S12, the target image capturing unit 12 captures a target image that is an image including the target 10 used in the target tracking test of the subject. Next, in step S13, the arithmetic unit 13 executes processing such as calculations.

[0052] Specifically, in step S13A, the eye image acquiring unit 13A acquires the eye image (image of the subject's eye) captured in step S11. Next, in step S13B, the gaze position measuring unit 13B uses VOG to measure the gaze position of the subject based on the eye image (image of the subject's eye) acquired in step S13A.

[0053] In step S13C, the target image acquisition unit 13C acquires the target image (image including the target 10) captured in step S12. Next, in step S13D, the two-dimensional area specifying unit 13D uses an object recognition algorithm to specify the two-dimensional area 10A corresponding to the visual target 10 included in the visual target image acquired in step S13C. Next, in step S13E, the target position calculation unit 13E calculates the position of the target 10 (the position of the target 10 on the target image) based on the two-dimensional area 10A specified in step S13D.

[0054] Next, in step S13F, the target position correcting unit 13F corrects the position of the target 10 calculated in step S13E. Next, in step S13G, the target position vector calculation unit 13G calculates the position vector of the target 10 based on the position of the target 10 corrected in step S13F. Next, in step S13H, the target position vector decomposition unit 13H decomposes the position vector of the target 10 calculated in step S13G into a left-right direction component and an up-down direction component. Next, in step S13I, the target movement direction discrimination unit 13I determines whether the movement direction of the target 10 included in the target image acquired in step S13C corresponds to one of the ``first movement,'' ``second movement,'' ``third movement,'' ``fourth movement,'' ``fifth movement,'' ``sixth movement,'' ``seventh movement,'' or ``eighth movement'' shown in Figure 3, based on the left-right component of the position vector of the target 10 decomposed in step S13H and the up-down component of the position vector of the target 10.

[0055] In addition, in step S13J, the merge processing unit 13J merges the gaze position of the subject measured in step S13B, which is the gaze position of the subject at the time when the target image acquired in step S13C was photographed by the target image photographing unit 12, into the target image.

[0056] <Example> The inventors used the eye tracking test system 1 of the first embodiment to automatically analyze the results of a nine-direction eye position test used in clinical ophthalmology without trigger input.

[0057] FIG. 12 is a diagram showing devices used as part of the eye-tracking test system 1 of the first embodiment in the examples. In this example, we used the EMR-9 manufactured by NAC Image Technology Inc. as the VOG for measuring eye movements. This device combines the external image captured by the camera module with the gaze position calculated from the subject's eye position using a controller, and outputs the results on the measurement screen.

[0058] FIG. 13 is an enlarged view of the camera module shown in FIG. The entire camera module can be moved horizontally and vertically by 8 cm, and the scene camera attached in the center has a sampling rate of 29.97 Hz, a field of view of 62 degrees, and can rotate 60 degrees in the pitch direction from the center position. The eye cameras installed above the left and right eyes have a sampling rate of 240Hz, a viewing angle of 43 degrees horizontally and 28.6 degrees vertically, and the center position can be adjusted horizontally by 1.3cm for each eye. The near-infrared light emitted from the eye cameras is reflected by a half mirror, which is also adjustable and can be rotated 2.5cm vertically and 30 degrees in the pitch direction.

[0059] Images from the eye camera can be displayed in the lower left and right sections of the measurement screen, and a binary image of the single eye can be displayed in the upper left section of the measurement screen. The eye position is calculated from the relative positions of the corneal reflex and pupil, and the subject's gaze position is measured. The measured gaze position of the subject can be displayed as part of the scene camera image in the upper right section of the measurement screen with a delay time of 52 ms or less.

[0060] FIG. 14 is a diagram for explaining the SSD used in the examples. As shown in Figure 14, SSD is a model that adds an extra module for object recognition to the VGG16 CNN model. SSD uses the features of the third convolutional layer in the fourth block of the VGG network as source 1 and the features of the final output layer as source 2, performs convolution on source 2 with features of 10x10, 5x5, 3x3, and 1x1, and outputs features from source 3 to source 6.

[0061] FIG. 15 is a diagram for explaining source 1 (38×38), source 5 (3×3), and source 6 (1×1) shown in FIG. Source 1, output from the third convolutional layer of the fourth block of the VGG network shown in Figure 14, has a feature map of 38x38, as shown in Figure 15. Source 5 has a feature map of 3x3, and Source 6 has a feature map of 1x1. Each source has a different number of feature maps, and the finer the feature map, the higher the accuracy of detecting small objects.

[0062] FIG. 16 is a diagram for explaining SSD training. In SSD training, multiple bounding boxes are prepared for the correct position label of an object, called ground truth, and as training is repeated, a bounding box that is closest to the correct box is learned.

[0063] In the embodiment, the peak latency (average of all directions) of the subject's right eye calculated by the peak latency calculation unit 13K was 0.126±0.029 [ms], and the peak latency (average of all directions) of the subject's left eye was 0.135±0.029 [ms]. In the example, the gain (average of all directions) of the right eye of the subject calculated by the gain calculation unit 13L was 0.876±0.093, and the gain (average of all directions) of the left eye of the subject was 0.895±0.107.

[0064] In the example, it was possible to determine the presentation direction (movement direction) of the optotype 10 without a cutoff value. That is, in the example, it was possible to determine the movement direction of the optotype 10 during the eye tracking test more clearly than when it was determined whether the movement direction of the optotype 10 included in the eye target image corresponds to the first movement, the second movement, the third movement, the fourth movement, the fifth movement, the sixth movement, the seventh movement, or the eighth movement, based on the magnitude relationship between the angle formed by the trajectory of the position of the optotype 10 obtained from the position of the optotype 10 calculated by the optotype position calculation unit 13E and a predetermined line (for example, a horizontal line, a vertical line, etc.) and a predetermined threshold. Furthermore, in the embodiment, the position of the target 10 identified by the AI ​​(artificial intelligence) built into the computing device 13 is used as a reference, so that eye movement in each direction can be evaluated without being affected by the living body's effects such as blinking or strabismus.

[0065] [Second embodiment] A second embodiment of the eye-tracking test system, eye-tracking test method, and program according to the present invention will now be described. The eye-tracking test system 1 of the second embodiment is configured similarly to the eye-tracking test system 1 of the first embodiment, except for the points described below. Therefore, the eye-tracking test system 1 of the second embodiment can achieve the same effects as the eye-tracking test system 1 of the first embodiment, except for the points described below.

[0066] As described above, the eye tracking test system 1 of the first embodiment includes the eye image capturing unit 11, the eye target image capturing unit 12, and the calculation device 13. On the other hand, the eye tracking test system 1 of the second embodiment includes the eye target image capturing unit 12 and the calculation device 13, and may not include the eye image capturing unit 11. In detail, the calculation device 13 of the eye target tracking test system 1 of the second embodiment may not include the eye image acquiring unit 13A, the gaze position measuring unit 13B, the merge processing unit 13J, etc.

[0067] [Third embodiment] A third embodiment of the eye-tracking test system, eye-tracking test method, and program of the present invention will be described below. The eye-tracking test system 1 of the third embodiment is configured similarly to the eye-tracking test system 1 of the first embodiment, except for the points that will be described later. Therefore, the eye-tracking test system 1 of the third embodiment can achieve the same effects as the eye-tracking test system 1 of the first embodiment, except for the points that will be described later.

[0068] As described above, in the eye tracking inspection system 1 of the first embodiment, the two-dimensional region specifying unit 13D uses SSD as the object recognition algorithm. On the other hand, in the eye tracking inspection system 1 of the third embodiment, the two-dimensional region specifying unit 13D uses an object recognition algorithm other than SSD (for example, R-CNN, YOLO, etc.), or uses the raster scan method as the object detection method.

[0069] The inventor has found through extensive research that there are cases where the peaks (maximum and minimum values) of the time waveform of the magnitude of the gaze position vector of a subject do not appear clearly, such as in the case of a patient with strabismus. The inventor has also found that in such cases, the peak latency calculation unit 13K of the eye tracking test system 1 of the first embodiment cannot accurately calculate the peak latency, which is the delay time between the maximum value of the time waveform of the magnitude of the gaze position vector of the subject and the maximum value of the time waveform of the magnitude of the position vector of the target 10. Furthermore, the inventor has discovered that even in such a case, the latency calculation unit 13M of the eye tracking test system 1 of the fourth embodiment described below can accurately calculate the latency, which is the delay time between the time waveform of the magnitude of the subject's gaze position vector and the time waveform of the magnitude of the position vector of the eye target 10.

[0070] [Fourth embodiment] A fourth embodiment of the eye-tracking test system, eye-tracking test method, and program according to the present invention will now be described. The eye-tracking test system 1 of the fourth embodiment is configured similarly to the eye-tracking test system 1 of the first embodiment, except for the points that will be described later. Therefore, the eye-tracking test system 1 of the fourth embodiment can achieve the same effects as the eye-tracking test system 1 of the first embodiment, except for the points that will be described later.

[0071] FIG. 17 is a diagram showing an example of the configuration of an eye-tracking test system 1 according to the fourth embodiment. 17, the eye-tracking test system 1 of the fourth embodiment includes an eye image capturing unit 11, an eye target image capturing unit 12, and a computing device 13, similar to the eye-tracking test system 1 of the first embodiment shown in FIG. 1. The eye image capturing unit 11 captures an eye image that is an image of the subject's eye, similar to the eye image capturing unit 11 of the eye-tracking test system 1 of the first embodiment shown in FIG. 1. The eye target image capturing unit 12 captures an eye target image that is an image including an eye target 10 (see FIG. 2) used in the eye-tracking test of the subject, similar to the eye target image capturing unit 12 of the eye-tracking test system 1 of the first embodiment shown in FIG. 1.

[0072] In the example shown in FIG. 1, the calculation device 13 includes an eye image acquisition unit 13A, a gaze position measurement unit 13B, a target image acquisition unit 13C, a two-dimensional area identification unit 13D, a target position calculation unit 13E, a target position correction unit 13F, a target position vector calculation unit 13G, a target position vector decomposition unit 13H, a target movement direction discrimination unit 13I, a merge processing unit 13J, a latency calculation unit 13M, and a gain calculation unit 13L. The eye image acquiring unit 13A acquires the eye image (image of the subject's eye) captured by the eye image capturing unit 11, similar to the eye image acquiring unit 13A of the eye tracking test system 1 of the first embodiment shown in FIG. The gaze position measuring unit 13B, like the gaze position measuring unit 13B of the eye tracking test system 1 of the first embodiment shown in Figure 1, uses VOG to measure the gaze position of the subject based on the eye image (image of the subject's eye) acquired by the eye image acquiring unit 13A.

[0073] The target image acquiring unit 13C acquires a target image (an image including the target 10) photographed by the target image photographing unit 12, similar to the target image acquiring unit 13C of the target tracking test system 1 of the first embodiment shown in FIG. The two-dimensional area identification unit 13D, similar to the two-dimensional area identification unit 13D of the first embodiment of the target tracking test system 1 shown in Figure 1, uses an object recognition algorithm to identify a two-dimensional area 10A (see Figure 4) corresponding to the target 10 included in the target image acquired by the target image acquisition unit 13C. The target position calculation unit 13E, similar to the target position calculation unit 13E of the target tracking test system 1 of the first embodiment shown in Figure 1, calculates the position of the target 10 (the position of the target 10 on the target image) based on the two-dimensional area 10A identified by the two-dimensional area identification unit 13D. The target position correcting section 13F corrects the position of the target 10 calculated by the target position calculating section 13E, similar to the target position correcting section 13F of the target tracking test system 1 of the first embodiment shown in FIG.

[0074] The target position vector calculation unit 13G calculates the position vector of the target 10 based on the position of the target 10 corrected by the target position correction unit 13F, similar to the target position vector calculation unit 13G of the target tracking test system 1 of the first embodiment shown in Figure 1. The target position vector decomposition unit 13H decomposes the position vector of the target 10 calculated by the target position vector calculation unit 13G into left-right direction components and up-down direction components, similar to the target position vector decomposition unit 13H of the target tracking test system 1 of the first embodiment shown in Figure 1. Similar to the target movement direction discrimination unit 13I of the target tracking test system 1 of the first embodiment shown in FIG. 1, the target movement direction discrimination unit 13I determines whether the movement direction of the target 10 included in the target image acquired by the target image acquisition unit 13C corresponds to one of the "first movement," "second movement," "third movement," "fourth movement," "fifth movement," "sixth movement," "seventh movement," or "eighth movement" shown in FIG. 3, based on the left-right component of the position vector of the target 10 and the up-down component of the position vector of the target 10 decomposed by the target position vector decomposition unit 13H. The merge processing unit 13J, like the merge processing unit 13J of the eye target tracking test system 1 of the first embodiment shown in Figure 1, merges the eye target position of the subject measured by the eye target position measuring unit 13B, which is the eye target position of the subject at the time the eye target image acquired by the eye target image acquiring unit 13C was photographed by the eye target image photographing unit 12, into the eye target image.

[0075] As described above, in the example shown in Figure 1, the peak latency calculation unit 13K calculates the peak latency, which is the delay time from the time corresponding to the maximum value of the time waveform of the magnitude of the position vector of the target 10 to the time corresponding to the maximum value of the time waveform of the magnitude of the subject's gaze position vector. As mentioned above, depending on the subject (e.g., a patient with strabismus), the ``maximum value of the time waveform of the magnitude of the subject's gaze position vector'' may not be clearly visible, and neither may the ``minimum value of the time waveform of the magnitude of the subject's gaze position vector'' be clearly visible. In view of this, in the example shown in Figure 17, the latency calculation unit 13M calculates the latency, which is the delay time of the time waveform of the magnitude of the subject's gaze position vector relative to the time waveform of the magnitude of the position vector of the target 10, without using either the "maximum value of the time waveform of the magnitude of the subject's gaze position vector" or the "minimum value of the time waveform of the magnitude of the subject's gaze position vector."

[0076] FIG. 18 is a diagram for explaining and comparing the peak latency calculation method by the peak latency calculation unit 13K of the eye-tracking test system 1 of the first embodiment shown in FIG. 1 with the latency calculation method by the latency calculation unit 13M of the eye-tracking test system 1 of the fourth embodiment shown in FIG. 17. In detail, Fig. 18(A) shows a method for calculating the peak latency by the peak latency calculation unit 13K of the eye tracking test system 1 of the first embodiment. The horizontal axis of Fig. 18(A) indicates time, similar to the horizontal axes of Fig. 9(A), Fig. 9(B), Fig. 9(C), and Fig. 10, and the vertical axis of Fig. 18(A) indicates the magnitude of the position vector (specifically, the position vector of the eye target 10 and the gaze position vector of the subject's right eye), similar to the vertical axes of Fig. 9(A), Fig. 9(B), Fig. 9(C), and Fig. 10. In the example shown in Figure 18(A), the peak latency calculation unit 13K of the eye tracking test system 1 of the first embodiment calculates the peak latency, which is the delay time between the movement of the gaze position of the subject's right eye relative to the movement of the position of the eye target 10, based on the horizontal distance between the right arrow indicating the peak (maximum value) of the position vector of the eye target 10 and the right arrow indicating the peak (maximum value) of the gaze position vector of the subject's right eye.

[0077] Fig. 18(B) shows a method for calculating latency by the latency calculation unit 13M of the eye tracking test system 1 of the fourth embodiment. The horizontal axis of Fig. 18(B) indicates time, similar to the horizontal axes of Fig. 9(A), Fig. 9(B), Fig. 9(C), and Fig. 10, and the vertical axis of Fig. 18(A) indicates the magnitude of the position vector (more specifically, the position vector of the eye target 10 and the gaze position vector of the subject's right eye), similar to the vertical axes of Fig. 9(A), Fig. 9(B), Fig. 9(C), and Fig. 10. In the example shown in Figure 18(B), the latency calculation unit 13M of the eye tracking test system 1 of the fourth embodiment calculates the similarity between the time waveform of the magnitude of the position vector of the eye target 10 and the time waveform of the magnitude of the gaze position vector of the subject's right eye by using a cross-correlation function to obtain the latency, which is the delay time between the movement of the position of the eye target 10 and the movement of the gaze position of the subject's right eye.

[0078] 18(B), the latency calculation unit 13M calculates the similarity between the time waveform of the magnitude of the position vector of the unshifted target 10 and the time waveform of the magnitude of the gaze position vector of the subject's right eye. The similarity value calculated by the latency calculation unit 13M is low. Furthermore, the latency calculation unit 13M calculates the similarity between the time waveform of the magnitude of the position vector of the target 10 advanced by n seconds (moved to the right in FIG. 18(B)) (the time waveform indicated by the dashed line as "t+n seconds" in FIG. 18(B)) and the time waveform of the magnitude of the gaze position vector of the subject's right eye. The similarity value calculated by the latency calculation unit 13M is low. Furthermore, the latency calculation unit 13M calculates the similarity between the time waveform of the magnitude of the position vector of the target 10 delayed by n seconds (moved to the left in FIG. 18(B)) (the time waveform indicated by the dashed line "tn seconds" in FIG. 18(B)) and the time waveform of the magnitude of the gaze position vector of the subject's right eye. The similarity value calculated by the latency calculation unit 13M is low.

[0079] Furthermore, the latency calculation unit 13M calculates the similarity between the time waveform of the magnitude of the position vector of the target 10 delayed by 2n seconds (moved to the left in FIG. 18(B)) (the time waveform indicated by the dashed line as "t-2n seconds" in FIG. 18(B)) and the time waveform of the magnitude of the gaze position vector of the subject's right eye. The similarity value calculated by the latency calculation unit 13M is a high value. Furthermore, the latency calculation unit 13M calculates the similarity between the time waveform of the magnitude of the position vector of the target 10 delayed by 3n seconds (moved to the left in FIG. 18(B)) (the time waveform indicated by the dashed line as "t-3n seconds" in FIG. 18(B)) and the time waveform of the magnitude of the gaze position vector of the subject's right eye. The similarity value calculated by the latency calculation unit 13M is low.

[0080] In the example shown in Figure 18(B), the similarity value is greatest when the time waveform of the magnitude of the position vector of the visual target 10 is delayed by 2n [seconds], so the latency calculation unit 13M calculates 2n [seconds] as the latency, which is the delay time of the time waveform of the magnitude of the subject's gaze position vector relative to the time waveform of the magnitude of the position vector of the visual target 10. 17, the latency calculation unit 13M calculates the similarity between the time waveform of the magnitude of the position vector of the visual target 10 delayed by a predetermined delay time (n [seconds], 2n [seconds], and 3n [seconds] in the example shown in FIG. 18(B)), and the time waveform of the magnitude of the gaze position vector of the subject. Furthermore, the latency calculation unit 13M calculates the predetermined delay time (2n [seconds] in the example shown in FIG. 18(B)) when the similarity value is greatest as the latency, which is the delay time of the time waveform of the magnitude of the gaze position vector of the subject relative to the time waveform of the magnitude of the position vector of the visual target 10.

[0081] FIG. 19 is a diagram showing an example of a comparison result between the peak latency calculated by the peak latency calculation unit 13K of the eye-tracking test system 1 of the first embodiment and the latency calculated by the latency calculation unit 13M of the eye-tracking test system 1 of the fourth embodiment. In the example shown in Figure 19, the peak latency calculation unit 13K of the eye tracking test system 1 of the first embodiment calculated 94.20 ± 82.62 [ms] as the peak latency, which is the delay in tracking of the gaze position of the subject's left eye with respect to the first movement of the eye target 10 (movement between the reference position 10P0 and the first position (position corresponding to the left front of the subject) 10P1), and the latency calculation unit 13M of the eye tracking test system 1 of the fourth embodiment calculated 96.13 ± 108.32 [ms] as the latency, which is the delay in tracking of the gaze position of the subject's left eye with respect to the first movement of the eye target 10 (movement between the reference position 10P0 and the first position 10P1). The peak latency calculation unit 13K of the eye tracking test system 1 of the first embodiment calculated 108.70±82.37 [ms] as the peak latency, which is the delay in tracking of the gaze position of the subject's left eye with respect to the second movement of the eye target 10 (movement between the reference position 10P0 and the second position (position corresponding to the right front of the subject) 10P2), and the latency calculation unit 13M of the eye tracking test system 1 of the fourth embodiment calculated 106.17±93.82 [ms] as the latency, which is the delay in tracking of the gaze position of the subject's left eye with respect to the second movement of the eye target 10 (movement between the reference position 10P0 and the second position 10P2).

[0082] The peak latency calculation unit 13K of the eye tracking test system 1 of the first embodiment calculated 140.58±105.39 [ms] as the peak latency, which is the delay in tracking of the gaze position of the subject's left eye with respect to the fourth movement of the eye target 10 (movement between the reference position 10P0 and the fourth position (a position corresponding to the upper left front of the subject) 10P4), and the latency calculation unit 13M of the eye tracking test system 1 of the fourth embodiment calculated 129.13±96.29 [ms] as the latency, which is the delay in tracking of the gaze position of the subject's left eye with respect to the fourth movement of the eye target 10 (movement between the reference position 10P0 and the fourth position 10P4). The peak latency calculation unit 13K of the eye tracking test system 1 of the first embodiment calculated 113.04±95.67 [ms] as the peak latency, which is the delay in tracking of the gaze position of the subject's left eye with respect to the fifth movement of the eye target 10 (movement between the reference position 10P0 and the fifth position 10P5 (a position corresponding to the upper right front of the subject)), and the latency calculation unit 13M of the eye tracking test system 1 of the fourth embodiment calculated 133.43±155.84 [ms] as the latency, which is the delay in tracking of the gaze position of the subject's left eye with respect to the fifth movement of the eye target 10 (movement between the reference position 10P0 and the fifth position 10P5).

[0083] The peak latency calculation unit 13K of the eye tracking test system 1 of the first embodiment calculated 155.07±103.38 [ms] as the peak latency, which is the delay in tracking of the gaze position of the subject's left eye with respect to the seventh movement of the eye target 10 (movement between the reference position 10P0 and the seventh position 10P7 (a position corresponding to the lower left front of the subject)), and the latency calculation unit 13M of the eye tracking test system 1 of the fourth embodiment calculated 154.96±122.10 [ms] as the latency, which is the delay in tracking of the gaze position of the subject's left eye with respect to the seventh movement of the eye target 10 (movement between the reference position 10P0 and the seventh position 10P7). The peak latency calculation unit 13K of the eye tracking test system 1 of the first embodiment calculated 182.61±112.02 [ms] as the peak latency, which is the delay in tracking of the gaze position of the subject's left eye with respect to the eighth movement of the eye target 10 (movement between the reference position 10P0 and the eighth position 10P8 (a position corresponding to the lower right front of the subject)), and the latency calculation unit 13M of the eye tracking test system 1 of the fourth embodiment calculated 139.17±97.78 [ms] as the latency, which is the delay in tracking of the gaze position of the subject's left eye with respect to the eighth movement of the eye target 10 (movement between the reference position 10P0 and the eighth position 10P8).

[0084] The peak latency calculation unit 13K of the eye tracking test system 1 of the first embodiment calculated 102.90±66.60 [ms] as the peak latency, which is the delay in tracking of the gaze position of the subject's left eye with respect to the third movement of the eye target 10 (movement between the reference position 10P0 and the third position (a position corresponding to the upper front of the subject) 10P3), and the latency calculation unit 13M of the eye tracking test system 1 of the fourth embodiment calculated 106.17±97.29 [ms] as the latency, which is the delay in tracking of the gaze position of the subject's left eye with respect to the third movement of the eye target 10 (movement between the reference position 10P0 and the third position 10P3). The peak latency calculation unit 13K of the eye tracking test system 1 of the first embodiment calculated 120.29±99.15 [ms] as the peak latency, which is the delay in tracking of the gaze position of the subject's left eye with respect to the sixth movement of the eye target 10 (movement between the reference position 10P0 and the sixth position 10P6 (a position corresponding to the lower front of the subject)), and the latency calculation unit 13M of the eye tracking test system 1 of the fourth embodiment calculated 110.48±92.12 [ms] as the latency, which is the delay in tracking of the gaze position of the subject's left eye with respect to the sixth movement of the eye target 10 (movement between the reference position 10P0 and the sixth position 10P6).

[0085] In addition, in the example shown in Figure 19, the peak latency calculation unit 13K of the eye tracking test system 1 of the first embodiment calculated 123.19 ± 85.37 [ms] as the peak latency, which is the delay in tracking of the gaze position of the subject's right eye with respect to the first movement of the eye target 10 (movement between the reference position 10P0 and the first position (position corresponding to the left front of the subject) 10P1), and the latency calculation unit 13M of the eye tracking test system 1 of the fourth embodiment calculated 104.74 ± 106.89 [ms] as the latency, which is the delay in tracking of the gaze position of the subject's right eye with respect to the first movement of the eye target 10 (movement between the reference position 10P0 and the first position 10P1). The peak latency calculation unit 13K of the eye tracking test system 1 of the first embodiment calculated 107.25±99.74 [ms] as the peak latency, which is the delay in tracking of the gaze position of the subject's right eye with respect to the second movement of the eye target 10 (movement between the reference position 10P0 and the second position (position corresponding to the right front of the subject) 10P2), and the latency calculation unit 13M of the eye tracking test system 1 of the fourth embodiment calculated 99.00±123.09 [ms] as the latency, which is the delay in tracking of the gaze position of the subject's right eye with respect to the second movement of the eye target 10 (movement between the reference position 10P0 and the second position 10P2).

[0086] The peak latency calculation unit 13K of the eye tracking test system 1 of the first embodiment calculated 169.56±107.64 [ms] as the peak latency, which is the delay in tracking of the gaze position of the subject's right eye with respect to the fourth movement of the eye target 10 (movement between the reference position 10P0 and the fourth position (a position corresponding to the upper left front of the subject) 10P4), and the latency calculation unit 13M of the eye tracking test system 1 of the fourth embodiment calculated 146.35±106.97 [ms] as the latency, which is the delay in tracking of the gaze position of the subject's right eye with respect to the fourth movement of the eye target 10 (movement between the reference position 10P0 and the fourth position 10P4). The peak latency calculation unit 13K of the eye tracking test system 1 of the first embodiment calculated 127.54±92.55 [ms] as the peak latency, which is the delay in tracking of the gaze position of the subject's right eye with respect to the fifth movement of the eye target 10 (movement between the reference position 10P0 and the fifth position 10P5 (a position corresponding to the upper right front of the subject)), and the latency calculation unit 13M of the eye tracking test system 1 of the fourth embodiment calculated 114.78±101.54 [ms] as the latency, which is the delay in tracking of the gaze position of the subject's right eye with respect to the fifth movement of the eye target 10 (movement between the reference position 10P0 and the fifth position 10P5).

[0087] The peak latency calculation unit 13K of the eye tracking test system 1 of the first embodiment calculated 162.32±119.70 [ms] as the peak latency, which is the delay in tracking of the gaze position of the subject's right eye with respect to the seventh movement of the eye target 10 (movement between the reference position 10P0 and the seventh position 10P7 (a position corresponding to the lower left front of the subject)), and the latency calculation unit 13M of the eye tracking test system 1 of the fourth embodiment calculated 170.74±106.00 [ms] as the latency, which is the delay in tracking of the gaze position of the subject's right eye with respect to the seventh movement of the eye target 10 (movement between the reference position 10P0 and the seventh position 10P7). The peak latency calculation unit 13K of the eye tracking test system 1 of the first embodiment calculated 173.91±100.22 [ms] as the peak latency, which is the delay in tracking of the gaze position of the subject's right eye with respect to the eighth movement of the eye target 10 (movement between the reference position 10P0 and the eighth position 10P8 (a position corresponding to the lower right front of the subject)), and the latency calculation unit 13M of the eye tracking test system 1 of the fourth embodiment calculated 173.61±243.90 [ms] as the latency, which is the delay in tracking of the gaze position of the subject's right eye with respect to the eighth movement of the eye target 10 (movement between the reference position 10P0 and the eighth position 10P8).

[0088] The peak latency calculation unit 13K of the eye tracking test system 1 of the first embodiment calculated 115.94±106.72 [ms] as the peak latency, which is the delay in tracking of the gaze position of the subject's right eye with respect to the third movement of the eye target 10 (movement between the reference position 10P0 and the third position (a position corresponding to the upper front of the subject) 10P3), and the latency calculation unit 13M of the eye tracking test system 1 of the fourth embodiment calculated 88.96±99.92 [ms] as the latency, which is the delay in tracking of the gaze position of the subject's right eye with respect to the third movement of the eye target 10 (movement between the reference position 10P0 and the third position 10P3). The peak latency calculation unit 13K of the eye tracking test system 1 of the first embodiment calculated 117.39±98.23 [ms] as the peak latency, which is the delay in tracking of the gaze position of the subject's right eye with respect to the sixth movement of the eye target 10 (movement between the reference position 10P0 and the sixth position 10P6 (a position corresponding to the lower front of the subject)), and the latency calculation unit 13M of the eye tracking test system 1 of the fourth embodiment calculated 144.91±211.80 [ms] as the latency, which is the delay in tracking of the gaze position of the subject's right eye with respect to the sixth movement of the eye target 10 (movement between the reference position 10P0 and the sixth position 10P6).

[0089] As shown in FIG. 19, not only can the peak latency calculation unit 13K of the eye tracking test system 1 of the first embodiment properly calculate the delay in the tracking ability of the subject's gaze position with respect to the movement of the eye target 10 as the peak latency, but also the latency calculation unit 13M of the eye tracking test system 1 of the fourth embodiment properly calculate the delay in the tracking ability of the subject's gaze position with respect to the movement of the eye target 10 as the latency.

[0090] In the example shown in FIG. 17, the gain calculation unit 13L calculates a gain, which is the ratio of the slope of the time waveform of the magnitude of the gaze position vector of the subject to the slope of the time waveform of the magnitude of the position vector of the target 10, similar to the gain calculation unit 13L of the eye tracking test system 1 of the first embodiment shown in FIG.

[0091] Although the embodiments of the present invention have been described in detail above with reference to the drawings, the specific configuration is not limited to this embodiment and can be appropriately modified without departing from the spirit of the present invention. The configurations described in the above-described embodiments and examples may be combined.

[0092] All or part of the eye-tracking test system 1 in the above embodiment may be realized by dedicated hardware, or may be realized by a memory and a microprocessor. In addition, all or part of the eye tracking test system 1 may be composed of a memory and a CPU (central processing unit), and the functions of each part of each system may be realized by loading a program into memory and executing the program. It is also possible to record a program for realizing all or part of the functions of the eye tracking test system 1 on a computer-readable recording medium, and have the computer system load and execute the program to perform processing for each part. Note that the term "computer system" here includes hardware such as the OS and peripheral devices. Furthermore, if a WWW system is used, the term "computer system" also includes the homepage provision environment (or display environment). "Computer-readable recording media" refers to portable media such as flexible disks, optical magnetic disks, ROMs, and CD-ROMs, as well as storage devices such as hard disks built into computer systems. Furthermore, "computer-readable recording media" also includes devices that dynamically store programs for a short period of time, such as communication lines used when transmitting programs over networks like the Internet or over communication lines like telephone lines, and devices that store programs for a fixed period of time, such as volatile memory within computer systems that serve as servers or clients. The programs may also be programs that implement some of the aforementioned functions, or may be programs that can realize the aforementioned functions in combination with programs already stored in the computer system. [Explanation of symbols]

[0093] 1...eye target tracking inspection system, 10...eye target, 10A...two-dimensional area, 10P0...reference position, 10P1...first position, 10P2...second position, 10P3...third position, 10P4...fourth position, 10P5...fifth position, 10P6...sixth position, 10P7...seventh position, 10P8...eighth position, 11...eye image capturing unit, 12...eye target image capturing unit, 13...computing device, 13A...eye image Acquisition unit, 13B...gaze position measurement unit, 13C...visual target image acquisition unit, 13D...two-dimensional area identification unit, 13E...visual target position calculation unit, 13F...visual target position correction unit, 13G...visual target position vector calculation unit, 13H...visual target position vector decomposition unit, 13I...visual target movement direction discrimination unit, 13J...merge processing unit, 13K...peak latency calculation unit, 13L...gain calculation unit, 13M...latency calculation unit

Claims

1. an eye target image capturing unit configured to capture an eye target image including an eye target used in an eye target tracking test of a subject; and a computing device, In the eye-tracking test, a first movement of the visual target in which the visual target is moved from a reference position of the visual target to a first position that is a position on one side of the reference position in a left-right direction, and then moved from the first position to the reference position; a second movement of the visual target in which the visual target is moved from the reference position to a second position that is a position on the other side of the reference position in the left-right direction, and then moved from the second position to the reference position; a third movement of the visual target, in which the visual target is moved from the reference position to a third position that is a position on one side of the reference position in the vertical direction, and then moved from the third position to the reference position; a fourth movement of the visual target, in which the visual target is moved from the reference position to a fourth position that is a position on one side in the left-right direction and one side in the up-down direction relative to the reference position, and then moved from the fourth position to the reference position; a fifth movement of the visual target, in which the visual target is moved from the reference position to a fifth position that is a position on the other side in the left-right direction and one side in the up-down direction of the reference position, and then moved from the fifth position to the reference position; a sixth movement of the visual target, in which the visual target is moved from the reference position to a sixth position that is a position on the other side of the reference position in the vertical direction, and then moved from the sixth position to the reference position; a seventh movement of the visual target, in which the visual target is moved from the reference position to a seventh position that is a position on one side in the left-right direction and on the other side in the up-down direction from the reference position, and then moved from the seventh position to the reference position; the target is moved from the reference position to an eighth position, which is a position on the other side in the left-right direction and the other side in the up-down direction from the reference position, and then an eighth movement of the target is performed, in which the target is moved from the eighth position to the reference position; The computing device an optotype image acquisition unit that acquires the optotype image captured by the optotype image capture unit; a two-dimensional area specifying unit that specifies a two-dimensional area corresponding to the visual target included in the visual target image acquired by the visual target image acquiring unit by using an object recognition algorithm; a target position calculation unit that calculates a position of the target based on the two-dimensional area specified by the two-dimensional area specification unit; a target position correction unit that corrects the position of the target calculated by the target position calculation unit; a target position vector calculation unit that calculates a position vector of the target based on the position of the target corrected by the target position correction unit; a target position vector decomposition unit that decomposes the target position vector calculated by the target position vector calculation unit into a left-right direction component and an up-down direction component; a target movement direction discrimination unit that determines whether a movement direction of the target included in the target image acquired by the target image acquisition unit corresponds to the first movement, the second movement, the third movement, the fourth movement, the fifth movement, the sixth movement, the seventh movement, or the eighth movement, based on a left-right direction component of the position vector of the target and an up-down direction component of the position vector of the target decomposed by the target position vector decomposition unit, Eye tracking testing system.

2. The target position correction unit correcting the position of the visual target so that the reference position of the visual target included in the visual target image acquired by the visual target image acquisition unit substantially coincides with a visual target image center position, which is a center position of the visual target image in the horizontal direction and the vertical direction; The eye-tracking testing system of claim 1 .

3. The magnitude of the position vector of the target calculated by the target position vector calculation unit indicates the distance between the center position of the target image and the position of the target corrected by the target position correction unit. The eye-tracking testing system of claim 2 .

4. a period from a time corresponding to a first minimum value of the time waveform of the magnitude of the position vector of the visual target calculated by the visual target position vector calculation unit to a time corresponding to a second minimum value adjacent to the first minimum value is a period for which the visual target movement direction discrimination unit is to discriminate the movement direction of the visual target; The eye-tracking examination system of claim 3 .

5. The target movement direction determination unit determining whether the movement direction of the visual target corresponds to the first movement, the second movement, the third movement, the fourth movement, the fifth movement, the sixth movement, the seventh movement, or the eighth movement, based on the maximum value and / or the minimum value of the time waveform of the left-right direction component of the position vector of the visual target during a period to be determined for the movement direction of the visual target, and the maximum value and / or the minimum value of the time waveform of the up-down direction component of the position vector of the visual target during a period to be determined for the movement direction of the visual target; 5. The eye-tracking testing system of claim 4.

6. an eye image capturing unit configured to capture an eye image of the subject's eye; The computing device an eye image acquisition unit that acquires the eye image captured by the eye image capturing unit; a gaze position measuring unit that measures a gaze position of a subject based on the eye image acquired by the eye image acquiring unit by using VOG (Video-oculography); a merging processing unit that merges the gaze position of the subject measured by the gaze position measuring unit, which is the gaze position of the subject at the time when the gaze image acquired by the gaze target image acquiring unit was photographed by the gaze target image photographing unit, with the gaze target image; The target image into which the gaze position of the subject is merged by the merging processing unit is the target image in which the position of the target has not been corrected by the target position correction unit. The eye-tracking testing system of claim 1 .

7. The computing device a peak latency calculation unit that calculates a peak latency, which is a delay time from a time corresponding to a maximum value of the time waveform of the magnitude of the position vector of the target to a time corresponding to a maximum value of the time waveform of the magnitude of the gaze position vector of the subject; 7. The eye-tracking testing system of claim 6.

8. The computing device a gain calculation unit that calculates a gain that is a ratio of a slope of a time waveform of the magnitude of the gaze position vector of the subject to a slope of a time waveform of the magnitude of the position vector of the target; 7. The eye-tracking testing system of claim 6.

9. The computing device calculating a similarity between a time waveform obtained by delaying the time waveform of the magnitude of the position vector of the target by a predetermined delay time and a time waveform of the magnitude of the gaze position vector of the subject; a latency calculation unit that calculates the predetermined delay time when the value of the similarity is greatest as a latency that is a delay time of a time waveform of a magnitude of a gaze position vector of the subject relative to a time waveform of a magnitude of a position vector of the target, 7. The eye-tracking testing system of claim 6.

10. an eye target image capturing step of capturing an eye target image that is an image including an eye target used in an eye tracking test of a subject; A method for eye tracking testing comprising a calculation step, In the eye-tracking test, a first movement of the visual target in which the visual target is moved from a reference position of the visual target to a first position that is a position on one side of the reference position in a left-right direction, and then moved from the first position to the reference position; a second movement of the visual target in which the visual target is moved from the reference position to a second position that is a position on the other side of the reference position in the left-right direction, and then moved from the second position to the reference position; a third movement of the visual target, in which the visual target is moved from the reference position to a third position that is a position on one side of the reference position in the vertical direction, and then moved from the third position to the reference position; a fourth movement of the visual target, in which the visual target is moved from the reference position to a fourth position that is a position on one side in the left-right direction and one side in the up-down direction relative to the reference position, and then moved from the fourth position to the reference position; a fifth movement of the visual target, in which the visual target is moved from the reference position to a fifth position that is a position on the other side in the left-right direction and one side in the up-down direction of the reference position, and then moved from the fifth position to the reference position; a sixth movement of the visual target, in which the visual target is moved from the reference position to a sixth position that is a position on the other side of the reference position in the vertical direction, and then moved from the sixth position to the reference position; a seventh movement of the visual target, in which the visual target is moved from the reference position to a seventh position that is a position on one side in the left-right direction and on the other side in the up-down direction from the reference position, and then moved from the seventh position to the reference position; the target is moved from the reference position to an eighth position, which is a position on the other side in the left-right direction and the other side in the up-down direction from the reference position, and then an eighth movement of the target is performed, in which the target is moved from the eighth position to the reference position; The calculation step includes: a visual target image acquiring step of acquiring the visual target image photographed in the visual target image photographing step; a two-dimensional area specifying step of specifying a two-dimensional area corresponding to the target included in the target image acquired in the target image acquiring step by using an object recognition algorithm; a target position calculation step of calculating a position of the target based on the two-dimensional area specified in the two-dimensional area specification step; a target position correcting step of correcting the position of the target calculated in the target position calculating step; a target position vector calculation step of calculating a position vector of the target based on the position of the target corrected in the target position correction step; a target position vector decomposition step of decomposing the target position vector calculated in the target position vector calculation step into a left-right direction component and an up-down direction component; and a target movement direction determining step of determining whether the movement direction of the target included in the target image acquired in the target image acquiring step corresponds to any one of the first movement, the second movement, the third movement, the fourth movement, the fifth movement, the sixth movement, the seventh movement, and the eighth movement, based on the left-right direction component of the position vector of the target decomposed in the target position vector decomposition step and the up-down direction component of the position vector of the target. Eye-tracking testing method.

11. In the subject's eye tracking test, a first movement of the visual target used in the eye-tracking test, in which the visual target is moved from a reference position of the visual target to a first position that is a position on one side of the reference position in a left-right direction, and then moved from the first position to the reference position; a second movement of the visual target in which the visual target is moved from the reference position to a second position that is a position on the other side of the reference position in the left-right direction, and then moved from the second position to the reference position; a third movement of the visual target, in which the visual target is moved from the reference position to a third position that is a position on one side of the reference position in the vertical direction, and then moved from the third position to the reference position; a fourth movement of the visual target, in which the visual target is moved from the reference position to a fourth position that is a position on one side in the left-right direction and one side in the up-down direction relative to the reference position, and then moved from the fourth position to the reference position; a fifth movement of the visual target, in which the visual target is moved from the reference position to a fifth position that is a position on the other side in the left-right direction and one side in the up-down direction of the reference position, and then moved from the fifth position to the reference position; a sixth movement of the visual target, in which the visual target is moved from the reference position to a sixth position that is a position on the other side of the reference position in the vertical direction, and then moved from the sixth position to the reference position; a seventh movement of the visual target, in which the visual target is moved from the reference position to a seventh position that is a position on one side in the left-right direction and on the other side in the up-down direction from the reference position, and then moved from the seventh position to the reference position; the target is moved from the reference position to an eighth position, which is a position on the other side in the left-right direction and the other side in the up-down direction from the reference position, and then an eighth movement of the target is performed, in which the target is moved from the eighth position to the reference position; To the computer a target image acquiring step of acquiring a target image including the target photographed by a target image photographing unit; a two-dimensional area specifying step of specifying a two-dimensional area corresponding to the target included in the target image acquired in the target image acquiring step by using an object recognition algorithm; a target position calculation step of calculating a position of the target based on the two-dimensional area specified in the two-dimensional area specification step; a target position correcting step of correcting the position of the target calculated in the target position calculating step; a target position vector calculation step of calculating a position vector of the target based on the position of the target corrected in the target position correction step; a target position vector decomposition step of decomposing the target position vector calculated in the target position vector calculation step into a left-right direction component and an up-down direction component; and a target movement direction determination step of determining whether the movement direction of the target included in the target image acquired in the target image acquisition step corresponds to the first movement, the second movement, the third movement, the fourth movement, the fifth movement, the sixth movement, the seventh movement, or the eighth movement, based on the left-right component of the target position vector and the up-down component of the target position vector decomposed in the target position vector decomposition step.

Images