System and method for detecting neurological disorders and for measuring general cognitive performance

The system uses an eye tracker and processor to analyze gaze tracking and pupil diameter data to detect neuropathies and cognitive impairments, offering precise identification of various cognitive declines through comprehensive eye movement analysis.

JP2025108439APending Publication Date: 2025-07-23ビューマインドインコーポレイテッド
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
JP2025045564
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2018-01-16
Filing Date
2025-03-19
Publication Date
2025-07-23

AI Technical Summary

Technical Problem

A widely available tool for diagnosing neuropathy has not been developed, and existing systems for detecting cognitive impairments through eye movements lack comprehensive analysis of gaze tracking and pupil diameter data to accurately assess various neuropathies and cognitive abilities.

Method used

A system comprising an eye tracker, processor, and display means that analyzes gaze tracking and pupil diameter data to detect neuropathies by counting fixations, measuring saccade amplitudes, and reporting cognitive declines, using intelligent algorithms to classify eye movement characteristics and report neuropathies and cognitive abilities.

Benefits of technology

The system provides accurate detection of neuropathies and cognitive impairments by analyzing gaze tracking and pupil diameter data, enabling precise identification of attentional, working memory, and retrieval memory declines, as well as executive function issues.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025108439000001_ABST
    Figure 2025108439000001_ABST
Patent Text Reader

Abstract

To provide a widely available tool for diagnosing neurological disorders, which has been needed for a long time.SOLUTION: A system 100 comprises an eye tracker 10 configured to monitor eye movements, means 17 for measuring a pupil diameter, a processor 20, and display means 40. The processor is configured to receive eye-tracking data from the eye tracker, to receive pupil diameter data from the means for measuring the pupil diameter, to analyze the eye-tracking and pupil diameter data, and to report a detection or non-detection of one or more disorders of memory binding function in a subject by displaying a test report 50 on the display means.SELECTED DRAWING: Figure 2
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a system and method for detecting neuropathy and measuring general cognitive ability, and more particularly, for performing such by measuring pupil diameter during eye movement and / or an eye movement task.

Background Art

[0002] Using eye tracking as a diagnostic tool has been practiced in the art.

[0003] U.S. Patent No. 4,889,422 discloses an automated system for determining the presence of dyslexia. This system includes eye stimulation means, an eye movement detector, a processor for collecting data representing eye position over time, and an analysis program for analyzing the data and classifying eye movements into micro movements, saccade movements, tracking movements, convergence / divergence movements, fixations, and blinks. If the total number of fixations is greater than the number of visual stimuli, a first indicator of dyslexia is registered.

[0004] Fielding et al. published "Ocular motor measures of cognitive dysfunction in multiple sclerosis II: working memory" (J Nerol, published online on April 9, 2015), which discloses an experiment that tested the working memory of patients with clinically definite multiple sclerosis (CDMS) or clinically isolated syndrome (CIS) using an eye examination that measured task error, saccade latency, and relative sensitivity to the load of working memory.

Prior Art Documents

Patent Documents

[0005]

Patent Document 1

Non-Patent Document

[0006]

Non-Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0007] A widely available tool for diagnosing neuropathy has been needed for many years.

Means for Solving the Problems

[0008] It is an object of the present invention to provide a system for detecting one or more neuropathies in a subject by measuring eye movements, the measurement of eye movements being performed while the subject is reading, and the system comprising a. an eye tracker

[10] configured to monitor the eye movements of a subject [5] while the subject [5] is reading text

[15] ; b. a processor

[20] configured to receive data from the eye tracker

[10] while the subject [5] is reading text

[15] ; c. a display means

[40] configured to display a test report

[50] received from the processor

[20] and the processor

[20] is further configured to analyze the gaze tracking data for one or more neuropathies or bases of general cognitive ability and report the detection of one or more neuropathies or the measurement of cognitive ability of the subject [5] in the test report

[50] .

[0009] For another object of the present invention described above, when the processor receives the gaze tracking data from the eye tracker, a. Count the total number of fixations of the subject while reading the text; b. If the total number of fixations of the subject while reading exceeds that of the control group, report in the test report that a compromise in the attentional process is detected; and is further configured to perform the above.

[0010] For another object of the present invention described above, when the processor receives the gaze tracking data from the eye tracker, a. Count the number of forward fixations of the subject while reading the text; b. If the number of forward fixations of the subject is less than that of the control group and the number of fixations of the subject while reading exceeds that of the control group, report in the test report

[50] that a decline in working memory is detected; and is further configured to perform the above.

[0011] For another object of the present invention described above, when the processor receives the gaze tracking data from the eye tracker, a. Count the number of words fixated on only once by the subject while reading the text; b. If the number of words fixated on only once by the subject is less than that of the control group, report in the test report that a decline in retrieval memory is detected; and is further configured to perform the above.

[0012] For another object of the present invention described above, when the processor receives the gaze tracking data from the eye tracker, a. Count the number of multiple fixations of the subject while reading the text; b. If the number of multiple fixations exceeds that of the control group, report in the test report that a decrease during the execution process is detected and is further configured to perform.

[0013] Another object of the present invention is to detect one or more neuropathies in a subject by measuring eye movements. When the processor receives gaze tracking data from an eye tracker, a. Calculate the average saccade amplitude from one fixation to the next fixation; b. If the average saccade amplitude is lower than that of the control group, report in the test report that a decrease during the execution process is detected and is further configured to perform.

[0014] For another object of the present invention described above, it further comprises means

[17] for measuring the pupil diameter of the subject, and the processor a. Track the pupil diameter of the subject while reading the text; b. If the pupil diameter of the subject does not show constriction as the subject reads further through the text, report in the test report that a decrease during the execution process is detected and is further configured to perform.

[0015] It is an object of the present invention to provide a system for detecting one or more neuropathies, and to measure eye movements and pupil movements and check the cognitive ability of a subject by applying an intelligent algorithm. The measurement of eye movements is performed while the subject is reading. This system a. An eye tracker

[10] , configured to monitor the eye movements and pupil movements of the subject [5] while the subject [5] is reading the text

[15] ; b. A processor

[20] configured to receive data from an eye tracker

[10] while a subject [5] is reading text

[15] ; c. An intelligent algorithm for learning, identifying, classifying, and categorizing eye movement characteristics in and within a pathology; d. A display means

[40] configured to display the output of the intelligent algorithm on a test report

[50] received from the processor

[20] ; comprising; The processor

[20] is further configured to analyze and model the eye-tracking data with respect to one or more bases of neuropathy and cognitive ability, and to report in the test report

[50] the detection and classification of one or more neuropathies of the subject [5] both between and within pathologies.

[0016] For another object of the present invention described above, when the processor receives eye-tracking data from the eye tracker, it identifies and classifies the eye movement characteristics and pupil movement during text reading, and provides the output of a classifier for reporting the cognitive ability and / or pathological classification of the subject (i.e., the pathology corresponding to the subject from the subject's eye movement characteristics) in a test report, and values within the pathology (i.e., the level of cognitive, behavioral, and biological decline shown by the subject within a specific pathology).

[0017] For another object of the present invention described above, the intelligent algorithm is configured to read at least one input, the input being selected from the group consisting of: a. An index of the total number of the subject's fixations while reading text. b. An index of the subject's forward fixations while reading text. c. An index of the words that the subject fixated on only once while reading text. d. An index of multiple fixations of the subject while reading text. e. Average saccade amplitude from one fixation to the next. f. Pupil diameter of the subject while reading text. g. Blink index obtained from the left eye, right eye, or both eyes. h. Microsaccades' Factors of Form (FF), namely i. HEWI: Indicates the height / width relationship of microsaccades. ii. AREA: Indicates the area of the rectangle inscribed by microsaccades. iii. LONG: Is the length of the trajectory of microsaccades in the horizontal-vertical plane. iv. ANG: Is the sum of all angles of microsaccades in the horizontal-vertical plane. v. AANG: Is the sum of the absolute values of all angles of microsaccades in radians in the horizontal-vertical plane. These last two FFs estimate the regularity of the microsaccade trajectory. vi. MOD and THETA: Are the modulus and angle of the polar coordinates of the sum of Cartesian coordinates. These give the spatial localization of microsaccades with respect to the fixation median. vii. TIME: Is the duration of microsaccades in milliseconds. viii. VMIN and VMAX: Are the minimum and maximum speeds of microsaccades in degrees per second. ix. Microsaccade rate: Is the instantaneous rate in each time bin. x. Direction consistency: Is the consistency between the microsaccade direction and the position of the stimulus. i. Eye position (i.e., horizontal and vertical coordinates) obtained from the left eye, right eye, or both eyes while reading text. j. Fixation sequence (i.e., eye movement) while reading text. The sequence can be obtained from images, matrices, etc. k. Distance of separation between fixations while reading text. l. The filia information of the subject (i.e., age, number of years of education, gender, race, occupation, physical activity time per week). m. Total reading time (i.e., the time spent by the subject while reading the text).

[0018] It is an object of the present invention to provide a method

[0300] for evaluating a decline in nerve function associated with multiple sclerosis [MS], and this method a. Providing a system

[0305] for evaluating a decline in nerve function associated with MS; b. Requesting the subject to fixate on a reference target of the chart

[0310] ; c. Presenting a stimulus image to the subject in one of the zones during several repetitions

[0315] , wherein the subject is required to remember in which zone and in what order each stimulus image appeared; the presenting step; d. Presenting a cue corresponding to one of the presented stimulus images to the subject

[0320] ; e. Measuring the saccade of the subject in response to the presenting of the cue

[0325] , wherein the subject is required to look at the zone where the stimulus image corresponding to the cue was presented; the measuring step; f. Repeating the step of presenting the cue and the step of measuring the saccade

[0330] ; g. Repeating steps b - f for several trials

[0335] ; h. i. The WM effect

[0340] (i.e., the WM effect is a measure that increases when WM demand increases. For each cue number, the WM effect is represented by the ratio of the number of errors reported by the subject over all trials to the number of trials), and ii. The average saccade latency

[0345] , wherein the saccade latency is defined as the amount of time it takes for the subject to initiate a saccade to the zone; the average saccade latency calculating one or more of them; i. i. the degree of decrease in working memory as the WM effect increases

[0350] , and ii. the degree of decrease during the execution process as the saccade latency increases

[0355] reporting one or more of them; and j. The method further includes additional steps including measurements taken during the step of presenting the stimulus image

[0315] , during which the subject is further required to look at the stimulus image, and this measurement is i. the amplitude of the pupil dilation of the subject

[0360] , ii. the number of fixations made by the subject on the stimulus image

[0365] , and iii. the duration of fixation on the stimulus image by the subject

[0370] including measuring one or more of them; k. The additional steps are i. the degree of decrease in the subcortical process as the amplitude of pupil dilation increases

[0375] , ii. the degree of decrease in the execution process as the number of fixations increases

[0380] , and iii. the degree of decrease in the execution process and working memory as the fixation duration increases

[0385] further including calculating and reporting one or more of them.

[0019] For another object of the present invention described above, the reference target is at the central position of the chart, and a plurality of zones are arranged around the reference target.

[0020] For another object of the present invention described above, the cue is arranged at the position of the reference target.

[0021] For another object of the present invention described above, an error is defined as an eye movement towards a location other than the correct zone and / or a saccade not starting within the time limit.

[0022] For another object of the present invention described above, a cue corresponding to a first presented stimulus is excluded from the presented cue number.

[0023] For another object of the present invention described above, after the step of presenting a cue number, a saccade is included in the step of calculating the WM effect and the saccade latency only if the saccade is started beyond the minimum saccade latency.

[0024] For another object of the present invention described above, if a saccade to one of the zones is not made within a time limit, fixation on the reference target cannot be maintained until the onset of a saccade to one of the angular zones, and blinking makes the eye movement uncertain, the saccade is excluded from the step of calculating the WM.

[0025] It is an object of the present invention to provide a system for detecting one or more neuropathies in a subject by measuring eye movements, the measurement of the eye movements being performed while the subject performs a visual test, the system comprising a. an eye tracker

[10] configured to monitor the eye movements of a subject [5] while the subject [5] is performing a visual test

[15] , b. requiring the subject to continuously fixate on a target that is part of a group of targets (e.g., dots) presented together in the same picture (i.e., a maze or labyrinth)

[0605] , c. requiring the subject to fixate on only one target at a time until all the targets have been visualized across the picture according to the maze or labyrinth direction (i.e., entering from below and exiting from above the maze or labyrinth)

[0610] , the eye tracker

[10] , d. a processor

[20] configured to receive data from the eye tracker

[10] while the subject [5] is performing the visual test

[15] , e. display means

[40] configured to display a test report

[50] received from the processor

[20] and The processor

[20] is further configured to analyze the eye-tracking data for evidence of neurological and attentional disorders and report in a test report

[50] the detection of one or more neurological and attentional disorders of the subject [5].

[0026] For another object of the present invention described above, when the processor receives eye-tracking data from the eye tracker while the subject is visualizing, recognizing, maintaining, controlling, suppressing, and ordering a target, a. Count the total number of fixations

[0615] of the subject's line of sight while performing a visual test; b. Report in the test report that if the total number of fixations of the subject's line of sight when visualizing the target exceeds that of the control group, a decline in the attentional process is detected. The processor is further configured to perform the above.

[0027] For another object of the present invention described above, when the processor receives eye-tracking data from the eye tracker, a. Measure the average saccade speed

[0620] while the subject moves from one target to the other; b. Report in the test report

[50] that if the average saccade speed

[0620] of the subject is lower than that of the control group, a decline in the executive function is detected. The processor is further configured to perform the above.

[0028] For another object of the present invention described above, when the processor receives eye-tracking data from the eye tracker, a. Count the number of correct target recognitions

[0625] ; b. Report in the test report that if the number of correct target recognitions

[0625] is lower than that of the control group, a decline in the working memory is detected. The processor is further configured to perform the above.

[0029] For another object of the present invention described above, when the processor receives gaze tracking data from an eye tracker, a. calculating the average saccade amplitude

[0630] ; b. when the average saccade amplitude

[0630] is below the control group, reporting in a test report that a decrease during the execution process has been detected and is further configured to perform.

[0030] For another object of the present invention described above, when the processor receives gaze tracking data from an eye tracker, a. calculating the total time

[0635] spent performing the visual test; b. when the total time

[0635] spent performing the visual test is above the control group, reporting in a test report that a decrease in the attentional process has been detected and is further configured to perform.

[0031] For another object of the present invention described above, it further comprises means

[17] for measuring the pupil diameter of the subject, and the processor a. tracking the pupil diameter

[0640] of the subject performing the visual test; b. when the pupil diameter

[0640] of the subject does not show an increase as the task progresses, reporting in a test report that a decrease in the attentional process has been detected and is further configured to perform.

[0032] For another object of the present invention described above, it further includes means

[17] for measuring the pupil diameter of the subject. The processor calculates the fixation duration on a human target during the visual test, and when the fixation duration

[0645] of the subject during fixation on the target is below the control group, it is further configured to report in a test report that decreases in the attentional process and the execution process have been detected.

[0033] It is an object of the present invention to provide a method [

[0400] ] for detecting the existence of one or more neurological disorders in a subject by measuring the eye movements of the subject or for measuring general cognitive ability, wherein the measurement of the eye movements is performed while the subject is reading [

[0405] ], and the method a. providing a system for detecting one or more neurological disorders according to claim 1 or claim 18; b. receiving gaze tracking data and / or pupil diameter data of the subject while the subject is reading text [

[0415] ]; and the method further includes analyzing the gaze tracking data and / or pupil diameter data for evidence of one or more neurological disorders [

[0417] ] and displaying a report of the detection of the neurological disorder [

[0499] ].

[0034] For another object of the present invention described above, a. counting the total number of fixations of the subject's gaze while the subject is reading text [

[0420] ]; b. reporting that a decrease in the attentional process is detected if the total number of fixations of the subject's gaze while reading the text exceeds that of a control group [

[0460] ]. and further includes.

[0035] For another object of the present invention described above, a. counting the total number of fixations of the subject's gaze while the subject is reading text [

[0420] ]; b. counting the number of forward fixations of the subject's gaze while the subject is reading text [

[0430] ]; c. reporting that a decrease in working memory is detected if the number of forward fixations of the subject's gaze while reading the text [

[0430] ] is less than that of a control group and the number of fixations of the subject's gaze while reading is greater than that of a control group [

[0470] ]. and further includes.

[0036] For another object of the present invention described above, a. A step of counting the number of fixations by the subject on each word in the text while the subject is reading the text

[0440] ; b. A step of counting the number of words that the subject fixated on only once while reading the text

[0445] ; c. A step of reporting that a decline in episodic memory is detected if the number of words that the subject fixated on only once

[0445] is lower than that of the control group while reading the text

[0480] ; further includes.

[0037] For another object of the present invention described above, a. A step of counting the number of multiple fixations of the subject while reading the text

[0450] ; b. A step of reporting that a decline in the execution process is detected if the number of multiple visual fixations of the subject

[0450] is higher than that of the control group while the subject is reading the text

[0490] ; further includes.

[0038] For another object of the present invention described above, a. A step of calculating the average saccade amplitude of the subject from one fixation to the next while reading the text

[0454] ; b. A step of reporting in a test report that a decline in the execution process is detected if the average saccade amplitude of the subject from one fixation to the next

[0454] while reading the text is lower than that of the control group

[0491] ; further includes.

[0039] For another object of the present invention described above, a. A step of tracking the pupil diameter of the subject while reading the text

[0456] ; b. A step of reporting in a test report that a decline in the execution process is detected if the pupil diameter of the subject

[0456] does not show a decrease as the subject reads further through the text

[0492] ; further includes.

[0040] It is an object of the present invention to present a system

[0100] for detecting a disorder in the memory binding function of a subject, the system comprising: a. an eye tracker

[10] ; and b. means for measuring the pupil diameter; and c. a processor

[20] configured to: i. receive gaze tracking data of the subject [5] from the eye tracker

[10] ; and ii. receive pupil diameter data of the subject [5] from the means for measuring the pupil diameter; and a display means

[40] configured to display a test report

[50] received from the processor

[20] . The processor

[20] is further configured to analyze the gaze tracking data and the pupil diameter data and report in the test report

[50] the detection of one or more disorders in the memory binding function of the subject [5]. For another object of the present invention described above, when the processor

[20] receives gaze tracking data from the eye tracker

[10] , the processor

[20] is further configured to:

[0041] a. measure one or more fixation durations of the subject [5] on each of one or more targets viewed by the subject [5]; b. calculate an average fixation duration of the subject [5] on the targets; and c. report in the test report

[50] that a decline in encoding and recognition of the targets is detected in the subject [5] if the average fixation duration of the subject [5] is longer than the average fixation duration of a control group.

[0042] For another object of the present invention described above, when the processor

[20] receives gaze tracking data from the eye tracker

[10] , the processor

[20] is further configured to: ​​​a. Counting the number of fixations made by the subject [5] while looking at one or more targets; b. Reporting in the test report

[50] that a decline in the attentional process is detected in the subject [5] if the number of fixations made by the subject [5] while looking at the target exceeds that of the control group; and further configured to perform.

[0043] For another object of the present invention described above, the processor

[20] applies an intelligent algorithm, a. Receiving the pupil diameter of the subject [5] from means for measuring the pupil diameter while the subject [5] is performing an activity that requires less cognitive effort; b. Receiving the pupil diameter of the subject [5] from means for measuring the pupil diameter while the subject [5] is performing an activity that requires greater cognitive effort; c. Reporting in the test report

[50] that a decline in cognitive resources is detected in the subject [5] if the pupil diameter of the subject [5] while performing an activity that requires greater cognitive effort does not show an increase exceeding the pupil diameter of the subject [5] while performing an activity that requires reduced / minimal cognitive effort; and further configured to perform.

[0044] For another object of the present invention described above, the processor

[20] further reports the results in the test report

[50] regarding a disorder of the memory binding function not detected by the system

[0100] in the subject [5].

[0045] It is an object of the present invention to provide a method

[0500] for detecting a disorder of the memory binding function of the subject

[0505] , the method including the following steps. a. Providing the system according to claim 1 or claim 33. b. Presenting a target step

[0510] . c. Step of having the subject fixate on the targets and asking them to memorize them (memorization)

[0515] . d. Step of presenting a blank screen

[0520] . e. Step of presenting the targets and asking the subject to identify whether the targets are exactly the same as what they saw before (recognition). If the targets are exactly the same, an answer of "the same" must be given. If the targets are not exactly the same, an answer of "different" must be given. Both answers must be collected using a keyboard or similar support

[0525] . Repeat the steps from [510 - 525] for several trials

[0530] . f. Step of repeating steps [510 - 525] for several trials

[0530] . g. Step of receiving eye - tracking data. h. Step of having the subject view one or more targets

[0540] . i. Step of measuring the duration of the subject's fixation on each of the targets

[0545] . j. Step of calculating the average fixation duration of the targets by the subject

[0550] . k. Step of measuring the pupil diameter of the subject while performing an activity that requires less cognitive effort

[0555] . l. Step of counting the number of fixations made by the subject while looking at the targets

[0560] . m. This method i. Step of reporting that a decline in the target memorization and recognition processes is detected in the subject if the average fixation duration of the subject is longer than the average fixation duration of the control group

[0565] , and ii. Step of reporting that a decline in cognitive resources is detected in the subject if the pupil diameter of the subject while performing an activity that requires greater cognitive effort does not show an increase exceeding the pupil diameter of the subject while performing an activity that requires less cognitive effort

[0570] , and iii. If the number of fixations made by the subject while looking at the target exceeds that of the control group, report the step of detecting a decrease in the attention process in the subject

[0575] and further includes.

[0046] For another object of the present invention described above, the intelligent algorithm is configured to read at least one input, and the input is selected from the group consisting of: a. The total number of fixations of the subject while performing each binding task. b. Binding evaluation task, i.e., "color to be bound" or "color not to be bound". c. Identification number of the binding trial. d. Answer of the correct action of the trial (i.e., "same" or "different"). e. Response of the subject's action. f. Part of the trial, i.e., inscription or recollection. g. Pupil diameter of the subject while performing the binding evaluation. h. Number of blinks obtained from the left eye, right eye, or both eyes. i. Microsaccade, form factor (FF), i.e., i. HEWI: Indicates the height / width relationship of the microsaccade. ii. AREA: Indicates the area of the rectangle inscribed by the microsaccade. iii. LONG: The length of the trajectory of the microsaccade in the horizontal-vertical plane. iv. ANG: The sum of all angles of the microsaccade in the horizontal-vertical plane. v. AANG: The sum of the absolute values of all angles in radians of the microsaccade in the horizontal-vertical plane. These last two FFs estimate the regularity of the microsaccade trajectory. vi. MOD and THETA: The coefficients and angles of the polar coordinates of the sum of the Cartesian coordinates. These give the spatial localization of the microsaccade with respect to the median of the fixation. vii. TIME: The duration of the microsaccade in milliseconds. viii. VMIN and VMAX: The minimum and maximum speeds of micro-saccades in degrees per second. ix. Micro-saccade rate: The instantaneous rate at each time interval. x. Direction match: The match between the micro-saccade direction and the position of the stimulus. j. The eye positions (i.e., horizontal and vertical coordinates) obtained from the left eye, right eye, or both eyes during the binding evaluation. k. The saccade amplitude during target processing. l. The fixation sequence (i.e., eye movement) during target processing. The sequence can be obtained from an image, matrix, etc. m. The distance between the fixation points of the right eye and the left eye during the binding evaluation. n. The subject's factor information (i.e., age, years of education, gender, race, occupation, weekly physical activity time). o. The fixation duration during target processing. p. The dwell duration during target processing. q. The number of fixations on each target. r. The number of fixations outside each target. s. The number of fixations on each target.

[0047] It is an object of the present invention to provide a method

[0600] for detecting a subject's neuropathy and attention disorder, and this method includes the following steps. a. Providing an eye tracker

[10] ; b. Means for measuring the pupil diameter; c. A processor

[20] , i. Receiving the gaze tracking data of the subject [5] from the eye tracker

[10] ; ii. Receiving the pupil diameter data of the subject [5] from the means for measuring the pupil diameter and configured to perform the above, a processor

[20] ; iii. Display means

[40] configured to display a test report

[50] received from the processor

[20] , and comprising the processor

[20] is further configured to analyze the eye-tracking data and the pupil diameter data and report in the test report

[50] the detection of one or more neurological disorders and attentional disorders of the subject [5].

[0048] For another object of the present invention described above, when the processor

[20] receives eye-tracking data from the eye tracker

[10] , a. measuring for each of one or more targets viewed by the subject [5] one or more fixation durations of the subject [5] on each target; b. calculating the average saccade amplitude of the subject [5] from each target to another target; c. reporting in the test report

[50] that if the average saccade amplitude of the subject [5] is shorter than the average saccade amplitude of the control group, a decrease in target visualization, recognition, maintenance, collation, suppression, and ordering is detected in the subject [5]. and is further configured to perform.

[0049] For another object of the present invention described above, when the processor

[20] receives eye-tracking data from the eye tracker

[10] , a. counting the number of fixations made by the subject [5] while viewing one or more targets; b. reporting in the test report

[50] that if the number of fixations made by the subject [5] while viewing the target exceeds that of the control group, a decrease in the attentional process is detected in the subject [5]. and is further configured to perform.

[0050] For another object of the present invention described above, the processor

[20] a. Receiving the pupil diameter of the subject [5] from means for measuring the pupil diameter while the subject [5] is performing an activity that requires a large amount of attentional resources; b. Receiving the pupil diameter of the subject [5] from means for measuring the pupil diameter while the subject [5] is performing an activity that requires a large amount of attention; c. If the pupil diameter of the subject [5] during an activity that requires a large amount of attention does not show an increase exceeding the pupil diameter of the subject [5] during an activity that requires a little attention, reporting in the test report

[50] that a decline in cognitive resources is detected in the subject [5]; and is further configured to perform.

[0051] It is an object of the present invention to provide a method

[0600] for detecting neurological disorders and executive disorders of a subject, and this method comprises: a. Providing the system described above; b. Receiving eye-tracking data; c. Having the subject view one or more targets [605 - 610]; d. Calculating the average saccade amplitude of the target by the subject

[0630] ; e. Measuring the pupil diameter of the subject while performing an activity that requires a large amount of attention

[0640] ; f. Measuring the pupil diameter of the subject while performing an activity that requires a large amount of attention rather than a little attention; g. Counting the number of fixations made by the subject while viewing the target

[0615] ; and includes h. This method i. If the average saccade amplitude of the subject is shorter than the average saccade amplitude of the control group, reporting that a decline in target visualization, recognition, maintenance, collation, suppression, and ordering processes is detected in the subject; ii. If the pupil diameter of the subject during an activity requiring a lot of attention does not show an increase exceeding the pupil diameter of the subject during an activity requiring a little attention, reporting that a decrease in cognitive resources and functional resources is detected in the subject; iii. If the number of fixations made by the subject while looking at the target exceeds that of the control group, reporting that a decrease in the attention process is detected in the subject; iv. If the average saccade latency (speed) of the subject is shorter than the average saccade latency of the control group, reporting that a decrease in the execution process is detected in the subject and further comprising.

[0052] For another object of the present invention described above, the method is configured to report that a decrease in the execution process is detected in the subject if the average saccade duration of the subject is shorter than the average fixation duration of the control group.

[0053] For another object of the present invention described above, the neuropathy is selected from the group consisting of Parkinson's disease or attention deficit hyperactivity disorder.

Brief Description of the Drawings

[0054]

Figure 1

Figure 2

Figure 3A

Figure 3B

Figure 4A

Figure 4B

Figure 5

Figure 5B

Figure 5C

Figure 6A

Figure 6B

DETAILED DESCRIPTION OF THE INVENTION

[0055] The term "cognitive effort" reflects the total amount of mental effort required for a subject to perform a task. In the present application, the term "less cognitive effort" refers to a decrease in the working memory demand during task execution.

[0056] In this application, the term "microsaccades", also known as "flicks", are small saccades that occur during the fixation time period. They are the largest and fastest of the fixational eye movements. In this application, the term "saccades" refers to the rapid simultaneous movement of both eyes between two or more phases of fixation.

[0057] In this application, the term "ocular drift" is a fixational eye movement characterized by the smoother and slower wandering movement of the eyes when fixed on an object.

[0058] In this application, the term "ocular microtremor" (OMT) is a small, high-speed, synchronized vibration of the eyes that generally occurs at approximately 90 Hz in the average healthy individual, but occurs at frequencies within the range of 40 to 100 Hz. They are characterized by high frequencies and very small amplitudes of only a few seconds of arc.

[0059] In this application, the term "stimulus image" refers to a specific visual pattern or target presented to a subject on a display. The term "visual task" or "visual test" refers to the activities performed on the subject while processing each stimulus image.

[0060] Non-limiting embodiments of the present invention will now be described in detail.

[0061] Next, referring to FIG. 1, a system

[0100] for detecting neuropathy or nerve function of a subject [5] according to some embodiments of the present invention is shown.

[0062] System

[0100] includes an eye tracker

[10] , means

[17] for measuring pupil diameter, a processor

[20] , and display means

[40] .

[0063] The eye tracker

[10] can be of any type known in the art, for example, an eye-attached tracker, an optical eye tracker, or an electrooculographic eye tracker.

[0064] The means

[17] for measuring the pupil diameter may include, for example, a camera configured to acquire an image of the eye and a processing unit for measuring the pupil diameter from the image. Instead of the processing unit, the means

[17] for measuring the pupil diameter can include a display of an image on which a manual measurement is made while looking at the display.

[0065] The eye tracker

[10] and the means

[17] for measuring the pupil diameter are communicatively connected to the processor

[20] . The communication connection can be of any form known in the art and can be wired (e.g., USB, parallel port, or the like) or wireless (e.g., WiFi, Bluetooth, or the like).

[0066] The processor

[20] receives and executes instructions stored in one or more storage media

[60] , such as RAM, CD / DVD, HDD, flash memory, and / or any suitable medium. The instructions cause the processor

[20] to: 1) receive gaze tracking data from the eye tracker

[10] ; 2) receive pupil diameter data from the means

[17] for measuring the pupil diameter; 3) analyze the gaze tracking and pupil diameter data (further described herein); and 4) report, in the test report 50, the detection or non-detection of one or more impairments of the memory binding function in the subject [5] for display on the display means

[40] . The display means

[40] can be a monitor, the screen of a mobile device such as a smartphone, a printout, or any suitable means for displaying the test report

[50] . The processor

[20] may store the received gaze tracking data, intermediate results at any stage of the analysis, and / or any of the test reports

[50] in the storage media

[60] .

[0067] The neurological disorders detected by the system

[0100] can include reading functions such as impairments in target inscription and recognition, impairments in attention processes, impairments in cognitive resources, or any combination thereof. In other embodiments, the detected disorders can include multiple sclerosis (MS), attention deficit hyperactivity disorder (ADHD), Parkinson's disorder (PD), Alzheimer's disease (AD), and the like.

[0068] In some embodiments, the processor

[20] receives gaze-tracking data from the eye tracker

[10] while the subject [5] looks at each of one or more targets

[30] . The processor

[20] measures the duration of the subject's [5] fixation on each target

[30] viewed by the subject [5]. The processor

[20] calculates the average fixation duration of the subject [5] on each of the targets

[30] . If the average of the subject's [5] fixation durations on the targets

[30] is longer than the average fixation duration of a control group, the processor

[20] reports in the test report

[50] that a decline in the target inscription and recognition process is detected in the subject [5].

[0069] In some embodiments, the processor

[20] , additionally or alternatively, counts the number of fixations made by the subject [5] while looking at each of the targets

[30] . If the number of fixations made by the subject [5] while looking at the targets

[30] exceeds that of a control group, the processor

[20] reports in the test report

[50] that a decline in the attention process is detected in the subject [5].

[0070] In some embodiments, the processor

[20] receives pupil diameter data from the means

[17] for measuring the pupil diameter while the subject [5] is performing an activity that requires less cognitive effort. The processor

[20] further receives pupil diameter data from the means

[17] for measuring the pupil diameter while the subject [5] is performing an activity that requires more cognitive effort than an activity that requires less cognitive effort. If the average pupil diameter of the subject 5 while performing an activity that requires more cognitive effort does not show an increase exceeding the average pupil diameter of the subject [5] while performing an activity that requires less cognitive effort, the processor

[20] reports in the test report

[50] that a decline in cognitive resources is detected in the subject [5].

[0071] The control group may include a statistically representative cross-section of the same demographic sectors as the subject [5] (e.g., the same gender, race, national culture, age group, and / or other demographic characteristics of the subject [5]). The eye-tracking data of the control group may be acquired by the system

[0100] , or in some cases, may be collected from previous research studies and / or clinical studies. If the average fixation duration or the number of fixations of the subject [5] is within the selected margin of the average numbers of the control group, i.e., within about one standard deviation of the distribution of the corresponding numbers of the control group, the system

[0100] may treat the average fixation duration or the number of fixations of the subject [5] as equal to the average corresponding numbers of the control group.

[0072] The eye-tracking data received by the processor

[20] may be a series of eye positions measured by the eye tracker

[10] , and it should be understood that the processor

[20] analyzes this to find the fixation duration or fixation of the subject [5]. Alternatively, the processor

[20] may receive a series of pre-processed signals from the eye tracker

[10] , each signaling the occurrence of a fixation duration or fixation. The signals may optionally be accompanied by metadata (e.g., eye position, time, and / or length of fixation).

[0073] Multiple sclerosis Next, referring to FIGS. 3A and 3B, which show a method

[0300] for evaluating a decline in neurological function associated with multiple sclerosis [MS] according to some embodiments of the present invention. The method

[0300] includes the following steps, namely a. Providing a system

[0305] for evaluating a decline in neurological function associated with MS; b. Requesting the subject to fixate on a reference target on a chart

[0310] ; c. A step of presenting a stimulus image to a subject in one of a plurality of zones on a chart during several repetitions

[0315] , wherein the subject is required to remember in which zone and in what order each stimulus image appeared, the presenting step

[0315] ; d. A step of presenting a cue corresponding to one of the presented stimulus images to the subject

[0320] ; e. A step of measuring the saccade of the subject in response to the step of presenting the cue

[0325] , wherein the subject is required to look at the zone where the presented stimulus image corresponding to the cue was located, the measuring step

[0325] ; f. A step of repeating the step of presenting the cue and the step of measuring the saccade

[0330] ; g. A step of repeating steps b to f for several trials

[0335] ; h. i. The WM effect

[0340] (i.e., the WM effect is a measure that increases when WM demand increases. For each cue number, the WM effect is represented by the ratio of the number of errors reported by the subject over all trials to the number of trials), and ii. The average saccade latency

[0345] , where the saccade latency is defined as the amount of time it takes for the subject to initiate a saccade to the zone, the average saccade latency A step of calculating one or more of them; i. i. The degree of decline in working memory associated with an increase in the WM effect

[0350] , and ii. The degree of decline in the execution process associated with an increase in the saccade latency

[0355] A step of reporting one or more of them; Including, The method further includes additional steps performed during the step of presenting the stimulus image

[0315] , during which the subject is further required to look at the stimulus image, j. The additional steps are i. The amplitude of the pupil dilation of the subject

[0360] , ii. The number of fixations performed on the stimulus image by the subject

[0365] , and iii. The duration of fixation on the stimulus image by the subject

[0370] including the step of measuring one or more of k. The additional steps are i. The degree of decline of the subcortical process associated with the invariance of the amplitude during pupil dilation

[0375] , ii. The degree of decline of the executive process associated with the increase in the number of fixations

[0380] , and iii. The degree of decline of the executive process and working memory associated with the increase in the fixation duration

[0385] including the step of calculating and reporting one or more of

[0074] The method employs an intelligent algorithm to analyze the subject using the following variables. a. The total number of eye fixations of the subject while performing the n-back task. b. The identification number of the n-back task trial (i.e., if there are 20 n-back task trials, the 5th trial is identified as 5. The 20th trial is identified as 20, etc.). c. The trial section, i.e., 1, 2, and 3. d. The part of the trial, i.e., inscription, recall. e. The pupil diameter of the subject while performing the n-back task. f. The number of blinks obtained from the left eye, right eye, or both eyes. g. Micro-saccades, form factor (FF), i.e., i. HEWI: Indicates the height / width relationship of micro-saccades. ii. AREA: Indicates the area of the rectangle inscribed by micro-saccades. iii. LONG: The length of the trajectory of the horizontal-vertical plane of micro-saccades. iv. ANG: The sum of all angles in the horizontal-vertical plane of micro-saccades. v. AANG: The sum of all absolute values of the angles in radians in the horizontal-vertical plane of the microsaccades. These last two FFs estimate the regularity of the microsaccade trajectory. vi. MOD and THETA: The coefficients and angles of the polar coordinates of the sum of the Cartesian coordinates. These give the spatial localization of the microsaccades with respect to the fixation median. vii. TIME: The duration of the microsaccades in milliseconds. viii. VMIN and VMAX: The minimum and maximum speeds of the microsaccades in degrees per second. ix. Microsaccade rate: The instantaneous rate at each time interval. x. Direction congruence: The congruence between the microsaccade direction and the position of the stimulus. h. The eye positions (i.e., horizontal and vertical coordinates) obtained from the left eye, right eye, or both eyes while performing the n-back task. i. Saccade amplitude while processing the target. j. Saccade latency. k. Fixation sequence (i.e., eye movements) while processing the target. The sequence is available from images, matrices, etc. l. The distance between the fixation points of the right and left eyes while processing the target. m. Subject factor information (i.e., age, number of years of education, gender, race, occupation, weekly physical activity time). n. Fixation duration while processing the target. o. Duration of fixation while processing the target. p. Number of fixations on each target. q. Number of fixations on areas other than each target.

[0075] The measurements taken while presenting the cueing image (feature j in method

[0300] ) provide information in the inscription that is made while the subject first identifies the location of the visual stimulus. In pilot studies conducted by the inventors, it was found that subjects with MS had impairments when inscribing visual information (e.g., the subject made many fixations on the display). The measurements during inscription are in addition to the measurements made during recognition when a cue is presented after the visual stimulus has been presented, as in the study by Fielding et al. (steps a - i in method

[0300] ). Overall, the subject's behavior between both inscription and recognition helps to identify further deficits (i.e., subcortical processes, executive processes, and / or degree of decline in executive processes) and can provide better insight into the subject's state than behavior during recognition alone.

[0076] Reading Next, referring to FIGS. 4A and 4B, there is shown a method for measuring general cognitive ability and for detecting one or more neurological disorders in a subject by measuring the subject's eye movements and / or pupil diameter while the subject is reading, according to some embodiments of the present invention.

[0077] Method

[0400] includes steps of providing a system for measuring general cognitive ability and for detecting the presence of one or more neurological disorders by measuring eye movements and / or pupil diameter, receiving gaze tracking data and / or pupil diameter data of a subject reading text, analyzing the gaze tracking data for evidence of one or more neurological disorders, and displaying a report of the detection of the neurological disorder.

[0078] In some embodiments, method

[0400] includes step

[0405] of counting the total number of fixations of a subject while the subject is reading text, and step

[0460] of reporting that a decline in attentional processes is detected if the total number of fixations of the subject while reading text exceeds that of a control group.

[0079] In some embodiments, method

[0400] further includes step

[0405] of counting the total number of the subject's fixations while the subject is reading text, step

[0430] of counting the number of the subject's forward fixations while the subject is reading text, and step

[0470] of reporting that a decline in working memory is detected if the number of the subject's forward fixations exceeds that of the control group and the total number of the subject's fixations while reading exceeds that of the control group.

[0080] Physiologically, a decline in working memory correlates with deterioration in the frontal lobe. In some embodiments, the report

[0470] of a decline in working memory may be used for additional treatment. For example, if brain surgery is indicated, method

[0400] may be followed by a step of examining a brain image of the subject's frontal lobe.

[0081] In some embodiments, method

[0400] includes step

[0440] of counting the number of the subject's fixations on each word in the text while the subject is reading the text, step

[0445] of counting the number of words fixated by the subject only once, and step

[0480] of reporting that a decline in recall memory is detected if the number of words fixated by the subject only once is less than that of the control group.

[0082] Physiologically, a decline in recall memory correlates with deterioration in the temporal lobe. In some embodiments, the report

[0480] of a decline in recall memory may be used for additional treatment. For example, if brain surgery is indicated, method

[0400] may be followed by a step of examining a brain image of the subject's frontal lobe.

[0083] In some embodiments, method

[0400] includes step

[0450] of counting the total number of a plurality of the subject's fixations while the subject is reading text, and step

[0490] of reporting that a decline in the execution process is detected if the number of the plurality of fixations exceeds that of the control group.

[0084] In some embodiments, method

[0400] includes step

[0454] of calculating the average saccade amplitude of a subject from one fixation to the next while reading text, and step

[0491] of reporting that a decline in the execution process is detected when the average saccade amplitude is below that of a control group.

[0085] In some embodiments, method

[0400] includes step

[0456] of tracking the pupil diameter of the subject while reading text, and step

[0492] of reporting that a decline in the execution process is detected when the pupil diameter of the subject does not show constriction as the text reading progresses.

[0086] Physiologically, a decline in the execution process correlates with deterioration in the frontal, temporal, and / or parietal lobes. In some embodiments, reporting of a decline in the execution process [490~491~492] may be used for additional treatment. For example, if brain surgery is indicated, method

[0400] may be followed by a step of examining brain images of the subject's frontal, temporal, and / or parietal lobes.

[0087] System and method

[0400] were tested on 50 healthy controls and 50 mild AD patients. Both groups read 40 regular sentences.

[0088] [Table 1]

[0089] List of references The above rules are partially based on the following research. 1. Fernandez G, Mandolesi P, Rotstein NP, Colombo O, Agamennoni O, Politi LE. (2013) Eye movement alterations during reading in patients with early Alzheimer disease. Invest Ophthalmol Vis Sci. pii: iovs.l3-l2877vl. doi: lO.H67 / iovs.l3- 12877。 2. Fernandez G., Manes F., Politi L., Orozco D., Schumacher M., Castro L., Agamennoni O., Rotstein N. (2016). Patients with Mild Alzheimer Disease Fail When Using Their Working Memory: Evidence from the Eye Tracking Technique. Journal of Alzheimer Disease; 50, 827~828。 3. Fernandez, G., Laubrock, J., Mandolesi P., Colombo O., Agamennoni O. (2014) Registering eye movements during reading in Alzheimer disease: difficulties in predicting upcoming words. Journal of Clinical and Experimental Neuropsychology; 36, 302~16。 4. Fernandez G., Sapognikoff M., Guinjoan S., Orozco D., Agamennoni O. (2016). Word processing during reading sentences in patients with schizophrenia: evidences from the eyetracking technique. COMPREHENSIVE PSYCHIATRY; 68, 193 - 200. 5. Fernandez G, Manes F, Rotstein N, Colombo O, Mandolesi P, Politi L, Agamennoni O. (2014) Lack of contextual - word predictability during reading in patients with mild Alzheimer disease. Neuropsychologia; 62, 143 - 51. 6. Fernandez G., Schumacher M., Castro L., Orozco D., Agamennoni O., (2015). Patients with Alzheimer disease produced shorter outgoing saccades when reading sentences. Psychiatry Research, 229, 470 - 478. 7. Fernandez G., Biondi J., Castro S., Agamennoni O. (2017). Pupil size behavior during online processing of sentences. Journal of Integrative Neurosciences 15(4) 485 - 496

[0090] Memory association Next, a non - limiting embodiment of the present invention will be described in detail.

[0091] Next, referring to FIG. 5, which shows a method

[0500] for detecting impairment of the memory binding function in a subject according to some embodiments of the present invention.

[0092] The method includes a step

[0505] of providing a system for detecting impairment of the memory binding function in a subject.

[0093] In some embodiments, the method

[0500] includes steps of having the subject view one or more targets [510 - 535], measuring the duration of the subject's fixation on each of the targets

[0545] , calculating the average fixation duration of the targets by the subject

[0550] , and reporting that a decline in the target inscription and recognition process is detected in the subject if the average of the subject's fixation durations is longer than the average fixation duration of a control group

[0565] .

[0094] In some embodiments, the method

[0500] includes a step of measuring one or more pupil diameters of the subject while performing an activity that requires less cognitive effort (e.g., recognizing or differentiating between three targets)

[0555] , and reporting that a decline in cognitive resources is detected in the subject [5] if the average pupil diameter of the subject [5] while performing an activity that requires greater cognitive effort does not show an increase beyond the average pupil diameter of the subject [5] while performing an activity that requires less cognitive effort

[0570] .

[0095] In some embodiments, the method

[0500] includes a step of counting the number of fixations of the subject [5] while viewing a target

[30]

[0560] , and reporting that a decline in the attention process is detected in the subject [5] if the number of fixations made by the subject [5] while viewing the target

[30] exceeds that of a control group

[0575] . List of References

[0096] The above rules are based in part on the following research. 1. Fernandez G, Mandolesi P, Rotstein NP, Colombo O, Agamennoni O, Politi LE. (2013) Eye movement alterations during reading in patients with early Alzheimer disease. Invest Ophthalmol Vis Sci. pii: iovs.l3-l2877vl. doi: lO.H67 / iovs.l3- 12877。 2. Fernandez G., Manes F., Politi L., Orozco D., Schumacher M., Castro L., Agamennoni O., Rotstein N. (2016). Patients with Mild Alzheimer Disease Fail When Using Their Working Memory: Evidence from the Eye Tracking Technique. Journal of Alzheimer Disease; 50, 827~828。 3. Fernandez, G., Laubrock, J., Mandolesi P., Colombo O., Agamennoni O. (2014) Registering eye movements during reading in Alzheimer disease: difficulties in predicting upcoming words. Journal of Clinical and Experimental Neuropsychology; 36, 302~16。 4. Fernandez G., Sapognikoff M., Guinjoan S., Orozco D., Agamennoni O. (2016). Word processing during reading sentences in patients with schizophrenia: evidences from the eyetracking technique. COMPREHENSIVE PSYCHIATRY; 68, 193 - 200. 5. Fernandez G, Manes F, Rotstein N, Colombo O, Mandolesi P, Politi L, Agamennoni O. (2014) Lack of contextual - word predictability during reading in patients with mild Alzheimer disease. Neuropsychologia; 62, 143 - 51. 6. Fernandez G., Schumacher M., Castro L., Orozco D., Agamennoni O., (2015). Patients with Alzheimer disease produced shorter outgoing saccades when reading sentences. Psychiatry Research, 229, 470 - 478. 7. Fernandez G., Biondi J., Castro S., Agamennoni O. (2017). Pupil size behavior during online processing of sentences. Journal of Integrative Neurosciences 15(4) 485 - 496. 8. Biondi J., Fernandez G., Castro S., Agamennoni O. (2018). Eye-movement behavior identification for Alzheimer Disease diagnosis. Journal of Integrative Neurosciences (in Press). 9. Fernandez, Orozco, Agamennoni, Schumacher, Sanudo, Biondi, Parra. (2018). Visual Processing during Short-Term Memory Binding in Mild Alzheimer's Disease. J Alzheimers Dis.;63(1): 185-194. doi: 10.3233 / JAD-170728.

[0097] Parkinson's disease (PD) and attention deficit hyperactivity disorder (ADHD) Next, referring to FIGS. 6A and 6B, there is shown a method for detecting one or more cognitive impairments, neurological disorders, and behavioral disorders of a person by measuring the eye movements and / or pupil diameter of the person while the person is performing a visual test, according to some embodiments of the present invention.

[0098] Method

[0600] includes steps of providing a system for detecting the presence of one or more cognitive impairments and neurological disorders by measuring eye movements while a person visualizes, recognizes, maintains, matches, suppresses, and sequences a target; receiving gaze-tracking data of a person visualizing, recognizing, maintaining, matching, suppressing, and sequencing a target; analyzing the gaze-tracking data for evidence of one or more cognitive impairments and neurological disorders; and displaying a report of the detection of the cognitive impairments and neurological disorders.

[0099] In some embodiments, method

[0600] includes step

[0615] of counting the total number of a person's fixations while the person is performing a visual test, and reporting that a decline in attention, execution, and inhibition processes is detected if the number of the person's fixations exceeds that of a control group.

[0100] In some embodiments, method

[0600] includes steps for calculating the average saccade speed

[0620] of subject [5] from one target to another while subject [5] is performing a visual test, and reporting that a decline in the execution function is detected if the average saccade speed performed by the subject is lower than that of a control group.

[0101] Physiologically, slower saccade speeds are correlated with deterioration in the frontal eye fields, basal ganglia, and superior colliculus. In some embodiments, reporting a decline in saccade speed may be used for additional treatment.

[0102] In some embodiments, method

[0600] includes step

[0625] of counting the number of correct target recognitions of a person while performing a visual test, and reporting that a decline in working memory is detected if the number of correct target recognitions is lower than that of a control group.

[0103] Physiologically, a decline in working memory is correlated with deterioration in the prefrontal cortex and posterior parietal cortex. In some embodiments, reporting declines in working memory, inhibition processes, and mental flexibility may be used for additional treatment.

[0104] In some embodiments, method

[0600] includes step

[0630] of calculating the average saccade amplitude from one fixation to the next, and reporting that a decline in the execution process is detected if the average saccade amplitude is lower than that of a control group.

[0105] In some embodiments, method

[0600] includes step

[0640] of tracking a person's pupil diameter while a vision test is being performed, and a step of reporting that a decline in the attentional process is detected if the person's pupil diameter does not show an increase as the vision test progresses.

[0106] Physiologically, a decline in the attentional process correlates with deterioration in the locus coeruleus, the noradrenergic system, and the superior colliculus. In some embodiments, reporting of a decline in the executive process may be used for additional treatment.

[0107] In some embodiments, method

[0600] includes step

[0635] of calculating the total time spent by a person while a vision trial is being performed, and a step of reporting that a decline in the attentional process is detected if the total time required to perform the trial is more than that reported for a control group.

[0108] Physiologically, declines in the attentional and inhibitory processes, as well as in mental flexibility, correlate with deterioration in the prefrontal cortex, the parietal cortex, the prefrontal striatal cerebellar, and the prefrontal striatal thalamic circuits. In some embodiments, reporting of a decline in the executive process may be used for additional treatment.

[0109] In some embodiments, method

[0600] includes step

[0645] of calculating a person's fixation duration on a target while a vision test is being performed, and a step of reporting that a decline in working memory is detected if the fixation duration on the target is below that of a control group.

[0110] Physiologically, a decline in attention and inhibitory processes, as well as in mental flexibility, correlates with deterioration in the prefrontal cortex, in the frontal eye fields, and in the dorsoparietal cortex. In some embodiments, reports of decline during performance may be used for additional treatment.

[0111] The method employs an intelligent algorithm to analyze a subject using the following variables. a. The total number of fixations of the subject's line of sight while performing a visual test. b. The identification number of each target according to its position in the maze or labyrinth. c. The pupil diameter of the subject while performing a visual test. d. The number of blinks obtained from the left eye, right eye, or both eyes. e. Microsaccades, form factor (FF), that is i. HEWI: Indicates the height / width relationship of microsaccades. ii. AREA: Indicates the area of the rectangle inscribed by the microsaccades. iii. LONG: The length of the horizontal-vertical plane trajectory of the microsaccades. iv. ANG: The sum of all angles in the horizontal-vertical plane of the microsaccades. v. AANG: The sum of all absolute values of the angles in radians in the horizontal-vertical plane of the microsaccades. These last two FFs estimate the regularity of the microsaccade trajectory. vi. MOD and THETA: The coefficients and angles of the polar coordinates of the sum of the Cartesian coordinates. These give the spatial orientation of the microsaccades with respect to the median of the fixation. vii. TIME: The duration of the microsaccades in milliseconds. viii. VMIN and VMAX: The minimum and maximum speeds of the microsaccades in degrees per second. ix. Microsaccade rate: The instantaneous rate at each time interval. x. Direction consistency: Consistency between the direction of the microsaccades and the position of the stimulus. f. Eye positions (i.e., horizontal and vertical coordinates) obtained from the left eye, right eye, or both eyes during the performance of the visual task. g. Saccade amplitude during the processing of the target. h. Saccade latency. i. Fixation sequence (i.e., eye movements) during the processing of the target. The sequence can be obtained from images, matrices, etc. j. Distance between the fixation points of the right and left eyes during the processing of the target. k. Subject factor information (i.e., age, number of years of education, gender, race, occupation, weekly physical activity time). l. Fixation duration during the processing of the target. m. Number of fixations on each target. n. Number of fixations on areas other than each target. o. Total visual task time (i.e., the time spent by the subject to complete the entire trial).

[0112] This method

[0600] was tested on subjects with PD and ADHD and compared with healthy controls.

[0113]

Table 2

Explanation of Symbols

[0114] 5 Subject 10 Eye tracker 15 Text 17 Means for measuring pupil diameter 20 Processor 30 Target 40 Display means 50 Test report 60 Memory medium 100 System

Claims

1. A method for evaluating a person's ability, driving skills, and cognitive function, comprising: requiring the person to perform a task, the task requiring the person to virtually touch a specific virtual object, the virtual objects having different characteristics respectively, the virtual objects being presented in a three-dimensional (3D) virtual reality environment, and the virtual objects moving towards or away from the person at a predetermined speed, acceleration, and direction; repeating the requirement by requiring the person to perform the task for each of the different virtual objects having different characteristics among the virtual objects; measuring the person's eye movements and limb movements while the person is looking at the virtual object and performing the task; identifying selected movements among the measured eye movements and limb movements that are related to the person's ability, driving skills, and cognitive function; determining the person's expected eye movements and limb movements while the person is looking at the virtual object and performing the task, comparing the expected eye movements and limb movements with the selected movements among the measured eye movements and limb movements, and determining the deviation therebetween; evaluating the person's ability, driving skills, and cognitive function based on the deviation. A method comprising the above steps.

2. The method according to claim 1, wherein the measured eye movements include at least one of saccade amplitude, fixation duration, and pupil movement.

3. The method according to claim 1, wherein the measured limb movements include the limb reaction time required to perform the required task.

4. The method according to claim 1, wherein the different characteristics of the virtual object are colors.

5. The step of evaluating comprises: determining measurement criteria, the measurement criteria including suppression process error (i.e., how long the person touches the incorrect object) and average saccade latency, and the saccade latency indicating the amount of time required for the person to initiate a saccade to continue looking at an object, the method according to claim 1 including this step.

6. The step of evaluating comprises: The method according to claim 1, comprising the step of determining (i) the degree of decrease in processing speed associated with an increase in the speed at which successive objects are presented to the person, and (ii) the degree of decrease in the execution process associated with an increase in suppression process errors.

7. The method further comprising the step of obtaining one or more additional measurements while the person is looking at the virtual object and performing the task, wherein the one or more additional measurements are i. the amplitude of the person's pupil dilation, ii. the number of fixations made by the person on the stimulus image, iii. the fixation duration of the person on the stimulus image, iv. the binocular disparity of the person during visual search and object visualization, v. the fixation on the target touched by the person and the position where the visual stimulus was present, vi. the number of successive objects touched by the person when performing the task, vii. the number of blinks obtained from the left eye, right eye, or both eyes, viii. the time required to first discover the object, ix. the time from when the person starts moving their hand and / or foot until the person touches or attempts to touch the object, x. the number of times the person touched or did not touch the virtual object, xi. the optimal position for target visualization and positions that are not efficient for object visualization, xii. the tracking accuracy when aligning the line of sight with a moving object, xiii. the hand - reach depth towards the object during the touching movement, xiv. the max hand velocity made by the hand during the movement towards the correct object, xv. the dominant hand ratio using the appropriate hand during hand - based interaction, xvi. the prediction time selected from the group consisting of, the method according to claim 1.

8. A system for evaluating a person's abilities, driving skills, and cognitive functions, A 3D virtual reality device configured to establish a three-dimensional (3D) virtual reality environment, in which a plurality of virtual objects are presented to a person, the plurality of virtual objects having at least one characteristic different from each other, and the virtual objects moving towards or away from the person at a predetermined speed, acceleration, and orientation. A 3D virtual reality device. An eye tracker configured to measure the eye movements of the person while the person is looking at the virtual object and performing the requested task, the requested task including a plurality of requests to request the person to virtually touch a specific virtual object, the specific virtual object each having one of specific characteristics. An eye tracker. One or more motion sensors configured to measure the limb movements of the person while the person is performing the requested task. A processor configured to receive data from the 3D virtual reality device, the eye tracker, and the one or more motion sensors while the person is performing the requested task. Comprising The processor is (i) Identify selected movements among the measured eye movements and limb movements that are related to the person's abilities, driving skills, and cognitive functions. (ii) Determine the expected eye movements and limb movements of the person while the person is looking at the virtual object and performing the requested task, compare the expected eye movements and limb movements with the selected movements among the measured eye movements and limb movements, and determine the deviation between the two. (iii) Evaluate the person's abilities, driving skills, and cognitive functions based on the deviation. A system further configured as follows.

9. A system, a. An eye tracker configured to monitor the eye movements of a subject while the subject is visualizing, recognizing, maintaining, controlling, fixating on, and analyzing a target. b. A processor configured to receive gaze tracking data from the eye tracker while the subject is visualizing, recognizing, maintaining, controlling, fixating on, and analyzing the target. A display configured to display a test report received from the processor. Comprising The processor is further configured to analyze the eye-tracking data for one or more neurological disorders or bases of general cognitive ability and report in the test report the detection of the one or more neurological disorders or the measurement of the cognitive ability of the subject. System. **Claim 10** When the processor receives the eye-tracking data from the eye tracker, a. Counting the total number of fixations of the subject while visualizing, recognizing, maintaining, controlling, fixating, and analyzing the target; b. Reporting in the test report that a decline in the attention process is detected if the total number of fixations of the subject while visualizing, recognizing, maintaining, controlling, fixating, and analyzing the target exceeds that of the control group; c. Counting the number of correct landing positions of the subject while visualizing, recognizing, maintaining, controlling, fixating, and analyzing the target; d. Reporting in the test report that a decline in the execution process is detected if the number of correct landing positions of the subject is less than that of the control group; e. Counting the number of outward saccades that responded to an appropriate cue while attempting to visualize, recognize, maintain, control, fixate, track, and analyze the target; f. Reporting in the test report that a decline in the execution process is detected if the number of outward saccades that responded to an appropriate cue (e.g., the direction of an arrow) made by the subject is less than that of the control group; g. Counting the number of outward saccades of the subject that were opposite to the direction of the cue while attempting to visualize, recognize, maintain, control, fixate, track, and analyze the target; h. Reporting in the test report that a decline in the suppression process is detected if the proportion of outward saccades that were opposite to the direction of the cue exceeds that of the control group; i. Calculating the average saccade amplitude from one fixation to the next while visualizing, recognizing, maintaining, controlling, fixating, tracking, and analyzing the target; j. Reporting in the test report that a decline in the execution process is detected if the average saccade amplitude is less than that of the control group; k. Counting the saccade latency of the subject while directing the gaze to visualize, recognize, maintain, control, suppress, fixate, track, and analyze the target; l. Report in the test report that a decrease in speed processing is detected when the saccade latency (time) exceeds that of the control group. m. Track the pupil diameter of the subject while visualizing, recognizing, maintaining, controlling, suppressing, fixating, tracking, and analyzing the target. n. Report in the test report that a decrease in the noradrenergic system is detected when the pupil diameter of the subject does not show a change during the progression of visualizing, recognizing, maintaining, controlling, suppressing, fixating, tracking, and analyzing the target. o. Count the length of the subject's fixation maintenance time while attempting to visualize, recognize, maintain, control, suppress, fixate, track, and analyze the target. p. Report in the test report that a decrease in online processing is detected when the length of the fixation maintenance time exceeds that of the control group. q. Count the subject's gaze maintenance time while attempting to visualize, recognize, maintain, control, fixate, track, and analyze the target. r. Report in the test report that a decrease in online processing is detected when the length of the gaze maintenance time exceeds that of the control group. s. Count the number of correct targets recognized while visualizing, recognizing, maintaining, controlling, suppressing, fixating, tracking, and analyzing the target. t. Report in the test report that a decrease in the execution process and working memory process is detected when the number of correct targets recognized is less than that of the control group. u. Count the number of blinks obtained from the left eye, right eye, or both eyes while visualizing, recognizing, maintaining, controlling, suppressing, fixating, tracking, and analyzing the target. v. Apply an intelligent algorithm that takes eye movement behavior as input to classify a person's ability. w. The form factor (FF) of microsaccades, i.e., i. HEWI: indicating the height / width relationship of microsaccades ii. AREA: indicating the area of the rectangle inscribed by the microsaccade iii. LONG: the length of the trajectory of the microsaccade in the horizontal-vertical plane iv. ANG: the sum of all angles in the horizontal-vertical plane of the microsaccade, giving an estimate of the regularity of the microsaccade trajectory v. AANG: The sum of all absolute values of the angles in radians in the horizontal-vertical plane of the microsaccades, which gives an estimate of the regularity of the microsaccade trajectory, vi. MOD and THETA: The coefficients and angles of the polar coordinates of the sum of the Cartesian coordinates, which give the spatial localization of the microsaccades with respect to the median of fixation, vii. TIME: The duration of the microsaccades in milliseconds, viii. VMIN and VMAX: The minimum and maximum speeds of the microsaccades in degrees per second, ix. Microsaccade rate: The instantaneous rate at each time interval, x. Direction coincidence: The coincidence between the microsaccade direction and the position of the stimulus, measuring, x. Measuring the eye positions (i.e., horizontal and vertical coordinates) obtained from the left eye, right eye, or both eyes while visualizing, recognizing, maintaining, controlling, suppressing, ordering, and analyzing the target, y. Measuring the total time (i.e., the time spent by the subject visualizing the target throughout the trial) of visualizing, recognizing, maintaining, controlling, fixating, tracking, and analyzing the target, z. Counting the number of correct targets recognized while visualizing, recognizing, maintaining, controlling, suppressing, fixating, tracking, and analyzing the target further configured to perform one or more of, The system according to claim 9.

Citation Information

Patent Citations

  • Method For Training And Quantifying Specific Motor Skills And Cognitive Processes In Persons By Analysing Oculomotor Patterns W Using A 3-D Virtual Reality Device With Embedded Eye-Tracking Technology, Specific Visual Stimuli, Sensors To Show The Movement Of Limbs

    US20240029886A1

  • Method and means for detecting dyslexia

    US4889422A