Method and system for testing cognition by processing a subject's reaction to stimuli
The method and system address the unreliability and cultural bias of existing cognitive tests by processing sensory stimulus responses to measure cognitive and emotional functioning, enabling faster, repeatable assessments and aiding in the diagnosis and monitoring of neurocognitive pathologies.
Patent Information
- Application Number
- FR2019008081
- Authority / Receiving Office
- FR · FR
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2019-07-17
- Publication Date
- 2024-11-29
- Estimated Expiration
- 2039-07-17
AI Technical Summary
Existing cognitive testing methods lack reliability due to unreliability in reaction time measurements and cultural bias, failing to distinguish responses related to difficulty from health status, and require long test batteries that are not adaptable for repeated use across diverse populations.
A method and system for testing cognition by processing a subject's reaction to sensory stimuli of increasing or decreasing complexity, measuring response times and errors, and processing these measurements to extract cognitive and emotional functioning information, using a system with sensory stimulus transmission, detection, and response processing means, including a database for storing responses and historical performances.
The method provides a faster, more international, and repeatable assessment of cognitive and emotional functioning, capable of distinguishing responses to difficulty from health status, and facilitating diagnosis and monitoring of neurocognitive pathologies and therapeutic effects.
Smart Images

Figure 00000014_0000 
Figure 00000014_0001 
Figure 00000015_0000
Abstract
Description
Title of the invention: Method and system for testing cognition by processing a subject's reaction to stimuli TECHNICAL FIELD OF THE INVENTION
[0001] The invention relates to a method for testing cognition by processing a subject's reaction to stimuli. The invention also relates to a system implementing said method. The method and system relate to the field of neuroscience and allow for testing certain cognitive abilities of a user as well as the reaction to difficulty, in order to assist in the assessment of cognitive functioning relating to context-adapted decision-making abilities and encompassing attentional and executive functions as well as the reaction to difficulty. STATE OF THE ART
[0002] Known in the prior art is patent application WO2009137663A1 which deals with testing and / or learning vision and cognition under stressful conditions. In the latter, the visual and cognitive abilities of a subject can be analyzed and / or trained by providing a visual stimulus to a subject. More particularly, a subject can be assessed and / or trained while under a stressful condition to determine the effect of a stressful condition, such as physical stress or cognitive stress, on the subject's visual and sensory abilities.
[0003] WO2003015059A1 discloses a system and method for diagnosing the onset and monitoring the progression of an intellectual disability. The method may include conducting one or more psychological tests and teaching a subject the rules for responding to one or more tests without providing cultural cues, such as may be found in language-based learning techniques. Appropriate responses to the tests may be simulated during a learning phase preceding the testing phase. An apparatus, system, and method for monitoring a cognitive function may be implemented in a computerized system.
[0004] Also known in the state of the art is US patent US6632174B1 which relates to a method for testing and / or evaluating cognitive abilities. Depending on the results, the cognitive level can then be divided into distinct cognitive skills and one or more tasks can be created, each task being linked to each of the distinct cognitive skills.
[0005] In another patent application US20090287064A1, a method is implemented by computer for cognitive testing, in particular for dementia-related conditions. The method is administered on a computer workstation in an interactive web-based format and examines the patient's cognitive abilities. The method can provide indications of dementia, including Alzheimer's disease and other cognitive disorders. The method does not require administration by a trained professional, but rather is administered in a web browser, uses a server and a workstation via the Internet or locally on the workstation.
[0006] Also known in the prior art is US patent US6280198B1 relating to a computer-implemented method for remotely administering and monitoring cognitive tests on a person using a computer network comprising remote computers. The computer-implemented method comprises administering a set of basic cognitive tests to the person. The method further comprises repeatedly administering a set of cognitive tests, obtaining a performance response of the person to the tests and downloading the test information via the computer network. A database may be constructed from the performance response of several people. The computer-implemented method comprises administration using at least two computers, at least one being local and the other being remote.
[0007] Finally, in the state of the art, Canadian patent CA 2683728 relates to the visual, cognitive and coordination skills of a subject which can be tested and / or trained by providing a variety of stimuli to a subject. Responses can be received from a subject, the appropriateness of which may depend on the combination of stimuli provided to the subject. A touch screen display device can be used both to provide stimuli and to receive responses from a subject. Any type of output device and input device for receiving responses can be used. Behavioral information and other data regarding a subject's performance can be recorded. Scoring can be based on speed, accuracy and other aspects of a subject's performance.
[0008] The known methods do not disclose a more reliable index for measuring brain function, because it does not involve a greater mobilization of the patient's attention. Consequently, there is a bias due to the diversity (unreliability) of the reaction time. In addition, the state of the art does not include filtering to distinguish, in the patients' responses, those linked to the reaction to the difficulty from those linked to the state of health.
[0009] The state of the art mainly uses simple or choice reaction time measures, or separate tests measuring specific functions with the calculation of an "overall" index. Then sets of tests are carried out, it being understood that the majority of the tests are culturally linked.
[0010] To assess attentional and executive difficulties (relating to context-adapted decision-making abilities), it is necessary to assess the cognitive and emotional aspects surrounding decision-making. This requires long test batteries. The majority of existing tests do not refer to recent neuroscience models, are linked to a given culture or language, and therefore cannot be used for all populations and have a learning effect (retest effect) which prevents their reuse on the same person for several months or even years.
[0011] The aim of the present invention is to propose a new evaluation method which is faster, more international and repeatable every few days (usable to monitor a follow-up), while being in phase with the latest developments in neuroscience. SUBJECT OF THE INVENTION
[0012] This objective is achieved with a method of testing cognition by processing a subject's reaction to sensory stimuli, comprising steps of: - submission of said subject to instructions to respond to these stimuli, of increasing or decreasing complexity according to at least three levels of difficulty, - measurement of response times and response errors to these stimuli, - storage of these response and error measurements, - processing of these response and error measurements thus stored, to extract information on the cognitive and emotional functioning of said subject.
[0013] This test method according to the invention can advantageously comprise processing of responses to stimuli of increasing complexity.
[0014] The set of stimuli emitted can be designed to distinguish at least two choices, each choice referring to two categories exclusive of each other.
[0015] In a practical embodiment of the test method according to the invention, it comprises three parts: - a first part intended to measure simple reaction times to stimuli, - a second part designed to measure reaction times to one choice, - a third part designed to measure reaction times with two choices,
[0016] The test method according to the invention can then further comprise processing of the reaction times measured in the first, second and third parts, comprising: - a list of errors caused by wrong choices and / or anticipated reactions, and / or reactions that are too slow, - access to the processing time of the difficulty linked to the subject's categorization instructions by having removed for each their simple reaction time corresponding to visual detection and motor response. - a mapping of the measurement results corresponding to the subject, on several axes including a first axis (S) representative of average reaction times and a second axis (A) representative of the subject's reaction to the difficulty of the stimuli.
[0017] We can then advantageously include a step to put execution times of tasks of different difficulties back on the same scale, in order to be able to compare them.
[0018] The test method according to the invention may further comprise a “semi-random” stimulus selection operation.
[0019] The stimuli may include images or sounds.
[0020] The detection of a response to a stimulus may comprise a detection of the release of an action previously initiated and continuously exercised until the arrival of said stimulus.
[0021] According to another aspect of the invention, there is provided a system for processing the responses of a human or animal subject to sensory stimuli, comprising means for emitting these stimuli towards a subject, means for detecting responses of the subject to these stimuli, means for processing the responses thus detected, and means for extracting therefrom information on the cognitive and emotional functioning of said subject, characterized in that it further comprises means for subjecting said subject to response instructions to these stimuli, of increasing or decreasing complexity according to at least three levels of difficulty.
[0022] The means for emitting sensory stimuli to a subject may comprise a screen or an audio headset or a sound emitting device.
[0023] The system comprises at least one database for storing the responses and optionally the historical performances of each subject. This database may further comprise the stimuli, for example, comprising images of animals, or images of objects in different colors.
[0024] The response detection means may advantageously be provided to receive pressure continuously exerted by the subject and to detect a release of this pressure which is interpreted as a response to this stimulus. The response detection means provided to receive pressure continuously exerted by the subject and to detect a release of this pressure comprise a computer mouse. BRIEF DESCRIPTION OF THE FIGURES
[0025] The invention will be better understood with reference to the following figures:
[0026] [Fig-1] [Fig.l] illustrates a practical example of a group of tests (A,B,C) put implemented in the method according to the invention, and the fact that each group of tests is preceded by a task learning phase.
[0027] [Fig.2] [Fig.2] illustrates a particular mode of response to a stimulus with motor engagement of attention (pressure triggering the test);
[0028] [Fig.3] [Fig.3] illustrates the steps associated with part A of a test: measurement of the subject's reaction time;
[0029] [Fig.4] [Fig.4] illustrates an example of an image from the database, without colors and with full colors;
[0030] [Fig.5] [Fig.5] illustrates the steps associated with part B of a test: measurement of reaction time associated with a choice category;
[0031] [Fig.6] [Fig.6] illustrates the steps associated with part C of a test: measurement of reaction time associated with two categories of choice;
[0032] [Fig.7] [Fig.7] is an example of a data mapping of a set of measurement witnesses collected in the test method according to the invention;
[0033] [Fig.8] [Fig.8] represents an example of a table of correlations between the collected data;
[0034] [Fig.9] [Fig.9] illustrates a method of graphically representing the results of a control group and the observed axis of symmetry then the data represented with a rotation of 45 degrees according to the axis of symmetry; and
[0035] [Fig. 10] [Fig. 10] schematically represents the different measurements taken, of errors and time and the mathematical processing which is carried out from these measurements. DETAILED DESCRIPTION OF THE INVENTION
[0036] We will now describe, with reference to Figures 1 to 6, a practical example of implementation of the test method according to the invention, comprising three parts A, B and C of increasing difficulty, each including 16 tests and preceded by a learning task. The subject is placed in front of a computer screen and responds to the stimuli by means of a mouse connected to this computer. The number of images and their complexity are identical in all conditions. The subject is asked to identify different targets in each condition.
[0037] This test makes it possible to highlight on the same data two independent axes of cognition of executive functions.
[0038] The use of a mouse is an example, another object being able to perform the same function such as for example a touch screen, a keyboard, a joystick, a pedal, a stylus, and more generally any object capturing pressure or a fixation on a target followed by a change, for example a gaze direction sensor.
[0039] For example, the present invention may use the various devices to test a wide range of motor skills such as moving objects (changing location) and / or complex / continuous motor skills such as positioning (by acting on a discrete state control) or adjustment. The present invention may also measure movement time, smoothness of movement, complex hand-eye coordination, hand-hand coordination, foot-eye coordination.
[0040] The system may include software, as well as a combination of software and hardware, for example: specially adapted game controllers, pedals, microphones, etc. It may further be configured to operate as a stand-alone module located in the user's home, a medical center, an institution, a therapeutic center or any other suitable location. It may further include an interconnected system of one or more workstations. The system may include adaptable computer programs accessible to the computers / workstations via CDs, USB sticks, the Internet, an intranet or any other means for transporting information.
[0041] The test method according to the invention comprises, with reference to [Fig. 2], elementary interrogation sequences consisting of pressing a device signifying the engagement of the subject's attention, a waiting time, the emission of a stimulus and a response from the subject by maintaining or releasing the pressure. The stimuli can be visual (images) or auditory (sounds) and have common properties (identical visual load, duration, frequency, identical sound volume, and others). The stimuli each respect the criteria of the instruction or not (for example gray or white, object or alive, low or high). The instruction is for the subject to release the pressure if the stimulus respects all the criteria of the instruction, whether this is simple or complex.
[0042] The response is validated or not depending on whether the stimulus meets the setpoint criteria. In the case of a good response, as in the case of a bad response, the time between the emission of the stimulus and the response is measured.
[0043] In this embodiment, the test is carried out using a computer and is based on a response where one "lifts the finger from the mouse" after having verified attentional engagement by engaging the finger on the mouse. The subject's action is measured so as to evaluate a speed of brain functioning by having removed the motor elements from the response.
[0044] Part A of the test according to the invention is dedicated to measuring the subject's simple reaction time. With reference to [Fig.3], a white screen is first displayed for 0.2 seconds, then a 2-second prompt to click the mouse appears. A blank screen is displayed for a random duration of between 2 and 7 seconds. If the subject responds during this sequence by releasing their finger, this response will be interpreted as an impulsive error. Following the blank screen of random duration, a test image is displayed for 3 seconds. A non-response to this stimulus is interpreted as an error of omission.
[0045] [Fig.4] shows an example of a test image displayed among the 16 images of a part A, B or C of the test, with 4 different images for each category. The images are extracted randomly from a database and no image is repeated.
[0046] In part B of the test, illustrated by [Fig.5], the objective is to measure reaction times and a choice of category (e.g., white / gray). A choice criterion is randomized. This criterion is, for example, that the subject releases his click only if the image is gray.
[0047] The elementary sequence of this part B inviting to release the click if the image is white, is for example the successive display of a white screen for 0.2 seconds, an invitation to click on the mouse for a duration of 2 seconds, a random white screen of 2 to 7 seconds, followed by either a gray image or a white image, for 3 seconds. The fact that the subject made a bad choice, in this case having released the pressure when the gray image appeared, will be considered as an error of choice.
[0048] Part C of the test according to the invention, illustrated by [Fig.6], is dedicated to reaction time measurements and the collection of two choices (white / grey and living / non-living). The criterion for the white / grey choice is the opposite of condition B, while the criterion for the living / non-living or object choice is randomized, for example an invitation to release the click only if the image is both grey and living.
[0049] Examples of processing of data collected by the test method according to the invention will now be described, in particular with reference to FIGS. 7 to 10.
[0050] The test method according to the invention comprises a part intended to aid in understanding the cognitive functioning of a diagnostic subject by post-processing the subject's data with the aim of isolating two components of the possible slowdown in said subject, and of being able to issue a diagnosis. It is thus a question of understanding how this subject makes a decision by breaking down his cognition according to a set of indicators of his underlying cognitive functioning.
[0051] The data processing is carried out on standardized response times by removing the response time to the simplest experiment from the other response times, in order to free oneself from the parts of perception of the stimulus and implementation of the response action in the response time.
[0052] With reference to Figures 7 and 8, a correlation matrix between the characteristics / practices of the 84 subjects considered normal, and having served as controls in this first calibration and the processing of the data collected for the three test batteries A, B and C was established.
[0053] From the data of response times normalized to experiments of increasing analytical difficulty, a two-factor analysis is carried out, noted S and A. These two factors have been shown to be independent of each other. The first factor S is representative of an overall slowing down of the subject from an average speed linked to the attention of the subject to the task brought back into a scale independent of the level of difficulty, and the second factor A of an over or under slowing down during an increase in difficulty.
[0054] These two factors can be used to characterize normal or pathological cognitive functioning. These elements could then be used as: aids in the diagnosis of neurocognitive pathologies, in therapeutic monitoring, in monitoring the cognitive effects of a treatment, in research on the effects of a treatment or therapy, in screening for cognitive disorders, in understanding the difficulties in the daily lives of people suffering from cognitive or emotional disorders, in particular in order to put in place effective strategies for daily assistance, in the characterization of certain vigilance disorders.
[0055] The cognitive functioning of a subject and the cognitive-emotional aspects related to his decision-making are characterized, which will allow his attentional and executive functions to be statistically positioned in relation to standards. In addition to these two factors, the analysis includes other factors based on an analysis of the rate and type of errors produced and the variance of response times for each individual. The aim of the test is to observe whether each of these factors deviates statistically from the standards.
[0056] We will now describe, with reference to Figures 9 and 10, an example of determining a task difficulty coefficient. The principle is to put execution times of tasks of different difficulties into the same scale, in order to be able to compare them.
[0057] For reaction time A, it was observed that this time has low fluctuations. It was decided to subtract time A which is considered as a “motor” time base (perception of the item and decision-making and execution of the motor response)”, because what interests us is the “cerebral” overtime linked specifically to the analysis of the difficulty.
[0058] With this method, the times of different levels of difficulty are brought back to the same scale by a multiplicative coefficient, in order to be able to compare them. This change of scale is made after the subtraction of the reaction time A. This coefficient 1.61 (non-limiting) was established on the data of the 84 control subjects used for calibration, and this coefficient will be adjusted as the calibration base increases, in particular according to the age and other parameters of the subject. This coefficient is calculated as the ratio of the average (on the control group) of CA by the average of BA.
[0059] This reaction time A was subtracted from the two other conditions which involved additional difficulties:
[0060] B'=BA and C'= (CA) / coefficient
[0061] We have thus aligned the means (B1 and C have the same mean on the control group). We then also observe that we no longer see the differences between the two distributions. The standard deviations have become identical.
[0062] From a scientific point of view, this seems to mean that the remaining response time, the extra time needed for the brain to analyze the difficulty, is a linear variable in the difficulty.
[0063] We then compared the two distributions and observed that we cannot statistically reject the hypothesis that they are identical.
[0064] In a 2D table with B'= BA on the abscissa and C'=(CA) / coefficient on the ordinate, as B' and C' have the same distributions, the graph of the 2D distribution is essentially symmetrical. From there, we looked for the coordinates respecting this symmetry. We therefore defined new coordinates S and A which are the proper directions of the principal components.
[0065] Whenever the data have a symmetry, axes corresponding to this symmetry are chosen. In the test method according to the invention, a change of axis has thus been made. It is just a different representation without loss of information. Thanks to this symmetry, we can look at the half-sum and the half-difference, because we know (as we observe that B' and C have the same standard deviations) that they are mathematically decorrelated.
[0066] For S, we obtain a reaction time (RT) of the subject which is independent of the difficulty, therefore specific to the individual subject of the test. We obtain a representation of the attentional functioning specific to each person.
[0067] For A, on the contrary, it is linked to the notion of increase in difficulty, it represents the way in which one reacts to the increase in difficulty. - S is the average attentional time, corresponding to the average executive slowdown of a person. In a scale made independent of the level of difficulty of the tasks; - A is the variation in response time related to the increase in task difficulty, an index of reaction to difficulty, including emotional reaction but also an index of adaptation to difficulty.
[0068] As an example illustrated by [Fig. 10], the variables S and A can be calculated as follows:
[0069] A = (C'-B') / 2 = (0.38A-B+0.62C) / 2
[0070] S=T'BC=(C'+B') / 2
[0071] The present invention may also be implemented on individual workstations or on multiple workstations connected to a network in retirement homes and communities, or health clubs.
[0072] The present invention may also include a database that may store the responses and possibly the historical performance of each user. The database may be local or remote and may be accessible via the Internet or be fully or partially available at the user's facility. In one embodiment, the database may be maintained by an organization and may accumulate the histories and responses of many individuals, thereby allowing for the possible creation of a global norm database. The database may be used to compare the stored responses with the current user's responses to facilitate cross-validation of the user's test results against currently acceptable diagnostic criteria.
[0073] In this way, it may be possible to characterize the current user's deviation from normal and possibly use it as a diagnostic aid tool, which may help the clinician in determining cognitive deficit related to a pathology such as post-traumatic deficit (following a stroke or head injury), Alzheimer's disease, Parkinson's disease (in particular but not exclusively). This tool for determining cognitive functioning will therefore constitute an element of assistance in the diagnosis of behavioral disorders such as hyperactivity and attention deficit disorder (in particular, but not exclusively, with all the tests dealing with attention capacities), or learning disorders such as dyslexia, dysgraphia or dyscalculia (mainly, but not exclusively, with tests measuring fluency and naming).The uses of the database are not limited to these applications, and are included in the principle of the present invention other applications thereof.
[0074] It is noted that the present invention may be operable from a mobile storage device, such as a CD or USB flash drive, or may be accessible from a central computer or via public communication networks, such as the Internet. In addition, the present invention may be practiced by a single person or a organization, and the database may be centralized, localized and / or owned by an internal or external organization.
[0075] Of course, the invention is not limited to the examples which have just been described and numerous adjustments can be made to these examples without departing from the scope of the invention. In addition, the various characteristics, forms, variants and embodiments of the invention can be associated with each other in various combinations to the extent that they are not incompatible or exclusive of each other.
Claims
Claims
1. System for processing the responses of a human or animal subject to sensory stimuli, comprising means for emitting these stimuli to a subject, means for detecting responses of the subject to these stimuli, means for processing the responses thus detected, a database for storing the responses and means for extracting therefrom information on the cognitive and emotional functioning of said subject, means for subjecting said subject to instructions for responding to these stimuli, of increasing or decreasing complexity according to at least three levels of difficulty corresponding respectively to simple reaction times to stimuli, to reaction times to a choice, and to reaction times with two choices, each choice referring to two categories exclusive of each other,characterized in that the processing means are arranged to provide access to the processing time of the difficulty linked to instructions for categorizing the subject, having removed for each its simple reaction time corresponding to visual detection and motor response.
2. System according to the preceding claim, characterized in that the database is provided to store the historical performances of each subject.
3. System according to the preceding claim, characterized in that the database comprises images of animals following different color gradients.
4. System according to any one of the preceding claims, characterized in that the database further comprises images of objects following different color gradients.
5. System according to any one of the preceding claims, characterized in that the means for emitting a sensory stimulus towards a subject comprise a screen or an audio headset or a sound emitting device.
6. System according to any one of the preceding claims, characterized in that the response detection means are provided to receive pressure or fixation of the gaze exerted continuously by the subject and to detect a release of this pressure or fixation of the gaze. pressure or fixation that is interpreted as a response to that stimulus.
7. System according to the preceding claim, characterized in that the response detection means provided to continuously receive pressure or fixation exerted by the subject and to detect a release of this pressure or fixation comprise a computer mouse, or a game controller or a touch screen or a device for capturing the direction of gaze or any accessory capable of capturing pressure or direction of gaze.
