A method for evaluating the executive function status of a subject based on fNIRS blood oxygen data and EEG data

Abstract

The present application provides a method for evaluating the executive function state of a subject based on brain fNIRS blood oxygen data and EEG data, and the method relates to the technical field of executive function state evaluation. It includes sequentially executing a preset number of task blocks at a preset first time interval, and pseudo-randomly alternating condition-consistent trials and condition-inconsistent trials at a second time interval in each task block; obtaining the brain fNIRS blood oxygen data of the subject during each task block and the first time interval and the EEG data of each trial in a preset third time period before and after the start of the second time period; evaluating the executive function state of the subject based on the acquired EEG data and brain fNIRS blood oxygen data of the subject. In this way, a dual-modal task paradigm for evaluating the executive function state of the subject can be provided, and accurate evaluation of the executive function state can be achieved based on EEG data and fNIRS blood oxygen data.

Description

Technical Field

[0001] The present application relates to the technical field of executive function status assessment, and in particular to a method for assessing the executive function status of a subject based on brain fNIRS blood oxygen data and electroencephalogram data. Background Art

[0002] Schizophrenia (SZ), bipolar disorder (BD), major depressive disorder (MDD), and attention deficit hyperactivity disorder (ADHD) all have executive dysfunction. In the fNIRS study, SZ patients, BD patients, MDD patients, and ADHD patients had significant differences in blood oxygen response during task execution compared with the healthy group due to executive dysfunction; however, the blood oxygen response between patients with different mental illnesses was not obvious. Although EEG data is helpful in distinguishing types of mental illness, it is difficult to accurately assess the executive function status of the subject using only EEG data.

[0003] Since the blood oxygen signal collected by fNIRS is a slow signal and the EEG signal collected by EEG is a fast signal, the task paradigm suitable for fNIRS signal collection is usually not suitable for EEG signal collection, and the task paradigm suitable for EEG signal collection is not suitable for fNIRS signal collection. At present, since there is no fNIRS and EEG dual-modal task paradigm suitable for evaluating the executive function status of the subject, it is difficult to combine fNIRS and EEG dual-modal signal indicators to evaluate the executive function status of patients with mental illness or subjects with mental illness tendencies. Summary of the invention

[0004] This application is proposed to solve the above technical problems in the prior art. This application aims to provide a method for evaluating the executive function state of a subject based on brain fNIRS blood oxygen data and EEG data, which can provide a dual-modal task paradigm for evaluating the executive function state of the subject, so as to simultaneously obtain the brain fNIRS blood oxygen data and EEG data of the subject when performing the dual-modal task paradigm, and more accurately evaluate the executive function state of the subject based on the brain fNIRS blood oxygen data and EEG data, and accurately classify mental illnesses related to the executive function state.

[0005] According to a first scheme of the present application, a method for evaluating the executive function state of a subject based on fNIRS blood oxygen data and EEG data of the brain is provided, wherein the subject may include a patient with a mental illness or a subject with a tendency to a mental illness, wherein the method comprises using a processor to perform the following steps: sequentially executing a preset number of task blocks at a preset first time interval, and pseudo-randomly alternatingly executing condition-consistent trials and condition-inconsistent trials in each task block at a second time interval, wherein the second time interval is pseudo-randomly selected from a set of candidate time periods of several hundred milliseconds so that each candidate time period in each task block maintains a predetermined ratio, and executing the condition-consistent trials comprises sequentially executing the condition-inconsistent trials at a preset first time interval. A fixation point is presented in a first time period, and a Chinese character whose color is consistent with its meaning is presented in a preset second time period, and the subject's judgment result on the color of the Chinese character is received. The execution of the inconsistent condition trial includes sequentially presenting a fixation point in a preset first time period, presenting a Chinese character whose color is inconsistent with its meaning in a preset second time period, and receiving the subject's judgment result on the color of the Chinese character; obtaining the subject's brain fNIRS blood oxygen data during each task block and the first time interval and the EEG data in a preset third time period from before to after the start of the second time period in each trial; and evaluating the subject's executive function state based on the acquired EEG data and brain fNIRS blood oxygen data of the subject.

[0006] According to a second scheme of the present application, a method for evaluating the executive function state of a subject based on brain fNIRS blood oxygen data and EEG data is provided, wherein the subject may include a patient with a mental illness or a subject with a tendency to a mental illness, wherein the method comprises using a processor to perform the following steps: sequentially executing a preset number of task blocks at a preset first time interval, and pseudo-randomly alternatingly executing condition-consistent trials and condition-inconsistent trials at a second time interval in each task block, wherein the second time interval is pseudo-randomly selected from a set of candidate time periods of several hundred milliseconds so that each candidate time period in each task block maintains a predetermined ratio, and executing the condition-consistent trials comprises sequentially presenting a fixation pattern within the preset first time period. , presenting the object with the matching first element and the second element in a preset second time period and receiving the subject's judgment result on the first element of the object, executing the inconsistent condition trial includes sequentially presenting the fixation pattern in the preset first time period, presenting the object with the first element and the second element that interferes with it in the preset second time period and receiving the subject's judgment result on the first element of the object; obtaining the subject's brain fNIRS blood oxygen data during each task block and the first time interval and the EEG data in a preset third time period from before to after the start of the second time period in each trial; and evaluating the subject's executive function state based on the acquired EEG data and brain fNIRS blood oxygen data of the subject.

[0007] According to a third scheme of the present application, a device for evaluating the executive function state of a subject based on brain fNIRS blood oxygen data and EEG data is provided, wherein the subject may include a patient with mental illness or a subject with a tendency to mental illness, and the device includes a processor, wherein the processor is configured to execute the method for evaluating the executive function state of a subject based on brain fNIRS blood oxygen data and EEG data as described in each embodiment of the present application.

[0008] According to the fourth scheme of the present application, a system for evaluating the executive function state of a subject based on brain fNIRS blood oxygen data and EEG data is provided, and the subject may include a patient with mental illness or a subject with a tendency to mental illness, and the system includes: a brain fNIRS acquisition module, used to collect the brain fNIRS blood oxygen data of the subject; an EEG acquisition module, used to collect the EEG data of the subject; an interface, which is configured to obtain the brain fNIRS blood oxygen data of the subject from the brain fNIRS acquisition module, and the EEG data of the subject from the EEG acquisition module; and a processor, which is configured to execute the method for evaluating the executive function state of the subject based on brain fNIRS blood oxygen data and EEG data as described in each embodiment of the present application.

[0009] Compared with the prior art, the beneficial effects of the embodiments of the present application are:

[0010] The method for evaluating the executive function state of the subject based on brain fNIRS blood oxygen data and EEG data provided in the embodiment of the present application is to execute a preset number of task blocks in sequence at a preset first time interval, and the time consumed for executing each task block is expected to be no less than 10s, and the blood oxygen level can reach a peak value in response to the generation of stimulation, which can meet the collection requirements of brain fNIRS blood oxygen data. In addition, in each task block, conditional consistency trials and conditional inconsistency trials are pseudo-randomly executed alternately at a second time interval, and the time consumed for executing each trial is expected to be about 2s, and the EEG signal within 1s or 2s caused by the stimulation in each trial can be obtained, thereby meeting the collection requirements of EEG data. Therefore, the method provided in the embodiment of the present application can provide the subject with an fNIRS-EEG dual-modal task paradigm for simultaneously collecting brain fNIRS blood oxygen data and EEG data, so that the subject's brain fNIRS blood oxygen data and EEG data can be obtained simultaneously during the subject's execution of the dual-modal task paradigm.

[0011] Based on the acquired EEG data and brain fNIRS blood oxygen data, it can be used to evaluate the executive function status of the subject, and the evaluation results have high reliability and accuracy. Moreover, based on the evaluation results, patients with mental illness can be distinguished from healthy people, and different mental illnesses can also be classified according to the evaluation results.

[0012] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above description and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] In the drawings, which are not necessarily drawn to scale, the same reference numerals may describe similar parts in different views. Similar reference numerals with letter suffixes or different letter suffixes may represent different examples of similar components. The accompanying drawings generally illustrate various embodiments by way of example and not by way of limitation, and together with the description and claims, are used to illustrate the disclosed embodiments. Such embodiments are illustrative and exemplary and are not intended to be exhaustive or exclusive embodiments of the present method or non-transitory computer-readable medium having instructions for implementing the method.

[0014] Figure 1 A flow chart of a method for evaluating the executive function state of a subject based on brain fNIRS blood oxygen data and EEG data according to an embodiment of the present application is shown.

[0015] Figure 2 A schematic diagram of an interface for sequentially presenting a preset number of task blocks according to an embodiment of the present application is shown.

[0016] Figure 3 A flowchart of a method for evaluating a subject's executive function state based on brain fNIRS blood oxygen data and EEG data according to an embodiment of the present application is shown.

[0017] Figure 4 A schematic diagram of the structure of a system for evaluating the executive function state of a subject based on brain fNIRS blood oxygen data and EEG data according to an embodiment of the present application is shown. DETAILED DESCRIPTION

[0018] In order to enable those skilled in the art to better understand the technical solution of the present application, the present application is described in detail below in conjunction with the accompanying drawings and specific implementation examples. The embodiments of the present application are further described in detail below in conjunction with the accompanying drawings and specific implementation examples, but are not intended to limit the present application.

[0019] The words "first", "second" and similar words used in this application do not indicate any order, quantity or importance, but are only used to distinguish. The words "include" or "comprises" and similar words used in this application mean that the elements before the word include the elements listed after the word, and do not exclude the possibility of covering other elements. In this application, the arrows shown in the figures of each step are only examples of the execution order, not limitations. The technical solution of this application is not limited to the execution order described in the embodiments. The various steps in the execution order can be combined, decomposed, or the order can be changed, as long as the logical relationship of the execution content is not affected.

[0020] All terms (including technical terms or scientific terms) used in this application have the same meaning as those understood by ordinary technicians in the field to which this application belongs, unless otherwise specifically defined. It should also be understood that terms defined in general dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and should not be interpreted in an idealized or extremely formal sense, unless explicitly defined here. Techniques and equipment known to ordinary technicians in the relevant field may not be discussed in detail, but where appropriate, the techniques and equipment should be considered as part of the specification.

[0021] Figure 1 A flow chart of a method for evaluating the executive function state of a subject based on brain fNIRS blood oxygen data and EEG data according to an embodiment of the present application is shown. Executive function refers to a set of high-level cognitive processes, including planning, organization, task initiation, flexibility, attention control, and self-monitoring, which help individuals make decisions and solve problems in a dynamic environment. Many mental illnesses, such as major depressive disorder (MDD), bipolar disorder (BD), anxiety, schizophrenia (SZ), attention deficit hyperactivity disorder (ADHD), etc., are often accompanied by disorders of executive function. However, due to the different executive dysfunctions and manifestations of patients with different mental illnesses, there is currently no method for evaluating the executive function state of different mental illnesses.

[0022] The embodiment of the present application utilizes a processor to execute the method shown in step S101-step S103. In this embodiment, the arrows shown in the figures of each step are merely examples of the execution order, rather than limitations. The technical solution of the present application is not limited to the execution order described in the embodiment. The various steps in the execution order can be combined for execution, can be decomposed for execution, and can be reordered, as long as the logical relationship of the execution content is not affected.

[0023] Figure 2 A schematic diagram of an interface for sequentially presenting a preset number of task blocks according to an embodiment of the present application is shown. Figure 2 Provide specific instructions.

[0024] In some embodiments, before the subject performs the fNIRS-EEG dual-modality task paradigm, the subject can wear a head cap suitable for collecting fNIRS signals and EEG signals, and the installation position of the fNIRS signal acquisition probe and the installation position of the EEG electrodes configured in the head cap can be set by the user based on prior medical knowledge, and there is no specific limitation on this; the paradigm type of the fNIRS-EEG dual-modality task paradigm can be, for example, the Stroop paradigm used to evaluate the subject's executive function status.

[0025] After the subject wears the head cap suitable for collecting fNIRS signals and EEG signals, the fNIRS-EEG dual-modality task paradigm can be started to collect the EEG data and brain fNIRS blood oxygen data of the subject when performing the fNIRS-EEG dual-modality task paradigm.

[0026] In step S101, a preset number of task blocks are executed in sequence at a preset first time interval, and in each task block, condition-consistent trials and condition-inconsistent trials are executed alternately and pseudo-randomly at a second time interval, the second time interval is selected in a pseudo-random manner from a group of candidate time periods of several hundred milliseconds so that each candidate time period in each task block maintains a predetermined ratio, executing the condition-consistent trials includes sequentially presenting a fixation point within the preset first time period, presenting a Chinese character whose color is consistent with its meaning within the preset second time period, and receiving the subject's judgment result on the color of the Chinese character, and executing the condition-inconsistent trials includes sequentially presenting a fixation point within the preset first time period, presenting a Chinese character whose color is inconsistent with its meaning within the preset second time period, and receiving the subject's judgment result on the color of the Chinese character.

[0027] In some embodiments, Figure 2 As shown, Figure 2 The first time interval shown in is 18000ms. Five task blocks 201 need to be executed to perform a complete assessment. That is, after the subject completes the first task block 201, he rests for 18000ms, then executes the second task block, then rests for another 18000ms, and then continues to execute the third task block... until the fifth task block is completed and the task is terminated after a rest of 18000ms. Alternatively, the task can be terminated directly after the subject completes the fifth task block. Figure 2 Only one task block 201 and a first time interval for rest are shown, and the rest are indicated by ellipsis and are not shown in detail.

[0028] Among them, the first time interval is at least 10 seconds so that the subject's blood oxygen response level returns to the baseline level, and the first time interval is not greater than 60 seconds to avoid excessive rest time that wastes time and easily distracts the subject's attention and responds to the effect of the final evaluation.

[0029] There is no specific limitation on the preset number. Preferably, the preset number is 2-8. In this way, for a complete assessment, the subject only needs to perform 2-8 task blocks, and the subject can accept the difficulty of the task.

[0030] In some other embodiments, for a complete assessment, 2 to 8 task blocks are executed sequentially with a first time interval of 10s to 60s, and the duration of each task block is 10s to 180s. In this way, it will not take too long for the subject to complete a complete dual-modal task paradigm, and the subject can complete the entire assessment task with better attention and emotional state, thereby avoiding a longer time that increases the difficulty of the task and causes the subject to lose patience, resulting in the failure to successfully complete the assessment task.

[0031] In this embodiment, the condition consistent trials and the condition inconsistent trials are pseudo-randomly performed alternately in each task block at a second time interval, that is, in each task block, the condition consistent trials and the condition inconsistent trials are pseudo-randomly presented alternately, which is conducive to avoiding the interference of external regular noise. Wherein, the second time interval is selected from a group of candidate time periods of several hundred milliseconds in a pseudo-random manner so that each candidate time period in each task block maintains a predetermined ratio, which can make each task block maintain the same time length, facilitate the complete collection of effective brain fnirs blood oxygen data, and facilitate the convenient analysis and processing of brain fnirs blood oxygen data. At the same time, the condition consistent trials and the condition inconsistent trials in each task block are pseudo-randomly presented alternately, and when the rapid collection requirements of electroencephalogram data can be met, the subject can be prevented from having an expected reduction in stimulation to the brain for the next trial. Such a design can take into account the dual-modal collection requirements of fnirs signal collection and electroencephalogram signal collection, and accurately obtain brain fnirs blood oxygen data and electroencephalogram data.

[0032] Specifically, Figure 2 , the candidate time periods in task block 201 are 217 ms, 417 ms, and 617 ms, respectively. The second time interval in each consistent and inconsistent trial is pseudo-randomly selected from the three candidate time periods of 217 ms, 417 ms, and 617 ms. For example, assuming Figure 2The task block 201 in has 5 trials. It is preset that among these 5 trials, the predetermined proportion of the second time interval of 217 ms is 20%, the predetermined proportion of the second time interval of 417 ms is 40%, and the predetermined proportion of the second time interval of 617 ms is 40%. Then, when the subjects perform the 5 task blocks 201, each task block 201 pseudo-randomly alternates and presents condition-consistent trials and condition-inconsistent trials according to the above predetermined proportion.

[0033] In some other embodiments, the group of candidate time periods of several hundred milliseconds are selected from the range of 87ms to 917ms, and the second time interval is selected from the range of 87ms to 917ms in a pseudo-random manner, which is beneficial for preventing external fixed frequencies from interfering with EEG data and avoiding the aliasing of EEG data and fixed-frequency noise interference that makes them difficult to separate, and can also make the difficulty of each task block adapt to the acceptance of the subjects, so that the subjects will not have an emotional breakdown due to too fast a change in trials, and thus be unable to complete the entire assessment task, and the subjects will not lose patience due to too slow a change in trials, resulting in the inability to successfully complete the assessment task.

[0034] The executive function states of patients with different mental illnesses vary greatly. Therefore, in other embodiments, the duration deviations of the candidate time periods can be determined based on pre-test results for depression, schizophrenia, bipolar disorder, and ADHD.

[0035] In some embodiments, before the subject formally begins to perform the test task, the doctor can preliminarily determine the possible type of mental illness of the subject through test scales, questionnaires, interviews, etc., for example, to determine whether the subject suffers from depression, schizophrenia, bipolar disorder or ADHD. Then, the doctor can set each candidate time period according to the subject's tendency to suffer from mental illness.

[0036] For example, subjects with a tendency to depression react slowly to stimuli. Therefore, for subjects with a tendency to depression, the duration deviation between each candidate time period when performing the task can be larger, such as a duration deviation of 400ms, so that subjects with a tendency to depression can respond to stimuli. For subjects with a tendency to schizophrenia, their awareness of subtle time difference deviations is higher, so the duration deviation can be set smaller, such as 100ms. For another example, for subjects with a tendency to ADHD, a larger duration deviation may cause the subject's emotional instability, impatience, and impatience, making it impossible to complete the entire assessment task well. Therefore, the duration deviation can be set smaller, such as a duration deviation of 150ms.

[0037] This is only for illustrative purposes and does not constitute a limitation on the specific solution. Doctors or other users can set the time deviation between each candidate time period according to the tendency of the mental illness of the subject to be examined initially judged by themselves.

[0038] In a preferred embodiment, the time deviation between each candidate time period is 100 - 400 ms. In this range, it can not only avoid the interference of external fixed frequencies on the EEG data, but also will not affect the emotional state, attention, etc. of the subject due to too small or too large time deviation, and can enable the subject to complete the entire evaluation task well and obtain real and effective brain fnirs blood oxygen data and EEG data.

[0039] In this embodiment, performing the consistent-condition trials includes sequentially presenting a fixation point within a preset first time period, presenting a Chinese character whose color is consistent with its meaning within a preset second time period, and receiving the subject's judgment result on the color of the Chinese character. In some other embodiments, the first time period is 80 - 617 ms, and the second time period is 400 to 1817 ms. Specifically, as Figure 2 shown, in the consistent-condition trials in task block 201, a fixation point plus sign is presented within a preset first time period of 517 ms, and the Chinese character "黄" (yellow) with a yellow font color is presented within a preset second time period of 1017 ms, and the font color of the Chinese character "黄" is consistent with the meaning of "yellow".

[0040] Figure 2 The content shown is only for illustrative purposes. For example, the fixation point can also be a dot, a circle, a triangle or other symbols, and no limitation is made thereto.

[0041] Among them, within the preset second time period, the subject observes the color of the Chinese character and confirms the judgment result on the color of the Chinese character. For example, the subject can execute the judgment result on the color of the Chinese character through various methods such as a touch screen, voice or buttons, and no limitation is made thereto.

[0042] And performing the inconsistent-condition trials includes sequentially presenting a fixation point within a preset first time period, presenting a Chinese character whose color is inconsistent with its meaning within a preset second time period, and receiving the subject's judgment result on the color of the Chinese character. That is to say, the inconsistent-condition trials are different from the consistent-condition trials. In the inconsistent-condition trials, the color of the font presented within the second time period is inconsistent with its meaning. For example, the color of the presented font is red, but the Chinese characters are "黄" (yellow), "蓝" (blue) or "绿" (green), then the color of the presented font is inconsistent with the meaning of the Chinese character, which is an inconsistent-condition trial.

[0043] In some other embodiments, the proportion of inconsistent trials in each task block is 30% to 90%, so that the proportion of inconsistent trials in each task block can be flexibly adjusted according to the subject's tendency to suffer from mental illness or the degree of damage to brain function, so as to better adapt to subjects with different tendencies to suffer from mental illness. For example, if the subject's tendency to suffer from mental illness is pre-assessed, if the subject has a tendency to suffer from schizophrenia, the proportion of inconsistent trials in each task block can be lowered a little, for example, only 40%, so that the difficulty of the task in each task block can be better accepted by the subject, so as to better complete the evaluation task.

[0044] This is just an example. Doctors can flexibly adjust the proportion of inconsistent trials in each task block to make the task difficulty of each task block compatible with the tolerance of the subject, so as to ensure that the subject completes the fNIRS-EEG dual-modality task paradigm with high quality.

[0045] Among them, three or four colors are selected from red, yellow, blue and green. The color of the presented Chinese characters can be set by the user according to the color vision condition of the subject.

[0046] For example, when the subject belongs to a group with normal color vision, three or four colors are randomly selected from red, yellow, blue, and green for the colors of the presented Chinese characters; when the subject belongs to a group with red-green color blindness, for example, for a group with green color blindness, three or four colors can be randomly selected from red, yellow, blue, and gray for the colors of the presented Chinese characters, or three or four colors can be randomly selected from red, yellow, blue, and black for the colors of the presented Chinese characters. For example, for a group with red color blindness, colors can be randomly selected from yellow, blue, and gray for each face picture with a corresponding emotion.

[0047] It should be noted that the above-mentioned targeted settings are only exemplary. In actual applications, corresponding settings can be made according to the specific types of visual impairment to improve the universality of the method provided in the embodiments of the present application.

[0048] In some other embodiments, when the subject is red-green color blind, the color of Chinese characters is determined based on manual operation, wherein the manual operation may be, for example, pressing a button, touching a touch screen, etc.

[0049] Specifically, before the subject performs the fNIRS-EEG dual-modality task paradigm, red, yellow, blue and green blocks can be pre-presented on the display interface, and the subject can distinguish each color. For example, the subject can listen to the doctor's color instructions to select the blocks corresponding to the color instructions, or match the blocks with the text of the prompt color to distinguish blocks of different colors. The processor obtains the subject's distinction results for red, yellow, blue and green, and identifies the subject as belonging to a normal color vision group, a red blind group or a green blind group based on the subject's distinction results for red, yellow, blue and green. For example, if the subject is shown red, yellow, blue and green pictures, if the subject considers green to be gray or dark black, it can be judged that this type of subject belongs to the green blind group. In this way, the universality of the method provided in the embodiment of the present application can be improved, and the executive function state of the subject suffering from red and green color blindness can be evaluated.

[0050] In some other embodiments, presenting Chinese characters whose colors are consistent or inconsistent with their meanings and receiving the subject's judgment result on the color of the Chinese characters within a preset second time period specifically includes: within the preset second time period: using the processor to present Chinese characters whose colors are consistent or inconsistent with their meanings on the display; receiving the subject's indication operation on the indicator regarding the color of the Chinese characters he judged, and using the processor to determine the subject's judgment result on the color of the Chinese characters based on the indication operation; and jumping to a blank screen display of the second time interval at the end of the second time period.

[0051] The indicator may be a button, a touch screen, a voice device, a remote control, etc., and is not specifically limited to this. For example, the subject is provided with buttons for representing four colors, red, yellow, blue, and green, respectively. Figure 2 , the yellow word "Yellow" is displayed on the display interface of the display, the subject observes the color of the Chinese character and presses the yellow button (when the subject's judgment on the color of the Chinese character is correct) to issue an indication operation on the color of the Chinese character "Yellow", the processor determines the subject's judgment result on the color of the Chinese character based on the indication operation, and jumps to a blank screen display at the end of the second time period 1017ms.

[0052] In step S102, the fNIRS blood oxygen data of the brain of the subject during each task block and the first time interval and the EEG data of the preset third time period before and after the second time period in each trial are obtained. During the second time interval, the subject is prone to distraction and is not in a good resting state. Therefore, the EEG data before the second time period can be selected as the baseline to facilitate the analysis and processing of the EEG data.

[0053] In a preferred embodiment, the third time period does not exceed the first time period before the start of the second time period, and does not exceed the second time interval after the second time period. Specifically, when the first time period is 517ms and the second time interval is 217ms, the third time period does not exceed 517ms before the start of the second time period, and does not exceed 217ms after the second time period, so as to ensure the reliability of the collected EEG data.

[0054] Returning to this embodiment, in step S103, the executive function state of the subject is evaluated based on the acquired EEG data and brain fNIRS blood oxygen data of the subject. The evaluation result has high reliability and accuracy, and can be used to distinguish patients with mental illness from healthy people based on the evaluation result. In addition, the evaluation result can also be used to distinguish different types of mental illness.

[0055] For example, when the subjects have schizophrenia (SZ), bipolar disorder (BD), major depressive disorder (MDD) and attention deficit hyperactivity disorder (ADHD), the executive function state of the subjects can be evaluated based on the acquired EEG data and brain fNIRS blood oxygen data of the subjects, and with reference to the correctness of the subjects' judgment results on the color of Chinese characters.

[0056] Specifically, based on the fNIRS blood oxygen data of the subjects' brains, patients with mental illness can be distinguished from healthy people, and the executive function status of the subjects can be evaluated by combining the EEG data and the accuracy of the judgment results of the Chinese character colors. According to the evaluation results, patients with schizophrenia (SZ), bipolar disorder (BD), major depressive disorder (MDD) and attention deficit hyperactivity disorder (ADHD) can be distinguished.

[0057] Among them, referring to the behavioral parameter of the correctness of the subject's judgment on the color of Chinese characters can further improve the accuracy and reliability of the evaluation results of the subject's executive function status.

[0058] In some other embodiments, a first analysis is performed based on the fNIRS blood oxygen data of the subject during each task block and the adjacent first time interval, and the EEG data of the subject in a preset third time period to identify the possibility parameters of whether the subject is a patient with schizophrenia (SZ), bipolar disorder (BD), major depressive disorder (MDD) or attention deficit hyperactivity disorder (ADHD), or belongs to the normal population. In this way, it is possible to determine whether the subject is a normal person or has a tendency to suffer from mental illness. The first analysis can be completed based on a binary classification model, and the binary classification model can be, for example, logistic regression, support vector machine, decision tree, random forest, etc., which is not limited to this. The existing binary classification model that has been disclosed can be used to determine whether the subject has a tendency to suffer from mental illness based on the fNIRS blood oxygen data and EEG data of the brain. Specifically, for example, machine learning algorithms (such as support vector machines, random forests, etc.) can be used to train and test the acquired brain fNIRS blood oxygen data and EEG data to identify the characteristics of different groups, and by comparing the brain activity states between different groups, find out the key parameters that can distinguish patients with mental illness from normal people. For example, through the first analysis, the analysis results may show that the probability that the subject has a tendency to suffer from mental illness is 70%, and the probability that he belongs to the normal population is 30%.

[0059] This is only an example and does not constitute a limitation on the specific solution.

[0060] After the first analysis is performed, the subject can be distinguished from the normal population. For subjects with a tendency to suffer from mental illness, a second analysis can be performed to identify the possibility parameters of various mental illnesses in schizophrenia (SZ), bipolar disorder (BD), major depressive disorder (MDD) and attention deficit hyperactivity disorder (ADHD), so as to distinguish the type of mental illness suffered by the subject. The second analysis can be implemented based on a multi-classification model, and the classification model can be, for example, multinomial logistic regression, a random forest composed of multiple decision trees, a neural network with a multi-output layer structure, etc., which is not limited to this, and the existing multi-classification model that has been disclosed can be used to distinguish the type of mental illness of the subject. Specifically, the second analysis is to specifically identify which mental illness it is, or the degree of overlap between the subject's symptoms and these mental illnesses. For example, algorithms such as multinomial logistic regression and decision trees with multi-classification functions can be used to classify the subject's brain fnirs blood oxygen data and EEG data to identify the possibility of belonging to which type of mental illness. The possibility parameter can be presented in the form of probability to indicate the possibility of which type of mental illness the subject belongs to. For example, a subject may be assessed as having a 50% chance of BD, a 30% chance of MDD, and a 20% chance of being a normal person. Such parameters can help doctors and researchers understand the subject's mental illness status. Of course, if the second analysis finds that the subject has a high probability of multiple mental illnesses, it can prompt the doctor that the subject may have comorbidities.

[0061] Figure 3The flowchart of the method for evaluating the executive function state of the subject based on the fNIRS blood oxygen data and EEG data of the brain according to the embodiment of the present application is shown. In step S301, a preset number of task blocks are sequentially executed at a preset first time interval, and condition-consistent trials and condition-inconsistent trials are pseudo-randomly and alternately executed in each task block at a second time interval, and the second time interval is selected in a pseudo-random manner from a set of candidate time periods of several hundred milliseconds so that each candidate time period in each task block maintains a predetermined ratio, and the execution of the condition-consistent trial includes sequentially presenting a fixation pattern in a preset first time period, and co-presenting an object with a matching first element and a second element in a preset second time period, and receiving the subject's judgment result on the first element of the object, and the execution of the condition-inconsistent trial includes sequentially presenting a fixation pattern in a preset first time period, and co-presenting an object with a first element and a second element that interferes with it in a preset second time period, and receiving the subject's judgment result on the first element of the object. Wherein, the fixation pattern can be a plus sign, a triangle, a circle or other symbols, which is not limited to this. The first and second elements that match, for example, the first element is the Chinese character "Puppy", and the second element is a picture of a puppy, or the first element is the expression of "crying", and the second element is the Chinese character of "crying". The second element that interferes with the first element, for example, the first element is a picture of the expression of "smiling", and the second element is the Chinese character of "crying".

[0062] In step S302, the fNIRS blood oxygen data of the brain of the subject during each task block and the first time interval and the EEG data of the preset third time period before and after the second time period in each trial are obtained. In step S303, the executive function state of the subject is evaluated based on the obtained EEG data and fNIRS blood oxygen data of the subject.

[0063] In this way, a dual-modal task paradigm for evaluating the subject's executive function state can be provided, so as to simultaneously obtain the subject's brain fNIRS blood oxygen data and EEG data when the subject performs the dual-modal task paradigm, and the subject's executive function state can be more accurately evaluated based on the brain fNIRS blood oxygen data and EEG data, and mental illness related to the executive function state can be accurately classified.

[0064] In some other embodiments, a device for evaluating the executive function state of a subject based on brain fNIRS blood oxygen data and EEG data is provided, wherein the subject may include a patient with a mental illness or a subject with a tendency to a mental illness, and the device includes a processor, wherein the processor is configured to execute the method for evaluating the executive function state of the subject based on brain fNIRS blood oxygen data and EEG data according to each embodiment of the present application. Based on the acquired EEG data and brain fNIRS blood oxygen data, it can be used to evaluate the executive function state of the subject, and the evaluation result has high reliability and accuracy. Moreover, based on the evaluation result, patients with mental illness can be distinguished from healthy people, and different mental illnesses can also be classified according to the evaluation result.

[0065] Figure 4 The structural schematic diagram of the system for evaluating the executive function state of the subject based on brain fNIRS blood oxygen data and EEG data according to an embodiment of the present application is shown. The subject can include a patient with a mental illness or a subject with a tendency to a mental illness, and the system 400 includes a brain fNIRS acquisition module 401, an EEG acquisition module 402, an interface 403 and a processor 404, wherein the brain fNIRS acquisition module 401 is used to collect the brain fNIRS blood oxygen data of the subject; the EEG acquisition module 402 is used to collect the EEG data of the subject; the interface 403 is configured to obtain the brain fNIRS blood oxygen data of the subject from the brain fNIRS acquisition module, and the EEG data of the subject from the EEG acquisition module; and the processor 404 is configured to execute the method for evaluating the executive function state of the subject based on brain fNIRS blood oxygen data and EEG data according to each embodiment of the present application.

[0066] The processor may be a processing device including one or more general-purpose processing devices, such as a microprocessor, a central processing unit (CPU), etc. More specifically, the processor may be a complex instruction set computing (CISC) microprocessor, a reduced instruction set computing (RISC) microprocessor, a very long instruction word (VLIW) microprocessor, a processor running other instruction sets, or a processor running a combination of instruction sets. The processor may also be one or more special-purpose processing devices, such as an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), a digital signal processor (DSP), a system on a chip (SoC), etc.

[0067] This application describes various operations or functions that may be implemented as software codes or instructions or defined as software codes or instructions. Such content may be source code or differential code ("incremental" or "patch" code) that can be directly executed ("object" or "executable" form). Software codes or instructions may be stored in a computer-readable storage medium, and when executed, may cause a machine to perform the described functions or operations, and include any mechanism for storing information in a form accessible to a machine (e.g., a computing device, an electronic system, etc.), such as recordable or non-recordable media (e.g., read-only memory (ROM), random access memory (RAM), magnetic disk storage media, optical storage media, flash memory devices, etc.).

[0068] The exemplary methods described in this application can be implemented at least in part by a machine or computer. In some embodiments, a computer-readable storage medium stores computer program instructions, which, when executed by a processor, cause the processor to execute the method for evaluating the executive function state of a subject based on brain fNIRS blood oxygen data and EEG data as described in various embodiments of this application.

[0069] The implementation of such a method may include software code, such as microcode, assembly language code, high-level language code, etc. Various software programming techniques may be used to create various programs or program modules. For example, a program portion or program module may be designed with or by means of Java, Python, C, C++, assembly language, or any known programming language. One or more of such software portions or modules may be integrated into a computer system and / or a computer-readable medium. Such software code may include computer-readable instructions for executing various methods. The software code may form a part of a computer program product or a computer program module. In addition, in an example, the software code may be tangibly stored on one or more volatile, non-temporary or non-volatile tangible computer-readable media, such as during execution or at other times. Examples of these tangible computer-readable media may include, but are not limited to, hard disks, removable disks, removable optical disks (such as optical disks and digital video disks), cassettes, memory cards or memory sticks, random access memories (RAMs), read-only memories (ROMs), etc.

[0070] In addition, although exemplary embodiments have been described herein, the scope includes any and all embodiments based on the present application with equivalent elements, modifications, omissions, combinations (e.g., various embodiments intersecting schemes), adaptations or changes. The elements in the claims will be interpreted broadly based on the language adopted in the claims, and are not limited to the examples described in this specification or during the execution of the application, and the examples will be interpreted as non-exclusive. Therefore, this specification and examples are intended to be considered as examples only, and the true scope and spirit are indicated by the claims and the full scope of their equivalents.

[0071] The above description is intended to be illustrative rather than restrictive. For example, the above examples (or one or more schemes thereof) may be used in combination with each other. For example, a person of ordinary skill in the art may use other embodiments when reading the above description. In addition, in the above-mentioned specific embodiments, various features may be grouped together to simplify the present application. This should not be interpreted as an intention that a disclosed feature that is not required to be protected is necessary for any claim. On the contrary, the subject matter of the present application may be less than all the features of a particular disclosed embodiment. Thus, the claims are incorporated herein as examples or embodiments in the specific embodiments, wherein each claim is independently a separate embodiment, and it is considered that these embodiments may be combined with each other in various combinations or arrangements. The scope of the present application should be determined with reference to the attached claims and the full scope of equivalent forms granted by these claims.

[0072] The above embodiments are only exemplary embodiments of the present application and are not intended to limit the present application. The protection scope of the present application is defined by the claims. Those skilled in the art may make various modifications or equivalent substitutions to the present application within the essence and protection scope of the present application, and such modifications or equivalent substitutions shall also be deemed to fall within the protection scope of the present application.

Claims

1. A method for evaluating the executive function state of a subject based on brain fNIRS blood oxygen data and EEG data, characterized in that: The subject may include a patient with a mental illness or a subject with a tendency to a mental illness. The method includes using a processor to execute the following steps: At a preset first time interval, a preset number of task blocks are sequentially executed, and in each task block, consistent condition trials and inconsistent condition trials are pseudo-randomly and alternately executed at a second time interval, the second time interval is pseudo-randomly selected from a group of candidate time periods of several hundred milliseconds so that each candidate time period in each task block maintains a predetermined ratio, executing the consistent condition trial includes sequentially presenting a fixation point within the preset first time period, presenting a Chinese character whose color is consistent with its meaning within the preset second time period, and receiving a subject's judgment result on the color of the Chinese character, and executing the inconsistent condition trial includes sequentially presenting a fixation point within the preset first time period, presenting a Chinese character whose color is inconsistent with its meaning within the preset second time period, and receiving a subject's judgment result on the color of the Chinese character; Acquire the fNIRS blood oxygen data of the subject's brain during each task block and the adjacent first time interval and the EEG data in a preset third time period from before to after the start of the second time period in each trial; as well as The executive function status of the subject is assessed based on the acquired EEG data and brain fNIRS blood oxygen data of the subject.

2. The method according to claim 1, characterized in that Also included is using the processor to: For a complete evaluation, 2 to 8 task blocks are sequentially executed with a first time interval of 10 s to 60 s, and the duration of each task block is 10 s to 180 s.

3. The method according to claim 1 or 2, characterized in that: The proportion of condition-inconsistent trials in each task block ranged from 30% to 90%.

4. The method according to claim 1 or 2, characterized in that: The method further includes selecting three or four colors from red, yellow, blue and green, presenting Chinese characters whose colors are consistent or inconsistent with their meanings within a preset second time period, and receiving the test subject's judgment result on the color of the Chinese characters. Specifically, within the preset second time period: Using the processor, presenting Chinese characters whose colors are consistent with or inconsistent with their meanings on a display; receiving an indication operation of the examinee on the indicator regarding the color of the Chinese character to be judged, and using the processor to determine the examinee's judgment result on the color of the Chinese character based on the indication operation; At the end of the second time period, the display switches to the blank screen of the second time interval.

5. The method according to claim 1 or 2, characterized in that: The set of candidate time periods of several hundred milliseconds is selected from the range of 87 ms to 917 ms.

6. The method according to claim 5, characterized in that The deviation of the duration of each candidate time period from each other was determined based on the results of pre-tests for depression, schizophrenia, bipolar disorder, and ADHD.

7. The method according to claim 5, characterized in that The duration deviation between each candidate time period is 100-400ms.

8. The method according to claim 1 or 2, characterized in that: The first time period is 80-617 ms, and the second time period is 400 to 1817 ms.

9. The method according to claim 1 or 2, characterized in that: The third time period does not exceed the first time period before the start of the second time period, and does not exceed the second time interval after the second time period.

10. The method according to claim 1 or 2, characterized in that: The subjects include patients with schizophrenia, bipolar disorder, major depressive disorder and ADHD. The executive function state of the subjects is evaluated based on the acquired EEG data and brain fNIRS blood oxygen data of the subjects, specifically including: based on the acquired EEG data and brain fNIRS blood oxygen data of the subjects, referring to the correctness of the subjects' judgment results on the color of Chinese characters, to evaluate the executive function state of the subjects.

11. The method according to claim 5, characterized in that Based on the acquired EEG data and brain fNIRS blood oxygen data of the subject, the subject's executive function status is evaluated, including: Based on the fNIRS blood oxygen data of the subject's brain during each task block and the adjacent first time interval, and the EEG data of the subject within a preset third time period, a first analysis is performed to identify the possibility parameters of whether the subject is a patient with schizophrenia, bipolar disorder, major depressive disorder or ADHD, or belongs to the normal population; a second analysis is performed to identify the possibility parameters of the subject belonging to various mental illnesses among schizophrenia, bipolar disorder, major depressive disorder and ADHD.

12. The method according to claim 1, characterized in that The method further comprises, using the processor: In the case where the subject belongs to a group with normal color vision, three or four colors are randomly selected from red, yellow, blue, and green to be used as the colors of the presented Chinese characters; When the subject belongs to the red-green color blindness group, three or four colors are randomly selected from red, yellow, blue and gray for the colors of the presented Chinese characters, or three or four colors are randomly selected from red, yellow, blue and black for the colors of the presented Chinese characters.

13. The method according to claim 12, characterized in that The method further comprises, using the processor: Pre-render red, yellow, blue, and green tiles; Obtain the examinee's discrimination results of red, yellow, blue and green; According to the test subject's distinction results for red, yellow, blue and green, it is determined whether the test subject belongs to the normal color vision group or the red and green color blind group.

14. A method for evaluating the executive function state of a subject based on fNIRS blood oxygen data and EEG data of the brain, characterized in that: The subject may include a patient with a mental illness or a subject with a tendency to a mental illness. The method includes using a processor to execute the following steps: At a preset first time interval, a preset number of task blocks are sequentially executed, and in each task block, consistent trials and inconsistent trials are pseudo-randomly and alternately executed at a second time interval, the second time interval is pseudo-randomly selected from a group of candidate time periods of several hundred milliseconds so that each candidate time period in each task block maintains a predetermined ratio, executing the consistent trial includes sequentially presenting a fixation pattern in the preset first time period, co-presenting an object with a matching first element and a second element in the preset second time period, and receiving a judgment result of the subject on the first element of the object, and executing the inconsistent trial includes sequentially presenting a fixation pattern in the preset first time period, co-presenting an object with a first element and a second element that interferes with it in the preset second time period, and receiving a judgment result of the subject on the first element of the object; Acquire the fNIRS blood oxygen data of the subject's brain during each task block and the adjacent first time interval and the EEG data in a preset third time period from before to after the start of the second time period in each trial; as well as The executive function status of the subject is assessed based on the acquired EEG data and brain fNIRS blood oxygen data of the subject.

15. A device for evaluating the executive function state of a subject based on fNIRS blood oxygen data and EEG data of the brain, characterized in that: The subject may include a patient with a mental illness or a subject with a tendency to a mental illness, and the device includes a processor configured to execute the method for evaluating the executive function state of the subject based on brain fNIRS blood oxygen data and EEG data according to any one of claims 1-14.

16. A system for evaluating the executive function state of a subject based on fNIRS blood oxygen data and EEG data, characterized in that: The subject may include a patient with a mental illness or a subject with a tendency to a mental illness, and the system includes: The brain fNIRS acquisition module is used to collect the brain fNIRS blood oxygen data of the subject; An EEG acquisition module is used to collect EEG data of the subject; An interface configured to acquire brain fNIRS blood oxygen data of the subject from the brain fNIRS acquisition module and EEG data of the subject from the EEG acquisition module; and A processor configured to execute the method for evaluating the executive function state of a subject based on brain fNIRS blood oxygen data and EEG data according to any one of claims 1-14.

Images