Method for assessing mental state of subject based on physiological data, storage medium, and device

Abstract

A method for assessing the mental state of a subject based on physiological data, a storage medium, and a device. The method comprises: presenting to a subject at least one task in a first composite task, wherein the first composite task comprises at least two types of tasks (S101); and acquiring at least two pieces of physiological data of the subject during first composite task execution, so as to perform auxiliary assessment on the tendency of mental illnesses of the subject on the basis of analysis results of the at least two pieces of physiological data (S102). Therefore, auxiliary assessment can be efficiently and accurately performed on the tendency of mental illnesses of the subject, especially mental illnesses with similar symptoms.

Description

Method, storage medium and device for evaluating the mental condition of a subject based on physiological data Technical Field

[0001] The present application relates to the technical field of mental condition assessment, and in particular to a method, storage medium, and device for assessing a subject's mental condition based on physiological data. Background Art

[0002] The symptoms of mental illness often lack specificity. Different mental illnesses may exhibit similar symptoms, while the same mental illness may present different symptoms in different patients. This makes it difficult for doctors to make accurate judgments based on symptoms alone.

[0003] Currently, existing psychological paradigms such as the VFT paradigm, N-back paradigm, RVP paradigm, and emotional Stroop paradigm can be used to assess patients' mental status. However, these paradigms primarily distinguish between a single mental illness and healthy individuals. Distinguishing between different types of mental illness often requires extensive physician experience and a combination of other clinical symptoms and scale test results. Therefore, existing methods are unable to provide objective and accurate diagnostic indicators, particularly for differentiating between different types of mental illness. Summary of the Invention

[0004] This application is proposed in response to the above-mentioned technical problems existing in the prior art. This application aims to provide a method, storage medium and device for evaluating the mental condition of a subject based on physiological data, which can present a first composite task containing multiple types of tasks to the subject at one time, so as to collect at least two types of physiological data corresponding to each type of task when the subject performs the first composite task. The at least two types of physiological data corresponding to each type of task can work together, which is conducive to efficiently and accurately identifying and distinguishing the predisposition to mental illness, thereby providing an objective and reliable indicator basis for the evaluation of the subject's mental condition.

[0005] According to a first embodiment of the present application, a method for evaluating the mental condition of a subject based on physiological data is provided, the method comprising presenting at least one task of a first composite task to the subject, wherein the first composite task comprises at least two types of tasks; obtaining at least two types of physiological data of the subject while performing the first composite task, so as to assist in evaluating the subject's tendency to suffer from a mental illness based on analysis results of the at least two types of physiological data.

[0006] According to a second aspect of the present application, a computer-readable storage medium is provided, which stores a computer program. When the computer program is executed by a processor, it performs the method of evaluating the mental condition of a subject based on physiological data as described in various embodiments of the present application.

[0007] According to the third scheme of the present application, a device for evaluating the mental condition of a subject based on physiological data is provided, the device comprising an interface and a processor, the interface being configured to: obtain at least two types of physiological data of the subject when performing a first complex task, wherein the first complex task comprises at least two types of tasks; the processor being configured to: analyze the at least two types of physiological data, and perform an auxiliary evaluation of the subject's tendency to suffer from mental illness based on the analysis results.

[0008] According to the fourth scheme of the present application, a method for evaluating the mental condition of a subject based on physiological data is provided, the method comprising using a processor to perform the following steps: obtaining at least two types of physiological data of the subject when performing a first complex task, wherein the first complex task includes at least two types of tasks; analyzing the at least two types of physiological data, and performing an auxiliary evaluation of the subject's tendency to suffer from mental illness based on the analysis results.

[0009] Compared with the prior art, the embodiments of the present application have the following advantages:

[0010] The method for evaluating the mental condition of a subject based on physiological data provided in an embodiment of the present application presents at least one task in a first composite task to the subject, and the first composite task includes at least two types of tasks. During the subject's execution of the first composite task, at least two types of physiological data corresponding to each type of task are obtained, wherein the at least two types of physiological data corresponding to each type of task work in coordination with each other. The two types of physiological data under the composite task can provide objective biological indicators for auxiliary evaluation of the tendency to develop mental illness, so as to efficiently and accurately assist in evaluating the subject's tendency to develop mental illness, especially certain mental illnesses with similar symptoms.

[0011] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above description and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] In the drawings, which are not necessarily drawn to scale, the same reference numerals may describe similar components in different views. Similar reference numerals with letter suffixes or different letter suffixes may represent different examples of similar components. The accompanying drawings generally illustrate various embodiments by way of example and not by way of limitation, and together with the description and claims, serve to illustrate the disclosed embodiments. Such embodiments are illustrative and exemplary and are not intended to be exhaustive or exclusive embodiments of the present method, apparatus, or non-transitory computer-readable medium having instructions for implementing the method.

[0013] FIG1 shows a flowchart of a method for evaluating a subject's mental condition based on physiological data according to an embodiment of the present application.

[0014] FIG2 shows a schematic diagram of display of a display when performing an N-back task according to an embodiment of the present application.

[0015] FIG3 shows a schematic diagram of a display when performing an emotional Stroop task according to an embodiment of the present application.

[0016] FIG4 is a schematic diagram showing a display of a display when an RVP task is executed according to an embodiment of the present application.

[0017] FIG5 shows a schematic diagram of a display when performing a Stroop task according to an embodiment of the present application.

[0018] FIG6 shows a schematic diagram of a display when performing forward and reverse saccade tasks according to an embodiment of the present application.

[0019] FIG. 7 shows a schematic diagram of a display when a smooth tracking task is performed according to an embodiment of the present application.

[0020] FIG8 shows a schematic diagram of an apparatus for evaluating a subject's mental condition based on physiological data according to an embodiment of the present application.

[0021] FIG9 shows a flowchart of a method for evaluating a subject's mental condition based on physiological data according to an embodiment of the present application. DETAILED DESCRIPTION

[0022] In order to enable those skilled in the art to better understand the technical solution of the present application, the present application is described in detail below in conjunction with the accompanying drawings and specific embodiments. The embodiments of the present application are further described in detail below in conjunction with the accompanying drawings and specific embodiments, but are not intended to limit the present application.

[0023] The words "first", "second" and similar terms used in this application do not indicate any order, quantity or importance, but are only used to distinguish. The words "include" or "comprises" and similar terms used in this application mean that the elements before the word include the elements listed after the word, and do not exclude the possibility of covering other elements. In this application, the arrows shown in the figures of each step are only examples of the execution order, not limitations. The technical solution of this application is not limited to the execution order described in the embodiments. The steps in the execution order can be combined, decomposed, or swapped, as long as the logical relationship of the execution content is not affected.

[0024] All terms (including technical or scientific terms) used in this application have the same meaning as those understood by ordinary technicians in the field to which this application belongs, unless otherwise specifically defined. It should also be understood that terms defined in general dictionaries should be interpreted as having a meaning consistent with their meaning in the context of the relevant technology, and should not be interpreted in an idealized or extremely formal sense unless explicitly defined as such here. Techniques and equipment known to ordinary technicians in the relevant field may not be discussed in detail, but where appropriate, the techniques and equipment should be considered as part of the specification.

[0025] FIG1 is a flowchart of a method for assessing a subject's mental condition based on physiological data according to an embodiment of the present application. Specifically, the method shown in steps S101 to S102 is executed. In this embodiment, the arrows shown in the figure are merely examples of the execution order, not limitations. The technical solution of the present application is not limited to the execution order described in the embodiment. The steps in the execution order can be combined, decomposed, or reordered, as long as the logical relationship of the execution content is not affected.

[0026] In step S101, at least one task in a first complex task is presented to a subject, wherein the first complex task includes at least two types of tasks. In step S102, at least two types of physiological data of the subject while performing the first complex task are obtained, and based on the analysis results of the at least two types of physiological data, an auxiliary assessment of the subject's predisposition to mental illness is performed.

[0027] The "class" in the two types of tasks can be understood as the type of task paradigm, wherein the task paradigm can be a resting-state task, a VFT task, an N-back task, etc. This is only used as an example and is not limiting.

[0028] Step S101 can be performed by a display, which can be understood as a device with a display function, such as a laptop, tablet computer, smartphone, or other device with both data processing and display functions, or an external display screen. In some embodiments, step S102 can be performed by a processor, which can be a dedicated processor or a general-purpose processor.

[0029] Specifically, the first composite task is a multimodal (e.g., bimodal and / or trimodal) task. The various tasks within the first composite task are sequentially executed using a display according to a preset task execution order and at preset time intervals. The preset time intervals may be 4 minutes, 5 minutes, 6 minutes, etc., and are not limited thereto. In this manner, the subject can be provided with a first composite task comprising multiple tasks at once.

[0030] The at least two types of physiological data may include near-infrared detection data, electroencephalogram data, eye movement information, magnetic resonance imaging data, and other data that can characterize the brain function status of the subject.

[0031] In some other embodiments of the present application, at least one type of task in the first complex task is selected from a resting-state task, a VFT task, an N-back task, an emotional Stroop task, an RVP task, a Stroop task, a forward and backward saccade task, and a smooth pursuit task.

[0032] Exemplarily, it is assumed that the first composite task includes a resting-state task, an emotional Stroop task, and a VFT task that are performed in sequence. During the process of the subject formally performing the first composite task, a "+" can be presented on the display to prompt the subject to perform the resting-state task. 60 seconds after the resting-state task is completed, a task prompt about the emotional Stroop task can be presented on the display, such as presenting a colored emotional picture, and the subject performs the emotional Stroop task according to the task prompt. 60 seconds after the emotional Stroop task is completed, a task prompt about the VFT task can be presented on the display, such as presenting "Please repeat the numbers 1, 2, 3, 4, 5", so that the subject performs the VFT task according to the task prompt. At the same time, the near-infrared acquisition module and the EEG acquisition module can be used to collect near-infrared detection data and EEG data of the subject when performing the resting-state task, the emotional Stroop task, and the VFT task.

[0033] This is merely an illustrative description and does not constitute a limitation on the specific solution.

[0034] Based on the method provided in the embodiments of this application, the subject can easily perform the first composite task in a single session. The collected at least two types of physiological data corresponding to each type of task can truly and objectively reflect the subject's different brain function conditions. Therefore, the two types of physiological data from the composite task can provide objective biological indicators for assisting in the assessment of mental illness predisposition, efficiently and accurately assisting in the assessment of the subject's mental illness predisposition, especially for certain mental illnesses with similar symptoms.

[0035] In some other embodiments of the present application, at least one type of task in the first composite task is a bimodal task. A bimodal task means that while the subject is performing the task, two different brain detection technologies are used to simultaneously collect data of two different dimensions. These two different dimensions of data may be, for example, near-infrared detection data and EEG data.

[0036] In this embodiment, the dual-modal task is one or more of a resting-state task, an N-back task, an emotional Stroop task, an RVP task, and a Stroop task.

[0037] That is to say, the resting-state task, N-back task, emotional Stroop task, RVP task, and Stroop task mentioned in each embodiment of the present application are all bimodal tasks, not unimodal tasks. The specific task paradigms for each bimodal task and trimodal task are set in detail in the Chinese application (application numbers 202411487030.X, 202411487031.4, 202411487032.9, 202510018739.3, 202510018740.6, and 202410070065.7) that serves as the priority, and the relevant contents are incorporated herein as examples. The settings of each bimodal task and trimodal task are not described in detail below.

[0038] In other embodiments, the resting-state task may include a rest and relaxation task, i.e., a task performed while the subject is in a static state (i.e., not performing calculations, recognition, movement, etc.). The resting-state task refers to an independent task paradigm. For example, a cross symbol may be presented on a display, or the subject may not be presented with the task content, so that the subject performs the resting-state task while simultaneously collecting near-infrared detection data and EEG data.

[0039] Because the blood oxygen signal collected by fNIRS is a slow signal, and the EEG signal collected by EEG is a fast signal, the task paradigm suitable for collecting fNIRS signals is generally not suitable for collecting EEG signals, and vice versa. Currently, there is no fNIRS and EEG dual-modal task paradigm suitable for assessing the brain function of subjects. Therefore, it is difficult to combine fNIRS and EEG dual-modal signal indicators to assess the brain function status of patients with mental illness or subjects with mental illness tendencies.

[0040] In order to achieve auxiliary diagnosis of mental illness, the inventors have made corresponding improvements to the existing task paradigm. The improved task paradigm can be applied to dual-modal data acquisition or tri-modal data acquisition, and realizes the collaborative acquisition of multiple brain function-related data of the subject in one task paradigm, so that a more accurate auxiliary assessment of the subject's tendency to suffer from mental illness can be made based on the collaboratively collected multi-modal data.

[0041] Below, the improved dual-modal task paradigm and tri-modal task paradigm are introduced one by one.

[0042] 1. Improved N-back task.

[0043] Preferably, the improved emotional Stroop task can be used to collaboratively collect near-infrared detection data and EEG data.

[0044] As shown in FIG2 , the N-back task includes sequentially executing a first preset number of task blocks 201 at a preset first time interval 206, sequentially executing a second preset number of trials in each task block 201, each trial sequentially including pseudo-randomly presenting a single number in a first time period 204 and presenting a fixation point in a variable second time period 205; receiving a judgment result from the subject in the second time period 205 as to whether the number of the current trial is the same as the number of the previous n-th trial, where n is 1 or 2, and each second time period 205 in each task block 201 is pseudo-randomly selected from a group of first candidate time periods of more than 900 ms, so that each first candidate time period maintains a predetermined ratio, and the sequence of single numbers appearing in the first preset number of task blocks 201 is a preset pseudo-random sequence.

[0045] In some embodiments, while the subject is performing the N-back task, near-infrared detection data of the subject during each task block 201 and the adjacent first time interval 206, and EEG data within a preset third time period 207 before and after the presentation of each number in each trial are collected.

[0046] Thus, by sequentially executing a first preset number of task blocks 201 at a preset first time interval 206 for the subject, a second preset number of trials are sequentially executed within each task block 201, each trial sequentially including pseudo-randomly presenting a single digit within a first time period 204 and presenting a fixation point within a variable second time period 205. Thus, for near-infrared detection data, the sequence of single digits appearing in the first preset number of task blocks 201 is a preset pseudo-random sequence, sufficient to collect valid and differentiated near-infrared detection data. For EEG data, a single digit is pseudo-randomly presented within the first time period 204, and the second time period 205 is pseudo-randomly selected from a set of first candidate time periods of 900ms or longer. This can reduce the subject's expectation effect on each digit and facilitate the collection of high-quality EEG data. Therefore, while executing the aforementioned task blocks 201, the subject can simultaneously collect high-quality near-infrared detection data and EEG data in dual modality. The collected data in each modality can be used to assess brain function status, particularly for assessing the subject's working memory status.

[0047] In addition, since only one task paradigm needs to be executed to simultaneously complete the accurate collection of two types of data, and the sequence of single numbers used for judgment in the task paradigm is a preset pseudo-random sequence, the difficulty of the task paradigm is controllable. Compared with executing two single-modal data acquisition paradigms separately, executing the task paradigm only once can not only improve the data collection efficiency, but also make it easier to regulate the difficulty of the task paradigm, which is convenient for unifying the difficulty of the same subject in different task paradigms, thereby ensuring the accuracy and consistency of the subject's brain function assessment, especially for the evaluation of the treatment effect of patients with related diseases. Through a task paradigm with consistent difficulty, the treatment effect on patients with related diseases can be accurately evaluated, reducing the interference caused by the different difficulty of the task paradigm, and improving the accuracy of the evaluation results.

[0048] As shown in Figure 2, the various task prompts were presented sequentially on the monitor screen. In the first trial 202 of task block 201, the single digit 2 was presented during a first time period 204, and a cross symbol was presented during a second time period 205. In the second trial 203, the single digit 8 was presented during a first time period 204, and a cross symbol was presented as the fixation point during a second time period 205.

[0049] In this embodiment, each preset pseudo-random sequence includes a focus sequence and an interference sequence, wherein the last digit of the focus sequence (i.e., the target digit) is the same as the previous n-th digit, the first digit and the last digit of the interference sequence are the same as the target digit, and the number of digits included in the interference sequence is different from the number of digits included in the focus sequence.

[0050] For example, when n is 1, the sequence of interest is BB (indicating two consecutive identical digits), and the interference sequences in this case include BAB (A and B are different digits). When n is 2, the sequence of interest is BAB (indicating that the last digit is the same as the second digit before it, A and B represent different digits), and the interference sequences in this case include BB and BACB (B represents a digit different from A and C). Interference sequences have a similar structure to the sequence of interest and can easily lead to incorrect judgments by the subject.

[0051] In this embodiment, the difficulty of each preset pseudo-random sequence can be determined based on at least one of the proportion of the focus sequence in the pseudo-random sequence, the proportion of the interference sequence, and the distribution of the focus sequence in the pseudo-random sequence.

[0052] The proportion of the attention sequence can be expressed as the ratio of the attention sequence to the complete sequence of the same task block. Similarly, the proportion of the interference sequence can be expressed as the ratio of the interference sequence to the total complete sequence of the same task block. The distribution of the attention sequence in the pseudo-random sequence can be determined based on the intervals between the respective attention sequences in the complete sequence.

[0053] In this embodiment, each preset pseudo-random sequence also includes a continuous attention sequence, wherein the continuous attention sequence includes at least two adjacent attention sequences. When n is 2, the recognition difficulty increases when the continuous attention sequence appears, while when n is 1, the subject is more likely to generate expectations based on the continuous attention sequence, which reduces the recognition difficulty. In other words, the effect of the continuous attention sequence on the difficulty judgment of the pseudo-random sequence when n is 1 is opposite to the effect of the continuous attention sequence on the difficulty judgment of the pseudo-random sequence when n is 2.

[0054] 2. Improved emotional Stroop task.

[0055] Preferably, the improved emotional Stroop task can be used to collaboratively collect near-infrared detection data and EEG data.

[0056] As shown in Figure 3, the emotional Stroop task includes alternatingly executing a happy emotion block 301 and a fear emotion block 302, pseudo-randomly alternatingly executing happy emotion trials and neutral emotion trials in the happy emotion block 301, and pseudo-randomly alternatingly executing fear emotion trials and neutral emotion trials in the fear emotion block; each emotional trial includes sequentially presenting a fixation point within a variable first time period 303, presenting facial images of various colors with corresponding emotions within a preset second time period 304, and allowing the subject to judge and receiving the subject's judgment operation results on the color of the facial image within a preset third time period 305, wherein each first time period 303 in each emotional block is pseudo-randomly selected from a group of second candidate time periods of several hundred milliseconds so that each second candidate time period maintains a predetermined proportion.

[0057] In some embodiments, EEG data of the subject in a preset fourth time period 306 from before to after the start of the second time period 304 in each emotion trial and near-infrared detection data during each emotion block may be collected.

[0058] Among them, the acquired EEG data and near-infrared detection data of the subject can be used to evaluate the subject's response inhibition function with emotion regulation.

[0059] In this way, the subject only needs to perform the above-mentioned dual-modal task to obtain the subject's EEG data and near-infrared detection data at the same time. The acquired EEG data and near-infrared detection data can not only truly reflect the differences in the subject's brain functional activities, but also have high reliability. Moreover, it can also be applied to patients with mental illnesses who have poor reaction inhibition function with emotional regulation, to ensure that patients with mental illnesses who have unstable emotional states and poor tolerance can better complete the dual-modal emotion regulation task, thereby achieving an accurate assessment of the reaction inhibition function with emotion regulation of patients with mental illnesses (or subjects with a tendency to the disease). The assessment results can be used as a reliable biological indicator for doctors to diagnose mental illnesses.

[0060] In this embodiment, the ratio of happy emotion trials in the happy emotion block 301 is 50%±15%, and the ratio of fear emotion trials in the fear emotion block 302 is 50%±15%. Preferably, the ratio of happy emotion trials in the happy emotion block 301 is 50%, and the ratio of fear emotion trials in the fear emotion block 302 is 50%. Adjusting the ratio of happy emotion trials in the happy emotion block 301 and the ratio of fear emotion trials in the fear emotion block 302 within the range of 50%±15% can prevent a small number of happy emotion trials or fear emotion trials from causing a false P300 in the collected EEG data, and can also prevent an excessive number of happy emotion trials or fear emotion trials from reducing the effect of emotional stimulation on the subject, thereby failing to effectively obtain EEG data and near-infrared detection data that truly reflect differences in brain function.

[0061] The preset fourth time period 306 is selected from the range from 1 ms before the start of the second time period 304 to the length of the shortest second candidate time period, and before the end of the third time period 305. The second time period 304 and the third time period 305 do not exceed 1500 ms in total, wherein at least part of the EEG data from 1 ms before the start of the second time period 304 to the length of the shortest second candidate time period is used as the baseline EEG data.

[0062] The fourth time period 306 is from 1100 milliseconds to 3500 milliseconds. The EEG data within this time range can truly and accurately reflect the brain's rapid processing of stimuli and provide real and effective EEG data.

[0063] 3. Improved RVP task.

[0064] Preferably, the improved RVP task can be used to collaboratively collect near-infrared detection data and EEG data.

[0065] The RVP task includes sequentially presenting a third predetermined number of numbers on the screen, with each number presented individually on the screen for a first predetermined time, wherein a target sequence of preset numbers appearing successively is separated by a number of numbers randomly selected from a range of 4 to 30, and the first predetermined time is selected within a range of 600±100 ms; receiving a confirmation operation performed by the subject upon recognition of the target sequence; and collecting near-infrared detection data and electroencephalogram (EEG) data of the subject during a second predetermined time period before and after presentation of each target sequence.

[0066] In this way, a sequence of a third predetermined number of numbers is presented on the screen in sequence, with each number presented individually for a first predetermined time. The target sequences, which appear in succession, are separated by a number of numbers randomly selected from a range of 4-30, with each number presented for 600±100ms. In this way, the time interval between target sequences allows the near-infrared signal induced by the previous target sequence to recover to a certain extent to the baseline level when the current target sequence is presented. Furthermore, because the time interval between target sequences varies randomly, the fNIRS signal also has good statistical power in subsequent analysis stages. On the other hand, EEG data can be used to analyze the EEG response induced by each target sequence, and the time interval between target sequences also meets the requirements for extracting EEG indicators. While the subject is performing the dual-modal task paradigm, both the subject's near-infrared detection data and EEG data can be obtained, thereby enabling the extraction of dual-modal brain function data.

[0067] Furthermore, the extracted data can reflect the activity of brain regions related to sustained attention ability. Combined with the subject's EEG data reflecting immediate neural activity, this can improve the accuracy and reliability of the assessment of the subject's sustained attention state. Therefore, this dual-modal task paradigm can serve as a highly specific indicator for patients with ADHD or those with a tendency to attention deficit, providing a reliable reference for doctors to diagnose mental illness in subjects.

[0068] Exemplarily, as shown in FIG4 , the background color of each presentation interface is a black background, and a small box with light-colored lines is presented in the center. The area indicated by the small box with light-colored lines is the first area 402, and the colors of the numbers presented in the center of the small box with light-colored lines are all white. A single white number "7" is presented in the center of the first area 402 of the first presentation interface 401. After the single number "7" is presented for 600ms, the next number set in sequence is presented, and the line of the single white number "7" is wider than the small box with light-colored lines. A target sequence is displayed in the second area 403 of the first presentation interface 401. There are three target sequences, namely "3, 5, 7", "2, 4, 6" and "4, 6, 8".

[0069] Second area 403 is located in the upper right corner of first presentation interface 401, and the location of second area 403 is the dominant perspective of first presentation interface 401. The three target sequences are presented in the upper right corner of first presentation interface 401 to reduce the working memory burden of the subject's brain and only utilize resources related to sustained attention. In other words, the target sequence is presented at a smaller size than the number in the dominant perspective of the presentation interface of each number.

[0070] For a single assessment, the third predetermined number is 300-1200 numbers, the target sequence ratio is 10-40%, there are 1-4 target sequences, and the numbers in each target sequence are regular, making the sustained attention requirement lower than that of random numbers. By collaboratively setting the third predetermined number, the target sequence ratio, and the number of target sequences, the subject's task time is maintained at 5-10 minutes, which can collaboratively ensure that the subject's sustained attention load remains within an acceptable range, thereby ensuring that the acquired biological data has high reliability.

[0071] 4. Modified Stroop Task

[0072] Preferably, the improved Stroop task can be used to collaboratively collect near-infrared detection data and EEG data.

[0073] As shown in Figure 5, the Stroop task includes sequentially executing a third preset number of task blocks 501 at a preset first time interval 502, and pseudo-randomly alternatingly executing condition-consistent trials and condition-inconsistent trials at a second time interval 505 in each task block 501. The second time interval 505 is pseudo-randomly selected from a set of third candidate time periods of several hundred milliseconds so that each third candidate time period in each task block 501 maintains a predetermined ratio. Executing the condition-consistent trial includes sequentially presenting a fixation point within a preset first time period 503, presenting a Chinese character whose color is consistent with its meaning within a preset second time period 504, and receiving the subject's judgment result on the Chinese character color. Executing the condition-inconsistent trial includes sequentially presenting a fixation point within a preset first time period 503, presenting a Chinese character whose color is inconsistent with its meaning within a preset second time period 504, and receiving the subject's judgment result on the Chinese character color. Near-infrared detection data of the subject during each task block 501 and the adjacent first time interval 502 and electroencephalogram data within a preset third time period 506 from before to after the start of the second time period 504 in each trial are collected.

[0074] In this embodiment, a preset number of task blocks 501 are executed sequentially at a preset first time interval 502. The time consumed for executing each task block 501 is estimated to be no less than 10 seconds. The blood oxygen level can reach a peak in response to the generation of the stimulus, which can meet the collection requirements of near-infrared detection data. In addition, in each task block 501, condition-consistent trials and condition-inconsistent trials are pseudo-randomly alternatingly executed at a second time interval 505. The time consumed for executing each trial is estimated to be around 2 seconds. The EEG signal within 1 or 2 seconds caused by the stimulus in each trial can be obtained, thereby meeting the collection requirements of EEG data. Therefore, a dual-modal task paradigm for simultaneously collecting near-infrared detection data and EEG data can be provided to the subject, so that the subject's near-infrared detection data and EEG data can be simultaneously obtained while the subject is executing the dual-modal task paradigm. Based on the acquired EEG data and near-infrared detection data, it can be used to evaluate the subject's executive function status, and the evaluation result has high reliability and accuracy. Moreover, based on the evaluation results, patients with mental illness can be distinguished from healthy people, and different mental illnesses can be classified according to the evaluation results.

[0075] In some embodiments, the first time period 503 is 80-617 ms, and the second time period 504 is 400-1817 ms.

[0076] In some embodiments, in each task block 501 , condition-consistent trials and condition-inconsistent trials are pseudo-randomly and alternately executed at the second time interval 505 , which is beneficial for avoiding interference from external regular noise.

[0077] In some embodiments, for a complete assessment, 2 to 8 task blocks 501 are executed sequentially with a first time interval 502 of 10s to 60s, and the duration of each task block 501 is 10s to 180s. In this way, it does not take the subject too long to complete a complete task, and the subject can complete the entire assessment task with better attention and emotional state.

[0078] In some embodiments, the group of third candidate time periods of several hundred milliseconds is selected from the range of 87ms to 917ms, and the second time interval 505 is selected from the range of 87ms to 917ms in a pseudo-random manner. This is beneficial for preventing external fixed frequencies from interfering with EEG data, avoiding the aliasing of EEG data and fixed-frequency noise interference that makes separation difficult, and can also make the difficulty of each task block 501 adapt to the acceptance of the subject.

[0079] In some embodiments, the proportion of inconsistent trials in each task block 501 is 30% to 90%, so that the proportion of inconsistent trials in each task block 501 can be flexibly adjusted according to the subject's tendency to mental illness or the degree of damage to brain function, so as to better adapt to subjects with different tendencies to mental illness.

[0080] In some other embodiments, at least one type of task in the first composite task is a trimodal task. Similar to the bimodal task, a trimodal task refers to using three different detection technologies to simultaneously collect data (or information) of three different dimensions while the subject performs the task. These three different dimensions of data (or information) can be, for example, near-infrared detection data, EEG data, and eye movement information.

[0081] 5. Improved forward and backward saccade task.

[0082] Preferably, the improved forward and reverse saccade tasks can be used to collaboratively collect near-infrared detection data, EEG data, and eye movement information.

[0083] As shown in Figure 6, the forward and backward saccade task includes sequentially executing a fourth preset number of task blocks 601 at a preset first time interval 608, and pseudo-randomly alternatingly executing forward saccade trials 602 and backward saccade trials 603 in each task block 601. Executing the forward saccade trial 602 includes sequentially presenting a first visual element 604 within a preset first time period 610, presenting a first identifier 605 indicating a forward saccade within a preset second time period 611, and presenting a second visual element 606 within a preset third time period 612; executing the backward saccade trial 603 includes sequentially presenting the first visual element 604 within the preset first time period 610, presenting a second identifier 607 indicating a backward saccade within the preset second time period 611, and presenting the second visual element 606 within the preset third time period 612.

[0084] At the same time, the subject's eye movement information within the third time period 612 preset in each trial, the near-infrared detection data during the first time interval 608 and in each task block 601, and the EEG data within the preset third time period 612 from before the second time period 611 in each trial to after the first time period 610 are collected.

[0085] Regarding near-infrared (NIR) data, the inclusion of both positive and negative saccade trials within the task blocks allows for sufficient collection of valid and differentiated NIR data. Furthermore, the time intervals between task blocks meet the time requirements for NIR signal acquisition and analysis, enabling the acquisition of high-quality NIR data. Regarding EEG data, the pseudo-random alternation of positive and negative saccade trials effectively reduces the subject's prediction and practice effects, ensuring that each stimulus elicits a maximal EEG response. Regarding eye movement information, different trial types meet the needs of assessing brain function across different dimensions, while also satisfying the signal acquisition and eye movement information collection requirements of EEG equipment. The eye movement information obtained from positive and negative saccade trials can effectively assess and verify brain function related to cognitive impairment. Therefore, while performing the aforementioned task blocks, subjects can simultaneously acquire high-quality trimodal data: eye movement, fNIRS, and EEG. Data from each modality can be used to assist in the assessment of brain function related to cognitive impairment.

[0086] In this way, while performing the aforementioned trimodal task paradigm, subjects simultaneously obtain effective and accurate eye movement information, fNIRS brain data, and EEG data. This allows for accurate assessment of brain function in subjects, particularly those with mental illness or those with a predisposition to mental illness. It also facilitates physicians in differentiating patients with mental disorders based on objective biological indicators, facilitating the establishment of more accurate classification models for subsequent diagnosis of cognitive dysfunction.

[0087] In some embodiments, for a complete task, 2-8 task blocks 601 are executed sequentially at a first time interval 608 of 10s-60s, with each task block 601 lasting 10s-60s. Furthermore, the duration of each task block 601 is consistent. Setting the first time interval 608 to 10s-60s helps restore brain blood oxygen levels to a reasonable range, thereby facilitating baseline selection during subsequent analysis. This also reduces the subject's task load, preventing the overall task duration from being excessively long due to excessive rest intervals.

[0088] In some embodiments, in each trial, the first time period 610 is 200ms-2000ms, the second time period 611 is 500ms-2000ms, and the third time period 612 is 1000ms-2500ms. In this way, the difficulty of the task performed by the subject can be well controlled.

[0089] The first visual element 604, the indicator mark and the second visual element 606 are presented in different time periods and on different screens. By reasonably setting different time periods for executing tasks, especially the third time period 612 being longer, free eye movements can be effectively controlled and the overlap of brain reactions caused by stimulation tasks can be reduced, and interference such as artifacts related to eye movements can be reduced, which is conducive to collecting accurate and effective eye movement information and EEG data.

[0090] In some embodiments, when the subject performs the tasks of each task block 601, in each task block 601, the positive saccade trials 602 and the anti-saccade trials 603 are pseudo-randomly alternately performed with a ratio of the positive saccade trials 602 being 50±20% and a ratio of the anti-saccade trials 603 being 50±20%.

[0091] In some embodiments, when a positive saccade trial 602 in the task block 601 is executed, the first visual element 604, the first identifier 605, and the second visual element 606 of the positive saccade trial 602 are presented in a preset screen sight constraint area; when an antisaccade trial 603 in the task block 601 is executed, the first visual element 604, the second identifier 607, and the second visual element 606 of the antisaccade trial 603 are presented in a preset screen sight constraint area; wherein the preset screen sight constraint area is defined based on the 10%-40% position between the opposite sides of the screen and the 60%-90% position between the opposite sides of the screen, and the two side boundaries of the preset screen sight constraint area are respectively presented as target objects with obvious contrast with the screen color, and the second visual element 606 is presented on one of the target objects.

[0092] 6. Improved smooth tracking task.

[0093] Preferably, the improved smooth pursuit task can be used to collaboratively collect near-infrared detection data, EEG data, and eye movement information.

[0094] As shown in Figure 7, the smooth tracking task includes sequentially executing a fifth preset number of task blocks 701 at a preset third time interval, executing at least two smooth trajectory motion tracking trials in each task block 701, and the at least two smooth trajectory motion tracking trials executed include a straight line motion tracking trial and a curved motion tracking trial. Executing the straight line motion tracking trial includes presenting a tracking target performing straight line motion within a preset first time period 702; executing the curved motion tracking trial includes presenting a tracking target performing curved motion within a preset second time period 703.

[0095] At the same time, the subject's eye movement information for the tracking target, near-infrared detection data during the third time interval and in each task block 701, and EEG data from the preset third time period 704 before the start of presentation of the tracking target in each tracking trial to the end of the current tracking trial are collected.

[0096] In this way, for near-infrared detection data, since the task block contains at least two smooth trajectory motion tracking trials, it is sufficient to collect effective and differentiated near-infrared detection data, and the block-based paradigm design can also meet the data collection requirements of near-infrared equipment, thereby obtaining high-quality near-infrared detection data; for EEG data, since the movement directions of at least two smooth trajectory motion tracking trials are different, and in the tracking trial in which the tracking target performs a relatively simple straight line motion, the tracking target performs a straight line back and forth motion, the subject's expected effect on the tracking trajectory can be reduced under the premise that the overall difficulty of the trial is moderate. Therefore, high-quality EEG data can be collected in both straight line back and forth motion tracking trials and curved motion tracking trials; for eye movement information, different types of smooth trajectory motion tracking trials can meet the use requirements of brain function assessment in different dimensions. The eye movement information obtained from the straight line back and forth motion tracking trial can effectively evaluate brain functions related to mental disorders, while the curved motion tracking trial can evaluate and verify brain functions related to mental disorders. Therefore, when the subjects perform the above-mentioned task blocks, high-quality eye movement, fNIRS, and EEG trimodal data can be collected simultaneously, and the data collected in each modality can be used to evaluate brain function related to mental disorders.

[0097] In this way, the subject only needs to perform one task paradigm on a single terminal to achieve accurate collection of eye movement information, brain fNIRS detection data, and EEG data, thereby accurately evaluating the brain function of the subject, especially patients with mental illness or subjects with mental illness tendencies. It also makes it easier for doctors to distinguish patients with mental disorders based on the objective biological indicators obtained from the evaluation.

[0098] In some embodiments, the fifth preset number can be set to 1-7, for example, 2, 3, 4, 5, 6; the third time interval can be set to 10-60s, for example, 15s, 20s, 30s, 40s, 50s; the first time period 702 can be set to 5-40s, for example, 10s, 20s, 30s; the second time period 703 can be set to 7-50s.

[0099] In some embodiments, the task block 701 includes at least three smooth trajectory motion tracking trials; wherein the at least three smooth trajectory motion tracking trials performed include at least two straight line motion tracking trials and one curved motion tracking trial, and the tracking target has different motion directions in the two straight line motion tracking trials.

[0100] Among them, in the first straight line reciprocating motion tracking trial of the two straight line reciprocating motion tracking trials, the movement direction of the tracking target can be to move rightward first and then to move leftward, realizing one straight line reciprocating motion, and the first straight line reciprocating motion tracking trial can include two straight line reciprocating motions; in the second straight line reciprocating motion tracking trial of the two straight line reciprocating motion tracking trials, the movement direction of the tracking target can be to move downward first and then to move upward, realizing one straight line reciprocating motion, and the second straight line reciprocating motion tracking trial can include two straight line reciprocating motions.

[0101] In some embodiments, the task block 701 includes at least five smooth trajectory motion tracking trials; wherein, the at least five smooth trajectory motion tracking trials performed include at least three straight line motion tracking trials and two curved motion tracking trials, and the three straight line motion tracking trials include at least one straight line motion tracking trial in a first direction and at least one straight line motion tracking trial in a second direction; the movement directions of the tracking target in the two curved motion tracking trials are different.

[0102] Among them, in the first straight line reciprocating motion tracking trial among the three straight line reciprocating motion tracking trials, the movement direction of the tracking target can be to move to the right first and then to the left, realizing one straight line reciprocating motion, and one straight line reciprocating motion tracking trial can include two straight line reciprocating motions; in the second straight line reciprocating motion tracking trial among the three straight line reciprocating motion tracking trials, the movement direction of the tracking target can be to move to the left first and then to the right, realizing one straight line reciprocating motion, and one straight line reciprocating motion tracking trial can include two straight line reciprocating motions; in the third straight line reciprocating motion tracking trial among the three straight line reciprocating motion tracking trials, the movement direction of the tracking target can be to move downward first and then upward, realizing one straight line reciprocating motion, and one straight line reciprocating motion tracking trial can include two straight line reciprocating motions.

[0103] In the first of the two curve motion tracking trials, the tracking target can use the center point of the display as the center of the circle to make a counterclockwise circular motion with a preset radius. In one curve motion tracking trial, two complete circular motions can be included, that is, the motion trajectory contains two complete circular motion trajectories. In the second of the two curve motion tracking trials, the tracking target can use the center point of the display as the center of the circle to make a clockwise circular motion with a preset radius. In one curve motion tracking trial, two complete circular motions can be included.

[0104] In this way, targeting the specific performance of schizophrenia patients in tracking horizontally moving objects, at least five smooth trajectory motion tracking trials, including two linear round-trip motion tracking trials with different motion directions (including two different horizontal tracking trials) and two curved motion tracking trials with different motion directions, can induce a better blood oxygen response and facilitate the superposition and averaging of EEG data and near-infrared responses. Furthermore, the trimodal data acquisition method can provide objective indicators with reference value for doctors' subjective diagnosis by further exploring the differences in trimodal results under different motion directions and paths.

[0105] In some embodiments, the movement of the tracking target in the smooth trajectory motion tracking trial includes at least an acceleration movement stage and a uniform speed movement stage performed in sequence, wherein: the tracking target accelerates at a preset acceleration in the acceleration movement stage until the speed of the tracking target reaches a preset speed; the tracking target moves at a uniform speed at the preset speed in the uniform speed movement stage, achieving a movement effect of first accelerating and then uniform speed.

[0106] Here, the preset speed and the preset acceleration can be set with reference to actual environmental parameters such as the display area of ​​the display and the size of the tracking target, and can be set to values ​​that can be perceived and tracked by the human eye.

[0107] In some embodiments, the movement of the tracking target in the smooth trajectory motion tracking trial may further include a deceleration movement stage. Specifically, the tracking target may accelerate at a preset acceleration in the acceleration movement stage until the speed of the tracking target reaches a preset speed; the tracking target may uniformly move at the preset speed in the uniform motion stage; and the tracking target may decelerate with the preset speed as the initial speed in the deceleration movement stage until completing one complete linear motion or circular motion.

[0108] In some embodiments, when the first complex task includes a bimodal task and / or a trimodal task, the at least two types of physiological data include near-infrared detection data and electroencephalogram data.

[0109] By providing the subject with a first composite task that includes multiple types of multimodal tasks at one time, physiological data of multiple modalities corresponding to each type of multimodal task can be obtained. This multimodal physiological data can reflect different cognitive function conditions of the subject, such as working memory state, response inhibition function, sustained attention state, executive function state, etc. from multiple dimensions. By combining and analyzing physiological data of multiple modalities, a comprehensive and efficient auxiliary assessment of the subject's tendency to suffer from mental illness can be carried out, thereby distinguishing different types of mental illness.

[0110] In some other embodiments of the present application, the type and / or priority of each task in the first composite task can be determined based on the preliminary analysis results of the subject's disease tendency; and the first composite task can be presented to the subject based on the preliminary analysis results.

[0111] Specifically, the examinee can be asked to complete a scale, or the doctor can conduct a preliminary analysis of the examinee's tendency to suffer from mental illness through observation, questioning, etc. This is only used as an example, and there is no specific limitation on the method of conducting the preliminary analysis.

[0112] After the subject's tendency toward mental illness is preliminarily analyzed, the first composite task can be adaptively configured according to the tendency toward mental illness.

[0113] In some other embodiments of the present application, the first composite task includes executing a first combination task with the highest priority, executing a second combination task with a lower priority than the first combination task, and executing a third combination task with a lower priority than the second combination task; wherein the first combination task, the second combination task, and the third combination task in the first composite task are determined based on the preliminary analysis results of the subject's disease tendency.

[0114] Among them, the first combination task is more sensitive to the type of mental illness determined by the preliminary analysis than the second and third combination tasks. Its sensitivity can be reflected by the significance of the brain function response caused by the subjects when performing the task. A higher significance indicates a higher sensitivity.

[0115] In some embodiments, only the first combined task with the highest priority may be executed, or only the first combined task and the second combined task may be executed, or the first combined task, the second combined task and the third combined task may be executed, without limitation.

[0116] For example, if the subject performs the first combination task, the subject's tendency to suffer from mental illness can be distinguished from other types of mental illness, and there is no need to continue to perform other combination tasks.

[0117] Of course, if the subject's tendency to suffer from mental illness cannot be identified when performing the first combination task, the second combination task and / or the third combination task can be continued to be performed, and the subject's tendency to suffer from mental illness can be auxiliary evaluated by jointly analyzing the subject's physiological data when performing each combination task.

[0118] In this embodiment, even for the same type of mental illness, the configured first, second, and third combination tasks can be the same or different due to the significant differences in the current cognitive abilities and mental states of different subjects. Alternatively, the doctor can adjust the priority of each task in the first combination task based on their own experience.

[0119] For example, for a subject with a tendency toward schizophrenia, if the subject's mental state is good, the first combination of tasks can include a resting-state task, an N-back task, a smooth pursuit task, and a VFT task, and the second combination of tasks can include a Stroop task. If the subject's mental state is poor, the first combination of tasks can include a resting-state task and an N-back task, and the second combination of tasks can include a smooth pursuit task and a VFT task.

[0120] This is only an illustrative description and does not constitute a limitation on the specific solution.

[0121] Based on the preliminary analysis results of the subject's predisposition to mental illness, the first, second, and third combination tasks within the first composite task are determined, such that the difficulty of each combination task is tailored to the subject's individual condition, facilitating the subject's ease and efficiency in completing the entire set of tasks. Furthermore, by specifically configuring each combination task, more accurate and objective physiological data can be collected from each subject during the entire set of tasks, thereby facilitating accurate auxiliary assessment of the subject's predisposition to mental illness and distinguishing between different types of mental illness.

[0122] In some other embodiments, when the preliminary analysis result indicates that the subject has a tendency toward ADHD, in the first combination task, the execution priority of the RVP task is higher than the execution priority of other tasks in the combination task.

[0123] Specifically, when the subject has ADHD tendencies, since there are obvious differences in brain function data among subjects with different mental illnesses when performing the RVP task, and the RVP task takes a long time to perform, the subject easily feels fatigued. Therefore, the first composite task can be configured to include at least the RVP task, and the RVP task can be performed first.

[0124] That is, when the preliminary analysis results determine that the subject has a tendency to suffer from ADHD, the RVP task can be prioritized as the basic task, and then combined with other types of multimodal tasks to configure the first composite task, and the configured first composite task can be provided to the subject.

[0125] For another example, when the subject has schizophrenia tendencies, there are obvious differences in brain function data of subjects with different mental illnesses when performing the N-back task. The first composite task can be configured to include at least the N-back task, and the N-back task can be performed first.

[0126] That is to say, when the preliminary analysis result shows that the subject has a tendency towards schizophrenia, at least one category of the first composite task includes an N-back task. The N-back task can be used as the basic task to be performed preferentially, and then combined with other types of multimodal tasks to configure the first composite task to obtain a first composite task that is conducive to distinguishing schizophrenia.

[0127] For example, a preliminary analysis may be performed on the subject's disease tendency, and the various types of tasks included in each combined task may be determined based on the preliminary analysis results.

[0128] In some embodiments, when the preliminary analysis result is that the subject has a tendency towards schizophrenia, the first combination task in the first composite task includes at least one of an N-back task, a smooth pursuit task, and a VFT task, the second combination task includes at least one of a resting-state task and a Stroop task, and the third combination task includes at least one of an emotional Stroop, an RVP task, and a forward and backward saccade task.

[0129] In some embodiments, when the preliminary analysis result is that the subject has a tendency to depression, the first combination task in the first composite task includes at least one of a resting-state task, an emotional Stroop, a VFT task, and a Stroop task, the second combination task includes a forward and reverse saccade task, and the third combination task includes at least one of an RVP task and a smooth pursuit task.

[0130] In some embodiments, when the preliminary analysis result shows that the subject has an anxiety tendency, the first combination task in the first complex task includes at least one of an emotional Stroop task and a VFT task, the second combination task includes at least one of a resting-state task and a Stroop task, and the third combination task includes at least one of an RVP task, a smooth pursuit task, and a forward and backward saccade task;

[0131] In some embodiments, when the preliminary analysis result shows that the subject has a tendency towards ADHD, the first combination task in the first complex task includes at least one of an RVP task, a Stroop task, and a forward and reverse saccade task, the second combination task includes at least one of a resting-state task, a VFT task, and an emotional Stroop task, and the third combination task includes a smooth pursuit task;

[0132] In some embodiments, when the preliminary analysis result is that the subject has a tendency to bipolar disorder, the first combination task in the first composite task includes at least one of an emotional Stroop, a Stroop task, and a VFT task, the second combination task includes a resting-state task, and the third combination task includes at least one of an RVP task, a forward and backward saccade task, and a smooth pursuit task.

[0133] The inventors believe that the above-mentioned composite task setting for different mental illness tendencies can achieve a comprehensive and efficient auxiliary assessment of the examinee's mental illness tendencies, and thus distinguish the examinee's mental illness type.

[0134] In this way, the subject's predisposition to mental illness is determined based on the preliminary analysis results, and a first composite task is configured for each type of mental illness. The first composite task within the first composite task has a higher execution priority than the other composite tasks. The subject will prioritize executing the first composite task, while the other tasks can serve as supplementary tasks to assist in analyzing the subject's predisposition to mental illness.

[0135] In some other embodiments of the present application, when the combined task includes a quiescent task, the execution priority of the quiescent task is higher than the execution priority of other tasks in the combined task.

[0136] Specifically, assuming the first combined task includes an emotional Stroop, a VFT task, a resting-state task, and a Stroop task, then the resting-state task has a higher priority than the emotional Stroop, VFT, and Stroop tasks. When performing this first combined task, the subject prioritizes the resting-state task over the other tasks.

[0137] In this way, prioritizing the execution of the resting state task will interfere with the data of the resting state task compared to prioritizing the execution of other tasks. Therefore, prioritizing the execution of the resting state task can also ensure the objectivity and accuracy of at least two physiological data corresponding to the resting state task.

[0138] In some other embodiments of the present application, in each combined task, the execution priority of each task is determined based on the significance of the brain function response of the subject caused by each task, so that the execution priority of the task with a high significance of the brain function response of the subject is higher than the execution priority of the task with a low significance.

[0139] For example, for subjects with a predisposition to schizophrenia, the inventors believe that the significance of the brain function response induced by the smooth pursuit task is higher than that induced by other tasks. Therefore, if the subject has a predisposition to schizophrenia and the first combination of tasks includes the N-back task, the smooth pursuit task, and the VFT task, the smooth pursuit task is prioritized over the other tasks, i.e., the subject is given priority to perform the smooth pursuit task.

[0140] In this way, by giving priority to tasks that cause a more significant brain function response, it is possible to avoid the task that is more sensitive to a certain type of mental illness from being interfered with and affected by other tasks, which is conducive to ensuring the accuracy and objectivity of at least two physiological data corresponding to the task collected.

[0141] In some other embodiments of the present application, when the preliminary analysis result shows that the subject has a tendency to suffer from a mixed disease, the first composite task includes at least a first task, which is a combined similar item task determined based on the mixed disease type.

[0142] The mixed diseases include, but are not limited to, anxiety with depression, bipolar disorder with depression, etc.

[0143] In some embodiments, the doctor can pre-set a first task based on the subject's tendency to suffer from mixed diseases. If the physiological indicators obtained when the subject performs the first task do not conform to the data of healthy people (for example, not within the preset integral value range corresponding to the mixed disease), other tasks can be added to the first task, and the physiological indicators of the subject when performing the supplementary tasks can be obtained to further assist in the analysis of the mixed disease type.

[0144] The combined similar item task can be determined based on a first composite task corresponding to a single type of mental illness involved in the mixed disease. For example, if the subject has a tendency to suffer from a mixed disease of anxiety and depression, the first task can be a combined similar item task. The combined similar item task is determined based on the first composite task corresponding to each of depression and anxiety, and can include a resting-state task, an emotional Stroop, a VFT task, and a Stroop task. This facilitates analysis based on at least two types of physiological data collected when the subject performs the first task, thereby accurately distinguishing the type of the mixed disease.

[0145] This is only an example and does not constitute a limitation to the specific solution.

[0146] In some embodiments of the present application, without conducting a preliminary analysis of the subject's disease tendency, the individual tasks in the first composite task are selected from at least two tasks among a resting-state task, a VFT task, an N-back task, an emotional Stroop task, an RVP task, a Stroop task, a forward and backward saccade task, and a smooth pursuit task.

[0147] There are no specific limitations on the individual tasks in the first composite task. Any combination of at least two tasks can be selected from a resting-state task, a VFT task, an N-back task, an emotional Stroop task, a RVP task, a Stroop task, a forward and backward saccade task, and a smooth pursuit task. The order of execution of the tasks can be arbitrarily arranged as needed.

[0148] Preferably, each task in the first complex task is a resting-state task, a VFT task, an N-back task, an emotional Stroop task, an RVP task, a Stroop task, a forward and backward saccade task, and a smooth pursuit task.

[0149] That is, without conducting a preliminary analysis of the subject's predisposition to mental illness, each subject performs the same first composite task. Furthermore, based on the at least two types of physiological data collected while the subject performs the first composite task, combined with the subject's other clinical symptoms, a comprehensive assessment of the subject's predisposition to mental illness can be conducted, which is particularly helpful for distinguishing between mental illnesses with similar symptoms.

[0150] In some other embodiments of the present application, the first composite task includes a third task that can cause the subject's brain function response level to exceed the healthy reference level range, and a fourth task that is directional for different mental illness tendencies.

[0151] The healthy reference level range may be obtained based on the brain function response level of a healthy subject when performing the first complex task, or may be obtained based on the brain function response level summarized or generalized from clinical experimental data.

[0152] Exemplarily, the third task may be a resting-state task. If the subject's brain function response level when performing the resting-state task exceeds the healthy reference level range, the subject is considered to have a tendency to suffer from mental illness, thereby distinguishing subjects with a tendency to suffer from mental illness from healthy people.

[0153] The fourth task may be an N-back task and a smooth pursuit task that are indicative of a schizophrenia predisposition. For example, after the subject completes the third task, it can be confirmed that the subject has a schizophrenia predisposition. Then, the N-back task and the smooth pursuit task are continued, and at least two types of physiological data from the subject are collected while performing the N-back task and the smooth pursuit task. Based on analysis of the physiological data, whether the subject has a schizophrenia predisposition can be determined. This improves the efficiency and accuracy of the auxiliary assessment of the subject's schizophrenia predisposition.

[0154] This is merely an exemplary description of the third task and the fourth task, wherein the third task and the fourth task may include multiple types of tasks rather than just one type of task.

[0155] In some embodiments, a fourth task that is directed towards different mental illness tendencies can be pre-configured for different mental illness tendencies. For example, for schizophrenia, the fourth task can be configured to include an N-back task, a smooth pursuit task, and a VFT task; for depression tendencies, the fourth task can be configured to include an emotional Stroop task, a VFT task, and a Stroop task. This is only for illustrative purposes. After a preliminary analysis of the subject to determine the mental illness tendency, the pre-configured task can be used to have the subject perform it to assess the subject's brain function.

[0156] In some other embodiments of the present application, when the physiological data includes near-infrared detection data and electroencephalogram (EEG) data, at least two types of physiological data of the subject's brain regions of interest are collected when the subject performs the first complex task, wherein the brain regions of interest corresponding to the near-infrared detection data include at least the frontal lobe, temporal lobe, and parietal lobe, and the brain regions of interest corresponding to the EEG data include at least the frontal lobe, temporal lobe, parietal lobe, and occipital lobe, including at least one of the following situations:

[0157] In case 1, when the subject performs a resting-state task, the brain area of ​​interest is the inferior frontal gyrus.

[0158] Scenario 2: When the subject performs the VFT task, the brain area of ​​interest is the prefrontal lobe and / or temporal lobe.

[0159] In scenario three, when the subject performs an N-back task, an emotional Stroop task, an RVP task, a Stroop task, a forward and backward saccade task, or a smooth pursuit task, the brain regions of interest are the prefrontal lobe, the temporal lobe, and the parietal lobe.

[0160] In this application, the brain areas that need to be tested can be adaptively adjusted based on the various tasks that the subject needs to perform, so as to more efficiently and accurately judge the subject's disease tendency.

[0161] In some other embodiments of the present application, the above-mentioned bimodal tasks and / or trimodal tasks may be arbitrarily combined to meet actual usage requirements. This embodiment does not limit the combinations that may actually be used.

[0162] In other embodiments of the present application, a device for assessing a subject's mental condition based on physiological data is provided, as shown in FIG8 . The device 800 includes an interface 801 and a processor 802. The interface 801 is configured to obtain at least two types of physiological data from a subject while performing a first complex task, wherein the first complex task includes at least two types of tasks; and the processor 802 is configured to analyze the at least two types of physiological data and, based on the analysis results, perform an auxiliary assessment of the subject's propensity for mental illness. In some embodiments, the interactive process of the first complex task can be implemented via a display.

[0163] When the subjects perform the first complex task, at least two physiological data corresponding to each task work together and support each other, which is conducive to the efficient and accurate identification and differentiation of mental illnesses, thereby providing an objective and reliable indicator basis for the assessment of the mental condition of the subjects.

[0164] Figure 9 shows a flowchart of a method for assessing a subject's mental condition based on physiological data. Steps S901 and S902 are executed by a processor. In step S901, at least two types of physiological data are obtained from the subject while performing a first complex task, where the first complex task includes at least two types of tasks. In step S902, the at least two types of physiological data are analyzed, and based on the analysis results, an auxiliary assessment of the subject's propensity for mental illness is performed to improve the accuracy of the auxiliary assessment and distinguish between different types of mental illness.

[0165] In some embodiments, when analyzing the at least two physiological data, taking the use of a dual-modal task paradigm to assess sustained attention as an example, the analysis process may include the following steps:

[0166] Step 1. Determine a reference model based on the convolution of the target sequence presentation time and the blood oxygen response dynamics function.

[0167] Step 2: Determine the degree of fit between the acquired near-infrared detection data and the reference model as the near-infrared detection feature.

[0168] Step 3. Use the EEG data within 50-600ms before the presentation of each target sequence as the baseline EEG data, and use the EEG data within 600ms from the start of each target sequence to the end of the complete presentation as the target EEG data to extract the attribute characteristics of the change curve of the target EEG data relative to the baseline EEG data as the EEG data features.

[0169] Step 4: Evaluate the subject's sustained attention state based on the near-infrared detection features in conjunction with the EEG data features.

[0170] In some embodiments, when analyzing the at least two physiological data, taking the trimodal task paradigm as an example, the data (or information) under the three modalities of the subject can be simultaneously analyzed based on a pre-trained model to obtain brain function assessment results.

[0171] Specifically, the training process of the model can be supervised, and the labels used in the training can include at least one of the evaluation results such as the doctor's subjective evaluation results, the scale evaluation results of the examination, etc.; in the input data processing stage of the model, the characteristic values ​​corresponding to each modality can be spliced ​​according to the preset modal feature splicing order to obtain the features to be analyzed containing the features under the three modalities. Subsequently, the features to be analyzed can be classified and processed to obtain the corresponding brain function evaluation results of the subjects.

[0172] In some embodiments, when analyzing the at least two physiological data, taking the use of a trimodal task paradigm as an example, usage rules for eye movement information, EEG data, and near-infrared detection data can be pre-established, and brain function assessment can be performed according to the usage rules.

[0173] The usage rules may include the order of using data / information in different modalities, the threshold value indicating normal brain function of the subject, etc.

[0174] In some embodiments of the present application, a collaborative interaction method for collecting multimodal physiological data is provided, including using a display to present at least one task in a first composite task to a subject, wherein the first composite task includes at least two types of tasks; and the collected data includes at least two types of physiological data of the subject when performing the first composite task. In this way, a single display can be used to achieve intuitive, convenient, and efficient collaborative interaction with the subject. During the collaborative interaction, at least two types of physiological data are obtained. The collaborative use of the at least two types of physiological data obtained can objectively and comprehensively reflect the impact of the subject's different brain function conditions on each modal data, facilitating the establishment of a more accurate classification model for the subsequent diagnosis of different mental illnesses.

[0175] The processor may be a processing device including one or more general-purpose processing devices, such as a microprocessor, a central processing unit (CPU), a graphics processing unit (GPU), etc. More specifically, the processor may be a complex instruction set computing (CISC) microprocessor, a reduced instruction set computing (RISC) microprocessor, a very long instruction word (VLIW) microprocessor, a processor running other instruction sets, or a processor running a combination of instruction sets. The processor may also be one or more special-purpose processing devices, such as an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), a digital signal processor (DSP), a system on a chip (SoC), etc.

[0176] This application describes various operations or functions that can be implemented as software code or instructions or defined as software code or instructions. Such content can be source code or differential code ("incremental" or "patch" code) that can be directly executed ("object" or "executable" form). Software code or instructions can be stored in a computer-readable storage medium and, when executed, can cause a machine to perform the described functions or operations, and include any mechanism for storing information in a form accessible to a machine (e.g., a computing device, an electronic system, etc.), such as recordable or non-recordable media (e.g., read-only memory (ROM), random access memory (RAM), magnetic disk storage media, optical storage media, flash memory devices, etc.).

[0177] The exemplary methods described herein can be at least partially implemented by a machine or computer. In some embodiments, a computer-readable storage medium stores computer program instructions that, when executed by a processor, cause the processor to perform the method for assessing a subject's mental condition based on physiological data as described in various embodiments of the present invention.

[0178] The implementation of such a method may include software code, such as microcode, assembly language code, high-level language code, etc. Various software programming techniques can be used to create various programs or program modules. For example, a program portion or program module can be designed with or by means of Java, Python, C, C++, assembly language, or any known programming language. One or more of such software portions or modules can be integrated into a computer system and / or computer-readable medium. Such software code may include computer-readable instructions for executing various methods. The software code may form part of a computer program product or a computer program module. In addition, in an example, the software code may be tangibly stored on one or more volatile, non-transitory, or non-volatile tangible computer-readable media, such as during execution or at other times. Examples of these tangible computer-readable media may include, but are not limited to, a hard disk, a removable disk, a removable optical disk (such as an optical disk and a digital video disk), a cassette tape, a memory card or memory stick, a random access memory (RAM), a read-only memory (ROM), etc.

[0179] In addition, although exemplary embodiments have been described herein, the scope includes any and all embodiments based on the present application with equivalent elements, modifications, omissions, combinations (e.g., solutions that intersect various embodiments), adaptations, or changes. The elements in the claims are to be interpreted broadly based on the language employed in the claims and are not limited to the examples described in this specification or during the prosecution of this application, which examples are to be interpreted as non-exclusive. Therefore, this specification and examples are intended to be considered as examples only, with the true scope and spirit being indicated by the following claims and the full scope of their equivalents.

[0180] The above description is intended to be illustrative and not restrictive. For example, the above examples (or one or more of their solutions) can be used in combination with each other. For example, those of ordinary skill in the art may use other embodiments when reading the above description. In addition, in the above-mentioned specific embodiments, various features can be grouped together to simplify the application. This should not be interpreted as an intention that a disclosed feature that is not required to be protected is necessary for any claim. On the contrary, the subject matter of the present application may be less than all the features of a specific disclosed embodiment. Thus, the claims are incorporated into the specific embodiments as examples or embodiments, wherein each claim is independently a separate embodiment, and it is considered that these embodiments can be combined with each other in various combinations or arrangements. The scope of this application should be determined with reference to the appended claims and the full scope of equivalents to which these claims are entitled.

[0181] The above embodiments are merely exemplary embodiments of the present application and are not intended to limit the scope of the present application. The scope of protection of the present application is defined by the claims. Those skilled in the art may make various modifications or equivalent substitutions to the present application within the essence and scope of protection of the present application, and such modifications or equivalent substitutions shall also be deemed to fall within the scope of protection of the present application.

Claims

1. A method for evaluating the mental state of a subject based on physiological data, characterized in that, The method includes: Presenting at least one task in a first composite task to a subject, where the first composite task includes at least two types of tasks; Obtaining at least two physiological data of the subject during the execution of the first composite task, so as to assist in evaluating the tendency of the subject to have a mental illness based on the analysis results of the at least two physiological data.

2. The method according to claim 1, wherein At least one type of task in the first composite task is selected from a resting-state task, a VFT task, an N-back task, an emotional Stroop task, an RVP task, a Stroop task, a prosaccade and antisaccade task, a smooth pursuit task.

3. The method according to claim 1, characterized in that At least one type of task in the first composite task is a bimodal task, and the bimodal task is one or more of a resting-state task, an N-back task, an emotional Stroop task, an RVP task, a Stroop task.

4. The method according to claim 1 or 3, characterized in that, When at least one type of task in the first composite task is a trimodal task, the trimodal task is a prosaccade and antisaccade task and / or a smooth pursuit task.

5. The method according to any one of claims 1 to 4, characterized in that, The method further includes: Determining the type and / or priority of each task in the first composite task according to the preliminary analysis result of the subject's tendency to get sick; and Presenting the first composite task to the subject according to the preliminary analysis result.

6. The method according to claim 5, wherein When the preliminary analysis result is that the subject has a schizophrenia tendency, at least one type of task in the first composite task includes an N-back task.

7. The method according to claim 5, wherein The first composite task includes a first combined task with the highest execution priority, a second combined task with an execution priority lower than that of the first combined task, and a third combined task with an execution priority lower than that of the second combined task; wherein, the first combined task, the second combined task and the third combined task in the first composite task are determined according to the preliminary analysis result of the subject's tendency to get sick.

8. The method according to claim 7, wherein The specific method for determining the execution priority of each task in each combined task includes: When the combined task includes a resting-state task, the execution priority of the resting-state task is higher than that of other tasks in the combined task.

9. The method according to claim 7, characterized in that The specific method for determining the execution priority of each task in each combined task further includes: In each combined task, determining the execution priority of each task based on the significance level of the brain function response of the subject caused by each task, so that the execution priority of the task with a higher significance level of the brain function response of the subject is higher than that of the task with a lower significance level.

10. The method according to claim 7, wherein Determining the first combined task, the second combined task and the third combined task in the first composite task according to the preliminary analysis result of the subject's tendency to get sick specifically includes: When the preliminary analysis result is that the subject has a schizophrenia tendency, the first combined task in the first composite task includes at least one of an N-back task, a smooth pursuit task and a VFT task, the second combined task includes at least one of a resting-state task and a Stroop task, and the third combined task includes at least one of an emotional Stroop, an RVP task and a prosaccade and antisaccade task; When the preliminary analysis result indicates that the subject has a tendency of depression, the first combined task in the first composite task includes at least one of a resting state task, an emotional Stroop, a VFT task, and a Stroop task, the second combined task includes a prosaccade and antisaccade task, and the third combined task includes at least one of an RVP task and a smooth pursuit task; When the preliminary analysis result indicates that the subject has a tendency of anxiety, the first combined task in the first composite task includes at least one of an emotional Stroop and a VFT task, the second combined task includes at least one of a resting state task and a Stroop task, and the third combined task includes at least one of an RVP task, a smooth pursuit task, and a prosaccade and antisaccade task; When the preliminary analysis result indicates that the subject has a tendency of ADHD, the first combined task in the first composite task includes at least one of an RVP task, a Stroop task, and a prosaccade and antisaccade task, the second combined task includes at least one of a resting state task, a VFT task, and an emotional Stroop task, and the third combined task includes a smooth pursuit task; When the preliminary analysis result indicates that the subject has a tendency of bipolar disorder, the first combined task in the first composite task includes at least one of an emotional Stroop, a Stroop task, and a VFT task, the second combined task includes a resting state task, and the third combined task includes at least one of an RVP task, a prosaccade and antisaccade task, and a smooth pursuit task.

11. The method according to claim 5, characterized in that, When the preliminary analysis result indicates that the subject has a tendency of ADHD, in the first combined task, the execution priority of the RVP task is higher than that of other tasks in this combined task.

12. The method according to claim 5, wherein The method further includes: When the preliminary analysis result indicates that the subject has a tendency of having a mixed disease, the first composite task includes at least a first task, and the first task is a combined like-term task determined based on the type of the mixed disease.

13. The method according to claim 1, characterized in that, The method further includes: When not conducting a preliminary analysis on the disease tendency of the subject, each task in the first composite task is selected from a resting state task, a VFT task, an N-back task, an emotional Stroop task, an RVP task, a Stroop task, a prosaccade and antisaccade task, and a smooth pursuit task.

14. The method according to claim 1 or 2, characterized in that, The first composite task includes a third task that can cause the brain function response level of the subject to exceed the healthy reference level range, and a fourth task that is directive for different mental disease tendencies.

15. The method according to claim 1, wherein When the first composite task includes a bimodal task and / or a trimodal task, the at least two physiological data include near-infrared detection data and electroencephalogram data.

16. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, it executes the method for evaluating the mental state of a subject based on physiological data according to any one of claims 1-15.

17. A device for evaluating the mental state of a subject based on physiological data, characterized in that, The device includes an interface and a processor, The interface is configured to: obtain at least two types of physiological data of the subject during the execution of the first composite task, where the first composite task includes at least two types of tasks; The processor is configured to: analyze the at least two types of physiological data and assist in evaluating the tendency of the subject to have a mental illness based on the analysis results.

18. A method for evaluating the mental state of a subject based on physiological data, characterized in that, The method includes using a processor to perform the following steps: Obtain at least two types of physiological data of the subject during the execution of the first composite task, where the first composite task includes at least two types of tasks; Analyze the at least two types of physiological data and assist in evaluating the tendency of the subject to have a mental illness based on the analysis results.

Images