Method, device and system for evaluating concentration ability based on visual and auditory hybrid modulation and evaluation equipment

Abstract

The invention relates to the technical field of concentration ability evaluation, and discloses a method for evaluating concentration ability based on visual and auditory hybrid modulation, which comprises the following steps of: generating an interaction task for evaluating the concentration ability by utilizing a visual frequency target, an auditory frequency target and a task prompt; collecting an electroencephalogram response induced by the to-be-tested object based on the interaction task; wherein the electroencephalogram response comprises visual steady-state response, auditory steady-state response and visual and auditory cross modulation frequency response; and according to the electroencephalogram response induced based on the interaction task, scoring the interaction task so as to evaluate the concentration ability of the to-be-tested object. On the basis of the real-time electroencephalogram signals, the ability evaluation is carried out by combining the electroencephalogram response induced by visual and auditory hybrid modulation. The invention also discloses a device and a system for evaluating the concentration ability based on visual and auditory hybrid modulation, and evaluation equipment.

Description

Technical Field

[0001] The present application relates to the technical field of concentration ability assessment, for example, to a method, device, system and assessment equipment for assessing concentration ability based on visual and auditory mixed modulation. Background Art

[0002] At present, traditional concentration ability assessment often relies on scales and behavioral methods. Scale assessment usually includes a series of self-report questions, and the person being assessed needs to answer according to his or her own feelings or behavior patterns. Behavioral methods assess concentration by observing the behavior of individuals in specific tasks or environments. The effectiveness of these methods may be affected by the subjective factors of the user and the judgment experience of experts. For example, the evaluator's interpretation of the behavior of the person being assessed may be biased. In order to improve the objectivity and accuracy of the assessment, with the advancement of technology and the conduct of more research, EEG signals have begun to be used to assess attention levels.

[0003] In order to use EEG signals to evaluate concentration ability, the relevant technology discloses an online attention detection system and detection method based on EEG signals, including: collecting EEG signal data of the detection object in real time through an EEG signal acquisition module and transmitting the EEG signal data back; denoising and feature extraction of the EEG signal data through an EEG signal preprocessing module, and sending the obtained feature values ​​to an attention state classification module; the attention state classification module inputs the feature values ​​into a trained EEG signal classifier to obtain the real-time attention state of the detection object.

[0004] In the process of implementing the embodiments of the present disclosure, it is found that there are at least the following problems in the related art:

[0005] Although related technologies can use EEG signals to detect attention, they usually focus on the collection and analysis of attention states. The attention state classification module focuses more on real-time detection of the subject's attention state, but cannot provide an evaluation result of the subject's concentration ability.

[0006] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present application, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention

[0007] In order to provide a basic understanding of some aspects of the disclosed embodiments, a brief summary is given below. The summary is not an extensive review, nor is it intended to identify key / critical components or delineate the scope of protection of these embodiments, but rather serves as a prelude to the detailed description that follows.

[0008] The embodiments of the present disclosure provide a method, apparatus, system and evaluation device for evaluating concentration ability based on visual-auditory mixed modulation, so as to evaluate concentration ability through electroencephalogram signals.

[0009] In some embodiments, the method for assessing concentration ability based on visual-auditory mixed modulation includes: generating an interactive task for assessing concentration ability using visual frequency targets, auditory frequency targets and task prompts; collecting the EEG response induced by the subject to be tested based on the interactive task; wherein the EEG response includes a visual steady-state response, an auditory steady-state response and a visual-auditory cross-modulation frequency response; and scoring the interactive task based on the EEG response induced by the interactive task to assess the concentration ability of the subject to be tested.

[0010] Optionally, an interactive task for assessing concentration ability is generated using visual frequency targets, auditory frequency targets and task prompts, including: using 2 visual frequency targets, 1 auditory frequency target and 1 auditory task prompt as an interactive task; and / or using 1 visual frequency target, 2 auditory frequency targets and 1 visual task prompt as an interactive task.

[0011] Optionally, two visual frequency targets, one auditory frequency target and one auditory task prompt are used as interactive tasks, including: controlling the two visual frequency targets to flash at a first visual frequency and a second visual frequency respectively; controlling the auditory frequency target to play at a first auditory frequency; executing the auditory task prompt during the playing of the auditory frequency target so that the subject to be tested obtains the auditory task; wherein, the auditory task uses any one of the two visual frequency targets as a prompt target that the subject to be tested needs to pay attention to, and the other visual frequency target as a non-prompt target.

[0012] Optionally, one visual frequency target, two auditory frequency targets and one visual task prompt are used as interactive tasks, including: controlling the two auditory frequency targets to play at a first auditory frequency and a second auditory frequency respectively; controlling the visual frequency target to flash at the first visual frequency; executing the visual task prompt during the flashing of the visual frequency target so that the subject to be tested obtains the visual task; wherein, the visual task uses any one of the two auditory frequency targets as a prompt target that the subject to be tested needs to pay attention to, and the other auditory frequency target as a non-prompt target.

[0013] Optionally, the interactive task is scored based on the EEG response induced by the interactive task, including: judging whether the subject to be tested correctly performs the task prompt based on the frequency of the visual steady-state response or the frequency of the auditory steady-state response in the EEG response, so as to score the task prompt; if the subject to be tested does not correctly perform the task prompt, the interactive task is scored as zero; if the subject to be tested correctly performs the task prompt, the interactive task is scored based on the intensity of the visual-auditory cross-modulation frequency EEG response.

[0014] Optionally, whether the subject to be tested correctly performs the task prompt is judged according to the frequency of the visual steady-state response or the frequency of the auditory steady-state response in the EEG response to score the task prompt, including: if the frequency of the visual steady-state response induced by the non-cue target is higher than or equal to the frequency of the visual steady-state response induced by the cue target, or the frequency of the auditory steady-state response induced by the non-cue target is higher than or equal to the frequency of the auditory steady-state response induced by the cue target, then it is judged that the subject to be tested has not correctly performed the task prompt; if the frequency of the visual steady-state response induced by the non-cue target is lower than the frequency of the visual steady-state response induced by the cue target, or the frequency of the auditory steady-state response induced by the non-cue target is lower than the frequency of the auditory steady-state response induced by the cue target, then it is judged that the subject to be tested correctly performs the task prompt.

[0015] Optionally, the interactive task is scored according to the intensity of the visual-auditory cross-modulation frequency EEG response, including: comparing the intensity of the cross-modulation frequency response with a score comparison table to obtain a score corresponding to the intensity of the cross-modulation frequency response as the score of the interactive task.

[0016] In some embodiments, the device for assessing concentration ability based on visual-auditory mixed modulation includes a processor and a memory storing program instructions, and the processor is configured to execute the method for assessing concentration ability based on visual-auditory mixed modulation as described above when running the program instructions.

[0017] In some embodiments, the system for assessing concentration ability based on visual-auditory mixed modulation includes: a task interaction terminal, configured to generate an interactive task for assessing concentration ability using visual frequency targets, auditory frequency targets and task prompts; a brain signal acquisition terminal, configured to acquire the EEG response induced by the subject to be tested based on the interactive task; wherein the EEG response includes a visual steady-state response, an auditory steady-state response and a visual-auditory cross-modulation frequency response; a brain signal analysis and processing terminal, configured to score the interactive task according to the EEG response induced based on the interactive task, so as to assess the concentration ability of the subject to be tested.

[0018] In some embodiments, the device for evaluating concentration ability includes: an evaluation device body; an apparatus for evaluating concentration ability based on visual-auditory mixed modulation as described above, installed on the evaluation device body; or a system for evaluating concentration ability based on visual-auditory mixed modulation as described above, installed on the evaluation device body.

[0019] The method, apparatus, system and evaluation device for evaluating concentration ability based on visual-auditory mixed modulation provided by the embodiments of the present disclosure can achieve the following technical effects:

[0020] In the disclosed embodiment, by designing interactive tasks containing visual and auditory components, the EEG response of the subject to be tested is induced, and an objective evaluation of the ability to concentrate is achieved. First, a series of interactive tasks are generated by using visual frequency targets and auditory frequency targets in combination with task prompts. When the subject to be tested performs the task, it is necessary to process visual and auditory information at the same time to test the subject's ability to concentrate. Compared with the related art, the disclosed embodiment is not affected by the subjective influence of the individual, and the ability is evaluated based on real-time EEG signals, combined with the EEG response induced by visual and auditory mixed modulation. In addition, the EEG response induced by the interactive task is used to quantify the performance of the subject to be tested in the interactive task, and a more specific evaluation result is obtained, which realizes a more accurate evaluation of the subject's ability to concentrate.

[0021] The above general description and the following description are exemplary and explanatory only and are not intended to limit the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] One or more embodiments are exemplarily described by corresponding drawings, which do not limit the embodiments. Elements with the same reference numerals in the drawings are shown as similar elements, and the drawings do not constitute a scale limitation, and wherein:

[0023] Figure 1 is a schematic diagram of an implementation environment of a method for assessing concentration ability based on visual-auditory mixed modulation according to an embodiment of the present disclosure;

[0024] Figure 2 is a schematic diagram of a method for assessing concentration ability based on visual-auditory mixed modulation provided by an embodiment of the present disclosure;

[0025] Figure 3 is a schematic diagram of another method for assessing concentration ability based on visual-auditory mixed modulation provided by an embodiment of the present disclosure;

[0026] Figure 4 is a schematic diagram of another method for assessing concentration ability based on visual-auditory mixed modulation provided by an embodiment of the present disclosure;

[0027] Figure 5is a schematic diagram of a device for assessing concentration ability based on visual and auditory mixed modulation provided by an embodiment of the present disclosure;

[0028] Figure 6 It is a schematic diagram of a system for evaluating concentration ability based on visual and auditory mixed modulation provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0029] In order to be able to understand the features and technical contents of the embodiments of the present disclosure in more detail, the implementation of the embodiments of the present disclosure is described in detail below in conjunction with the accompanying drawings. The attached drawings are for reference only and are not used to limit the embodiments of the present disclosure. In the following technical description, for the convenience of explanation, a full understanding of the disclosed embodiments is provided through multiple details. However, one or more embodiments can still be implemented without these details. In other cases, to simplify the drawings, well-known structures and devices can be simplified for display.

[0030] The terms "first", "second", etc. in the technical solutions described in the embodiments of the present disclosure are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchanged where appropriate, so as to describe the embodiments of the present disclosure described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions.

[0031] Unless otherwise stated, the term "plurality" means two or more.

[0032] In the embodiment of the present disclosure, the character " / " indicates that the preceding and following objects are in an "or" relationship. For example, A / B indicates: A or B.

[0033] The term "and / or" is a description of the association relationship between objects, indicating that three relationships can exist. For example, A and / or B means: A or B, or, A and B.

[0034] The term "correspondence" may refer to an association relationship or a binding relationship. The correspondence between A and B means that there is an association relationship or a binding relationship between A and B.

[0035] Brain-computer interface (BCI) is a new communication and control channel established between the brain and the external environment that does not rely on peripheral nerves and muscles, and can realize direct interaction between the brain and external devices.

[0036] Traditional concentration ability assessment usually uses scales and behavioral methods, which are easily affected by user subjective factors and expert judgment experience. The disclosed embodiment can achieve objective assessment of the user's concentration ability from multiple physiological induced response perspectives through visual and auditory mixed task modulation.

[0037] Among them, the basic principles of mixed visual and auditory task modulation are as follows:

[0038] When the human eye is annotated with a flickering light of fixed frequency f1, the visual cortex will produce an evoked response with the same frequency as f1, which is the steady-state visual evoked potential (SSVEP). When the hearing continuously receives periodic auditory stimulation of fixed frequency f2, the auditory cortex will produce an evoked response with the same frequency as f2, which is the auditory steady state response (ASSR).

[0039] When the human eye notices the flickering light of f1 and the hearing continues to receive periodic auditory stimulation of a fixed frequency f2, a cross-modulation frequency response of f1 and f2 (a*f1+b*f2, a and b are integers between -5 and 5) will be generated between the visual and auditory response areas. Usually, the (f1+f2) or (|f1–f2|) response is stronger. This cross-modulation response is the basic principle of “mixed visual and auditory task modulation”.

[0040] Based on the above basic principles, a combination of visual and auditory modulation tasks can be designed to detect the intensity of the cross-modulation frequency response of f1 and f2, and then judge the user's concentration ability.

[0041] Figure 1 Schematic diagram of the implementation environment of the method for assessing concentration ability based on visual and auditory mixed modulation according to an embodiment of the present disclosure. Figure 1 As shown, the implementation environment may include a processor 500 , a task database 100 , and an EEG cap 200 .

[0042] Among them, the task database 100 stores relevant task materials for concentration ability assessment. For example, videos, images, texts, audios, etc. that match the cognitive abilities of different age groups are used to keep users focused. The materials and task trial combinations in the task database 100 are all derived from expert recommendations and classic literature in the field. The task database 100 can be continuously expanded according to application needs in actual applications.

[0043] The EEG cap 200 can collect the EEG response of the subject to be tested through different collection methods such as wet electrodes, dry electrodes or semi-dry electrodes. The subject to be tested completes the corresponding visual and auditory mixed modulation interaction task. The EEG cap 200 will synchronously collect the EEG signal and transmit it to the processor 500. The processor 500 will perform real-time analysis on the EEG signal of the subject to be tested and finally give the concentration ability evaluation result of the subject to be tested.

[0044] Combination Figure 2As shown, the embodiment of the present disclosure provides a method for evaluating concentration ability based on visual-auditory mixed modulation, including:

[0045] S201, the processor generates an interactive task for evaluating concentration ability using visual frequency targets, auditory frequency targets, and task prompts.

[0046] S202, the processor collects the electroencephalogram (EEG) response induced by the subject to be tested based on the interactive task; wherein the EEG response includes a visual steady-state response, an auditory steady-state response, and a visual-auditory cross-modulation frequency response.

[0047] S203, the processor scores the interactive task according to the electroencephalogram response induced by the interactive task to evaluate the concentration ability of the subject to be tested.

[0048] The method for evaluating concentration ability based on visual-auditory mixed modulation provided by the embodiment of the present disclosure is adopted. By designing interactive tasks containing visual and auditory components, the EEG response of the subject to be tested is induced, and an objective evaluation of the concentration ability is achieved. First, a series of interactive tasks are generated by using visual frequency targets and auditory frequency targets in combination with task prompts. When the subject to be tested performs the task, it is necessary to process visual and auditory information at the same time to test the concentration ability of the subject to be tested. Compared with the related art, the embodiment of the present disclosure is not affected by the subjective influence of the individual. It is based on real-time EEG signals and combines the EEG response induced by visual and auditory mixed modulation to evaluate the ability. In addition, the EEG response induced by the interactive task is used to quantify the performance of the subject to be tested in the interactive task, and a more specific evaluation result is obtained, which realizes a more accurate evaluation of the concentration ability of the subject to be tested.

[0049] Optionally, an interactive task for assessing concentration ability is generated using visual frequency targets, auditory frequency targets and task prompts, including: using 2 visual frequency targets, 1 auditory frequency target and 1 auditory task prompt as an interactive task; and / or using 1 visual frequency target, 2 auditory frequency targets and 1 visual task prompt as an interactive task.

[0050] Combination Figure 3 As shown, the embodiment of the present disclosure provides another method for assessing concentration ability based on visual-auditory mixed modulation, including:

[0051] S301, the processor takes 2 visual frequency targets, 1 auditory frequency target and 1 auditory task prompt as an interactive task; and / or takes 1 visual frequency target, 2 auditory frequency targets and 1 visual task prompt as an interactive task.

[0052] S302, the processor collects the electroencephalogram (EEG) response induced by the subject to be tested based on the interactive task; wherein the EEG response includes a visual steady-state response, an auditory steady-state response, and a visual-auditory cross-modulation frequency response.

[0053] S303, the processor scores the interactive task according to the electroencephalogram response induced by the interactive task to evaluate the concentration ability of the subject to be tested.

[0054] In the disclosed embodiment, an interactive task is designed by visual frequency targets, auditory frequency targets and task prompts, and the individual's concentration ability is evaluated by combining visual and auditory stimulation and task prompts. Specifically, first, steady-state visual evoked potentials are induced by displaying two visual targets that flash at different frequencies, and an audio played at a fixed frequency is played as an auditory stimulus to induce an auditory steady-state response. In addition, through auditory task prompts, such as voice instructions, the subject to be tested is guided to switch attention between different visual targets, thereby generating a cross-modulation frequency response in the EEG signal. Alternatively, a visual frequency target and two auditory frequency targets can be used, supplemented by visual task prompts to perform the evaluation. During the execution of the task, the EEG signal of the subject to be tested is collected in real time, and the response frequency of the visual and auditory stimuli and the intensity of the visual-auditory cross-modulation frequency response are analyzed. In this way, the measurement of concentration ability based on physiological responses can make the evaluation results more objective.

[0055] Optionally, two visual frequency targets, one auditory frequency target and one auditory task prompt are used as interactive tasks, including: controlling the two visual frequency targets to flash at a first visual frequency and a second visual frequency respectively; controlling the auditory frequency target to play at a first auditory frequency; executing the auditory task prompt during the playing of the auditory frequency target so that the subject to be tested obtains the auditory task; wherein, the auditory task uses any one of the two visual frequency targets as a prompt target that the subject to be tested needs to pay attention to, and the other visual frequency target as a non-prompt target.

[0056] In an embodiment of the present disclosure, two visual stimulation targets are controlled to flash at a first visual frequency and a second visual frequency, respectively, and an audio played at a fixed first auditory frequency is played as an auditory stimulus. During the playback of the auditory stimulation, the subject to be tested is guided to focus on one of the two visual targets, namely the prompt target, through auditory task prompts, such as voice instructions, and the other becomes a non-prompt target. The subject to be tested needs to switch its attention between the two visual targets according to the auditory task prompts, thereby generating a steady-state response related to the visual and auditory stimulation frequencies in the EEG signal. By analyzing the EEG signals of the subject to be tested when performing the task, especially the intensity of the visual and auditory cross-modulation frequency responses, the subject's ability to concentrate can be evaluated. In this way, the ability to concentrate can be more accurately identified and quantified, and customized training programs can be provided for individuals to improve cognitive function.

[0057] In actual applications, there are two visual frequency targets on the screen, visual frequency target 1 flashes at a frequency of f1, and visual frequency target 2 flashes at a frequency of f2.

[0058] In the headphones, an audio with a constant frequency of f3 is played continuously. At the same time, a task voice prompt task (including "Please focus your attention on the left visual frequency target 1", "Please focus your attention on the right visual frequency target 2") will appear once every few seconds in the audio. The probability of the two voice prompt tasks appearing is completely random.

[0059] The subjects were required to focus their attention on the corresponding visual frequency target according to the voice prompts heard through the headphones.

[0060] Optionally, one visual frequency target, two auditory frequency targets and one visual task prompt are used as interactive tasks, including: controlling the two auditory frequency targets to play at a first auditory frequency and a second auditory frequency respectively; controlling the visual frequency target to flash at the first visual frequency; executing the visual task prompt during the flashing of the visual frequency target so that the subject to be tested obtains the visual task; wherein, the visual task uses any one of the two auditory frequency targets as a prompt target that the subject to be tested needs to pay attention to, and the other auditory frequency target as a non-prompt target.

[0061] In the disclosed embodiment, two auditory stimulation targets are controlled to play at a first auditory frequency and a second auditory frequency respectively, and a visual stimulation target is controlled to flash at a fixed first visual frequency. During the flashing of the visual stimulation target, the subject to be tested is guided to focus on one of the two auditory targets, i.e., the prompt target, through visual task prompts, such as text or images on the screen, while the other becomes a non-prompt target. The subject to be tested needs to switch its attention between the two auditory targets according to the visual task prompts, thereby generating a steady-state response related to the auditory and visual stimulation frequencies in the EEG signal. By analyzing the EEG signals of the subject to be tested when performing the task, especially the intensity of the auditory and visual cross-modulation frequency responses, the subject's ability to concentrate can be evaluated and quantified.

[0062] In actual application, there is a visual frequency target on the screen, which flashes at a frequency of f1. At the same time, a text task prompt (including "Please focus on the auditory frequency target 1 of the left ear" and "Please focus on the auditory frequency target 2 of the right ear") will appear in the center of the visual frequency target every few seconds, and the probability of the two text task prompts appearing is completely random.

[0063] In the earphones, the left earphone plays audio with a constant frequency of f2, and the right earphone plays audio with a constant frequency of f3.

[0064] The subjects need to concentrate their attention on the corresponding auditory frequency target according to the text task prompts seen on the screen.

[0065] Optionally, the interactive task is scored based on the EEG response induced by the interactive task, including: judging whether the subject to be tested correctly performs the task prompt based on the frequency of the visual steady-state response or the frequency of the auditory steady-state response in the EEG response, so as to score the task prompt; if the subject to be tested does not correctly perform the task prompt, the interactive task is scored as zero; if the subject to be tested correctly performs the task prompt, the interactive task is scored based on the intensity of the visual-auditory cross-modulation frequency EEG response.

[0066] Combination Figure 4 As shown, the embodiment of the present disclosure provides another method for assessing concentration ability based on visual-auditory mixed modulation, including:

[0067] S401, the processor generates an interactive task for evaluating concentration ability using visual frequency targets, auditory frequency targets, and task prompts.

[0068] S402, the processor collects the electroencephalogram (EEG) response induced by the subject to be tested based on the interactive task; wherein the EEG response includes a visual steady-state response, an auditory steady-state response, and a visual-auditory cross-modulation frequency response.

[0069] S403, the processor determines whether the subject to be tested correctly performs the task prompt according to the frequency of the visual steady-state response or the frequency of the auditory steady-state response in the electroencephalogram response, so as to score the task prompt.

[0070] S404: If the subject to be tested fails to correctly perform the task prompt, the processor records the interactive task as zero.

[0071] S405, when the subject to be tested correctly performs the task prompt, the processor scores the interactive task according to the intensity of the visual-auditory cross-modulation frequency electroencephalogram response.

[0072] In the disclosed embodiment, the ability to concentrate when performing interactive tasks is scored by analyzing the EEG response. First, the visual steady-state response frequency or the auditory steady-state response frequency in the EEG response is used to determine whether the subject to be tested has correctly executed the task prompt. For example, the task prompt requires the subject to be tested to focus on the left visual target. If the subject to be tested correctly executes the task prompt, the amplitude of the corresponding visual or auditory steady-state response frequency will increase, indicating that the subject to be tested has successfully focused on the specified target. If the subject to be tested does not correctly execute the task prompt, the interactive task will be scored as zero.

[0073] If the subject performs the task prompt correctly, the interactive task is scored based on the strength of the visual-auditory cross-modulation frequency response in the EEG response. The visual-auditory cross-modulation frequency response is the result of the interaction between visual and auditory stimuli in the brain, and its strength is closely related to the subject's ability to concentrate. By analyzing the strength of the cross-modulation frequency response, the subject's degree of concentration when performing the task can be quantified.

[0074] Optionally, whether the subject to be tested correctly performs the task prompt is judged according to the frequency of the visual steady-state response or the frequency of the auditory steady-state response in the EEG response to score the task prompt, including: if the frequency of the visual steady-state response induced by the non-cue target is higher than or equal to the frequency of the visual steady-state response induced by the cue target, or the frequency of the auditory steady-state response induced by the non-cue target is higher than or equal to the frequency of the auditory steady-state response induced by the cue target, then it is judged that the subject to be tested has not correctly performed the task prompt; if the frequency of the visual steady-state response induced by the non-cue target is lower than the frequency of the visual steady-state response induced by the cue target, or the frequency of the auditory steady-state response induced by the non-cue target is lower than the frequency of the auditory steady-state response induced by the cue target, then it is judged that the subject to be tested correctly performs the task prompt.

[0075] In the disclosed embodiment, the execution of the task prompt is evaluated by analyzing the visual and auditory steady-state evoked potentials in the EEG response. First, the visual steady-state response of the subject to be tested is induced by the visual stimulation target, and the auditory steady-state response is induced by the auditory stimulation target. Then, according to the task prompt, the subject to be tested needs to focus on a specific visual or auditory target. During the process, the EEG signal is collected in real time, and the visual and auditory steady-state response frequencies in the signal are analyzed to determine whether the subject to be tested has correctly executed the task prompt. Specifically, if the EEG response frequency associated with the non-prompt target is higher than or equal to the EEG response frequency associated with the prompt target, it is determined that the subject to be tested has not correctly executed the task prompt, and the task is scored zero. On the contrary, if the EEG response frequency associated with the prompt target is higher than the EEG response frequency associated with the non-prompt target, it is determined that the subject to be tested has correctly executed the task prompt, and then the task execution is scored according to the intensity of the cross-modulation frequency response.

[0076] Optionally, the interactive task is scored according to the intensity of the visual-auditory cross-modulation frequency EEG response, including: comparing the intensity of the cross-modulation frequency response with a score comparison table to obtain a score corresponding to the intensity of the cross-modulation frequency response as the score of the interactive task.

[0077] In the disclosed embodiment, the interactive task is scored by analyzing the cross-modulation frequency response strength in the EEG response, and the EEG signal of the subject to be tested is collected in real time when the subject to be tested performs the interactive task involving visual and auditory stimulation. The cross-modulation frequency response induced by visual and auditory stimulation in the EEG signal is a biomarker for measuring the concentration ability of the subject to be tested. The collected EEG signal is preprocessed, including filtering, denoising and artifact removal, to extract the intensity information of the cross-modulation frequency response. Then, the extracted cross-modulation frequency response intensity is compared with a score comparison table obtained by constructing a model based on large sample training. The comparison table is based on the data of a large number of subjects to be tested and corresponds the response intensity to the concentration ability score. Finally, according to the comparison table, the cross-modulation frequency response intensity of the subject to be tested is converted into a specific score as a score for the interactive task.

[0078] In practical applications, the cross-modulation frequency response intensity (a*f1+b*f2) in the EEG response of the subject in the occipital-temporal region is analyzed. The higher the response intensity, the stronger the subject's concentration ability.

[0079] Combination Figure 5 As shown, an embodiment of the present disclosure provides a device 50 for evaluating concentration ability based on visual-auditory mixed modulation, including a processor (processor) 500 and a memory (memory) 501. Optionally, the device 50 may also include a communication interface (Communication Interface) 502 and a bus 503. Among them, the processor 500, the communication interface 502, and the memory 501 can communicate with each other through the bus 503. The communication interface 502 can be used for information transmission. The processor 500 can call the logic instructions in the memory 501 to execute the method for evaluating concentration ability based on visual-auditory mixed modulation of the above embodiment.

[0080] In addition, the logic instructions in the memory 501 described above can be implemented in the form of software functional units and can be stored in a computer-readable storage medium when sold or used as an independent product.

[0081] The memory 501 is a computer-readable storage medium that can be used to store software programs and computer-executable programs, such as program instructions / modules corresponding to the method in the embodiment of the present disclosure. The processor 500 executes the function application and data processing by running the program instructions / modules stored in the memory 501, that is, the method for evaluating concentration ability based on visual-auditory mixed modulation in the above embodiment is implemented.

[0082] The memory 501 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application required for at least one function; the data storage area may store data created according to the use of the terminal device, etc. In addition, the memory 501 may include a high-speed random access memory and may also include a non-volatile memory.

[0083] Combination Figure 6 As shown, the embodiment of the present disclosure provides a system 60 for evaluating concentration ability based on visual-auditory mixed modulation, including a task interaction terminal 601, a brain signal acquisition terminal 602, and a brain signal analysis and processing terminal 603. The task interaction terminal 601 is configured to generate an interactive task for evaluating concentration ability using visual frequency targets, auditory frequency targets, and task prompts. The brain signal acquisition terminal 602 is configured to collect the electroencephalogram (EEG) responses induced by the subject to be tested based on the interactive task; wherein the EEG responses include visual steady-state responses, auditory steady-state responses, and visual-auditory cross-modulation frequency responses. The brain signal analysis and processing terminal 603 is configured to score the interactive task based on the electroencephalogram (EEG) responses induced based on the interactive task to evaluate the concentration ability of the subject to be tested.

[0084] At the beginning of the assessment, the required material library is selected from the task database according to the basic situation of the subject to be tested (or the subject to be tested is prompted by the information options given by the task interaction terminal). The task interaction terminal 601 processes the material based on the principle of visual and auditory mixed task modulation. For example, a flashing light with a brightness changing at a frequency of f1 is superimposed on the video background; an audio with a frequency of f2 is superimposed on the audio background, and a set of interactive tasks with the subject to be tested is formed (the interactive tasks include two modes and multiple groups of random order).

[0085] The task interaction terminal 601 can select VR headsets, AR glasses or high refresh rate displays according to the actual scene requirements, and can be equipped with a desktop computer or mobile phone to run the interactive program. The visual interaction tasks (images, videos, text, etc.) that need to be observed by the object to be tested can be displayed in sequence on the screen, and the audio is also played synchronously. Each video combined with auditory audio (or image, text combined with audio) is regarded as a task trial, and the user can be given time to adjust between each two trials as needed. The specific number of completed trials is set according to the different task groups in the task database.

[0086] The brain signal acquisition terminal 602 acquires the EEG signals of the subject in real time during the visual and auditory mixed modulation attention interaction task, and simultaneously records the start time and end time of each interactive task sent by the task interaction terminal 601, and finally transmits them to the brain signal analysis and processing terminal 603. The brain signal acquisition can be adapted to different acquisition methods (wet electrode, dry electrode or semi-dry electrode) of the EEG cap and EEG acquisition equipment according to the scene requirements.

[0087] The brain signal analysis and processing terminal 603 processes and analyzes the data transmitted by the brain signal acquisition terminal 602 .

[0088] The embodiments of the present disclosure provide an evaluation device for the ability to concentrate, including: an evaluation device body, and the above-mentioned apparatus for evaluating the ability to concentrate based on visual-auditory mixed modulation. The apparatus for evaluating the ability to concentrate based on visual-auditory mixed modulation is installed on the evaluation device body. The installation relationship described here is not limited to placement inside the evaluation device body, but also includes installation connections with other components of the evaluation device, including but not limited to physical connections, electrical connections, or signal transmission connections. Those skilled in the art can understand that the apparatus for evaluating the ability to concentrate based on visual-auditory mixed modulation can be adapted to a feasible evaluation device body, thereby realizing other feasible embodiments.

[0089] The technical solution of the embodiment of the present disclosure can be embodied in the form of a software product, which is stored in a storage medium and includes one or more instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the method described in the embodiment of the present disclosure. The aforementioned storage medium may be a non-transient storage medium, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk, and other media that can store program codes.

[0090] The above description and the accompanying drawings fully illustrate the embodiments of the present disclosure so that those skilled in the art can practice them. Other embodiments may include structural, logical, electrical, process and other changes. The embodiments represent only possible changes. Unless explicitly required, separate components and functions are optional, and the order of operation may vary. The parts and features of some embodiments may be included in or replace the parts and features of other embodiments. Moreover, the words used in this application are only used to describe the embodiments and are not used to limit the claims. As used in the description of the embodiments and the claims, unless the context clearly indicates, the singular forms of "a", "an" and "the" are intended to include plural forms as well. Similarly, the term "and / or" as used in this application refers to any and all possible combinations of listings containing one or more associated ones. In addition, when used in the present application, the term "comprise" and its variants "comprises" and / or comprising refer to the presence of stated features, wholes, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or groups thereof. In the absence of further restrictions, the elements defined by the sentence "comprising a ..." do not exclude the presence of other identical elements in the process, method or device comprising the elements. In this article, each embodiment may focus on the differences from other embodiments, and the same and similar parts between the various embodiments may refer to each other. For the methods, products, etc. disclosed in the embodiments, if they correspond to the method part disclosed in the embodiments, then the relevant parts can refer to the description of the method part.

[0091] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software may depend on the specific application and design constraints of the technical solution. The technicians may use different methods for each specific application to implement the described functions, but such implementations should not be considered to exceed the scope of the embodiments of the present disclosure. The technicians may clearly understand that, for the convenience and simplicity of description, the specific working processes of the systems, devices and units described above may refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.

[0092] In the embodiments disclosed herein, the disclosed methods and products (including but not limited to devices, equipment, etc.) can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units can be only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between each other shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms. The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to implement this embodiment. In addition, each functional unit in the embodiment of the present disclosure may be integrated in a processing unit, or each unit may exist physically alone, or two or more units may be integrated in one unit.

[0093] The flowchart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to the embodiment of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of the code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. In some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, which can depend on the functions involved. In the description corresponding to the flowchart and the block diagram in the accompanying drawings, the operations or steps corresponding to different boxes can also occur in a different order from the order disclosed in the description, and sometimes there is no specific order between different operations or steps. For example, two consecutive operations or steps can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, which can depend on the functions involved. Each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented by a dedicated hardware-based system that performs the specified functions or actions, or may be implemented by a combination of dedicated hardware and computer instructions.

Claims

1. A method for evaluating concentration ability based on visual and auditory mixed modulation, characterized in that: include: Generate interactive tasks that assess attention ability using visual frequency targets, auditory frequency targets, and task cues; Collecting the EEG response induced by the subject under test based on the interactive task; wherein the EEG response includes visual steady-state response, auditory steady-state response and visual-auditory cross-modulation frequency response; The interactive tasks were scored based on the EEG responses evoked by the interactive tasks to assess the subjects' ability to concentrate.

2. The method according to claim 1, characterized in that Use visual frequency targets, auditory frequency targets, and task prompts to generate interactive tasks that assess attention ability, including: Use 2 visual frequency targets, 1 auditory frequency target, and 1 auditory task cue as an interactive task; and / or, One visual frequency target, two auditory frequency targets, and one visual task cue were used as the interactive task.

3. The method according to claim 2, characterized in that Two visual frequency targets, one auditory frequency target, and one auditory task cue were used as the interactive task, including: Controlling two visual frequency targets to flash at a first visual frequency and a second visual frequency respectively; Controlling the auditory frequency target to play at the first auditory frequency; During the playback of the auditory frequency target, an auditory task prompt is performed so that the subject to be tested obtains the auditory task; wherein, the auditory task uses any one of the two visual frequency targets as a prompt target that the subject to be tested needs to pay attention to, and the other visual frequency target as a non-prompt target.

4. The method according to claim 2, characterized in that: The interactive task consisted of 1 visual frequency target, 2 auditory frequency targets, and 1 visual task cue, including: Controlling two auditory frequency targets to play at a first auditory frequency and a second auditory frequency respectively; Controlling the visual frequency target to flash at a first visual frequency; A visual task prompt is performed during the flashing of the visual frequency target so that the subject to be tested can obtain the visual task; wherein, the visual task uses any one of the two auditory frequency targets as a prompt target that the subject to be tested needs to pay attention to, and the other auditory frequency target as a non-prompt target.

5. The method according to any one of claims 1 to 4, characterized in that: Interactive tasks were scored based on the EEG responses evoked by the interactive tasks, including: Judging whether the subject performs the task prompt correctly according to the frequency of the visual steady-state response or the frequency of the auditory steady-state response in the EEG response, so as to score the task prompt; In the case where the subject did not correctly perform the task prompt, the interactive task was scored as zero; When the subjects correctly performed the task prompts, the interactive task was scored based on the strength of the visual-auditory cross-modulation frequency EEG response.

6. The method according to claim 5, characterized in that According to the frequency of the visual steady-state response or the frequency of the auditory steady-state response in the EEG response, it is judged whether the subject to be tested correctly performs the task prompt, so as to score the task prompt, including: If the frequency of the visual steady-state response induced by the non-cue target is higher than or equal to the frequency of the visual steady-state response induced by the cue target, or the frequency of the auditory steady-state response induced by the non-cue target is higher than or equal to the frequency of the auditory steady-state response induced by the cue target, it is determined that the subject has not correctly performed the task prompt; If the frequency of the visual steady-state response induced by the non-cue target is lower than the frequency of the visual steady-state response induced by the cued target, or the frequency of the auditory steady-state response induced by the non-cue target is lower than the frequency of the auditory steady-state response induced by the cued target, then it is determined that the subject has correctly performed the task prompt.

7. The method according to claim 5, characterized in that Interaction tasks were scored based on the strength of the visual-auditory cross-modulation frequency EEG response, including: The intensity of the cross-modulation frequency response is compared with the score comparison table, and the score corresponding to the intensity of the cross-modulation frequency response is obtained as the score of the interactive task.

8. A device for assessing concentration ability based on visual-auditory mixed modulation, comprising a processor and a memory storing program instructions, characterized in that: The processor is configured to execute the method for assessing concentration ability based on visual-auditory mixed modulation as described in any one of claims 1 to 7 when running the program instructions.

9. A system for assessing concentration ability based on visual and auditory mixed modulation, characterized in that: include: a task interaction terminal configured to generate an interactive task for assessing concentration ability using a visual frequency target, an auditory frequency target, and a task prompt; A brain signal acquisition terminal is configured to acquire the electroencephalogram (EEG) response induced by the subject to be tested based on the interactive task; wherein the EEG response includes a visual steady-state response, an auditory steady-state response, and a visual-auditory cross-modulation frequency response; The brain signal analysis and processing terminal is configured to score the interactive task based on the electroencephalographic response induced by the interactive task to evaluate the concentration ability of the subject to be tested.

10. A device for assessing concentration ability, characterized in that: include: Evaluate the equipment itself; The device for assessing concentration ability based on visual and auditory mixed modulation as claimed in claim 8, installed in the assessment device body; Or, the system for evaluating concentration ability based on visual and auditory mixed modulation as described in claim 9 is installed in the evaluation device body.

Images