A cognitive level assessment method, system, and electronic device

Abstract

The application relates to a cognitive level evaluation method, system and electronic device, wherein the method comprises the following steps: obtaining simulation task execution data of a subject operator in the process of executing a simulation task, obtaining a first cognitive level evaluation result according to the simulation task execution data; obtaining questionnaire data and reaction task data, obtaining a second cognitive level evaluation result according to the questionnaire data and the reaction task data; obtaining physiological data of the subject operator, obtaining a third cognitive level evaluation result according to the physiological data; and evaluating the cognitive level of the subject operator according to the first cognitive level evaluation result, the second cognitive level evaluation result and the third cognitive level evaluation result. The cognitive level evaluation method provided by the application can accurately and comprehensively evaluate the cognitive level of the operator and can improve the real-time performance of the cognitive level evaluation of the operator.

Description

Technical Field

[0001] This application relates to the field of human factors safety experiments, and more particularly to a cognitive level assessment method, system, and electronic device. Background Technology

[0002] Cognitive level reflects the ability to process information, mainly including judgment, thinking ability, and knowledge reserves. Cognitive level is a crucial support for frontline operators in production units to ensure the safe and stable operation of production unit systems, especially in high-risk areas like nuclear power. Accurate and comprehensive cognitive level assessments of nuclear power plant operators can effectively understand their on-duty status, reduce the possibility of missed information and erroneous operations, identify weaknesses in operator operations during routine maintenance and accident handling, and make targeted improvements, thus effectively enhancing production safety. Current cognitive level assessment methods can only provide a non-real-time, general, and indirect evaluation of operators' cognitive abilities. They lack objectivity and real-time accuracy, cannot understand the internal factors that impair operators' cognitive abilities, and are difficult to effectively implement corresponding measures to improve operators' cognitive levels. Summary of the Invention

[0003] In view of this, this application proposes a cognitive level assessment method, system, electronic device, and storage medium that can accurately and comprehensively assess the cognitive level of an operator and improve the real-time performance of the operator's cognitive level assessment.

[0004] According to one aspect of this application, a method for assessing cognitive level is provided. The method includes: acquiring simulation task execution data of a subject manipulator during the execution of a simulated task; obtaining a first cognitive level assessment result based on the simulation task execution data; wherein the simulated task is a task simulating an accident scenario; acquiring questionnaire data and response task data; obtaining a second cognitive level assessment result based on the questionnaire data and the response task data; wherein the questionnaire data is obtained by the subject manipulator completing a questionnaire; and the response task data is obtained by the subject manipulator performing a response task; the response task is used to assess the subject manipulator based on their response to a given stimulus or instruction; acquiring physiological data of the subject manipulator; obtaining a third cognitive level assessment result based on the physiological data; and assessing the cognitive level of the subject manipulator based on the first cognitive level assessment result, the second cognitive level assessment result, and the third cognitive level assessment result.

[0005] In one possible implementation, the simulation task includes at least one of a monitoring subtask, an inspection subtask, a response subtask, and a communication subtask; wherein the monitoring subtask is used to assess the monitoring and awareness abilities of the subject manipulator; the inspection subtask is used to assess the comprehension and understanding abilities of the subject manipulator; the response subtask is used to assess the decision-making and action abilities of the subject manipulator; and the communication subtask is used to assess the teamwork abilities of the subject manipulator.

[0006] In one possible implementation, the simulated task execution data includes at least one of the following: task completion rate, task completion time, and number of erroneous operations.

[0007] In one possible implementation, the questionnaire includes at least one of a situational awareness questionnaire, a workload questionnaire, and a somatosensory assessment questionnaire; wherein the situational awareness questionnaire is used to assess the situational awareness ability of the subject operator; the workload questionnaire is used to assess the workload of the subject operator; and the somatosensory assessment questionnaire is used to assess the adaptability of the subject operator in an accident environment.

[0008] In one possible implementation, the response task includes at least one of a mental alertness task, a Stroop task, a connect-the-dots task, an addition task, a typing task, an N-back task, and a balloon-simulated risk task; wherein the mental alertness task is used to assess the subject's monitoring and awareness abilities; the Stroop task is used to assess the subject's comprehension and intuitive abilities; the connect-the-dots task is used to assess the subject's visual search abilities; the addition task is used to assess the subject's computational abilities; the typing task is used to assess the subject's perceptual control abilities; the N-back task is used to assess the subject's working memory abilities; and the balloon-simulated risk task is used to assess the subject's risk tolerance.

[0009] In one possible implementation, the physiological data includes at least one of electrocardiogram (ECG) data, cerebral oxygenation data, and eye movement data; wherein the ECG data is used to assess the neural activity of the subject manipulator; the cerebral oxygenation data is used to assess the energy metabolism of the subject manipulator; and the eye movement data is used to assess the visual search ability of the subject manipulator.

[0010] In one possible implementation, the physiological data includes electrocardiogram (ECG) data, cerebral oxygenation data, and eye movement data; obtaining the third cognitive level assessment result based on the physiological data includes: performing ECG data analysis on the ECG data to obtain a neural activity assessment result; the ECG data analysis includes at least one of time-domain analysis, frequency-domain analysis, and time-frequency analysis; analyzing the cerebral oxygenation data to obtain an energy metabolism assessment result; the cerebral oxygenation data includes task-state cerebral oxygenation data and resting-state cerebral oxygenation data; analyzing the cerebral oxygenation data includes: fitting a generalized linear model to the task-state cerebral oxygenation data, and / or performing functional connectivity analysis on the resting-state cerebral oxygenation data; analyzing the eye movement data to obtain a visual search ability assessment result; the eye movement data includes at least one of pupillary change data, eye movement thermograms, fixation indices, and saccade indices; and obtaining the third cognitive level assessment result based on the neural activity assessment result, the energy metabolism assessment result, and the visual search ability assessment result.

[0011] According to another aspect of this application, a cognitive level assessment system is provided, the system comprising: a first assessment module, configured to acquire simulation task execution data of a subject manipulator during the execution of a simulated task, and obtain a first cognitive level assessment result based on the simulation task execution data; wherein the simulated task is a task in a simulated accident scenario; a second assessment module, configured to acquire questionnaire data and response task data, and obtain a second cognitive level assessment result based on the questionnaire data and the response task data; wherein the questionnaire data is obtained by the subject manipulator completing a questionnaire; and the response task data is obtained by the subject manipulator performing a response task; the response task is used to assess the subject manipulator based on their response to a given stimulus or instruction; a third assessment module, configured to acquire physiological data of the subject manipulator, and obtain a third cognitive level assessment result based on the physiological data; and a cognitive level assessment module, configured to assess the cognitive level of the subject manipulator based on the first cognitive level assessment result, the second cognitive level assessment result, and the third cognitive level assessment result.

[0012] According to another aspect of this application, a cognitive level assessment system is provided, the system comprising: a stimulus presentation device for: presenting a simulated task, a questionnaire, and a response task to a subject manipulator; the simulated task being a task simulating an accident scenario; the response task being used to assess the subject manipulator based on their response to a given stimulus or instruction; acquiring simulated task execution data of the subject manipulator during the execution of the simulated task, and obtaining a first cognitive level assessment result based on the simulated task execution data; acquiring questionnaire data and response task data, and obtaining a second cognitive level assessment result based on the questionnaire data and the response task data; the questionnaire data being obtained by the subject manipulator completing a questionnaire; the response task data being obtained by the subject manipulator performing a response task; a physiological monitoring device for acquiring physiological data of the subject manipulator, and obtaining a third cognitive level assessment result based on the physiological data; the physiological monitoring device further for transmitting the third cognitive level assessment result to the stimulus presentation device; the stimulus presentation device further for: receiving the third cognitive level assessment result; and assessing the cognitive level of the subject manipulator based on the first cognitive level assessment result, the second cognitive level assessment result, and the third cognitive level assessment result.

[0013] According to another aspect of this application, an electronic device is provided, comprising: a processor; a memory for storing processor-executable instructions; wherein the processor is configured to implement the above-described cognitive level assessment method when executing instructions stored in the memory.

[0014] According to another aspect of this application, a non-volatile computer-readable storage medium is provided, on which computer program instructions are stored, wherein the computer program instructions, when executed by a processor, implement the above-described cognitive level assessment method.

[0015] According to another aspect of this application, a computer program product is provided, including computer-readable code, or a non-volatile computer-readable storage medium carrying computer-readable code, wherein when the computer-readable code is run in a processor of an electronic device, the processor in the electronic device performs the above-described cognitive level assessment method.

[0016] The cognitive level assessment method provided in this application integrates task performance, self-assessment, response testing, and physiological monitoring to quantitatively assess the operator's cognitive level from three aspects: task performance, cognitive ability, and physiological activity. This method can accurately and comprehensively assess the operator's cognitive level, improving the comprehensiveness and reliability of the cognitive level assessment. Furthermore, the cognitive level assessment method provided in this application can acquire simulated task execution data, questionnaire data, response task data, and physiological data in real time. By assessing the operator's cognitive level based on this real-time data, the real-time performance of the cognitive level assessment can be improved.

[0017] Other features and aspects of this application will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0018] The accompanying drawings, which are included in and form part of this specification, illustrate exemplary embodiments, features, and aspects of this application together with the specification and serve to explain the principles of this application.

[0019] Figure 1 A flowchart illustrating a cognitive level assessment method according to an embodiment of this application is shown.

[0020] Figure 2 A schematic diagram of a cognitive level assessment method according to an embodiment of this application is shown.

[0021] Figure 3 A schematic diagram of the structure of a cognitive level assessment system according to an embodiment of this application is shown.

[0022] Figure 4 A schematic diagram of the structure of a cognitive level assessment system according to an embodiment of this application is shown.

[0023] Figure 5 A schematic diagram of a cognitive level assessment system according to an embodiment of this application is shown.

[0024] Figure 6 A block diagram of an electronic device 1900 according to an embodiment of this application is shown. Detailed Implementation

[0025] Various exemplary embodiments, features, and aspects of this application will now be described in detail with reference to the accompanying drawings. The same reference numerals in the drawings denote elements that have the same or similar functions. Although various aspects of the embodiments are shown in the drawings, they are not necessarily drawn to scale unless specifically indicated otherwise.

[0026] The term “exemplary” as used herein means “serving as an example, embodiment, or illustration.” Any embodiment illustrated herein as “exemplary” is not necessarily to be construed as superior to or better than other embodiments.

[0027] Furthermore, to better illustrate this application, numerous specific details are provided in the following detailed embodiments. Those skilled in the art should understand that this application can be implemented without certain specific details. In some instances, methods, means, components, and circuits well-known to those skilled in the art have not been described in detail in order to highlight the main points of this application.

[0028] Accurate and comprehensive cognitive assessment of nuclear power plant operators can effectively improve the production safety of nuclear power plants. Traditional cognitive assessments often rely on self-assessment, peer observation, and response task evaluation, providing non-real-time and general indirect evaluations of operators' cognitive abilities. These methods lack objectivity, real-time accuracy, and physiological support, failing to understand the internal factors and physiological mechanisms underlying cognitive impairment in operators, and making it difficult to take effective measures to improve their cognitive levels.

[0029] With the increasing lightweighting of physiological monitoring methods and the deepening research into the physiological mechanisms of cognitive abnormalities, it has become possible to quantitatively assess cognitive levels through physiological data monitoring. In view of this, this application provides a cognitive level assessment method that integrates task performance, self-assessment, response testing, and physiological monitoring to quantitatively assess the operator's cognitive level. This method can accurately and comprehensively assess the operator's cognitive level and improve the real-time nature of the assessment.

[0030] Figure 1 A flowchart illustrating a cognitive level assessment method according to an embodiment of this application is shown, such as... Figure 1 As shown, the method may include:

[0031] S101. Obtain simulation task execution data of the operator during the execution of the simulation task, and obtain the first cognitive level assessment result based on the simulation task execution data; the simulation task is a task in a simulated accident scenario.

[0032] For example, the environment of the main control room during a nuclear power plant accident can be simulated in the experimental chamber. This includes simulating the sound, brightness, vibration, and temperature of the main control room during an accident. The experimental chamber can be considered a virtual main control room, allowing test subjects to conduct experiments within it. The experimental chamber may include a first host computer, a first display, a first mouse, and a first keyboard.

[0033] For example, parameters on the central control system during a nuclear power plant accident can be simulated using a first host computer. The accident location can be randomly set, and the tasks that operators need to perform in the simulated accident scenario can be used as simulation tasks. Simulation tasks can include two categories: accident monitoring and detection tasks and unit load reduction operation tasks. Accident monitoring and detection tasks are for preventing, monitoring, and responding to potential accidents or abnormal situations at the nuclear power plant; unit load reduction operation tasks are for operators to reduce the reactor power level to maintain the safe and stable operation of the nuclear power plant when power demand decreases or the power grid fails during operation.

[0034] As an example, a scenario of a steam generator heat transfer tube rupture in a nuclear power plant can be simulated, with the task that the operator needs to perform in this scenario (i.e., the steam generator heat transfer tube rupture task) serving as the simulated task. As another example, a scenario of a main feedwater pipeline rupture within the containment of a nuclear power plant can be simulated, with the task that the operator needs to perform in this scenario (i.e., the main feedwater pipeline rupture within the containment task) serving as the simulated task. Both the steam generator heat transfer tube rupture task and the main feedwater pipeline rupture within the containment task fall under the category of accident monitoring and detection tasks.

[0035] For example, based on research on human error mechanisms and cognitive models of nuclear power plant operators commissioned by the U.S. Nuclear Regulatory Commission, an operator cognitive model can be established, comprising "monitoring and detection - understanding and comprehension - decision-making - action - teamwork." The simulation task can then be broken down into multiple sub-tasks based on the operator cognitive model and the accident handling operation sequence (i.e., the standard handling procedure in the event of an accident). The operator cognitive model includes four cognitive elements: monitoring and detection, understanding and comprehension, decision-making and action, and teamwork. Based on the cognitive elements corresponding to discrete events in the accident handling sequence, the simulation task can be broken down into four sub-tasks: monitoring sub-task, inspection sub-task, response sub-task, and communication sub-task.

[0036] The monitoring subtask corresponds to monitoring and detection in the operator's cognitive model. In this subtask, the operator needs to detect and report whether a control (e.g., instrument, switch, light box, status box, and other controls) or parameter (e.g., pressure, temperature, flow rate, liquid level, or material level) deviates from its normal state within a certain period of time. The inspection subtask corresponds to understanding and comprehension in the operator's cognitive model. In this subtask, the operator needs to check and confirm key controls or parameters according to the emergency plan after an emergency occurs, read the status of key controls or parameters, understand the system status they reflect and the possible types of accidents, and predict the future development trend of the system. The response subtask corresponds to decision-making and action in the operator's cognitive model. In this subtask, the operator needs to make correct control of key controls or correct adjustment of key parameters according to the emergency plan after an emergency occurs. The communication subtask corresponds to teamwork in the operator's cognitive model. In this subtask, the operator needs to report the system status and accident type to the responsible personnel after an emergency occurs and confirm that the other party has effectively received the information during the communication process. Among them, the monitoring subtask can be used to assess the operator's monitoring and awareness capabilities; the inspection subtask can be used to assess the operator's comprehension and understanding capabilities; the response subtask can be used to assess the operator's decision-making and action capabilities; and the communication subtask can be used to assess the operator's teamwork capabilities.

[0037] In one possible implementation, a simulation task may include at least one of the following: monitoring subtasks, inspection subtasks, response subtasks, and communication subtasks; that is, a simulation task may include one or more of these four subtasks. In this way, a simulation task can assess one or more of the operator's monitoring and awareness abilities, comprehension and understanding abilities, decision-making and action abilities, and teamwork abilities.

[0038] For example, a typical nuclear power plant accident scenario covering four sub-tasks can be selected as the simulation task, such as a steam generator heat transfer tube rupture scenario and a main feedwater pipeline containment rupture scenario. In this way, a single simulation task can simultaneously assess the operator's monitoring and detection capabilities, comprehension and interpretation capabilities, decision-making and action capabilities, and teamwork capabilities.

[0039] For example, a simulated task can be presented to a subject operator through a first host and a first display, and the subject operator can use a first mouse and a first keyboard to operate and perform the simulated task on the first host.

[0040] The simulated task execution data refers to the data collected during the simulation task performed by the subject operator, which is related to the completion of the simulated task.

[0041] In one possible implementation, the simulated task execution data may include at least one of the following: task completion rate, task completion time, and number of erroneous operations.

[0042] For example, a simulated task can be broken down into multiple subtasks, each belonging to one of the following categories: monitoring, checking, responding, or communicating. For each subtask, standard operating procedures (SOPs) can be defined. The operating procedures performed by the subject manipulator during the execution of the subtask can be obtained and compared with the SOPs. The ratio of the number of correct operating procedures performed by the subject manipulator to the number of SOPs is taken as the task completion rate of the subtask, and the number of incorrect operating procedures performed by the subject manipulator is taken as the number of incorrect operating procedures performed by the subject manipulator. For example, if subtask A includes N SOPs, and the subject manipulator correctly completed M SOPs, then the task completion rate of subtask A = M / N, and the number of incorrect operating procedures = N - M. For each subtask, the time taken by the subject manipulator to complete the subtask can be obtained. For each subtask, the task completion rate, task completion time, and number of incorrect operating procedures can be taken as the task performance of the subtask. A first-level cognitive assessment result can be obtained based on the task performance of each subtask. In this way, by taking task completion rate, task completion time and number of erroneous operations as task performance, and by using task performance to reflect the operator's cognitive level, the operator's cognitive level can be quantitatively assessed.

[0043] As an example, the performance of monitoring subtasks can be used to obtain a first-level monitoring and awareness assessment result, which may include the task completion rate, completion time, and number of errors for each subtask belonging to the monitoring subtask. Similarly, the performance of inspection subtasks can be used to obtain a first-level comprehension and understanding assessment result, which may include the task completion rate, completion time, and number of errors for each subtask belonging to the inspection subtask. The performance of response subtasks can be used to obtain a decision-making and action assessment result, which may include the task completion rate, completion time, and number of errors for each subtask belonging to the response subtask. Furthermore, the performance of communication subtasks can be used to obtain a teamwork assessment result, which may include the task completion rate, completion time, and number of errors for each subtask belonging to the communication subtask. The first-level cognitive assessment result may include the first-level monitoring and awareness assessment result, the first-level comprehension and understanding assessment result, the decision-making and action assessment result, and the teamwork assessment result. Based on the first-level cognitive assessment result, the operator's cognitive level can be quantitatively assessed from the perspective of task performance.

[0044] This application embodiment can decompose the simulated task into monitoring sub-tasks, inspection sub-tasks, response sub-tasks, and communication sub-tasks based on the operator's cognitive model. These correspond to monitoring and perception, understanding and comprehension, decision-making and action, and teamwork in the operator's cognitive model, respectively. By finding the specific correspondence between the operator's cognitive links and the operational tasks, the task performance of the four sub-tasks in the simulated task can reflect the subject operator's monitoring and perception ability, understanding and comprehension ability, decision-making and action ability, and teamwork ability, respectively. This allows for a more objective and quantitative assessment of the operator's cognitive level.

[0045] S102. Obtain questionnaire data and response task data, and obtain the second cognitive level assessment result based on the questionnaire data and the response task data; the questionnaire data is obtained by the subject manipulator filling out the questionnaire; the response task data is obtained by the subject manipulator performing the response task; the response task is used to evaluate the subject manipulator based on the subject manipulator's response to a given stimulus or instruction.

[0046] For example, a questionnaire and response task can be presented to a subject operator through a first host and a first display. The subject operator can use a first mouse and a first keyboard to operate the first host, fill in the questionnaire and perform the response task.

[0047] In one possible implementation, the questionnaire may include at least one of a situational awareness questionnaire, a workload questionnaire, and a somatosensory assessment questionnaire; wherein, the situational awareness questionnaire can be used to assess the situational awareness ability of the subject operator; the workload questionnaire can be used to assess the workload of the subject operator; and the somatosensory assessment questionnaire can be used to assess the adaptability of the subject operator in an accident environment.

[0048] For example, each questionnaire may have multiple questions with different scores, and the questionnaire data may include the subject's accuracy rate, time taken to answer questions, and score for each questionnaire.

[0049] For example, a situation awareness questionnaire can be designed based on the Situation Awareness Global Assessment Technique (SAGAT). The SAGAT method can examine the operator's situation awareness at three levels: perception, understanding, and prediction. Specific questions in the situation awareness questionnaire can be designed using the SAGAT method in conjunction with the actual operating scenarios of a nuclear power plant. The situation awareness capability assessment results can be obtained through the questionnaire, and these results can include the accuracy rate of the responses, the time taken to complete the responses, and the questionnaire score.

[0050] As an example, the situational awareness questionnaire can be set up with three levels of questions: Level 1 perception questions, Level 2 comprehension questions, and Level 3 prediction questions. Level 1 perception questions can examine the operator's perception of the current state, Level 2 comprehension questions can examine whether the operator understands what is happening, and Level 3 prediction questions can examine whether the operator can predict the impact of an accident. Level 1 perception questions may include: (1) writing down the approximate range of key parameters, such as the range of parameters such as pressure, temperature, flow rate, liquid level, or material level; (2) writing down the on / off status of key controls, such as the on / off status of instruments, switches, light boxes, status boxes, and other controls; and (3) writing down the status of alarm lights or windows. Level 2 understanding questions may include: (1) judging the operating status of key equipment, such as the core, primary loop, secondary loop, steam generator, turbine and other equipment; (2) judging the operating status of key systems, such as the operating status of the safety injection system, auxiliary feedwater system and other systems; (3) judging what accident has occurred at the nuclear power plant, judging the faulty equipment and faulty location, such as whether a steam generator heat transfer tube rupture accident or a heat sink loss accident has occurred, and pointing out the faulty steam generator, heat sink loss equipment, etc. Level 3 prediction questions may include: (1) predicting whether key equipment and systems can work normally after an accident occurs, such as whether the safety injection system, auxiliary feedwater system and other systems can work normally; (2) predicting what changes will occur in the system status after the current basic tasks are completed, such as the temperature, pressure and flow rate change trends of the primary or secondary loop, the liquid level or material level change trends of the steam generator, pressurizer and other systems, etc. In this way, a basic problem framework for situational awareness, namely level 1 perception, level 2 understanding and level 3 prediction, can be set from the status of key controls and parameters to the status of key equipment and systems and then to the status of accidents, providing a general scheme for assessing situational awareness capabilities through the SAGAT method.

[0051] For example, the workload questionnaire can be the National Aeronautics and Space Administration Task Load Index (NASA-TLX) questionnaire. Workload assessment results can be obtained through the NASA-TLX questionnaire, and these results can include the accuracy of responses, response time, and questionnaire score.

[0052] For example, questions in the somatosensory assessment questionnaire may include subjective somatosensory experiences such as the temperature, humidity, and sweating levels of the experimental chamber, with scores assigned according to different levels of subjective somatosensory experience. The somatosensory assessment questionnaire can be used to understand whether the subject operator can adapt to the control room environment during a nuclear power plant accident, assessing the subject operator's adaptability to such an environment. Environmental adaptability assessment results can be obtained through the somatosensory assessment questionnaire, and these results may include the questionnaire score.

[0053] In one possible implementation, the response task may include at least one of the following: a Psychomotor Vigilance Task (PVT), a Stroop task, a connect-the-dots task, an addition task, a typing task, an N-back task, and a balloon-simulated risk task. Specifically, the Psychomotor Vigilance Task can be used to assess the participant's monitoring and awareness abilities; the Stroop task can be used to assess the participant's comprehension and intuitive abilities; the connect-the-dots task can be used to assess the participant's visual search abilities; the addition task can be used to assess the participant's computational abilities; the typing task can be used to assess the participant's perceptual control abilities; the N-back task can be used to assess the participant's working memory abilities; and the balloon-simulated risk task can be used to assess the participant's risk tolerance. The above response tasks can be set up with reference to relevant technologies.

[0054] In the classic Stroop task, text representing colors appears on the screen, and the text is presented in a certain color. The color representing the text can be the same as or different from the text's actual color. Participants need to respond with a key based on the color of the text, while ignoring the color itself, i.e., ignoring the meaning of the text. As an example, the classic Stroop task can be improved by combining color conflict and semantic conflict. Participants can be asked, with a certain probability, to alternate between choosing color consistency and semantic consistency. That is, for some text, participants can respond with a key based on the color of the text, ignoring the meaning of the text itself; for other text, participants can respond with a key based on the color representing the text, ignoring the color itself. This allows for the assessment of participants' comprehension and intuitive abilities based on semantic conflict, expanding the scope of the Stroop task's assessment capabilities.

[0055] Response task data refers to data collected during the performance of the response task by the subject manipulator, which is related to the subject manipulator's response during the performance of the response task.

[0056] For example, reaction task data may include the reaction time, number of correct reactions, and number of incorrect reactions for each reaction task.

[0057] As an example, a second assessment of monitoring and perception ability can be obtained through a mental alertness task, which may include reaction time, number of correct responses, and number of incorrect responses for the mental alertness task; a second assessment of comprehension and understanding ability can be obtained through an improved Stroop task, which may include reaction time, number of correct responses, and number of incorrect responses for the improved Stroop task; a first assessment of visual search ability can be obtained through a connect-the-dots task, which may include reaction time, number of correct responses, and number of incorrect responses for the connect-the-dots task; and computational ability can be obtained through an addition task. The assessment results can include: computational ability assessment results (such as reaction time, number of correct responses, and number of incorrect responses for addition tasks); perceptual control ability assessment results (such as reaction time, number of correct responses, and number of incorrect responses for typing tasks); working memory ability assessment results (such as reaction time, number of correct responses, and number of incorrect responses for N-back tasks); and risk acceptance assessment results (such as reaction time, number of correct responses, and number of incorrect responses for balloon-simulated risk tasks).

[0058] For example, the results of the second cognitive level assessment may include situational awareness assessment results, workload assessment results, environmental adaptability assessment results, second monitoring and perception assessment results, second comprehension and understanding assessment results, first visual search assessment results, calculation ability assessment results, perceptual control ability assessment results, working memory assessment results, and risk acceptance assessment results. Based on the results of the second cognitive level assessment, the operator's cognitive level can be quantitatively assessed from the perspective of cognitive ability.

[0059] This application embodiment uses two methods, questionnaire evaluation and response task, to assess the various cognitive abilities of the subject manipulator based on the questionnaire's answer accuracy, answer time, questionnaire score, and the response time, number of correct responses, and number of incorrect responses corresponding to the response task. It can integrate self-assessment methods and response test methods to quantitatively assess the manipulator's cognitive level.

[0060] S103. Obtain the operator's physiological data and obtain the third cognitive level assessment result based on the physiological data.

[0061] In one possible implementation, the physiological data may include at least one of electrocardiogram (ECG) data, cerebral oxygenation data, and eye-tracking data. Specifically, ECG data can be used to assess the neural activity of the subject; cerebral oxygenation data can be used to assess the energy metabolism of the subject; and eye-tracking data can be used to assess the visual search ability of the subject.

[0062] For example, electrocardiogram data of the subject can be collected by an electrocardiogram acquisition device (e.g., a three-lead electrocardiogram acquisition device); brain blood oxygenation data of the subject can be collected by a near-infrared brain functional imaging device; and eye movement data of the subject can be collected by an eye-tracking acquisition device.

[0063] For example, the experimental chamber may also include a second host. The second host includes physiological data acquisition software, which can control the software to collect physiological data from the subject. The second host can be connected to the first host via a serial port. Operational data generated by the subject's actions on the first host can be transmitted to the second host via the serial port; this operational data can be referred to as tagged data. The tagged data from the first host can be recorded simultaneously with the physiological data collected by the second host; that is, each physiological data point can correspond to one tagged data point. Based on the physiological data and its corresponding tagged data, the subject's operational state at the time of data collection can be determined. This method of collecting physiological data can be called tagged acquisition. For example, if the subject performs a button operation on the first host during physiological data collection, tagged acquisition can record the data of this button operation (e.g., button press time) in relation to the physiological data at the time of the button press.

[0064] In one possible implementation, the physiological data may include electrocardiogram data, cerebral blood oxygenation data, and eye movement data; the third cognitive level assessment result obtained based on the physiological data may include:

[0065] (1) Perform ECG data analysis on the ECG data to obtain the assessment results of neural activity; ECG data analysis includes at least one of time domain analysis, frequency domain analysis, and time-frequency analysis.

[0066] For example, time-domain analysis can be performed on ECG data to extract P, Q, R, S, and T characteristic waves for statistical analysis, assessing the subject's physical load, heart rate variability, and cardiac autoregulation ability; frequency-domain analysis can be performed on ECG data to obtain the power spectrum ratio of each frequency band, assessing the tension and balance of the vagus and sympathetic nervous systems; and time-frequency analysis can be performed on ECG data to obtain the temporal distribution changes of neural activity. Methods for time-domain, frequency-domain, and time-frequency analysis of ECG data can refer to relevant technologies.

[0067] For example, the assessment results of neural activity can be obtained based on the evaluation results of physical load, heart rate variability, cardiac autoregulation, tension and balance of the vagus and sympathetic nervous systems, and changes in the temporal distribution of neural activity.

[0068] (2) Analyze the cerebral blood oxygen data to obtain the assessment results of energy metabolism.

[0069] For example, brain oxygenation data may include task-based brain oxygenation data and resting-state brain oxygenation data; task-based brain oxygenation data is brain oxygenation data collected by the subject operator when performing a specific task, and resting-state brain oxygenation data is brain oxygenation data collected by the subject operator when not performing a specific task.

[0070] For example, analyzing cerebral oxygenation data may include: fitting a generalized linear model to task-state cerebral oxygenation data, and / or performing functional connectivity analysis on resting-state cerebral oxygenation data.

[0071] As an example, generalized linear model fitting can be performed on task-oriented brain oxygenation data to assess the activation status and cognitive load of prefrontal cortex cognitive regions; functional connectivity analysis can be performed on resting-state brain oxygenation data to assess the synergy between different channels in the prefrontal cortex cognitive regions. Methods for generalized linear model fitting and functional connectivity analysis of brain oxygenation data can be found in relevant techniques.

[0072] For example, the energy metabolism assessment results can be obtained based on the assessment results of the activation status and cognitive load of the prefrontal cognitive brain regions and the coordination between different channels of the prefrontal cognitive brain regions.

[0073] (3) Analyze the eye movement data to obtain the second visual search ability assessment results; the eye movement data includes at least one of pupil change data, eye movement heatmap, fixation index, and saccade index.

[0074] For example, the attention allocation, information retrieval efficiency, and cognitive processing ability of subject operators can be assessed by analyzing pupil change data, eye movement thermograms, fixation indices, and saccade indices. The methods for analyzing pupil change data, eye movement thermograms, fixation indices, and saccade indices can refer to relevant techniques.

[0075] For example, the evaluation results of second visual search ability can be obtained based on the evaluation results of attention allocation, information search efficiency and cognitive processing ability.

[0076] (4) Based on the assessment results of neural activity, energy metabolism and visual search ability, the third cognitive level assessment results are obtained.

[0077] For example, the results of the third cognitive level assessment may include assessments of neural activity, energy metabolism, and second visual search ability. Based on the results of the third cognitive level assessment, the operator's cognitive level can be quantitatively assessed from the perspective of physiological activity.

[0078] For example, the intrinsic factors and physiological mechanisms of changes in the operator's cognitive level can be studied based on physiological data and corresponding labeling data, as well as the results of the third cognitive level assessment.

[0079] In this application, three typical physiological monitoring methods—electrocardiogram monitoring, near-infrared brain functional imaging, and eye tracking—are selected to measure neural activity, energy metabolism, and visual search, respectively. This can effectively explore the intrinsic factors and physiological mechanisms of changes in the operator's cognitive level.

[0080] S104. The cognitive level of the subject operator is assessed based on the first cognitive level assessment result, the second cognitive level assessment result, and the third cognitive level assessment result.

[0081] For example, the cognitive levels of the subject manipulator can be assessed by combining the results of the first cognitive level assessment, the second cognitive level assessment, and the third cognitive level assessment.

[0082] As an example, the results of the first and second assessments of monitoring and awareness abilities can be combined to evaluate the subject's level in monitoring and awareness; the results of the first and second assessments of comprehension and understanding abilities can be combined to evaluate the subject's level in comprehension and understanding; the results of the first and second assessments of visual search abilities can be combined to evaluate the subject's level in visual search; and the results of assessments of decision-making and action abilities, teamwork abilities, situational awareness, workload, environmental adaptability, computational abilities, perceptual control abilities, working memory, risk acceptance, neural activity, and energy metabolism can be used to evaluate the subject's level in decision-making and action, teamwork, situational awareness, workload, environmental adaptability, computation, perceptual control, working memory, risk acceptance, neural activity, and energy metabolism, respectively.

[0083] For example, based on the assessment results of the cognitive levels of the test operators in different aspects, the areas where the test operators' cognitive levels are weak can be identified. Targeted measures can then be taken to help the test operators improve in their weak areas, thereby improving their cognitive levels in a targeted manner and contributing to the improvement of nuclear power plant production safety.

[0084] For example, the differences in simulated task execution data, questionnaire data, response task data, and physiological data of the subjects under different working conditions can be analyzed to further study how to correlate these data with the cognitive level of the subjects.

[0085] The cognitive level assessment method of this application integrates task performance, self-assessment, reaction test, and physiological monitoring to quantitatively assess the operator's cognitive level from three aspects: task performance, cognitive ability, and physiological activity. This method can accurately and comprehensively assess the operator's cognitive level, improving the comprehensiveness and reliability of the cognitive level assessment. Furthermore, the cognitive level assessment method of this application can acquire simulated task execution data, questionnaire data, reaction task data, and physiological data in real time, and assess the operator's cognitive level based on this real-time data, thereby improving the real-time performance of the cognitive level assessment.

[0086] Figure 2 A schematic diagram of a cognitive level assessment method according to an embodiment of this application is shown, such as... Figure 2As shown, this method can include three layers: a model layer, a task layer, and a data layer. At the model layer, an operator cognitive model can be established, encompassing "monitoring and awareness - understanding and comprehension - decision-making - action - teamwork." At the task layer, the simulated task can be decomposed based on the operator cognitive model and the accident handling operation sequence. The simulated task can be further broken down into four sub-tasks based on the cognitive elements corresponding to discrete events in the accident handling sequence: monitoring sub-tasks, inspection sub-tasks, response sub-tasks, and communication sub-tasks. The simulated tasks can be categorized into two types: accident monitoring and awareness tasks and unit load reduction operation tasks. At the data layer, the operator's cognitive level can be quantitatively assessed from three aspects: task performance, cognitive ability, and physiological activity. Regarding task performance, typical nuclear power plant accident tasks covering the four sub-tasks can be selected as simulated tasks. For example, a steam generator heat transfer tube rupture task and a main feedwater pipeline containment rupture task can be selected as simulated tasks; both of these tasks belong to accident monitoring and awareness tasks. The task completion rate, task completion time, and number of erroneous operations of each sub-task during the execution of the simulated task can be obtained as task performance data. The first cognitive level assessment result is obtained based on the task performance. In terms of cognitive abilities, assessment can be conducted using both questionnaires and response tasks. The SAGAT method can be used to design a situational awareness questionnaire, assessing the operator's situational awareness ability through the accuracy and time taken to complete the questionnaire. The NASA-TLX questionnaire can be used to assess the operator's workload. A somatosensory assessment questionnaire can be used to assess the operator's environmental adaptability. A PVT task can be used to assess the operator's monitoring and perception abilities. A modified Stroop task can be used to assess the operator's comprehension and intuitive understanding abilities. A connect-the-dots task can be used to assess the operator's visual search ability. An addition task can be used to assess the operator's calculation ability. A typing task can be used to assess the operator's perceptual control ability. An N-back task can be used to assess the operator's working memory ability. A balloon-simulated risk task can be used to assess the operator's risk acceptance. These methods yield the results of the second cognitive level assessment. In terms of physiological activities, electrocardiogram (ECG), cerebral oxygenation (COS), and eye movement (EMT) data can be acquired from the subjects. Analysis of ECG data assesses the subjects' neural activity; analysis of COS data assesses their energy metabolism; and analysis of EMT data assesses their visual search ability. This yields a third level of cognitive assessment results. The results from the first, second, and third levels of cognitive assessment can then be combined to evaluate different aspects of the subjects' cognitive abilities.The cognitive level assessment method of this application provides a hierarchical framework and components of an operator's cognitive level measurement system, consisting of three layers: model layer, task layer, and data layer. It breaks down the cognitive level of the operator from the cognitive model to the sub-tasks of the simulated task to specific abilities, and selects corresponding classic psychological tasks and typical physiological methods for measurement. It provides a general framework for quantitatively measuring the operator's cognitive level, and improves the comprehensiveness and reliability of cognitive level assessment.

[0087] It should be noted that although the embodiments of this application use the assessment of the cognitive level of nuclear power plant operators as an example to introduce the cognitive level assessment method provided by this application, those skilled in the art will understand that this application should not be limited to this. The cognitive level assessment method provided by this application can also be used to assess the cognitive level of operators in other fields, as long as the requirements are met.

[0088] This application also provides a cognitive level assessment system, which can be used to implement the above-described cognitive level assessment method, for example, it can implement the above-described cognitive level assessment method. Figure 1 The steps of the cognitive level assessment method are shown.

[0089] Figure 3 This diagram illustrates the structure of a cognitive level assessment system according to an embodiment of the present application. Figure 3 As shown, the system may include a first assessment module 301, a second assessment module 302, a third assessment module 303, and a cognitive level assessment module 304.

[0090] The first assessment module 301 is used to acquire simulation task execution data of the subject operator during the execution of the simulation task, and to obtain the first cognitive level assessment result based on the simulation task execution data; the simulation task is a task in a simulated accident scenario.

[0091] For example, the simulation task may include at least one of a monitoring subtask, an inspection subtask, a response subtask, and a communication subtask; the monitoring subtask may be used to assess the monitoring and awareness abilities of the subject manipulator; the inspection subtask may be used to assess the understanding and comprehension abilities of the subject manipulator; the response subtask may be used to assess the decision-making and action abilities of the subject manipulator; and the communication subtask may be used to assess the teamwork abilities of the subject manipulator.

[0092] For example, simulated task execution data may include at least one of the following: task completion rate, task completion time, and number of erroneous operations.

[0093] For example, the first evaluation module 301 can realize the program interaction of the simulated task, record the execution data of the simulated task, and obtain the task performance based on the execution data of the simulated task, and obtain the first cognitive level evaluation result based on the task performance.

[0094] The second assessment module 302 is used to acquire questionnaire data and response task data, and to obtain a second cognitive level assessment result based on the questionnaire data and the response task data; the questionnaire data is obtained by the subject manipulator filling out a questionnaire; the response task data is obtained by the subject manipulator performing a response task; the response task is used to assess the subject manipulator based on the subject manipulator's response to a given stimulus or instruction.

[0095] For example, the questionnaire may include at least one of a situational awareness questionnaire, a workload questionnaire, and a somatosensory assessment questionnaire; wherein, the situational awareness questionnaire can be used to assess the situational awareness ability of the subject operator; the workload questionnaire can be used to assess the workload of the subject operator; and the somatosensory assessment questionnaire can be used to assess the adaptability of the subject operator in a nuclear power plant accident scenario.

[0096] For example, the response task may include at least one of the following: a mental alertness task, a Stroop task, a connect-the-dots task, an addition task, a typing task, an N-back task, and a balloon-simulated risk task; wherein, the mental alertness task can be used to assess the subject's monitoring and awareness abilities; the Stroop task can be used to assess the subject's comprehension and intuitive abilities; the connect-the-dots task can be used to assess the subject's visual search abilities; the addition task can be used to assess the subject's computational abilities; the typing task can be used to assess the subject's perceptual control abilities; the N-back task can be used to assess the subject's working memory abilities; and the balloon-simulated risk task can be used to assess the subject's risk tolerance.

[0097] For example, the second assessment module 302 may include a self-assessment module and a response task module. The self-assessment module can implement interactive programming of situational awareness questionnaires, workload questionnaires, and somatosensory assessment questionnaires, and record questionnaire data. The response task module can implement interactive programming of mental alertness tasks, Stroop tasks, connect-the-dots tasks, addition tasks, typing tasks, N-back tasks, and balloon simulation risk tasks, and record response task data. The second assessment module 302 can assess the subject's various cognitive abilities based on questionnaire data and response task data, and obtain a second cognitive level assessment result.

[0098] The third assessment module 303 is used to acquire the physiological data of the subject manipulator and obtain the third cognitive level assessment result based on the physiological data.

[0099] For example, physiological data may include at least one of electrocardiogram (ECG) data, cerebral oxygenation data, and eye movement data; wherein, ECG data can be used to assess the neural activity of the subject manipulator; cerebral oxygenation data can be used to assess the energy metabolism of the subject manipulator; and eye movement data can be used to assess the visual search ability of the subject manipulator.

[0100] For example, the third evaluation module 303 can perform real-time recording, data processing, data analysis, and feature extraction of electrocardiogram data, cerebral blood oxygen data, and eye movement data, and can record the data analysis results.

[0101] In one possible implementation, the physiological data includes electrocardiogram (ECG) data, cerebral oxygenation data, and eye movement data; the third assessment module 303 can also be used to: perform ECG data analysis on the ECG data to obtain an assessment result of neural activity; the ECG data analysis includes at least one of time-domain analysis, frequency-domain analysis, and time-frequency analysis; analyze the cerebral oxygenation data to obtain an assessment result of energy metabolism; the cerebral oxygenation data includes task-state cerebral oxygenation data and resting-state cerebral oxygenation data; the analysis of the cerebral oxygenation data includes: performing generalized linear model fitting on the task-state cerebral oxygenation data, and / or performing functional connectivity analysis on the resting-state cerebral oxygenation data; analyze the eye movement data to obtain an assessment result of visual search ability; the eye movement data includes at least one of pupillary change data, eye movement thermogram, fixation index, and saccade index; and obtain the third cognitive level assessment result based on the assessment results of neural activity, the assessment results of energy metabolism, and the assessment results of visual search ability.

[0102] The cognitive level assessment module 304 is used to assess the cognitive level of the subject operator based on the first cognitive level assessment result, the second cognitive level assessment result, and the third cognitive level assessment result.

[0103] In some embodiments, the system provided in this application may have functions or include modules that can be used to execute the methods described in the above method embodiments. The specific implementation can be referred to the description of the above method embodiments, and for the sake of brevity, it will not be repeated here.

[0104] The cognitive level assessment system of this application embodiment can quantitatively assess the operator's cognitive level from three aspects: task performance, cognitive ability, and physiological activity. It can accurately and comprehensively assess the operator's cognitive level, improving the comprehensiveness and reliability of the cognitive level assessment. Furthermore, the cognitive level assessment system of this application embodiment can acquire simulated task execution data, questionnaire data, reaction task data, and physiological data in real time, and assess the operator's cognitive level based on this real-time data, thereby improving the real-time performance of the cognitive level assessment.

[0105] This application also provides a cognitive level assessment system, which can be used to implement the above-described cognitive level assessment method, for example, it can implement the above-described cognitive level assessment method. Figure 1 The steps of the cognitive level assessment method are shown.

[0106] Figure 4 This diagram illustrates the structure of a cognitive level assessment system according to an embodiment of the present application. Figure 4 As shown, the cognitive level assessment system 400 may include a stimulus presentation device 402 and a physiological monitoring device 404.

[0107] The stimulus presentation device 402 is used to: present a simulated task, a questionnaire, and a response task to a subject manipulator; the simulated task is a task simulating an accident scenario; the response task is used to evaluate the subject manipulator based on their response to a given stimulus or instruction; acquire simulated task execution data of the subject manipulator during the execution of the simulated task, and obtain a first cognitive level assessment result based on the simulated task execution data; acquire questionnaire data and response task data, and obtain a second cognitive level assessment result based on the questionnaire data and the response task data; the questionnaire data is obtained by the subject manipulator filling out a questionnaire; the response task data is obtained by the subject manipulator performing a response task.

[0108] For example, the stimulus presentation device 402 may include a first host and a first display. The first host can simulate the parameters on the central control system when an accident occurs in a nuclear power plant, and the first display can face the subject operator. The first display can be connected to the first host, and simulated tasks, questionnaires, and response tasks can be presented to the subject operator through the first host and the first display.

[0109] For example, the first host can acquire simulated task execution data and obtain a first cognitive level assessment result based on the simulated task execution data; it can also acquire questionnaire data and response task data and obtain a second cognitive level assessment result based on the questionnaire data and response task data.

[0110] Physiological monitoring device 404 is used to acquire physiological data of the subject operator and obtain the third cognitive level assessment result based on the physiological data.

[0111] Exemplarily, the physiological monitoring device 404 may include a second host and a second display. The second host includes physiological data acquisition software, which can control the physiological data acquisition software to acquire physiological data. The physiological data acquisition software may include: electrocardiogram (ECG) data acquisition software, used to control the ECG acquisition device to acquire ECG data; cerebral oxygenation data acquisition software, used to control the near-infrared brain functional imaging device to acquire cerebral oxygenation data; and eye-tracking data acquisition software, used to control the eye-tracking acquisition device to acquire eye-tracking data. The second host can be connected to the first host via a serial port to collect and label the physiological data, i.e., each physiological data point can correspond to a labeled data point, which is the operation data generated by the subject manipulator on the first host. The second host can analyze the collected physiological data to obtain a third cognitive level assessment result. The second display can be connected to the second host and can display the collected physiological data and data analysis results.

[0112] Exemplarily, the physiological monitoring device 404 may further include an electrocardiogram (ECG) acquisition device, a near-infrared brain imaging device, and an eye-tracking acquisition device. The ECG acquisition device, near-infrared brain imaging device, and eye-tracking acquisition device can be connected to a second host computer. The ECG acquisition device can be placed on the chest of the subject operator to collect the subject operator's ECG data and transmit the ECG data to the second host computer; the near-infrared brain imaging device can be placed in the prefrontal cortex of the subject operator to collect the subject operator's cerebral blood oxygenation data and transmit the cerebral blood oxygenation data to the second host computer; the eye-tracking acquisition device can be placed in front of the subject operator's eyes to collect the subject operator's eye movement data and transmit the eye movement data to the second host computer.

[0113] For example, the physiological monitoring device 404 can also be used to transmit the third cognitive level assessment result to the first host in the stimulus presentation device 402; the first host in the stimulus presentation device 402 can also be used to: receive the third cognitive level assessment result; and assess the cognitive level of the subject manipulator based on the first cognitive level assessment result, the second cognitive level assessment result and the third cognitive level assessment result.

[0114] Optionally, the system may also include an environmental simulation device 401 for simulating the main control room environment during an accident.

[0115] For example, the environmental simulation device 401 can generate quantitatively adjustable sound, light, heat and vibration stimuli through temperature control system, air control system, etc., to simulate the sound, brightness, temperature and vibration of the main control room when a nuclear power plant accident occurs.

[0116] Optionally, the system may also include a reaction acquisition device 403 for acquiring the actions performed by the subject operator using a mouse and keyboard during the execution of the simulation task, the reaction task, and the completion of the questionnaire.

[0117] For example, the response acquisition device 403 may include a first mouse and a first keyboard. The first mouse and the first keyboard may be connected to a first host computer, and the subject manipulator may use the first mouse and the first keyboard to perform simulated tasks and response tasks and fill out questionnaires on the first host computer. The response acquisition device 403 may acquire the mouse and keyboard response events of the subject manipulator (i.e., the operations performed by the subject manipulator through the first mouse and the first keyboard).

[0118] In some embodiments, the system provided in this application may have functions or include modules that can be used to execute the methods described in the above method embodiments. The specific implementation can be referred to the description of the above method embodiments, and for the sake of brevity, it will not be repeated here.

[0119] The cognitive level assessment system of this application provides hardware equipment for executing the above-described cognitive level assessment method. This cognitive level assessment system can quantitatively assess the operator's cognitive level from three aspects: task performance, cognitive ability, and physiological activity. It can accurately and comprehensively assess the operator's cognitive level, improving the comprehensiveness and reliability of the cognitive level assessment. Furthermore, the cognitive level assessment system of this application can acquire simulated task execution data, questionnaire data, reaction task data, and physiological data in real time, and assess the operator's cognitive level based on this real-time data, thus improving the real-time performance of the cognitive level assessment.

[0120] Figure 5 A schematic diagram of a cognitive level assessment system according to an embodiment of this application is shown, such as... Figure 5As shown, the system can include both hardware and software components. The hardware component can include an environmental simulation device, a stimulus presentation device, a response acquisition device, and a physiological monitoring device. The environmental simulation device can generate quantitatively adjustable sound, light, heat, and vibration stimuli to simulate a nuclear power plant accident scenario. The stimulus presentation device can present stimulus materials to the subject, including simulated tasks, response tasks, and self-assessment (i.e., questionnaires). The stimulus presentation device includes a host computer (i.e., the stimulus presentation computer) that controls the stimulus material program and a monitor facing the subject. The response acquisition device can collect the subject's mouse and keyboard response events, including the mouse and keyboard facing the subject. The physiological monitoring device can collect the subject's physiological data in real time, including a host computer and monitor that control all physiological data acquisition software, and is connected to the stimulus presentation computer via a serial port for tagging and data acquisition. The physiological monitoring device also includes an electrocardiogram (ECG) acquisition device placed on the subject's chest, a near-infrared brain functional imaging device placed on the subject's prefrontal cortex, and an eye-tracking acquisition device placed in front of the subject's eyes. The software component may include a simulation task module, a reaction task module, a self-assessment module, and a physiological monitoring module. The simulation task module enables interactive programming and result recording for simulated tasks. The reaction task module enables interactive programming and result recording for tasks such as mental alertness, Stroop, connect-the-dots, addition, typing, N-back, and balloon-simulated risk tasks. The self-assessment module enables interactive programming and result recording for situational awareness questionnaires, workload questionnaires, and somatosensory assessment questionnaires. The physiological monitoring module enables real-time recording, signal processing, feature extraction, and data analysis of electrocardiogram data, cerebral oxygenation data, and eye movement data. The cognitive level assessment system of this application provides a framework and layout for an operator's cognitive level assessment device, consisting of four main modules: a stimulus presentation device, a response acquisition device, an environmental simulation device, and a physiological monitoring device. It can comprehensively and quantitatively assess the operator's cognitive level from three aspects: task performance, cognitive ability, and physiological activity.

[0121] This application also proposes an electronic device, including: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to implement the above-mentioned instructions when executing the instructions stored in the memory. Figure 1 A cognitive level assessment method.

[0122] Figure 6 A block diagram of an electronic device 1900 according to an embodiment of this application is shown. For example, device 1900 may be provided as a server or terminal device. (Refer to...) Figure 6The device 1900 includes a processing component 1922, which further includes one or more processors, and memory resources represented by memory 1932 for storing instructions executable by the processing component 1922, such as application programs. The application programs stored in memory 1932 may include one or more modules, each corresponding to a set of instructions. Furthermore, the processing component 1922 is configured to execute instructions to perform the aforementioned... Figure 1 A cognitive level assessment method.

[0123] Device 1900 may also include a power supply component 1926 configured to perform power management of device 1900, a wired or wireless network interface 1950 configured to connect device 1900 to a network, and an input / output (I / O) interface 1958. Device 1900 can operate on an operating system stored in memory 1932, such as Windows Server™, MacOS X™, Unix™, Linux™, FreeBSD™, or similar.

[0124] This application also proposes a computer-readable storage medium storing computer program instructions thereon, which, when executed by a processor, implement the above-described functionality. Figure 1 A method for assessing cognitive levels. Computer-readable storage media can be volatile or non-volatile.

[0125] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 1932 including computer program instructions, which can be executed by the processing component 1922 of the device 1900 to perform the above-described tasks. Figure 1 A cognitive level assessment method.

[0126] This application also provides a computer program product, including computer-readable code, or a non-volatile computer-readable storage medium carrying computer-readable code. When the computer-readable code is executed in the processor of an electronic device, the processor in the electronic device performs the above-described... Figure 1 A cognitive level assessment method.

[0127] This application may be a system, method, and / or computer program product. A computer program product may include a computer-readable storage medium having computer-readable program instructions loaded thereon for causing a processor to implement various aspects of this application.

[0128] Computer-readable storage media can be tangible devices capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example—but not limited to—electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination thereof. The computer-readable storage media used herein are not to be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.

[0129] The computer-readable program instructions described herein can be downloaded from computer-readable storage media to various computing / processing devices, or downloaded via a network, such as the Internet, local area network, wide area network, and / or wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards them to the computer-readable storage media in the respective computing / processing device.

[0130] The computer program instructions used to perform the operations of this application may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The computer-readable program instructions may be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuits, such as programmable logic circuits, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), are personalized by utilizing state information from the computer-readable program instructions. These electronic circuits can execute the computer-readable program instructions to implement various aspects of this application.

[0131] Various aspects of this application are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer-readable program instructions.

[0132] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, they create means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. These computer-readable program instructions can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.

[0133] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.

[0134] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction containing one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those marked in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0135] The various embodiments of this application have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical applications, or technological improvements to the embodiments in the market, or to enable others skilled in the art to understand the embodiments disclosed herein.

Claims

1. A method for assessing cognitive level, characterized in that, The method includes: The simulation task execution data of the subject operator is obtained during the execution of the simulation task, and the first cognitive level assessment result is obtained based on the simulation task execution data; the simulation task is a task in a simulated accident scenario; the simulated accident scenario includes a nuclear power plant simulated accident scenario; Acquire questionnaire data and response task data, and obtain the second cognitive level assessment results based on the questionnaire data and the response task data; the questionnaire data is obtained by the subject manipulator completing the questionnaire; the response task data is obtained by the subject manipulator performing the response task; the response task is used to evaluate the subject manipulator based on the subject manipulator's response to a given stimulus or instruction. Physiological data of the subject manipulators were obtained, and the third cognitive level assessment results were obtained based on the physiological data; The cognitive level of the subject manipulator is assessed based on the results of the first cognitive level assessment, the second cognitive level assessment, and the third cognitive level assessment. The questionnaire includes at least one of a situational awareness questionnaire, a workload questionnaire, and a somatosensory assessment questionnaire; wherein the situational awareness questionnaire is used to assess the situational awareness ability of the subject operator; the workload questionnaire is used to assess the workload of the subject operator; and the somatosensory assessment questionnaire is used to assess the adaptability of the subject operator in an accident environment.

2. The method according to claim 1, characterized in that, The simulation task includes at least one of a monitoring subtask, an inspection subtask, a response subtask, and a communication subtask; wherein the monitoring subtask is used to assess the monitoring and awareness abilities of the subject manipulator; the inspection subtask is used to assess the comprehension and understanding abilities of the subject manipulator; the response subtask is used to assess the decision-making and action abilities of the subject manipulator; and the communication subtask is used to assess the teamwork abilities of the subject manipulator.

3. The method according to claim 1, characterized in that, The simulated task execution data includes at least one of the following: task completion rate, task completion time, and number of erroneous operations.

4. The method according to claim 1, characterized in that, The response task includes at least one of the following: a mental alertness task, a Stroop task, a connect-the-dots task, an addition task, a typing task, an N-back task, and a balloon-simulated risk task; wherein, the mental alertness task is used to assess the participant's monitoring and awareness abilities; the Stroop task is used to assess the participant's comprehension and intuitive abilities; the connect-the-dots task is used to assess the participant's visual search abilities; the addition task is used to assess the participant's computational abilities; the typing task is used to assess the participant's perceptual control abilities; the N-back task is used to assess the participant's working memory abilities; and the balloon-simulated risk task is used to assess the participant's risk tolerance.

5. The method according to claim 1, characterized in that, The physiological data includes at least one of electrocardiogram (ECG) data, cerebral oxygenation data, and eye movement data; wherein the ECG data is used to assess the neural activity of the subject manipulator; the cerebral oxygenation data is used to assess the energy metabolism of the subject manipulator; and the eye movement data is used to assess the visual search ability of the subject manipulator.

6. The method according to claim 5, characterized in that, The physiological data includes electrocardiogram data, cerebral blood oxygenation data, and eye movement data; the process of obtaining the third cognitive level assessment result based on the physiological data includes: The electrocardiogram (ECG) data is analyzed to obtain an assessment of neural activity; the ECG data analysis includes at least one of time-domain analysis, frequency-domain analysis, and time-frequency analysis. The brain oxygenation data is analyzed to obtain an assessment of energy metabolism. The brain oxygenation data includes task-oriented brain oxygenation data and resting-oriented brain oxygenation data. The analysis of the brain oxygenation data includes: fitting a generalized linear model to the task-oriented brain oxygenation data, and / or performing functional connectivity analysis on the resting-oriented brain oxygenation data. The eye-tracking data is analyzed to obtain visual search ability assessment results; the eye-tracking data includes at least one of pupil change data, eye-tracking heatmap, fixation index, and saccade index. The third cognitive level assessment result is obtained based on the assessment results of neural activity, energy metabolism, and visual search ability.

7. A cognitive level assessment system, characterized in that, The system includes: The first assessment module is used to acquire simulation task execution data of the subject operator during the execution of the simulation task, and to obtain a first cognitive level assessment result based on the simulation task execution data; the simulation task is a task in a simulated accident scenario; the simulated accident scenario includes a nuclear power plant simulated accident scenario; The second assessment module is used to acquire questionnaire data and response task data, and to obtain a second cognitive level assessment result based on the questionnaire data and the response task data; the questionnaire data is obtained by the subject manipulator filling out the questionnaire; the response task data is obtained by the subject manipulator performing the response task; the response task is used to assess the subject manipulator based on the subject manipulator's response to a given stimulus or instruction. The third assessment module is used to acquire the physiological data of the subject manipulator and obtain the third cognitive level assessment result based on the physiological data. The cognitive level assessment module is used to assess the cognitive level of the subject operator based on the first cognitive level assessment result, the second cognitive level assessment result, and the third cognitive level assessment result. The questionnaire includes at least one of a situational awareness questionnaire, a workload questionnaire, and a somatosensory assessment questionnaire; wherein the situational awareness questionnaire is used to assess the situational awareness ability of the subject operator; the workload questionnaire is used to assess the workload of the subject operator; and the somatosensory assessment questionnaire is used to assess the adaptability of the subject operator in an accident environment.

8. A cognitive level assessment system, characterized in that, The system includes: Stimulus presentation device, used for: The experimenter was presented with a simulated task, a questionnaire, and a response task; the simulated task was a task in a simulated accident scenario; the response task was used to evaluate the experimenter based on their response to a given stimulus or instruction; the simulated accident scenario included a simulated nuclear power plant accident scenario. Acquire simulation task execution data of the subject manipulator during the simulation task, and obtain the first cognitive level assessment result based on the simulation task execution data; Acquire questionnaire data and response task data, and obtain the second cognitive level assessment results based on the questionnaire data and the response task data; the questionnaire data is obtained by the subject manipulator completing the questionnaire; the response task data is obtained by the subject manipulator performing the response task. A physiological monitoring device is used to acquire physiological data of the subject manipulator and to obtain a third cognitive level assessment result based on the physiological data; The physiological monitoring device is also used to transmit the third cognitive level assessment result to the stimulus presentation device; The stimulus presentation device is also used for: Receive the assessment results of the third cognitive level; The cognitive level of the subject manipulator is assessed based on the results of the first cognitive level assessment, the second cognitive level assessment, and the third cognitive level assessment. The questionnaire includes at least one of a situational awareness questionnaire, a workload questionnaire, and a somatosensory assessment questionnaire; wherein the situational awareness questionnaire is used to assess the situational awareness ability of the subject operator; the workload questionnaire is used to assess the workload of the subject operator; and the somatosensory assessment questionnaire is used to assess the adaptability of the subject operator in an accident environment.

9. An electronic device, characterized in that, include: processor; Memory used to store processor-executable instructions; The processor is configured to implement the method of any one of claims 1-6 when executing instructions stored in the memory.

Images