Personnel work state assessment system and method based on eye movement and electroencephalogram indicators

Abstract

The application provides a personnel operation state evaluation system based on eye movement and electroencephalogram indexes. The system can realize acquisition and selection of operation state indexes of different personnel, and provides a personnel operation state evaluation method based on eye movement and electroencephalogram indexes, has the characteristics of good sensitivity and high comprehensiveness, and can provide technical support for trigger mechanism design of dynamic man-machine function distribution of a complex industrial system, so as to enhance the integration efficiency of man and system and ensure human safety.

Description

Technical Field

[0001] This invention relates to a system and method for assessing the operational status of personnel based on eye movement and electroencephalogram (EEG) indicators. Background Technology

[0002] Designing and evaluating the triggering mechanism for dynamic human-machine function allocation in complex industrial systems plays a crucial role in system design and development, enhancing the integration efficiency between humans and systems and ensuring human safety.

[0003] Current research on systems for assessing human work status based on eye-tracking and electroencephalography (EEG) indicators is still relatively lacking. Firstly, research on assessing human work status based on physiological indicators is incomplete, lacking exploration of corresponding sensitive indicators and labels for human work status. Secondly, current research mostly focuses on assessing single cognitive states (such as workload, situational awareness, etc.), lacking attempts to integrate multiple cognitive states to construct a comprehensive assessment of human work status. Finally, there is a lack of attempts to integrate eye-tracking and EEG indicators sensitive to multiple task conditions for assessing human work status.

[0004] Based on the above, a system for determining the operational status of personnel based on eye movement and electroencephalogram (EEG) indicators was designed. This system can address the aforementioned shortcomings and can be applied to the design of triggering mechanisms for dynamic human-machine function allocation in complex industrial systems. This provides a certain reference for enhancing the integration efficiency between humans and systems and ensuring human safety. Summary of the Invention

[0005] The purpose of this invention is to provide a system and method for assessing the work status of personnel based on eye movement and electroencephalogram (EEG) indicators. This system and method can acquire and select work status indicators for different categories of personnel, and proposes a method for assessing the work status of personnel based on eye movement and EEG indicators.

[0006] According to one aspect of the present invention, a personnel work status assessment system based on eye movement and electroencephalogram (EEG) indicators is provided, comprising: a personnel work status indicator calculation and measurement subsystem, used to input measurement data from different task scenarios, acquire data in categories such as eye movement, EEG, and performance, select corresponding calculation and judgment indicators, and import them into a personnel work status analysis subsystem; and a personnel work status analysis subsystem, used to preprocess the data, construct and optimize labels for personnel work status, determine the current personnel work status, and output the determination result of the personnel status.

[0007] According to one aspect of the present invention, a subsystem for calculating and measuring personnel work status indicators is provided, comprising: a measurement data input module for inputting measurement data in different task scenarios; a personnel eye movement indicator calculation module for acquiring the input eye movement data and selecting three task-scenario-sensitive eye movement indicators: NNI, fixation duration, and average pupil diameter; and a personnel electroencephalogram (EEG) indicator calculation module for acquiring the input EEG data and selecting five task-scenario-sensitive EEG indicators: high_alpha_Fz, high_alpha_Cz, high_alpha_Pz, THA_Fz, and THA_Pz; wherein high_alpha_Fz refers to the power value of the Fz electrode at the midpoint of the frontal lobe at 10–13 Hz on an EEG, and high_alpha_Cz refers to the power value of the central part of the brain at 10–13 Hz. The system uses the following parameters: Cz electrode power value at 10-13 Hz on EEG; high_alpha_Pz refers to the power value at the Pz electrode at the apex of the brain at 10-13 Hz on EEG; THA_Fz is the ratio of the power value at the Fz electrode at the mid-frontal cortex at 4-8 Hz to the power value at 10-13 Hz on EEG; THA_Pz is the ratio of the power value at the Pz electrode at the apex of the brain at 4-8 Hz to the power value at 10-13 Hz on EEG; Personnel performance measurement module: acquires input performance data and selects accuracy and reaction time indicators to evaluate personnel performance; Personnel fatigue measurement module: acquires input fatigue data and selects the Stanford Somnolence Scale score to evaluate personnel fatigue; Personnel workload measurement module: acquires input workload data and selects the National Aeronautics and Space Administration (NASA) Mission Load Index (NLASIK) scale. The NASA-TLX Aeronautics and Space Administration Task Load Index (NASA-TLX) score is used to assess personnel workload; the personnel situational awareness measurement module is used to acquire input situational awareness data and select the Situation Awareness Global Assessment Technology (SAGAT) score to assess personnel situational awareness; the calculation and measurement index import module is used to import eye movement and EEG calculation indicators of personnel's work status, as well as measurement indicators of performance, fatigue, workload, and situational awareness.

[0008] According to a further aspect of the present invention, the personnel work status analysis subsystem includes a preprocessing module, a personnel work status label construction module, a personnel work status determination module, and a personnel work status result output module. The preprocessing module is used to preprocess the calculated and measured indicators; the personnel work status label construction module is used to construct and optimize personnel work status labels; the personnel work status determination module is used to determine the current personnel work status; and the personnel work status result output module is used to output the determination result of the personnel status.

[0009] According to another aspect of the present invention, a method for assessing personnel work status based on eye movement and electroencephalogram (EEG) indicators is provided, characterized by comprising: a sub-step for calculating and measuring personnel work status indicators, used to input measurement data from different task scenarios, acquire data in categories such as eye movement, EEG, and performance, select corresponding calculation and judgment indicators, and import them into a personnel work status analysis sub-system; and a sub-step for analyzing personnel work status, used to preprocess the data, construct and optimize labels for personnel work status, determine the current personnel work status, and output the determination result of the personnel status.

[0010] According to a further aspect of the present invention, a sub-step for calculating and measuring personnel work status indicators is provided, comprising: a measurement data input step for inputting measurement data in different task scenarios; a personnel eye movement indicator calculation step for acquiring the input eye movement data and selecting three task scenario-sensitive eye movement indicators: NNI, fixation duration, and average pupil diameter; and a personnel electroencephalogram (EEG) indicator calculation step for acquiring the input EEG data and selecting five task scenario-sensitive EEG indicators: high_alpha_Fz, high_alpha_Cz, high_alpha_Pz, THA_Fz, and THA_Pz; wherein high_alpha_Fz refers to the power value of the Fz electrode at the midpoint of the frontal lobe in the brain at 10-13 Hz on the EEG, and high_alpha_Cz refers to the power value of the Fz electrode at the midpoint of the frontal lobe in the brain. The power values ​​of the central point Cz electrode at 10–13 Hz on EEG are defined as follows: high_alpha_Pz refers to the power value of the apex Pz electrode at 10–13 Hz on EEG; THA_Fz is the ratio of the power value of the frontal midpoint Fz electrode at 4–8 Hz to that at 10–13 Hz on EEG; THA_Pz is the ratio of the power value of the apex Pz electrode at 4–8 Hz to that at 10–13 Hz on EEG; Personnel performance measurement steps are used to acquire input performance data and select accuracy and reaction time indicators to assess personnel performance; Personnel fatigue measurement steps are used to acquire input fatigue data and select the Stanford Somnolence Scale score to assess personnel fatigue; Personnel workload measurement steps are used to acquire input workload data and select the National Aeronautics and Space Administration (NASA) Mission Load Index (NLASIK) scale. The NASA-TLX Aeronautics and Space Administration Task Load Index score is used to assess personnel workload; the personnel situational awareness measurement step is used to acquire input situational awareness data and select the Situation Awareness Global Assessment Technology (SAGAT) score to assess personnel situational awareness; the calculation and measurement index import step is used to import eye movement and EEG calculation indicators of personnel's work status, as well as measurement indicators of performance, fatigue, workload and situational awareness;

[0011] According to a further aspect of the present invention, the personnel work status analysis sub-step includes a preprocessing step, a personnel work status label construction step, a personnel work status determination step, and a personnel work status result output step. The preprocessing step is used to preprocess the calculated and measured indicators; the personnel work status label construction step is used to construct and optimize personnel work status labels; the personnel work status determination step is used to determine the current personnel work status; and the personnel work status result output step is used to output the determination result of the personnel status. Attached Figure Description

[0012] Figure 1 This is a general structural diagram of a personnel work status assessment system based on eye movement and electroencephalogram (EEG) indicators according to an embodiment of the present invention.

[0013] Figure 2 This is a flowchart illustrating the overall workflow of a personnel work status assessment system based on eye movement and electroencephalogram (EEG) indicators according to an embodiment of the present invention.

[0014] Figure 3 This is a flowchart of a subsystem for calculating and measuring personnel work status indicators according to an embodiment of the present invention. Figure 3 Some characters are too small; try to enlarge them to avoid the patent office rejecting your work and requiring you to redo it.

[0015] Figure 4 This is a flowchart of a personnel work status analysis subsystem according to an embodiment of the present invention.

[0016] Figures 5A-5D This is an example interface diagram of a personnel work status assessment system based on eye movement and electroencephalogram (EEG) indicators according to an embodiment of the present invention. Detailed Implementation

[0017] like Figure 1 As shown, the personnel work status assessment system based on eye movement and electroencephalogram (EEG) indicators according to the present invention includes a personnel work status indicator calculation and measurement subsystem and a personnel work status analysis subsystem. The personnel work status indicator calculation and measurement subsystem includes a measurement data input module, a personnel eye movement indicator calculation module, a personnel EEG indicator calculation module, a personnel performance measurement module, a personnel fatigue measurement module, a personnel workload measurement module, a personnel situational awareness measurement module, and a calculation and measurement indicator import module. The personnel work status analysis subsystem includes a preprocessing module, a personnel work status label construction module, a personnel work status determination module, and a personnel work status result output module.

[0018] In such Figure 2In the configuration and operation embodiment of the personnel work status assessment system based on eye movement and electroencephalogram (EEG) indicators shown, the measurement data input module of the personnel work status indicator calculation and measurement subsystem is first used to input measurement data from different task scenarios. This measurement data is simultaneously input into the personnel eye movement indicator calculation module, personnel EEG indicator calculation module, personnel performance measurement module, personnel fatigue measurement module, personnel workload measurement module, and personnel situational awareness measurement module. Among them, the personnel eye movement indicator calculation module is used to acquire the input eye movement data and select three eye movement indicators that are sensitive to the task scenario: NNI (Near-Neural Interference), fixation duration, and mean pupil diameter. Indicators; Using the personnel EEG indicator calculation module, the input EEG data is acquired, and five EEG indicators sensitive to the task scenario are selected: high_alpha_Fz, high_alpha_Cz, high_alpha_Pz, THA_Fz, and THA_Pz. Here, high_alpha refers to the power value of the EEG at 10-13Hz, THA is the ratio of theta power to high_alpha power, theta is the power value of the EEG at 4-8Hz, and Fz, Cz, and Cz are three electrode points along the midline of the brain; Using the personnel performance measurement module, the input... The system collects performance data and selects accuracy and reaction time indicators to assess personnel performance. It then uses a fatigue assessment module to obtain input fatigue data and selects the Stanford Somnolence Scale score to assess personnel fatigue. Next, it uses a workload assessment module to obtain input workload data and selects the NASA-TLX Mission Load Index score to assess personnel workload. Finally, it uses a situational awareness assessment module to obtain input situational awareness data and SAGAT scores to assess personnel situational awareness. The results are then input into a calculation and measurement indicator import module to import eye movements and other data related to personnel's work status. The system calculates EEG indicators and measures performance, fatigue, workload, and situational awareness. Based on this, the data is fed into the preprocessing module of the personnel work status analysis subsystem for preprocessing the calculated and measured indicators. Then, the preprocessed data is sent to the personnel work status label construction module to obtain and optimize the personnel work status labels. Next, the preprocessed data is sent to the personnel work status determination module to determine the current personnel work status. Finally, the determination result of the personnel work status is output through the personnel work status result output module.

[0019] like Figure 3The diagram illustrates a more specific embodiment of the working process of the personnel work status index calculation and measurement subsystem according to the present invention. After inputting measurement data for different task scenarios into the measurement data input module, data of corresponding categories are acquired using the personnel's eye movement, EEG, performance, fatigue, workload, and situational awareness calculation or measurement modules. Further, indicators sensitive to the task scenario are selected from the eye movement and EEG calculation indicators. Eye movement indicators include NNI, fixation duration, and average pupil diameter; EEG indicators include high_alpha_Fz, high_alpha_Cz, high_alpha_Pz, THA_Fz, and THA_Pz. Similarly, indicators sensitive to the task scenario are selected from the performance, fatigue, workload, and situational awareness measurement indicators. Performance measurement indicators include accuracy and reaction time; fatigue measurement indicators include the Stanford Somnolence Scale score; workload measurement indicators include the NASA-TLX score; and situational awareness measurement indicators include the SAGAT score. Finally, the selection results of the above-mentioned calculation indicators and measurement indicators are input into the calculation and measurement indicator import module of the personnel work status analysis subsystem. This completes the import of task-scenario-sensitive indicators from eye-tracking and EEG calculation indicators into the calculation indicator import module, as well as the import of task-scenario-sensitive indicators from performance, fatigue, workload, and situational awareness measurement indicators into the measurement indicator import module.

[0020] like Figure 4 The diagram illustrates the working process of a personnel work status analysis subsystem according to an embodiment of the present invention. Its workflow includes:

[0021] After completing the import of eye-tracking and EEG calculation indicators, as well as the import of performance, fatigue, workload, and situational awareness measurement indicators in the calculation and measurement indicator import module, the above indicators are fed into equation (1) in the preprocessing module for data standardization.

[0022] x i '=(x i -mean(x i )) / σ(x i (1),

[0023] In equation (1), i = 1 to 12, x i The parameters are fixation duration, nearest neighbor index (NNI), mean pupil size, high alpha Fz, high alpha Cz, high alpha Pz, THA Fz and THA Pz, SAGAT score, NASA-TLX scale score, task accuracy, and task reaction time, respectively. i ) is x i The mean, σ(x)i ) is x i standard deviation, x' i These are the standardized values ​​mentioned above;

[0024] The standardized data x' i The equations (2) of the personnel work status label construction module and (3) to (5) of the personnel work status determination module are further fed into the system.

[0025] H = 0.26*x'9 - 0.31*x' 10 +0.5*(x' 11 -x' 12 (2),

[0026]

[0027]

[0028]

[0029] In equation (2), H is the personnel status score. Based on its value, it is evenly divided into three types of personnel work status: low, medium, and high, in ascending order, so as to define the corresponding personnel status labels. At this time, the personnel work status label results can be viewed, and it can be selected whether to optimize the personnel work status labels. In equations (3) to (5), y1, y2, and y3 represent the low, medium, and high personnel work status, respectively. The maximum value max(y1, y2, y3) determines the actual personnel work status.

[0030] Finally, the results of the personnel's work status are output through the personnel work status result output module.

[0031] like Figures 5A to 5D The diagram shown is a user interface illustration of a personnel work status assessment system based on eye-tracking and electroencephalogram (EEG) indicators, according to a specific example of an embodiment of the present invention. After the system enters the personnel work status assessment system based on eye-tracking and EEG indicators, its main interface is as follows: Figure 5A As shown in the image, this interface contains four buttons: "User Instructions," "Personnel Work Status Indicator Calculation and Measurement Subsystem," "Personnel Work Status Analysis Subsystem," and "Exit System." After entering this interface, the user first clicks the "User Instructions" button to access the user instructions interface, as shown below. Figure 5BAs shown. Users read the system's user manual to understand how to use the system to assess personnel work status based on eye movement and electroencephalogram (EEG) indicators. After reading the manual, click the "Back" button to return to the main interface. When calculating and measuring personnel work status indicators, users click the "Personnel Work Status Indicator Calculation and Measurement Subsystem" button to enter the Personnel Work Status Indicator Calculation and Measurement Subsystem interface, as shown. Figure 5C As shown. First, you can click on the measurement data input module to input the measurement data, and then click on the personnel eye movement index calculation module, personnel EEG index calculation module, personnel performance measurement module, personnel fatigue measurement module, personnel workload measurement module, and personnel situational awareness measurement module to obtain the corresponding data and select the indicators. Selectable indicators include NNI, fixation duration, and mean pupil diameter for eye movements (calculated indicators); high_alpha_Fz, high_alpha_Cz, high_alpha_Pz, THA_Fz, and THA_Pz for EEG (calculated indicators); and accuracy and reaction time for performance evaluation (judgment indicators); Stanford Somnolence Scale score for fatigue; NASA-TLX score for workload data; and SAGAT score for situational awareness. Click the "Import Eye Movement and EEG Calculated Indicators" and "Import Performance, Fatigue, Workload, and Situational Awareness Measurement Indicators" buttons in the Calculated and Measurement Indicators Import module to import the corresponding data. Click "Indicator Confirmation" to complete the selection and saving of calculated and judgment indicators. Alternatively, click "Indicator Export" to export the data. Clicking "Next" returns you to the main page of the personnel work status assessment system based on eye movement and EEG indicators. Clicking "Personnel Work Status Analysis Subsystem" will take you to the personnel work status analysis subsystem interface, as shown below. Figure 5D As shown. First, you can click the "Data Standardization" button in the preprocessing module to complete the data standardization; then, click "Personnel Work Status Label Result" and "Personnel Work Status Label Optimization" in the personnel work status label construction module to save and output the personnel work status label results and optimize and modify the labels; click the "Start Analysis" button, and the personnel work status determination module will display the corresponding y1, y2, y3 and the maximum value, and then the personnel work status result output module will display the determination result of the current personnel work status.

[0032] The advantages and beneficial effects of this invention include:

[0033] (1) A subsystem for calculating and measuring personnel work status indicators is provided. After the measurement data input is completed, eye movement and electroencephalogram calculation indicators, as well as performance, fatigue, workload and situational awareness measurement indicators can be selected and imported.

[0034] (2) A personnel work status analysis subsystem is provided. By carrying out data preprocessing, personnel work status labels are constructed and optimized, thereby outputting the judgment result of personnel work status.

[0035] (3) A method for assessing the work status of personnel based on eye movement and EEG indicators is provided. By simply selecting and importing the eye movement and EEG calculation indicators, as well as the measurement indicators of performance, fatigue, workload and situational awareness, the judgment result of the work status of personnel can be given directly.

[0036] (4) Compared with traditional methods for assessing the work status of personnel based on eye movement and EEG indicators, the present invention can construct and optimize personnel work status labels after completing the input of measurement data, selecting and importing eye movement and EEG calculation indicators, as well as measurement indicators of performance, fatigue, workload and situational awareness, thereby outputting the judgment results of personnel work status. It can be used to directly guide the design of triggering mechanisms for dynamic human-machine function allocation in complex industrial systems, enhance the integration efficiency of humans and systems, and ensure human safety.

Claims

1. A system for assessing the operational status of personnel based on eye-tracking and electroencephalogram (EEG) indicators, characterized in that... include: A) Personnel work status index calculation and measurement subsystem, used to input measurement data in different task scenarios, obtain data including eye movement, EEG, and performance category data, select the corresponding calculation and judgment indicators and import them into the personnel work status analysis subsystem; B) Personnel work status analysis subsystem, used for data preprocessing, constructing and optimizing labels for personnel work status, determining the current personnel work status, and outputting the determination result. in: The personnel work status index calculation and measurement subsystem includes: A1) Measurement data input module, used for inputting measurement data in different task scenarios; A2) The personnel eye movement index calculation module is used to acquire the input eye movement data and select three eye movement indices that are sensitive to the task scenario: the nearest neighbor index (NNI), fixation duration, and average pupil diameter. A3) The EEG index calculation module is used to acquire the input EEG data and select five sensitive EEG indicators that are sensitive to the task scenario: high_alpha_Fz, high_alpha_Cz, high_alpha_Pz, THA_Fz, and THA_Pz. Among them, high_alpha_Fz refers to the power value of the Fz electrode at the midpoint of the frontal lobe in the 10-13 Hz range; high_alpha_Cz refers to the power value of the Cz electrode at the midpoint of the frontal lobe in the 10-13 Hz range; high_alpha_Pz refers to the power value of the Pz electrode at the vertex of the frontal lobe in the 10-13 Hz range; THA_Fz is the ratio of the power value of the Fz electrode at the midpoint of the frontal lobe in the 4-8 Hz range to the power value in the 10-13 Hz range; and THA_Pz is the ratio of the power value of the Pz electrode at the vertex of the frontal lobe in the 4-8 Hz range to the power value in the 10-13 Hz range. A4) The personnel performance measurement module is used to acquire input performance data and select accuracy and reaction time indicators to evaluate personnel performance; A5) The personnel fatigue measurement module is used to acquire input fatigue data and select the Stanford Somnolence Scale score to assess personnel fatigue. A6) Personnel workload measurement module, used to acquire input workload data and select the NASA-TLX score of the American Aerospace Mission Load Index to assess personnel workload; A7) Personnel Situational Awareness Measurement Module, used to acquire input situational awareness data and select the SAGAT score, a comprehensive situational awareness assessment technique, to assess personnel's situational awareness; A8) Calculation and Measurement Index Import Module, used to import eye movement and EEG calculation indicators of personnel's work status, as well as measurement indicators of performance, fatigue, workload, and situational awareness. B) The personnel work status analysis subsystem includes: B1) Preprocessing module, used for preprocessing calculation and measurement indicators, including importing eye-tracking and EEG calculation indicators after completing the calculation and measurement indicator import module, and After the performance, fatigue, workload, and situational awareness measurement indicators are imported, these indicators are fed into equation (1) of the preprocessing module for data standardization: x i '=(x i -mean(x i )) / σ(x i ) (1), in: i＝1～12， x i The parameters included fixation duration, NNI, mean pupil size, high alpha Fz, high alpha Cz, high alpha Pz, THA Fz and THA Pz, SAGAT score, NASA-TLX scale score, task accuracy, and task reaction time. mean(x i ) is x i The mean, σ(x i ) is x i standard deviation x' i These are the standardized values ​​mentioned above; B2) Personnel Work Status Tag Construction Module, used for constructing and optimizing personnel work status tags, including: The standardized data x' i Equation (2) is further fed into the personnel work status label construction module. H=0.26*x'9-0.31*x' 10 +0.5*(x' 11 -x' 12 ) (2), in: H represents the personnel status score. Based on its value, personnel work status is evenly divided into three levels: low, medium, and high, in ascending order. Corresponding personnel status labels are then defined. The results of the personnel work status labels can be viewed, and it can be selected whether to optimize the personnel work status labels. B3) Personnel work status determination module, used to determine the current work status of personnel, including: The standardized data x' i Equations (3) to (5) are sent to the personnel work status determination module: Where y1, y2, and y3 represent the low, medium, and high work status of personnel, respectively, and the maximum value max(y1, y2, y3) indicates the actual work status of the personnel. The results of personnel work status are output through the personnel work status output module; B4) Output module for personnel work status, used to output the determination result of personnel status.

2. The personnel work status assessment system based on eye movement and electroencephalogram (EEG) indicators according to claim 1, characterized in that: The personnel work status calculation and measurement subsystem selects three eye-tracking indicators that are sensitive to tasks: NNI, fixation duration, and average pupil diameter, as well as five electroencephalogram (EEG) indicators: high_alpha_Fz, high_alpha_Cz, high_alpha_Pz, THA_Fz, and THA_Pz. The personnel work status assessment indicators select performance accuracy and reaction time, fatigue Stanford Somnolence Scale score, workload NASA-TLX score, and situational awareness SAGAT score.

3. The personnel work status assessment system based on eye movement and electroencephalogram (EEG) indicators according to claim 1, characterized in that: The personnel work status analysis subsystem first standardized the preprocessing module and then fed the data after table transformation into equation (2); the standardized SAGAT score x'9 and NASA-TLX scale score x'9 were used for the construction of personnel work status labels. 10 The accuracy of the task x' 11 and the reaction time of the task x' 12 The empirical coefficients are 0.26, -0.31, 0.5 and -0.5 respectively; the results of determining the personnel's work status are output based on the maximum values ​​of equations (3) to (5).

4. The personnel work status assessment system based on eye movement and electroencephalogram (EEG) indicators according to claim 1, characterized in that: The personnel work status index calculation and measurement subsystem supports setting specific storage locations and can export indexes in at least one of the following formats: Word, Excel, and PDF. The personnel work status analysis subsystem supports exporting analysis results in at least one of the following formats: Word, Excel, PDF, and PNG.

5. A method for assessing the work status of personnel based on eye movement and electroencephalogram (EEG) indicators, characterized in that... include: C) Personnel work status index calculation and measurement sub-step, used to input measurement data in different task scenarios, obtain data including eye movement, EEG, and performance category data, select the corresponding calculation and judgment indicators and import them into the personnel work status analysis sub-step; D) Personnel work status analysis sub-step, used for data preprocessing, constructing and optimizing labels for personnel work status, determining the current personnel work status, and outputting the determination result of personnel status. in: The sub-steps for calculating and measuring personnel work status indicators include: C1) Measurement data input steps, used for inputting measurement data in different task scenarios; C2) The steps for calculating human eye movement indicators are used to obtain the input eye movement data and select three eye movement indicators that are sensitive to the task scenario: the nearest neighbor index (NNI), fixation duration, and average pupil diameter. C3) Personnel EEG index calculation steps, used to acquire input EEG data and select five sensitive EEG indices sensitive to the task scenario: high_alpha_Fz, high_alpha_Cz, high_alpha_Pz, THA_Fz, and THA_Pz. Among them, high_alpha_Fz refers to the power value of the Fz electrode at the midpoint of the frontal lobe in the 10-13 Hz range; high_alpha_Cz refers to the power value of the Cz electrode at the midpoint of the frontal lobe in the 10-13 Hz range; high_alpha_Pz refers to the power value of the Pz electrode at the vertex of the frontal lobe in the 10-13 Hz range; THA_Fz is the ratio of the power value of the Fz electrode at the midpoint of the frontal lobe in the 4-8 Hz range to the power value in the 10-13 Hz range; and THA_Pz is the ratio of the power value of the Pz electrode at the vertex of the frontal lobe in the 4-8 Hz range to the power value in the 10-13 Hz range. C4) Personnel performance measurement steps, used to obtain input performance data and select accuracy and reaction time indicators to evaluate personnel performance; C5) Personnel fatigue assessment steps, used to obtain input fatigue data and select the Stanford Somnolence Scale score to assess personnel fatigue; C6) Personnel workload determination procedure, used to obtain input workload data and select the NASA-TLX score of the American Aerospace Mission Load Index to assess personnel workload; C7) Personnel situational awareness assessment steps, used to obtain input situational awareness data, and select the SAGAT score, a comprehensive situational awareness assessment technique, to assess personnel's situational awareness; C8) The steps for calculating and measuring indicators are used to import eye-tracking and electroencephalogram (EEG) calculation indicators of personnel's work status, as well as measurement indicators of performance, fatigue, workload, and situational awareness. The sub-steps for personnel work status analysis include: D1) Preprocessing step, used for preprocessing the calculation and measurement indicators. After completing the import of eye-tracking and electroencephalogram (EEG) calculation indicators, as well as the import of performance, fatigue, workload, and situational awareness indicators in the calculation and measurement indicator import steps, the above indicators are fed into equation (1) in the preprocessing step for data standardization: x i '=(x i -mean(x i )) / σ(x i ) (1), in: i＝1～12， x i The parameters included fixation duration, NNI, mean pupil size, high alpha Fz, high alpha Cz, high alpha Pz, THA Fz and THA Pz, SAGAT score, NASA-TLX scale score, task accuracy, and task reaction time. mean(x i ) is x i The mean, σ(x i ) is x i standard deviation x' i These are the standardized values ​​mentioned above; D2) Personnel job status label construction steps, used to construct and optimize personnel job status labels, including: The standardized data x' i The equation (2) for the personnel work status label construction step is further fed into. H=0.26*x'9-0.31*x' 10 +0.5*(x' 11 -x' 12 ) (2), in: H represents the personnel status score. Based on its value, personnel work status is evenly divided into three levels: low, medium, and high, in ascending order. This results in the determination of corresponding personnel status labels. At this point, the results of the personnel work status labels can be viewed, and the decision can be made on whether to optimize the personnel work status labels. D3) Personnel work status determination step, used to determine the current work status of personnel, including: The standardized data x' i Equations (3) to (5) for the steps of determining the working status of the personnel being sent in. Where: y1, y2, and y3 represent the low, medium, and high working status of personnel, respectively, and the maximum value max(y1, y2, y3) is used to determine the actual working status of personnel. The output step is to output the results of the personnel's work status. D4) Output the result of the personnel's work status, which is used to output the judgment result of the personnel status.

6. The method for assessing personnel work status based on eye movement and electroencephalogram (EEG) indicators according to claim 5, characterized in that: The calculation and measurement of personnel work status indicators included three eye-tracking indicators sensitive to tasks (NNI, fixation duration, and mean pupil diameter) and five electroencephalogram (EEG) indicators (high_alpha_Fz, high_alpha_Cz, high_alpha_Pz, THA_Fz, and THA_Pz). The indicators for judging personnel work status included performance accuracy and reaction time, fatigue (Stanford Somnolence Scale score), workload (NASA-TLX score), and situational awareness (SAGAT score).

7. The method for assessing personnel work status based on eye movement and electroencephalogram (EEG) indicators according to claim 5, characterized in that: The personnel work status analysis sub-step first standardized the preprocessing operations and then fed the transformed data into equation (2); the standardized SAGAT score x'9 and NASA-TLX scale score x'9 were used to construct the personnel work status labels. 10 The accuracy of the task x' 11 and the reaction time of the task x' 12 The empirical coefficients are 0.26, -0.31, 0.5 and -0.5 respectively; the results of determining the personnel's work status are output based on the maximum values ​​of equations (3) to (5).

8. The method for assessing personnel work status based on eye movement and electroencephalogram (EEG) indicators according to claim 5, characterized in that: The sub-step for calculating and measuring personnel work status indicators supports setting specific storage locations and can export indicators in at least one format, including Word, Excel, and PDF. The personnel work status analysis sub-step supports exporting analysis results in at least one of the following formats: Word, Excel, PDF, and PNG.

9. A computer-readable storage medium storing a computer-executable program that enables a processor to perform the method according to any one of claims 5-8.

Images