Man-machine work efficiency test system and evaluation method thereof

Abstract

The invention relates to the technical field of flight safety cockpit multi-person collaborative interaction design and measurement, and discloses a man-machine ergonomics test system, which comprises a data acquisition module, a data division module, a first calculation module, a data classification module, a second calculation module, a display and report module and a virtual simulation platform, the data acquisition module is used for simulating measurement and simulation data collection in the flight process; the data division module divides the measurement and simulation data into multiple groups of flight personnel unit initial data according to preset duration; the first calculation module obtains the initial data and performs correlation calculation on the target data; the data classification module classifies multiple groups of data to form a data set; the second calculation module processes the data set; the display and report module displays the processed data in a visual form; the virtual simulation platform is used for constructing a simulation flight environment. According to the invention, the operation state and man-machine work efficiency of the pilot are comprehensively evaluated, and the comprehensiveness and depth of data processing are improved.

Description

Technical Field

[0001] The present invention relates to the technical field of multi-person collaborative interaction design and measurement of a flight safety cockpit, and in particular to a human-machine ergonomics testing system and an evaluation method thereof. Background Art

[0002] Human factors are important factors that affect the performance and flight safety of aircraft, and the cockpit is the main working environment for pilots to perform flight operations. China's civil aviation regulations regulate the impact of the cockpit on human factors in many regulations, requiring that the "cockpit and its equipment" must provide the aircraft operator with a "sufficiently wide, clear and undistorted view" and must ensure "convenient operation and prevent confusion and misoperation" so that the crew "will not be overly focused or fatigued" when performing their duties.

[0003] After searching, the Chinese patent number CN109145485B discloses a human-machine ergonomics test method, including: obtaining measurement and simulation data based on preset display and control layout parameters during simulated flight; dividing the measurement and simulation data according to a predetermined time length to obtain multiple groups of flight human factor unit initial data; based on each group of flight human factor unit initial data, obtaining the human-machine ergonomics result data of the flight human factor unit through human-machine ergonomics calculation; classifying multiple groups of human-machine ergonomics result data according to preset scenario constraints to obtain the human-machine ergonomics result data set of the preset display and control layout parameters and the preset scenario constraints of the pilot's operation. This application can more intuitively obtain the relationship between the human-machine ergonomics result statistics and the changes in the cockpit display and control layout parameters, and at the same time facilitate the rapid iteration and optimization design of the cockpit display and control layout design.

[0004] Many existing test systems are designed only for specific application scenarios, lacking sufficient flexibility and scalability, and are difficult to cover complex and changeable actual working environments. Although some systems can record data during human-computer interaction, they are insufficient in terms of real-time, accuracy, and comprehensiveness of data processing, and are difficult to provide in-depth performance analysis reports. Based on this, the present invention designs a human-machine ergonomics test system and its evaluation method to solve the above problems. Summary of the invention

[0005] The purpose of the present invention is to provide an ergonomics testing system and an evaluation method thereof, which solve the problem of insufficient accuracy and flexibility in the background technology.

[0006] In order to solve the above technical problems, the present invention provides the following technical solutions:

[0007] A human-machine ergonomics testing system includes a data acquisition module, a data division module, a first calculation module, a data classification module, a second calculation module, a display and reporting module and a virtual simulation platform.

[0008] Data acquisition module: The data acquisition module is used to collect measurement and simulation data during simulated flight under preset display and control layout parameters;

[0009] Data division module: divides the above measurement and simulation data into multiple groups of flight personnel unit initial data according to the predetermined duration, so as to facilitate subsequent data processing and analysis;

[0010] The first calculation module: obtains the initial data, performs correlation calculation on the target data, and obtains the ergonomics result data of the flight human factors unit;

[0011] Data classification module: classifies multiple groups of ergonomics result data according to preset scenario constraints to form a ergonomics result data set of pilot operations under preset display and control layout parameters and preset scenario constraints;

[0012] The second calculation module processes the ergonomics result data set after the above classification to obtain ergonomics test data;

[0013] Display and reporting module: displays the processed data in a visual form and generates a detailed ergonomic performance analysis report;

[0014] Virtual simulation platform: used to build a simulated flight environment, simulate different display and control layout parameters and flight scenarios to verify and optimize the performance of the test system.

[0015] Preferably, the data acquisition module also includes a signal preprocessing unit for filtering, denoising and standardizing the captured eye signals, hand signals, physiological signals, limb signals, control signals and flight signals.

[0016] Preferably, the data division module further includes a dynamic adjustment unit, which dynamically adjusts the predetermined duration according to the complexity of the flight mission and the pilot's operating behavior to ensure that the initial data of each flight human factors unit contains sufficient and appropriate information.

[0017] Preferably, the first calculation module includes the following units:

[0018] Process data calculation unit: Based on each set of initial data of flight human factors unit, the flight human factors unit process data such as operation reaction time, operation completion time and operation deviation are calculated;

[0019] Target data calculation unit: Based on the process data, the human-machine ergonomics calculation model is used to obtain the flight human factors unit target data such as cognitive response, workload, control activities and performance results. The human-machine ergonomics calculation model uses a deep learning algorithm to accurately predict the pilot's cognitive response, workload, control activities and performance results by training a large amount of historical flight data;

[0020] Correlation calculation unit: performs correlation calculation on target data to obtain the ergonomics result data of the flight human factors unit;

[0021] Anomaly detection unit: used to identify and mark abnormal values ​​or abnormal patterns in process data so that these anomalies can be excluded or specially considered in subsequent data analysis and processing;

[0022] The first computing module also includes multi-source data analysis technology, which can comprehensively process multi-source data such as eye signals, hand signals, physiological signals, etc. to comprehensively evaluate the pilot's operating status and ergonomics.

[0023] Preferably, the data classification module includes the following technologies:

[0024] Wireless sensor technology: It uses a combination of wireless radio frequency and Bluetooth technology to ensure high-quality data transmission at high speeds without any constraints or interference to the subjects.

[0025] Synchronous recording technology: Realize real-time synchronous recording and tracking of psychological, physiological and behavioral data at the same time point or time period;

[0026] The data classification module also includes a custom scene setting unit, which allows the user to customize the flight phase, flight event or flight process according to specific test requirements.

[0027] Preferably, in the second calculation module, the ergonomics result data set is weighted averaged to obtain a statistical value of the ergonomics result, which is the ergonomics test data under the preset display and control layout parameters and preset scenario constraints; the second calculation module also includes a weight allocation unit, which allows the user to customize the weight of the weighted average according to the importance of different scenarios or indicators.

[0028] Preferably, the display and reporting module includes an interactive analysis interface, allowing users to intuitively explore ergonomic results data through operations such as dragging and zooming, and supports exporting detailed reports in multiple formats (such as PDF, Excel, CSV).

[0029] Preferably, the display and reporting module includes a trend prediction unit, which predicts the ergonomic performance of pilots in future flight missions based on historical data and current test results.

[0030] Preferably, the ergonomic performance analysis report includes key indicators of operating efficiency, fatigue status, and cognitive load.

[0031] Preferably, a method for evaluating an ergonomics test system comprises the following steps:

[0032] Step S1: using a data acquisition module to acquire measurement and simulation data during a simulated flight based on preset display and control layout parameters;

[0033] Step S2: Dividing the measurement and simulation data according to a predetermined time period to obtain multiple groups of flight crew unit initial data;

[0034] Step S3: Based on each group of initial data of the flight human factor unit, the ergonomic result data of the flight human factor unit is obtained through calculation by the first calculation module;

[0035] Step S4: classify the multiple groups of ergonomics result data according to the preset scenario constraints to obtain the ergonomics result data set of the pilot's operation under the preset display and control layout parameters and the preset scenario constraints;

[0036] Step S5: performing weighted averaging on the ergonomics result data set to obtain a statistical value of the ergonomics result, which is the ergonomics test data under the preset display and control layout parameters and preset scene constraints;

[0037] Step S6: Through the display and reporting module, the test results are displayed in a visual form and a detailed ergonomic performance analysis report is generated.

[0038] Compared with the prior art, the beneficial effects achieved by the present invention are:

[0039] 1. The present invention, by constructing a virtual simulation platform, can simulate different display and control layout parameters and flight scenarios, so that the test system is no longer limited to specific application scenarios and can flexibly cope with complex and changeable actual working environments. This design greatly enhances the scalability of the system and provides the ability to quickly respond to new scenarios and new requirements in the future.

[0040] 2. In the present invention, the signal preprocessing unit integrated in the data acquisition module effectively improves the data filtering, denoising and standardization processing capabilities, ensuring the accuracy and reliability of the data. At the same time, the introduction of multi-source data analysis technology enables the system to comprehensively process multi-source data such as eye signals, hand signals, physiological signals, etc., and comprehensively evaluate the pilot's operating status and ergonomics, thereby improving the comprehensiveness and depth of data processing.

[0041] 3. In the present invention, the first calculation module uses a human-machine ergonomics calculation model constructed by a deep learning algorithm, which can accurately predict the pilot's cognitive response, workload, control activities and performance results by training a large amount of historical flight data. In addition, the anomaly detection unit can timely detect and process abnormal values ​​or abnormal patterns in the data, further improving the accuracy and scientificity of the evaluation results. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] Figure 1It is a system composition diagram of the present invention;

[0043] Figure 2 It is a diagram showing the system modules and technologies of the present invention;

[0044] Figure 3 The figure is a flow chart of the testing method of the present invention. DETAILED DESCRIPTION

[0045] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0046] Embodiment 1;

[0047] See also Figure 1-Figure 2 In an embodiment of the present invention, an ergonomics testing system includes a data acquisition module, a data division module, a first calculation module, a data classification module, a second calculation module, a display and reporting module and a virtual simulation platform.

[0048] Data acquisition module: The data acquisition module is used to collect measurement and simulation data during simulated flight under preset display and control layout parameters;

[0049] Data division module: divides the above measurement and simulation data into multiple groups of flight personnel unit initial data according to the predetermined duration, so as to facilitate subsequent data processing and analysis;

[0050] The first calculation module: obtains the initial data, performs correlation calculation on the target data, and obtains the ergonomics result data of the flight human factors unit;

[0051] Data classification module: classifies multiple groups of ergonomics result data according to preset scenario constraints to form a ergonomics result data set of pilot operations under preset display and control layout parameters and preset scenario constraints;

[0052] The second calculation module processes the ergonomics result data set after the above classification to obtain ergonomics test data;

[0053] Display and reporting module: displays the processed data in a visual form and generates a detailed ergonomic performance analysis report;

[0054] Virtual simulation platform: used to build a simulated flight environment, simulate different display and control layout parameters and flight scenarios to verify and optimize the performance of the test system.

[0055] like Figure 2As shown, the data acquisition module also includes a signal preprocessing unit for filtering, denoising and standardizing the captured eye signals, hand signals, physiological signals, limb signals, control signals and flight signals.

[0056] like Figure 2 As shown, the data division module further includes a dynamic adjustment unit, which dynamically adjusts the predetermined duration according to the complexity of the flight mission and the pilot's operating behavior to ensure that the initial data of each flight human factor unit contains sufficient and appropriate information.

[0057] like Figure 2 As shown, the first calculation module includes the following units:

[0058] Process data calculation unit: Based on each set of initial data of flight human factors unit, the flight human factors unit process data such as operation reaction time, operation completion time and operation deviation are calculated;

[0059] Target data calculation unit: Based on the process data, the human-machine ergonomics calculation model is used to obtain the flight human factors unit target data such as cognitive response, workload, control activities and performance results. The human-machine ergonomics calculation model uses a deep learning algorithm to accurately predict the pilot's cognitive response, workload, control activities and performance results by training a large amount of historical flight data;

[0060] Correlation calculation unit: performs correlation calculation on target data to obtain the ergonomics result data of the flight human factors unit;

[0061] Anomaly detection unit: used to identify and mark abnormal values ​​or abnormal patterns in process data so that these anomalies can be excluded or specially considered in subsequent data analysis and processing;

[0062] The first computing module also includes multi-source data analysis technology, which can comprehensively process multi-source data such as eye signals, hand signals, physiological signals, etc. to comprehensively evaluate the pilot's operating status and ergonomics.

[0063] The data classification module includes the following techniques,

[0064] Wireless sensor technology: It uses a combination of wireless radio frequency and Bluetooth technology to ensure high-quality data transmission at high speeds without any constraints or interference to the subjects.

[0065] Synchronous recording technology: Realize real-time synchronous recording and tracking of psychological, physiological and behavioral data at the same time point or time period;

[0066] The data classification module also includes a custom scenario setting unit that allows users to customize flight phases, flight events or flight processes according to specific test requirements.

[0067] like Figure 2 As shown, in the second calculation module, the ergonomics result data set is weighted averaged to obtain a statistical value of the ergonomics result, which is the ergonomics test data under the preset display and control layout parameters and preset scenario constraints; the second calculation module also includes a weight allocation unit, which allows the user to customize the weight of the weighted average according to the importance of different scenarios or indicators.

[0068] The working principle of the embodiment of the present invention is as follows: the data acquisition module is the front end of the system, which is responsible for real-time capture and collection of various types of data during the simulated flight process under the preset display and control layout parameters, including eye signals, hand signals, physiological signals (such as electrocardiogram, electromyography, skin electricity, etc.), limb signals, control signals and flight status signals. The module has a built-in signal preprocessing unit to filter, denoise and standardize the captured signals to ensure data quality and lay a solid foundation for subsequent analysis.

[0069] The data partitioning module divides the pre-processed measurement and simulation data into multiple groups of flight personnel unit initial data according to the predetermined duration (the duration can be dynamically adjusted to adapt to the complexity of different flight missions). The dynamic adjustment unit flexibly adjusts the predetermined duration according to the actual situation of the flight mission and the pilot's operating behavior to ensure that each group of data contains sufficient information but is not too long, which is convenient for subsequent processing and analysis.

[0070] The first calculation module is the core processing unit of the system, which includes multiple sub-units working together. The process data calculation unit calculates key process data such as operation reaction time, operation completion time and operation deviation based on the initial data of each set of flight human factors unit. The target data calculation unit uses the ergonomics calculation model (based on deep learning algorithm training) combined with process data to accurately predict the pilot's cognitive response, workload, control activities and performance results. The correlation calculation unit performs correlation analysis on the target data to obtain the ergonomics result data of the flight human factors unit. The anomaly detection unit identifies and marks abnormal values ​​or patterns in the process, providing important reference for data analysis and processing. Multi-source data analysis technology comprehensively processes multi-source data such as eyes, hands, and physiology to achieve a comprehensive assessment of the pilot's operating status.

[0071] The data classification module uses wireless sensing technology and synchronous recording technology to ensure real-time synchronous recording and tracking of psychological, physiological and behavioral data at the same time point or time period. Through the custom scene setting unit, users can flexibly set flight stages, events or processes according to specific test needs to achieve effective classification and organization of data.

[0072] The second calculation module performs weighted average processing on the classified ergonomics result data set to obtain the ergonomics result statistics. The weight allocation unit allows the user to customize the weight of the weighted average according to the importance of the scene or indicator to ensure the objectivity and accuracy of the test results.

[0073] Embodiment 2;

[0074] See also Figure 1-Figure 2 In an embodiment of the present invention, the display and reporting module includes an interactive analysis interface, which allows users to intuitively explore ergonomic result data through operations such as dragging and zooming, and supports exporting detailed reports in multiple formats (such as PDF, Excel, and CSV).

[0075] The display and reporting module includes a trend prediction unit that predicts the pilot's ergonomic performance in future flight missions based on historical data and current test results.

[0076] The ergonomics performance analysis report includes key indicators of operational efficiency, fatigue status, and cognitive load.

[0077] The working principle of the embodiment of the present invention is as follows: the display and reporting module provides an interactive analysis interface, and users can intuitively explore the ergonomics result data through operations such as dragging and zooming. The module has an embedded trend prediction unit, which predicts the ergonomics performance of pilots in future flight missions based on historical data and current test results. Finally, the system generates an ergonomics performance analysis report containing key indicators such as operating efficiency, fatigue status, cognitive load, etc., and supports export in multiple formats to facilitate users to further analyze and make decisions.

[0078] Embodiment 3;

[0079] See also Figure 1-Figure 3 In an embodiment of the present invention, a method for evaluating an ergonomics testing system includes the following steps:

[0080] Step S1: using a data acquisition module to acquire measurement and simulation data during a simulated flight based on preset display and control layout parameters;

[0081] Step S2: Divide the measurement and simulation data according to a predetermined time period to obtain multiple groups of flight crew unit initial data;

[0082] Step S3: Based on each group of initial data of the flight human factor unit, the ergonomic result data of the flight human factor unit is obtained through calculation by the first calculation module;

[0083] Step S4: classify the multiple groups of ergonomics result data according to the preset scenario constraints to obtain the ergonomics result data set of the pilot's operation under the preset display and control layout parameters and the preset scenario constraints;

[0084] Step S5: weighted averaging the ergonomics result data set to obtain a statistical value of the ergonomics result, which is the ergonomics test data under the preset display and control layout parameters and preset scene constraints;

[0085] Step S6: Through the display and reporting module, the test results are displayed in a visual form and a detailed ergonomic performance analysis report is generated.

[0086] The working principle of the embodiment of the present invention is as follows: Data acquisition uses a data acquisition module to capture and collect various types of data in the simulated flight process in real time under preset display and control layout parameters. Data preprocessing filters, denoises and standardizes the captured data to improve data quality. Data division divides the preprocessed data into multiple groups of flight human factor unit initial data according to a predetermined duration, and dynamically adjusts the duration as needed. Process and target data calculation is performed through a first calculation module to calculate key process data and target data, and perform correlation analysis and anomaly detection. Data classification uses wireless sensing and synchronous recording technology to classify and organize the ergonomics result data according to preset scenario constraints. Result statistics and analysis The second calculation module performs weighted average processing on the classified data to obtain the ergonomics result statistics. Display and report Through the display and report module, the test results are displayed in a visual form, and a detailed ergonomics performance analysis report is generated.

[0087] Working principle: The ergonomics test system uses data acquisition, division, calculation, classification, recalculation, display and reporting modules, combined with a virtual simulation platform, to comprehensively evaluate the pilot's operating efficiency, fatigue status and cognitive load in different display and control layouts and flight scenarios. The system first collects multi-source data from simulated flights, divides data units according to a predetermined duration after pre-processing, calculates ergonomics results using a deep learning algorithm, and then processes the data according to preset scenarios. Finally, statistical values ​​are obtained through weighted average and a visual report is generated, providing a scientific basis for optimizing flight display and control layouts and improving ergonomics.

[0088] Although the embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and alterations may be made to the embodiments without departing from the principles and spirit thereof, and the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A human-machine ergonomics testing system, comprising a data acquisition module, a data division module, a first calculation module, a data classification module, a second calculation module, a display and reporting module and a virtual simulation platform, characterized in that: Data acquisition module: The data acquisition module is used to collect measurement and simulation data during simulated flight under preset display and control layout parameters; Data division module: divides the above measurement and simulation data into multiple groups of flight personnel unit initial data according to the predetermined duration, so as to facilitate subsequent data processing and analysis; The first calculation module: obtains the initial data, performs correlation calculation on the target data, and obtains the ergonomics result data of the flight human factors unit; Data classification module: classifies multiple groups of ergonomics result data according to preset scenario constraints to form a ergonomics result data set of pilot operations under preset display and control layout parameters and preset scenario constraints; The second calculation module processes the ergonomics result data set after the above classification to obtain ergonomics test data; Display and reporting module: displays the processed data in a visual form and generates a detailed ergonomic performance analysis report; Virtual simulation platform: used to build a simulated flight environment, simulate different display and control layout parameters and flight scenarios to verify and optimize the performance of the test system.

2. The ergonomics testing system according to claim 1, characterized in that: The data acquisition module also includes a signal preprocessing unit for filtering, denoising and standardizing the captured eye signals, hand signals, physiological signals, limb signals, control signals and flight signals.

3. The ergonomics testing system according to claim 1, characterized in that: The data division module further includes a dynamic adjustment unit, which dynamically adjusts the predetermined duration according to the complexity of the flight mission and the pilot's operating behavior to ensure that the initial data of each flight human factor unit contains sufficient and appropriate information.

4. The ergonomics testing system according to claim 1, characterized in that: The first calculation module includes the following units: Process data calculation unit: Based on each set of initial data of flight human factors unit, the flight human factors unit process data such as operation reaction time, operation completion time and operation deviation are calculated; Target data calculation unit: Based on the process data, the human-machine ergonomics calculation model is used to obtain the flight human factors unit target data such as cognitive response, workload, control activities and performance results. The human-machine ergonomics calculation model uses a deep learning algorithm to accurately predict the pilot's cognitive response, workload, control activities and performance results by training a large amount of historical flight data; Correlation calculation unit: performs correlation calculation on target data to obtain the ergonomics result data of the flight human factors unit; Anomaly detection unit: used to identify and mark abnormal values ​​or abnormal patterns in process data so that these anomalies can be excluded or specially considered in subsequent data analysis and processing; The first computing module also includes multi-source data analysis technology, which can comprehensively process multi-source data such as eye signals, hand signals, physiological signals, etc. to comprehensively evaluate the pilot's operating status and ergonomics.

5. The ergonomics testing system according to claim 1, characterized in that: The data classification module includes the following technologies, Wireless sensor technology: It uses a combination of wireless radio frequency and Bluetooth technology to ensure high-quality data transmission at high speeds without any constraints or interference to the subjects. Synchronous recording technology: Realize real-time synchronous recording and tracking of psychological, physiological and behavioral data at the same time point or time period; The data classification module also includes a custom scene setting unit, which allows the user to customize the flight phase, flight event or flight process according to specific test requirements.

6. The ergonomics testing system according to claim 1, characterized in that: In the second calculation module, the ergonomics result data set is weighted averaged to obtain a statistical value of the ergonomics result, which is the ergonomics test data under the preset display and control layout parameters and preset scenario constraints; the second calculation module also includes a weight allocation unit, which allows the user to customize the weight of the weighted average according to the importance of different scenarios or indicators.

7. The ergonomics testing system according to claim 1, characterized in that: The display and reporting module includes an interactive analysis interface that allows users to intuitively explore ergonomic results data through operations such as dragging and dropping, and zooming, and supports exporting detailed reports in multiple formats (such as PDF, Excel, and CSV).

8. The ergonomics testing system according to claim 1, characterized in that: The display and reporting module includes a trend prediction unit that predicts the ergonomic performance of pilots in future flight missions based on historical data and current test results.

9. The ergonomics testing system according to claim 1, characterized in that: The ergonomics performance analysis report includes key indicators of operating efficiency, fatigue status, and cognitive load.

10. The method for evaluating an ergonomics test system according to any one of claims 1 to 9, characterized in that: The following steps are included: Step S1: using a data acquisition module to acquire measurement and simulation data during a simulated flight based on preset display and control layout parameters; Step S2: Dividing the measurement and simulation data according to a predetermined time period to obtain multiple groups of flight crew unit initial data; Step S3: Based on each group of initial data of the flight human factor unit, the ergonomic result data of the flight human factor unit is obtained through calculation by the first calculation module; Step S4: classify the multiple groups of ergonomics result data according to the preset scenario constraints to obtain the ergonomics result data set of the pilot's operation under the preset display and control layout parameters and the preset scenario constraints; Step S5: performing weighted averaging on the ergonomics result data set to obtain a statistical value of the ergonomics result, which is the ergonomics test data under the preset display and control layout parameters and preset scene constraints; Step S6: Through the display and reporting module, the test results are displayed in a visual form and a detailed ergonomic performance analysis report is generated.

Images