Flight training evaluation system for situational awareness and information management

Abstract

The application discloses a flight training evaluation system for situational awareness and information management, which comprises a trajectory tracking unit, a response unit, a fuel tank state unit, a communication unit and an evaluation unit. Seven behavior indexes of situational awareness and information management (SAW) competency are quantified into seven calculation formulas, and the competency of a testee is evaluated through the work performance of the testee in a multitask test.

Description

Technical Field

[0001] This invention relates to a technology in the field of flight control, specifically a flight training and evaluation system for situational awareness and information management. Background Technology

[0002] Existing flight simulation technology is difficult to effectively compare with the evaluation results of the theoretical learning stage, and cannot provide accurate reference for subsequent learning and training. Summary of the Invention

[0003] To address the aforementioned shortcomings of existing technologies, this invention proposes a flight training assessment system for situational awareness and information management (SAW). The system quantifies seven behavioral indicators of SAW competence into seven calculation formulas, and assesses the competence of test subjects based on their work performance in multi-task tests.

[0004] This invention is achieved through the following technical solution:

[0005] This invention relates to a flight training evaluation system for situational awareness and information management, comprising: a trajectory tracking unit, a response unit, a fuel tank status unit, a communication unit, and an evaluation unit. The trajectory tracking unit performs tracking frame operation processing based on target location information to obtain the tracking trajectory result; the response unit performs alarm response processing based on warning light status and instrument parameter information to obtain the response event type and response time result; the fuel tank status unit performs fuel pump control processing based on fuel tank level information to obtain the fuel level maintenance status result; the communication unit performs option matching processing based on voice broadcast information to obtain the communication response correctness result; and the evaluation unit performs timeline display processing based on multi-task status information to obtain behavioral indicators.

[0006] The behavioral indicators include: monitoring and evaluating the status of the aircraft and systems; monitoring and evaluating the aircraft's energy status and projected flight path; monitoring and evaluating the overall environment that may affect operations; verifying the accuracy of information and checking for errors; the overall performance of the subjects in the system monitoring and resource management unit; and the comparison of the overall performance of the trajectory tracking unit, response unit, fuel tank status unit, and communication unit in the first five minutes with the overall performance in the last five minutes.

[0007] The aforementioned monitoring and evaluation of the aircraft and system status, and assessment of the gaze duration of the time-planning and trajectory tracking units, specifically includes: ,in: and This refers to the participant's attention allocation score in the time planning and trajectory tracking units, with 60% and 40% as weighted values. Attention Allocation Score , This refers to the actual fixation time. This is the optimal fixation time.

[0008] The aforementioned trajectory tracking refers to the movement of the target box adopting a time-varying motion mode, with its trajectory generated by a random process, including dynamic changes in velocity, acceleration, and direction parameters, to simulate the unsteady motion characteristics of the target object in a real flight environment.

[0009] The aforementioned time planning refers to: using an independent dynamic timeline to visualize the evolution of multiple task states in real time, providing operators with intuitive priority decision support.

[0010] The monitoring and evaluation of the aircraft's energy state and predicted flight path, and the assessment of the subjects' performance in the resource management and trajectory tracking units, specifically the achievement rate in the resource management unit and the tracking success rate in the trajectory tracking unit, are as follows:

[0011] , ,in: The total time taken for the unit to correctly complete the task. The total test duration for the unit is in seconds.

[0012] The monitoring and evaluation described may affect the overall operating environment. The assessment evaluates whether the participants' attention allocation across the three units—system monitoring, resource management, and information reception—is reasonable, specifically as follows: ,in: , Attention scores are assigned to the system monitoring unit, resource management unit, and information receiving unit.

[0013] The system monitoring mentioned refers to: fault display format and subject operation feedback signals.

[0014] The accuracy of the verification information is checked and errors are examined. The performance score of the subjects in completing the task in the information receiving unit is evaluated, specifically as follows:

[0015] The overall performance of the test subjects in the system monitoring and resource management unit is specifically as follows: , , ,in: .

[0016] The comparison of the total performance of the trajectory tracking unit, response unit, fuel tank status unit, and communication unit in the first five minutes and the last five minutes is as follows: , ,in: , .

[0017] Technical effect

[0018] This invention utilizes an integrated crew competency testing hardware system that combines multi-unit collaborative acquisition, hardware-level data fusion, and quantitative evaluation. It integrates five functional hardware units of the AE (trajectory tracking, system monitoring, fuel tank management, information reception, and time planning) with an eye tracker. Through a hardware-level time synchronization mechanism (synchronization error ≤5ms), it collects multi-dimensional data on subject behavior, attention allocation, and response speed in parallel. After cross-validation and fusion, the data supports comprehensive evaluation, overcoming the limitations of existing single-unit acquisition and data fragmentation. The computer-readable storage medium is deeply adapted to multiple units, and pre-stored computer programs can directly drive the startup, parameter configuration, and parallel acquisition of each hardware unit. Through program instructions, hardware resources are invoked to perform joint quantitative calculations of seven core indicators on the multi-unit fused data, achieving integrated operation of the entire process from acquisition to fusion to calculation to storage. This solves the problem of hardware, program, and storage media being disconnected in existing technologies. Compared with existing technologies, this invention improves the comprehensiveness and accuracy of data acquisition: through multi-unit parallel acquisition and hardware timing synchronization mechanism, it covers multi-dimensional data such as subject operation behavior and attention allocation; the computer-readable storage medium is deeply adapted to multiple units and can be directly ported to different types of flight evaluation hardware platforms; the quantitative calculation output of multi-unit fused data outputs standardized results, realizing horizontal comparability of results for different subjects and different test stages (verified through cross-platform testing in subsequent embodiments); and it ensures the security and traceability of data storage: the storage medium supports encrypted storage of multi-unit acquired data, and can completely retain the data of the entire process of "acquisition-fusion-computation", providing traceable hardware-level data support for evaluation review and process optimization.

[0019] Attached image caption

[0020] Figure 1 This is a flowchart of the present invention. Detailed Implementation

[0021] like Figure 1 As shown in this embodiment, a flight training assessment system for situational awareness and information management (SAW) is provided. After testing on a crew competency testing platform, test subjects receive an operation log file of the entire testing process. During the test, test subjects wear an eye tracker to record the distribution of fixation points. By statistically analyzing these fixation points, the fixation duration for each module can be obtained. The method of this invention performs detailed calculations on the data in the operation log file and the fixation duration for each module to obtain seven behavioral indicators of situational awareness and information management (SAW) competency.

[0022] The experiment was conducted using a crew competency testing hardware system. 340 newly hired pilots and 237 experienced pilots with more than 3 years of flying experience each completed 3 sets of simulated tasks. The results showed that the average score of the situational awareness and information management (SAW) comprehensive competency of the newly hired pilots was 59.7, while the average score of the experienced pilots was 84.2. The scores of the two groups were significantly different after independent samples t test (t=21.36, P<0.01), which verifies that the hardware system can effectively distinguish the core competency levels of personnel with different experience levels.

[0023] Compared with existing technologies, this invention adopts multi-module collaborative acquisition and hardware timing synchronization technology (synchronization error ≤5ms), and the data acquisition dimensions cover multiple dimensions of objective data such as operational behavior and attention allocation, solving the problem of data fragmentation in existing technologies. Through the quantitative calculation formula of 7 SAW core indicators and the joint operation of multi-module fused data, horizontal comparability is achieved for different qualifications and different testing stages, breaking through the limitations of subjective evaluation or single-dimensional assessment in existing technologies. The deep adaptation design of computer-readable storage media and multi-module hardware improves the cross-platform portability compatibility of the system. The innovative hardware design, such as the time-varying motion mode of the trajectory tracking module and the closed-loop feedback of system monitoring faults, improves the fit between the test scenario and the real flight environment.

[0024] Corresponding to the above method, the present invention also provides a system comprising a computer device, the computer device including a processor, a memory, an eye-tracking acquisition device, and a heart rate acquisition device, the memory storing computer instructions and final test data, the processor executing the computer instructions stored in the memory, and the eye-tracking and heart rate acquisition devices acquiring corresponding physiological data and storing them in the memory. When the computer instructions are executed by the processor, the system implements the steps of the method described above.

[0025] The system of this invention is an evaluation system suitable for pilots, derived by collecting performance data and physiological data, which helps in the selection and evaluation of pilots; and the system of this invention is based on the dual evaluation of expert experience and machine learning algorithms, making the evaluation more objective and accurate; this invention comprehensively considers the cognitive level of pilots in various dimensions, and the evaluation results have high ecological validity.

[0026] This invention also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the steps of the aforementioned edge computing server deployment method. The computer-readable storage medium can be a tangible storage medium, such as random access memory (RAM), main memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, floppy disks, hard disks, removable storage disks, CD-ROMs, or any other form of storage medium known in the art.

[0027] The above-described specific implementations can be partially adjusted by those skilled in the art in different ways without departing from the principles and purpose of the present invention. The scope of protection of the present invention is defined by the claims and is not limited to the above-described specific implementations. All implementation schemes within the scope of the claims are bound by the present invention.

Claims

1. A flight training assessment system for situational awareness and information management, characterized in that, include: The system includes a trajectory tracking unit, a response unit, a fuel tank status unit, a communication unit, and an evaluation unit. Specifically: the trajectory tracking unit performs tracking frame operation processing based on the target location information to obtain the tracking trajectory result; the response unit performs alarm response processing based on the warning light status and instrument parameter information to obtain the response event type and response time result; and the fuel tank status unit performs oil pump control processing based on the fuel tank level information to obtain the level maintenance status result. The communication unit performs option matching processing based on the voice broadcast information to obtain the communication response correctness result; the evaluation unit performs timeline display processing based on the multi-task status information to obtain behavioral indicators.

2. The flight training assessment system for situational awareness and information management according to claim 1, characterized in that, The behavioral indicators include: monitoring and evaluating the status of the aircraft and systems; monitoring and evaluating the aircraft's energy status and projected flight path; monitoring and evaluating the overall environment that may affect operations; verifying the accuracy of information and checking for errors; the overall performance of the subjects in the system monitoring and resource management unit; and the comparison of the overall performance of the trajectory tracking unit, response unit, fuel tank status unit, and communication unit in the first five minutes with the overall performance in the last five minutes.

3. The flight training assessment system for situational awareness and information management according to claim 2, characterized in that, The aforementioned monitoring and evaluation of the aircraft and system status is achieved through assessing the gaze duration of the trajectory tracking unit during time planning, specifically as follows: ,in: and This refers to the participant's attention allocation score in the time planning and trajectory tracking units, with 60% and 40% as weighted values. , This refers to the actual fixation time. This is the optimal fixation time.

4. The flight training assessment system for situational awareness and information management according to claim 2, characterized in that, The aforementioned trajectory tracking refers to the movement of the target box adopting a time-varying motion mode, with its trajectory generated by a random process, including dynamic changes in velocity, acceleration, and direction parameters, to simulate the unsteady motion characteristics of the target object in a real flight environment.

5. The flight training assessment system for situational awareness and information management according to claim 2, characterized in that, The aforementioned time planning refers to: using an independent dynamic timeline to visualize the evolution of multiple task states in real time, providing operators with intuitive priority decision support.

6. The flight training assessment system for situational awareness and information management according to claim 2, characterized in that, The monitoring and evaluation of the aircraft's energy status and predicted flight path are achieved by assessing the subjects' performance in the resource management and trajectory tracking units, specifically the achievement rate in the resource management unit and the tracking success rate in the trajectory tracking unit. , ,in: The total time it takes for a unit to correctly complete a task. The total test duration for the unit is in seconds.

7. The flight training assessment system for situational awareness and information management according to claim 2, characterized in that, The monitoring and evaluation mentioned above may affect the overall operating environment. The evaluation assesses whether the subjects' attention allocation across the three units of system monitoring, resource management, and information reception is reasonable. Specifically: ,in: , Attention scores are assigned to the system monitoring unit, resource management unit, and information receiving unit.

8. The flight training assessment system for situational awareness and information management according to claim 2, characterized in that, The system monitoring mentioned refers to: fault display format and subject operation feedback signals.

9. The flight training assessment system for situational awareness and information management according to claim 2, characterized in that, The verification of information accuracy and the checking of errors are achieved by evaluating the participants' operational scores in completing tasks at the information receiving unit, specifically as follows:

10. The flight training assessment system for situational awareness and information management according to claim 2, characterized in that, The overall performance of the test subjects in the system monitoring and resource management unit is specifically as follows: , , ,in: ; The comparison of the total performance of the trajectory tracking unit, response unit, fuel tank status unit, and communication unit in the first five minutes and the last five minutes is as follows: , ,in: , .

Images