A pilot attention allocation assessment training method, system, device and medium

Abstract

The invention discloses a pilot attention allocation assessment training method, system, equipment and medium, which belongs to the field of civil aviation flight technology, and obtains the pilot's sight movement trajectory in the aircraft cockpit, the length of stay in a specific area and the allocation ratio; reads the flight parameters, matches the obtained movement trajectory, length of stay and allocation ratio with the read flight parameters according to the time axis, and obtains the attention allocation in each specific flight stage; according to the length of time the pilot's sight leaves the aircraft attitude to observe other instruments in a stable aircraft attitude state, formulates the pilot's attention allocation assessment rules, judges whether the attention allocation in each specific flight stage deviates and determines the frequency and duration of the deviation; evaluates the pilot's attention allocation according to the frequency and duration of the deviation. The method can accurately obtain the pilot's attention allocation in real time, and provide timely guidance, thereby improving the training quality of the pilot.

Description

Technical Field

[0001] The present invention relates to the field of civil aviation flight technology, and more specifically to a pilot attention allocation assessment training method, system, equipment and medium. Background Art

[0002] During the flight, pilots need to process a large amount of flight parameters and environmental information at the same time and perform multiple tasks, such as aircraft control, navigation, communication, etc. Due to the limitations of human vision, pilots can only focus on and obtain one flight parameter or information at a time. Therefore, it is crucial for pilots to adopt correct and efficient attention allocation and obtain the required information.

[0003] Attention allocation has always been the focus of flight training. Correct attention allocation can help pilots quickly and effectively collect various flight information and make correct and timely judgments on the flight status. Improper attention allocation will prevent pilots from collecting the required effective information in time, leading to flight errors and even flight accidents. At present, at least 80% of flight trainees do not really master the correct attention allocation skills when they graduate from flight academies, and even a considerable number of flight instructors do not master it. The main reason is that there is a lack of direct means of observing the pilot's attention allocation. The student's attention allocation can only be inferred from the results. There is no effective evaluation and training method for pilots' attention allocation. The emergence of eye trackers allows people's eye movement data to be captured, making it possible to directly observe the pilot's attention allocation.

[0004] At present, researchers at home and abroad have obtained pilots' eye movement data through eye trackers, but the research has only stopped at collecting attention allocation data of mature pilots at a certain stage of flight. The feasibility of the attention allocation method has been verified through eye trackers, but no pilot attention allocation model has been established on this basis for use in actual flight training. On the one hand, because wearable eye trackers are usually used, the image will be unstable during the recording process due to the frequent head movements of the wearable eye tracker, and the acquired eye movement data is stored on the memory card of the wearable eye tracker. Video or image processing is required after the experiment is completed, that is, offline analysis and collection of the required data lacks timeliness. At the same time, the equipment price is relatively high, so the research can only stay in the experimental stage and cannot be used on a large scale for flight evaluation training. On the other hand, the lack of in-depth participation of expert pilots has made the research on attention allocation superficial and unable to deeply explore the underlying logic of pilot attention allocation.

[0005] In summary, during traditional flight training, flight instructors can only indirectly infer the flight trainees' attention allocation through their flight performance or subjective description, but cannot directly observe the pilots' attention allocation, which makes attention allocation training a difficult problem in pilot training and seriously affects the quality of flight training. Summary of the invention

[0006] In view of the problems existing in the above-mentioned fields, the present invention proposes a pilot attention allocation assessment training method, system, equipment and medium, which can solve the technical problem that in the traditional flight training process, the flight instructor can only indirectly infer the flight trainee's attention allocation through the flight trainee's flight performance or subjective description, and cannot directly observe the pilot's attention allocation, which makes attention allocation training a difficult problem in pilot training and seriously affects the quality of flight training.

[0007] In order to solve the above technical problems, the present invention discloses a pilot attention allocation assessment training method, comprising the following steps:

[0008] During the flight, the eye tracker is set up to obtain and record the position of the pilot's gaze in a specific area during the flight state, so as to obtain the pilot's line of sight movement trajectory in the aircraft cockpit, the length of time spent in a specific area, and the distribution ratio;

[0009] Read the flight parameters, match the pilot's line of sight movement trajectory, the duration of stay in a specific area, and the allocation ratio with the read flight parameters on a timeline, and obtain the attention allocation in each specific flight phase;

[0010] Based on the length of time the pilot's eyes leave the aircraft's attitude to observe other instruments when the aircraft's attitude is stable, a pilot attention allocation evaluation rule is developed to determine whether there is any deviation in the attention allocation in each specific flight phase and to determine the frequency and duration of the deviation; based on the frequency and duration of the deviation, the pilot's attention allocation is evaluated to obtain the attention allocation evaluation result.

[0011] Preferably, obtaining the pilot's line of sight movement trajectory in the aircraft cockpit, the length of stay in a specific area, and the distribution ratio comprises the following steps:

[0012] The flight process includes real flight process and simulated flight process;

[0013] Taking simulated flight as reference, a desktop eye tracker was used as the experimental equipment;

[0014] When performing simulated flight missions, the flight simulation software and real-time feedback system are run on the main screen computer, and the cockpit that matches the running flight simulation software is displayed on the secondary screen. The pilot's attention allocation is observed in real time and the information including the line of sight movement trajectory, stay duration and allocation ratio is obtained;

[0015] The attention allocation trajectory is obtained through the attention allocation data, and then the conversion frequency of attention allocation is obtained. The conversion frequency directly reflects the workload of the pilot's attention allocation.

[0016] Reading the flight parameters of the real flight process through the onboard equipment or reading the flight parameters of the simulated flight process through the software, determining the flight stage through the flight parameters, comparing the flight parameters of the real flight process or the simulated flight process with the target flight parameters of the stage, and analyzing and obtaining the flight quality of the real flight process or the simulated flight process;

[0017] The real-time feedback system collects the pilot's screen eye movement data at each flight stage at a sampling rate of no less than 5Hz, and transmits and saves it to the computer.

[0018] Preferably, the reading of flight parameters comprises the following steps:

[0019] Read the aircraft's flight parameters from the onboard QAR or SD card during real flight;

[0020] Read the aircraft's flight parameters from the software during simulated flight.

[0021] Preferably, the formulation of pilot attention allocation evaluation rules includes:

[0022] Through the research on the distribution of pilots' attention by flight training experts, it is proposed that the pilots' attention should be centered on the aircraft's posture during flight, and the proportion of their sight on the posture should be ≥70%;

[0023] When operating an aircraft, the pilot must always keep an eye on and control the aircraft attitude when the aircraft attitude changes; the pilot cannot take his eyes off the aircraft attitude before the aircraft attitude stabilizes;

[0024] When the aircraft attitude is stable, the pilot will take his eyes off the aircraft attitude for a short time and observe other instruments and equipment, but the stay time cannot be too long.

[0025] Preferably, the determining whether there is a deviation in the attention allocation in each specific flight phase and determining the frequency and duration of the deviation comprises the following steps:

[0026] Pilots conduct simulated flight training and collect flight parameters and attention allocation data, including the pilot's line of sight movement trajectory, stay duration, and allocation ratio;

[0027] The flight phase is determined by analyzing the collected flight parameters, and the pilot's flight quality is obtained by comparing the flight parameters with the target parameters of the phase;

[0028] The pilot's eye movement information is obtained through an eye tracker, and the length of time the pilot's gaze stays in each specific area is analyzed, and then the attention allocation data percentage of each area in a certain flight phase in the area is obtained;

[0029] When recording the changes in posture parameter data, whether the line of sight always stays in the posture area;

[0030] Record whether the line of sight always stays in the posture area when there is a control signal input;

[0031] Record whether the time the gaze stays in the area other than the posture area is ≥ 2 seconds.

[0032] Preferably, obtaining the attention allocation evaluation result comprises the following steps:

[0033] By recording the pilot's eye movement data, when the pilot has the following specific situations, it is recorded as a deviation in attention allocation:

[0034] The pilot's line of sight in the attitude area during flight should account for ≥ 70%;

[0035] When the posture parameters change, the line of sight does not stay in the posture area;

[0036] When the control signal is input, the line of sight does not stay in the posture area;

[0037] The gaze stays in the area other than the posture area for ≥ 2 seconds;

[0038] When the total deviation duration accounts for ≤10% of the duration of a certain flight phase, it is calibrated as an occasional deviation and the attention allocation is evaluated as excellent; when the total deviation duration accounts for ≤20% of the duration of a certain flight phase, it is calibrated as a large deviation and the attention allocation is evaluated as good; when the total deviation duration accounts for ≤30% of the duration of a certain flight phase, it is calibrated as a frequent deviation and the attention allocation is evaluated as medium; when the total deviation duration accounts for >30% of the duration of a certain flight phase, it is calibrated as a serious deviation and the attention allocation is evaluated as poor.

[0039] Preferably, the method further includes dividing the evaluation training into post-evaluation training and real-time evaluation training according to the eye movement data and flight parameter acquisition methods in the attention allocation evaluation results, and training the pilots according to different evaluation training situations, including the following steps:

[0040] According to the movement trajectory, stay duration and distribution ratio of the pilot's line of sight during flight and the different ways of obtaining flight parameters, it is divided into post-flight and real-time.

[0041] Through real flight, for after-the-flight guidance, due to the passage of time, it is difficult for pilots to clearly recall the situation at that time, and the effect is relatively poor;

[0042] Through simulated flight, eye movement data and flight parameters are acquired and matched in real time, and an assessment is given in real time. Based on the assessment results, text or voice messages are given to the pilot for real-time guidance.

[0043] Preferably, a pilot attention allocation assessment training system is also included, comprising:

[0044] The attention allocation data acquisition module is used to obtain and record the position of the pilot's gaze at a specific area in the flight state by setting an eye tracker during the flight, and obtain the pilot's line of sight movement trajectory in the aircraft cockpit, the length of time spent in a specific area, and the allocation ratio;

[0045] The attention allocation acquisition module is used to read the flight parameters, match the pilot's line of sight movement trajectory, the length of stay in a specific area, and the allocation ratio with the read flight parameters on a time axis, and obtain the attention allocation in each specific flight phase;

[0046] The attention allocation assessment module is used to formulate pilot attention allocation assessment rules based on the length of time the pilot's eyes leave the aircraft attitude to observe other instruments when the aircraft attitude is stable, determine whether there is any deviation in the attention allocation in each specific flight phase, and determine the frequency and duration of the deviation; based on the frequency and duration of the deviation, evaluate the pilot's attention allocation and obtain the attention allocation assessment result.

[0047] Preferably, a computer device is also included, the computer device comprising a memory and a processor, the memory storing a computer program, and when the computer program is executed by the processor, the processor executes the following steps:

[0048] During the flight, the eye tracker is set up to obtain and record the position of the pilot's gaze in a specific area during the flight state, so as to obtain the pilot's line of sight movement trajectory in the aircraft cockpit, the length of time spent in a specific area, and the distribution ratio;

[0049] Read the flight parameters, match the pilot's line of sight movement trajectory, the duration of stay in a specific area, and the allocation ratio with the read flight parameters on a timeline, and obtain the attention allocation in each specific flight phase;

[0050] Based on the length of time the pilot's eyes leave the aircraft's attitude to observe other instruments when the aircraft's attitude is stable, a pilot attention allocation evaluation rule is developed to determine whether there is any deviation in the attention allocation in each specific flight phase and to determine the frequency and duration of the deviation; based on the frequency and duration of the deviation, the pilot's attention allocation is evaluated to obtain the attention allocation evaluation result.

[0051] Preferably, it further comprises a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor executes the following steps:

[0052] During the flight, the eye tracker is set up to obtain and record the position of the pilot's gaze in a specific area during the flight state, so as to obtain the pilot's line of sight movement trajectory in the aircraft cockpit, the length of time spent in a specific area, and the distribution ratio;

[0053] Read the flight parameters, match the pilot's line of sight movement trajectory, the duration of stay in a specific area, and the allocation ratio with the read flight parameters on a timeline, and obtain the attention allocation in each specific flight phase;

[0054] Based on the length of time the pilot's eyes leave the aircraft's attitude to observe other instruments when the aircraft's attitude is stable, a pilot attention allocation evaluation rule is developed to determine whether there is any deviation in the attention allocation in each specific flight phase and to determine the frequency and duration of the deviation; based on the frequency and duration of the deviation, the pilot's attention allocation is evaluated to obtain the attention allocation evaluation result.

[0055] Compared with the prior art, the present invention has the following beneficial effects:

[0056] The present invention takes the stability of the aircraft attitude and the length of time the pilot's sight leaves the aircraft attitude as references, formulates the pilot's attention allocation evaluation rules, and visualizes them. By obtaining the trajectory, stay duration and allocation ratio of the pilot's attention allocation in flight and matching them with the read flight parameters according to the time axis, the attention allocation situation in each specific flight stage is obtained, and the attention allocation situation in different stages can be obtained in real time and accurately; according to the formulated attention allocation evaluation rules, it is judged whether the attention allocation situation in each specific flight stage is deviated and the frequency and duration of the deviation are determined, and the pilot's attention allocation is evaluated. By analyzing the attention allocation situation in each specific flight stage, it can be accurately judged whether it is deviated; according to the deviation judgment situation, the pilot's attention allocation is further targeted for evaluation and training. Compared with the traditional method, the method can accurately obtain the pilot's attention allocation situation in real time, provide timely guidance on the pilot's flight skills, and thus improve the quality of flight training. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] Figure 1 is a flow chart of the overall method of the present invention;

[0058] Figure 2 The gaze percentage of the flight instructor and the flight trainee during the take-off phase provided by the embodiment of the present invention;

[0059] Figure 3 The gaze percentage of the flight instructor and the flight trainee during the level flight phase provided by the embodiment of the present invention;

[0060] Figure 4 The gaze percentage of the flight instructor at different stages provided by the embodiment of the present invention;

[0061] Figure 5 The embodiment of the present invention provides the gaze percentages of flight trainees at different stages. DETAILED DESCRIPTION

[0062] The following will be combined with the attached embodiment of the present invention Figure 1-5 , the technical solutions in the embodiments of the present invention are clearly and completely described. It should be understood that the terms described in the present invention are only used to describe specific implementation methods and are not used to limit the present invention.

[0063] During flight, the pilot's attention is focused on the aircraft's attitude. On the basis of maintaining attitude control, he glances at instruments for parameters such as speed, altitude, heading, and ascent and descent speed, and adjusts the aircraft's attitude based on the read parameters, aided by the required power to achieve on-demand flight.

[0064] An embodiment of the present invention provides a pilot attention allocation assessment training method, comprising the following steps:

[0065] Based on the pilots' years of practical flight experience, this application summarizes the following pilot attention allocation evaluation rules:

[0066] 1. Through the research of flight training experts on the distribution of pilots' attention, it is proposed that the pilot's attention should be centered on the aircraft attitude during flight, and the proportion of sight on the attitude should be ≥70%. When the aircraft attitude changes, the pilot must always keep an eye on the aircraft attitude, and when the aircraft attitude changes, the pilot must always keep an eye on and control the aircraft attitude. When the aircraft attitude is not stable, the pilot's sight cannot leave the aircraft attitude;

[0067] 2. When the aircraft attitude is stable, the pilot can take his eyes off the aircraft attitude for a short time and observe other instruments and equipment for a short time. The stay time should not be too long. Usually, only one parameter is flashed to avoid changes in the aircraft attitude that the pilot is not aware of.

[0068] Based on the above two evaluation rules, combined with the direct observation of the pilot's line of sight by the eye tracker, an evaluation training method for pilot attention allocation is established:

[0069] S1: Identification of pilot attention allocation

[0070] The flight process includes real flight process and simulated flight process;

[0071] Taking simulated flight as reference, a desktop eye tracker was used as the experimental equipment;

[0072] When performing simulated flight missions, the simulation flight software and real-time feedback system are run on the main screen computer, and the cockpit that matches the running simulation flight software is displayed on the secondary screen, and the pilot's attention allocation data is observed in real time, including the line of sight movement trajectory, stay duration and allocation ratio.

[0073] S2: Acquisition of flight data

[0074] The aircraft's flight parameters are read from the onboard QAR or SD card in real flight and from the software in simulated flight.

[0075] S3: Matching attention allocation with flight data

[0076] Match the pilot's attention with the aircraft's flight parameters on a timeline to obtain the attention allocation at each specific flight stage;

[0077] The attention allocation trajectory is obtained through the attention allocation data, and then the conversion frequency of attention allocation is obtained. The conversion frequency directly reflects the workload of the pilot's attention allocation.

[0078] Reading the flight parameters of the real flight process through the onboard equipment or reading the flight parameters of the simulated flight process through the software, determining the flight stage through the flight parameters, comparing the flight parameters of the real flight process or the simulated flight process with the target flight parameters of the stage, and analyzing and obtaining the flight quality of the real flight process or the simulated flight process;

[0079] The real-time feedback system collects the pilot's screen eye movement data at each flight stage at a sampling rate of no less than 5Hz, and transmits and saves it to the computer.

[0080] S4: Assessment of pilot attention allocation

[0081] Pilots conduct simulated flight training and collect flight parameters and attention allocation data, including the pilot's line of sight movement trajectory, stay duration, and allocation ratio;

[0082] The flight phase is determined by analyzing the collected flight parameters, and the pilot's flight quality is obtained by comparing the flight parameters with the target parameters of the phase;

[0083] The pilot's eye movement information is obtained through an eye tracker, and the length of time the pilot's gaze stays in each specific area is analyzed, and then the attention allocation data percentage of each area in a certain flight phase in the area is obtained;

[0084] When recording the changes in posture parameter data, whether the line of sight always stays in the posture area;

[0085] Record whether the line of sight always stays in the posture area when there is a control signal input;

[0086] Record whether the time the gaze stays in the area other than the posture area is ≥ 2 seconds;

[0087] According to the two evaluation rules of pilot attention allocation, determine whether there is a deviation in attention allocation and the specific circumstances of the deviation, and evaluate the attention allocation according to the frequency and duration of the deviation, including:

[0088] By recording the pilot's eye movement data, when the pilot has the following specific situations, it is recorded as a deviation in attention allocation:

[0089] The pilot's line of sight in the attitude area during flight should account for ≥ 70%;

[0090] When the posture parameters change, the line of sight does not stay in the posture area;

[0091] When the control signal is input, the line of sight does not stay in the posture area;

[0092] The gaze stays in the area other than the posture area for ≥ 2 seconds;

[0093] When the total deviation duration accounts for ≤10% of the duration of a certain flight phase, it is calibrated as an occasional deviation and the attention allocation is evaluated as excellent; when the total deviation duration accounts for ≤20% of the duration of a certain flight phase, it is calibrated as a large deviation and the attention allocation is evaluated as good; when the total deviation duration accounts for ≤30% of the duration of a certain flight phase, it is calibrated as a frequent deviation and the attention allocation is evaluated as medium; when the total deviation duration accounts for >30% of the duration of a certain flight phase, it is calibrated as a serious deviation and the attention allocation is evaluated as poor.

[0094] For example, in visual flight, the pilot should use the horizon as the main reference for judging the aircraft's attitude, and at the same time use the target taken into account when observing the horizon as a reference for the aircraft's direction. If the pilot is found to be looking at the horizon too much and the aircraft's heading compass too much, it can be determined that the attention allocation is biased. When the aircraft's attitude changes during flight that can be recognized by the human eye, and the pilot's line of sight is not focused on the aircraft's attitude, it can be determined that the attention allocation is biased.

[0095] S5: Pilot attention distribution training

[0096] Provide guidance to pilots on attention allocation based on the attention allocation assessment.

[0097] According to the different ways of obtaining eye movement data and flight parameters, it can be divided into post-event and real-time.

[0098] The effect of post-flight guidance through real flight is relatively poor because pilots tend to forget the situation at the time as time goes by. Through simulated flight, eye movement data and flight parameters can be obtained and matched in real time, and evaluation can be given in real time. According to the evaluation results, pilots can be given text or voice guidance, which is even more effective than the guidance of flight instructors.

[0099] This application also proposes a pilot attention allocation assessment training system, including:

[0100] The attention allocation data acquisition module is used to obtain and record the position of the pilot's gaze at a specific area in the flight state by setting an eye tracker during the flight, and obtain the pilot's line of sight movement trajectory in the aircraft cockpit, the length of time spent in a specific area, and the allocation ratio;

[0101] The attention allocation acquisition module is used to read the flight parameters, match the pilot's line of sight movement trajectory, the length of stay in a specific area, and the allocation ratio with the read flight parameters on a time axis, and obtain the attention allocation in each specific flight phase;

[0102] The attention allocation assessment module is used to formulate pilot attention allocation assessment rules based on the length of time the pilot's eyes leave the aircraft attitude to observe other instruments when the aircraft attitude is stable, determine whether there is any deviation in the attention allocation in each specific flight phase, and determine the frequency and duration of the deviation; based on the frequency and duration of the deviation, evaluate the pilot's attention allocation and obtain the attention allocation assessment result.

[0103] The real-time training of pilots in simulated flight is divided into post-evaluation training and real-time evaluation training according to the way of obtaining eye movement data and flight parameters in the attention allocation evaluation results. Pilots are trained according to different evaluation training situations. According to the results of the real-time evaluation of pilot attention allocation, trainees are given voice guidance on attention allocation. The effectiveness of the pilot attention allocation evaluation training method can be directly seen from the improvement of flight control performance and attention allocation performance.

[0104] The present application also proposes a computer device, the computer device comprising a memory and a processor, the memory storing a computer program, and when the computer program is executed by the processor, the processor executes the following steps:

[0105] During the flight, the eye tracker is set up to obtain and record the position of the pilot's gaze in a specific area during the flight state, so as to obtain the pilot's line of sight movement trajectory in the aircraft cockpit, the length of time spent in a specific area, and the distribution ratio;

[0106] Read the flight parameters, match the pilot's line of sight movement trajectory, the duration of stay in a specific area, and the allocation ratio with the read flight parameters on a timeline, and obtain the attention allocation in each specific flight phase;

[0107] Based on the length of time the pilot's eyes leave the aircraft's attitude to observe other instruments when the aircraft's attitude is stable, a pilot attention allocation evaluation rule is developed to determine whether there is any deviation in the attention allocation in each specific flight phase and to determine the frequency and duration of the deviation; based on the frequency and duration of the deviation, the pilot's attention allocation is evaluated to obtain the attention allocation evaluation result.

[0108] The present application also proposes a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor executes the following steps:

[0109] During the flight, the eye tracker is set up to obtain and record the position of the pilot's gaze in a specific area during the flight state, so as to obtain the pilot's line of sight movement trajectory in the aircraft cockpit, the length of time spent in a specific area, and the distribution ratio;

[0110] Read the flight parameters, match the pilot's line of sight movement trajectory, the duration of stay in a specific area, and the allocation ratio with the read flight parameters on a timeline, and obtain the attention allocation in each specific flight phase;

[0111] Based on the length of time the pilot's eyes leave the aircraft's attitude to observe other instruments when the aircraft's attitude is stable, a pilot attention allocation evaluation rule is developed to determine whether there is any deviation in the attention allocation in each specific flight phase and to determine the frequency and duration of the deviation; based on the frequency and duration of the deviation, the pilot's attention allocation is evaluated to obtain the attention allocation evaluation result.

[0112] This application takes aircraft attitude as the core, summarizes two attention allocation principles, and concretizes them. At the same time, based on the attention allocation principles, a method for pilot attention assessment training is proposed.

[0113] Pilot attention allocation is the most basic and important flying skill for pilots. Deviations that occur during flight are almost all related to attention allocation. The present invention constructively proposes an evaluation method for pilot attention allocation, and on this basis provides a training method for pilot attention allocation. The evaluation and training method can help pilots master the correct attention allocation, which will greatly improve the pilot's technical level and thus better ensure flight safety.

[0114] Example

[0115] The present invention selected 10 flight trainees and two flight instructors from the Civil Aviation Flight Academy of China to conduct a Microsoft Flight Simulator comparison experiment. Among them, the flight trainees had 32 hours of training flight experience and 167 hours of primary training aircraft flight hours, and the flight instructor had 1000 hours of flight experience. A desktop eye tracker was used as the experimental equipment.

[0116] When performing simulated flight missions, the flight simulation software and real-time feedback system are run on the main screen computer, and the instrument panel of the same model as the flight simulation software is displayed on the secondary screen to observe the eye movement trajectory, stay time, distribution ratio and flight parameters of the test flight trainees in real time. The real-time feedback system collects the pilot's screen eye movement data in real time at a sampling rate of no less than 5Hz, and transmits and saves it to the computer, such as Figure 1 shown.

[0117] like Figure 2 and Figure 3 As shown, it corresponds to the overall gaze percentage of flight trainees during the takeoff and level flight stages. Through data analysis, it is found that during the takeoff and level flight stages, the overall gaze percentage of flight trainees is more than that of flight instructors. For example, as for the percentage of time looking at the attitude instrument, the flight instructors' gaze percentage on the attitude instrument during the takeoff and level flight stages is 33.25% and 36.65%, while during the takeoff and level flight stages, the flight trainees' gaze percentage on the attitude instrument is 44.12% and 46.91%.

[0118] like Figure 4 and Figure 5 As shown in the figure, the corresponding percentage of the flight instructors and flight trainees looking at each instrument or device at different stages. Through data analysis, it is found that the flight instructors look at the horizon for about 30% of the time, while the flight trainees look at about 40%. By analyzing the duration of the gaze, the difficulty of extracting information can be reflected. On the other hand, the number of gaze durations at each stage can also indicate the importance of that stage to the entire flight process.

[0119] This shows that flight instructors can quickly pay attention to relevant indicators and quickly obtain the required information when making decisions, and have more fixed patterns and shorter fixed times in operations. On the contrary, through the analysis of the percentage of gaze, it can be seen that due to the short flight time and lack of flight experience of flight trainees, flight trainees have not formed good flying habits, resulting in long duration of gaze at different stages, slow decision-making and acquisition of required information, and easy fatigue and tension in simulated flight training.

[0120] The above description is only a preferred specific implementation manner of the present invention, but the protection scope of the present invention is not limited thereto. Any technician familiar with the technical field can make equivalent replacements or changes according to the technical scheme and inventive concept of the present invention within the technical scope disclosed by the present invention, which should be covered by the protection scope of the present invention.

[0121] In addition, unless otherwise specified, all technical and scientific terms used in the present invention have the same meanings as commonly understood by those skilled in the art to which the present invention belongs. All documents mentioned in this specification are incorporated by reference to disclose and describe the methods related to the documents. In the event of any conflict with any incorporated document, the content of this specification shall prevail.

Claims

1. A pilot attention allocation assessment training method, It is characterized in that The following steps are involved: During the flight, the eye tracker is set up to obtain and record the position of the pilot's gaze in a specific area during the flight state, so as to obtain the pilot's line of sight movement trajectory in the aircraft cockpit, the length of time spent in a specific area, and the distribution ratio; Read the flight parameters, match the pilot's line of sight movement trajectory, the duration of stay in a specific area, and the allocation ratio with the read flight parameters on a timeline, and obtain the attention allocation in each specific flight phase; According to the length of time the pilot takes his eyes off the aircraft attitude to observe other instruments when the aircraft attitude is stable, formulate a pilot attention allocation assessment rule to determine whether there is a deviation in the attention allocation in each specific flight phase and determine the frequency and duration of the deviation; according to the frequency and duration of the deviation, evaluate the pilot's attention allocation and obtain the attention allocation assessment result; The step of obtaining the pilot's line of sight movement trajectory in the aircraft cockpit, the duration of stay in a specific area, and the distribution ratio includes the following steps: The flight process includes real flight process and simulated flight process; Taking simulated flight as reference, a desktop eye tracker was used as the experimental equipment; When performing simulated flight missions, the flight simulation software and real-time feedback system are run on the main screen computer, and the cockpit that matches the running flight simulation software is displayed on the secondary screen. The pilot's attention allocation is observed in real time and the information including the line of sight movement trajectory, stay duration and allocation ratio is obtained; The attention allocation trajectory is obtained through the attention allocation data, and then the conversion frequency of attention allocation is obtained. The conversion frequency directly reflects the workload of the pilot's attention allocation. Reading the flight parameters of the real flight process through the onboard equipment or reading the flight parameters of the simulated flight process through the software, determining the flight stage through the flight parameters, comparing the flight parameters of the real flight process or the simulated flight process with the target flight parameters of the stage, and analyzing and obtaining the flight quality of the real flight process or the simulated flight process; The real-time feedback system collects the pilot's screen eye movement data at each flight stage at a sampling rate of no less than 5Hz, and transmits and saves it to the computer; The formulation of pilot attention allocation assessment rules includes: Through the research on the distribution of pilots' attention by flight training experts, it is proposed that the pilots' attention should be centered on the aircraft's posture during flight, and the proportion of their sight on the posture should be ≥70%; When operating an aircraft, the pilot must always keep an eye on and control the aircraft attitude when the aircraft attitude changes; the pilot cannot take his eyes off the aircraft attitude before the aircraft attitude stabilizes; When the aircraft attitude is stable, the pilot should take his eyes off the aircraft attitude for a short time and observe other instruments and equipment. The stay time should not be too long. The step of determining whether there is a deviation in the attention allocation in each specific flight phase and determining the frequency and duration of the deviation comprises the following steps: Pilots conduct simulated flight training and collect flight parameters and attention allocation data, including the pilot's line of sight movement trajectory, stay duration, and allocation ratio; The flight phase is determined by analyzing the collected flight parameters, and the pilot's flight quality is obtained by comparing the flight parameters with the target parameters of the phase; The pilot's eye movement information is obtained through an eye tracker, and the length of time the pilot's gaze stays in each specific area is analyzed, and then the attention allocation data percentage of each area in a certain flight phase in the area is obtained; When recording the changes in posture parameter data, whether the line of sight always stays in the posture area; Record whether the line of sight always stays in the posture area when there is a control signal input; Record whether the time the gaze stays in the area other than the posture area is ≥ 2 seconds; The step of obtaining the attention allocation evaluation result comprises the following steps: By recording the pilot's eye movement data, when the pilot has the following specific situations, it is recorded as a deviation in attention allocation: The pilot's line of sight in the attitude area during flight should account for ≥ 70%; When the posture parameters change, the line of sight does not stay in the posture area; When the control signal is input, the line of sight does not stay in the posture area; The gaze stays in the area other than the posture area for ≥ 2 seconds; When the total deviation duration accounts for ≤10% of the duration of a certain flight phase, it is marked as an occasional deviation, and the attention allocation is evaluated as excellent; when the total deviation duration accounts for ≤20% of the duration of a certain flight phase, it is marked as a large deviation, and the attention allocation is evaluated as good; when the total deviation duration accounts for ≤30% of the duration of a certain flight phase, it is marked as a frequent deviation, and the attention allocation is evaluated as medium; when the total deviation duration accounts for >30% of the duration of a certain flight phase, it is marked as a serious deviation, and the attention allocation is evaluated as poor; It also includes dividing the assessment training into post-assessment training and real-time assessment training according to the eye movement data and flight parameter acquisition methods in the attention allocation assessment results, and training pilots according to different assessment training situations, including the following steps: According to the movement trajectory, stay duration and distribution ratio of the pilot's line of sight during flight and the different ways of obtaining flight parameters, it is divided into post-flight and real-time. Through real flight, for after-the-flight guidance, due to the passage of time, it is difficult for pilots to clearly recall the situation at that time, and the effect is relatively poor; Through simulated flight, eye movement data and flight parameters are acquired and matched in real time, and an assessment is given in real time. Based on the assessment results, text or voice messages are given to the pilot for real-time guidance.

2. The pilot attention allocation assessment training method according to claim 1, It is characterized in that The reading of flight parameters comprises the following steps: Read the aircraft's flight parameters from the onboard QAR or SD card during real flight; Read the aircraft's flight parameters from the software during simulated flight.

3. A pilot attention allocation assessment training system, It is characterized in that include: The attention allocation data acquisition module is used to obtain and record the position of the pilot's gaze at a specific area in the flight state by setting an eye tracker during the flight, and obtain the pilot's line of sight movement trajectory in the aircraft cockpit, the length of time spent in a specific area, and the allocation ratio; The attention allocation acquisition module is used to read the flight parameters, match the pilot's line of sight movement trajectory, the length of stay in a specific area, and the allocation ratio with the read flight parameters on a time axis, and obtain the attention allocation in each specific flight phase; The attention allocation assessment module is used to formulate the pilot's attention allocation assessment rules according to the length of time the pilot's eyes leave the aircraft attitude to observe other instruments when the aircraft attitude is stable, determine whether there is any deviation in the attention allocation in each specific flight phase, and determine the frequency and duration of the deviation; evaluate the pilot's attention allocation according to the frequency and duration of the deviation, and obtain the attention allocation assessment result; The step of obtaining the pilot's line of sight movement trajectory in the aircraft cockpit, the length of stay in a specific area, and the distribution ratio includes the following steps: The flight process includes real flight process and simulated flight process; Taking simulated flight as reference, a desktop eye tracker was used as the experimental equipment; When performing simulated flight missions, the flight simulation software and real-time feedback system are run on the main screen computer, and the cockpit that matches the running flight simulation software is displayed on the secondary screen. The pilot's attention allocation is observed in real time and the information including the line of sight movement trajectory, stay duration and allocation ratio is obtained; The attention allocation trajectory is obtained through the attention allocation data, and then the conversion frequency of attention allocation is obtained. The conversion frequency directly reflects the workload of the pilot's attention allocation. Reading the flight parameters of the real flight process through the onboard equipment or reading the flight parameters of the simulated flight process through the software, determining the flight stage through the flight parameters, comparing the flight parameters of the real flight process or the simulated flight process with the target flight parameters of the stage, and analyzing and obtaining the flight quality of the real flight process or the simulated flight process; The real-time feedback system collects the pilot's screen eye movement data at each flight stage at a sampling rate of no less than 5Hz, and transmits and saves it to the computer; The formulation of pilot attention allocation assessment rules includes: Through the research on the distribution of pilots' attention by flight training experts, it is proposed that the pilots' attention should be centered on the aircraft's posture during flight, and the proportion of their sight on the posture should be ≥70%; When operating an aircraft, the pilot must always keep an eye on and control the aircraft attitude when the aircraft attitude changes; the pilot cannot take his eyes off the aircraft attitude before the aircraft attitude stabilizes; When the aircraft attitude is stable, the pilot should take his eyes off the aircraft attitude for a short time and observe other instruments and equipment. The stay time should not be too long. The step of determining whether there is a deviation in the attention allocation in each specific flight phase and determining the frequency and duration of the deviation comprises the following steps: Pilots conduct simulated flight training and collect flight parameters and attention allocation data, including the pilot's line of sight movement trajectory, stay duration, and allocation ratio; The flight phase is determined by analyzing the collected flight parameters, and the pilot's flight quality is obtained by comparing the flight parameters with the target parameters of the phase; The pilot's eye movement information is obtained through an eye tracker, and the length of time the pilot's gaze stays in each specific area is analyzed, and then the proportion of attention allocation data in each area at a certain flight stage in the area is obtained; When recording the changes in posture parameter data, whether the line of sight always stays in the posture area; Record whether the line of sight always stays in the posture area when there is a control signal input; Record whether the time the gaze stays in the area other than the posture area is ≥ 2 seconds; The step of obtaining the attention allocation evaluation result comprises the following steps: By recording the pilot's eye movement data, when the pilot has the following specific situations, it is recorded as a deviation in attention allocation: The pilot's line of sight in the attitude area during flight should account for ≥ 70%; When the posture parameters change, the line of sight does not stay in the posture area; When the control signal is input, the line of sight does not stay in the posture area; The gaze stays in the area other than the posture area for ≥ 2 seconds; When the total deviation duration accounts for ≤10% of the duration of a certain flight phase, it is marked as an occasional deviation, and the attention allocation is evaluated as excellent; when the total deviation duration accounts for ≤20% of the duration of a certain flight phase, it is marked as a large deviation, and the attention allocation is evaluated as good; when the total deviation duration accounts for ≤30% of the duration of a certain flight phase, it is marked as a frequent deviation, and the attention allocation is evaluated as medium; when the total deviation duration accounts for >30% of the duration of a certain flight phase, it is marked as a serious deviation, and the attention allocation is evaluated as poor; It also includes dividing the assessment training into post-assessment training and real-time assessment training according to the eye movement data and flight parameter acquisition methods in the attention allocation assessment results, and training pilots according to different assessment training situations, including the following steps: According to the movement trajectory, stay duration and distribution ratio of the pilot's line of sight during flight and the different ways of obtaining flight parameters, it is divided into post-flight and real-time. Through real flight, for after-the-flight guidance, due to the passage of time, it is difficult for pilots to clearly recall the situation at that time, and the effect is relatively poor; Through simulated flight, eye movement data and flight parameters are acquired and matched in real time, and an assessment is given in real time. Based on the assessment results, text or voice messages are given to the pilot for real-time guidance.

4. A computer device, It is characterized in that The computer device includes a memory and a processor, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor performs the following steps: During the flight, the eye tracker is set up to obtain and record the position of the pilot's gaze in a specific area during the flight state, so as to obtain the pilot's line of sight movement trajectory in the aircraft cockpit, the length of time spent in a specific area, and the distribution ratio; Read the flight parameters, match the pilot's line of sight movement trajectory, the duration of stay in a specific area, and the allocation ratio with the read flight parameters on a timeline, and obtain the attention allocation in each specific flight phase; According to the length of time the pilot takes his eyes off the aircraft attitude to observe other instruments when the aircraft attitude is stable, formulate a pilot attention allocation assessment rule to determine whether there is a deviation in the attention allocation in each specific flight phase and determine the frequency and duration of the deviation; according to the frequency and duration of the deviation, evaluate the pilot's attention allocation and obtain the attention allocation assessment result; The step of obtaining the pilot's line of sight movement trajectory in the aircraft cockpit, the length of stay in a specific area, and the distribution ratio includes the following steps: The flight process includes real flight process and simulated flight process; Taking simulated flight as reference, a desktop eye tracker was used as the experimental equipment; When performing simulated flight missions, the flight simulation software and real-time feedback system are run on the main screen computer, and the cockpit that matches the running flight simulation software is displayed on the secondary screen. The pilot's attention allocation is observed in real time and the information including the line of sight movement trajectory, stay duration and allocation ratio is obtained; The attention allocation trajectory is obtained through the attention allocation data, and then the conversion frequency of attention allocation is obtained. The conversion frequency directly reflects the workload of the pilot's attention allocation. Reading the flight parameters of the real flight process through the onboard equipment or reading the flight parameters of the simulated flight process through the software, determining the flight stage through the flight parameters, comparing the flight parameters of the real flight process or the simulated flight process with the target flight parameters of the stage, and analyzing and obtaining the flight quality of the real flight process or the simulated flight process; The real-time feedback system collects the pilot's screen eye movement data at each flight stage at a sampling rate of no less than 5Hz, and transmits and saves it to the computer; The formulation of pilot attention allocation assessment rules includes: Through the research on the distribution of pilots' attention by flight training experts, it is proposed that the pilots' attention should be centered on the aircraft's posture during flight, and the proportion of their sight on the posture should be ≥70%; When operating an aircraft, the pilot must always keep an eye on and control the aircraft attitude when the aircraft attitude changes; the pilot cannot take his eyes off the aircraft attitude before the aircraft attitude stabilizes; When the aircraft attitude is stable, the pilot should take his eyes off the aircraft attitude for a short time and observe other instruments and equipment. The stay time should not be too long. The step of determining whether there is a deviation in the attention allocation in each specific flight phase and determining the frequency and duration of the deviation comprises the following steps: Pilots conduct simulated flight training and collect flight parameters and attention allocation data, including the pilot's line of sight movement trajectory, stay duration, and allocation ratio; The flight phase is determined by analyzing the collected flight parameters, and the pilot's flight quality is obtained by comparing the flight parameters with the target parameters of the phase; The pilot's eye movement information is obtained through an eye tracker, and the length of time the pilot's gaze stays in each specific area is analyzed, and then the attention allocation data percentage of each area in a certain flight phase in the area is obtained; When recording the changes in posture parameter data, whether the line of sight always stays in the posture area; Record whether the line of sight always stays in the posture area when there is a control signal input; Record whether the time the gaze stays in the area other than the posture area is ≥ 2 seconds; The step of obtaining the attention allocation evaluation result comprises the following steps: By recording the pilot's eye movement data, when the pilot has the following specific situations, it is recorded as a deviation in attention allocation: The pilot's line of sight in the attitude area during flight should account for ≥ 70%; When the posture parameters change, the line of sight does not stay in the posture area; When the control signal is input, the line of sight does not stay in the posture area; The gaze stays in the area other than the posture area for ≥ 2 seconds; When the total deviation duration accounts for ≤10% of the duration of a certain flight phase, it is marked as an occasional deviation, and the attention allocation is evaluated as excellent; when the total deviation duration accounts for ≤20% of the duration of a certain flight phase, it is marked as a large deviation, and the attention allocation is evaluated as good; when the total deviation duration accounts for ≤30% of the duration of a certain flight phase, it is marked as a frequent deviation, and the attention allocation is evaluated as medium; when the total deviation duration accounts for >30% of the duration of a certain flight phase, it is marked as a serious deviation, and the attention allocation is evaluated as poor; It also includes dividing the assessment training into post-assessment training and real-time assessment training according to the eye movement data and flight parameter acquisition methods in the attention allocation assessment results, and training pilots according to different assessment training situations, including the following steps: According to the movement trajectory, stay duration and distribution ratio of the pilot's line of sight during flight and the different ways of obtaining flight parameters, it is divided into post-flight and real-time. Through real flight, for after-the-flight guidance, due to the passage of time, it is difficult for pilots to clearly recall the situation at that time, and the effect is relatively poor; Through simulated flight, eye movement data and flight parameters are acquired and matched in real time, and an assessment is given in real time. Based on the assessment results, text or voice messages are given to the pilot for real-time guidance.

5. A computer-readable storage medium, It is characterized in that The computer readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor performs the following steps: During the flight, the eye tracker is set up to obtain and record the position of the pilot's gaze in a specific area during the flight state, so as to obtain the pilot's line of sight movement trajectory in the aircraft cockpit, the length of time spent in a specific area, and the distribution ratio; Read the flight parameters, match the pilot's line of sight movement trajectory, the duration of stay in a specific area, and the allocation ratio with the read flight parameters on a timeline, and obtain the attention allocation in each specific flight phase; According to the length of time the pilot takes his eyes off the aircraft attitude to observe other instruments when the aircraft attitude is stable, formulate a pilot attention allocation assessment rule to determine whether there is a deviation in the attention allocation in each specific flight phase and determine the frequency and duration of the deviation; according to the frequency and duration of the deviation, evaluate the pilot's attention allocation and obtain the attention allocation assessment result; The step of obtaining the pilot's line of sight movement trajectory in the aircraft cockpit, the length of stay in a specific area, and the distribution ratio includes the following steps: The flight process includes real flight process and simulated flight process; Taking simulated flight as reference, a desktop eye tracker was used as the experimental equipment; When performing simulated flight missions, the flight simulation software and real-time feedback system are run on the main screen computer, and the cockpit that matches the running flight simulation software is displayed on the secondary screen. The pilot's attention allocation is observed in real time and the information including the line of sight movement trajectory, stay duration and allocation ratio is obtained; The attention allocation trajectory is obtained through the attention allocation data, and then the conversion frequency of attention allocation is obtained. The conversion frequency directly reflects the workload of the pilot's attention allocation. Reading the flight parameters of the real flight process through the onboard equipment or reading the flight parameters of the simulated flight process through the software, determining the flight stage through the flight parameters, comparing the flight parameters of the real flight process or the simulated flight process with the target flight parameters of the stage, and analyzing and obtaining the flight quality of the real flight process or the simulated flight process; The real-time feedback system collects the pilot's screen eye movement data at each flight stage at a sampling rate of no less than 5Hz, and transmits and saves it to the computer; The formulation of pilot attention allocation assessment rules includes: Through the research on the distribution of pilots' attention by flight training experts, it is proposed that the pilots' attention should be centered on the aircraft's posture during flight, and the proportion of their sight on the posture should be ≥70%; When operating an aircraft, the pilot must always keep an eye on and control the aircraft attitude when the aircraft attitude changes; the pilot cannot take his eyes off the aircraft attitude before the aircraft attitude stabilizes; When the aircraft attitude is stable, the pilot should take his eyes off the aircraft attitude for a short time and observe other instruments and equipment. The stay time should not be too long. The step of determining whether there is a deviation in the attention allocation in each specific flight phase and determining the frequency and duration of the deviation comprises the following steps: Pilots conduct simulated flight training and collect flight parameters and attention allocation data, including the pilot's line of sight movement trajectory, stay duration, and allocation ratio; The flight phase is determined by analyzing the collected flight parameters, and the pilot's flight quality is obtained by comparing the flight parameters with the target parameters of the phase; The pilot's eye movement information is obtained through an eye tracker, and the length of time the pilot's gaze stays in each specific area is analyzed, and then the attention allocation data percentage of each area in a certain flight phase in the area is obtained; When recording the changes in posture parameter data, whether the line of sight always stays in the posture area; Record whether the line of sight always stays in the posture area when there is a control signal input; Record whether the time the gaze stays in the area other than the posture area is ≥ 2 seconds; The step of obtaining the attention allocation evaluation result comprises the following steps: By recording the pilot's eye movement data, when the pilot has the following specific situations, it is recorded as a deviation in attention allocation: The pilot's line of sight in the attitude area during flight should account for ≥ 70%; When the posture parameters change, the line of sight does not stay in the posture area; When the control signal is input, the line of sight does not stay in the posture area; The gaze stays in the area other than the posture area for ≥ 2 seconds; When the total deviation duration accounts for ≤10% of the duration of a certain flight phase, it is marked as an occasional deviation, and the attention allocation is evaluated as excellent; when the total deviation duration accounts for ≤20% of the duration of a certain flight phase, it is marked as a large deviation, and the attention allocation is evaluated as good; when the total deviation duration accounts for ≤30% of the duration of a certain flight phase, it is marked as a frequent deviation, and the attention allocation is evaluated as medium; when the total deviation duration accounts for >30% of the duration of a certain flight phase, it is marked as a serious deviation, and the attention allocation is evaluated as poor; It also includes dividing the assessment training into post-assessment training and real-time assessment training according to the eye movement data and flight parameter acquisition methods in the attention allocation assessment results, and training pilots according to different assessment training situations, including the following steps: According to the movement trajectory, stay duration and distribution ratio of the pilot's line of sight during flight and the different ways of obtaining flight parameters, it is divided into post-flight and real-time. Through real flight, for after-the-flight guidance, due to the passage of time, it is difficult for pilots to clearly recall the situation at that time, and the effect is relatively poor; Through simulated flight, eye movement data and flight parameters are acquired and matched in real time, and an assessment is given in real time. Based on the assessment results, text or voice messages are given to the pilot for real-time guidance.

Images