Multi-visibility-based visual attention distribution strategy establishment method, system and equipment

Abstract

The invention belongs to the technical field of civil aviation flight safety, particularly relates to a multi-visibility-based visual attention distribution strategy establishment method, system and equipment, and aims to solve the problem that a pilot lacks effective attention resource distribution strategy guidance in a final approaching landing stage. The operation risk of the flight stage is increased; and the flight training quality and the flight performance are possibly influenced. The method comprises the following steps: acquiring eye movement data and height data; dividing a region of interest and a height interval; obtaining the mapping position of each region of interest in different height intervals; screening out effective eye movement data of the expert pilot in different height intervals; acquiring a change trend of attention distribution and a differentiated attention distribution strategy; and judging the consistency of the differentiated attention distribution strategy and the flight control result, and guiding the attention distribution strategy of the pilot. According to the method, the visual attention distribution strategy can be optimized, a support is provided for a pilot to make a correct decision under a complex meteorological condition, and the flight performance is improved.

Description

Background Art

[0002] Final approach and landing are highly complex flight phases. Statistics from the global commercial jet fleet show that 54% of fatal accidents occur during this phase. Weather factors are one of the important factors affecting flight safety. According to IATA's accident statistics for the landing phase of passenger aircraft from 2005 to 2023, unsafe incidents caused by low visibility accounted for 9.74%, second only to wind / wind shear / turbulence and thunderstorms / convection. When visibility changes, external visual references change or there is a lack of sufficient visual information, which affects the pilot's perception of the aircraft's status. Especially in night environments, it is more difficult for the crew to obtain visual information, and the safety risk during visual approach is higher.

[0003] The visual attention strategy of pilots is an implicit skill based on knowledge and experience. Although the airline's crew operating manual and operation manual explain the approach and landing procedures and aircraft status maintenance, the flight crew lacks reference and guidance on the allocation of attention resources suitable for the task, and knows little about the correct methods of monitoring information inside and outside the cockpit and cross-checking between crew members. This not only poses a safety risk, but also affects the quality of flight training and the improvement of flight performance.

[0004] Based on this, the present invention proposes a method, system and device for establishing a visual attention allocation strategy based on multiple visibility. Summary of the invention

[0005] In order to solve the above-mentioned problems in the prior art, namely, during the final approach and landing phase, especially under low visibility conditions, the pilot may lack effective guidance and support to optimize the allocation of his attention resources and the monitoring and cross-checking of internal and external information in the cockpit, which increases the safety risk of this flight phase and may affect the quality of flight training and flight performance, the present invention provides a method, system and device for establishing a visual attention allocation strategy based on multiple visibility.

[0006] A first aspect of the present invention provides a method for establishing a visual attention allocation strategy based on multiple visibility, comprising the following steps:

[0007] Obtain pilot eye movement data and altitude data from the primary flight display during the flight mission; divide the areas of interest inside and outside the cockpit, approach lights and runway, and divide the altitude intervals from the final approach to landing;

[0008] Obtain the mapping position of each area of ​​interest in different altitude intervals; select expert pilots based on the process parameters and ground parameters in the flight parameters, and obtain effective eye movement data of expert pilots in different altitude intervals;

[0009] The fixation duration is selected as the eye movement analysis indicator, and combined with the mapping position, the effective eye movement data of each interest area in different height intervals are analyzed to obtain the change trend of attention allocation and the differentiated attention allocation strategy;

[0010] The consistency between differentiated attention allocation strategies and flight control results is judged based on the analysis results of expert pilots' touchdown flight parameters.

[0011] In some preferred embodiments, the eye movement data and the altitude data in the primary flight display are acquired synchronously based on two different eye trackers.

[0012] In some preferred embodiments, the runway is divided into interest areas in the horizontal and vertical directions, and the runway interest area is divided into the middle, the left side and the right side in the horizontal direction;

[0013] The middle part includes the inner edge area of ​​the touchdown zone lights on both sides, the left side is the area from the touchdown zone lights to the left side lights of the runway, and the right side is the area from the touchdown zone lights to the right side lights of the runway;

[0014] The runway area of ​​interest is divided longitudinally into the lead-in light area, the near end of the runway, the middle of the runway, and the far end of the runway;

[0015] The lead-in light area is the inner edge of the short row of lights on the side. The near end of the runway is from the runway entrance mark to the leading edge of the second touchdown zone mark. The middle section of the runway is from the second touchdown zone mark to the leading edge of the third touchdown zone mark and includes the aiming point mark area. The far end of the runway is the area behind the third touchdown zone mark.

[0016] In some preferred embodiments, the altitude interval from the preset altitude to the touchdown in the final approach and landing phase is divided into a pre-decision phase, a decision phase, and a post-decision phase.

[0017] In some preferred embodiments, the mapping position of each area of ​​interest at different height intervals is obtained by:

[0018] Based on image data taken at multiple altitudes under different flight conditions, the image data of normal visibility during the day is used as the basic mapping base map to obtain mapping results under various flight conditions. The image data taken under normal visibility at night and day / night low visibility conditions are used as references to process the basic mapping base map to obtain a processed base map that is close to the actual scene map, and all mapping results are presented on the processed base map.

[0019] In some preferred embodiments, the process parameters and the grounding parameters respectively include:

[0020] The process parameters include approach speed, approach slope, descent rate, air load, final approach attitude, glide path and localizer deviation during the final approach / landing phase;

[0021] The touchdown parameters include touchdown load, touchdown heading deviation, touchdown pitch attitude, touchdown pitch change rate and landing distance.

[0022] In some preferred embodiments, the visual attention allocation strategy includes a visual attention allocation strategy for the interior and exterior areas of the cockpit, and the analysis method is:

[0023] Using a repeated measures variance analysis method, obtaining the first main effect and the first interaction effect of the altitude interval and the inner and outer areas of the cockpit under each visibility condition, and determining whether the first interaction effect is less than a preset threshold;

[0024] If it is less than, then compare the gaze durations of the inner and outer areas of the cockpit at each altitude interval, and obtain the difference data of the gaze durations of the inner and outer areas of the cockpit according to the comparison results;

[0025] If it is not less than, then the influence of the height interval and the inner and outer areas on the fixation duration is obtained according to the first main effect;

[0026] Using a repeated measures variance analysis method, obtaining the second main effect and the second interaction effect of the visibility condition and the altitude range, and determining whether the second interaction effect is less than a preset threshold;

[0027] If it is less than, then compare the internal and external gaze durations under different visibility conditions in each height interval, and obtain the impact data of different visibility conditions on the internal and external gaze durations based on the comparison results;

[0028] If it is not less than, then the influence of visibility condition and altitude range on fixation duration is obtained according to the second main effect;

[0029] The data on the difference in gaze duration inside and outside the cockpit at each altitude stage and the impact of visibility conditions on the gaze duration inside and outside the cockpit at each altitude stage are used as the visual attention allocation strategy for the inside and outside areas of the cockpit.

[0030] In some preferred embodiments, the visual attention allocation strategy includes a visual attention allocation strategy for an instrument area, and the analysis method is:

[0031] Using repeated measures analysis of variance, the third main effect and the third interaction effect between the altitude interval and the instrument area inside the cockpit under each visibility condition were obtained, and it was determined whether the third interaction effect was less than the preset threshold;

[0032] If it is less than, then compare the gaze time of the instrument area in each height interval, and obtain the difference data of the gaze time of the instrument area according to the comparison result;

[0033] If it is not less than , the influence of the height interval and instrument area on the fixation duration is obtained according to the third main effect;

[0034] Using a repeated measures variance analysis method, obtaining the fourth main effect and the fourth interaction effect of the visibility condition and the altitude range, and determining whether the fourth interaction effect is less than a preset threshold;

[0035] If it is less than, then compare the instrument area gaze time under different visibility conditions in each altitude interval, and obtain the impact data of visibility conditions on instrument gaze time based on the comparison results;

[0036] If it is not less than, then the influence of visibility conditions and altitude range on the instrument looking time is obtained according to the fourth main effect;

[0037] The data on the difference in gaze duration in the instrument area at each altitude stage and the impact of visibility conditions on the gaze duration in the instrument area at each altitude stage are used as the visual attention allocation strategy for the instrument area.

[0038] In some preferred embodiments, the visual attention allocation strategy includes a visual attention allocation strategy for a runway area, and the analysis method is:

[0039] Using a repeated measures analysis of variance method, obtaining the fifth main effect and the fifth interaction effect between the altitude interval and the runway area under each visibility condition, and determining whether the fifth interaction effect is less than a preset threshold;

[0040] If it is less than, then compare the gaze durations of different runway areas in each height interval, and obtain runway area gaze duration difference data according to the comparison results;

[0041] If it is not less than, then the influence of the height interval and the runway area on the fixation time is obtained according to the fifth main effect; wherein the runway area includes the horizontal area and the vertical area; the runway area fixation time difference includes the horizontal runway area fixation time difference and the vertical runway area fixation time difference;

[0042] Using a repeated measures variance analysis method, obtaining the sixth main effect and the sixth interaction effect of the visibility condition and the altitude range, and determining whether the sixth interaction effect is less than a preset threshold;

[0043] If it is less than, then compare the runway watching time under different visibility conditions in each altitude interval, and obtain the impact of visibility conditions on the runway watching time based on the comparison results;

[0044] If it is not less than, then the influence of visibility conditions and altitude range on the watching time of the runway area is obtained according to the sixth main effect;

[0045] The difference data of gaze duration in the runway area at each altitude stage and the impact of visibility conditions on the runway gaze duration at each altitude stage are used as the visual attention allocation strategy for the runway area.

[0046] Another aspect of the present invention provides a system for establishing a visual attention allocation strategy based on multiple visibility, and a method for establishing a visual attention allocation strategy based on multiple visibility, comprising:

[0047] An area of ​​interest and altitude segmentation module configured to obtain pilot eye movement data and altitude data from the primary flight display during the flight mission; segment areas of interest for the interior and exterior of the cockpit, approach lights, and runway, and segment altitude intervals for the final approach to landing phase;

[0048] A mapping position acquisition module configured to acquire the mapping position of each area of ​​interest at different height intervals;

[0049] An expert pilot screening module, configured to screen out expert pilots based on process parameters and touchdown parameters in the flight parameters, and obtain effective eye movement data of the expert pilots in different altitude intervals;

[0050] an attention allocation strategy generation module, which is configured to select fixation duration as an eye movement analysis indicator, and analyze the effective eye movement data of each interest area in different height intervals in combination with the mapping position, to obtain a change trend of attention allocation and a differentiated attention allocation strategy;

[0051] The consistency judgment module is configured to judge the consistency between the differentiated attention allocation strategy and the flight control result based on the ground flight parameter analysis result of the expert pilot.

[0052] According to a third aspect of the present invention, an electronic device is provided, comprising:

[0053] at least one processor; and

[0054] a memory communicatively connected to at least one of the processors; wherein,

[0055] The memory stores instructions that can be executed by the processor, and the instructions are used to be executed by the processor to implement the above-mentioned method for establishing a visual attention allocation strategy based on multiple visibility.

[0056] In a fourth aspect of the present invention, a computer-readable storage medium is proposed, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to be executed by the computer to implement the above-mentioned method for establishing a visual attention allocation strategy based on multiple visibility.

[0057] Beneficial effects of the present invention:

[0058] Improve safety: By quantifying the visual attention allocation patterns of expert pilots under different visibility conditions, safety hazards caused by improper attention allocation of pilots can be significantly reduced. This method can help pilots better understand what information to pay attention to when and where, thereby reducing the occurrence of human errors and unsafe events, especially in adverse weather conditions, such as low visibility or night flying, where such precise attention guidance is particularly important.

[0059] Improve training quality: It provides specific and quantifiable visual attention allocation guidelines for flight training, which helps improve flight training courses and make training closer to actual flight needs. This can not only help new pilots master the necessary skills faster, but also ensure that all pilots can follow best practices. This method can be used to evaluate the performance of trainees during training, and to promptly identify and correct bad attention allocation habits to ensure the quality and effectiveness of training.

[0060] Optimize decision making: Visual attention allocation strategies based on data analysis can help pilots make more accurate decisions in complex meteorological conditions. This means that when flying in low visibility or at night, pilots can perform approach and landing procedures more confidently because they know how to use limited visual information most effectively to avoid potential risks.

[0061] Enhanced situational awareness: Provides situational awareness training materials for specific environments (such as low visibility) to help pilots better identify and respond to potential risks. By simulating the allocation of visual attention under different flight conditions, the pilots' sensitivity to changes in the external environment is enhanced, enabling them to maintain a comprehensive understanding of the flight status under various conditions.

[0062] Promote standardized operations: This method can be integrated into standard operating procedures (SOPs) to ensure that all pilots follow a consistent and proven effective visual attention allocation strategy. This standardized operating process helps reduce safety risks caused by individual differences, while also simplifying the training process and improving the overall level of flight safety.

[0063] Improve flight performance: By optimizing the pilot's visual attention allocation strategy, the overall flight performance can be improved, including reducing landing deviations and improving fuel efficiency. The data-driven approach ensures that pilots can focus on key flight parameters, thereby achieving smooth and efficient flight, which means lower costs and higher customer satisfaction for airlines.

[0064] Assisted technology development: This method can also be used to support advanced cockpit design and technology development, such as the design of automatic prompt systems or augmented reality (AR) interfaces. These systems can dynamically adjust the display content according to the current flight conditions, guide pilots to allocate their attention reasonably, and thus improve flight safety and efficiency. In addition, this technology can also provide more realistic training scenarios for flight simulators, further improving pilots' actual operational capabilities. BRIEF DESCRIPTION OF THE DRAWINGS

[0065] Other features, objects and advantages of the present application will become more apparent by reading the detailed description of non-limiting embodiments made with reference to the following drawings:

[0066] Figure 1 It is a flow chart of an experimental design and analysis method of a visual attention allocation method based on different visibilities of the present invention;

[0067] Figure 2 It is a flowchart of an experimental process of a visual attention allocation method based on different visibilities of the present invention;

[0068] Figure 3 is a schematic diagram of various interest areas of a visual attention allocation method based on different visibilities of the present invention;

[0069] Figure 4 It is a schematic diagram of height division of a visual attention allocation method based on different visibilities of the present invention;

[0070] Figure 5 It is a schematic diagram of the result of mapping image data collected under low visibility or nighttime conditions in a visual attention allocation method based on different visibilities of the present invention;

[0071] Figure 6 It is a heat map of the fixation duration of the runway area in a visual attention allocation method based on different visibilities of the present invention;

[0072] Figure 7 It is a schematic diagram of a runway watching strategy under normal visibility during the day in a visual attention allocation method based on different visibilities of the present invention;

[0073] Figure 8 It is a schematic diagram of a runway watching strategy under normal visibility at night in a visual attention allocation method based on different visibilities of the present invention;

[0074] Fig. 9 It is a schematic diagram of a runway watching strategy under low visibility during the day in a visual attention allocation method based on different visibilities of the present invention;

[0075] Fig.10It is a schematic diagram of a runway watching strategy under low visibility at night in a visual attention allocation method based on different visibilities of the present invention;

[0076] Fig.11 It is a structural diagram of a computer system of a server for implementing the method, system, and device embodiments of the present application. DETAILED DESCRIPTION

[0077] The present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are only used to explain the relevant invention, rather than to limit the invention. It is also necessary to explain that, for ease of description, only the parts related to the relevant invention are shown in the accompanying drawings.

[0078] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The present application will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0079] The present invention provides a method for establishing a visual attention allocation strategy based on multiple visibility, comprising the following steps:

[0080] Obtain pilot eye movement data and altitude data from the primary flight display during the flight mission; divide the areas of interest inside and outside the cockpit, approach lights and runway, and divide the altitude intervals from the final approach to landing;

[0081] Obtain the mapping position of each area of ​​interest in different altitude intervals; select expert pilots based on the process parameters and touchdown parameters in the flight parameters, and select the effective eye movement data of expert pilots in different altitude intervals;

[0082] The fixation duration is selected as the eye movement analysis indicator, and combined with the mapping position, the effective eye movement data of each interest area in different height intervals are analyzed to obtain the change trend of attention allocation and the differentiated attention allocation strategy;

[0083] The consistency between the differentiated attention allocation strategy and the flight control results is determined based on the analysis results of the expert pilots' touchdown flight parameters.

[0084] In order to more clearly explain the visual attention allocation method based on different visibilities of the present invention, the following is combined with Figure 1 and Figure 2 Each step in the embodiment of the present invention is described in detail as follows:

[0085] Acquire the pilot's eye movement data and the altitude data in the primary flight display during the flight mission; divide the areas of interest inside and outside the cockpit, approach lights and runway, and divide the altitude intervals from the final approach to landing.

[0086] Among them, this method selects mature pilots to complete approach and landing tasks under different conditions on a full-motion simulator. Two eyeglass eye trackers are synchronized, one is used to collect the eye movement data of the operating pilot, and the other is fixed at the monitoring pilot's position to record the primary flight display to read the altitude data. The simulator operation quality assurance (SOQA) system records the flight parameters of all flight missions. After processing the raw data, the eye movement analysis indicators of each altitude interval are obtained, and the expert pilots are confirmed as the formal data analysis samples by checking the flight parameters. The visual attention allocation strategy is obtained by analyzing the eye movement indicators of the expert pilots. The consistency between the visual attention strategy and the landing performance is judged based on the analysis results of the ground flight parameters.

[0087] like Figure 3 As shown, in the present invention, there are 9 areas of interest (AOIs) inside and outside the cockpit: 5 AOIs (speed, altitude, pitch, roll and lateral deviation areas) of the primary flight display (PFD), 1 AOI each for the navigation display (ND), the engine warning display (EWD), other internal areas and the outside.

[0088] Introducing lights and runway 12 AOIs:

[0089] The runway is divided into interest areas horizontally and vertically, and the runway interest area is horizontally divided into the middle, left and right parts;

[0090] The middle part includes the inner edge area of ​​the touchdown zone lights on both sides, the left side is the area from the touchdown zone lights to the left side lights of the runway, and the right side is the area from the touchdown zone lights to the right side lights of the runway;

[0091] The runway area of ​​interest is divided longitudinally into the lead-in light area, the near end of the runway, the middle of the runway, and the far end of the runway;

[0092] The lead-in light area is the inner edge of the short row of lights on the side. The near end of the runway is from the runway entrance mark to the leading edge of the second touchdown zone mark. The middle section of the runway is from the second touchdown zone mark to the leading edge of the third touchdown zone mark and includes the aiming point mark area. The far end of the runway is the area behind the third touchdown zone mark.

[0093] like Figure 4As shown, there are 14 altitude intervals: the altitude interval from 500ft to touchdown in the final approach and landing phase is further subdivided into the pre-decision stage (500-200ft), the decision stage (200-100ft) and the post-decision stage (100-0ft). Specifically, the final approach and landing phase (500-0ft) is divided into the pre-decision stage, including 500-400ft, 400-300ft; the decision stage, including 300-250ft, 250-200ft, 200-150ft, 150-100ft; the post-decision stage, including 100-70ft, 70-50ft, 50-40ft, 40-30ft, 30-20ft, 20-10ft, 10-5ft and 5-0ft.

[0094] Obtain the mapping position of each area of ​​interest in different altitude intervals; screen out expert pilots based on process parameters and ground parameters in the flight parameters, and screen out effective eye movement data of expert pilots in different altitude intervals.

[0095] The present invention is based on image data of different flight conditions shot at multiple altitudes, and uses image data of normal visibility during the day as the basic mapping base map to obtain mapping results under various flight conditions. The basic mapping base map is processed with reference to the image data of normal visibility at night and low visibility conditions during the day / night, to obtain a processed base map close to the actual scene map, and all mapping results can be presented on the processed base map.

[0096] Specifically, the raw eye movement data (Raw Data Points) of valid participants were filtered out using the Tobii I-VT Gaze Filter with a sampling rate of ≥75%. Eye movement indicators in all regions were obtained by manual mapping.

[0097] like Figure 5 As shown, Figure 5 The upper left corner is the base map of normal daytime visibility (100ft), the lower left corner is the processed map of low daytime visibility (100ft), the upper right corner is the processed map of normal nighttime visibility (100ft), and the lower right corner is the processed map of low nighttime visibility (100ft);

[0098] Since the base map under low visibility and night conditions cannot clearly distinguish the gaze position during manual mapping, scene maps under different visibility conditions were selected at three heights (300ft / 100ft / 50ft). The scene map with normal visibility during the day was used as the base map for manual mapping to obtain the mapping results under all visibility conditions. Then, the scene maps with normal visibility at night and low visibility during the day / night obtained by shooting were used as references, and the scene maps with normal visibility during the day were processed using PR software (adjusting contrast, saturation, color and transparency) to obtain a base map similar to each shot scene map. The processed base map was used to replace the scene maps under low visibility and night conditions, and the mapping results under various visibility conditions can be presented.

[0099] This method selects flight quality monitoring parameters that match the flight phase of this study from the parameters recorded by the SOQA system, and divides the flight parameters into process parameters and touchdown parameters, a total of 12. Process parameters (7): approach speed, approach slope, descent rate, air load, final approach attitude, glide path and localizer deviation in the final approach / landing phase. Touchdown parameters (5): touchdown load, touchdown heading deviation, touchdown pitch attitude, touchdown pitch change rate and landing distance. Expert pilots were screened based on the criterion that the 12 parameters did not exceed the limit value of the third level event. The limit values ​​are shown in the following table:

[0100]

[0101] The fixation duration is selected as the eye movement analysis indicator, and combined with the mapping position, the effective eye movement data of each interest area in different height intervals are analyzed to obtain the changing trend of attention allocation and differentiated attention allocation strategies.

[0102] The eye movement behavior indicators used in this method are the fixation duration and the percentage of fixation duration in each area of ​​interest. Fixation duration is the sum of all fixation durations in an area of ​​interest and is the best indicator for comparing the attention allocation characteristics of different fixation targets. The percentage of fixation duration is the ratio of the cumulative fixation time within a certain range to the total fixation time. The changing trend of attention allocation is obtained based on the change in the percentage of fixation duration, and the fixation duration under different conditions is analyzed to obtain differentiated attention allocation strategies.

[0103] In the present invention, the main effects of different factors and the interaction effects between factors are obtained through repeated measurement experiments and analysis methods. The specific methods are as follows:

[0104] The repeated measurement experimental method is to measure the same subject multiple times, measure the continuous variable (dependent variable) at different levels of one or more factors (independent variables), and study the impact of each factor on the continuous variable. Specifically, a within-subject multi-factor repeated measurement design is used, with the independent variables being visibility conditions, height range, and fixation area, and the dependent variable being the fixation duration of each visual attention allocation area. This method can control the impact of differences between subjects on the research results and relatively accurately analyze the impact of independent variables at different nodes.

[0105] The repeated measures ANOVA method was used to test the influence of different levels of categorical variables on the occurrence of events, including the main effects of each factor and the interaction effects of the combination of each factor. When the interaction is significant, it indicates that the independent variables have common importance to the experimental results, and it is necessary to further understand at which level(s) of one independent variable the difference of another independent variable is significant; if the interaction is not significant, the main effect of the independent variable is important. In this method, if the interaction between the altitude interval and the fixation area is significant, it indicates that the significance level of the difference in the fixation duration of each fixation area at different altitude stages is different, and the attention allocation strategy adapted to the altitude stage can be obtained according to the highly staged characteristics of the subject's attention allocation. This method also compares the main effects and interaction effects of visibility conditions and altitude intervals. If the interaction effect is significant, it indicates that the influence of visibility conditions on the fixation duration of a certain fixation area(s) has highly staged characteristics.

[0106] Basic conditions: The experimental sample data comes from a normally distributed population, the variation of the sample data is additive, and there is no significant difference in the sample variance.

[0107] Basic principle: The variation characteristics of sample data can be expressed as SS 总 =SS A +SS B +SS AB +SS 误差 ;

[0108] 【Note: SS A —The sum of squares of the effect of factor A, SS B —The sum of squares of the effect of factor B, SS AB —Sum of squares of interaction effects, SS 误差 —sum of squared errors];

[0109] Each variation term is expressed as:

[0110]

[0111]

[0112]

[0113]

[0114]

[0115] [Note: Factor A has r levels, factor B has s levels, and each subject undergoes t experiments].

[0116] Test hypothesis: Remove the effect of the number of items on the variation between and within groups, and use the mean square to compare the size of the variation, that is, F A =MS A / MS 误差 , F B =MS B / MS 误差 , F AB =MS AB / MS 误差 When F>1, it indicates that the data variation is mainly caused by experimental treatment, and the difference caused by errors and individual differences is not significant. A >1 or F B >1, or It indicates that the main effect of factor A or B is significant, that is, the total variation of the experimental data is caused by the effect of experimental factor A or B; when F AB >1, i.e. This indicates that the interaction between factor A and factor B is statistically significant, and requires testing the difference between any two levels of factor A on all levels of factor B. [Note: (r-1), (s-1), and rs(t-1) are degrees of freedom].

[0117] In the present invention, the visual attention allocation strategy includes the visual attention allocation strategy for the inner and outer areas of the cockpit, and the analysis method is as follows:

[0118] The changing trend of attention allocation in the cockpit and outside areas is obtained according to the percentage of fixation time in each altitude interval. The specific method is summarized as follows: by analyzing the percentage of fixation time in the cockpit and outside areas in each altitude interval under different visibility conditions, how attention allocation changes with altitude is determined.

[0119] Based on the differences in internal and external fixation durations at each altitude interval, as well as the differences in internal or external fixation durations at each altitude interval under different visibility conditions, differentiated internal and external attention allocation strategies are obtained.

[0120] Using repeated measures ANOVA,

[0121] Obtaining the first main effect and the first interaction effect of the altitude interval and the inner and outer areas of the cockpit under each visibility condition, and determining whether the first interaction effect is less than a preset threshold;

[0122] If it is less than, then compare the gaze durations of the inner and outer areas of the cockpit at each altitude interval, and obtain the difference data of the gaze durations of the inner and outer areas of the cockpit according to the comparison results;

[0123] If it is not less than, then the influence of the height interval and the inner and outer areas on the fixation duration is obtained according to the first main effect;

[0124] Using a repeated measures variance analysis method, obtaining the second main effect and the second interaction effect of the visibility condition and the altitude range, and determining whether the second interaction effect is less than a preset threshold;

[0125] If it is less than, then compare the internal and external gaze durations under different visibility conditions in each height interval, and obtain the impact data of different visibility conditions on the internal and external gaze durations based on the comparison results;

[0126] If it is not less than, the influence of visibility conditions and altitude range on the fixation duration is obtained according to the second main effect.

[0127] The preset threshold in the present invention is 0.05.

[0128] The factors and levels in the present invention include:

[0129] Independent variables: visibility conditions, with different levels or categories (such as normal visibility, low visibility); altitude range, with specific ranges as shown in the above divisions; viewing area, divided into inside and outside the cockpit.

[0130] The first main effect: The influence of visibility conditions, internal and external areas, and altitude range on fixation duration is called the first main effect, which means that each factor has a significant impact on fixation duration.

[0131] First interaction effect: When the first interaction effect is significant (P<0.05), it indicates that the effect of the combination of visibility conditions, internal and external areas, and altitude intervals on fixation duration is not a simple summation effect, but the result of interaction. Specifically, the difference in fixation duration between the internal and external areas is affected by visibility conditions and altitude intervals.

[0132] After determining that the first interaction effect was significant, in order to further explore its specific manifestations, the internal and external gaze durations in each height interval were compared, so that a more detailed understanding of the specific differences in internal and external gaze durations within a specific height interval could be obtained; the internal or external gaze durations under different visibility conditions in each height interval were compared to determine whether there were significant differences in the gaze durations of the internal and external or external areas under different visibility conditions.

[0133] The first interaction effect between the height interval and the inner and outer regions was significant (P<0.05), indicating that the difference in fixation duration between the inner and outer regions was affected by the height interval, that is, the difference in fixation duration between the inner and outer regions was different in different height intervals.

[0134] The second interaction effect between visibility conditions and altitude range in the present invention was significant (P<0.05), indicating that the effect of flight conditions on fixation duration was affected by altitude range, that is, the effect of visibility conditions on fixation duration was different in different altitude ranges.

[0135] The data on the difference in gaze duration inside and outside the cockpit at each altitude stage and the impact of visibility conditions on the gaze duration inside and outside the cockpit at each altitude stage are used as the visual attention allocation strategy for the inside and outside areas of the cockpit.

[0136] In the present invention, the visual attention allocation strategy includes a visual attention allocation strategy for the instrument area, and the analysis method is:

[0137] The changing trend of attention allocation in the instrument area is obtained according to the percentage of fixation time in each altitude interval. The specific method is summarized as follows: by analyzing the percentage of fixation time in the instrument area in each altitude interval under different visibility conditions, how attention allocation changes with altitude is determined.

[0138] According to the differences in the duration of looking at the instrument area in each altitude interval and the differences in the duration of looking at the instrument area in each altitude interval under different visibility conditions, differentiated instrument attention allocation strategies are obtained.

[0139] Using repeated measures analysis of variance, the third main effect and the third interaction effect between the altitude interval and the instrument area inside the cockpit under each visibility condition were obtained, and it was determined whether the third interaction effect was less than the preset threshold;

[0140] If it is less than, then compare the gaze time of the instrument area in each height interval, and obtain the difference data of the gaze time of the instrument area according to the comparison result;

[0141] If it is not less than , the influence of the height interval and instrument area on the fixation duration is obtained according to the third main effect.

[0142] In the present invention, two factors, "altitude range" and "instrument area", and one response variable, "gaze duration of each instrument area", are considered, and repeated measures analysis of variance is specifically used to evaluate the main effects and interaction effects of these factors.

[0143] Third main effect: Altitude interval and instrument area had independent effects on fixation duration.

[0144] Third interaction effect: If the third interaction effect is significant (p < 0.05), it means that when the height interval and instrument area work together, their effect cannot be simply predicted by the sum of their individual effects. Specifically, when the height changes, different instrument areas have different degrees of influence on the fixation duration.

[0145] After determining that the third interaction effect was significant, in order to further explore its specific manifestations, the gaze durations of different instrument areas in each height interval were compared to determine whether there were significant differences in the gaze durations of different instrument areas in each height interval.

[0146] The third interaction effect between altitude interval and instrument area in the present invention was significant (P<0.05), indicating that the difference in gaze duration in instrument area was affected by altitude interval, that is, the difference in gaze duration in different instrument areas was different at different altitude stages.

[0147] Using a repeated measures variance analysis method, obtaining the fourth main effect and the fourth interaction effect of the visibility condition and the altitude range, and determining whether the fourth interaction effect is less than a preset threshold;

[0148] If it is less than, then compare the instrument area gaze time under different visibility conditions in each altitude interval, and obtain the impact data of visibility conditions on instrument gaze time based on the comparison results;

[0149] If it is not less than, the influence of visibility conditions and altitude range on the instrument looking time is obtained according to the fourth main effect.

[0150] Among them, the factors considered in the present invention this time are "visibility conditions" and "altitude range", as well as the same response variable - "gaze duration of each instrument area". Repeated measures ANOVA is also used to evaluate the main effects and interaction effects of these two factors.

[0151] Fourth main effect: Visibility condition and altitude interval had independent effects on fixation duration.

[0152] Fourth interaction effect: If the fourth interaction effect is significant (p<0.05), it indicates that when the altitude changes, different visibility conditions have different effects on the duration of gaze in the instrument area.

[0153] To further clarify the fourth interaction effect, the gaze duration under different visibility conditions in each altitude interval was compared to determine whether there was a significant difference in the gaze duration on the instrument area under different visibility conditions.

[0154] The fourth interaction effect between visibility conditions and altitude range in the present invention is significant (P<0.05), indicating that the effect of visibility conditions on fixation duration is affected by altitude range, that is, the effect of visibility conditions on fixation duration is different in different altitude ranges.

[0155] The difference data of fixation time in the instrument area at each altitude stage and the impact data of visibility conditions on the fixation time of the instrument at each altitude stage are used as the visual attention allocation strategy for the instrument area.

[0156] In the present invention, the method for obtaining the gaze strategy for the introduction light area is consistent with that for the instrument area, and will not be described in detail here.

[0157] In the present invention, the visual attention allocation strategy includes a visual attention allocation strategy for the runway area, and the analysis method is:

[0158] Using a repeated measures analysis of variance method, obtaining the fifth main effect and the fifth interaction effect between the altitude interval and the runway area under each visibility condition, and determining whether the fifth interaction effect is less than a preset threshold;

[0159] If it is less than, then compare the gaze durations of different runway areas in each height interval, and obtain runway area gaze duration difference data according to the comparison results;

[0160] If it is not less than, then the influence of the height interval and the runway area on the fixation time is obtained according to the fifth main effect; wherein the runway area includes the horizontal area and the vertical area; the runway area fixation time difference includes the horizontal runway area fixation time difference and the vertical runway area fixation time difference;

[0161] Specifically, when determining the lateral area of ​​a runway:

[0162] The present invention firstly considers two factors, namely "lateral area of ​​the runway" and "altitude interval", and a response variable, namely "fixation duration in the lateral area of ​​the runway", and uses repeated measures ANOVA to evaluate the main effects and interaction effects of these factors.

[0163] Fifth main effect: Altitude interval and lateral area had independent effects on fixation duration.

[0164] Fifth interaction effect: If the fifth interaction effect is significant (p<0.05), it means that when the lateral area and the height range work together, their effect cannot be simply predicted by the sum of their individual effects.

[0165] After determining that the fifth interaction effect was significant, in order to further explore its specific manifestations, the horizontal area fixation duration in each height range was compared, so that a more detailed understanding of the specific differences in the horizontal area fixation duration within a specific height range can be obtained.

[0166] In the present invention, the fifth interaction effect of the lateral area and the height interval under each visibility condition is significant. Specifically, under each visibility condition and different height intervals, the fixation time in the middle area of ​​the runway is significantly longer than that on the left and right sides ((P<0.01, P<0.001)), and the difference in the fixation time on the left and right sides is not significant (P>0.05).

[0167] Next, this method analyzes the fixation duration in the longitudinal area of ​​the runway to obtain the attention allocation results of the longitudinal area of ​​the runway at each height interval under different visibility conditions, and no longer subdivides the interest areas of the lateral runway area.

[0168] The first purpose of the present invention is to obtain the changing trend of attention allocation in the longitudinal area of ​​the runway according to the percentage of the attention time in each altitude interval. The specific method is summarized as follows: by analyzing the percentage of the attention time in the longitudinal area of ​​the runway in each altitude interval under different visibility conditions, how the attention allocation changes with the change of altitude is determined.

[0169] The second purpose of the present invention is to obtain a differentiated runway area attention allocation strategy based on the runway area attention time difference data of each height interval and the runway area attention time difference data of each height interval under different visibility conditions.

[0170] The fifth main effect and fifth interaction effect between the altitude interval and the longitudinal area of ​​the runway under each visibility condition were obtained by repeated measures analysis of variance, and it was determined whether the fifth interaction effect was less than the preset threshold. If it was less than, the gaze duration of different runway areas in each altitude interval was compared, and the difference in the gaze duration of the longitudinal area of ​​the runway was obtained based on the comparison results; if it was not less than, the influence of the altitude interval and the runway area on the gaze duration was obtained based on the fifth main effect.

[0171] Specifically, when determining the longitudinal area of ​​a runway:

[0172] The present invention takes into account two factors, namely, "altitude interval" and "longitudinal area of ​​the runway", and the same response variable, namely, "the fixation duration of each longitudinal area".

[0173] Fifth main effect: Altitude interval and runway area had independent effects on fixation duration.

[0174] Fifth interaction effect: If the interaction effect is significant (p<0.05), it means that when the height changes, the difference in the fixation duration in different longitudinal areas of the runway is different.

[0175] After determining that the interaction effect was significant, the fixation durations in different longitudinal areas of the runway in each altitude interval were compared to determine whether there were significant differences in the fixation durations in different longitudinal areas of the runway in each altitude interval.

[0176] The interaction effect between the height interval and the longitudinal area of ​​the runway was significant (P<0.05), indicating that the difference in the fixation time of the longitudinal area of ​​the runway was affected by the height interval. In other words, the fixation time of different runway areas was different in different height intervals.

[0177] Using a repeated measures variance analysis method, obtaining the sixth main effect and the sixth interaction effect of the visibility condition and the altitude range, and determining whether the sixth interaction effect is less than a preset threshold;

[0178] If it is less than, then compare the runway watching time under different visibility conditions in each altitude interval, and obtain the impact of visibility conditions on the runway watching time based on the comparison results;

[0179] If it is not less than, the influence of visibility conditions and altitude range on the watching time of the runway area is obtained according to the sixth main effect.

[0180] The factors considered by the present invention this time are "visibility conditions" and "altitude range", as well as the response variable - "watching time in the longitudinal area of ​​the runway".

[0181] Sixth main effect: Visibility condition and altitude interval had independent effects on fixation duration.

[0182] Sixth interaction effect: When visibility conditions change, different height intervals have different effects on gaze duration, and this interaction effect is also significant (p<0.05).

[0183] To further clarify the sixth interaction effect, the looking durations under different visibility conditions in each altitude interval were compared to determine whether there were significant differences in the looking durations in the longitudinal area of ​​the runway under different visibility conditions.

[0184] The sixth interaction effect between visibility conditions and altitude range in the present invention is significant (P<0.05), indicating that the effect of visibility conditions on the gaze time of the runway area is affected by the altitude range. That is, the effect of visibility conditions on the gaze time of the longitudinal area of ​​the runway is different at different altitude stages.

[0185] The difference data of the looking time of the runway area in each altitude interval and the impact of visibility conditions on the looking time of the runway in each altitude stage are used as the visual attention allocation strategy for the runway area.

[0186] The present invention implements the following strategies through the above scheme:

[0187] Visual attention allocation strategy:

[0188] The 500ft-0ft before the aircraft touches down belongs to the final approach and landing stage. This method divides the altitude interval into three main stages:

[0189] Phase 1—Pre-decision phase (altitude 500ft-200ft)

[0190] In low visibility conditions, more attention is paid to the interior than to the exterior. When visibility is normal, there is no significant difference in attention between the interior and exterior below 400ft.

[0191] The interior focuses on the PITCH area (flight guidance and aircraft attitude information) of the instrument area;

[0192] As the altitude decreases, internal attention gradually decreases and external attention gradually increases.

[0193] When the aircraft enters the landing mode at 400ft, the pilot's visual behavior should be aimed at obtaining the visual references, instrument information and aircraft status required at different altitude stages. The visual strategy can be flexibly adjusted according to the mission requirements, and more external visual references can be used to obtain aircraft attitude information (PITCH area of ​​internal instruments) and vertical speed information (ATITUDE area of ​​internal instruments). That is, compared with low visibility, under normal visibility conditions, more external landing aids and information (including night lights) are used, and less attention is paid to PITCH and ALTITUDE information.

[0194] Phase 2—Decision Phase (200ft-100ft) (Transition from instrument flight to visual flight)

[0195] Under low visibility conditions, there is no significant difference in the allocation of attention to the interior and exterior; when visibility is normal, below 150ft, more attention is paid to the exterior than to the interior.

[0196] Internally, the focus is mainly on the PITCH area (flight guidance and aircraft attitude information) in the instrument area, and when visibility is normal, the focus on the PITCH area is reduced.

[0197] As the altitude decreases, internal attention gradually decreases and external attention gradually increases.

[0198] Above the decision altitude (about 200ft), the aircraft is mainly controlled and deviations are corrected by aircraft instrument information. Visual references must be established and maintained before visual flight can continue the approach. ILS Class I requires the decision altitude to be at least 200ft above the ground, and appropriate visual references must be established and maintained. A runway visual reference must also be established at 100ft.

[0199] Phase 3—Post-decision phase (height 100ft-0ft) (see Figure 7 — Fig.10 )

[0200] Pay more attention to the outside than the inside, mainly focusing on the runway centerline area, and the line of sight gradually moves forward as the altitude decreases. When visibility is normal, the line of sight moves forward earlier and the landing distance is longer; under low visibility conditions, the line of sight moves forward later and the landing position is closer.

[0201] Focus on the PITCH area (flight guidance and aircraft attitude information) of the instrument area. As the altitude decreases, the internal focus continues to decrease and the external focus continues to increase. Compared with normal visibility, the altitude when the line of sight is completely turned to the outside under low visibility conditions is lower.

[0202] In this stage, the approach lights and runway entrance signs can provide references for the aircraft's attitude and position. In order to maintain continuity with the visual information input and aircraft motion state perception and judgment in the leveling stage, it is recommended to shift the line of sight to a distance in front of the aircraft and move the line of sight forward as the aircraft moves. During the process, the relative position of the aircraft can be judged by the touchdown zone sign, and the peripheral visual system can be used to judge the aircraft's speed and sinking (including other body perception information) based on the movement of the touchdown zone sign and the aiming point sign, and then enter the leveling stage until the aircraft touches down.

[0203] Under low visibility conditions, due to the limited clues in the visible ground area, the pilot's perception and judgment of the pitch attitude, aircraft position and descent rate are directly affected, which can easily create the illusion of flying at a too high altitude. It is necessary to combine the aircraft system information to avoid the actual low flight altitude, which may cause the touchdown position to be too close or the landing distance to be too short.

[0204] The reference model manual recommends that the movement of the aiming point be used to judge the aircraft's sinking during the landing and leveling phases. During the leveling process, the line of sight should be shifted to the front of the aircraft, which can help control the aircraft's pitch attitude and judge the descent rate and the position of the aircraft relative to the ground. There are two types of line of sight positions during the leveling phase: one is to look at the end of the runway, and the other is to tilt downward 10 to 15 degrees to observe the movement of the intersection of the line of sight and the runway. Looking at the end of the runway helps to adjust the extended focus so that the aircraft remains level and the field of vision is wider. The runway edge angle and the optical flow of peripheral vision may be useful. The downward tilt of the line of sight is based on the fact that the intersection will move forward when the pitch attitude is too large, and it will slowly move toward the pilot based on the appropriate leveling. This method adopts a gaze strategy of tilting the line of sight downward to a position not far from the aircraft, rather than looking at the far end of the runway.

[0205] Although the various steps in the above embodiment are described in the above-mentioned order, those skilled in the art can understand that in order to achieve the effect of this embodiment, different steps do not have to be executed in such an order. They can be executed simultaneously (in parallel) or in a reverse order. These simple changes are within the scope of protection of the present invention.

[0206] A system for establishing a visual attention allocation strategy based on multiple visibility according to a second embodiment of the present invention is based on a method for establishing a visual attention allocation strategy based on multiple visibility, and includes:

[0207] An area of ​​interest and altitude segmentation module configured to obtain pilot eye movement data and altitude data from the primary flight display during the flight mission; segment areas of interest for the interior and exterior of the cockpit, approach lights, and runway, and segment altitude intervals for the final approach to landing phase;

[0208] A mapping position acquisition module configured to acquire the mapping position of each area of ​​interest at different height intervals;

[0209] An expert pilot screening module, configured to screen out expert pilots based on process parameters and touchdown parameters in the flight parameters, and obtain effective eye movement data of the expert pilots in different altitude intervals;

[0210] an attention allocation strategy generation module, which is configured to select fixation duration as an eye movement analysis indicator, and analyze the effective eye movement data of each interest area in different height intervals in combination with the mapping position, to obtain a change trend of attention allocation and a differentiated attention allocation strategy;

[0211] The consistency judgment module is configured to judge the consistency between the differentiated attention allocation strategy and the flight control result based on the ground flight parameter analysis result of the expert pilot.

[0212] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process and related instructions of the system described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0213] It should be noted that the above embodiment provides a visual attention allocation system based on different visibilities, and only uses the division of the above functional modules as an example. In practical applications, the above functional allocation can be completed by different functional modules as needed, that is, the modules or steps in the embodiments of the present invention can be decomposed or combined. For example, the modules in the above embodiments can be combined into one module, or further divided into multiple sub-modules to complete all or part of the functions described above. The names of the modules and steps involved in the embodiments of the present invention are only for distinguishing the modules or steps, and are not regarded as improper limitations of the present invention.

[0214] An electronic device according to a third embodiment of the present invention includes:

[0215] at least one processor; and

[0216] a memory communicatively connected to at least one of the processors; wherein,

[0217] The memory stores instructions that can be executed by the processor, and the instructions are used to be executed by the processor to implement the above-mentioned method for establishing a visual attention allocation strategy based on multiple visibility.

[0218] A fourth embodiment of the present invention is a computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to be executed by the computer to implement the above-mentioned method for establishing a visual attention allocation strategy based on multiple visibility.

[0219] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process and related instructions of the storage device and processing device described above can refer to the corresponding process in the aforementioned method embodiment and will not be repeated here.

[0220] Those skilled in the art should be able to appreciate that the modules and method steps of each example described in conjunction with the embodiments disclosed herein can be implemented with electronic hardware, computer software or a combination of the two, and the programs corresponding to the software modules and method steps can be placed in random access memory (RAM), internal memory, read-only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disks, removable disks, CD-ROMs, or any other form of storage medium known in the technical field. In order to clearly illustrate the interchangeability of electronic hardware and software, the composition and steps of each example have been generally described in the above description according to the function. Whether these functions are performed in electronic hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present invention.

[0221] Reference below Fig.11 , which shows a schematic diagram of the structure of a computer system of a server for implementing the method, system, and device embodiments of the present application. Fig.11 The server shown is merely an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0222] like Fig.11As shown, the computer system includes a central processing unit (CPU) 1101, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 1102 or the program loaded from the storage part 1108 to the random access memory (RAM) 1103. Various programs and data required for system operation are also stored in the RAM 1103. The CPU 1101, ROM 1102 and RAM 1103 are connected to each other through a bus 1104. An input / output (I / O) interface 1105 is also connected to the bus 1104.

[0223] The following components are connected to the I / O interface 1105: an input section 1106 including a keyboard, a mouse, etc.; an output section 1107 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker; a storage section 1108 including a hard disk, etc.; and a communication section 1109 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 1109 performs communication processing via a network such as the Internet. A drive 1110 is also connected to the I / O interface 1105 as needed. A removable medium 1111, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 1110 as needed so that a computer program read therefrom is installed into the storage section 1108 as needed.

[0224] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 1109, and / or installed from the removable medium 1111. When the computer program is executed by the central processing unit (CPU) 1101, the above-mentioned functions defined in the method of the present application are executed. It should be noted that the above-mentioned computer-readable medium of the present application can be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium can be, for example, - but not limited to - an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to, an electrical connection with one or more conductors, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, an apparatus or a device. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in combination with an instruction execution system, an apparatus or a device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0225] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0226] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0227] The terms "first", "second", etc. are used to distinguish similar objects rather than to describe or indicate a particular order or sequence.

[0228] The term "comprise" or any other similar term is intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus / device that includes a list of elements includes not only those elements but also other elements not expressly listed, or also includes elements inherent to such process, method, article, or apparatus / device.

[0229] So far, the technical solutions of the present invention have been described in conjunction with the preferred embodiments shown in the accompanying drawings. However, it is easy for those skilled in the art to understand that the protection scope of the present invention is obviously not limited to these specific embodiments. Without departing from the principle of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the protection scope of the present invention.

Claims

1. A method for establishing a visual attention allocation strategy based on multiple visibility, characterized in that: The steps include: Obtain pilot eye movement data and altitude data from the primary flight display during the flight mission; divide the areas of interest inside and outside the cockpit, approach lights and runway, and divide the altitude intervals from the final approach to landing; Obtain the mapping position of each area of ​​interest in different altitude intervals; select expert pilots based on the process parameters and ground parameters in the flight parameters, and obtain effective eye movement data of expert pilots in different altitude intervals; The fixation duration is selected as the eye movement analysis indicator, and combined with the mapping position, the effective eye movement data of each interest area in different height intervals are analyzed to obtain the change trend of attention allocation and the differentiated attention allocation strategy; Based on the analysis results of the expert pilot's touchdown flight parameters, the consistency between the differentiated attention allocation strategy and the flight control results is judged, and the pilot's flight strategy is guided.

2. According to the method for establishing a multi-visibility based visual attention allocation strategy according to claim 1, it is characterized in that: Eye tracking data and altitude data in the primary flight display are acquired synchronously based on two different eye trackers.

3. The method for establishing a visual attention allocation strategy based on multiple visibility according to claim 1, characterized in that: The runway is divided into interest areas horizontally and vertically, and the runway interest area is horizontally divided into the middle, left and right parts; The middle part includes the inner edge area of ​​the touchdown zone lights on both sides, the left side is the area from the touchdown zone lights to the left side lights of the runway, and the right side is the area from the touchdown zone lights to the right side lights of the runway; The runway area of ​​interest is divided longitudinally into the lead-in light area, the near end of the runway, the middle of the runway, and the far end of the runway; The lead-in light area is the inner edge of the short row of lights on the side, the near end of the runway is from the runway entrance mark to the leading edge of the second touchdown zone mark, the middle section of the runway is from the second touchdown zone mark to the leading edge of the third touchdown zone mark and includes the aiming point mark area, and the far end of the runway is the area behind the third touchdown zone mark.

4. The method for establishing a visual attention allocation strategy based on multiple visibility according to claim 1, characterized in that: The final approach and landing phase is divided into the pre-decision phase, the decision phase and the post-decision phase, starting from the preset altitude to the touchdown altitude range.

5. The method for allocating visual attention based on different visibilities according to claim 1, characterized in that: Get the mapping position of each area of ​​interest at different height intervals by: Based on image data taken at multiple altitudes under different flight conditions, the image data of normal visibility during the day is used as the basic mapping base map to obtain mapping results under various flight conditions. Then, the image data taken under normal visibility at night and day / night low visibility conditions are used as reference to process the basic mapping base map to obtain a processed base map that is close to the actual scene map, and all mapping results are presented on the processed base map.

6. The method for establishing a visual attention allocation strategy based on multiple visibility according to claim 1, characterized in that: The process parameters and the grounding parameters respectively include: The process parameters include approach speed, approach slope, descent rate, air load, final approach attitude, glide path and localizer deviation during the final approach / landing phase; The touchdown parameters include touchdown load, touchdown heading deviation, touchdown pitch attitude, touchdown pitch change rate and landing distance.

7. The method for establishing a visual attention allocation strategy based on multiple visibility according to claim 1, characterized in that: The visual attention allocation strategy includes a visual attention allocation strategy for the inner and outer areas of the cockpit, and the analysis method is as follows: Using a repeated measures variance analysis method, obtaining the first main effect and the first interaction effect of the altitude interval and the inner and outer areas of the cockpit under each visibility condition, and determining whether the first interaction effect is less than a preset threshold; If it is less than, then compare the gaze durations of the inner and outer areas of the cockpit at each altitude interval, and obtain the difference data of the gaze durations of the inner and outer areas of the cockpit according to the comparison results; If it is not less than, then the influence of the height interval and the inner and outer areas on the fixation duration is obtained according to the first main effect; Using a repeated measures variance analysis method, obtaining the second main effect and the second interaction effect of the visibility condition and the altitude range, and determining whether the second interaction effect is less than a preset threshold; If it is less than, then compare the internal and external gaze durations under different visibility conditions in each height interval, and obtain the impact data of different visibility conditions on the internal and external gaze durations based on the comparison results; If it is not less than, then the influence of visibility condition and altitude range on fixation duration is obtained according to the second main effect; The data on the difference in gaze duration inside and outside the cockpit at each altitude stage and the impact of visibility conditions on the gaze duration inside and outside the cockpit at each altitude stage are used as the visual attention allocation strategy for the inside and outside areas of the cockpit.

8. The method for establishing a visual attention allocation strategy based on multiple visibility according to claim 1, characterized in that: The visual attention allocation strategy includes a visual attention allocation strategy for the instrument area, and the analysis method is as follows: Using repeated measures analysis of variance, the third main effect and the third interaction effect between the altitude interval and the instrument area inside the cockpit under each visibility condition were obtained, and it was determined whether the third interaction effect was less than the preset threshold; If it is less than, then compare the gaze time of the instrument area in each height interval, and obtain the difference data of the gaze time of the instrument area according to the comparison result; If it is not less than , the influence of the height interval and instrument area on the fixation duration is obtained according to the third main effect; Using a repeated measures variance analysis method, obtaining the fourth main effect and the fourth interaction effect of the visibility condition and the altitude range, and determining whether the fourth interaction effect is less than a preset threshold; If it is less than, then compare the instrument area gaze time under different visibility conditions in each altitude interval, and obtain the impact data of visibility conditions on instrument gaze time based on the comparison results; If it is not less than, then the influence of visibility conditions and altitude range on the instrument looking time is obtained according to the fourth main effect; The data on the difference in gaze duration in the instrument area at each altitude stage and the impact of visibility conditions on the gaze duration in the instrument area at each altitude stage are used as the visual attention allocation strategy for the instrument area.

9. The method for establishing a visual attention allocation strategy based on multiple visibility according to claim 1, characterized in that: The visual attention allocation strategy includes a visual attention allocation strategy for the runway area, and the analysis method is as follows: Using a repeated measures analysis of variance method, obtaining the fifth main effect and the fifth interaction effect between the altitude interval and the runway area under each visibility condition, and determining whether the fifth interaction effect is less than a preset threshold; If it is less than, then compare the gaze durations of different runway areas in each height interval, and obtain runway area gaze duration difference data according to the comparison results; If it is not less than, then the influence of the height interval and the runway area on the fixation time is obtained according to the fifth main effect; wherein the runway area includes the horizontal area and the vertical area; the runway area fixation time difference includes the horizontal runway area fixation time difference and the vertical runway area fixation time difference; Using a repeated measures variance analysis method, obtaining the sixth main effect and the sixth interaction effect of the visibility condition and the altitude range, and determining whether the sixth interaction effect is less than a preset threshold; If it is less than, then compare the runway watching time under different visibility conditions in each altitude interval, and obtain the impact of visibility conditions on the runway watching time based on the comparison results; If it is not less than, then the influence of visibility conditions and altitude range on the watching time of the runway area is obtained according to the sixth main effect; The difference data of gaze duration in the runway area at each altitude stage and the impact of visibility conditions on the runway gaze duration at each altitude stage are used as the visual attention allocation strategy for the runway area.

10. A system for establishing a visual attention allocation strategy based on multiple visibility, based on a method for establishing a visual attention allocation strategy based on multiple visibility as claimed in any one of claims 1 to 9, characterized in that: include: an area of ​​interest and altitude segmentation module configured to obtain eye movement data of a pilot during a flight mission and altitude data in a primary flight display; Delineate areas of interest for the cockpit interior and exterior, approach lights and runway, and altitude intervals for the final approach to landing; A mapping position acquisition module configured to acquire the mapping position of each area of ​​interest at different height intervals; An expert pilot screening module, configured to screen out expert pilots based on process parameters and touchdown parameters in the flight parameters, and obtain effective eye movement data of the expert pilots in different altitude intervals; an attention allocation strategy generation module, which is configured to select fixation duration as an eye movement analysis indicator, and analyze the effective eye movement data of each interest area in different height intervals in combination with the mapping position, to obtain a change trend of attention allocation and a differentiated attention allocation strategy; The consistency judgment module is configured to judge the consistency between the differentiated attention allocation strategy and the flight control result based on the ground flight parameter analysis result of the expert pilot.

11. An electronic device, characterized in that: include: at least one processor; as well as a memory communicatively connected to at least one of the processors; wherein, The memory stores instructions executable by the processor, and the instructions are used to be executed by the processor to implement a method for establishing a visual attention allocation strategy based on multiple visibility as described in any one of claims 1-9.

12. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to be executed by the computer to implement a method for establishing a visual attention allocation strategy based on multiple visibility as described in any one of claims 1-9.

Images