A method for optimizing the layout and presentation of flight procedure forms based on situational tasks

By using a scenario-based task optimization method, combined with eye-tracking technology and fuzzy comprehensive evaluation, the layout and presentation of the flight procedure form for amphibious aircraft were optimized, solving the problem of low information acquisition efficiency for pilots and achieving more efficient information transmission and reduced workload.

CN115640086BActive Publication Date: 2026-03-27AVIC GENERAL HUANAN AIRCRAFT IND CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-09-23
Publication Date
2026-03-27

AI Technical Summary

Technical Problem

In the design of flight procedure forms for amphibious aircraft, existing technologies have failed to effectively optimize the layout and presentation, resulting in low information acquisition efficiency and increased workload for pilots in special situations.

Method used

An optimization method based on contextual tasks is adopted, which uses eye-tracking technology and fuzzy comprehensive evaluation to optimize the layout and presentation of flight procedure forms. The optimized form layout and presentation format are designed by combining the pilot's visual cognition and mission characteristics.

Benefits of technology

It improves the efficiency of pilots in acquiring information in special situations, reduces the information search process, lowers workload, meets the visual cognitive needs of pilots, and improves work efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115640086B_ABST
    Figure CN115640086B_ABST
Patent Text Reader

Abstract

The present application belongs to the cross technical field of operation file verification technology, aircraft flight simulation and simulation technology, and relates to an optimization method for flight program table layout and presentation based on scenario tasks, which comprises the following steps: step 1: designing and compiling flight program styles, determining layout and presentation format texts, the styles and the texts being the first drafts of the flight program table; step 2: building a human-computer interaction platform, determining a flight task scheme based on the characteristics of the tasks and the characteristics of each flight state; step 3: optimizing the improved flight program table based on the first draft of the flight program table; step 4: implementing eye movement tracking tests on the flight program table and the improved flight program table; step 5: obtaining main and objective index data, if the data does not meet the requirements, the flight task scheme needs to be redesigned, if the data meets the requirements, the differences between the flight program table and the improved flight program table are analyzed; and step 6: determining the optimal flight program table layout and presentation format.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application belongs to the cross technical field of operation file verification technology, aircraft flight simulation and simulation technology, and relates to an optimization method for flight procedure table layout and presentation based on scenario tasks. BACKGROUND

[0002] The operation file is one of the important components of the final delivery of a civil aircraft, which contains technical instructions, operation steps and other related contents involved in the execution of flight tasks by the crew. After the operation file is compiled (including the draft and preliminary draft stages), it needs to be verified internally. The correctness, completeness and operability of the operation file will directly affect the attention and workload of the pilots, and the important data, limitation conditions and operation procedures need to be verified before delivery. In order to ensure the quality of the operation file, the aircraft manufacturer must carry out operation file verification work and continuously improve it, so that the quality of the operation file can meet the design, airworthiness and customer requirements.

[0003] In the process of cockpit human-computer interaction, the operation file is one of the ways for pilots to obtain information. The flight procedure table is used most frequently, and emergency and abnormal checklists account for 80% of interactive information. The flight procedure table has undergone decades of development of Airbus, Boeing, Comac and other major manufacturers, and all of them have adopted similar "standard specifications", i.e. five types of content including title, condition (condition), operation steps, precautions and other supplements. Although each manufacturer is based on its own cockpit concept and is not unified, the layout and presentation of the table cannot avoid these five types of content. Under this principle, how to provide pilots with the most needed information in special situations, reduce the process of pilots searching for information, and improve the work efficiency of pilots is the key.

[0004] As the verification research of the amphibious aircraft being developed in China is in the blank stage, most manual writers are affected by subjective factors such as experience and thinking angle, and often focus on the accuracy of technical parameters, while ignoring related problems in the actual operation environment. In recent years, user experience, human factors and human-computer interaction research have used eye tracking technology in experiments. The advantage of this method is that it can collect data comprehensively and objectively, and will not have any impact on the implementation process. The amphibious aircraft is a special task aircraft, and its main task is to perform tasks in fire extinguishing or rescue task scenarios. Eye tracking technology is very suitable. The research paradigm is like a "fast channel" of visual cognition, which verifies the rationality of the experimental design through known conclusions, and relates the relationship between visual cognition and eye movement indicators. In the visual-situational research paradigm, the stimuli in the auditory channel and the visual channel often have cross-channel effects, and eye tracking technology can obtain the perception situation under different representations and the eye movement trajectory of the subjects. SUMMARY

[0005] The application provides an optimization method for flight procedure form layout and presentation based on a situational task, in order to continuously optimize the flight procedure form, the application is based on the user concept of "pilot-centered", implements civil aviation standards and specification requirements into flight procedure form application, performs situational task tests in five flight stages of water take-off and landing, analyzes the hierarchical relationship between flight procedure form information coding and cognitive mechanism, and provides test data difference for subsequent optimization and redesign and design principles.

[0006] The technical scheme of the application is as follows:

[0007] An optimization method for flight procedure form layout and presentation based on a situational task, comprising the following steps:

[0008] Step 1: designing and preparing a flight procedure style, determining a layout and presentation format text, the style and the text are the first draft of the flight procedure form;

[0009] Step 2: building a human-computer interaction platform, determining a flight task scheme based on task characteristics and characteristics of each flight state;

[0010] Step 3: optimizing the improved flight procedure form based on the first draft of the flight procedure form;

[0011] Step 4: performing eye movement tracking tests on the flight procedure form and the improved flight procedure form;

[0012] Step 5: obtaining main and objective index data, if the data does not meet the requirements, the flight task scheme needs to be redesigned, if the data meets the requirements, the difference between the flight procedure form and the improved flight procedure form is analyzed;

[0013] Step 6: determining the optimal flight procedure form layout and presentation format.

[0014] Further, the flight procedure style prepared in the step 1 comprises a title, a condition statement, an operation procedure, a non-working item, an affected item and a delay item, collects pilot and expert requirements, determines a flight procedure layout and presentation format, and formulates the flight procedure form.

[0015] Further, the human-computer interaction platform suitable for the flight procedure form is built in the step 2, and the human-computer interaction platform comprises an interactive display and control system and a visual simulation system, situational tasks of amphibious aircraft are determined based on task characteristics and characteristics of each flight state, the flight task scheme is determined, and the situational tasks of the amphibious aircraft include five task situations of water take-off, water sliding, normal water throwing, emergency water throwing and water landing.

[0016] Further, the step 3 is improved and optimized for the existing flight procedure form draft, mainly highlighting, simplifying and designing the continuity of information elements.

[0017] Further, the subjective index in the subjective index and the objective index in the step 5 include the task completion rate and the completion time, and the objective index includes the eye movement index, including the reaction time, the number of fixation points, the fixation time and the average saccade time.

[0018] Further, the step 6 utilizes the test results to determine the difference between the two forms by using the fuzzy comprehensive evaluation method, and continuously improves the layout of the form.

[0019] Further, when the amphibious aircraft takes off on water, slides to draw water, normally drops water, emergency drops water and lands on water according to the scene task, the respective responsibilities of the pilot, the monitoring pilot and the mechanic in the three-person crew should be considered, and the flight procedure logic, the assumed premise condition and the matters needing attention should be considered.

[0020] Further, when the layout of the form is improved, the work load of the crew is increased when the scene task is executed according to the particularity of the amphibious aircraft, and the task description of the flight task scene content and the specific operation steps is clear.

[0021] The beneficial effects of the present application are:

[0022] (1) The user concept of "pilot-centered" is followed, the development law of the flight procedure form is summarized, the layout and presentation design trend is explored, the display of the flight procedure form is defined to meet the visual cognitive angle of the pilot, the visual physiology, specific parameters and characteristics of the pilot are analyzed, and the effectiveness and feasibility of the optimization method and design principle of the present application are verified through the test results.

[0023] (2) Based on the information transmission way of the pilot when executing the flight task, the acquisition and transmission of the layout and presented information are focused on, the cognitive load problem involved in different stages is combined, the hierarchical relationship between the information coding and the cognitive mechanism of the flight procedure form design elements is analyzed, and the most needed information of the pilot in the special situation is provided, the process of the pilot searching for information is reduced, and the work efficiency of the pilot is improved.

[0024] (3) The flight procedure form design elements are more, the test research is carried out mainly for the icon feature coding, the interface information layout coding and other problems, and the test basis and design principle for subsequent optimization and redesign are provided. DETAILED DESCRIPTION

[0025] Figure 1 It is a flow chart of the layout and presentation screening optimization of the flight procedure form.

[0026] Figure 2 It is a display format of the flight procedure form. Detailed Implementation

[0027] The following description, with reference to the accompanying drawings, further details the specific embodiments of the present invention, including the shape and structure of each component, the relative positions and connections between the parts, the function and working principle of each part, the manufacturing process, and the operation and use methods. This is to help those skilled in the art to have a more complete, accurate, and in-depth understanding of the concept and technical solution of the present invention.

[0028] This example proposes an optimization method for the layout and presentation of flight procedure forms based on scenario-based tasks. It employs subjective and objective data and fuzzy comprehensive evaluation, and assesses the cognitive load of flight procedures by comparing the eye-tracking and behavioral response indicators of flight crews in the old and new forms. Through comparative analysis of subjects performing tasks at different stages, it statistically analyzes priorities, providing experimental basis and scientific guidelines for the coding of flight procedure form information layout.

[0029] Specifically, such as Figure 1 As shown, an optimization method for the layout and presentation of flight procedure forms based on scenario-based tasks includes the following steps:

[0030] Step 1: Design and compile flight procedure templates. Flight procedure templates include titles, status statements, operating procedures, non-operating items, affected items, and delayed items. These are the basic prerequisites for designing flight procedure forms.

[0031] The layout and presentation format of the text were determined; all flight procedure forms in the experiment were paper A5 size; to reduce visual search interference, all stimuli were presented within the A5 size range, such as... Figure 2 As shown, the style is the initial draft of the flight procedure form for the experiment, which is the old form described in this example. The flight procedure form is divided into four main sections: A, B, C, and D. Section A is the title and is not further subdivided. Section B is subdivided into two parts, mainly for the division of situation statements. Section D is subdivided into three parts, mainly for the division of supplementary content. Therefore, there are a total of nine subdivided sections, which are numbered for the convenience of experimental data statistical analysis.

[0032] Step 2: Build a human-computer interaction platform and determine the flight mission plan based on the mission characteristics and the features of each flight state;

[0033] The interactive display system in the human-computer interaction platform of the flight procedure form refers to the part of the interaction between the flight crew and the aircraft and the flight procedure form. The test conditions of the flight task include the main flight display, the flight control panel, the control display unit, and the operating devices such as the steering wheel, the throttle, and the landing gear handle. The interactive line control system is connected with various display interfaces by using the VAPS software. The visual simulation system in the human-computer interaction platform of the flight procedure form is developed by using Vega Prime. The 6-channel and 3d realize the stereoscopic rendering of the picture, and can restore the scene of the actual situation of the subject as much as possible.

[0034] Different flight task state stages are set, including water take-off, taxiing for water absorption, normal water release, emergency water release, and water landing.

[0035] According to different periods of the amphibious aircraft, the high-brightness environment and the low-brightness environment are set.

[0036] According to the position of the information source observed by the crew, the ground information environment and the air information environment are set.

[0037] The amphibious aircraft is a special aircraft, and the visual cognitive function of the pilot in this environment will be greatly affected. The main factors are special situation factors, cabin environment factors, and other factors.

[0038] Table 1 Influence factors of flight procedure form

[0039]

[0040]

[0041] Step 3, on the basis of the initial draft of the flight procedure form, the information elements are highlighted, simplified, and designed for the continuity of the flight procedure design, and the improved flight procedure form is optimized.

[0042] Step 4, eye movement tracking tests are conducted on the two forms.

[0043] The test is divided into 5 groups, which are the simulation of the flight task state in the special situation 5, which is the first experimental factor, and each state has A / B / C / D 4 large area variables, which is the second experimental factor. In each test, any area can be randomly changed and presented. It is not tested whether there is a difference between different levels of each factor. The test uses a factorial experimental design.

[0044] After the start of each test, the subjects are given observation tasks in each stage, such as water take-off, which requires the subjects to complete other flight tasks, observe the speed, altitude, and load information, and then require the subjects to complete the water take-off checklist within a unit time. There are 5 experiments, 9 small areas in each group, and each small area needs to be observed in turn in the new and old checklists, a total of 90 times. Through the random arrangement of the presentation order, the attention of the subjects is maintained.

[0045] The amphibious aircraft is a "three-man" model, divided into the pilot (PF), monitor pilot (PM), and air mechanic (ME). The responsibilities of each checklist are defined before the test, and recorded by the eye tracker. Each task is expected to take 10-20 minutes, and the total time is 1-2 hours.

[0046] Step 5, obtain the subjective and objective index data, and redesign the flight task plan if the requirements are not met;

[0047] Table 2 Evaluation index

[0048]

[0049]

[0050] Step 6, analyze the differences between the two forms according to the data results, and determine the optimal flight procedure form layout and presentation format.

[0051] According to the evaluation index in Table 2, the evaluation index and comment set are determined, the weight vector matrix A and the weight judgment matrix R are constructed, the weight is calculated, and the decision evaluation is made. There are four calculation methods (i.e. four fuzzy operators) for fuzzy comprehensive evaluation. According to the test data, the weighted average type is selected.

[0052] According to the statistical analysis of the test data of the five stages, the visual priority ranking of the specific sub-regions is summarized, and the preferred region, the second selected region, and the alternative region of the flight procedure form in the five stages of water take-off, taxiing, normal water throwing, emergency water throwing, and water landing are summarized.

[0053] Table 3 Test conclusion statistics

[0054]

[0055]

[0056] Although the three-person crew's division of labor and the automation level of the cockpit gradually increase, the crew still needs to operate and control a large number of operations during the flight, especially in the flight phases of water take-off, emergency water release and water landing, which will generate a certain workload on the crew. As can be seen from the test conclusion in the above table, the three phases have more preferred regions. For example, during the emergency water release process, the subject only needs to pay attention to the information of the aircraft height, speed and attitude on the primary flight display PFD, and make some minor adjustments to the aircraft according to the information. However, after the occurrence of a special situation, the operating pilot (PF) is responsible for the throttle lever, flight trajectory and airspeed control, aircraft shape, navigation, etc.; the monitoring pilot (PM) is responsible for monitoring and reading out the checklist, performing the required actions, communication, and top control panel operations; and the mechanic (ME) is responsible for engine switch, engine state and system operation, monitoring aircraft state and aircraft shape PF instruction action task. Their workload will increase linearly at this time. According to the operation procedure, it can be considered that for the entire process, the interaction of the information flow and control flow performed by the subject is relatively frequent, so it is necessary to reduce the crew's confusion about the layout presentation, and it must not increase other burdens.

[0057] Since the standard operating procedures SOPs for different subjects are similar for specific tasks, and the AOI area and human-machine interaction process converged by the heat map are also similar, this conclusion is helpful for flight training. Many indicators in the optimization of the flight procedure sheet layout and presentation can be used as evaluation indicators for flight training, and can be further extended to operation verification of the running file.

[0058] The above describes the present application in conjunction with the drawings, and it is obvious that the specific implementation of the present application is not limited by the above manner. Any non-essential improvement using the method concept and technical solution of the present application, or direct application of the concept and technical solution of the present application to other occasions without improvement, is within the protection scope of the present application.

Claims

1. An optimized method for the layout and presentation of flight procedure forms based on scenario-based tasks, characterized in that, Includes the following steps: Step 1: Design and compile flight procedure templates, determine the layout and presentation format text. The templates and texts are the initial drafts of the flight procedure forms. The flight procedure templates include titles, status statements, operating procedures, non-operating items, affected items, and delayed items. Collect requirements from pilots and experts, determine the layout and presentation format of the flight procedures, and develop the flight procedure forms. Step 2: Build a human-computer interaction platform and determine the flight mission plan based on the mission characteristics and the features of each flight state; Step 3: Based on the initial draft of the flight procedure form, optimize it into an improved flight procedure form. Specifically, improve and optimize the existing initial draft of the flight procedure form by highlighting and simplifying information elements and designing for consistency. Step 4: Perform eye-tracking tests on both the flight procedure form and the improved flight procedure form; Step 5: Obtain subjective and objective indicator data. If the data does not meet the requirements, the flight mission plan needs to be redesigned. If the data meets the requirements, analyze the differences between the flight procedure form and the improved flight procedure form. Step 6: Determine the optimal layout and presentation format of the flight procedure form. Specifically, use the fuzzy comprehensive evaluation method based on the test results to determine the differences between the two forms and continuously improve the layout of the form.

2. The method for optimizing the layout and presentation of a scenario-based flight procedure form according to claim 1, characterized in that, In step 2, a human-computer interaction platform suitable for flight procedure forms is built, including an interactive display and control system and a visual simulation system. Based on the mission characteristics and the features of each flight state, the scenario missions of the amphibious aircraft are analyzed and determined, and the flight mission plan is determined. The scenario missions of the amphibious aircraft include five mission scenarios: water take-off, taxiing and water scooping, normal water drop, emergency water drop, and water landing.

3. The method for optimizing the layout and presentation of a scenario-based flight procedure form according to claim 1, characterized in that, In step 5, the subjective indicators include task completion rate and completion time, while the objective indicators include eye movement indicators, such as reaction time, number of fixations, fixation time, and average saccade time.

4. The method for optimizing the layout and presentation of a scenario-based flight procedure form according to claim 2, characterized in that, When amphibious aircraft take off, taxi to collect water, drop water normally, drop water in an emergency, or land on water, the responsibilities of the three-person crew members—the pilot in charge, the monitoring pilot, and the mechanic—as well as the flight procedure logic, presuppositions, and precautions should be taken into account.

5. The method for optimizing the layout and presentation of a scenario-based flight procedure form according to claim 1, characterized in that, When refining the layout of the form, the special characteristics of amphibious aircraft should be taken into account to increase the workload of the crew when performing scenario missions, and the mission descriptions of the flight mission scenario and specific operating steps should be clearly defined.

Citation Information

Patent Citations

  • Automatic UAV (unmanned aerial vehicle) flight test task list planning method on basis of Oracle database

    CN104680325A

  • Flight task-based HUD interface optimization layout self-adaption method and system

    CN110096328A