A method, device and equipment for determining situational awareness state in a flight mission

Abstract

The embodiment of the present application provides a method, device and equipment for determining the situational awareness state in a flight mission, which relates to the field of pilot training. The method includes: based on the time sequence, decomposing the preset air flight mission into targets and actions, and determining a variety of flight training tasks; determining a plurality of test variables; constructing a test model of the situational awareness state according to a plurality of flight training tasks and a plurality of test variables; running the test model, responding to the pilot's operation, and executing a variety of flight missions to be executed; obtaining the pilot's measurement indicators in the process of executing each flight mission to be executed; adjusting the test model according to the measurement indicators until the test model is stable; determining the pilot's situational awareness state using the stable test model; being able to induce different situational awareness states of the pilot in the process of executing the flight mission in the ground environment, and providing technical support for the subsequent evaluation of the pilot's situational awareness state in real flight.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of pilot training, and in particular to a method, device and equipment for determining the state of situational awareness in a flight mission. Background Art

[0002] With the development of technology, flight operations have become increasingly complex and diverse. At the same time, the cognitive effort of pilots has also increased accordingly. Whether in routine operations or special situations, pilots need to continuously carry out a dynamic cycle of information perception, selection, comprehensive judgment and decision-making.

[0003] The cockpit of an aircraft is a complex human-machine interaction system. The amount of information carried by its display and control system is diversified and complex. While the various types of information provide pilots with accurate and comprehensive cabin status and external environment data, they also cause new problems. Some key information may be submerged in the massive information display and difficult for pilots to perceive and extract in time, resulting in narrow attention, omission of key information, redundant retrieval of invalid information, etc., which in turn leads to human errors and even catastrophic consequences.

[0004] Therefore, it is very important to determine the pilot's situational awareness. The situational awareness state affects the pilot's decision-making quality and task performance. Losing situational awareness means that the cognitive task cannot be completed, which will lead to catastrophic consequences. Summary of the invention

[0005] The embodiments of the present application provide a method, device and equipment for determining the situational awareness state in a flight mission, which can be combined with the preset air flight mission environment to induce different situational awareness states of the pilot in the process of executing the flight mission, provide support for the optimization of situational awareness evaluation and human-computer interaction interface design, and realize the use of test models in a ground environment to induce different situational awareness states of the pilot in the process of executing the flight mission, and provide technical support for the subsequent evaluation of the pilot's situational awareness state in actual flight.

[0006] In order to achieve the above purpose, the embodiment of the present application adopts the following technical solution:

[0007] In a first aspect, an embodiment of the present application provides a method for determining the situational awareness state in a flight mission, the method comprising: based on a time sequence, decomposing a preset air flight mission into targets and actions to determine a plurality of flight training tasks; the plurality of flight training tasks comprises a first flight mission, a second flight mission and a third flight mission; the situational awareness state of the pilot in the first flight mission is higher than the situational awareness state of the pilot in the second flight mission; the situational awareness state of the pilot in the second flight mission is higher than the situational awareness state of the pilot in the third flight mission; each of the plurality of flight training tasks comprises three stages: detection, attack and avoidance; determining a plurality of experimental variables; the experimental variables are used to influence the situational awareness state of the pilot; the plurality of experimental variables comprise a target aircraft information completeness and a flight mission process execution degree; the target aircraft information completeness is used to characterize a known quantity of the target aircraft information, and the flight mission process execution degree is used to characterize whether it is a necessary process for completing the flight mission; the target aircraft information comprises the target aircraft's At least one of altitude, speed, and azimuth; the target aircraft is a cooperative object / attack object in the flight training mission; a test model of situational awareness status is constructed according to multiple flight training missions and multiple test variables; the test model is used to simulate the execution of multiple flight missions to be executed, and to determine the situational awareness status of the pilot in each flight mission to be executed; the flight mission to be executed is one of multiple training tasks, or a combination of at least two of multiple training tasks; the test model is run, and in response to the pilot's operation, multiple flight missions to be executed, and each flight mission to be executed is executed in three stages; in the process of executing each flight mission to be executed, the pilot's measurement indicators are obtained, and the measurement indicators include objective data of the pilot in each flight mission to be executed collected by the sensor equipment, and the pilot's subjective evaluation data after situational awareness status training; according to the obtained measurement indicators, the test model is adjusted until the test model is stable; the pilot's situational awareness status is determined using the stable test model.

[0008] In a possible implementation, the target aircraft information completeness corresponding to the first flight mission is at a first level, and the flight mission process execution degree corresponding to the first flight mission is at a first execution degree;

[0009] The target aircraft information completeness corresponding to the second flight mission is at the first level, and the flight mission process execution degree corresponding to the second flight mission is at the second execution degree; the second execution degree is lower than the first execution degree;

[0010] The target aircraft information completeness corresponding to the third flight mission is at the second level, and the flight mission process execution degree corresponding to the third flight mission is at the second execution degree, and the second level is lower than the first level.

[0011] In another possible implementation, the objective data includes flight mission assessment parameters and physiological behavior parameters. The flight mission assessment parameters are used to characterize the accuracy of the pilot in completing the corresponding flight mission to be performed; the physiological behavior data are used to characterize the pilot's physiological characteristics in the process of completing the corresponding flight mission to be performed.

[0012] In another possible implementation, the flight mission assessment parameter includes at least one of operation quality, reaction rate, and decision accuracy;

[0013] The physiological behavior parameter includes at least one of an eye movement parameter and an electrocardiogram parameter; the eye movement parameter is collected by using an eye movement sensor, and the electrocardiogram parameter is collected by using an electrocardiogram sensor.

[0014] In summary, in the method for determining the situational awareness state provided in the embodiment of the present application, a variety of flight training tasks are determined by decomposing the preset air flight mission into targets and actions; in addition, after determining multiple test variables (the target aircraft information completeness and the flight mission process execution degree, the target aircraft is the cooperation object / attack object in the flight mission to be executed), a test model of the situational awareness state is constructed according to the multiple flight missions and test variables, and the test model is run to simulate the mission scenario for the pilot, inducing different situational awareness states of the pilot. Under different situational awareness states, measurement indicators including objective data and subjective evaluation data are obtained, and the test model is adjusted according to the measurement indicators until the test model is stable, so that the pilot's situational awareness state can be determined using a stable test model.

[0015] It can be seen that the test model in the embodiment of the present application is determined based on the flight training task, test variables, objective data and subjective evaluation data. The flight training task is obtained by analyzing the preset air flight task, the test variables will affect the pilot's situational awareness state, and the objective data and subjective evaluation data can more comprehensively characterize the pilot's response. Therefore, the test model in the embodiment of the present application can more accurately reflect the pilot's situational awareness state in performing the flight mission.

[0016] In a second aspect, a device for determining a situational awareness state in a flight mission, characterized in that the determining device comprises:

[0017] A determination module is used to decompose the preset air flight missions into targets and actions based on a time sequence to determine a plurality of flight training missions; the plurality of flight training missions include a first flight mission, a second flight mission and a third flight mission; the situational awareness state of the pilot in the first flight mission is higher than that in the second flight mission; the situational awareness state of the pilot in the second flight mission is higher than that in the third flight mission; each of the plurality of flight training missions includes three stages: detection, attack and avoidance;

[0018] The determination module is further used to determine a plurality of test variables; the test variables are used to influence the pilot's situational awareness state; the plurality of test variables include target aircraft information completeness and flight mission process execution degree; the target aircraft information completeness is used to characterize the known quantity of target aircraft information, and the flight mission process execution degree is used to characterize whether it is a necessary process for completing the flight mission; the target aircraft information includes at least one of the target aircraft's altitude, speed, and azimuth; the target aircraft is a cooperative object / attack object in the flight training mission;

[0019] A model building module is used to build a test model of situational awareness status according to multiple flight training tasks and multiple test variables; the test model is used to simulate the execution of multiple flight tasks to be executed, and determine the situational awareness status of the pilot in each flight task to be executed; the flight task to be executed is one of the multiple training tasks, or a combination of at least two of the multiple training tasks;

[0020] The model operation module is used to operate the test model and execute a variety of flight missions to be executed in response to the pilot's operation, and each flight mission to be executed is executed in three stages;

[0021] An indicator collection module is used to obtain the pilot's measurement indicators during the execution of each flight mission to be performed. The measurement indicators include objective data of the pilot in each flight mission to be performed collected by the sensor equipment, and subjective evaluation data of the pilot after the situational awareness state training;

[0022] The model adjustment module is used to adjust the test model according to the obtained measurement indicators until the test model is stable;

[0023] The model operation module is also used to determine the pilot's situational awareness state using a stable test model.

[0024] In a possible implementation, the target aircraft information completeness corresponding to the first flight mission is at a first level, and the flight mission process execution degree corresponding to the first flight mission is at a first execution degree;

[0025] The target aircraft information completeness corresponding to the second flight mission is at the first level, and the flight mission process execution degree corresponding to the second flight mission is at the second execution degree; the second execution degree is lower than the first execution degree;

[0026] The target aircraft information completeness corresponding to the third flight mission is at the second level, and the flight mission process execution degree corresponding to the third flight mission is at the second execution degree, and the second level is lower than the first level.

[0027] In another possible implementation, the objective data includes flight mission assessment parameters and physiological behavior parameters. The flight mission assessment parameters are used to characterize the accuracy of the pilot in completing the corresponding flight mission to be performed; the physiological behavior data are used to characterize the pilot's physiological characteristics in the process of completing the corresponding flight mission to be performed.

[0028] In another possible implementation, the flight mission assessment parameters include at least one of operation quality, reaction rate, and decision accuracy; the physiological behavior parameters include at least one of eye movement parameters and electrocardiogram parameters; the eye movement parameters are collected using an eye movement sensor, and the electrocardiogram parameters are collected using an electrocardiogram sensor.

[0029] In a third aspect, an embodiment of the present application provides an electronic device, comprising a processor and a memory, wherein the memory stores computer instructions, and the processor is used to execute the computer instructions stored in the memory. When the computer instructions are executed by the processor, the electronic device implements the determination method as described in the first aspect above and any one of its possible implementation methods.

[0030] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having computer execution instructions stored thereon. When the computer execution instructions are executed, the determination method described in any one of the above-mentioned first aspect and its possible implementation methods is executed.

[0031] In a fifth aspect, an embodiment of the present application provides a computer program product, which includes program instructions. When the program instructions are run on a computer, they are used to execute the method for determining the situational awareness state described in the first aspect and any one of its possible implementation methods.

[0032] It should be understood that the beneficial effects achieved by the technical solutions of the second to fifth aspects of the embodiments of the present application and the corresponding possible implementation methods can be referred to the technical effects of the first aspect and its corresponding possible implementation methods mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] Figure 1 A flowchart of a method for determining a situational awareness state in a flight mission provided by an embodiment of the present application;

[0034] Figure 2 A schematic diagram of the structure of a device for determining a situational awareness state in a flight mission provided by an embodiment of the present application;

[0035] Figure 3 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0036] The term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0037] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0038] In the description of the embodiments of the present application, unless otherwise specified, the meaning of "multiple" refers to two or more than two. For example, multiple processing units refer to two or more processing units; multiple systems refer to two or more systems.

[0039] The cockpit of an aircraft is a complex human-machine interaction system. The amount of information carried by its display and control system is diversified and complex. While the various types of information provide pilots with accurate and comprehensive cabin status and external environment data, they also cause new problems. Some key information may be submerged in the massive information display and difficult for pilots to perceive and extract in time, resulting in narrow attention, omission of key information, redundant retrieval of invalid information, etc., which in turn leads to human errors and even catastrophic consequences.

[0040] Therefore, it is very important to determine the pilot's situational awareness. The situational awareness state affects the pilot's decision-making quality and task performance. Losing situational awareness means that the cognitive task cannot be completed, which will lead to catastrophic consequences.

[0041] Situational awareness is a person's ability to accurately perceive environmental changes and predict future developments through understanding and judgment during information processing. Specifically, for pilots, the pilot's situational awareness refers to the perception of various elements in the flight environment, the understanding of the meaning of these elements, and the prediction of their subsequent states in a specific space and time. It is an important factor affecting pilots' decision-making and operations.

[0042] The real-time assessment of the pilot's situational awareness within a specific time unit is a key condition to reflect his or her cognitive status of various factors and conditions that affect the operation in a specific time period and specific situation, and is of great significance to reducing flight accidents caused by situational awareness errors. Simply put, the better the pilot's situational awareness, the more accurately and quickly he or she can perform flight missions.

[0043] In this way, better technical support can be provided during actual flight to avoid abnormal situations. It is crucial to accurately determine the situational awareness status of each pilot in the ground environment.

[0044] To this end, the embodiment of the present application provides a method for determining the situational awareness state in a flight mission, by decomposing the preset air flight mission into targets and actions, and determining a variety of flight training tasks; multiple test variables (the target aircraft information completeness and the flight mission process execution degree, the target aircraft is the cooperation object / attack object in the flight mission to be executed) are also determined, and a test model of the situational awareness state is constructed based on multiple flight missions and test variables, and the test model is run to simulate the flight mission scene for the pilot, inducing different situational awareness states of the pilot. Under different situational awareness states, measurement indicators including objective data and subjective evaluation data are obtained, and the test model is adjusted according to the measurement indicators until the test model is stable, so that the pilot's situational awareness state can be determined using a stable test model.

[0045] The test model in the embodiment of the present application is determined based on the flight training task, test variables, objective data and subjective evaluation data. The flight training task is obtained by analyzing the preset air flight task, the test variables will affect the pilot's situational awareness state, and the objective data and subjective evaluation data can more comprehensively characterize the pilot's response. Therefore, the test model in the embodiment of the present application can more accurately reflect the pilot's situational awareness state in the performance of the flight mission. The situational awareness state determined by the test model in the embodiment of the present application is relatively accurate and has a wide range of applicable scenarios.

[0046] The method for determining the situational awareness state in a flight mission provided in the embodiment of the present application can be applicable to low-altitude economic scenarios as well as high-altitude flight scenarios, and the embodiment of the present application does not make any specific limitations on this.

[0047] Specifically, the method for determining the situational awareness state in a flight mission provided in the embodiment of the present application can be applicable to various low-altitude flight activities of various manned / unmanned electronic devices in low-altitude economic scenarios. The electronic devices here can be drones, electric vertical take-off and landing vehicles (eVTOL), helicopters, traditional fixed-wing aircraft, etc.

[0048] The electronic device may also be a computer or a computer cluster, which is not specifically limited in the embodiments of the present application.

[0049] The electronic device may include a memory and a processor, and the memory and the processor are connected via at least one communication interface.

[0050] The electronic device includes a memory that can store the test model. The memory can be a cache, a solid state drive (SSD), a hard disk drive (HDD), a storage class memory (SCM), a memory, or other storage media.

[0051] Exemplarily, storage particles storing a specific number of bits include: single level cell (SLC), double level cell (MLC), triple level cell (TLC) or quad level cell (QLC).

[0052] The test model may be a neural network model or other artificial intelligence (AI) model, and the embodiments of the present application do not specifically limit this.

[0053] The processor included in the electronic device implements training of the measurement model stored in the memory according to the received measurement indicators. The processor may include one or more processor cores. The processor may be a very large scale integrated circuit. An operating system and other software programs are installed in the processor, so that the processor can access the memory and various peripheral component interconnect Express (PCIe) devices.

[0054] It is understandable that in this embodiment, the processor core in the processor may be a central processing unit (CPU) or other specific integrated circuits (ASIC). The processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field programmable gate arrays (FPGA), graphics processing units (GPU), AI chips, systems-on-a-chip (SoC) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc.

[0055] In combination with the above description, the method for determining the situational awareness state in a flight mission provided by an embodiment of the present application is described below.

[0056] like Figure 1 As shown, an embodiment of the present application provides a method for determining a situational awareness state in a flight mission, the method comprising:

[0057] S100: Based on the time sequence, decompose the preset air flight mission into targets and actions to determine a variety of flight training tasks.

[0058] The various flight training missions include a first flight mission, a second flight mission, and a third flight mission.

[0059] The pilot's situational awareness state in the first flight mission is higher than that in the second flight mission; the pilot's situational awareness state in the second flight mission is higher than that in the third flight mission.

[0060] Each of the various flight training missions includes three stages: detection, attack, and avoidance.

[0061] For example, if the air mission is a beyond visual range air combat, the mission is based on situational awareness, and the key information required includes engagement rules, target location, etc. After determining to engage with the beyond visual range target aircraft, the subsequent steps need to be executed in sequence. Therefore, the air mission can be decomposed into targets and actions, and each flight mission can be determined in advance.

[0062] In the detection flight mission phase, the target flight is discovered through detection means and the target aircraft is identified. In this phase, the key information of all potential target aircraft needs to be determined, including azimuth, altitude, speed and closing speed.

[0063] During the attack flight mission phase, it is necessary to determine the position, speed, altitude, heading and other information of each target aircraft, and to perceive and evaluate the beyond-visual-range air combat situation and attack mode.

[0064] During the evasive flight mission phase, evasive maneuvers or interference are required.

[0065] The multiple flight missions include a first flight mission, a second flight mission, and a third flight mission.

[0066] The target aircraft information completeness corresponding to the first flight mission is the first level (e.g., the target aircraft information is clear), and the flight mission process execution degree corresponding to the first flight mission is the first execution degree (e.g., it must be executed). The target aircraft information completeness corresponding to the second flight mission is the first level, and the flight mission process execution degree corresponding to the second flight mission is the second execution degree (e.g., it can be executed selectively); the second execution degree is lower than the first execution degree. The target aircraft information completeness corresponding to the third flight mission is the second level (e.g., the target aircraft information is not clear), and the flight mission process execution degree corresponding to the third flight mission is the second execution degree, and the second level is lower than the first level.

[0067] It can be simply understood that the difficulty (or complexity) of the first task is lower than that of the second task, and the difficulty (or complexity) of the second task is lower than that of the third task. These three tasks can also be called high situation awareness state tasks, medium situation awareness state tasks, and low situation awareness state tasks, respectively.

[0068] Exemplarily, the first task corresponds to "clarify the target aircraft's information" and "this aircraft must execute it", the second task corresponds to "clarify the target aircraft's information" and "can be executed optionally", and the third task corresponds to "unclear target aircraft's information" and "can be executed optionally".

[0069] S101. Determine multiple test variables.

[0070] Experimental variables were used to influence the pilot's situational awareness state.

[0071] The multiple test variables include target aircraft information completeness and flight mission process execution. Target aircraft information completeness is used to characterize the known quantity of target aircraft information. Flight mission process execution is used to characterize whether it is a necessary process for the completion of the flight mission.

[0072] The target aircraft information includes at least one of the altitude, speed, and azimuth of the target aircraft; the target aircraft is a cooperation object / attack object in the flight training mission.

[0073] S102. Construct a test model of situational awareness state based on multiple flight training tasks and multiple test variables.

[0074] The situational awareness state test model is used to simulate the execution of various flight missions and determine the pilot's situational awareness state in each flight mission.

[0075] After determining a variety of flight training tasks and multiple experimental variables, the network model is simulated and trained to build a test model of the situational awareness state.

[0076] S103, running the test model, and executing a variety of pending flight missions in response to the pilot's operation, and each pending flight mission is executed in three stages.

[0077] After the test model is constructed, it is run to preliminarily determine the pilot's situational awareness state for each flight mission to be performed, that is, the test model is used in a ground environment to induce different situational awareness states of the pilot in the process of performing the flight mission to be performed.

[0078] When executing each flight mission to be executed, the pilot is required to give a corresponding response, such as controlling the steering wheel, clicking the attack button, changing the route, etc. After receiving the pilot's operation, the corresponding task is executed in response to the pilot's operation.

[0079] S104. In the process of executing each flight mission to be executed, obtaining measurement indicators of the pilot, the measurement indicators including objective data of the pilot in each flight mission to be executed collected by the sensor equipment, and subjective evaluation data of the pilot after situational awareness training.

[0080] Among them, objective data include flight mission assessment parameters and physiological behavior parameters.

[0081] The flight mission assessment parameters are used to characterize the accuracy of the pilot in completing the corresponding flight mission to be performed; the physiological behavior data are used to characterize the physiological characteristics of the pilot in the process of completing the corresponding flight mission to be performed.

[0082] Optionally, the flight mission assessment parameter includes at least one of operation quality, reaction rate, and decision accuracy. The physiological behavior parameter includes at least one of eye movement parameter and electrocardiogram parameter. The eye movement parameter is collected by an eye movement sensor, and the electrocardiogram parameter is collected by an electrocardiogram sensor.

[0083] Of course, it is understandable that the flight mission assessment parameters may also include other assessment parameters related to actual needs, which are not specifically limited in the embodiments of the present application. Similarly, the physiological behavior parameters may also include other parameters used to characterize the physiological characteristics of the pilot, which are not specifically limited in the embodiments of the present application.

[0084] For example, in a single-aircraft beyond visual range flight mission, the pilot needs to continuously make key decisions and perform corresponding actions. The flight mission assessment parameters can be quantitatively evaluated based on the optimal decision-making, reaction speed, and operation quality in a complex environment, including:

[0085] Whether it is possible to identify and lock high-value targets from a multi-target situation based on multi-source detection information, and the quantitative basis is the recognition accuracy and the reaction time to join the list;

[0086] Whether it is possible to make the best decision based on the enemy and friendly attack envelope prompt information and operate the weapon launch, and the quantitative basis is the decision accuracy and launch action response time;

[0087] Whether the missile can complete the optimal maneuver after launch while tracking the target and maintaining guidance, and the quantitative basis is the effective attack distance of the target aircraft;

[0088] Whether it is possible to correctly judge the enemy and friendly situation based on multi-source threat warnings and evade at the best time, the quantitative basis of which is the judgment accuracy and evasive maneuver response time;

[0089] Whether it is possible to complete the optimal escape evasive maneuver when the target aircraft approaches our aircraft, and the quantitative basis is whether the probability of hitting the target aircraft is reduced.

[0090] The subjective evaluation data of pilots after situational awareness training can be represented by the Situation Awareness Rating Technique (SART), CARS or C-SAS.

[0091] S105. Adjust the test model according to the obtained measurement indicators until the test model is stable.

[0092] After obtaining the measurement indicators, the test model can be adjusted according to the obtained measurement indicators until the test model is stable (which can also be understood as until the test model converges). In this way, the situational awareness state determined by the test model will be more accurate.

[0093] S106. Determine the pilot's situational awareness state using a stable test model.

[0094] In summary, in the method for determining the situational awareness state provided in the embodiment of the present application, a variety of flight training tasks are determined by decomposing the preset air flight mission into targets and actions; in addition, after determining multiple test variables (the target aircraft information completeness and the flight mission process execution degree, the target aircraft is the cooperation object / attack object in the flight mission to be executed), a test model of the situational awareness state is constructed according to the multiple flight missions and test variables, and the test model is run to simulate the mission scenario for the pilot, inducing different situational awareness states of the pilot. Under different situational awareness states, measurement indicators including objective data and subjective evaluation data are obtained, and the test model is adjusted according to the measurement indicators until the test model is stable, so that the pilot's situational awareness state can be determined using a stable test model.

[0095] It can be seen that the test model in the embodiment of the present application is determined based on the flight training task, test variables, objective data and subjective evaluation data. The flight training task is obtained by analyzing the preset air flight task, the test variables will affect the pilot's situational awareness state, and the objective data and subjective evaluation data can more comprehensively characterize the pilot's response. Therefore, the test model in the embodiment of the present application can more accurately reflect the pilot's situational awareness state in performing the flight mission.

[0096] like Figure 2 As shown, another embodiment of the present application provides a device for determining the situational awareness state in a flight mission, and the determination device includes: a determination module 201, a model construction module 301, a model operation module 302, an indicator collection module 303, and a model adjustment module 304.

[0097] The determination module 201 is used to decompose the preset air flight mission into targets and actions based on a time sequence to determine a plurality of flight training missions; the plurality of flight training missions include a first flight mission, a second flight mission and a third flight mission; the situational awareness state of the pilot in the first flight mission is higher than that in the second flight mission; the situational awareness state of the pilot in the second flight mission is higher than that in the third flight mission; each of the plurality of flight training missions includes three stages: detection, attack and avoidance.

[0098] Determination module 201 is also used to determine multiple test variables; the test variables are used to influence the pilot's situational awareness state; the multiple test variables include target aircraft information completeness and flight mission process execution degree; the target aircraft information completeness is used to characterize the known quantity of target aircraft information, and the flight mission process execution degree is used to characterize whether it is a necessary process for completing the flight mission; the target aircraft information includes at least one of the target aircraft's altitude, speed, and azimuth; the target aircraft is a cooperation object / attack object in the flight training mission.

[0099] The model building module 301 is used to build a test model of situational awareness status based on multiple flight training tasks and multiple test variables; the test model is used to simulate the execution of multiple flight tasks to be performed, and to determine the pilot's situational awareness status in each flight task to be performed; the flight task to be performed is one of the multiple training tasks, or a combination of at least two of the multiple training tasks.

[0100] The model operation module 302 is used to operate the test model and execute a variety of flight missions to be executed in response to the pilot's operation, and each flight mission to be executed is executed in three stages.

[0101] The indicator collection module 303 is used to obtain the pilot's measurement indicators during the execution of each flight mission to be performed. The measurement indicators include objective data of the pilot in each flight mission to be performed collected by the sensor equipment, and subjective evaluation data of the pilot after situational awareness training.

[0102] The model adjustment module 304 is used to adjust the test model according to the acquired measurement indicators until the test model is stable.

[0103] The model running module 302 is further configured to determine the pilot's situational awareness state using the stable test model.

[0104] Optionally, the target aircraft information completeness corresponding to the first flight mission is the first level, and the flight mission process execution degree corresponding to the first flight mission is the first execution degree; the target aircraft information completeness corresponding to the second flight mission is the first level, and the flight mission process execution degree corresponding to the second flight mission is the second execution degree; the second execution degree is lower than the first execution degree; the target aircraft information completeness corresponding to the third flight mission is the second level, and the flight mission process execution degree corresponding to the third flight mission is the second execution degree, and the second level is lower than the first level.

[0105] Optionally, the objective data includes flight mission assessment parameters and physiological behavior parameters. The flight mission assessment parameters are used to characterize the accuracy of the pilot in completing the corresponding flight mission to be performed; the physiological behavior data are used to characterize the pilot's physiological characteristics in the process of completing the corresponding flight mission to be performed.

[0106] Optionally, the flight mission assessment parameters include at least one of operation quality, reaction rate, and decision accuracy; the physiological behavior parameters include at least one of eye movement parameters and electrocardiogram parameters; the eye movement parameters are collected using an eye movement sensor, and the electrocardiogram parameters are collected using an electrocardiogram sensor.

[0107] like Figure 3As shown, another embodiment of the present application provides an electronic device, which includes a processor and a memory. The memory stores computer instructions, and the processor is used to execute the computer instructions stored in the memory. When the computer instructions are executed by the processor, the electronic device implements the method for determining the situational awareness state as described in the above embodiment.

[0108] Another embodiment of the present application provides a computer-readable storage medium having computer-executable instructions stored thereon. When the computer-executable instructions are executed, the method for determining the situational awareness state as described in the above embodiment is implemented.

[0109] Another embodiment of the present application provides a computer program product, which includes program instructions. When the program instructions are run on a computer, the method for determining the situational awareness state described in the embodiment is executed.

[0110] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using a software program, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instruction is loaded and executed on a computer, the process or function in accordance with the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network or other programmable device. The computer instruction may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instruction may be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (eg, a floppy disk, a magnetic disk, a magnetic tape), an optical medium (eg, a digital video disc (DVD)), or a semiconductor medium (eg, a solid state drive (SSD)), etc.

[0111] Through the description of the above implementation methods, technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0112] In the several embodiments provided in the embodiments of the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0113] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0114] In addition, each functional unit in each embodiment of the present application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of software functional units.

[0115] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the method described in each embodiment of the embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as flash memory, mobile hard disk, read-only memory, random access memory, disk or optical disk.

[0116] The above is only a specific implementation of the embodiment of the present application, but the protection scope of the embodiment of the present application is not limited thereto, and any changes or replacements within the technical scope disclosed in the embodiment of the present application should be included in the protection scope of the embodiment of the present application. Therefore, the protection scope of the embodiment of the present application should be based on the protection scope of the claims.

Claims

1. A method for determining the state of situational awareness in a flight mission, characterized in that: The determination method comprises: Based on the time sequence, the preset air flight missions are decomposed into targets and actions to determine a plurality of flight training missions; the plurality of flight training missions include a first flight mission, a second flight mission and a third flight mission; the situational awareness state of the pilot in the first flight mission is higher than the situational awareness state of the pilot in the second flight mission; the situational awareness state of the pilot in the second flight mission is higher than the situational awareness state of the pilot in the third flight mission; each of the plurality of flight training missions includes three stages: detection, attack and avoidance; Determine the multiple test variables; the test variables are used to affect the pilot's situational awareness state; the multiple test variables include target aircraft information completeness and flight mission process execution degree; the target aircraft information completeness is used to characterize the known quantity of the target aircraft information, and the flight mission process execution degree is used to characterize whether it is a necessary process for completing the flight mission; the target aircraft information includes at least one of the target aircraft's altitude, speed, and azimuth; the target aircraft is a cooperation object / attack object in the flight training mission; A test model of situational awareness state is constructed according to the multiple flight training tasks and the multiple test variables; the test model is used to simulate the execution of multiple flight tasks to be executed, and to determine the situational awareness state of the pilot in each flight task to be executed; the flight task to be executed is one of the multiple training tasks, or a combination of at least two of the multiple training tasks; Running the test model, and executing the plurality of flight missions to be executed in response to the pilot's operation, wherein each flight mission to be executed is executed according to the three stages; In the process of performing each flight mission to be performed, obtaining measurement indicators of the pilot, the measurement indicators including objective data of the pilot in each flight mission to be performed collected by the sensor equipment, and subjective evaluation data of the pilot after situational awareness training; According to the obtained measurement indicators, the test model is adjusted until the test model is stable; Determine the pilot's state of situational awareness using a stable test model.

2. The determination method according to claim 1, characterized in that: The target aircraft information completeness corresponding to the first flight mission is at a first level, and the flight mission process execution degree corresponding to the first flight mission is at a first execution degree; The target aircraft information completeness corresponding to the second flight mission is the first level, and the flight mission process execution degree corresponding to the second flight mission is the second execution degree; the second execution degree is lower than the first execution degree; The target aircraft information completeness corresponding to the third flight mission is at the second level, and the flight mission process execution degree corresponding to the third flight mission is at the second execution degree, and the second level is lower than the first level.

3. The determination method according to claim 1 or 2, characterized in that: The objective data includes flight mission assessment parameters and physiological behavior parameters. The flight mission assessment parameters are used to characterize the accuracy of the pilot in completing the corresponding flight mission to be performed; the physiological behavior data are used to characterize the physiological characteristics of the pilot in the process of completing the corresponding flight mission to be performed.

4. The determination method according to claim 3, characterized in that: The flight mission assessment parameters include at least one of operation quality, reaction rate, and decision accuracy; The physiological behavior parameter includes at least one of an eye movement parameter and an electrocardiogram parameter; the eye movement parameter is collected by an eye movement sensor, and the electrocardiogram parameter is collected by an electrocardiogram sensor.

5. A device for determining the state of situational awareness during a flight mission, characterized in that: The determining device comprises: A determination module is used to decompose the preset air flight missions into targets and actions based on a time sequence to determine a plurality of flight training missions; the plurality of flight training missions include a first flight mission, a second flight mission and a third flight mission; the situational awareness state of the pilot in the first flight mission is higher than the situational awareness state of the pilot in the second flight mission; the situational awareness state of the pilot in the second flight mission is higher than the situational awareness state of the pilot in the third flight mission; each of the plurality of flight training missions includes three stages: detection, attack and avoidance; The determination module is further used to determine the multiple test variables; the test variables are used to affect the pilot's situational awareness state; the multiple test variables include target aircraft information completeness and flight mission process execution degree; the target aircraft information completeness is used to characterize the known quantity of the target aircraft information, and the flight mission process execution degree is used to characterize whether it is a necessary process for completing the flight mission; the target aircraft information includes at least one of the target aircraft's altitude, speed, and azimuth; the target aircraft is a cooperative object / attack object in the flight training mission; a model building module, configured to build a test model of situational awareness status according to the multiple flight training tasks and the multiple test variables; the test model is configured to simulate the execution of multiple flight tasks to be executed, and determine the situational awareness status of the pilot in each flight task to be executed; the flight task to be executed is one of the multiple training tasks, or a combination of at least two of the multiple training tasks; A model running module, used for running the test model, and executing the plurality of flight missions to be executed in response to the pilot's operation, wherein each flight mission to be executed is executed according to the three stages; An indicator collection module, used for obtaining the pilot's measurement indicators in the process of performing each flight mission to be performed, wherein the measurement indicators include objective data of the pilot in each flight mission to be performed collected by the sensor equipment, and subjective evaluation data of the pilot after situational awareness training; A model adjustment module, used to adjust the test model according to the acquired measurement indicators until the test model is stable; The model running module is also used to determine the pilot's situational awareness state using a stable test model.

6. The determination device according to claim 5, characterized in that: The target aircraft information completeness corresponding to the first flight mission is at a first level, and the flight mission process execution degree corresponding to the first flight mission is at a first execution degree; The target aircraft information completeness corresponding to the second flight mission is the first level, and the flight mission process execution degree corresponding to the second flight mission is the second execution degree; the second execution degree is lower than the first execution degree; The target aircraft information completeness corresponding to the third flight mission is at the second level, and the flight mission process execution degree corresponding to the third flight mission is at the second execution degree, and the second level is lower than the first level.

7. The determination device according to claim 5 or 6, characterized in that: The objective data includes flight mission assessment parameters and physiological behavior parameters. The flight mission assessment parameters are used to characterize the accuracy of the pilot in completing the corresponding flight mission to be performed; the physiological behavior data are used to characterize the physiological characteristics of the pilot in the process of completing the corresponding flight mission to be performed.

8. The determination device according to claim 7, characterized in that: The flight mission assessment parameters include at least one of operation quality, reaction rate, and decision accuracy; The physiological behavior parameter includes at least one of an eye movement parameter and an electrocardiogram parameter; the eye movement parameter is collected by an eye movement sensor, and the electrocardiogram parameter is collected by an electrocardiogram sensor.

9. An electronic device, characterized in that: The electronic device comprises a processor and a memory, wherein the memory stores computer instructions, and the processor is used to execute the computer instructions stored in the memory. When the computer instructions are executed by the processor, the electronic device implements the determination method as claimed in any one of claims 1 to 4.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed, the determination method according to any one of claims 1 to 4 is implemented.

Images