Situational awareness state determination method and device and electronic equipment

Abstract

The embodiment of the invention provides a scenario awareness state determination method and device and electronic equipment, and relates to the field of data processing, and the determination method comprises the steps: constructing a test model of a scenario awareness state; the test model is run, multiple tasks are executed in response to operation of a pilot, and each task is executed according to three stages; in the process of executing each task, measuring indexes of the pilot are obtained, and the measuring indexes comprise objective data, collected based on sensing equipment, of the pilot in each task and subjective evaluation data of the pilot after scene awareness state training; adjusting the test model according to the obtained measurement index until the test model is stable; determining a scene awareness state of the pilot by using the stable test model; different scene awareness states of the pilot can be induced by using the test model in a ground environment, and technical support is provided for subsequent scene awareness state evaluation of the pilot in real flight.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of pilot training, and more particularly to a method, device and electronic device for determining a situational awareness state. Background Art

[0002] The pilot's situational awareness (SA) refers to the perception of various elements in the flight environment, the understanding of the meaning of these elements, and the prediction of their subsequent states in a specific space and time. It is an important factor affecting the pilot's decision-making and operation. The real-time evaluation of the pilot's situational awareness state in a specific time unit is a key condition to reflect his or her cognitive status of various factors and conditions that affect the operation in a specific time period and specific situation. It is of great significance to reduce flight accidents caused by situational awareness errors. Simply put, the better the pilot's situational awareness state, the more accurately and quickly he or she can perform tasks.

[0003] Therefore, being able to accurately determine a pilot's state of situational awareness is critical. Summary of the invention

[0004] The embodiments of the present application provide a method, device and electronic device for determining the situational awareness state, which can induce different situational awareness states of pilots using a test model in a ground environment, and provide technical support for the subsequent evaluation of the pilot's situational awareness state in actual flight.

[0005] In order to achieve the above purpose, the embodiment of the present application adopts the following technical solution: In a first aspect, an embodiment of the present application provides a method for determining a situational awareness state, comprising: constructing a test model for a situational awareness state; the test model for the situational awareness state is used to simulate the execution of multiple tasks (each of the multiple tasks includes multiple test variables, and the multiple test variables include information support and distraction. Information support is used to characterize the amount of information provided to the pilot, and distraction is used to characterize the amount of interfering information to the pilot), and the test variables are used to affect the pilot's situational awareness state; each task includes three stages: detection, attack, and avoidance), and determining the pilot's situational awareness state in each task; running the test model, responding to the pilot's operation, executing multiple tasks, and each task is executed in three stages; in the process of executing each task, obtaining the pilot's measurement indicators (the measurement indicators include the pilot's objective data in each task collected based on the sensor equipment, and the pilot's subjective evaluation data after situational awareness state training); adjusting the test model according to the obtained measurement indicators until the test model is stable; and determining the pilot's situational awareness state using the stable test model.

[0006] In a possible implementation, the above-mentioned construction of a test model for situational awareness status includes: determining multiple tasks; determining multiple test variables; constructing a test model based on the multiple tasks and the multiple test variables; the multiple tasks include a first task, a second task and a third task; the situational awareness state of the pilot in the first task is higher than the situational awareness state of the pilot in the second task; the situational awareness state of the pilot in the second task is higher than the situational awareness state of the pilot in the third task.

[0007] In another possible implementation, the information support corresponding to the first task is full information support, and the distraction degree corresponding to the first task is a non-distracting task; the information support corresponding to the second task is partial information support, and the distraction degree corresponding to the second task is a non-distracting task; the information support corresponding to the third task is partial information support, and the distraction degree corresponding to the third task is a distracting task.

[0008] In another possible implementation, the objective data includes task assessment parameters and physiological behavior parameters. The task assessment parameters are used to characterize the accuracy of the pilot in completing the corresponding task; the physiological behavior data are used to characterize the physiological characteristics of the pilot in the process of completing the corresponding task.

[0009] In another possible implementation, the task assessment parameters include operation performance parameters, secondary task performance parameters, and scoring parameters; the physiological behavior parameters include eye movement parameters and electrocardiogram parameters; the eye movement parameters are collected by eye movement sensors, and the electrocardiogram parameters are collected by electrocardiogram sensors. The operation performance parameters are used to characterize the accuracy of the pilot's control of the aircraft; the secondary task performance parameters are used to characterize the accuracy of other sounds appearing in the continuous white noise; and the scoring parameters are used to characterize the degree of completion of the corresponding task by the pilot.

[0010] In summary, in the method for determining the situational awareness state provided in the embodiment of the present application, a test model of the situational awareness state is constructed based on a variety of tasks and test variables, and the test model is run to simulate the mission scenario for the pilot, inducing different situational awareness states of the pilot. Under different situational awareness states, measurement indicators including objective data and subjective evaluation data are obtained, and the test model is adjusted according to the measurement indicators until the test model is stable. In this way, the situational awareness state of the pilot can be determined using the stable test model. The test model in the embodiment of the present application is determined based on the comprehensive determination of tasks, test variables, objective data and subjective evaluation data. Therefore, the determined situational awareness state is relatively accurate and has a wider range of applicable scenarios.

[0011] In a second aspect, an embodiment of the present application provides a device for determining a situational awareness state, the device comprising: The model building module is used to build a test model of the situational awareness state; the test model of the situational awareness state is used to simulate the execution of multiple tasks and determine the pilot's situational awareness state in each task; each of the multiple tasks includes multiple test variables, and the test variables are used to affect the pilot's situational awareness state; each task includes three stages: detection, attack, and avoidance; the multiple test variables include information support and distraction. Information support is used to characterize the amount of information provided to the pilot, and distraction is used to characterize the amount of information that interferes with the pilot; A model running module is used to run the test model, and execute various tasks in response to the pilot's operation, and each task is executed in three stages; An indicator collection module is used to obtain the pilot's measurement indicators during the execution of each task. The measurement indicators include objective data of the pilot in each task collected by the sensor equipment, and subjective evaluation data of the pilot after situational awareness training; The model adjustment module is used to adjust the test model according to the obtained measurement indicators until the test model is stable; The model operation module is also used to determine the pilot's situational awareness state using a stable test model.

[0012] In a possible implementation, the above model building module is specifically used to: Determine multiple tasks; the multiple tasks include a first task, a second task and a third task; the situational awareness state of the pilot in the first task is higher than the situational awareness state of the pilot in the second task; the situational awareness state of the pilot in the second task is higher than the situational awareness state of the pilot in the third task; Identify multiple experimental variables; Build and test models based on multiple tasks and multiple experimental variables.

[0013] In another possible implementation, the information support corresponding to the first task is the full information support, and the distraction degree corresponding to the first task is a non-distracting task; The information support corresponding to the second task is partial information support, and the distraction corresponding to the second task is a non-distracting task; The information support corresponding to the third task is partial information support, and the distraction degree corresponding to the third task is distracting task.

[0014] In another possible implementation, Objective data include task assessment parameters and physiological behavioral parameters. Task assessment parameters are used to characterize the accuracy of pilots in completing corresponding tasks; physiological behavioral data are used to characterize the physiological characteristics of pilots in the process of completing corresponding tasks.

[0015] In another possible implementation, the task assessment parameters include operation performance parameters, sub-task performance parameters, and scoring parameters; Physiological behavior parameters include eye movement parameters and electrocardiogram parameters; eye movement parameters are collected using eye movement sensors, and electrocardiogram parameters are collected using electrocardiogram sensors.

[0016] In a third aspect, an embodiment of the present application provides an electronic device, comprising a processor and a memory, wherein the memory stores computer instructions, and the processor is used to execute the computer instructions stored in the memory. When the computer instructions are executed by the processor, the electronic device implements the method for determining the situational awareness state as described in the first aspect above and any one of its possible implementation methods.

[0017] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having computer execution instructions stored thereon. When the computer execution instructions are executed, the method for determining the situational awareness state described in the first aspect and any one of its possible implementation methods is executed.

[0018] In a fifth aspect, an embodiment of the present application provides a computer program product, which includes program instructions. When the program instructions are run on a computer, they are used to execute the method for determining the situational awareness state described in the first aspect and any one of its possible implementation methods.

[0019] It should be understood that the beneficial effects achieved by the technical solutions of the second to fifth aspects of the embodiments of the present application and the corresponding possible implementation methods can be referred to the technical effects of the first aspect and its corresponding possible implementation methods mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 A flowchart of a method for determining a situational awareness state provided in an embodiment of the present application; Figure 2 It is a statistical diagram of the tasks at different situational awareness states at flight altitudes in the embodiment of the present application; Figure 3 A schematic diagram of the structure of a device for determining a situational awareness state provided in an embodiment of the present application; Figure 4 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0021] The term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0022] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0023] In the description of the embodiments of the present application, unless otherwise specified, the meaning of "multiple" refers to two or more than two. For example, multiple processing units refer to two or more processing units; multiple systems refer to two or more systems.

[0024] Situational awareness is a person's ability to accurately perceive environmental changes and predict future developments through understanding and judgment during information processing. Specifically, for pilots, the pilot's situational awareness refers to the perception of various elements in the flight environment, the understanding of the meaning of these elements, and the prediction of their subsequent states in a specific space and time. It is an important factor affecting pilots' decision-making and operations.

[0025] The real-time assessment of the pilot's situational awareness within a specific time unit is a key condition to reflect his or her cognitive status of various factors and conditions that affect the operation in a specific time period and specific situation, and is of great significance to reducing flight accidents caused by situational awareness errors. Simply put, the better the pilot's situational awareness, the more accurately and quickly he or she can perform tasks.

[0026] In order to provide better technical support during actual flight and avoid abnormal situations, it is crucial to accurately determine the situational awareness state of each pilot in the ground environment.

[0027] To this end, the embodiment of the present application provides a method for determining the situational awareness state, constructs a test model of the situational awareness state based on multiple tasks and test variables, and runs the test model to simulate the task scenario for the pilot (i.e., the pilot), inducing different situational awareness states of the pilot. Under different situational awareness states, measurement indicators including objective data and subjective evaluation data are obtained, and the test model is adjusted according to the measurement indicators until the test model is stable, so that the situational awareness state of the pilot can be determined using the stable test model. The test model in the embodiment of the present application is determined based on the comprehensive determination of tasks, test variables, objective data, and subjective evaluation data, so the determined situational awareness state is relatively accurate and has a wider range of applicable scenarios.

[0028] The method for determining the situational awareness state provided in the embodiment of the present application is applicable to electronic devices in low-altitude scenes. The electronic device may be a computer or a computer cluster, which is not specifically limited in the embodiment of the present application.

[0029] In a first possible scenario, the electronic device is a computer, and the computer may include a memory and a processor, and the memory and the processor are connected via at least one communication interface.

[0030] The computer includes a memory that can store the test model. The memory can be a cache, a solid state drive (SSD), a hard disk drive (HDD), a storage class memory (SCM), a memory, or other storage media.

[0031] Exemplarily, storage particles storing a specific number of bits include: single level cell (SLC), double level cell (MLC), triple level cell (TLC) or quad level cell (QLC).

[0032] The test model may be a neural network model or other artificial intelligence (AI) model, and the embodiments of the present application do not specifically limit this.

[0033] The processor included in the computer implements the training of the measurement model stored in the memory according to the received measurement index. The processor may include one or more processor cores. The processor may be a very large-scale integrated circuit. An operating system and other software programs are installed in the processor, so that the processor can access the memory and various peripheral component interconnect (Peripheral Component Interconnect Express, PCIe) devices. It can be understood that in this embodiment, the processor core in the processor may be a central processing unit (Central Processing Unit, CPU) or other specific integrated circuits (Application Specific Integrated Circuit, ASIC). The processor may also be other general-purpose processors, digital signal processors (Digital Signal Processing, DSP), application-specific integrated circuits (Application-specific Integrated Circuit, ASIC), field programmable gate arrays (Field Programmable Gate Array, FPGA), graphics processors (Graphics Processing Unit, GPU), AI chips, systems on chip (System-on-a-chip, SoC) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. In practical applications, the processing device 110 may also include multiple processors.

[0034] In a second possible scenario, the electronic device is a computer cluster. The computer cluster refers to a collection of computers connected via a local area network or the Internet. Exemplarily, the computer cluster may have a rack, and the rack may establish communication for multiple computers included in the computer cluster via a wired connection, such as a Universal Serial Bus (USB) or a PCIe high-speed bus.

[0035] Computer clusters are usually used to perform large tasks (also called jobs). Here, jobs are usually large jobs that require more resources to process in parallel. The embodiments of the present application do not limit the nature and number of jobs. A job may include multiple computing tasks generated during the model training process, and these computing tasks can be assigned to multiple computing resources for execution. Most tasks are executed concurrently or in parallel, while some tasks need to rely on data generated by other tasks. Each computer in a computer cluster uses the same hardware and the same operating system; different hardware and different operating systems can also be used in the computers in the computer cluster according to business needs.

[0036] One or more virtual machines can run in a computer cluster. A virtual machine is a virtual device obtained by virtualizing physical computing resources, storage resources, and network resources through virtualization technology. In one possible example, one or more virtual machines (VMs) run on a computer, such as two VMs running on a computer. In another possible example, a VM runs on multiple computers, such as a VM using the processing resources of computer A and the storage resources of computer B.

[0037] It is worth noting that the above electronic device can refer to a single computing device with model training capabilities, such as a desktop, laptop, mobile phone or tablet computer.

[0038] In combination with the above description, the method for determining the situational awareness state provided in the embodiment of the present application is described below.

[0039] like Figure 1 As shown, an embodiment of the present application provides a method for determining a situational awareness state, the method comprising: S100. Construct a test model of situational awareness state.

[0040] The situational awareness test model is used to simulate the execution of multiple tasks and determine the pilot's situational awareness state in each task.

[0041] Each of the multiple missions includes multiple experimental variables. The experimental variables are used to influence the pilot's situational awareness. Each mission includes three stages: detection, attack, and avoidance.

[0042] Specifically, the electronic device determines multiple tasks and multiple test variables, and constructs a test model based on the multiple tasks and multiple test variables.

[0043] The multiple tasks include a first task, a second task and a third task; the situational awareness state of the pilot in the first task is higher than the situational awareness state of the pilot in the second task; the situational awareness state of the pilot in the second task is higher than the situational awareness state of the pilot in the third task.

[0044] It can be simply understood that the difficulty (or complexity) of the first task is lower than that of the second task, and the difficulty (or complexity) of the second task is lower than that of the third task. These three tasks can also be called high situation awareness state tasks, medium situation awareness state tasks, and low situation awareness state tasks, respectively.

[0045] The multiple experimental variables include information support and distraction. Information support is used to characterize the amount of information provided to the pilot. Distraction is used to characterize the amount of information that interferes with the pilot.

[0046] It is easy to understand that by controlling the information support and distraction respectively, the pilot's interference in different tasks can be achieved, which makes it easier to stimulate and accurately determine the pilot's state of situational awareness. Controlling "information support" is mainly about the amount of task-related information provided to the pilot, which directly changes the amount of information available to the pilot, thereby changing the pilot's state of situational awareness. Controlling "distraction" is mainly about whether to provide secondary tasks for the operating personnel, which directly changes the attention resource capacity available for the main task, thereby changing the pilot's state of situational awareness.

[0047] The information support can be adjusted / controlled by whether the downward-looking display is blocked. For example, if the downward-looking display is not blocked, the pilot can obtain mission information through the head-up display and the downward-looking display, which can be understood as full information support. If the downward-looking display is blocked, the pilot can only obtain mission information through the head-up display, which can be understood as partial information support.

[0048] The distraction level can be adjusted / controlled by adding a secondary task to the pilot (i.e., adding other additional tasks in addition to the current main task). For example, if a secondary task is added to the pilot, the pilot needs to complete both the main task and the secondary task at the same time, which can be understood as a distraction task; if no other tasks are added to the pilot, the pilot only needs to complete the main task, which can be understood as a non-distraction task.

[0049] S101. Run the test model to execute various tasks in response to the pilot's operation, and each task is executed in three stages.

[0050] After the test model is constructed, it is run to preliminarily determine the pilot's situational awareness state under each task, that is, to determine the pilot's situational awareness state in the ground scene.

[0051] When executing each task, the pilot is required to give a corresponding response, such as controlling the steering wheel, clicking the attack button, changing the route, etc. After receiving the pilot's operation, the corresponding task is executed in response to the pilot's operation.

[0052] Specifically, for the first, second, and third missions, the three phases of detection, attack, and avoidance are performed. Correspondingly, the pilot may need to complete the following operations: 1. Perform takeoff operations according to the altitude and speed required by the mission; 2. Continuously observe the situation during the mission until the target is found; 3. Turn at the required altitude and speed and fly along the scheduled route; 4. Perform a second turn as required, and then fly along the planned route until the target is found; 5. Take appropriate action on the target (such as interception).

[0053] S102. In the process of executing each task, obtain the pilot's measurement indicators. The measurement indicators include objective data of the pilot in each task collected by the sensor equipment, and subjective evaluation data of the pilot after situational awareness training.

[0054] Among them, objective data include task assessment parameters and physiological behavior parameters.

[0055] The task assessment parameters are used to characterize the accuracy of the pilot in completing the corresponding task, and the physiological behavior data are used to characterize the physiological characteristics of the pilot in the process of completing the corresponding task.

[0056] Optionally, the task assessment parameters may include operation performance parameters, sub-task performance parameters, and scoring parameters. Physiological behavior parameters may include eye movement parameters and electrocardiogram parameters. Eye movement parameters are collected using an eye movement sensor and may include eye movement parameters including fixation rate, eye saccade rate, average fixation time, blink time, blink frequency, etc. Electrocardiogram parameters are collected using an electrocardiogram sensor.

[0057] The operational performance parameter is used to characterize the accuracy of the pilot's control of the aircraft; the secondary task performance parameter is used to characterize the accuracy of the pilot's control of the aircraft in the presence of the secondary task; and the scoring parameter is used to characterize the degree of completion of the corresponding task by the pilot.

[0058] Optionally, the operational performance parameters may include flight altitude error, flight speed error, and flight heading error; the sub-task performance parameters are used to characterize the accuracy of distinguishing other sounds that may appear in the continuous white noise feedback; and the scoring parameters are the comprehensive scores of the pilot after completing the task.

[0059] The subjective evaluation data of pilots after situational awareness training can be represented by the Situation Awareness Rating Technique (SART) scale, CARS scale or C-SAS scale.

[0060] S103: Adjust the test model according to the obtained measurement indicators until the test model is stable.

[0061] After obtaining the measurement indicators, the test model can be adjusted according to the obtained measurement indicators until the test model is stable (which can also be understood as until the test model converges). In this way, the situational awareness state determined by the test model will be more accurate.

[0062] S104. Determine the pilot's situational awareness state using a stable test model.

[0063] In summary, in the method for determining the situational awareness state provided in the embodiment of the present application, a test model of the situational awareness state is constructed based on a variety of tasks and test variables, and the test model is run to simulate the mission scenario for the pilot, inducing different situational awareness states of the pilot. Under different situational awareness states, measurement indicators including objective data and subjective evaluation data are obtained, and the test model is adjusted according to the measurement indicators until the test model is stable. In this way, the situational awareness state of the pilot can be determined using the stable test model. The test model in the embodiment of the present application is determined based on the comprehensive determination of tasks, test variables, objective data and subjective evaluation data. Therefore, the determined situational awareness state is relatively accurate and has a wider range of applicable scenarios.

[0064] In addition, this determination method can also use the test model to induce different situational awareness states of pilots in a ground environment, providing technical support for the subsequent evaluation of the pilot's situational awareness state in actual flight.

[0065] In order to understand the impact of measurement indicators on the test model, the following mainly uses the flight altitude error in the operation performance parameter as an example to illustrate.

[0066] Assume that the standard trajectory of altitude change is a straight line from 0 to 6000m during takeoff and a horizontal line in the second half. The altitude error is calculated as the root mean square error between the actual flight altitude change and the standard trajectory.

[0067] Figure 2 The descriptive statistical results of flight altitude errors under different situational awareness states are shown. Figure 2 The A (box plot) in the figure can represent the maximum, median and minimum values ​​of the flight altitude error under different situational awareness state tasks; Figure 2 The B (mean graph) in shows the mean of the flight altitude error under different situational awareness tasks. Figure 2 As shown in the figure, it can be seen that for high situational awareness state tasks, medium situational awareness state tasks, and low situational awareness state tasks, the flight altitude error gradually increases. In other words, the altitude error of the low situational awareness state task is much higher than the altitude error of the high situational awareness state task.

[0068] Combined with specific examples, the experiment concluded that the results of the one-way repeated measures analysis of variance are shown in Table 1. The main effect of the situational awareness state task was significant (p<0.001).

[0069] Table 1. Results of variance analysis of height error Further, the verification results of multiple comparisons are shown in Table 2, and it can be seen that: (1) There was a significant difference between the high situational awareness state task and the low situational awareness state task condition (p<0.001), and the height error was larger in the low situational awareness state task; (2) There was a significant difference between the medium and low situational awareness tasks (p = 0.04), with the height error being greater in the low situational awareness task. (3) There was no significant difference between the high situational awareness state task and the medium situational awareness state task (p>0.05).

[0070] Table 2 Multiple comparisons of height error after verification The number of * is used to distinguish whether it is significant or not.

[0071] like Figure 3 As shown, another embodiment of the present application provides a device for determining a situational awareness state, the device comprising: The model building module 301 is used to build a test model of the situational awareness state; the test model of the pilot's situational awareness state is used to simulate the execution of multiple tasks and determine the pilot's situational awareness state in each task; each of the multiple tasks of the pilot includes multiple test variables, and the pilot test variables are used to affect the pilot's situational awareness state; each pilot task includes three stages: detection, attack, and avoidance; The model operation module 302 is used to operate the pilot test model, and execute various tasks of the pilot in response to the pilot's operation, and each task is executed according to the three stages of the pilot; The indicator collection module 303 is used to obtain the pilot's measurement indicators in the process of performing each task, and the pilot measurement indicators include the objective data of the pilot in each task collected by the sensor equipment and the subjective evaluation data of the pilot after the situational awareness state training; A model adjustment module 304 is used to adjust the pilot test model according to the acquired measurement indicators until the pilot test model is stable; The model running module 302 is further configured to determine the pilot's situational awareness state using the stable test model.

[0072] Specifically, the model building module 301 is specifically used for: Determine multiple tasks; the multiple tasks include a first task, a second task and a third task; the situational awareness state of the pilot in the first task is higher than the situational awareness state of the pilot in the second task; the situational awareness state of the pilot in the second task is higher than the situational awareness state of the pilot in the third task; Identify multiple experimental variables; Build and test models based on multiple tasks and multiple experimental variables.

[0073] Optionally, the multiple test variables include information support and distraction, where the information support is used to characterize the amount of information provided to the pilot, and the distraction is used to characterize the amount of information that interferes with the pilot.

[0074] Optionally, the information support corresponding to the first task is full information support, and the distraction degree corresponding to the first task is a non-distracting task; the information support corresponding to the second task is partial information support, and the distraction degree corresponding to the second task is a non-distracting task; the information support corresponding to the third task is partial information support, and the distraction degree corresponding to the third task is a distracting task.

[0075] The above objective data include task assessment parameters and physiological behavioral parameters. The task assessment parameters are used to characterize the accuracy of the pilot in completing the corresponding task; the physiological behavioral data are used to characterize the physiological characteristics of the pilot in the process of completing the corresponding task.

[0076] The above task assessment parameters include operation performance parameters, secondary task performance parameters, and scoring parameters. Operation performance parameters are used to characterize the accuracy of the pilot's control of the aircraft; secondary task performance parameters are used to characterize the accuracy of other sounds appearing in continuous white noise; and scoring parameters are used to characterize the degree of completion of the pilot's corresponding task.

[0077] Physiological behavior parameters include eye movement parameters and electrocardiogram parameters; eye movement parameters are collected using eye movement sensors, and electrocardiogram parameters are collected using electrocardiogram sensors.

[0078] like Figure 4 As shown, another embodiment of the present application provides an electronic device, which includes a processor and a memory. The memory stores computer instructions, and the processor is used to execute the computer instructions stored in the memory. When the computer instructions are executed by the processor, the electronic device implements the method for determining the situational awareness state as described in the above embodiment.

[0079] Another embodiment of the present application provides a computer-readable storage medium having computer-executable instructions stored thereon. When the computer-executable instructions are executed, the method for determining the situational awareness state as described in the above embodiment is implemented.

[0080] Another embodiment of the present application provides a computer program product, which includes program instructions. When the program instructions are run on a computer, the method for determining the situational awareness state described in the embodiment is executed.

[0081] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using a software program, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer instruction is loaded and executed on a computer, the process or function in accordance with the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network or other programmable device. The computer instruction may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instruction may be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium may be a magnetic medium (eg, a floppy disk, a magnetic disk, a magnetic tape), an optical medium (eg, a digital video disc (DVD)), or a semiconductor medium (eg, a solid state drive (SSD)), etc.

[0082] Through the description of the above implementation methods, technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0083] In the several embodiments provided in the embodiments of the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0084] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0085] In addition, each functional unit in each embodiment of the present application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of software functional units.

[0086] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the method described in each embodiment of the embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as flash memory, mobile hard disk, read-only memory, random access memory, disk or optical disk.

[0087] The above is only a specific implementation of the embodiment of the present application, but the protection scope of the embodiment of the present application is not limited thereto, and any changes or replacements within the technical scope disclosed in the embodiment of the present application should be included in the protection scope of the embodiment of the present application. Therefore, the protection scope of the embodiment of the present application should be based on the protection scope of the claims.

Claims

1. A method for determining a situational awareness state, characterized in that: The determination method comprises: Constructing a test model of situational awareness state; the test model of situational awareness state is used to simulate the execution of multiple tasks and determine the situational awareness state of the pilot in each task; each of the multiple tasks includes multiple test variables, and the test variables are used to affect the situational awareness state of the pilot; each task includes three stages: detection, attack, and avoidance; the multiple test variables include information support and distraction, the information support is used to characterize the amount of information provided to the pilot, and the distraction is used to characterize the amount of interference information to the pilot; Running the test model to execute the plurality of tasks in response to the pilot's operation, wherein each task is executed according to the three stages; During the execution of each task, obtaining measurement indicators of the pilot, the measurement indicators including objective data of the pilot in each task collected by the sensor equipment and subjective evaluation data of the pilot after situational awareness training; According to the obtained measurement indicators, the test model is adjusted until the test model is stable; Determine the pilot's state of situational awareness using a stable test model.

2. The determination method according to claim 1, characterized in that: The test model for constructing the situational awareness state includes: Determining the multiple tasks; the multiple tasks include a first task, a second task, and a third task; the situational awareness state of the pilot in the first task is higher than the situational awareness state of the pilot in the second task; the situational awareness state of the pilot in the second task is higher than the situational awareness state of the pilot in the third task; determining the plurality of experimental variables; The test model is constructed according to the multiple tasks and the multiple experimental variables.

3. The determination method according to claim 1, characterized in that: The information support corresponding to the first task is the full information support, and the distraction degree corresponding to the first task is a non-distracting task; The information support corresponding to the second task is partial information support, and the distraction degree corresponding to the second task is a non-distracting task; The information support corresponding to the third task is partial information support, and the distraction degree corresponding to the third task is a distracting task.

4. The determination method according to any one of claims 1 to 3, characterized in that: The objective data includes task assessment parameters and physiological behavior parameters, and the task assessment parameters are used to characterize the accuracy of the pilot in completing the corresponding task; The physiological behavior data is used to characterize the physiological characteristics of the pilot in the process of completing the corresponding task.

5. The determination method according to claim 4, characterized in that: The task assessment parameters include operation performance parameters, secondary task performance parameters, and scoring parameters; the operation performance parameters are used to characterize the accuracy of the pilot's control of the aircraft; the secondary task performance parameters are used to characterize the accuracy of other sounds appearing in the continuous white noise; The scoring parameter is used to characterize the pilot's degree of completion of the corresponding task; The physiological behavior parameters include eye movement parameters and electrocardiogram parameters; the eye movement parameters are collected using an eye movement sensor, and the electrocardiogram parameters are collected using an electrocardiogram sensor.

6. A device for determining a situational awareness state, characterized in that: The determining device comprises: A model building module, used to build a test model of situational awareness state; the test model of situational awareness state is used to simulate the execution of multiple tasks and determine the situational awareness state of the pilot in each task; each of the multiple tasks includes multiple test variables, and the test variables are used to affect the situational awareness state of the pilot; each task includes three stages: detection, attack, and avoidance; the multiple test variables include information support and distraction, the information support is used to characterize the amount of information provided to the pilot, and the distraction is used to characterize the amount of interference information to the pilot; A model running module, used for running the test model, and executing the multiple tasks in response to the pilot's operation, wherein each task is executed according to the three stages; An indicator collection module, used to obtain the pilot's measurement indicators during the execution of each task, wherein the measurement indicators include objective data of the pilot in each task collected by the sensor equipment and subjective evaluation data of the pilot after situational awareness training; A model adjustment module, used to adjust the test model according to the acquired measurement indicators until the test model is stable; The model operation module is also used to determine the pilot's situational awareness state using a stable test model.

7. The determination device according to claim 6, characterized in that: The model building module is specifically used for: Determining the multiple tasks; the multiple tasks include a first task, a second task, and a third task; the situational awareness state of the pilot in the first task is higher than the situational awareness state of the pilot in the second task; the situational awareness state of the pilot in the second task is higher than the situational awareness state of the pilot in the third task; determining the plurality of experimental variables; The test model is constructed according to the multiple tasks and the multiple experimental variables.

8. The determination device according to claim 6, characterized in that: The information support corresponding to the first task is the full information support, and the distraction degree corresponding to the first task is a non-distracting task; The information support corresponding to the second task is partial information support, and the distraction degree corresponding to the second task is a non-distracting task; The information support corresponding to the third task is partial information support, and the distraction degree corresponding to the third task is a distracting task.

9. The determination device according to any one of claims 6 to 8, characterized in that: The objective data includes task assessment parameters and physiological behavior parameters, and the task assessment parameters are used to characterize the accuracy of the pilot in completing the corresponding task; The physiological behavior data is used to characterize the physiological characteristics of the pilot in the process of completing the corresponding task.

10. The determination device according to claim 9, characterized in that: The task assessment parameters include operation performance parameters, secondary task performance parameters, and scoring parameters; the operation performance parameters are used to characterize the accuracy of the pilot's control of the aircraft; the secondary task performance parameters are used to characterize the accuracy of other sounds appearing in the continuous white noise; The scoring parameter is used to characterize the pilot's degree of completion of the corresponding task; The physiological behavior parameters include eye movement parameters and electrocardiogram parameters; the eye movement parameters are collected using an eye movement sensor, and the electrocardiogram parameters are collected using an electrocardiogram sensor.

11. An electronic device, characterized in that: The electronic device includes a processor and a memory, wherein the memory stores computer instructions, and the processor is used to execute the computer instructions stored in the memory. When the computer instructions are executed by the processor, the electronic device implements the method for determining the situational awareness state as described in any one of claims 1 to 5.

12. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, and when the computer-executable instructions are executed, the method for determining the situational awareness state according to any one of claims 1 to 5 is implemented.

Images