Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A method for extracting visual attention allocation patterns of UAV pilots associated with mission scenarios

A technology of visual attention and distribution mode, which is applied in character and pattern recognition, space navigation condition simulation device, simulator, etc. It can solve the problems that are not applicable to drone reconnaissance missions, etc., and achieve strong guiding significance and high accuracy Effect

Active Publication Date: 2022-05-03
NORTHWESTERN POLYTECHNICAL UNIV
View PDF19 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the eye movement mode in this invention is only aimed at different frequency grating stimulation tasks, and is not suitable for relatively complex task situations such as UAV reconnaissance tasks.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method for extracting visual attention allocation patterns of UAV pilots associated with mission scenarios
  • A method for extracting visual attention allocation patterns of UAV pilots associated with mission scenarios
  • A method for extracting visual attention allocation patterns of UAV pilots associated with mission scenarios

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038]Embodiments of the present invention are described in detail below, and the embodiments are exemplary and intended to explain the present invention, but should not be construed as limiting the present invention.

[0039] The method for extracting the UAV pilot's visual attention distribution pattern associated with the task scenario in the present embodiment comprises the following steps:

[0040] Step 1: Set up the flight mission and clarify the operations that the UAV pilot needs to perform at each stage of the mission; the UAV pilot performs the flight mission on the simulation platform according to the flight mission requirements, and uses the eye movement acquisition device to obtain the pilot's trial flight mission process. The eye movement data in , preprocess the eye movement data, and extract the gaze point data.

[0041] In this step, the experimental environment of the simulation platform should be quiet and well-lit; the drone pilot (subject) who performs the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The present invention discloses a method for extracting the visual attention distribution mode of UAV pilots associated with mission scenarios. The method obtains pilot attention distribution data through an eye tracker, divides different mission scenarios through flight parameter data, and extracts the division of pilot physiological signals. Its fatigue level distinguishes the distribution of pilots' attention under different task scenarios and different fatigue levels. The eye tracker collects the eye movement data of pilots when performing tasks under the simulation platform; segment and cluster the high-dimensional time series of flight parameters to divide different mission scenarios; collect pilot ECG data for time-frequency domain analysis, combine eye movement data and Establish a fatigue state discrimination classifier during auditory response; characterize the attention distribution characteristics through the fixation point percentage, return times, and importance of the area of ​​interest, and extract the attention distribution situation with the highest support as a model, which can play a role in the control of UAV pilots. The guiding role is also of great significance to optimize the interface settings of the UAV control platform.

Description

technical field [0001] The invention relates to the field of unmanned aerial vehicle flight control training, and specifically relates to a method for extracting the visual attention distribution mode of the drone pilot associated with the task scene, which can extract the visual attention distribution mode of the drone pilot associated with the task scene , and then used to guide the pilot's eye movement behavior. Background technique [0002] In the modern drone control system, the degree of automation is very high, and the main function of the drone pilot has changed from control to surveillance. When performing different flight tasks, UAV pilots need to monitor a variety of information at the same time, so there is an optimal visual attention distribution mode that enables pilots to complete information collection in the most accurate and timely manner. It has strong guiding significance for UAV pilots. In addition, this mode can also be applied to the ergonomics evalu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G09B9/08G06K9/62
CPCG09B9/08G06F18/23G06F18/2411
Inventor 于薇薇陆正煜蔡闻峰任志军
Owner NORTHWESTERN POLYTECHNICAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products