Task scene associated unmanned aerial vehicle pilot visual attention distribution mode extraction method

A technology for visual attention and pattern allocation, which is applied in character and pattern recognition, simulation devices for space navigation conditions, simulators, etc. It can solve problems such as inapplicability to UAV reconnaissance tasks and achieve high accuracy.

Active Publication Date: 2020-11-17
NORTHWESTERN POLYTECHNICAL UNIV
View PDF19 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the eye movement mode in this invention is only aimed at different frequency grating stimulation tasks, and is not suitable for relatively complex task situations such as UAV reconnaissance tasks.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Task scene associated unmanned aerial vehicle pilot visual attention distribution mode extraction method
  • Task scene associated unmanned aerial vehicle pilot visual attention distribution mode extraction method
  • Task scene associated unmanned aerial vehicle pilot visual attention distribution mode extraction method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038]Embodiments of the present invention are described in detail below, and the embodiments are exemplary and intended to explain the present invention, but should not be construed as limiting the present invention.

[0039] The method for extracting the UAV pilot's visual attention distribution pattern associated with the task scenario in the present embodiment comprises the following steps:

[0040] Step 1: Set up the flight mission and clarify the operations that the UAV pilot needs to perform at each stage of the mission; the UAV pilot performs the flight mission on the simulation platform according to the flight mission requirements, and uses the eye movement acquisition device to obtain the pilot's trial flight mission process. The eye movement data in , preprocess the eye movement data, and extract the gaze point data.

[0041] In this step, the experimental environment of the simulation platform should be quiet and well-lit; the drone pilot (subject) who performs the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a task scenario associated unmanned aerial vehicle pilot visual attention distribution mode extraction method, which comprises the steps of obtaining pilot attention distribution data through an eye tracker, dividing different task scenarios through flight parameter data, extracting pilot physiological signals to divide fatigue levels of the pilot physiological signals, anddistinguishing pilot attention distribution situations under different task scenes and different fatigue levels. An eye tracker collects eye movement data when a pilot executes a task under the simulation platform; performs segmentation clustering on the flight parameter high-dimensional time sequence, and dividing different task scenes; collects pilot electrocardiogram data for time-frequency domain analysis, and establishes a fatigue state discrimination classifier in combination with eye movement data and auditory response; attention distribution characteristics are represented through thepercentage of fixation points in the region of interest, the number of times of review and the importance degree, the attention distribution situation with the highest support degree is extracted toserve as a mode, the guidance effect can be achieved on control over pilots of the unmanned aerial vehicle, and the important significance is also achieved on optimization of interface setting of an unmanned aerial vehicle control platform.

Description

technical field [0001] The invention relates to the field of unmanned aerial vehicle flight control training, and specifically relates to a method for extracting the visual attention distribution mode of the drone pilot associated with the task scene, which can extract the visual attention distribution mode of the drone pilot associated with the task scene , and then used to guide the pilot's eye movement behavior. Background technique [0002] In the modern drone control system, the degree of automation is very high, and the main function of the drone pilot has changed from control to surveillance. When performing different flight tasks, UAV pilots need to monitor a variety of information at the same time, so there is an optimal visual attention distribution mode that enables pilots to complete information collection in the most accurate and timely manner. It has strong guiding significance for UAV pilots. In addition, this mode can also be applied to the ergonomics evalu...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G09B9/08G06K9/62
CPCG09B9/08G06F18/23G06F18/2411
Inventor 于薇薇陆正煜蔡闻峰任志军
Owner NORTHWESTERN POLYTECHNICAL UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products