A pilot gaze object recognition method and system based on eye movement data

CN122347795APending Publication Date: 2026-07-07PLA AIR FORCE AVIATION UNIVERSITY

View PDF 0 Cites 0 Cited by

Patent Information

Authority / Receiving Office: CN · China
Patent Type: Applications(China)
Current Assignee / Owner: PLA AIR FORCE AVIATION UNIVERSITY
Filing Date: 2026-06-04
Publication Date: 2026-07-07

AI Technical Summary

Technical Problem

Existing technologies have low accuracy in identifying objects of gaze during flight training, and cannot effectively convert this into information for optimizing flight training. Furthermore, traditional AOI segmentation methods are difficult to accurately characterize attention distribution due to differences in lighting inside and outside the cockpit and inconsistencies in the areas of focus on instruments.

Method used

The YOLOV8n neural network is used for target detection. The relative positional relationship between the objects being gazed at by the pilot is combined for inspection and correction. The gaze area of the instrument is reconstructed, and the objects being gazed at by the pilot are identified using eye-tracking data.

Benefits of technology

It improves the accuracy and robustness of gaze object recognition, enabling accurate identification of gaze objects at every moment in complex flight training environments, and significantly enhances the effectiveness of gaze object recognition.

✦ Generated by Eureka AI based on patent content.

Smart Images

Figure CN122347795A_ABST

Patent Text Reader

Abstract

The application is suitable for the technical field of eye movement data processing, and provides a pilot gaze object recognition method and system based on eye movement data. The method comprises the following steps: sampling video data into images, constructing a training data set, training a YOLOV8n neural network, and obtaining a YOLO lightweight target detection model; based on the YOLO lightweight target detection model, frame-by-frame recognition is performed on the video data to be recognized; according to the relative position relationship between the gaze objects, the preliminary recognition result is checked and corrected; the pointer position of the instrument type gaze object is detected, and the gaze area of the gaze object is reconstructed according to the pointer position; and according to the gaze point coordinates in the table data and the reconstructed gaze area, the gaze object at each moment is determined. According to the table data and the video data recorded by the eye tracker, the pilot's gaze object at each moment in the flight training process can be accurately recognized.

Need to check novelty before this filing date? Find Prior Art