The application discloses a visual information recognition method and
system based on
eye movement attention, a medium and equipment, and relates to the technical field of visual analysis.
Eye movement data is obtained through an eye jump experiment, and after
processing, the
eye movement data first enters a multi-head attention unit to calculate the self-attention weight of the
eye movement data to perform
feature selection in the first stage, then enters a local attention unit to further extract local attention features and obtain key information of the eye movement data, and finally, the
data information is added through an adding unit, so that the extracted features are more comprehensive and more accurate. In the case of limited eye movement data, the key information in the features is maximized to more accurately detect visual information.