The invention discloses a
visual identification method and
system based on electroencephalogram
signal enhancement, and the method comprises the steps: S1, carrying out the grouping of a multi-class image
data set, and generating a sequence image through employing a dual
randomization strategy; s2, presenting an
image sequence to a subject by adopting an ERP normal form, and randomly inserting a task target irrelevant to the main task into the sequence; s3, collecting EEG (electroencephalogram) signals with high
time resolution of the whole brain and preprocessing the EEG signals; s4, respectively extracting features by using an image
encoder and an electroencephalogram
encoder, and carrying out joint training by adopting a supervised contrast learning target containing a hard
negative sample weighting mechanism to generate feature representations aligned in a unified
semantic space; and S5, inputting the aligned feature representation into a Transform-based fusion model, performing depth information interaction through a cross attention mechanism to generate a final fusion feature representation, and outputting an identification result by a classifier. According to the invention, the mixed
granularity visual identification performance is improved.