The application discloses a brain electrical
signal visual decoding method and
system based on neural co-occurrence
pattern learning, and comprises a neural co-occurrence
Transformer model, specifically comprises a space-time
convolution feature extraction module and a neural co-occurrence
encoder, and the neural co-occurrence
encoder comprises feature identity embedding and a
Transformer encoding block.The feature identity embedding is that a set of learnable vector parameters are initialized as unique identity identifiers of each feature block, and the parameters are directly superimposed on the feature blocks output by the space-time
convolution feature extraction module, so that the
neural activity patterns stably co-occurring under specific visual stimulation are automatically discovered and focused; then the
neural activity patterns are input into the
Transformer encoding block to obtain brain electrical representation vectors; and the brain electrical
signal is decoded by adopting a multi-
modal contrast learning mode and discarding traditional time position coding and instead capturing the co-occurrence patterns of neural signals, so that the visual decoding precision of the brain electrical
signal is significantly improved.