The invention relates to the technical field of
cognitive impairment detection, and discloses a
cognitive impairment early warning method and device based on an electroencephalogram micro state and an
eye movement trajectory, and the method comprises the following steps: S1,
data acquisition, S2, electroencephalogram preprocessing, S3,
electroencephalogram feature extraction, S4,
eye movement feature extraction, S5,
feature fusion, and S6, early warning judgment. According to the method, through independent
convolution branch of electroencephalogram and
eye movement features, a
receptive field is expanded by utilizing cavity
convolution to capture multi-scale features, and long-distance dependence is modeled by a self-attention layer; after
tensor splicing,
time sequence information is dynamically fused through a gating cycle unit (GRU), and cross-
modal time correlation is captured. The method has the advantages that the multi-
modal feature hierarchical extraction and self-adaptive modeling capability is enhanced, the complementarity fusion efficiency is optimized, meanwhile, by means of cavity
convolution sparse connection, self-attention parameter sharing and GRU lightweight design, the
model complexity and the calculation efficiency are balanced, and efficient feature representation is provided for
cognitive impairment early warning.