The invention discloses an old people abnormal behavior identification method and
system based on multi-
modal fusion, and the method comprises the steps: an edge end synchronously collects visual, inertial and environmental heterogeneous data, and extracts each
modal feature after
time alignment and preprocessing; vision and
inertia feature weights are dynamically corrected through a cross-
modal attention adapter, and modal unbalance is relieved; constructing a multi-modal fusion graph, executing a graph attention mechanism (HLGAtt) in a hyperbolic Lorentz space, and depicting a behavior hierarchical relationship; and detecting anomaly based on the graph
attention network, positioning a
root cause node through random walk, and outputting an anomaly category and
root cause interpretation. Compared with the prior art, the method has the advantages that the anomaly identification F1
score is increased by more than 6%, the
false alarm rate is lower than 0.7 times per day, and the method has the characteristics of high reliability and
interpretability, can be widely applied to
nursing homes, communities and family scenes, and provides
technical support for intelligent
nursing for the aged.