The invention discloses a
millimeter wave radar gesture recognition method and
system based on gating collaborative fusion, and belongs to the technical field of
artificial intelligence and man-
machine interaction. The method comprises the following steps: firstly, acquiring and preprocessing
original data through a
millimeter wave radar sensor; secondly, extracting a global spatial feature map (such as a two-dimensional
point cloud map) capable of representing the overall motion track of the gesture and a plurality of local
dynamic feature maps (such as a distance-
time map, a Doppler-
time map and the like) capable of representing dynamic information of the gesture in parallel; and then, the extracted multi-
modal features are processed through the gated collaborative fusion network designed by the invention. The core of the method is that the global spatial feature map is processed through a first neural network and a global average
pooling layer to generate a static global
feature vector; dynamically modulating a local feature sequence processed by a second neural network through a gating unit by using the static global
feature vector; and finally, fusing all modulated sequences, inputting the fused sequences into a
time sequence processing module for analysis, and outputting a final gesture category. According to the method, through an innovative gating
fusion mechanism, dynamic cooperation of multi-
modal features is realized, the problem that a traditional fusion method cannot adapt to different gesture feature changes is effectively solved, and the accuracy and robustness of
gesture recognition are remarkably improved.