A Method and System for Pedestrian Gait Multimodal Fusion Recognition Based on 4D Imaging Radar

Abstract

This invention discloses a method and system for multimodal fusion recognition of pedestrian gait based on 4D imaging radar, comprising the following steps: target detection using 4D imaging radar; multi-target tracking and association, retaining pedestrian target trajectories and removing ghost target trajectories; extracting pedestrian target 4D point cloud sequences and micro-Doppler time-frequency maps; constructing a dual-modal gait recognition network model; training and updating the parameters of the dual-modal gait recognition network model; and using the trained dual-modal gait recognition network model to achieve gait identity recognition. This invention aims to eliminate the influence of ghost targets on pedestrian gait data extraction through multi-target tracking, and to fuse 4D point cloud sequences and micro-Doppler time-frequency maps related to pedestrian gait, combining spatiotemporal variation information and micro-motion information to solve the problem of low gait data representation capability of single-modal radar, thereby improving the robustness of gait recognition.

Images