The application provides a kind of
pedestrian traffic intention multimodal prediction method and prediction device, applied to
access control monitoring technical field, based on the image information obtained, extract
pedestrian multimodal feature, and whether the current
pedestrian is allowed to pass through by decision logic judgment, including the following steps: S1, obtain the
image sequence of inbound pedestrian, execute multi-target detection and tracking, identify each pedestrian ID, form boundary box sequence;S2, for each pedestrian, multimodal
feature extraction is carried out, the multimodal feature includes card swiping action,
gaze direction, running behavior and pedestrian category;S3, after
processing multimodal feature, input into
decision model to judge, to control gate state.The pedestrian traffic intention multimodal prediction method and prediction device, by fusing the
gaze direction of pedestrian, action behavior, hand card swiping action and
human body feature information, etc. Comprehensive judgment of the traffic intention of current traffic personnel, improve the accuracy and timeliness of abnormal behavior detection.