Subway station multi-modal data noise processing method, computer device and program product

Abstract

The application provides a subway station multi-modal data noise processing method, computer equipment and program product, which is applied to a subway station multi-source perception data processing scene, and is used for realizing noise identification and abnormality repair in a multi-modal data fusion process. First, each modal data from different devices is subjected to space-time alignment processing, multi-source data is uniformly mapped to a same time slice and a station space unit to obtain corresponding multi-modal data, on the basis of which, a dynamic fusion feature of a current time slice is constructed for each station space unit, noise embedded in the dynamic fusion feature is identified based on cross-modal consistency features in the dynamic fusion feature and modal data feature representations, an abnormal modal is located, finally, target modal data feature representations corresponding to the abnormal modal are repaired, and the repair result is written back to the dynamic fusion feature for updating, so as to suppress noise propagation and improve the accuracy of the fusion result.

Images