The application relates to the technical field of
data processing, and discloses a city-level intelligent
community multi-source heterogeneous data
standardization management method, which comprises the following steps: acquiring heterogeneous
data messages and generating a structure topology
fingerprint, performing differential
processing according to a
fingerprint comparison result; when the comparison result is inconsistent, extracting
time sequence statistical features of unknown fields to construct a physical
feature vector, and calculating the topological structure correlation among the unknown fields to construct a topological
distance matrix; based on the physical
feature vector and a standard field
reference vector, combining the topological
distance matrix to construct and solve a global mapping
loss function, and establishing the mapping relationship between the unknown fields and the standard fields; generating a streaming
mask according to the mapping relationship and a message
network communication protocol type, and extracting and storing standardized data based on the
mask. The application can perceive
message structure changes through a structure
fingerprint, and can constrain a mapping relationship by combining space-time joint features, so that the accuracy of heterogeneous
data mapping conversion and the
system processing efficiency are improved.