The invention discloses a multi-source streaming
big data fusion convergence
processing framework
model implementation method, which comprises a multi-source
streaming data acquisition implementationmethod which comprises steps of realizing
streaming data acquisition agent and multi-source
streaming data acquisition service, providing an convergence
metadata standard, and performing streaming multi-
source data acquisition; and a multi-source streaming data fusion
processing implementation method which comprises the steps of fusing and converging multi-source streaming data, providing a streaming
processing engine based on Flink & Spark
Stream; and according to the convergence
metadata standard, configuring the collected streaming multi-
source data fusion to carry out streaming
data processing, processing the streaming multi-
source data into convergence
metadata meeting the convergence
metadata standard requirement, carrying out regularized convergence
metadata standard storage, and providing data for statistics, mining and analysis of the convergence data. According to the method,
big data processing mainstream Flink and Sprakstream
open source technical components are fused, andthe problems of multi-source data
complementation, feature operator processing, convergence metadata
standardization and streaming target
data matching in multi-source data fusion convergence processing are solved.