Multi-source heterogeneous public security big data intelligent docking engine system

Abstract

The invention discloses a multi-source heterogeneous public security big data intelligent docking engine system, which belongs to the technical field of internet information. A data acquisition module, based on an online service calling mode and a message theme publishing/subscribing mechanism, can perform data source acquisition, cleaning conversion, target data analysis, transmission and loading to a target data source on line in real time, and continuous flow of data can be realized as long as a network is connected; in addition, a Spring Cloud micro-service framework is adopted inside for service management, micro-service packaging of multi-source data acquisition services is achieved, the concurrent acquisition capability of multi-source end data is supported, the running state of each acquisition service can be monitored in real time, and visual monitoring of the concurrent acquisition services is achieved; a loose coupling architecture is adopted among the tasks, and dependency triggering among the tasks is realized through a service flow control technology, so that the integration process of data from each source end to the target end is automatically controlled and executed in a flow mode.

Description

technical field [0001] The invention relates to the field of Internet information technology, in particular to a multi-source heterogeneous public security big data intelligent docking engine system. Background technique [0002] There are many public security business scenarios in the society, which leads to many types of public security data, a large amount of data, large-scale public security big data correlation and intersection, data characteristics and actual needs have changed. Data characterized by large-scale, multi-source heterogeneous, cross-domain, cross-media, dynamic evolution, and pervasiveness play a more important role, and the corresponding data storage, analysis, and understanding are also facing major challenges. In particular, it is necessary to study how to use the association, intersection and fusion of data to maximize the value of public security big data. [0003] The essence of the perception fusion of public security big data is to obtain high-qu...

AI Technical Summary

Problems solved by technology

[0004] The technical problem to be solved by the present invention is to provide a multi-source heterogeneous public security big data intelligent docking engine system in view of the deficiency of the background technology, which solves the problem that there are too many types of resource information in the public security field, resulting in insufficient subscribing, incoherent classification, Governance of problems that cannot be solved has realized the integration of heterogeneous data in the public security field, and greatly promoted the integrated construction of the police platform

Images