Big data platform and construction method thereof

Abstract

The invention discloses a big data platform, which comprises nine subsystems: a data basic library platform library, a data exchange management system, a data management system, a data sharing management system, a data governance management system, an operation support management system, a unified data portal management system, a big data visualization platform and a city operation one-graph module. According to the big data platform, the third-party application can be effectively helped to be in butt joint with the government affair unit, repeated development of the access application and the supporting platform is reduced, integration and sharing of resources are achieved, and the problem of information islands is solved. According to the big data platform, a distributed database is used and assisted by technical means such as a distributed file system HDFS and MapReduce to process and analyze a large amount of data in real time, the system performance is greatly optimized, multiple access interfaces are added, convenience is provided for platform developers to use data, the big data platform is generally suitable for business scenes with high concurrent access requirements, strong transaction consistency and low transaction response delay.

Description

Technical field [0001] The present invention relates to the field of government data management, and more particularly to a large data platform and its construction methods. Background technique [0002] A large number of structural and non-structural data, including public security, corporate, vehicle data, social security, labor, etc. of public security, health, family planning data, approval and work A large number of document data generated in, as well as the massive video data generated by law enforcement, which constitutes a massive amount, and has important impact on the aspects of the city. These data are often stored in the self-built system of various departments, and there is problems such as difficulty, data disclosure, and more in the data sharing. [0003] In order to solve the above problems to collect, clean, transition, convert, and convert according to different network environments, depending on different network environments, different data types, to achieve a...

AI Technical Summary

Problems solved by technology

The big data platform of the present invention uses a distributed database and supplemented by technical means such as distributed file system HDFS and MapReduce to process and analyze a large amount of data in real time in order to solve the problem of low performance of the traditional web big data platform using a single database storage

Images