Wireless city big data offline processing system and big data offline processing method of system

Abstract

The invention belongs to the field of wireless city data processing technology and particularly relates to a wireless city big data offline processing system and a big data offline processing method of the system. The system comprises a timing increment module, a matching extraction module, a storage module, an analysis module and a statistical module, wherein the timing increment module is used for acquiring timing increment data of wireless city big data; the matching extraction module is used for reading the timing increment data and extracting matching data; the storage module is used forreceiving and storing the matching data from the matching extraction module; the analysis module is used for reading and analyzing the matching data stored in the storage module; and the statistical module is used for performing statistical analysis and display on the matching data analyzed through the analysis module. According to the system and the method, an HDFS file system is adopted, multiple Hadoop clusters are integrated, extension is convenient, a non-relational database Hbase set up on the HDFS file system realizes storage of the wireless city big data at a 100-million level, and thedemand of big data statistical analysis in a wireless city is met.

Description

technical field [0001] The invention belongs to the technical field of wireless city data processing, and in particular relates to a wireless city big data off-line processing system and a big data off-line processing method thereof. Background technique [0002] With the rapid development of social economy and the rapid increase of the use of smart phones by citizens, it is the main demand of the public that smart phones can be connected to wireless WIFI anytime and anywhere. Various data including business district data, user preferences, location, etc. Based on cloud computing technology, building a reasonable and advanced big data collection and analysis platform to provide services and assistance for merchants, public security personnel, scientific research personnel and government monitors will become an important direction of future informatization work. [0003] At this stage, the wireless city big data offline processing system collects incomplete information. Ther...

AI Technical Summary

Problems solved by technology

[0003] At this stage, the wireless city big data offline processing system collects incomplete information, does not collect information targeted at business districts, merchants, etc., cannot process billion-level wireless city data, and can only analyze a small amount of data, and the analysis speed is slow and error-prone , the obtained results are not universal and accurate

Images