Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Big data platform-based wireless city audit data offline analysis method

A big data platform, wireless city technology, applied in the field of offline analysis of wireless city audit data based on big data platform, can solve the problems of inability to meet business data storage and processing requirements, small user base, slow processing speed, etc., to improve interaction display, fast processing, and fast analysis

Inactive Publication Date: 2018-05-11
ANHUI SUN CREATE ELECTRONICS
View PDF4 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the traditional offline analysis method of wireless city audit data can handle small user base, small amount of information, and slow processing speed, which cannot meet the existing business data storage and processing needs.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data platform-based wireless city audit data offline analysis method
  • Big data platform-based wireless city audit data offline analysis method
  • Big data platform-based wireless city audit data offline analysis method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

[0039] Such as figure 1 , 2 As shown, an offline analysis method of wireless city audit data based on a big data platform includes the following steps:

[0040] S1. Collect audit data, and store the collected audit data to the FTP server in the form of a CSV file extension;

[0041] S2. The big data platform regularly schedules the audit data stored in the FTP server in the form of a file extension of CSV;

[0042] S3. Preprocess the audit da...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention belongs to the technical field of wireless city big data offline analysis, and particularly relates to a big data platform-based wireless city audit data offline analysis method. Througha data preprocessing module and an ETL tool, the collection quality of audit data is improved; data storage adopts a distributed file system, so that the capacity bottleneck of hundred million data storage is solved, and the security of the audit data is ensured; part of audit data tables are stored in a memory, so that the storage and reading speeds of the audit data is greatly increased; data analysis adopts a MapReduce calculation framework, so that the analysis speed is high, and the interactive display of the audit data and a user is greatly improved; and the wireless city audit data offline analysis method is large in processable user base, large in information quantity and high in processing speed, meets existing business data storage and processing demands, and better finishes expansion and analysis of the audit data for hundred million information.

Description

Technical field [0001] The invention belongs to the technical field of wireless city big data offline analysis, and in particular relates to a wireless city audit data offline analysis method based on a big data platform. Background technique [0002] In recent years, with the rapid development and wide application of information technology, convenient and timely networking of smart phones has become a major public demand. The amount of data generated and applied by mobile Internet users is increasing. The emergence of billion-level user data and the diversification of data structures make it very complicated to collect and store such huge amounts of data on servers. Wireless cities contain a large amount of data and serve the government, The company's and the public's new generation of wireless WIFI technology and a unified wireless city operation platform are regarded as an important direction for the development of future urban informatization and an important means to improve...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/16G06F16/1824
Inventor 邓惠元范联伟余保华徐圣吉展昭张金国吴磊胡鸿超
Owner ANHUI SUN CREATE ELECTRONICS
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products