Community management service big data processing system and processing method thereof

A technology of big data processing and community management, applied in the field of big data processing and analysis, it can solve the problem of high redundancy of big data

Active Publication Date: 2015-05-13
HEFEI UNIV OF TECH
View PDF3 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The present invention aims to overcome the deficiencies in the prior art, and provides a community management service big data processing system and its processing method, in order to form a collection mechanism for semi-structured data and structured data oriented to community management services, aiming at Community management service big data with different timeliness forms an efficient storage mechanism, and forms a complete integration mechanism to solve the problem of high redundancy of community management service big data, thereby improving the processing efficiency of community management service big data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Community management service big data processing system and processing method thereof
  • Community management service big data processing system and processing method thereof
  • Community management service big data processing system and processing method thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] In this embodiment, the community management service big data extends to the government affairs systems related to basic population information such as public security, human resources, family planning, and civil affairs, and government affairs systems related to basic information of legal persons such as industry and commerce, taxation, quality supervision, and organization. And government affairs systems related to basic macroeconomic information and basic geospatial information; such as figure 1 As shown, a community management service big data processing system includes: a community management service database, a data collection system, and a data integration system;

[0043] The data collection system includes a semi-structured data collection module and a structured data collection module; the semi-structured data collection module is used for targeted collection of HTML format data of community management services to obtain semi-structured data; the structured data c...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a community management service big data processing system and a processing method of the community management service big data processing system. The community management service big data processing system comprises a community management service database, a data collection system and a data integration system; the data collection system is used for collecting community management service big data; the data integration system is used for converting and fusing the community management service big data. Through the community management service big data processing system and the processing method of the community management service big data processing system, a collection mechanism oriented to semi-structured data and structured data of community management services can be formed, an efficient storage mechanism is formed according to the community management service big data different in timeliness, a complete integration mechanism is formed to solve the problem that the community management service big data are high in redundancy, and therefore processing efficiency of the community management service big data is improved.

Description

Technical field [0001] The invention relates to big data processing and analysis, in particular to a big data processing system and method for community management services. Background technique [0002] Community management is the cell of social governance and an important foundation for the modernization of the national governance system and governance capabilities. The wide application of the Internet, especially the mobile Internet, in community management services, and the continuous emergence of new information sources such as social networks and smart cities have given birth to multi-source, dynamic, massive, and heterogeneous community management service big data. [0003] The current mainstream big data computing method is the open source distributed computing platform Hadoop, whose core is the distributed file system HDFS and the programming model MapReduce. Although Mapreduce is good at processing semi-structured data and structured data, the efficiency of data processi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/25G06F16/84
Inventor 丁帅杨善林蔡琼徐健潘禹辰牛锋
Owner HEFEI UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products