Service platform integration method based on big data

A service platform and big data technology, applied in the field of big data, can solve the problems of not having unstructured and semi-structured data, unable to serve government affairs and the general public, and imperfect modeling of big data systems, so as to increase effective utilization efficiency, reducing communication costs and time costs

Inactive Publication Date: 2016-09-21
四川中软科技有限公司
View PDF6 Cites 48 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] Big data is the commanding height of the next generation of information technology in the information industry. The construction of smart cities has been put on the agenda in China. Smart cities contain a large amount of data and are a new generation of application technologies serving government affairs, enterprises and citizens. However, the existing smart cities Big data integration technology is still unable to serve government affairs and the general public in all aspects of the city, which is mainly due to the limitations of the following aspects:
[0003] (1) The computational model of the complexity of big data is currently only analyzing the nat

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Service platform integration method based on big data
  • Service platform integration method based on big data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0055] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the drawings in the embodiments of the present invention.

[0056] Such as figure 1 and figure 2As shown, the present invention provides a service platform integration method based on big data, comprising the following steps:

[0057] Step 1: Collect multi-source heterogeneous data. The specific collection process includes the following steps:

[0058] Step 1.1: Configure multi-source heterogeneous data sources, configure front-end processors and manual input terminal devices in the departments that collect data (including: land, environmental protection, water conservancy, meteorology, forestry, safety supervision, quality supervision, etc.), Configure equipment such as front-end processors, application servers, database servers, WEB servers, system monitoring terminals, and work terminals for business processing of collected data;...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a service platform integration method based on big data. The method comprises the following steps: (1) acquiring multi-source heterogeneous data; (2) integrating the acquired multi-source heterogeneous data, and storing the integrated data in an Hbase database; (3) using Hive to perform ETL treatment on the integrated data which is stored in the Hbase database, and storing in the Hbase database, cleaning the data which is stored in the Hbase database, to obtain clean data, and storing the clean data in the Hbase database; (4) based on an Hadoop technology, performing modeling analysis on the obtained clean data, and storing an analysis result in an Hive database; (5) using a service-oriented architecture based on SOA to establish a data exchange and shared service bus, and then based on the service bus, establishing a data exchange architecture, and through the data exchange architecture, pushing the analysis result which is stored in the Hive database to a business application system database. The method effectively reduces communication cost and time cost, and improves data effective utilization rate.

Description

technical field [0001] The invention relates to the technical field of big data, in particular to a service platform integration method based on big data. Background technique [0002] Big data is the commanding height of the next generation of information technology in the information industry. The construction of smart cities has been put on the agenda in China. Smart cities contain a large amount of data and are a new generation of application technologies serving government affairs, enterprises and citizens. However, the existing smart cities Big data integration technology is still unable to serve government affairs and the general public in all aspects of the city, which is mainly due to the limitations of the following aspects: [0003] (1) The computational model of the complexity of big data is currently only analyzing the nature and exploring the laws of multi-source data, and there is no complete application method system; [0004] (2) There is less structured da...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/215G06F16/254G06F16/285
Inventor 向富强曾逸杨雪琴
Owner 四川中软科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap