Data collection method and management system of data aggregation platform

A data acquisition system and data acquisition technology, applied in the direction of electrical digital data processing, special data processing applications, database indexing, etc., can solve the problems of data loss, affecting data transmission and collection, long interface response time, etc., to improve processing efficiency , The effect of improving the receiving efficiency

Pending Publication Date: 2021-10-08
慧生活信息技术有限公司
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

If the amount of data is too large, it will occupy a large amount of system resources of the server to insert or modify data, m

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data collection method and management system of data aggregation platform
  • Data collection method and management system of data aggregation platform

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0032] In order to better understand the present invention, the present invention will be further described below in connection with those skilled in the art.

[0033] In a smart community big data item, in order not to affect the traffic of the day network channel and the load of the server, the present invention sets the time between the data acquisition to 1 point to 5 o'clock. During this time, multiple systems (property, user app, online related community news) of the smart community are running, and the news of news and other data from the Internet will upload a large amount of data to the acquisition system, and the acquisition system needs to be analyzed at the same time. And save a lot of data into the database.

[0034] Since the speed problem of the database saves seriously reduces the performance of the server, it is often timeout, the server is wrong, lost the acquisition data, and therefore, the present invention adds a temporary data pool in the data acquisition sys...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data collection method of a data aggregation platform and a management system thereof, and belongs to the field of data collection, the data collection method comprises the following steps: S1, receiving data uploaded by each business system, the received data being provided with identification codes; S2, creating a data table for storing the data received in the S1 in a temporary data pool; S3, reading data in the data table, and analyzing the data through the identification codes; and S4, storing the analyzed data after being cleaned. According to the invention, the concurrent efficiency of the system interface can be improved, the i/o page view of the server is reduced, the pressure of the acquisition server is reduced, and the possibility of data loss is reduced.

Description

technical field [0001] The invention belongs to the field of data collection, and in particular relates to a data collection method of a data aggregation platform and a management system thereof. Background technique [0002] The main technology of data collection of data aggregation platform is data integration. Under normal circumstances, the data collection system customizes the update interface of various data according to different update strategies such as batch update, incremental update, real-time update, and data synchronization, and provides data collection methods such as manual entry and interface service collection, and provides strict The quality inspection tool realizes the collection and update of various data in the data center, and ensures the timeliness, authority and consistency of the data resource center database. [0003] There are many types of data collected by the data aggregation platform. Each type of data has different data attributes, formats, ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/22G06F16/215
CPCG06F16/2282G06F16/215
Inventor 杨炳
Owner 慧生活信息技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap