Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data collection method and management system of data aggregation platform

A data acquisition system and data acquisition technology, applied in the direction of electrical digital data processing, special data processing applications, database indexing, etc., can solve the problems of data loss, affecting data transmission and collection, long interface response time, etc., to improve processing efficiency , The effect of improving the receiving efficiency

Pending Publication Date: 2021-10-08
慧生活信息技术有限公司
View PDF5 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

If the amount of data is too large, it will occupy a large amount of system resources of the server to insert or modify data, making the response time of the interface too long, affecting subsequent data transmission and collection, resulting in data loss

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data collection method and management system of data aggregation platform
  • Data collection method and management system of data aggregation platform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] In order to enable those skilled in the art to better understand the solutions of the present invention, the present invention will be further described in detail below in conjunction with specific embodiments.

[0033] In a smart community big data project, in order not to affect the traffic of the network channel and the load of the server during the day, the present invention sets the data collection time between 1:00 am and 5:00 am. During this part of the time, multiple systems operated by the smart community (property, user APP, Internet of Things, online related community news, etc.) will upload a large amount of data to the collection system at this time, and the collection system at this time needs to analyze at the same time And save a large amount of data into the database.

[0034] Because the speed problem of database preservation has seriously reduced the performance of server, also often overtime, server makes mistakes, loses the data collected, therefore...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data collection method of a data aggregation platform and a management system thereof, and belongs to the field of data collection, the data collection method comprises the following steps: S1, receiving data uploaded by each business system, the received data being provided with identification codes; S2, creating a data table for storing the data received in the S1 in a temporary data pool; S3, reading data in the data table, and analyzing the data through the identification codes; and S4, storing the analyzed data after being cleaned. According to the invention, the concurrent efficiency of the system interface can be improved, the i / o page view of the server is reduced, the pressure of the acquisition server is reduced, and the possibility of data loss is reduced.

Description

technical field [0001] The invention belongs to the field of data collection, and in particular relates to a data collection method of a data aggregation platform and a management system thereof. Background technique [0002] The main technology of data collection of data aggregation platform is data integration. Under normal circumstances, the data collection system customizes the update interface of various data according to different update strategies such as batch update, incremental update, real-time update, and data synchronization, and provides data collection methods such as manual entry and interface service collection, and provides strict The quality inspection tool realizes the collection and update of various data in the data center, and ensures the timeliness, authority and consistency of the data resource center database. [0003] There are many types of data collected by the data aggregation platform. Each type of data has different data attributes, formats, ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/22G06F16/215
CPCG06F16/2282G06F16/215
Inventor 杨炳
Owner 慧生活信息技术有限公司
Features
  • Generate Ideas
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com