A big data acquisition system and method

A collection system and data collection module technology, applied in database management system, database index, structured data retrieval, etc., can solve problems such as high pressure on collection server and transmission network, high frequency of data transmission, loss, etc.

Inactive Publication Date: 2019-05-10
北京云基数技术有限公司
View PDF6 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The main problems faced by the existing big data collection are: the amount of data generated by the data source in real time is huge, the data transmission frequency is high, and the pressure on the collection server and the transmission network is very high. In the case of an unstable transmission network, the data collection and transmission The process is prone to data leakage, loss and other problems, and the data security is poor

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A big data acquisition system and method
  • A big data acquisition system and method
  • A big data acquisition system and method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054] In order to make the object, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be described in detail below. Apparently, the described embodiments are only some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other implementations obtained by persons of ordinary skill in the art without making creative efforts fall within the protection scope of the present invention.

[0055] figure 1 It is a schematic structural diagram provided by Embodiment 1 of the big data acquisition system of the present invention.

[0056] Such as figure 1 As shown, the big data acquisition system described in this embodiment includes:

[0057] Data acquisition module 1, data aggregation module 8 and data receiving module 2;

[0058]Wherein, the data acquisition module 1 includes: one or more agent units 11;

[0059] The agent unit 11 is deployed o...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a big data acquisition system and method. The big data acquisition system comprises a data acquisition module, a data aggregation module and a data receiving module, the dataacquisition module comprises one or more agent units; wherein the agent unit is deployed on a data device to be collected, and the agent unit is used for collecting operation data and sending the datato the data aggregation module for aggregation and preprocessing; the data receiving module is used for receiving the processing data uploaded by the data aggregation module, processing the data andstoring and displaying the processed data; collected data is preprocessed through the data aggregation module, the data transmission amount and the transmission frequency can be reduced, and the datacan be more stably transmitted to the data receiving module. By arranging the storage unit on the data acquisition module, the probability of data leakage and loss can be reduced, and the security ofthe acquisition system can be improved.

Description

technical field [0001] The invention relates to the technical field of data collection, in particular to a large data collection system and method. Background technique [0002] With the continuous advancement of technology, especially the rapid development of technologies such as the mobile Internet and the Internet of Things, the amount of global data has exploded. Not only is the amount of data increasing and there are many types of data, but also the real-time processing must meet the requirements, all of which have brought great challenges to the collection and processing of big data. The collection of big data mainly uses Internet technology to realize remote data collection, which is collected and transmitted on the Internet through collection software, and after multiple aggregation and forwarding, it is finally sent to the big data platform as a data source for analysis and application. [0003] The main problems faced by the existing big data collection are: the a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/25G06F16/22
Inventor 王江胡湿黄福鑫
Owner 北京云基数技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap