Data acquisition method of distributed data system and distributed data system

A distributed data and data acquisition technology, applied in the field of distributed systems, can solve the problem of incomplete collection of target data in the data center, and achieve the effect of avoiding incomplete collection of target data and speeding up the processing speed

Active Publication Date: 2019-08-16
SHENZHEN LONGRISE SCI & TECH
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The main purpose of the present invention is to provide a data acquisition method of a distributed data system and a distributed data system, aiming to solve the technical problem of incomplete acquisition target data in existing data centers

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data acquisition method of distributed data system and distributed data system
  • Data acquisition method of distributed data system and distributed data system
  • Data acquisition method of distributed data system and distributed data system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0053] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0054]The present invention provides a data collection method (hereinafter referred to as the data collection method) of a distributed data system. In the first embodiment of the data collection method of the present invention, refer to figure 1 and Image 6 , the distributed data system includes a plurality of data centers connected by communication with each other and the remote terminals 300 subordinate to each data center. The data centers include a management data center 100 and an auxiliary data center 100. The data center that starts the data collection process at the earliest can be used as the management data center Center 100, other data centers in the distributed data system serve as auxiliary data centers 110, the data collection method includes:

[0055] Step S10, the management data center 100 evenly di...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a distributed data system data acquisition method and a distributed data system. The distributed data system comprises a plurality of data centers and remote terminals, wherein the data centers comprise a management data center and auxiliary data centers. The data acquisition method comprises: the management data center equally distributing data acquisition tasks to each auxiliary data center for execution; the management data center obtaining the hardware load of the data acquisition task of each auxiliary data center every preset interval, and using the hardware load as a reference hardware load; and according to the reference hardware load, the management data center dynamically adjusting the data acquisition task executed by each auxiliary data center in order to balance the hardware load of each auxiliary data center. The data acquisition method accelerates a data acquisition task processing speed, and allows the data centers to timely collect required object data so as to avoid object data acquisition completeness caused by unresponsive object data acquisition.

Description

technical field [0001] The invention relates to the technical field of distributed systems, in particular to a data collection method of a distributed data system and a distributed data system. Background technique [0002] In reality, a large amount of data is generated all the time, some of which need to be analyzed and some need to be stored. The amount of all these data that needs to be processed is huge and similar, so it is necessary to analyze and process these big data. data. [0003] In the prior art, data collection machines are generally used to collect target data (such as performance data, alarm data, flow data, business data, etc.) , and then the data acquisition machine uploads the target data to the data center. However, due to the limited hardware performance of the data acquisition machine and insufficient network bandwidth, when the number of remote terminals reaches a certain number, the data acquisition machine will not be able to collect the required t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/08
CPCH04L67/1008H04L67/12
Inventor 张锐
Owner SHENZHEN LONGRISE SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap