Easy to expand massive data acquisition system

Abstract

The invention provides an extensible mass data collection system which comprises a data storage controller, a storage information buffer memory, a storage working terminal manager, a storage task buffer memory, a storage terminal, a storage information unloading file, a configuration rule base and an error information unloading file. The data storage controller is used for receiving and distributing information to be stored. The storage working terminal manager is used for receiving and distributing storage tasks. The storage terminal receiving manager receives tasks distributed by the manager and executes the storage operation. The configuration rule base is used for storing configuration information of configuration rules and providing the basis for parts to make response under specific conditions. Compared with the prior art, the scheduling management is added in the mass data storage process, the system expandability can be improved remarkably, the data storage accuracy and completeness are improved, and the data storage working reliability is improved.

Description

technical field [0001] The invention relates to the field of IT operation and maintenance, in particular to an easily expandable data collection system. Background technique [0002] In the field of IT operation and maintenance, data monitoring is a basic work, and its accuracy and processing efficiency play an important role in ensuring the operation of the system. With the continuous development of the information system itself, the amount of data collection continues to increase. , and different devices involve many network element indicators. Therefore, within a unit time, the amount of network element data collected by the monitoring system is huge. Although there are many solutions for mass data storage in the prior art, in IT operation and maintenance The matching degree of the field is not high, there is a lack of scheduling mechanisms such as caching, dumping, and sequence adjustment for data tasks, and there is a lack of efficient, accurate, and massive data storag...

AI Technical Summary

Problems solved by technology

[0002] In the field of IT operation and maintenance, data monitoring is a basic work, and its accuracy and processing efficiency play an important role in ensuring the operation of the system. With the continuous development of the information system itself, the amount of data collection continues to increase. , and different devices involve many network element indicators. Therefore, within a unit time, the amount of network element data collected by the monitoring system is huge. Although there are many solutions for mass data storage in the prior art, in IT operation and maintenance The matching degree of the field is not high, there is a lack of scheduling mechanisms such as caching, dumping, and sequence adjustment for data tasks, and there is a lack of efficient, accurate, and massive data storage solutions for IT operation and maintenance tools

Images