Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Extensible mass data collection system

A massive data collection system technology, applied in the field of IT operation and maintenance, can solve problems such as low matching degree, lack of data storage scheme, lack of data task caching, dumping, sequence adjustment and other scheduling mechanisms, etc., to achieve flexible configuration, Improve scalability, improve the effect of scalability

Active Publication Date: 2014-06-11
勤智数码科技股份有限公司
View PDF9 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] In the field of IT operation and maintenance, data monitoring is a basic work, and its accuracy and processing efficiency play an important role in ensuring the operation of the system. With the continuous development of the information system itself, the amount of data collection continues to increase. , and different devices involve many network element indicators. Therefore, within a unit time, the amount of network element data collected by the monitoring system is huge. Although there are many solutions for mass data storage in the prior art, in IT operation and maintenance The matching degree of the field is not high, there is a lack of scheduling mechanisms such as caching, dumping, and sequence adjustment for data tasks, and there is a lack of efficient, accurate, and massive data storage solutions for IT operation and maintenance tools

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Extensible mass data collection system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0020] All the features disclosed in this specification, or all disclosed methods or steps in the process, except for mutually exclusive features and / or steps, can be combined in any manner.

[0021] Such as figure 1 As shown, in the field of IT operation and maintenance, the massive performance index data collected by different collection terminals are stored. First, configure rules to define that the optimal number of incoming messages for each batch is 1000, the longest waiting time for the optimal number of messages is 3 seconds, the maximum number of tasks that can be carried is 500, and the inbound work managed by the terminal manager When the number of tasks in the task cache exceeds the maximum number of tasks, 30% of the tasks in the task cache are randomly transferred to the inbound information dump file, the inbound task fails to be retried 3 times, and the inbound information dump file is a message. dump, error message dump file error_message.dump.

[0022] During sys...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an extensible mass data collection system which comprises a data storage controller, a storage information buffer memory, a storage working terminal manager, a storage task buffer memory, a storage terminal, a storage information unloading file, a configuration rule base and an error information unloading file. The data storage controller is used for receiving and distributing information to be stored. The storage working terminal manager is used for receiving and distributing storage tasks. The storage terminal receiving manager receives tasks distributed by the manager and executes the storage operation. The configuration rule base is used for storing configuration information of configuration rules and providing the basis for parts to make response under specific conditions. Compared with the prior art, the scheduling management is added in the mass data storage process, the system expandability can be improved remarkably, the data storage accuracy and completeness are improved, and the data storage working reliability is improved.

Description

Technical field [0001] The invention relates to the field of IT operation and maintenance, in particular to a data acquisition system that is easy to expand. Background technique [0002] In the field of IT operation and maintenance, data monitoring is a basic work, and its accuracy and processing efficiency play an important role in ensuring the operation of the system. With the continuous development of the information system itself, the amount of data collection continues to increase, not only monitoring many devices at the same time , And different equipment involves many network element indicators. Therefore, in unit time, the amount of network element data collected by the monitoring system is huge. Although there are many solutions for mass data storage in the prior art, it is important for IT operation and maintenance. The matching degree of the field is not high, lack of scheduling mechanisms such as caching, dumping, and sequence adjustment of data tasks, and lack of ef...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/258
Inventor 舒刚
Owner 勤智数码科技股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com