Parallel asynchronous efficient collection and analysis method and system

Abstract

The invention provides a parallel asynchronous efficient collection and analysis method and system. The method comprises the steps: issuing an equipment data collection and analysis task to an intelligent scheduling module, and issuing the task to a task collection module in an asynchronous manner; a task collection module converts the collection analysis task into a standardized data collection task according to a preset data collection rule and issues the standardized data collection task to the parallel asynchronous collection module; a parallel asynchronous collection module combines the collected data with the cache historical data according to the collection task type for data integration, and sends the integrated data to the data analysis module; a data analysis module performs data analysis based on the service analysis model to obtain an analysis result, and pushes the analysis result to the user side. The system is applied to the method. According to the invention, the performance data of the whole network equipment is efficiently collected and analyzed in a parallel asynchronous mode, minute-level monitoring and inspection can be realized, the parallel efficiency is high, and the cloud application efficiency is high.

Description

technical field [0001] The invention relates to the technical field of big data processing, in particular to a parallel asynchronous high-efficiency collection and analysis method and a system applying the method. Background technique [0002] At present, the number of users of optical fiber network operators usually reaches millions, and the communication equipment in the network includes backbone network equipment, aggregation layer equipment, access network equipment, etc. Each business department needs to know the operation status and business health status of the network in real time. At this time, it is necessary to monitor and analyze the TCP / IP devices in the network in real time. The operation support platform will send the corresponding GET command to the network device management module to be analyzed and processed after receiving the request from the external system. [0003] The operator's network equipment data is usually stored in a database. The network mana...

AI Technical Summary

Problems solved by technology

[0004] In the communication network, the network management system is responsible for inspecting the equipment data in the network and synchronizing business data and analyzing and warning, providing reliable guarantee for business operations. Due to the large scale of data, the inspection and analysis of the entire network data takes more than 5 minutes. In this way, it is difficult to implement minute-level monitoring and inspection of the entire network equipment and business systems, and it is impossible to predict potential network performance risks in the network in a timely manner, resulting in lower customer satisfaction with the support of communication operators.

Images