Method for quick finishing large data-handling and reporting system

Abstract

The invention discloses a report system and method for quickly completing large data processing. The method includes: selecting a report template and setting parameters for report query; forming a pre-compiled data structure according to the selected report template and parameter information; Query the original result set in , and filter the original result set according to the filter expression; the data processing module sorts and groups the filtered result set, and performs formatting according to the template information; the data processing module converts the report The resulting structure is encapsulated as a query result set and returned to the client for rendering. The system and method of the present invention are used to realize high-speed data generation because the format and data are completely separated. After the client receives the data, it does not need to analyze the data, which improves the efficiency of data transmission between the client and the server, greatly Improve the speed of querying a large amount of data in the report, reduce the memory usage of server-side data, and reduce the system load.

Description

technical field [0001] The present invention relates to a large data processing system and method in the technical field of wireless communication, and in particular to a system and method for presenting large data of various services (performance, alarm, report, etc.) in various communication network management systems. Background technique [0002] In the prior art telecommunication network management, there is usually a large amount of data processing. Taking the report management in the network management system as an example to illustrate, the report management provides the system administrator with a unified report output function for the important information of the network management system. Using the report management function, the system administrator can customize report tasks and output report data, so as to facilitate the monitoring of the operation of the network management system. In order to better use the report data to analyze the operation of the system, i...

AI Technical Summary

Problems solved by technology

[0003] The columns of data required by the report initially come from the database, one can directly correspond to the fields of the database table; the other is the index, which is usually processed in the stored procedure script, and the writing method of the stored procedure is closely related to the database technology , this method is not universal, there are a large number of redundant scripts, which is relatively labor-intensive

[0004] In the existing system, when the data in each column of the report contains indicators, the network management system will first query the original data from the database, and then perform grouping and statistical operations in the memory, such as averaging, summing, maximum, minimum, and other custom statistical methods; and the filling of the format, which consumes memory and is very slow. As report data more and more participate in the comprehensive analysis system operation, the amount of raw statistical data increases by orders of magnitude. It will be time-consuming to query the report data every time, and it will also consume a lot of memory when the terminal is rendered

Images