Method and device for information statistics of configuration management resource library
By building an adaptive data collection interface, distributed crawlers and machine learning algorithms, combined with hierarchical classification statistical methods, the problems of incomplete and inefficient information statistics in the configuration management resource library are solved, and efficient and accurate information statistics and real-time updates are achieved.
Patent Information
- Application Number
- CN202510765464.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-06-10
- Publication Date
- 2025-09-16
AI Technical Summary
The existing technology of configuration management resource library has incomplete data collection, low processing efficiency and poor statistical accuracy, which makes it difficult to meet the needs of enterprises for real-time and accurate statistical analysis.
Build an adaptive data collection interface system, combine distributed crawler technology and machine learning algorithms to perform data cleaning and standardization, use hierarchical classification statistical methods to generate visual reports, and build a real-time data monitoring mechanism.
It achieves comprehensive, efficient and accurate statistics of configuration management resource library information, ensures the integrity and accuracy of statistical results, and enables users to obtain the latest information in real time.
Smart Images
Figure CN120653694A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of resource library information statistics, in particular to a method and device for configuring and managing resource library information statistics. Background Art
[0002] In today's information age, enterprises and organizations have numerous configuration management repositories, which store extensive configuration information related to software, hardware, and networks. Effective statistical analysis of the information in these repositories can help enterprises better understand their IT asset status, optimize resource allocation, improve operational efficiency, and ensure system stability and security.
[0003] In the related technologies, the existing means of statistical information of configuration management resource libraries have many shortcomings. On the one hand, during the data collection stage, traditional methods are difficult to fully cover various types of heterogeneous data in the resource library, resulting in the omission of some key information, and the statistical results cannot truly present the overall picture of the resource library, and the statistics are incomplete; on the other hand, in the data processing and statistical links, the algorithm efficiency is low, the processing speed is slow when facing massive data, and the statistical accuracy is easily affected by data noise, and the accuracy is poor; thus, it is difficult to meet the urgent needs of enterprises for real-time and accurate statistical analysis. Summary of the Invention
[0004] In order to overcome the shortcomings of the existing technology, the purpose of the present invention is to provide a method and device for statistics of configuration management resource library information, so as to overcome the problems of incomplete data collection, low processing efficiency and poor accuracy of statistical results in the existing technology, and realize comprehensive, efficient and accurate statistics of configuration management resource library information.
[0005] To achieve the above-mentioned object of the invention, a method for configuring and managing resource library information statistics of the present invention includes: S1: Build an adaptive data collection interface system. Through the preset data collection interface, various configuration information is collected from the configuration management resource library. With the help of the interface adaptation layer, the resource library type is automatically identified and the collection strategy is dynamically adjusted. S2: Uses distributed crawler technology to comprehensively capture software configuration information, hardware configuration parameters, and network topology information in the resource library. It uses an incremental collection mechanism to only collect updated or newly added data, reducing data redundancy and collection burden. S3: Builds a data cleaning model based on machine learning algorithms for collected data, automatically identifies duplicate records, incorrectly formatted data, and missing values, and cleans and corrects the data through feature extraction and pattern recognition. S4: Standardize the cleaned data and convert data from different sources and formats into a standard format that is convenient for subsequent statistical analysis; S5: Build a hierarchical configuration information classification system, dividing configuration information into basic, intermediate, and high-level layers, and using different statistical methods for data at different levels; S6: Generate intuitive, rich, and easy-to-understand visual reports based on statistical results; S7: Build a real-time data monitoring mechanism. When the data in the configuration management resource library changes, it automatically triggers the re-statistics and report update process to ensure that users always have the latest and most accurate statistical information. S8: stores statistical information; S9: Display statistical results.
[0006] Preferably, the adaptive acquisition interface system in S1 is used to be compatible with a variety of common configuration management resource library formats, including relational databases, non-relational databases, and file storage systems in specific formats.
[0007] Preferably, in S5, the basic layer performs simple counting statistics on the models and quantities of hardware devices, the middle layer uses cluster analysis and other methods to perform statistical analysis on the system characteristics formed by the combination of related hardware devices, and the high-level layer constructs complex statistical models to conduct comprehensive statistical evaluation of the performance indicators and stability indicators of the overall IT architecture.
[0008] Preferably, the visual report in S6 supports a variety of chart formats, such as bar charts, line charts, pie charts, and topology charts, and users can customize the report content according to their own needs.
[0009] Preferably, the content of the visualization report in S6 covers statistical data, proportions and trend analysis of various configuration information.
[0010] The present invention also provides a configuration management resource library information statistics device, comprising: Data acquisition module, data cleaning module, classification and statistics module, statistical report generation module, storage module and display module. The data acquisition module is used to perform data acquisition functions. The data cleaning module is used to receive data transmitted by the data acquisition module, clean and verify the data. The classification and statistics module is used to receive data transmitted by the data cleaning module, classify the cleaned data, and perform corresponding statistical calculations on each category. The statistical report generation module is used to receive data transmitted by the classification and statistics module and generate statistical reports in various formats. The storage module is used to receive data transmitted by the statistical report generation module and store the generated report data. The display module is used to receive data transmitted by the storage module and display the generated report.
[0011] Preferably, the data acquisition module integrates an adaptive acquisition interface system and distributed crawler technology, automatically obtains configuration information from the resource library according to the set acquisition rules and frequency, and transmits the collected data to the data cleaning module.
[0012] Preferably, the data cleaning module has built-in data cleaning algorithms and rules, and builds a data cleaning model based on a machine learning algorithm to identify and remove duplicate data, correct erroneous data, and supplement missing data.
[0013] Preferably, the classification statistics module has multiple built-in statistical models and algorithms for completing statistical analysis of various configuration information. Based on the hierarchical configuration information classification system, different statistical methods are used at different levels to transmit the statistical results to the statistical report generation module.
[0014] Preferably, the statistical report generation module has a real-time data monitoring mechanism, which automatically triggers report updates when data changes.
[0015] Compared with the existing technology, the present invention ensures that all kinds of information in the configuration management resource library can be covered by utilizing a multi-source heterogeneous data collection method and the corresponding device modules, avoiding data omissions and making the statistical results more complete and representative. The distributed crawler technology and incremental collection mechanism can significantly improve the data collection speed. The machine learning-driven data cleaning and hierarchical classification statistical methods can greatly improve the data processing and statistical efficiency. The various modules of the device work together to quickly cope with massive data. The data cleaning model can effectively remove data noise and errors. The hierarchical statistical method accurately analyzes the characteristics of data at different levels to ensure the high accuracy of the statistical results. The dynamic update function of the visual report combined with the real-time data monitoring mechanism in the device can enable users to grasp the latest status of the configuration management resource library in real time, providing timely and effective data support for decision-making. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.
[0017] Figure 1 It is a flow chart of the method for configuring and managing resource library information statistics of the present invention.
[0018] Figure 2 It is a structural block diagram of the configuration management resource library information statistics device of the present invention. DETAILED DESCRIPTION
[0019] The technical solutions of this application will be described clearly and completely below with reference to specific embodiments. Obviously, the embodiments described are only a portion of the embodiments of this application, not all of them. All other embodiments derived by persons of ordinary skill in the art based on the embodiments of this application without creative effort are also within the scope of protection of this application.
[0020] like Figure 1 、 Figure 2 As shown, a method for configuring and managing resource library information statistics of the present invention includes: S1: Build an adaptive data collection interface system. Through the preset data collection interface, various configuration information is collected from the configuration management resource library. With the help of the interface adaptation layer, the resource library type is automatically identified and the collection strategy is dynamically adjusted. S2: Uses distributed crawler technology to comprehensively capture software configuration information, hardware configuration parameters, and network topology information in the resource library. It uses an incremental collection mechanism to only collect updated or newly added data, reducing data redundancy and collection burden. S3: Builds a data cleaning model based on machine learning algorithms for collected data, automatically identifying duplicate records, incorrectly formatted data, and missing values. It then cleans and corrects the data through feature extraction and pattern recognition. For example, it uses regular expression matching and semantic analysis to correct incorrect IP address formats and association rule mining to supplement missing hardware device attribute information. S4: Standardize the cleaned data, converting data from different sources and formats into a standard format that facilitates subsequent statistical analysis. For example, standardize software version numbers according to unified semantic rules to facilitate accurate comparison and statistics. S5: Build a hierarchical configuration information classification system, dividing configuration information into basic, intermediate, and high-level layers. Use different statistical methods for data at different levels. The basic layer includes information about individual hardware devices, the intermediate layer includes system information based on hardware device combinations, and the high-level layer includes information about the overall IT architecture. S6: Generate intuitive, rich, and easy-to-understand visual reports based on statistical results; S7: Build a real-time data monitoring mechanism. When the data in the configuration management resource library changes, it automatically triggers the re-statistics and report update process to ensure that users always have the latest and most accurate statistical information. S8: stores statistical information; S9: Display statistical results.
[0021] In this embodiment, the adaptive acquisition interface system in S1 is used to be compatible with a variety of common configuration management resource library formats, including relational databases, non-relational databases, and file storage systems in specific formats; the basic layer in S5 performs simple counting statistics on hardware device models and quantities, and the middle layer uses cluster analysis and other methods to perform statistical analysis on the system characteristics formed by the combination of related hardware devices, such as calculating the resource utilization distribution of different server clusters. The high-level layer constructs complex statistical models to conduct comprehensive statistical evaluation of the performance indicators and stability indicators of the overall IT architecture; the visual report in S6 supports a variety of chart formats, such as bar charts, line charts, pie charts, and topology charts. Users can customize the report content according to their own needs. The visual report content in S6 covers statistical data, proportions, and trend analysis of various configuration information.
[0022] In this embodiment, the implementation steps of the above-mentioned method for configuring resource library information statistics are as follows: Through the adaptive collection interface system, the interface adaptation layer automatically identifies the resource library type, and the distributed crawler is started. According to the set collection frequency, the resource library is fully scanned every morning. The incremental collection mechanism is enabled, and only the data that has changed since the last collection is collected. For example, if a new hard drive is detected in a server, the crawler automatically collects and records the relevant configuration information of the hard drive. A machine learning-based data cleaning model began to clean the collected data. For example, if it discovered that the IP address records of some network devices had format errors, the data cleaning model corrected them through regular expression matching and semantic analysis. For server records with missing production dates, these were supplemented by linking to the device procurement database. The cleaned data was then standardized, with all software version numbers standardized into the "major version, minor version, revision" format. According to the hierarchical classification system, at the basic level, statistics are collected on the number of servers of different models and the number of ports on each type of network device. At the middle level, cluster analysis methods are used to calculate the resource utilization of server clusters in different regions, grouping clusters with similar utilization rates. At the high level, the entire enterprise's IT architecture is comprehensively considered to calculate the overall system availability indicators, failure rates, etc. Visual reports are generated based on the classified statistical results. Operations and maintenance personnel can customize the report content through the company's internal reporting system. For example, a bar chart can be used to display the purchase quantity of various hardware devices in different quarters, and a line chart can be used to display the version update frequency of the software system. When the data in the configuration management resource library changes, such as the addition of a server or the update of a software version, the real-time data monitoring mechanism is triggered to automatically re-execute the data collection, cleaning, statistics and report update processes, ensuring that operations and maintenance personnel and management always have the latest statistical information. Store the generated report data and display the generated reports.
[0023] The present invention provides a configuration management resource library information statistics device comprising: The data acquisition module is used to perform data collection functions. It has multiple data collection interfaces and can adapt to different types of configuration management resource repositories. The data acquisition module integrates an adaptive collection interface system and distributed crawler technology. According to the set collection rules and frequency, it automatically obtains configuration information from the resource repository and transmits the collected data to the data cleaning module, which can realize the efficient collection of multi-source heterogeneous data. The data cleaning module is used to receive data transmitted by the data acquisition module and clean and verify the data. The data cleaning module has built-in data cleaning algorithms and rules, and builds a data cleaning model based on machine learning algorithms to identify and remove duplicate data, correct erroneous data, and supplement missing data to ensure data accuracy and completeness; The classification statistics module is used to receive data transmitted by the data cleaning module, classify the cleaned data, and perform corresponding statistical calculations for each category. The classification statistics module has multiple built-in statistical models and algorithms to complete the statistical analysis of various configuration information. Based on the hierarchical configuration information classification system, different statistical methods are used at different levels, and the statistical results are transmitted to the statistical report generation module; The statistical report generation module is used to receive data transmitted by the classification statistics module and generate statistical reports in various formats. This module supports users to customize the style, content and layout of reports and can generate reports that meet the needs of different users. Reports can be stored in the form of electronic documents and can also be transmitted and shared through the network. The statistical report generation module has a real-time data monitoring mechanism that automatically triggers report updates when data changes; The storage module is used to receive data transmitted by the statistical report generation module and store the generated report data; The display module is used to receive data transmitted by the storage module and display the generated reports.
[0024] Through the above structure, when the configuration management resource library information statistics device provided by the present invention is running, the data acquisition module adopts a high-performance network interface card and data acquisition software, which can quickly and stably collect data from the configuration management resource library. The data cleaning module is based on the big data processing framework, uses multi-threading technology and efficient data cleaning algorithms, and can complete the cleaning of large amounts of data in a short time. The classification statistics module uses a distributed computing architecture and has built-in multiple statistical models and algorithm libraries, which can perform fast and accurate statistical analysis according to different configuration information categories. The statistical report generation module adopts a visual report generation tool and supports the output of multiple report formats. The storage module can stably store the generated report data, and the display module can display the generated reports for easy viewing by personnel.
[0025] The device is deployed in the enterprise's server cluster and a high-speed network connection is established with the server where the configuration management resource library is located. By configuring the device parameters, the frequency of data collection, data cleaning rules, statistical categories, and report generation formats are set. After starting the device, each module works together to automatically complete the statistics and report generation of the configuration management resource library information. For example, the data collection module collects the latest configuration information once an hour, the data cleaning module cleans the data immediately after the collection is completed, the classification statistics module performs statistical analysis based on the cleaned data, and the statistical report generation module generates the latest report after the statistics are completed, and automatically uploads the report to the enterprise's shared folder for relevant personnel to view at any time.
[0026] The above is a detailed introduction to a method and device for configuring resource library information statistics provided by the present application. Specific embodiments are used herein to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method and core idea of the present application. It should be pointed out that for ordinary technicians in this technical field, without departing from the principles of the present application, several improvements and modifications can be made to the present application, and these improvements and modifications also fall within the scope of protection of the claims of the present application.
Claims
1. A method for configuring and managing resource library information statistics, characterized by: include S1: Build an adaptive data collection interface system. Through the preset data collection interface, various configuration information is collected from the configuration management resource library. With the help of the interface adaptation layer, the resource library type is automatically identified and the collection strategy is dynamically adjusted. S2: Uses distributed crawler technology to comprehensively capture software configuration information, hardware configuration parameters, and network topology information in the resource library. It uses an incremental collection mechanism to only collect updated or newly added data, reducing data redundancy and collection burden. S3: Builds a data cleaning model based on machine learning algorithms for collected data, automatically identifies duplicate records, incorrectly formatted data, and missing values, and cleans and corrects the data through feature extraction and pattern recognition. S4: Standardize the cleaned data and convert data from different sources and formats into a standard format that is convenient for subsequent statistical analysis; S5: Build a hierarchical configuration information classification system, dividing configuration information into basic, intermediate, and high-level layers, and using different statistical methods for data at different levels; S6: Generate intuitive, rich, and easy-to-understand visual reports based on statistical results; S7: Build a real-time data monitoring mechanism. When the data in the configuration management resource library changes, it automatically triggers the re-statistics and report update process to ensure that users always have the latest and most accurate statistical information. S8: stores statistical information; S9: Display statistical results.
2. The method for collecting statistics on configuration management resource libraries according to claim 1, characterized in that: The adaptive acquisition interface system in S1 is used to be compatible with a variety of common configuration management resource library formats, including relational databases, non-relational databases, and file storage systems in specific formats.
3. The method for collecting statistics on configuration management resource libraries according to claim 1, characterized in that: In S5, the basic layer performs simple counting statistics on the models and quantities of hardware devices, the middle layer uses cluster analysis methods to perform statistical analysis on the system characteristics formed by the combination of related hardware devices, and the high-level layer constructs complex statistical models to conduct comprehensive statistical evaluation of the performance indicators and stability indicators of the overall IT architecture.
4. The method for collecting statistics on configuration management resource libraries according to claim 1, characterized in that: The visual report in S6 supports a variety of chart formats, such as bar charts, line charts, pie charts, and topology charts, and users can customize the report content according to their own needs.
5. The method for collecting statistics on configuration management resource libraries according to claim 1, characterized in that: The visualization report content in S6 covers the statistical data, proportion and trend analysis of various configuration information.
6. A device for collecting statistics on configuration management resource library information, characterized in that: It includes a data acquisition module, a data cleaning module, a classification and statistics module, a statistical report generation module, a storage module and a display module; the data acquisition module is used to perform data acquisition functions; the data cleaning module is used to receive data transmitted by the data acquisition module, clean and verify the data; the classification and statistics module is used to receive data transmitted by the data cleaning module, classify the cleaned data, and perform corresponding statistical calculations on each category; the statistical report generation module is used to receive data transmitted by the classification and statistics module and generate statistical reports in various formats; the storage module is used to receive data transmitted by the statistical report generation module and store the generated report data; The display module is used to receive data transmitted by the storage module and display the generated report.
7. The configuration management resource library information statistics device according to claim 6, characterized in that: The data acquisition module integrates an adaptive acquisition interface system and distributed crawler technology. According to the set acquisition rules and frequency, it automatically obtains configuration information from the resource library and transmits the collected data to the data cleaning module.
8. The configuration management resource library information statistics device according to claim 6, characterized in that: The data cleaning module has built-in data cleaning algorithms and rules, and builds a data cleaning model based on machine learning algorithms to identify and remove duplicate data, correct erroneous data, and supplement missing data.
9. The configuration management resource library information statistics device according to claim 6, characterized in that: The classification statistics module has built-in multiple statistical models and algorithms for completing statistical analysis of various configuration information. Based on the hierarchical configuration information classification system, different statistical methods are used at different levels to transmit the statistical results to the statistical report generation module.
10. The configuration management resource library information statistics device according to claim 6, characterized in that: The statistical report generation module has a real-time data monitoring mechanism that automatically triggers report updates when data changes.