Network state analysis system and method

Abstract

The invention provides a network state analysis system and method, and the system comprises an information collection module and an information analysis module, the information collection module is connected with a user interface through a first restful interface unit, the information collection module is connected with network equipment through a second restful interface unit, the information collection module is connected with a log collection module, and the log collection module is connected with the user interface through a second restful interface unit. According to the system, the working principle is simple, information interaction and unified display of a user interface and network equipment are completed through a restful interface, and a friendly interaction interface is achieved. According to the method, the workload of network management of network personnel can be greatly reduced, the technical difficulty of network operation and maintenance is reduced, and meanwhile, a function-extensible network operation and maintenance analysis tool can be provided for advanced network management personnel.

Description

Technical Field

[0001] The present application relates to the technical field of network systems, and in particular to a network status analysis system and method. Background Art

[0002] The current network equipment health check system is mainly based on the information collected by the SNMP protocol, or the analysis of the collected network equipment alarm logs, to generate health analysis reports on network equipment and network links. The current model has some inherent shortcomings. For example, the analysis system using the SNMP protocol requires customized adjustments to the MIB information of different manufacturers' equipment, which is not conducive to the update and iteration of network equipment in the network environment; the system based on log analysis relies on the initial judgment of the equipment manufacturer on the log information of each level of network equipment, which has the disadvantages of a large amount of redundancy of low-importance information, unclear marking of high-importance information, and inability to customize alarm information according to user needs.

[0003] The network administrator monitors and analyzes the network working status based on the above system, but it is difficult to flexibly adjust and customize the collection and analysis of system information according to the characteristics of its own network environment. Therefore, it is necessary to design a network status analysis system. Summary of the invention

[0004] The present application provides a network status analysis system and method to solve the problem of high difficulty in network operation and maintenance in the prior art, thereby greatly reducing the workload of network personnel in network management and reducing the technical difficulty of network operation and maintenance.

[0005] The present application provides a network status analysis system, including an information collection module and an information analysis module;

[0006] The information collection module is connected to the user interface via a first restful interface unit;

[0007] The information collection module is connected to the network device via a second restful interface unit;

[0008] The information collection module is connected to the log collection module;

[0009] The log collection module is connected to the information analysis module.

[0010] Preferably, the information collection module includes an information collection server, a background python collection script generation unit, a network device information collection unit, a storage unit, and a collection situation report generation unit. The information collection server is used to customize the information that the user needs to collect; the background python collection script generation unit is used to generate a background python collection script according to the user's selection; the network device information collection unit automatically completes the network device information collection according to the collection time point specified by the user; the storage unit is used to store the network device information; and the collection situation report generation unit is used to generate a collection situation report.

[0011] Preferably, the information analysis module includes a logstash processing unit, an Elastic retrieval unit, and a Kibana display unit, wherein the input end of the logstash processing unit is connected to the log collection module, the output end of the logstash processing unit is connected to the input end of the Elastic retrieval unit, the output end of the Elastic retrieval unit is connected to the input end of the Kibana display unit, and the output end of the Kibana display unit is bidirectionally connected to the user interface; wherein the logstash processing unit is used to complete customized data segmentation; the Elastic retrieval unit is used to complete customized data query; and the Kibana display unit is used to complete customized analysis report generation and display functions.

[0012] Preferably, the log collection module includes a log collection unit and a log upload unit. The log collection unit collects log data of a set collection object; and the log upload unit is used to upload the collected log data.

[0013] Preferably, it further comprises a dynamic configuration unit, wherein the dynamic configuration unit is used to take the log file as the collection object, add the collection object to the collection object list, and set the time interval for log monitoring and the time interval for log collection.

[0014] Preferably, it further comprises a dynamic monitoring unit, wherein the dynamic monitoring unit is used to regularly monitor the collection object list according to the time interval of log monitoring, and remove the collection objects whose collection has been completed from the collection object list.

[0015] Preferably, a method for using a network status analysis system comprises the following steps:

[0016] A. First, the information collection server customizes the information that the user needs to collect, and the background python collection script generation unit is used to generate the background python collection script according to the user's selection;

[0017] B. Afterwards, the network device information is automatically collected and stored according to the collection time specified by the user, and a collection status report is generated;

[0018] C. Then, the customized data segmentation is completed through the logstash processing unit, and the customized data query is completed through the Elastic retrieval unit;

[0019] D. Finally, the customized analysis report generation and display function is completed through the Kibana display unit.

[0020] Beneficial effects:

[0021] (1) The working principle of the present invention is simple. It completes the information interaction and unified display between the user interface and network equipment through the restful interface, and has a relatively friendly interactive interface. The present invention can greatly reduce the workload of network personnel in network management and the technical difficulty of network operation and maintenance. At the same time, it can provide senior network management personnel with a functionally scalable network operation and maintenance analysis tool.

[0022] (2) Based on SNMP protocol collection and syslog log analysis, the present invention adds a customized network device status collection function, allowing network administrators to flexibly formulate information collection of interest according to the characteristics of their own network environment, and at the same time provide network managers with the ability to customize production reports and generate health detection reports, and can generate health trend analysis reports by combining historically collected status information. It has the good effect of improving the ability of refined network management, enriching network management methods, and enabling intelligent network management.

[0023] The above description is only an overview of the technical solution of the embodiment of the present application. In order to more clearly understand the technical means of the embodiment of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the embodiment of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] In order to more clearly illustrate the technical solutions of the embodiments of the present application, a brief introduction will be given below to the drawings required for use in the description of the embodiments. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0025] Figure 1 This is a block diagram of the working principle of the present invention;

[0026] Figure 2 This is a functional block diagram of the log collection module of the present invention;

[0027] Figure 3 It is the work flow chart of the present invention;

[0028] Explanation of the accompanying drawings: information collection module 1, information analysis module 2, first restful interface unit 3, user interface 4, second restful interface unit 5, network device 6, log collection module 7, information collection server 8, background python collection script generation unit 9, network device information collection unit 10, storage unit 11, collection status report generation unit 12, logstash processing unit 13, Elastic retrieval unit 14, Kibana display unit 15, log collection unit 16, log upload unit 17, dynamic configuration unit 18, dynamic monitoring unit 19. DETAILED DESCRIPTION

[0029] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0030] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by technicians in the technical field to which this application belongs; the terms used in the specification of the application are only for the purpose of describing specific embodiments and are not intended to limit this application; the terms "including" and "having" and any variations thereof in the specification, claims and drawings of this application are intended to cover non-exclusive inclusions.

[0031] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase "embodiments" in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0032] The directional words appearing in the following description are all directions shown in the drawings, and do not limit the specific structure of the present application. For example, in the description of the present application, the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise", "axial", "radial", "circumferential" and the like indicate directions or positional relationships based on the directions or positional relationships shown in the drawings, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific direction, be constructed and operated in a specific direction, and therefore cannot be understood as a limitation on the present application.

[0033] In addition, the expressions of indicated directions such as the X direction, the Y direction, and the Z direction used to illustrate the operation and construction of the components of the present embodiment are not absolute but relative, and although these indications are appropriate when the components are in the positions shown in the figures, when these positions change, these directions should be interpreted differently to correspond to the changes.

[0034] In addition, the terms "first", "second", etc. in the specification and claims of this application or the above-mentioned drawings are used to distinguish different objects rather than to describe a specific order, and may explicitly or implicitly include one or more of the features.

[0035] In the description of the present application, it should be noted that, unless otherwise clearly specified and limited, the terms "installed", "connected" and "connected" should be understood in a broad sense. For example, the "connection" or "connection" of a mechanical structure may refer to a physical connection. For example, the physical connection may be a fixed connection, such as a fixed connection through a fixing member, such as a fixed connection through a screw, bolt or other fixing member; the physical connection may also be a detachable connection, such as a mutual snap-on or snap-fit ​​connection; the physical connection may also be an integral connection, such as a connection formed by welding, bonding or integral molding. For those of ordinary skill in the art, the specific meanings of the above terms in the present application can be understood according to specific circumstances.

[0036] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings.

[0037] See also Figure 1-Figure 3 , the present application discloses a network status analysis system, including an information collection module 1 and an information analysis module 2;

[0038] The information collection module 1 is connected to the user interface 4 via the first restful interface unit 3;

[0039] The information collection module 2 is connected to the network device 6 via the second restful interface unit 5;

[0040] The information collection module 1 is connected to the log collection module 7;

[0041] The log collection module 7 is connected to the information analysis module 2 .

[0042] In the present invention, the information collection module 1 includes an information collection server 8, a background python collection script generation unit 9, a network device information collection unit 10, a storage unit 11, and a collection situation report generation unit 12. The information collection server is used to customize the information that the user needs to collect; the background python collection script generation unit is used to generate a background python collection script according to the user's selection; the network device information collection unit automatically completes the network device information collection according to the user's specified collection time point; the storage unit is used to store the network device information; and the collection situation report generation unit is used to generate a collection situation report. The module has built-in common collection commands of multiple network device manufacturers, and at the same time provides users with the function of customizing collection commands for specific network devices to meet the needs of various network environments.

[0043] In the present invention, the information analysis module 2 includes a logstash processing unit 13, an Elastic retrieval unit 14, and a Kibana display unit 15, wherein the input end of the logstash processing unit 13 is connected to the log collection module 7, the output end of the logstash processing unit 13 is connected to the input end of the Elastic retrieval unit 14, the output end of the Elastic retrieval unit 14 is connected to the input end of the Kibana display unit 15, and the output end of the Kibana display unit 15 is bidirectionally connected to the user interface 4; wherein the logstash processing unit is used to complete customized data segmentation; the Elastic retrieval unit is used to complete customized data query; and the Kibana display unit is used to complete customized analysis report generation and display functions. This module can provide a large number of query and report templates for different manufacturers' equipment in combination with daily network operation and maintenance, and supports users to customize query conditions and report templates for specific network equipment and specific network analysis needs.

[0044] In addition, in the present invention, the log collection module 7 includes a log collection unit 16 and a log upload unit 17. The log collection unit 16 collects log data of the set collection object; the log upload unit 17 is used to upload the collected log data; it also includes a dynamic configuration unit 18, the dynamic configuration unit 18 is used to take the log file as the collection object, add the collection object to the collection object list, and set the log monitoring time interval and the log collection time interval; it also includes a dynamic monitoring unit 19, the dynamic monitoring unit 19 is used to regularly monitor the collection object list according to the log monitoring time interval, and remove the collection objects that have been collected from the collection object list.

[0045] The present invention can customize the information to be collected, the indicators to be analyzed, the alarm thresholds of each level, and the output template of the analysis report. It provides a visualization tool for large network managers to analyze the network operation status, discover network operation risks in advance, and optimize the existing network configuration in combination with the managed network architecture and the desired network planning and design.

[0046] Working principle: A method for using a network status analysis system, the method comprising the following steps:

[0047] A. First, the information collection server customizes the information that the user needs to collect, and the background python collection script generation unit is used to generate the background python collection script according to the user's selection;

[0048] B. Afterwards, the network device information is automatically collected and stored according to the collection time specified by the user, and a collection status report is generated;

[0049] C. Then, the customized data segmentation is completed through the logstash processing unit, and the customized data query is completed through the Elastic retrieval unit;

[0050] D. Finally, the customized analysis report generation and display function is completed through the Kibana display unit.

[0051] Based on SNMP protocol collection and syslog log analysis, the invention adds a customized network device status collection function, allowing network administrators to flexibly formulate information collection of interest according to the characteristics of their own network environment, and at the same time provide network managers with the ability to customize production reports and generate health detection reports, and can generate health trend analysis reports by combining historically collected status information. It has the good effect of improving the ability of refined network management, enriching network management methods, and enabling intelligent network management.

[0052] In summary, the working principle of the present invention is simple, and the information interaction and unified display between the user interface and network equipment are completed through the restful interface, which has a relatively friendly interactive interface. The present invention can greatly reduce the workload of network personnel in network management, reduce the technical difficulty of network operation and maintenance, and provide a functionally scalable network operation and maintenance analysis tool for senior network managers.

[0053] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A network status analysis system, characterized in that: It comprises an information collection module (1) and an information analysis module (2); The information collection module (1) is connected to the user interface (4) via a first restful interface unit (3); The information collection module (2) is connected to the network device (6) via the second restful interface unit (5); The information collection module (1) is connected to the log collection module (7); The log collection module (7) is connected to the information analysis module (2).

2. A network status analysis system according to claim 1, characterized in that: The information collection module (1) comprises an information collection server (8), a background python collection script generation unit (9), a network device information collection unit (10), a storage unit (11), and a collection situation report generation unit (12); the information collection server is used to customize the information that the user needs to collect; the background python collection script generation unit is used to generate a background python collection script according to the user's selection; The network device information collection unit automatically completes the network device information collection according to the collection time point specified by the user; the storage unit is used to store the network device information; and the collection situation report generation unit is used to generate a collection situation report.

3. A network status analysis system according to claim 1, characterized in that: The information analysis module (2) comprises a logstash processing unit (13), an Elastic retrieval unit (14), and a Kibana display unit (15); the input end of the logstash processing unit (13) is connected to the log collection module (7); the output end of the logstash processing unit (13) is connected to the input end of the Elastic retrieval unit (14); the output end of the Elastic retrieval unit (14) is connected to the input end of the Kibana display unit (15); and the output end of the Kibana display unit (15) is bidirectionally connected to the user interface (4); wherein the logstash processing unit is used to complete customized data segmentation; the Elastic retrieval unit is used to complete customized data query; and the Kibana display unit is used to complete customized analysis report generation and display functions.

4. A network status analysis system according to claim 1, characterized in that: The log collection module (7) comprises a log collection unit (16) and a log upload unit (17). The log collection unit (16) collects log data of a set collection object; and the log upload unit (17) is used to upload the collected log data.

5. A network status analysis system according to claim 4, characterized in that: It also includes a dynamic configuration unit (18), which is used to use the log file as a collection object, add the collection object to a collection object list, and set the time interval for log monitoring and the time interval for log collection.

6. A network status analysis system according to claim 5, characterized in that: It also comprises a dynamic monitoring unit (19), which is used to regularly monitor the collection object list according to the time interval of log monitoring, and remove the collection objects whose collection has been completed from the collection object list.

7. A method for using the network status analysis system according to claim 1, characterized in that: The method of use includes the following steps: A. First, the information collection server customizes the information that the user needs to collect, and the background python collection script generation unit is used to generate the background python collection script according to the user's selection; B. Afterwards, the network device information is automatically collected and stored according to the collection time specified by the user, and a collection status report is generated; C. Then, the customized data segmentation is completed through the logstash processing unit, and the customized data query is completed through the Elastic retrieval unit; D. Finally, the customized analysis report generation and display function is completed through the Kibana display unit.

Images