Method for generating network link topological graph based on graph technology

Abstract

The invention relates to the field of network topological graphs, in particular to a method for generating a network link topological graph based on a graph technology, which comprises a data acquisition and storage step, a step of acquiring structured data of network equipment in real time, a step of defining an entity relationship, a step of respectively defining the structured data as an entity and a relationship according to an equipment type, and a step of drawing a network link. The method comprises the following steps: drawing a network link topological structure according to entities and relationships in a network link, carrying out network link visual analysis, converting the network link topological structure into a visual network link topological graph, and connecting the network link topological structure by using the entities as association marks. The problem that an existing network link topological graph only supports connection of part of link data and cannot be freely expanded is solved, and the flexibility and accuracy of drawing of the network link topological graph are improved; and moreover, the timeliness and the accuracy of the network link topological graph are enhanced in a mode of acquiring the real-time network equipment data in real time.

Description

Technical Field

[0001] The present invention relates to the field of network topology graphs, and in particular to a method for generating a network link topology graph based on graph technology. Background Art

[0002] In the existing network management field, traditional network link topology map generation often relies on static data and cannot reflect the changes of network links in real time, resulting in poor timeliness and accuracy of network link topology maps. In addition, existing network link topology map generation methods have limitations in customizing entity and relationship names. Since the link data formats and contents on different network devices are different, traditional generation methods are often unable to flexibly adapt to these differences, resulting in the generated network link topology map being unable to truly reflect the actual situation of the network devices. Moreover, existing network link map drawing technology cannot freely expand the drawn network link map and cannot adapt to network changes.

[0003] Therefore, in view of the shortcomings of the prior art, the present invention proposes a method for generating a network link topology map based on graph technology. Summary of the invention

[0004] In view of the deficiencies in the prior art, the purpose of the present invention is to provide a method for generating a network link topology map based on graph technology.

[0005] To achieve the above object, the present invention provides the following technical solutions: A method for generating a network link topology map based on graph technology comprises the following steps: A data collection and storage step, obtaining real-time network device data through a data interface of the network device, converting the network device data into structured data and storing the structured data; An entity relationship definition step, defining the structured data as entities and relationships respectively according to the device type, defining the names of the specific entities and relationships according to the content of the structured data, and configuring them into an entity relationship model; A network link drawing step, extracting the structured data based on the entity relationship model to obtain a plurality of network links, and merging the network links according to the association of the entities to generate a network link topology structure; The network link visualization analysis step constructs the network link topology structure through graph database visualization to generate a visualized network link topology map and backs up a copy of the network link topology map.

[0006] As a further improvement of the present invention, the data acquisition and storage step reads the network device data and parses fields, filters the read data, extracts key fields based on the parsed field results, and structures the network device data based on the key fields to obtain a number of structured data with data tags, and defines them as entities or relationships based on the data tag content.

[0007] As a further improvement of the present invention, the entity relationship definition step conventionally defines the structured data according to common entity types and common relationships in the database, and names the structured data in a customized manner according to the network device type.

[0008] As a further improvement of the present invention, it also includes a network link dynamic update step. When the network device data changes, the network device data is converted and extracted again to obtain several updated network links that are different from the existing network links, and the updated network links are associated with the network link topology structure according to the entity relationship model.

[0009] As a further improvement of the present invention, it also includes a drawing automatic update step, setting an automatic drawing cycle, when the automatic drawing cycle starts, detecting whether there is an updated network link in the network link, if there is an updated network link, associating the updated network link to the network link topology structure, and then redrawing the network link topology map.

[0010] As a further improvement of the present invention, it also includes an automatic backup switching step. When the network link topology map is drawn and automatically updated, the automatic update step enters the background drawing. When the drawing is not completed, the visualization interface displays a copy of the network link topology map. When the drawing is completed, the visualization interface automatically updates and displays the redrawn network link topology map, and backs up the redrawn network link topology map to generate a new copy of the network topology structure map.

[0011] As a further improvement of the present invention, the network link visualization analysis step takes the entity as the starting point of the network link topology map, and generates a network link topology map by connecting the network link topology structure according to the relationship. When there are network link topology structures with the same entity starting point but the end entity names are different, the network link topology map is forked.

[0012] As a further improvement of the present invention, it also includes an entity identification query step, by inputting a query entity name, retrieving a network link topology structure where the query entity name exists, and displaying a network link topology diagram.

[0013] Beneficial effects of the present invention: By using a network link topology map construction method based on dynamic data, real-time updating of the network link topology map can be achieved, thereby improving the timeliness and accuracy of the network link topology map; by customizing entity and relationship names based on link data configured on network devices, the authenticity of the network link topology map is ensured, and the network link topology structure is connected by using entities as association tags, thereby solving the problem that the existing network link topology map only supports the connection of part of the link data and cannot be freely expanded, thereby improving the flexibility and accuracy of drawing the network link topology map; the present invention can also output statistical data of entities and relationships in the network link topology map, and query network links according to entity names, thereby improving the convenience of viewing the network link topology map and improving the efficiency of using the network link topology map. BRIEF DESCRIPTION OF THE DRAWINGS

[0014] Figure 1 It is the overall flow chart of the present invention; Figure 2 It is a schematic diagram of entity relationship definition in the present invention. DETAILED DESCRIPTION

[0015] The present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. The same parts are represented by the same reference numerals. It should be noted that the words "front", "rear", "left", "right", "upper" and "lower" used in the following description refer to directions in the accompanying drawings, and the words "bottom surface" and "top surface", "inner" and "outer" refer to directions toward or away from the geometric center of a specific component, respectively.

[0016] In the current existing network management field, traditional network link topology map generation often relies on static data and cannot reflect the changes of network links in real time, resulting in poor timeliness and accuracy of network link topology maps. In addition, existing network link topology map generation methods have limitations in customizing entity and relationship names. Since the link data formats and contents on different network devices are different, traditional generation methods often cannot flexibly adapt to these differences, resulting in the generated network link topology map being unable to truly reflect the actual situation of the network devices. Moreover, existing network link map drawing technology cannot freely expand the drawn network link map and cannot adapt to network changes. In order to solve the above problems and improve the timeliness and accuracy of the network link topology map; at the same time, the method can also customize the entity and relationship names based on the link data configured on the network device, thereby ensuring the authenticity of the network link topology map. Therefore, the present invention designs such a method for generating a network link topology map based on graph technology, such as Figure 1 shown.

[0017] A method for generating a network link topology map based on graph technology comprises the following steps: The data collection and storage step obtains real-time network equipment data through the data interface of the network equipment to avoid the untimely update of network data in the prior art, draws the network link topology map, converts the network equipment data into structured data and stores it; the data collection and storage step reads the network equipment data and parses the fields, filters the read data to remove invalid data, avoids repeated storage of the same data, extracts key fields according to the results of the parsed fields, and structures the network equipment data according to the key fields to obtain several structured data with data tags, and defines them as entities or relationships according to the content of the data tags. Among them, the network equipment data of the network equipment includes but is not limited to domain name resolution data, resolution records of public IP, mapping data of Huawei Cloud WAF, backtracking data of Huawei Cloud CDN, cloud load balancing data, etc.

[0018] The entity relationship definition step defines the structured data as entities and relationships according to the device type, and defines the names of the specific entities and relationships according to the content of the structured data, such as Figure 2 As shown, and configured as an entity relationship model; the entity relationship definition step, according to the common entity types and common relationships in the database, the structured data is conventionally defined, and when special needs (manually defined naming) arise, the structured data is named in a custom manner according to the network device type, and according to the needs, the custom naming rules are set to realize the editable naming of entities and relationships. Entities and relationships are defined according to different link data on the network device, and an entity and relationship database is configured, wherein common entity names include IP, domain name, SLB, VIP, etc., and common relationship names include resolution, backtracking, forwarding, and access, etc. When performing conventional definitions, the data types and names in the database are automatically matched according to the keywords contained in the data. When customizing, entities and relationships can also be arbitrarily defined through manual operations.

[0019] The network link drawing step extracts the structured data based on the entity relationship model to obtain a number of network links, and merges the network links according to the association of the entities to generate a network link topology structure; for example, when the entities are defined as "domain name" and "IP" in the domain name resolution data, where "IP" is extracted from the resolution address, one or more are supported, and the relationship is defined as "resolution", then a network link of "domain name-[resolution]>IP" will be generated; based on this, the present invention can trigger the manual drawing of a complete network link topology diagram, extract and parse the link data of each network device, and generate the following network link topology structure: The network links can be automatically associated with the same entities through entity identifiers to form a complete network link topology. For example, the network link "a.com-[resolution]>1.1.1.1" is generated through domain name resolution data, and the network link "1.1.1.1-[forwarding]>10.1.1.1" is generated through SLB forwarding data. At this time, the two network links are automatically associated according to the entity identifier "1.1.1.1" (that is, the same address) to form a network link topology structure "a.com-[resolution]>1.1.1.1-[forwarding]>10.1.1.1".

[0020] The step of visualizing and analyzing the network links is to construct the network link topology structure through the visualization of the graph database to generate a visualized network link topology map and back up a copy of the network link topology map. The step of visualizing and analyzing the network links is to use the entity as the starting point of the network link topology map, and to connect the network link topology structure according to the relationship to generate a network link topology map. When the names of the end entities of the network link topology structures with the same entity starting point are different, the network link topology map will be bifurcated. For example, with the domain name or public IP as the entrance, it is forwarded to the backend server through network devices such as CDN, WAF, SLB, VIP, etc. At the same time, the open ports and process information on the server can be associated. For example, one of the links may be the domain name a.com-[distribution]>xxx.a.com-[forwarding]>yyy.b.com-[resolution]>114.114.114.114-[forwarding]>1.1.1.1-[open]>20-[start]>process exe. Of course, if there are multiple addresses in each link, there will be a bifurcation; in this case, when the target network has multiple first-level or second-level domain names, multiple network topology diagrams will be formed. When the end points are the same (that is, when the data converges through the same network device), a complete network link topology diagram is formed. For example, when the two links are "a.com-[distribution]>xxx.a.com->[resolution]111.111.111.111" and "b.com-[distribution]>xxx.b.com-[resolution]>111.111.111.111", a complete network link topology diagram is finally generated; if they do not pass through the same network device, two independent network link topology diagrams are finally generated.

[0021] The advantages of the present invention are as follows: by using a network link topology map construction method based on dynamic data, real-time updating of the network link topology map can be achieved, thereby improving the timeliness and accuracy of the network link topology map; by customizing entity and relationship names based on link data configured on network devices, the authenticity of the network link topology map is ensured, and the network link topology structure is connected by using entities as association tags, thereby solving the problem that the existing network link topology map only supports the connection of part of the link data and cannot be freely expanded, thereby improving the flexibility and accuracy of drawing the network link topology map; the present invention can also output statistical data of entities and relationships in the network link topology map, and query network links according to entity names, thereby improving the convenience of viewing the network link topology map and improving the efficiency of using the network link topology map.

[0022] Specifically, it also includes the step of dynamically updating the network link, establishing a data detection mechanism, detecting data changes by means of data stream processing, and when the network device data changes, re-parse, filter and structure the network device data, extract the updated network link based on the structured data obtained after reprocessing, identify the different parts of the updated network link from the existing network link, and re-associate the part to the network link topology structure as the updated network link; at this time, if an entity or relationship that does not exist in the existing model appears in the updated network link, it is necessary to customize the entity or relationship first, and then replace, expand or delete the network link topology structure. By using the method of dynamically updating the network link, the problem that the network link cannot be updated in real time in the prior art can be solved, the network link topology structure update process is simplified, the efficiency of building the network link topology structure is improved, and the drawing of the network link diagram can be more flexible and efficient.

[0023] Specifically, it also includes the drawing automatic update step, setting the automatic drawing cycle. Since the update frequency of the network link is often low, the automatic drawing update cycle is usually set to 24 hours. When the automatic drawing cycle starts, the system triggers the detection mechanism. The detection mechanism confirms whether there is an updated network link by comparing the current network device data with the data used in the last drawing. If there is an updated network link, the updated network link is associated with the network link topology structure according to the entity relationship model, and then the network link topology map is redrawn by incremental update, the visual interface is updated, and a copy of the network link topology map is displayed before the redrawing is completed. By setting the drawing automatic update, the topology structure of the network link can be detected and updated in time when the network link changes, and the corresponding network link topology map can be updated in time, which improves the timeliness, authenticity and flexibility of the network link topology map drawing method, and by adopting the incremental update method, only the changed part is updated, which can reduce the cost of redrawing and improve the drawing efficiency.

[0024] Specifically, it also includes an automatic backup switching step. When the network link topology map is automatically updated during drawing, the automatic update step enters the background drawing. While the background drawing is in progress, a copy of the last drawn network link topology map can be displayed on the visual interface. After the drawing is completed, it is detected whether the drawing is successful. If the drawing is successful, the visual interface is updated and automatically updated to the redrawn network link topology map. If the drawing fails, error handling can be performed and the copy of the network link topology map of the previous stable version can be rolled back. By setting the automatic backup switching step, it can be ensured that the continuity and availability of the visual interface are maintained when the network link topology map is automatically updated, and when problems occur in the drawing update, it can avoid affecting the use of the current network link topology map, thereby improving the stability of the network link topology map drawing.

[0025] Specifically, it also includes an entity identification query step, setting a query interface in the visual interface, which may include controls such as text boxes, drop-down lists, and buttons, so that users can input and submit queries. When performing a query, the system receives the input entity name as input, and searches the internal data structure to see if there is an entity that matches the query entity name. If a matching entity is found, the network link topology map related to the entity is displayed. By implementing the entity identification query step, a convenient way to retrieve and display the relevant network link topology map is provided, thereby improving the efficiency and convenience of network management.

[0026] The above are only preferred embodiments of the present invention. The protection scope of the present invention is not limited to the above embodiments. All technical solutions under the concept of the present invention belong to the protection scope of the present invention. It should be pointed out that for ordinary technicians in this technical field, some improvements and modifications without departing from the principle of the present invention should also be regarded as the protection scope of the present invention.

Claims

1. A method for generating a network link topology map based on graph technology, characterized in that: The steps include: A data collection and storage step, obtaining real-time network device data through a data interface of the network device, converting the network device data into structured data and storing the structured data; An entity relationship definition step, defining the structured data as entities and relationships respectively according to the device type, defining the names of the specific entities and relationships according to the content of the structured data, and configuring them into an entity relationship model; A network link drawing step, extracting the structured data based on the entity relationship model to obtain a plurality of network links, and merging the network links according to the association of the entities to generate a network link topology structure; The network link visualization analysis step constructs the network link topology structure through graph database visualization to generate a visualized network link topology map and backs up a copy of the network link topology map.

2. According to claim 1, a method for generating a network link topology map based on graph technology is characterized in that: The data collection and storage step reads the network device data and parses fields, filters the read data, extracts key fields based on the parsed field results, and structures the network device data based on the key fields to obtain a number of structured data with data tags, and defines them as entities or relationships based on the data tag content.

3. The method for generating a network link topology map based on graph technology according to claim 1, characterized in that: The entity relationship definition step includes conventionally defining the structured data according to common entity types and common relationships in the database.

4. The method for generating a network link topology map based on graph technology according to claim 1, characterized in that: The entity relationship definition step also includes naming the structured data in a customized manner according to the network device type.

5. The method for generating a network link topology map based on graph technology according to claim 1, characterized in that: It also includes a network link dynamic update step. When the network device data changes, the network device data is converted and extracted again to obtain several updated network links different from the existing network links, and the updated network links are associated with the network link topology structure according to the entity relationship model.

6. The method for generating a network link topology map based on graph technology according to claim 5, characterized in that: The method also includes a drawing automatic update step, setting an automatic drawing cycle, and when the automatic drawing cycle starts, detecting whether there is an updated network link in the network link, and if there is an updated network link, associating the updated network link with the network link topology structure, and then redrawing the network link topology map.

7. The method for generating a network link topology map based on graph technology according to claim 6, characterized in that: It also includes an automatic backup switching step. When the network link topology map is drawn and automatically updated, the automatic update step enters the background drawing. When the drawing is not completed, the visualization interface displays a copy of the network link topology map. When the drawing is completed, the visualization interface automatically updates and displays the redrawn network link topology map, and backs up the redrawn network link topology map to generate a new copy of the network topology structure map.

8. The method for generating a network link topology map based on graph technology according to claim 1, characterized in that: The network link visualization analysis step takes the entity as the starting point of the network link topology map, and generates a network link topology map by connecting the network link topology structure according to the relationship. When there are network link topology structures with the same entity starting point but different end entity names, the network link topology map is forked.

9. The method for generating a network link topology map based on graph technology according to claim 1, characterized in that: The method also includes an entity identification query step, in which a network link topology structure having the query entity name is retrieved by inputting the query entity name, and a network link topology diagram is displayed.

Images