Communication link visualization method, device, equipment, medium and program product
By obtaining the communication connection data between the system and the collection of the system, and combined with the visualization of the diagram database component, the problem of complex connection between the association between the system and the low data timeliness, the accurate visualization and fault quickly positioning the communication relationship between the systems are realized. Essence
Patent Information
- Application Number
- CN202411283993.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-13
- Publication Date
- 2025-01-24
- Estimated Expiration
- 2044-09-13
AI Technical Summary
When operating and maintaining a large system group, the relationship between each system is complex and changes in real time, resulting in the existing configuration management system relying on manual sorting, poor data quality and low timeliness.
By obtaining the system correspondence between the running node and the reverse proxy node and the system on the server side, collecting the communication connection data of the service node, obtaining the service configuration file, and combining the graph database component to image the communication link relationship data, and generate the communication Link diagram.
The accurate visualization of communication relationship between the system is realized, the communication link relationship data is updated in a timely manner, the communication relationship between the systems and the service node is visually displayed, and the operation and maintenance personnel can quickly discover the fault and deal with it.
Smart Images

Figure CN119363596A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of computer technology or financial technology, and more specifically to a communication link visualization method, device, equipment, medium and program product. Background Art
[0002] When operating and maintaining a large group of systems, the relationship between the systems is particularly important for system operation status analysis and fault impact analysis in the operation and maintenance work. However, the relationship between the systems is often complicated and often changes in real time with the business. In related technologies, conventional configuration management systems often only store system-related attribute information. The relationship between systems needs to be manually sorted, input, and maintained by operation and maintenance personnel, resulting in poor data quality and low timeliness. Summary of the invention
[0003] In view of the above problems, the present disclosure provides a communication link visualization method, apparatus, device, medium and program product.
[0004] According to a first aspect of the present disclosure, a communication link visualization method is provided, which is applied to a server, wherein the server includes multiple systems, the system includes multiple service nodes, the service nodes include running nodes and reverse proxy nodes, and the reverse proxy nodes are used to forward requests to the running nodes, including: respectively obtaining the system correspondence between the running nodes and the reverse proxy nodes and the systems; respectively collecting the communication connection data of the service nodes based on a preset collection frequency to obtain the communication connection data within a preset time period, the communication connection data including the target IP address of the service node corresponding to the data receiving end and the source IP address of the service node corresponding to the data sending end; obtaining the service configuration file of the reverse proxy node, the service configuration file including the proxy mapping relationship between the running node and the reverse proxy node; obtaining the communication link relationship data within the preset time period based on the communication connection data, the service configuration file and the system correspondence, the communication link relationship data including the communication link data between the multiple systems and the communication link data between the multiple service nodes; calling the graph database component to perform image visualization on the communication link relationship data to obtain a communication link graph.
[0005] According to an embodiment of the present disclosure, the communication link relationship data within a preset time period is obtained based on the communication connection data, the service configuration file and the system correspondence, including: in a case where the target IP address and the source IP address of the communication connection data correspond to IP addresses in the same system in the system correspondence, the communication connection data is determined as intra-system communication connection data; in a case where the target IP address and the source IP address of the communication connection data correspond to IP addresses in different systems in the system correspondence, the communication connection data is determined as inter-system communication connection data; the intra-system communication link relationship data within a preset time period is obtained based on the intra-system communication connection and the service configuration file; and the inter-system communication link relationship data is obtained based on all the inter-system communication connection data.
[0006] According to an embodiment of the present disclosure, the above method also includes: obtaining service registration data, the above service registration data includes a service identifier, a service instance IP address and a listening port number; and obtaining second communication link relationship data within a preset time period based on the above communication connection data and the above service registration data.
[0007] According to an embodiment of the present disclosure, the above-mentioned second communication link relationship data includes a communication link between services and a communication link between service instances, the above-mentioned service identifier and the above-mentioned service instance IP address have a service instance mapping relationship, and the above-mentioned second communication link relationship data within a preset time period is obtained based on the above-mentioned communication connection data and the above-mentioned service registration data, including: when the service instance IP address of the above-mentioned communication connection data is equal to the above-mentioned target IP address and / or the above-mentioned source IP address of the above-mentioned communication connection data, the above-mentioned communication link between service instances is obtained based on the above-mentioned service registration data and the above-mentioned communication connection data; the above-mentioned communication link between services is obtained based on the communication link between service instances and the above-mentioned service instance mapping relationship.
[0008] According to an embodiment of the present disclosure, the above-mentioned second communication link relationship data includes a communication link between services and a communication link between service instances, the above-mentioned service identifier and the above-mentioned service instance IP address have a service instance mapping relationship, and the above-mentioned second communication link relationship data within a preset time period is obtained based on the above-mentioned communication connection data and the above-mentioned service registration data, including: when the service instance IP address of the above-mentioned communication connection data is equal to the above-mentioned target IP address and / or the above-mentioned source IP address of the above-mentioned communication connection data, the above-mentioned communication link between service instances is obtained based on the above-mentioned service registration data and the above-mentioned communication connection data; the above-mentioned communication link between services is obtained based on the communication link between service instances and the above-mentioned service instance mapping relationship.
[0009] According to an embodiment of the present disclosure, the above-mentioned communication connection data also includes a communication connection status, and the above-mentioned communication link between the service instances is obtained based on the above-mentioned service registration data and the above-mentioned communication connection data, including: determining the communication connection data whose communication connection status is not a disconnected state as candidate communication connection data; and obtaining the communication link between the above-mentioned service instances based on the mapping relationship between the above-mentioned candidate communication connection data and the above-mentioned service instances.
[0010] A second aspect of the present disclosure provides a communication link visualization device, the device is installed on a server, the server includes multiple systems, the system includes multiple service nodes, the service nodes include operation nodes and reverse proxy nodes, the reverse proxy nodes are used to forward requests to the operation nodes, the device includes: an acquisition module, used to respectively acquire the system correspondence between the operation nodes and the reverse proxy nodes and the system;
[0011] A collection module is used to collect the communication connection data of the above-mentioned service nodes based on a preset collection frequency, and obtain the communication connection data within a preset time period. The above-mentioned communication connection data includes the target IP address of the above-mentioned service node corresponding to the data receiving end and the source IP address of the above-mentioned service node corresponding to the data sending end; a service configuration file acquisition module is used to obtain the service configuration file of the above-mentioned reverse proxy node, and the above-mentioned service configuration file includes the proxy mapping relationship between the above-mentioned running node and the above-mentioned reverse proxy node; a communication link relationship calculation module is used to obtain the communication link relationship data within a preset time period based on the above-mentioned communication connection data, the above-mentioned service configuration file and the above-mentioned system correspondence relationship. The above-mentioned communication link relationship data includes the communication link data between multiple systems and the communication link data between multiple service nodes; a visualization module is used to call the graph database component to perform image visualization on the above-mentioned communication link relationship data to obtain a communication link graph.
[0012] According to an embodiment of the present disclosure, the communication link relationship calculation module includes: an intra-system communication connection data determination submodule, which is used to determine the communication connection data as intra-system communication connection data when the target IP address and the source IP address of the communication connection data correspond to IP addresses in the same system in the system correspondence relationship; an inter-system communication connection data determination submodule, which is used to determine the communication connection data as inter-system communication connection data when the target IP address and the source IP address of the communication connection data correspond to IP addresses in different systems in the system correspondence relationship; an intra-system communication link relationship data calculation submodule, which is used to obtain the intra-system communication link relationship data within a preset time period based on the intra-system communication connection and the service configuration file;
[0013] The inter-system communication link relationship data calculation submodule is used to obtain the inter-system communication link relationship data based on all the inter-system communication connection data mentioned above.
[0014] According to an embodiment of the present disclosure, the above-mentioned device also includes: a service registration data acquisition module, used to obtain service registration data, the above-mentioned service registration data includes a service identifier, a service instance IP address and a listening port number; a second communication link relationship data calculation module, used to obtain the second communication link relationship data within a preset time period based on the above-mentioned communication connection data and the above-mentioned service registration data.
[0015] According to an embodiment of the present disclosure, the above-mentioned second communication link relationship data includes an inter-service communication link and an inter-service instance communication link, the above-mentioned service identifier and the above-mentioned service instance IP address have a service instance mapping relationship, and the above-mentioned second communication link relationship data calculation module includes: an inter-service instance communication link calculation sub-module, which is used to obtain the above-mentioned inter-service instance communication link based on the above-mentioned service registration data and the above-mentioned communication connection data when the service instance IP address of the above-mentioned communication connection data is equal to the above-mentioned target IP address and / or the above-mentioned source IP address of the above-mentioned communication connection data; an inter-service communication link calculation sub-module, which is used to obtain the above-mentioned inter-service communication link based on the inter-service instance communication link and the above-mentioned service instance mapping relationship.
[0016] According to an embodiment of the present disclosure, the communication connection data further includes a communication connection identifier, and the device further includes: an inter-socket communication link calculation module, which is used to obtain the inter-socket communication link based on the communication connection identifier and the communication link between the IP addresses.
[0017] According to an embodiment of the present disclosure, the above-mentioned communication connection data also includes a communication connection status, and the above-mentioned communication link calculation submodule between service instances includes: a candidate communication connection data determination unit, which is used to determine the communication connection data whose communication connection status is not a disconnected state as candidate communication connection data; and a communication link determination unit between service instances, which is used to obtain the communication link between the above-mentioned service instances based on the mapping relationship between the above-mentioned candidate communication connection data and the above-mentioned service instances.
[0018] A third aspect of the present disclosure provides an electronic device, comprising: one or more processors; and a memory for storing one or more computer programs, wherein the one or more processors execute the one or more computer programs to implement the steps of the above method.
[0019] The fourth aspect of the present disclosure further provides a computer-readable storage medium on which a computer program or instruction is stored, and the steps of the above method are implemented when the above computer program or instruction is executed by a processor.
[0020] The fifth aspect of the present disclosure further provides a computer program product, including a computer program or instructions, which implement the steps of the above method when the above computer program or instructions are executed by a processor.
[0021] According to the embodiments of the present disclosure, the communication connection data of the service nodes are collected at a preset collection frequency, and the system correspondence and service configuration files between the running nodes, reverse proxy nodes and the system are obtained, so as to obtain the communication link relationship data that can characterize the communication relationship between the systems and the communication link relationship data of the communication relationship between multiple service nodes. The communication link relationship data is visualized through the graph database component, so that the communication relationship between the system and the running nodes can be obtained more accurately, the communication link relationship data can be updated in time and displayed in the form of a communication link graph, which can intuitively display the communication relationship between each system and service node, and can help operation and maintenance personnel quickly discover fault location problems in the system and handle them. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] The above contents and other objects, features and advantages of the present disclosure will become more apparent through the following description of the embodiments of the present disclosure with reference to the accompanying drawings, in which:
[0023] Figure 1 The application scenario diagram of the communication link visualization method and device according to the embodiment of the present disclosure is schematically shown;
[0024] Figure 2 A flow chart of a communication link visualization method according to an embodiment of the present disclosure is schematically shown;
[0025] Figure 3 A schematic diagram of a communication link between systems according to an embodiment of the present disclosure is shown;
[0026] Figure 4 A schematic diagram schematically shows a visual display of system association relationships according to an embodiment of the present disclosure;
[0027] Figure 5 The structure block diagram of the communication link visualization device according to the embodiment of the present disclosure is schematically shown;
[0028] Figure 6 A block diagram of an electronic device suitable for implementing a communication link visualization method according to an embodiment of the present disclosure is schematically shown. DETAILED DESCRIPTION
[0029] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. However, it should be understood that these descriptions are exemplary only and are not intended to limit the scope of the present disclosure. In the following detailed description, for ease of explanation, many specific details are set forth to provide a comprehensive understanding of the embodiments of the present disclosure. However, it is apparent that one or more embodiments may also be implemented without these specific details. In addition, in the following description, descriptions of known structures and technologies are omitted to avoid unnecessary confusion of the concepts of the present disclosure.
[0030] The terms used herein are only for describing specific embodiments and are not intended to limit the present disclosure. The terms "comprise", "include", etc. used herein indicate the existence of the features, steps, operations and / or components, but do not exclude the existence or addition of one or more other features, steps, operations or components.
[0031] All terms (including technical and scientific terms) used herein have the meanings commonly understood by those skilled in the art unless otherwise defined. It should be noted that the terms used herein should be interpreted as having a meaning consistent with the context of this specification and should not be interpreted in an idealized or overly rigid manner.
[0032] When using expressions such as "at least one of A, B, and C, etc.", they should generally be interpreted according to the meaning of the expression commonly understood by those skilled in the art (for example, "a system having at least one of A, B, and C" should include but is not limited to a system having A alone, B alone, C alone, A and B, A and C, B and C, and / or A, B, C, etc.).
[0033] It should be noted that in the embodiments of the present application, certain software, components, models and other existing solutions in the industry may be mentioned, and they should be regarded as exemplary. Their purpose is only to illustrate the feasibility of implementing the technical solution of the present application, but it does not mean that the applicant has or will necessarily use the solution.
[0034] In the technical solution of the present disclosure, the user information (including but not limited to user personal information, user image information, user device information, such as location information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved are all information and data authorized by the user or fully authorized by all parties, and the collection, storage, use, processing, transmission, provision, disclosure and application of the relevant data comply with relevant laws, regulations and standards, take necessary confidentiality measures, do not violate public order and good morals, and provide corresponding operation entrances for users to choose to authorize or refuse.
[0035] In the scenario of using personal information for automated decision-making, the methods, devices, and systems provided by the embodiments of the present disclosure provide users with corresponding operation portals for users to choose to agree or reject the automated decision-making results; if the user chooses to reject, the expert decision-making process will be entered. The expression "automated decision-making" here refers to the activity of automatically analyzing and evaluating a person's behavioral habits, interests and hobbies, or economic, health, credit status, etc. through computer programs, and making decisions. The expression "expert decision-making" here refers to the activity of making decisions by people who specialize in a certain field, have specialized experience, knowledge and skills, and have reached a certain level of professionalism.
[0036] In the operation and maintenance of a large number of systems, the relationship between each system is crucial for the system's operating status analysis and fault impact analysis. However, the relationship between these systems is usually complicated and changes in real time with the development of the business. In this case, it is very difficult for operation and maintenance personnel to manually sort out and understand these relationships, and it is difficult to grasp the overall picture of the system. In addition, if only operation and maintenance personnel manually sort out, input, and maintain data, the data quality is poor and the timeliness is low.
[0037] In view of this, an embodiment of the present disclosure provides a communication link visualization method, which is applied to a server, the server includes multiple systems, the system includes multiple service nodes, the service nodes include running nodes and reverse proxy nodes, the reverse proxy nodes are used to forward requests to the running nodes, and the method includes: respectively obtaining the system correspondence between the running nodes and the reverse proxy nodes and the system; respectively collecting the communication connection data of the service nodes based on a preset collection frequency, and obtaining the communication connection data within a preset time period, the communication connection data including the target IP address of the service node corresponding to the data receiving end and the source IP address of the service node corresponding to the data sending end; obtaining the service configuration file of the reverse proxy node, the service configuration file including the proxy mapping relationship between the running node and the reverse proxy node; obtaining the communication link relationship data within the preset time period based on the communication connection data, the service configuration file and the system correspondence, the communication link relationship data including the communication link data between multiple systems and the communication link data between multiple service nodes; calling the graph database component to perform image visualization on the communication link relationship data to obtain a communication link graph.
[0038] Figure 1 The application scenario diagram of the communication link visualization method and device according to the embodiments of the present disclosure is schematically shown.
[0039] like Figure 1As shown, the application scenario 100 according to this embodiment may include a first terminal device 101, a second terminal device 102, a third terminal device 103, a network 104, and a server 105. The network 104 is used to provide a medium for a communication link between the first terminal device 101, the second terminal device 102, the third terminal device 103, and the server 105. The network 104 may include various connection types, such as wired, wireless communication links, or optical fiber cables, etc.
[0040] The user can use the first terminal device 101, the second terminal device 102, and the third terminal device 103 to interact with the server 105 through the network 104 to receive or send messages, etc. Various communication client applications can be installed on the first terminal device 101, the second terminal device 102, and the third terminal device 103, such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, social platform software, etc. (only for example).
[0041] The first terminal device 101, the second terminal device 102, and the third terminal device 103 may be various electronic devices having display screens and supporting web browsing, including but not limited to smart phones, tablet computers, laptop computers, desktop computers, and the like.
[0042] The server 105 may be a server that provides various services, such as a background management server (only as an example) that provides support for websites browsed by users using the first terminal device 101, the second terminal device 102, and the third terminal device 103. The background management server may analyze and process the received data such as user requests, and feed back the processing results (such as web pages, information, or data obtained or generated according to user requests) to the terminal device.
[0043] It should be noted that the communication link visualization method provided in the embodiment of the present disclosure can generally be executed by the server 105. Accordingly, the communication link visualization device provided in the embodiment of the present disclosure can generally be set in the server 105. The communication link visualization method provided in the embodiment of the present disclosure can also be executed by a server or server cluster that is different from the server 105 and can communicate with the first terminal device 101, the second terminal device 102, the third terminal device 103 and / or the server 105. Accordingly, the communication link visualization device provided in the embodiment of the present disclosure can also be set in a server or server cluster that is different from the server 105 and can communicate with the first terminal device 101, the second terminal device 102, the third terminal device 103 and / or the server 105.
[0044] It should be understood that Figure 1The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to the implementation requirements.
[0045] The following will be based on Figure 1 The scene described by Figure 2~Figure 4 The communication link visualization method of the embodiment of the present disclosure is described in detail.
[0046] Figure 2 The flowchart of the communication link visualization method according to the embodiment of the present disclosure is schematically shown.
[0047] like Figure 2 As shown, the communication link visualization method of this embodiment includes operations S210 to S250.
[0048] According to an embodiment of the present disclosure, the above method is applied to a server, which includes multiple systems, the systems include multiple service nodes, the service nodes include running nodes and reverse proxy nodes, and the reverse proxy nodes are used to forward requests to the running nodes.
[0049] In operation S210, system correspondences between the running node and the reverse proxy node and the system are respectively obtained.
[0050] According to an embodiment of the present disclosure, the above-mentioned multiple systems may include a cloud management platform, and the system correspondence relationship may be stored in the cloud management platform.
[0051] Exemplarily, the system correspondence may be: running node a1: IP address is 10.16.0.1, belonging to system A; reverse proxy node b1: IP address is 10.16.0.2, belonging to system B.
[0052] In operation S220, communication connection data of the service nodes are collected respectively based on a preset collection frequency to obtain communication connection data within a preset time period.
[0053] The communication connection data includes a target IP address of a service node corresponding to a data receiving end and a source IP address of a service node corresponding to a data sending end.
[0054] According to the embodiment of the present disclosure, an agent may be installed on each service node to automatically collect communication connection data, and the agent may collect network connection data at the bottom layer of the operating system.
[0055] According to an embodiment of the present disclosure, the preset acquisition frequency may be, for example, 1 minute, 1 hour, etc. The preset time period may be, for example, 1 second, 10 seconds, 20 seconds, 1 minute, etc., and the present disclosure does not limit this.
[0056] Exemplarily, the agent on each service node may collect the communication connection data of the service node within 1 second every 1 minute.
[0057] According to an embodiment of the present disclosure, the above-mentioned communication connection data may also include a target port number of a service node corresponding to the data receiving end and a source port number corresponding to the data sending end.
[0058] In operation S230, a service configuration file of the reverse proxy node is obtained.
[0059] The service configuration file includes the proxy mapping relationship between the running node and the reverse proxy node.
[0060] According to the embodiment of the present disclosure, to obtain the service configuration file, the service running location may be scanned first, and then the directory where the service configuration file is located may be scanned, and the corresponding service configuration file may be obtained after parsing the configuration file.
[0061] According to an embodiment of the present disclosure, the above-mentioned service configuration file may include a listening port number, a service name, and a proxy mapping relationship between a running node and a reverse proxy node, wherein the proxy mapping relationship corresponds to, for example, partial data of a received request, and forwards it to a corresponding proxy node.
[0062] For example, for a request with a suffix of " / edu / ", it can be forwarded to a running node with an IP address of "http: / / 10.32.2.161:8080"; for a request with a suffix of " / vod / ", it can be forwarded to a running node with an IP address of "http: / / 10.32.2.201:80".
[0063] In operation S240, communication link relationship data within a preset time period is obtained based on the communication connection data, the service configuration file, and the system correspondence.
[0064] The communication link relationship data includes communication link data between multiple systems and communication link data between multiple service nodes.
[0065] According to the embodiment of the present disclosure, the data communication link relationship can be obtained by integrating the communication connection data, the service configuration file and the system correspondence relationship.
[0066] The following Table 1 schematically shows a data communication link relationship table of a reverse proxy node according to an embodiment of the present disclosure.
[0067] Table 1
[0068]
[0069] Among them, srcSocketID represents the socket corresponding to the communication connection data between the running node and the reverse proxy, tgtSocketID represents the socket corresponding to the communication connection data between the reverse proxy node and the system external service node, and relName represents the communication link relationship data that the communication link relationship belongs to the reverse proxy.
[0070] In operation S250, the graph database component is called to visualize the communication link relationship data to obtain a communication link graph.
[0071] According to the embodiments of the present disclosure, the above-mentioned graph database may be a native graph database or a non-native graph database, and the present application does not impose any limitation on this.
[0072] According to the embodiments of the present disclosure, the communication link relationship data may be stored in a graph database in the form of a graph, and a communication link graph may be generated based on the graph database and displayed to the target user when the user views the graph.
[0073] According to an embodiment of the present disclosure, different parameters can be passed in when calling a graph database component for image visualization to generate communication link graphs of different levels, for example, communication link graphs between systems and communication link graphs between service nodes can be generated.
[0074] Figure 3 A communication link diagram between systems according to an embodiment of the present disclosure is schematically shown.
[0075] like Figure 3 As shown, system A sends requests to system B, system C, and system D respectively; system B sends a request to system D, and system C and system D send requests to each other.
[0076] According to the embodiments of the present disclosure, the communication connection data of the service nodes are collected at a preset collection frequency, and the system correspondence and service configuration files between the running nodes, reverse proxy nodes and the system are obtained, so as to obtain the communication link relationship data that can characterize the communication relationship between the systems and the communication link relationship data of the communication relationship between multiple service nodes. The communication link relationship data is visualized through the graph database component, so that the communication relationship between the system and the running nodes can be obtained more accurately, the communication link relationship data can be updated in time and displayed in the form of a communication link graph, which can intuitively display the communication relationship between each system and service node, and can help operation and maintenance personnel quickly discover fault location problems in the system and handle them.
[0077] According to an embodiment of the present disclosure, the communication link relationship data within a preset time period is obtained based on the communication connection data, the service configuration file and the system correspondence, including: when the target IP address and the source IP address of the communication connection data correspond to IP addresses in the same system in the system correspondence, the communication connection data is determined as intra-system communication connection data; when the target IP address and the source IP address of the communication connection data correspond to IP addresses in different systems in the system correspondence, the communication connection data is determined as inter-system communication connection data; the intra-system communication link relationship data within a preset time period is obtained based on the intra-system communication connection and the service configuration file; and the inter-system communication link relationship data is obtained based on all inter-system communication connection data.
[0078] For example, the following data is taken as an example, where the system correspondence is: running node a1: IP address is 10.16.0.1, belonging to system A; running node a2: IP address is 10.16.0.2, belonging to system B; reverse proxy node b1: IP address is 10.16.0.3, belonging to system B; the target IP address in the collected communication connection data s1 is 10.16.0.3 and the source IP address is 10.16.0.1, and the target IP address in the collected communication connection data s2 is 10.16.0.2 and the source IP address is 10.16.0.3; the service configuration file is for For requests with the suffix / edu / , the reverse proxy node b1 will forward them to the running node with the IP address "10.16.0.2". Then, based on the target IP address, source IP address and system correspondence in the communication connection data, it can be determined that the communication connection data s2 between the running node a2 and the reverse proxy node b1 is the intra-system communication connection data, and the communication connection data s1 between the running node a1 and the reverse proxy node b1 is the inter-system communication connection data. Then, based on s2 and the service configuration file, the intra-system communication link relationship data can be determined, and the inter-system communication link data can be determined based on all inter-system communication connection data.
[0079] According to the embodiments of the present disclosure, the intra-system communication connection data and the inter-system communication connection data are respectively determined by the target IP address and the source IP address of the communication connection data, the intra-system communication link relationship data are obtained based on the service configuration file, and the inter-system communication link relationship data are obtained based on all the inter-system communication connection data. The communication connection between each node in the system can be clearly tracked, which is convenient for troubleshooting and locating problems. Further, the system operation status can be monitored to improve the system stability.
[0080] According to an embodiment of the present disclosure, the above method also includes: obtaining service registration data, the service registration data including a service identifier, a service instance IP address and a listening port number; and obtaining second communication link relationship data within a preset time period based on the communication connection data and the service registration data.
[0081] According to an embodiment of the present disclosure, the above service registration data may be stored in a registration center, which includes a variety of service registration data. For a service, there may be multiple service nodes running the service, and each service node running the service may be called a service instance.
[0082] According to an embodiment of the present disclosure, the above-mentioned second communication link relationship data includes a communication link between services and a communication link between service instances, and the service identifier and the service instance IP address have a service instance mapping relationship. The second communication link relationship data within a preset time period is obtained based on the communication connection data and the service registration data, including: when the service instance IP address of the communication connection data is equal to the target IP address and / or source IP address of the communication connection data, the communication link between service instances is obtained based on the service registration data and the communication connection data; and the communication link between services is obtained based on the communication link between service instances and the service instance mapping relationship.
[0083] According to an embodiment of the present disclosure, the communication connection data also includes a target port number and a source port number. When it is determined that the service instance IP address of the communication connection data and the target IP address and / or source IP address of the communication connection data are equal, it can be determined whether the communication connection data is inter-service communication connection data based on the service listening port number and the target port number and source port number in the communication connection data.
[0084] For example, for a service whose service instance IP is 10.32.2.32 and whose listening port number is 63626 in the service registration data, if the target IP address or source IP address of the communication connection data is equal to the service instance IP address, it is possible to further determine whether it is a communication link between service instances based on the target port number and the source port number.
[0085] According to an embodiment of the present disclosure, after determining the communication link between service instances, the communication link between services can be obtained based on the service instance mapping relationship. For example, after determining that service instance c1 serves service node a1, service instance c2 serves service node a2, and service instance c3 serves service node a3, according to the service instance mapping relationship, c1 and c3 belong to service A, and c2 belongs to service B, then it can be obtained that service A serves service nodes a1 and a3, and service B serves service node a2.
[0086] According to the embodiments of the present disclosure, by obtaining service registration data and determining the communication link between service instances based on the communication connection data and the service registration data, operation and maintenance personnel can perform intelligent load distribution based on the communication link between service instances to optimize resource utilization. Furthermore, the communication link between services is obtained through the service instance mapping relationship, and the overall operating status of the service can be monitored.
[0087] According to an embodiment of the present disclosure, the above-mentioned communication connection data also includes a communication connection identifier, and the method further includes: obtaining the communication link between sockets based on the communication connection identifier and the communication link between IP addresses.
[0088] Table 2 below schematically shows the socket communication connection structure data according to an embodiment of the present disclosure.
[0089] Table 2
[0090]
[0091] Among them, socketID is the communication connection identifier. There is a communication connection identifier for each communication connection data. IP is the specific IP address bound to the socket. Port is the port bound to the socket. There can be multiple sockets for a service node, and the multiple sockets are respectively bound to different ports of the service node.
[0092] Table 3 schematically shows the communication connection data structure data according to an embodiment of the present disclosure.
[0093] Table 3
[0094]
[0095] Among them, srcSocketID represents the source sockeID, indicating that the request is made by the object corresponding to the source SocketID, tgtSocketID represents the target socketID, indicating that the request is made to the object corresponding to the target socketID, and relName indicates that the communication link relationship belongs to the communication link relationship data of the request.
[0096] According to an embodiment of the present disclosure, the above-mentioned communication connection data also includes a communication connection status, and obtaining a communication link between service instances based on the service registration data and the communication connection data includes: determining communication connection data whose communication connection status is not a disconnected state as candidate communication connection data; and obtaining the communication link between service instances based on a mapping relationship between the candidate communication connection data and the service instance.
[0097] Table 4 schematically shows communication connection data according to an embodiment of the present disclosure.
[0098] Table 4
[0099]
[0100] Among them, the communication connection status indicates the TCP connection status, including LISTEN (listening) state, ESTABLISHED (established) state and CLOSED (closed) state, among which LISTEN means that the corresponding service node opens a socket for listening to listen for connection requests from other service node ports; ESTABLISHED means an open connection, and the two parties of the connection can or are already exchanging data; CLOSED means that the service node enters the closed state after receiving the ACK (confirmation) packet, that is, the connection ends and there is no connection state.
[0101] According to the embodiment of the present disclosure, by screening communication connection data whose communication connection status is not disconnected as candidate communication connection data, and further obtaining the communication link between service instances based on the mapping relationship between the candidate communication connection data and the service instance, efficiency can be improved and server computing time can be reduced.
[0102] Figure 4 A schematic diagram schematically shows a visual display of system association relationships according to an embodiment of the present disclosure.
[0103] like Figure 4 As shown, by aggregating communication connection data, service configuration files, service registration data, system correspondence data and other data, the relationship data can be enriched. The following Table 5 schematically shows the IP host relationship data; Table 6 schematically shows the host system relationship data; Table 7 schematically shows the Socket service relationship data.
[0104] Table 5
[0105]
[0106] Table 6
[0107]
[0108] Among them, IPID is the ID corresponding to the IP address, hostID is the ID corresponding to the host, systemID is the ID corresponding to the system, and relName indicates the relationship between the IP and the host, and the relationship between the host and the system.
[0109] Table 7
[0110]
[0111] Among them, socketID represents the ID corresponding to the socket, serviceID represents the ID corresponding to the service, and relName represents the relationship between the socket and the service, that is, the socket is used to provide the service.
[0112] According to the embodiments of the present disclosure, the inter-system association relationships at the system level, host level, service level, and socket level can be displayed according to needs, and the corresponding communication link diagrams can be displayed in sequence according to the data relationship.
[0113] Based on the above communication link visualization method, the present disclosure also provides a communication link visualization device. Figure 5 The device is described in detail.
[0114] Figure 5 The structure block diagram of the communication link visualization device according to the embodiment of the present disclosure is schematically shown.
[0115] like Figure 5 As shown, the communication link visualization device 500 of this embodiment includes an acquisition module 510 , a collection module 520 , a service configuration file acquisition module 530 , a communication link relationship calculation module 540 and a visualization module 550 .
[0116] The acquisition module 510 is used to respectively acquire the system correspondence between the running node and the reverse proxy node and the system. In one embodiment, the acquisition module 510 can be used to perform the operation S210 described above, which will not be repeated here.
[0117] The collection module 520 is used to collect the communication connection data of the service node based on the preset collection frequency, and obtain the communication connection data within the preset time period, wherein the communication connection data includes the target IP address of the service node corresponding to the data receiving end and the source IP address of the service node corresponding to the data sending end. In one embodiment, the collection module 520 can be used to perform the operation S220 described above, which will not be repeated here.
[0118] The service configuration file acquisition module 530 is used to acquire the service configuration file of the reverse proxy node, and the service configuration file includes the proxy mapping relationship between the running node and the reverse proxy node. In one embodiment, the service configuration file acquisition module 530 can be used to perform the operation S230 described above, which will not be repeated here.
[0119] The communication link relationship calculation module 540 is used to obtain the communication link relationship data within a preset time period based on the communication connection data, the service configuration file and the system correspondence, and the communication link relationship data includes the communication link data between multiple systems and the communication link data between multiple service nodes. In one embodiment, the communication link relationship calculation module 540 can be used to perform the operation S240 described above, which will not be repeated here.
[0120] The visualization module 550 is used to call the graph database component to visualize the communication link relationship data to obtain a communication link graph. In one embodiment, the visualization module 550 can be used to perform the operation S250 described above, which will not be described in detail here.
[0121] According to an embodiment of the present disclosure, the communication link relationship calculation module includes: an intra-system communication connection data determination submodule, which is used to determine the communication connection data as intra-system communication connection data when the target IP address and the source IP address of the communication connection data correspond to IP addresses in the same system in the system correspondence relationship; an inter-system communication connection data determination submodule, which is used to determine the communication connection data as inter-system communication connection data when the target IP address and the source IP address of the communication connection data correspond to IP addresses in different systems in the system correspondence relationship; an intra-system communication link relationship data calculation submodule, which is used to obtain the intra-system communication link relationship data within a preset time period based on the intra-system communication connection and the service configuration file;
[0122] The inter-system communication link relationship data calculation submodule is used to obtain the inter-system communication link relationship data based on all the inter-system communication connection data mentioned above.
[0123] According to an embodiment of the present disclosure, the above-mentioned device also includes: a service registration data acquisition module, used to obtain service registration data, the above-mentioned service registration data includes a service identifier, a service instance IP address and a listening port number; a second communication link relationship data calculation module, used to obtain the second communication link relationship data within a preset time period based on the above-mentioned communication connection data and the above-mentioned service registration data.
[0124] According to an embodiment of the present disclosure, the above-mentioned second communication link relationship data includes an inter-service communication link and an inter-service instance communication link, the above-mentioned service identifier and the above-mentioned service instance IP address have a service instance mapping relationship, and the above-mentioned second communication link relationship data calculation module includes: an inter-service instance communication link calculation sub-module, which is used to obtain the above-mentioned inter-service instance communication link based on the above-mentioned service registration data and the above-mentioned communication connection data when the service instance IP address of the above-mentioned communication connection data is equal to the above-mentioned target IP address and / or the above-mentioned source IP address of the above-mentioned communication connection data; an inter-service communication link calculation sub-module, which is used to obtain the above-mentioned inter-service communication link based on the inter-service instance communication link and the above-mentioned service instance mapping relationship.
[0125] According to an embodiment of the present disclosure, the communication connection data further includes a communication connection identifier, and the device further includes: an inter-socket communication link calculation module, which is used to obtain the inter-socket communication link based on the communication connection identifier and the communication link between the IP addresses.
[0126] According to an embodiment of the present disclosure, the above-mentioned communication connection data also includes a communication connection status, and the above-mentioned communication link calculation submodule between service instances includes: a candidate communication connection data determination unit, which is used to determine the communication connection data whose communication connection status is not a disconnected state as candidate communication connection data; and a communication link determination unit between service instances, which is used to obtain the communication link between the above-mentioned service instances based on the mapping relationship between the above-mentioned candidate communication connection data and the above-mentioned service instances.
[0127] According to an embodiment of the present disclosure, any multiple modules among the acquisition module 510, the acquisition module 520, the service profile acquisition module 530, the communication link relationship calculation module 540 and the visualization module 550 can be combined into one module for implementation, or any one of the modules can be split into multiple modules. Alternatively, at least part of the functions of one or more of these modules can be combined with at least part of the functions of other modules and implemented in one module. According to an embodiment of the present disclosure, at least one of the acquisition module 510, the acquisition module 520, the service profile acquisition module 530, the communication link relationship calculation module 540 and the visualization module 550 can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application specific integrated circuit (ASIC), or can be implemented by hardware or firmware such as any other reasonable way of integrating or packaging the circuit, or implemented in any one of the three implementation methods of software, hardware and firmware or in a suitable combination of any of them. Alternatively, at least one of the acquisition module 510, the collection module 520, the service profile acquisition module 530, the communication link relationship calculation module 540 and the visualization module 550 can be at least partially implemented as a computer program module, and when the computer program module is executed, the corresponding function can be performed.
[0128] Figure 6 A block diagram of an electronic device suitable for implementing a communication link visualization method according to an embodiment of the present disclosure is schematically shown.
[0129] like Figure 6As shown, the electronic device 600 according to an embodiment of the present disclosure includes a processor 601, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 602 or a program loaded from a storage part 605 to a random access memory (RAM) 603. The processor 601 may include, for example, a general-purpose microprocessor (such as a CPU), an instruction set processor and / or a related chipset and / or a dedicated microprocessor (for example, an application-specific integrated circuit (ASIC)), etc. The processor 601 may also include an onboard memory for caching purposes. The processor 601 may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present disclosure.
[0130] In RAM 603, various programs and data required for the operation of electronic device 600 are stored. Processor 601, ROM 602 and RAM 603 are connected to each other via bus 604. Processor 601 performs various operations of the method flow according to the embodiment of the present disclosure by executing the program in ROM 602 and / or RAM 603. It should be noted that the program can also be stored in one or more memories other than ROM 602 and RAM 603. Processor 601 can also perform various operations of the method flow according to the embodiment of the present disclosure by executing the program stored in the one or more memories.
[0131] According to an embodiment of the present disclosure, the electronic device 600 may further include an input / output (I / O) interface 605, which is also connected to the bus 604. The electronic device 600 may further include one or more of the following components connected to the input / output (I / O) interface 605: an input portion 606 including a keyboard, a mouse, etc.; an output portion 607 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage portion 605 including a hard disk, etc.; and a communication portion 609 including a network interface card such as a LAN card, a modem, etc. The communication portion 609 performs communication processing via a network such as the Internet. A drive 610 is also connected to the input / output (I / O) interface 605 as needed. A removable medium 611, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 610 as needed, so that a computer program read therefrom is installed into the storage portion 605 as needed.
[0132] The present disclosure also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or may exist independently without being assembled into the device / apparatus / system. The above computer-readable storage medium carries one or more programs, and when the above one or more programs are executed, the method according to the embodiment of the present disclosure is implemented.
[0133] According to an embodiment of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium, for example, it may include but is not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, an apparatus or a device. For example, according to an embodiment of the present disclosure, the computer-readable storage medium may include the ROM 602 and / or RAM 603 described above and / or one or more memories other than ROM 602 and RAM 603.
[0134] The embodiment of the present disclosure also includes a computer program product, which includes a computer program, and the computer program contains program code for executing the method shown in the flowchart. When the computer program product is run in a computer system, the program code is used to enable the computer system to implement the communication link visualization method provided by the embodiment of the present disclosure.
[0135] The above functions defined in the system / device of the embodiment of the present disclosure are performed when the computer program is executed by the processor 601. According to the embodiment of the present disclosure, the system, device, module, unit, etc. described above can be implemented by a computer program module.
[0136] In one embodiment, the computer program may rely on tangible storage media such as optical storage devices, magnetic storage devices, etc. In another embodiment, the computer program may also be transmitted and distributed in the form of signals on a network medium, and downloaded and installed through the communication part 609, and / or installed from a removable medium 611. The program code contained in the computer program may be transmitted using any appropriate network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.
[0137] In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 609, and / or installed from the removable medium 611. When the computer program is executed by the processor 601, the above functions defined in the system of the embodiment of the present disclosure are performed. According to the embodiment of the present disclosure, the system, device, apparatus, module, unit, etc. described above can be implemented by a computer program module.
[0138] According to an embodiment of the present disclosure, the program code for executing the computer program provided by the embodiment of the present disclosure can be written in any combination of one or more programming languages. Specifically, these computing programs can be implemented using high-level process and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages include, but are not limited to, Java, C++, python, "C" language or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, partially on the remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (for example, using an Internet service provider to connect through the Internet).
[0139] The flow charts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0140] It will be appreciated by those skilled in the art that the features described in the various embodiments of the present disclosure may be combined and / or combined in a variety of ways, even if such combinations or combinations are not explicitly described in the present disclosure. In particular, without departing from the spirit and teachings of the present disclosure, the features described in the various embodiments of the present disclosure may be combined and / or combined in a variety of ways. All of these combinations and / or combinations fall within the scope of the present disclosure.
[0141] The embodiments of the present disclosure are described above. However, these embodiments are only for illustrative purposes and are not intended to limit the scope of the present disclosure. Although the embodiments are described above, this does not mean that the measures in the various embodiments cannot be used in combination to advantage. Without departing from the scope of the present disclosure, those skilled in the art may make a variety of substitutions and modifications, which should all fall within the scope of the present disclosure.
Claims
1. A communication link visualization method, characterized in that: The method is applied to a server, the server includes multiple systems, the system includes multiple service nodes, the service nodes include operation nodes and reverse proxy nodes, the reverse proxy nodes are used to forward requests to the operation nodes, and the method includes: Respectively obtaining the system correspondence between the running node and the reverse proxy node and the system; Collecting the communication connection data of the service node based on the preset collection frequency to obtain the communication connection data within a preset time period, wherein the communication connection data includes the target IP address of the service node corresponding to the data receiving end and the source IP address of the service node corresponding to the data sending end; Obtaining a service configuration file of the reverse proxy node, wherein the service configuration file includes a proxy mapping relationship between the running node and the reverse proxy node; Based on the communication connection data, the service configuration file and the system correspondence, communication link relationship data within a preset time period is obtained, wherein the communication link relationship data includes communication link data between a plurality of the systems and communication link data between a plurality of the service nodes; The graph database component is called to visualize the communication link relationship data to obtain a communication link graph.
2. The method according to claim 1, characterized in that The obtaining of the communication link relationship data within a preset time period based on the communication connection data, the service configuration file and the system correspondence includes: In a case where the target IP address and the source IP address of the communication connection data correspond to IP addresses in the same system in the system correspondence relationship, determining the communication connection data as intra-system communication connection data; In a case where the target IP address and the source IP address of the communication connection data correspond to IP addresses in different systems in the system correspondence relationship, determining the communication connection data as inter-system communication connection data; Obtaining intra-system communication link relationship data within a preset time period based on the intra-system communication connection and the service configuration file; The inter-system communication link relationship data is obtained based on the all inter-system communication connection data.
3. The method according to claim 1, characterized in that The method further comprises: Obtain service registration data, the service registration data including service identifier, service instance IP address and listening port number; Second communication link relationship data within a preset time period is obtained based on the communication connection data and the service registration data.
4. The method according to claim 3, characterized in that The second communication link relationship data includes an inter-service communication link and an inter-service instance communication link, the service identifier and the service instance IP address have a service instance mapping relationship, and the second communication link relationship data within a preset time period is obtained based on the communication connection data and the service registration data, including: In a case where the service instance IP address of the communication connection data is equal to the target IP address and / or the source IP address of the communication connection data, obtaining the communication link between the service instances based on the service registration data and the communication connection data; The inter-service communication link is obtained based on the inter-service instance communication link and the service instance mapping relationship.
5. The method according to claim 1, characterized in that The communication connection data also includes a communication connection identifier, and the method further includes: The inter-socket communication link is obtained based on the communication connection identifier and the communication link between the IP addresses.
6. The method according to claim 4, characterized in that The communication connection data also includes a communication connection state, and obtaining the communication link between the service instances based on the service registration data and the communication connection data includes: Determining the communication connection data whose communication connection state is not a disconnected state as candidate communication connection data; The communication link between the service instances is obtained based on the candidate communication connection data and the service instance mapping relationship.
7. A communication link visualization device, characterized in that: The device is installed on a server, the server includes multiple systems, the system includes multiple service nodes, the service nodes include operation nodes and reverse proxy nodes, the reverse proxy nodes are used to forward requests to the operation nodes, and the device includes: An acquisition module, used to respectively acquire the system correspondence between the running node and the reverse proxy node and the system; A collection module, used to collect the communication connection data of the service node based on a preset collection frequency, and obtain the communication connection data within a preset time period, wherein the communication connection data includes a target IP address of the service node corresponding to a data receiving end and a source IP address of the service node corresponding to a data sending end; A service configuration file acquisition module, used to acquire a service configuration file of the reverse proxy node, wherein the service configuration file includes a proxy mapping relationship between the running node and the reverse proxy node; a communication link relationship calculation module, configured to obtain communication link relationship data within a preset time period based on the communication connection data, the service configuration file and the system correspondence, wherein the communication link relationship data includes communication link data between a plurality of the systems and communication link data between a plurality of the service nodes; The visualization module is used to call the graph database component to perform image visualization on the communication link relationship data to obtain a communication link graph.
8. An electronic device comprising: one or more processors; a memory for storing one or more computer programs, It is characterized in that the one or more processors execute the one or more computer programs to implement the steps of the method according to any one of claims 1 to 6.
9. A computer-readable storage medium having a computer program or instruction stored thereon, characterized in that: When the computer program or instruction is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.
10. A computer program product comprising a computer program or instructions, characterized in that When the computer program or instruction is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.
Citation Information
Patent Citations
Oscillating classifier
ES40099U
Monitoring method of full-service scene link and related equipment
CN114968701A
Topology-based Nginx log analysis method, system and equipment
CN115333966A
Network space link surveying and mapping method and system, storage medium and equipment
CN115460095A
Cloud network topology generation method and device, equipment and medium
CN116866183A