Traffic monitoring method, system, device and storage medium
By monitoring and reconstructing the traffic data of container applications through load balancing, and generating simulated messages to locate traffic nodes, this technology solves the problems of poor universality and scalability in monitoring container applications in existing technologies, and realizes real-time monitoring and sensitive information detection of container applications.
Patent Information
- Application Number
- CN202210933540.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-08-04
- Publication Date
- 2024-11-15
- Estimated Expiration
- 2042-08-04
AI Technical Summary
Existing technologies for monitoring container application traffic suffer from poor versatility and scalability, and require intrusion into the original architecture of cluster services.
By monitoring traffic data between container applications and other clusters or Internet nodes through load balancing, the system distributes and replicates the data. When the replicated traffic data contains sensitive information, it is reconstructed to generate simulated messages to simulate the traffic data distribution process and locate traffic nodes.
It enables real-time monitoring of container applications without affecting the original traffic's closed nature and timeliness. It has good versatility and scalability, and can start monitoring at any stage of container business without needing to embed a monitoring module in the container application.
Smart Images

Figure CN115297038B_ABST
Abstract
Description
Background Art
[0002] With the development of cloud computing platform technology and container technology, more and more business applications are implemented using container deployment due to the advantages of rapid deployment, elastic scalability, portability, lightweight, high availability, and high resource utilization of container technology. However, at the same time, supervision also requires that sensitive information be exposed on the Internet to the greatest extent possible. It is necessary to strengthen the interactive monitoring of sensitive information and locate the node information involved, so that administrators can take corresponding protection or restriction measures for the corresponding container applications.
[0003] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present invention, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention
[0004] In view of the problems in the prior art, the purpose of the present invention is to provide a flow monitoring method, system, device and storage medium, which overcomes the difficulties of the prior art and can improve the versatility and scalability of flow monitoring.
[0005] An embodiment of the present invention provides a flow monitoring method, which includes:
[0006] Monitor the traffic data between the cluster where the container application is located and other clusters or Internet nodes through load balancing;
[0007] Distribute and replicate traffic data;
[0008] In the case where the copied traffic data contains sensitive information, reconstructing the copied traffic data to obtain a simulated message, and distributing the simulated message;
[0009] When a response message of the simulation message is obtained, a message node of the simulation message is located according to the response message, and the message node is used as a flow node of the flow data.
[0010] In some embodiments, monitoring the traffic data of the container application through load balancing includes:
[0011] Receive traffic data from the cluster where the container application is located, other clusters, or Internet nodes through load balancing.
[0012] In some embodiments, the flow monitoring method further includes:
[0013] In the case where the replicated traffic data contains sensitive information, before reconstructing the replicated traffic data to obtain the simulated message, the replicated traffic data is submitted to the data warehouse through load balancing;
[0014] receiving a flow data reconstruction request from the data warehouse, the flow data reconstruction request being generated when the replicated flow data includes sensitive information;
[0015] In response to the traffic data reconstruction request, the replicated traffic data is extracted from the data warehouse and the replicated traffic data is reconstructed to obtain a simulation message.
[0016] In some embodiments, in the case of obtaining a response message to a simulated message, before locating a message node of the simulated message according to the response message, the traffic monitoring method further includes:
[0017] Receive candidate traffic through load balancing;
[0018] When the tracking tag information is extracted from the candidate traffic, it is confirmed that the candidate traffic is a response message of the simulation message.
[0019] In some embodiments, the flow monitoring method further includes:
[0020] In the case where the tracking tag information is not extracted from the candidate traffic, the candidate traffic is confirmed to be traffic data of the container application, and the traffic data is distributed and copied based on the traffic data return of the container application.
[0021] In some embodiments, the flow monitoring method further includes:
[0022] In the case that the copied traffic data does not contain sensitive information, a deletion request for the copied traffic data is sent to the data warehouse.
[0023] In some embodiments, the flow monitoring method further includes:
[0024] The node information of the traffic node, the traffic data and the sensitive information contained therein are sent to an administrator.
[0025] In some embodiments, reconstructing the replicated traffic data to obtain a simulated message includes:
[0026] For the data header of the copied traffic data, the source address in the data header is modified to the address of the load balancer, and the tracking mark information is added to the data body to obtain a simulated message including the address of the load balancer and the tracking mark information.
[0027] In some embodiments, when the copied traffic data contains sensitive information, before reconstructing the copied traffic data to obtain the simulated message, the traffic monitoring method further includes:
[0028] Determine whether the copied traffic data contains the sensitive information.
[0029] An embodiment of the present invention further provides a flow monitoring system, which includes:
[0030] The traffic monitoring module monitors the traffic data between the cluster where the container application is located and other clusters or Internet nodes through load balancing;
[0031] Traffic processing module distributes and copies traffic data;
[0032] A traffic reconstruction module, which reconstructs the copied traffic data to obtain a simulated message when the copied traffic data contains sensitive information, and distributes the simulated message;
[0033] The node positioning module locates the message node of the simulation message according to the response message when obtaining the response message of the simulation message, and uses the message node as the flow node of the flow data.
[0034] An embodiment of the present invention further provides an electronic device, including:
[0035] processor;
[0036] a memory in which executable instructions for the processor are stored;
[0037] The processor is configured to execute the steps of the above-mentioned flow monitoring method by executing executable instructions.
[0038] An embodiment of the present invention further provides a computer-readable storage medium for storing a program, which implements the steps of the above-mentioned traffic monitoring method when executed.
[0039] The purpose of the present invention is to provide a traffic monitoring method, system, device and storage medium, which monitors the traffic data interacting between the cluster where the container application is located and other clusters or Internet nodes through load balancing, and distributes and copies the traffic data. When the copied traffic data contains sensitive information, the copied traffic data is reconstructed to obtain a simulated message, and the distribution process of the traffic data is simulated using the simulated message, and the traffic node of the original traffic data is obtained according to the response message of the simulated message. The scheme of the present invention does not affect the closure and timeliness of the original traffic of the container application, is not limited to a specific container application business, is not limited to a specific message type, can start monitoring at various stages of container business deployment, does not affect the original framework of the container application and its cluster deployment, and has good versatility and scalability. At the same time, the detection of sensitive information by the present invention does not invade the container application, and does not need to embed a monitoring module in the container application before and after the container business deployment, so sensitive information detection is easier to achieve. BRIEF DESCRIPTION OF THE DRAWINGS
[0040] Other features, objectives and advantages of the present invention will become more apparent from a reading of the detailed description of non-limiting embodiments made with reference to the following accompanying drawings.
[0041] Figure 1 is an architecture diagram of a business system according to an embodiment of the present invention;
[0042] Figure 2 is one of the flow charts of the flow monitoring method according to an embodiment of the present invention;
[0043] Figure 3 This is the second flow chart of the flow monitoring method according to an embodiment of the present invention;
[0044] Figure 4 is an architectural diagram of a flow monitoring system according to an embodiment of the present invention;
[0045] Figure 5 This is the third flow chart of the flow monitoring method according to the embodiment of the present invention;
[0046] Figure 6 It is a schematic diagram of the module structure of the flow monitoring system according to an embodiment of the present invention;
[0047] Figure 7 is a schematic diagram of the operation of the electronic device of the present invention;
[0048] Figure 8 A schematic diagram of a storage medium according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION
[0049] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the embodiments set forth herein. Instead, these embodiments are provided to make the present invention comprehensive and complete and to fully convey the concepts of the example embodiments to those skilled in the art.
[0050] The accompanying drawings are only schematic illustrations of the present invention and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or implemented in one or more hardware forwarding modules or integrated circuits, or implemented in different networks and / or processor devices and / or microcontroller devices.
[0051] In addition, the processes shown in the accompanying drawings are only exemplary and do not necessarily include all the steps. For example, some steps can be decomposed, some steps can be combined or partially combined, and the actual execution order may change according to the actual situation. The words "first", "second" and similar words used in the specific description do not indicate any order, quantity or importance, but are only used to distinguish different components. It should be noted that the embodiments of the present invention and the features in different embodiments can be combined with each other without conflict.
[0052] After testing the relevant technologies, we found that the relevant technologies embed monitoring modules locally before or during business deployment to monitor local data or log information of each container and realize the monitoring of sensitive information. Therefore, the relevant technologies need to invade the original architecture of cluster business, and their versatility and scalability are poor.
[0053] The disclosed embodiment proposes a traffic monitoring method, the inventive concept of which is to monitor the traffic data interacting between the cluster where the container application is located and other clusters or Internet nodes through load balancing, and distribute and copy the traffic data. When the copied traffic data contains sensitive information, the copied traffic data is reconstructed to obtain a simulated message, and the distribution process of the traffic data is simulated using the simulated message, and the traffic node of the original traffic data is obtained according to the response message of the simulated message. The traffic node includes at least one of the source address, destination address and path node of the traffic data, which are not limited here.
[0054] In the disclosed embodiment, the traffic that interacts between the container application and other clusters or with the Internet nodes outside the cluster will first flow through the load balancer and then flow to the interface of the corresponding destination address. Therefore, the disclosed embodiment can monitor the traffic of the container application in real time, copy the traffic data for local processing in the load balancer, so as to locate the traffic nodes involved in the traffic data, without affecting the closure and timeliness of the original traffic of the business load, not limited to specific container application business, not limited to specific message types, and can start monitoring at various stages of container business deployment, without affecting the original framework of the container application and its cluster deployment, and has good versatility and scalability.
[0055] Therefore, it can be expected that since the traffic monitoring for container applications only involves load balancing, it will not invade other container application architectures and is open. Therefore, sensitive information and monitoring methods can be modified in a timely manner in line with changes in regulatory requirements. This solution has further good adaptability and scalability.
[0056] At the same time, this embodiment can also solve the problem of huge monitoring workload consumption caused by the small granularity of container application in related technologies.
[0057] In the embodiment of the present disclosure, load balancing is used to receive traffic between the Internet and the cluster, and between clusters, and distribute it according to load balancing rules. Figure 1 In the cluster-oriented business system shown, load balancing is used to distribute traffic between clusters and between clusters and the Internet based on load balancing rules.
[0058] The Internet requests the business services deployed in the cluster through the Internet. The cluster contains the working nodes and the container applications deployed on them. The cluster is used to carry the container applications, provide business services to the outside world, or request business services provided by other cluster containers. The container application and the container have the same meaning. The container application refers to the containerized application, and the container is used to carry the application.
[0059] Figure 2 This is a flow chart of a traffic monitoring method provided in an embodiment of the present disclosure. The execution subject of the traffic monitoring method may be load balancing, which is not limited here.
[0060] Load balancing can be accomplished by dedicated software and hardware. Its main function is to reasonably distribute the traffic data of container applications or the Internet to containers in multiple clusters for execution, which is used to solve the problems of high concurrency and high availability in the cluster architecture.
[0061] like Figure 2 As shown, the flow monitoring method includes the following steps:
[0062] Step 210: Monitor the traffic data of the interaction between the cluster where the container application is located and other clusters or Internet nodes through load balancing;
[0063] Step 220: Distribute and copy the traffic data;
[0064] Step 230: In the case where the copied traffic data contains sensitive information, reconstructing the copied traffic data to obtain a simulated message, and distributing the simulated message;
[0065] Step 240: When a response message to the simulation message is obtained, the message node of the simulation message is located according to the response message, and the message node is used as the flow node of the flow data.
[0066] In the disclosed embodiment, the simulation message is used to simulate the distribution process of the original traffic data, so the node information of the message node can be obtained according to the response message of the simulation message, and further the message node can be used as the traffic node of the traffic data.
[0067] In this way, using the traffic monitoring method provided by the embodiment of the present disclosure, it is possible to monitor the traffic interacting between the cluster where the container application is located and other clusters or Internet nodes in real time, copy the traffic data for local processing in the load balancing, so as to locate the traffic nodes involved in the traffic data, without affecting the closedness and timeliness of the original traffic of the container application, not limited to specific container application services, not limited to specific message types, and can start monitoring at various stages of container service deployment, without affecting the original framework of the container application and its cluster deployment, and has good versatility and scalability. At the same time, the detection of sensitive information by the present invention does not invade the container application, and does not require the embedding of a monitoring module in the container application before and after the container service deployment, so sensitive information detection is easier to achieve.
[0068] In an optional embodiment of the present disclosure, the traffic data of the container application may refer to the traffic data sent from the cluster where the container application is located, or the traffic data sent to the container application from an external Internet node or other cluster.
[0069] Specifically, traffic data can be interactive traffic data between clusters or between a cluster and the Internet. The interactive traffic data is interacted and distributed through load balancing, and is used to monitor interactive messages outside the cluster. It does not involve interactive information within the container cluster. Its purpose is to avoid external exposure of sensitive messages.
[0070] Therefore, in an optional embodiment of the present disclosure, monitoring the flow data of the container application through load balancing may include: receiving flow data from the cluster where the container application is located, or other clusters or Internet nodes through load balancing. The Internet node refers to a node outside the cluster.
[0071] In the embodiment of the present disclosure, for the original traffic data, the load balancing will distribute it based on the load balancing rules, for example, forwarding it to the corresponding container applications in other clusters.
[0072] In an optional embodiment of the present disclosure, when the copied traffic data contains sensitive information, before reconstructing the copied traffic data to obtain a simulated message, the traffic monitoring method further includes:
[0073] Determine whether the copied traffic data contains the sensitive information.
[0074] Specifically, the traffic data can be matched with a sensitive word database to determine whether the copied traffic data contains sensitive information. If a sensitive word is matched, the sensitive word is used as sensitive information. The sensitive word database is configured by the administrator.
[0075] In another embodiment of the present disclosure, the load balancer itself may not perform the determination of whether the replicated traffic data contains sensitive information, but may request other nodes to determine whether the replicated traffic data contains sensitive information.
[0076] In the embodiments of the present disclosure, Figure 3 As shown, the flow monitoring method includes the following steps:
[0077] Step 310: Monitor the traffic data of the container application through load balancing;
[0078] Step 320: Distribute and replicate the traffic data, submit the replicated traffic data to the data warehouse through load balancing, and receive a traffic data reconstruction request from the data warehouse. The traffic data reconstruction request is generated when the replicated traffic data contains sensitive information;
[0079] Step 330: In response to the traffic data reconstruction request, extract the replicated traffic data from the data warehouse and reconstruct the replicated traffic data to obtain a simulation message, reconstruct the replicated traffic data to obtain a simulation message, and distribute the simulation message;
[0080] Step 340: When a response message to the simulation message is obtained, the message node of the simulation message is located according to the response message, and the message node is used as the flow node of the flow data.
[0081] The load balancing system stores the replicated traffic data through the supporting data warehouse, and reconstructs and distributes the traffic data in response to the simulated message reconstruction request, as well as locates the traffic nodes. In this way, the corresponding resource consumption is transferred to the data warehouse, thereby saving the resource consumption of the load balancing system.
[0082] In an optional embodiment of the present disclosure, the flow monitoring method may further include the following steps:
[0083] The copied traffic data is divided into a data header and a data body. In this case, the data header and the data body are submitted to the data warehouse. In this case, the copied traffic data is reconstructed to obtain a simulated message, which may specifically include:
[0084] The source address in the data header is modified to the load balancing address, and the tracking tag information is added to the data body to obtain the final simulated message.
[0085] In this case, the response node of the simulated message will be directly fed back to the load balancing through the load balancing address, and the load balancing can quickly identify the simulated message based on the tracking tag information, and extract the response node that receives the simulated message based on the simulated message, so as to quickly locate and track the traffic nodes involved in the traffic data.
[0086] The traffic nodes involved in the traffic data include the nodes of both interacting parties of the original traffic data.
[0087] In an optional embodiment of the present disclosure, when a traffic node is located, the information of the traffic node, the original traffic data, and the corresponding sensitive information are sent to an administrator, who then maintains the container application, such as protecting or restricting it.
[0088] In addition, in the case where the copied traffic data does not contain sensitive information, a deletion request for the copied traffic data may be sent to the data warehouse.
[0089] Figure 4 An architecture diagram of a traffic monitoring system provided in an embodiment of the present disclosure includes a traffic replication module 411 and a message retransmission module 412 integrated in a load balancer 41 , as well as a data warehouse module 42 and a sensitive word analysis module 43 .
[0090] Based on this flow monitoring system, combined with Figure 5 As shown, the flow monitoring method includes the following steps based on the above modules:
[0091] Step 510: The traffic replication module 411 monitors the traffic of the container application;
[0092] Step 520: The traffic replication module 411 replicates the traffic of the container application and divides the traffic data into a data header and a data body;
[0093] Step 530: The traffic replication module 411 forwards the traffic of the container application to the data warehouse module 42, and the data warehouse module 42 is used to pre-process the traffic;
[0094] Step 540: the data warehouse module 42 determines whether the traffic is a response message of the simulation message;
[0095] If yes, step 550 is executed, the data warehouse module 42 maps and stores the cluster, container information, sensitive information and classification information received by the simulated message, and notifies the administrator;
[0096] If not, then step 560 is executed, and the sensitive word analysis module 43 performs sensitive information detection;
[0097] Step 570: The sensitive word analysis module 43 receives the sensitive words, search algorithms and sensitivity classification rules set by the administrator, and performs sensitive word search and matching level classification on the replication traffic submitted by the data warehouse module 42 to determine whether the traffic meets the sensitivity classification rules;
[0098] If yes, step 580 is executed, and the message retransmission module 412 reconstructs the original traffic to generate a simulated message;
[0099] Step 590: resend simulation message and tracking;
[0100] If not, that is, the sensitivity classification rules are not met, step 5100 is executed, and the data warehouse module 42 deletes the copied traffic data.
[0101] The traffic monitoring system proposed in the embodiment of the present disclosure has decoupled modules, which facilitates administrators to modify sensitive information and classification rules in real time according to policy changes, and has good programmability, interoperability and scalability.
[0102] The disclosed embodiments may be a service for container cluster deployment, which may monitor the traffic data of container applications and copy the traffic data to a data warehouse, filter and match the data based on sensitive words and detection methods input by an administrator, reconstruct the traffic information when the sensitive classification level is reached, and send a reconstructed simulation message to track the container cluster involved in the sensitive information; thereby notifying the administrator to take corresponding protection or restriction measures for different categories of container applications.
[0103] Figure 6 is a module diagram of an embodiment of the flow monitoring system provided by the present disclosure, such as Figure 6 As shown, the flow monitoring system 600 includes but is not limited to the following modules:
[0104] The traffic monitoring module 610 monitors the traffic data of the interaction between the cluster where the container application is located and other clusters or Internet nodes through load balancing;
[0105] Traffic processing module 620 distributes and copies traffic data;
[0106] The traffic reconstruction module 630 reconstructs the copied traffic data to obtain a simulated message when the copied traffic data contains sensitive information, and distributes the simulated message;
[0107] The node positioning module 640, when obtaining a response message of the simulation message, locates the message node of the simulation message according to the response message, and uses the message node as the flow node of the flow data.
[0108] Using the traffic monitoring system of the disclosed embodiment, it is possible to monitor the traffic interacting between the cluster where the container application is located and other clusters or Internet nodes in real time, copy the traffic data for local processing in the load balancing, so as to locate the traffic nodes involved in the traffic data, without affecting the closedness and timeliness of the original traffic of the container application, not limited to specific container application services, not limited to specific message types, and can start monitoring at various stages of container service deployment, without affecting the original framework of the container application and its cluster deployment, and has good versatility and scalability. At the same time, the detection of sensitive information by the present invention does not invade the container application, and does not require the embedding of a monitoring module in the container application before and after the container service deployment, so sensitive information detection is easier to achieve.
[0109] Therefore, it can be expected that since the traffic monitoring for traffic applications only involves load balancing and does not invade other container application architectures, sensitive information and monitoring methods can be modified in a timely manner following changes in regulatory requirements. This solution has further good adaptability and scalability.
[0110] The implementation principle of the above modules can be found in the relevant introduction of the traffic monitoring method, which will not be repeated here.
[0111] Optionally, the flow monitoring module 610 is specifically used for:
[0112] Receive traffic data from the cluster where the container application is located, other clusters, or Internet nodes through load balancing.
[0113] Optionally, the traffic processing module 620 is further configured to:
[0114] In the case where the replicated traffic data contains sensitive information, before reconstructing the replicated traffic data to obtain the simulated message, the replicated traffic data is submitted to the data warehouse through load balancing;
[0115] receiving a flow data reconstruction request from the data warehouse, the flow data reconstruction request being generated when the replicated flow data includes sensitive information;
[0116] The traffic reconstruction module 630 is specifically used for:
[0117] In response to the traffic data reconstruction request, the replicated traffic data is extracted from the data warehouse and the replicated traffic data is reconstructed to obtain a simulation message.
[0118] Optionally, the node positioning module 640 is further configured to:
[0119] In the case of obtaining a response message to the simulated message, before locating a message node of the simulated message according to the response message, receiving the candidate traffic through load balancing;
[0120] When the tracking tag information is extracted from the candidate traffic, it is confirmed that the candidate traffic is a response message of the simulation message.
[0121] Optionally, the node positioning module 640 is further configured to:
[0122] In the case where the tracking tag information is not extracted from the candidate traffic, the candidate traffic is confirmed to be traffic data of the container application, and the traffic data is distributed and copied based on the traffic data return of the container application.
[0123] Optionally, the traffic processing module 620 is further configured to:
[0124] In the case that the copied traffic data does not contain sensitive information, a deletion request for the copied traffic data is sent to the data warehouse.
[0125] Optionally, the traffic reconstruction module 630 is specifically used for:
[0126] For the data header of the copied traffic data, the source address in the data header is modified to the address of the load balancer, and the tracking mark information is added to the data body to obtain a simulated message including the address of the load balancer and the tracking mark information.
[0127] Optionally, the traffic reconstruction module 630 is further configured to:
[0128] The node information of the traffic node, the traffic data and the sensitive information contained therein are sent to an administrator.
[0129] Optionally, the traffic reconstruction module 630 is further configured to:
[0130] In the case where the copied traffic data contains sensitive information, before reconstructing the copied traffic data to obtain the simulated message, it is determined whether the copied traffic data contains the sensitive information.
[0131] An embodiment of the present invention further provides an electronic device, comprising a processor and a memory, wherein executable instructions of the processor are stored, wherein the processor is configured to execute the steps of the flow monitoring method by executing the executable instructions.
[0132] As shown above, the electronic device of the embodiment of the present disclosure monitors the traffic interacting between the cluster where the container application is located and other clusters or Internet nodes in real time through load balancing, and copies the traffic data for processing locally in the load balancing so as to locate the traffic nodes involved in the traffic data. It does not affect the closedness and timeliness of the original traffic of the container application, is not limited to specific container application services, is not limited to specific message types, and can start monitoring at various stages of container service deployment. It does not affect the original framework of the container application and its cluster deployment, and has good versatility and scalability.
[0133] It will be appreciated by those skilled in the art that various aspects of the present invention may be implemented as systems, methods or program products. Therefore, various aspects of the present invention may be specifically implemented in the following forms, namely: complete hardware implementation, complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software implementations, which may be collectively referred to herein as "circuits", "modules" or "platforms".
[0134] Figure 7 The structural diagram of the electronic device of the present invention is shown below. Figure 7 An electronic device 700 according to this embodiment of the present invention will be described. Figure 7 The electronic device 700 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.
[0135] like Figure 7 As shown, the electronic device 700 is in the form of a general computing device. The components of the electronic device 700 may include, but are not limited to: at least one processing unit 710, at least one storage unit 720, a bus 730 connecting different platform components (including the storage unit 720 and the processing unit 710), a display unit 740, etc.
[0136] The storage unit stores program codes, which can be executed by the processing unit 710, so that the processing unit 710 executes the steps of various exemplary embodiments of the present invention described in the flow monitoring method section. For example, the processing unit 710 can execute Figure 2 Steps shown.
[0137] The storage unit 720 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 721 and / or a cache memory unit 722 , and may further include a read-only memory unit (ROM) 723 .
[0138] The storage unit 720 may also include a program / utility 724 having a set (at least one) of program modules 725, such program modules 725 including but not limited to: a processing system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment.
[0139] Bus 730 may represent one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.
[0140] The electronic device 700 may also communicate with one or more external devices 70 (e.g., keyboards, pointing devices, Bluetooth devices, etc.), one or more devices that enable a user to interact with the electronic device 700, and / or any device that enables the electronic device 700 to communicate with one or more other computing devices (e.g., routers, modems, etc.). Such communication may be performed through an input / output (I / O) interface 750.
[0141] Furthermore, the electronic device 700 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) via a network adapter 760. The network adapter 760 may communicate with other modules of the electronic device 700 via the bus 730. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the electronic device 700, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage platforms, etc.
[0142] The embodiment of the present invention also provides a computer-readable storage medium for storing a program, and the steps of the flow monitoring method are implemented when the program is executed. In some possible implementations, various aspects of the present invention can also be implemented in the form of a program product, which includes a program code. When the program product is run on a terminal device, the program code is used to enable the terminal device to execute the steps of various exemplary embodiments of the present invention described in the flow monitoring method section of the specification.
[0143] refer to Figure 8 As shown, a program product 800 for implementing the above method according to an embodiment of the present disclosure is described. The program product for implementing the above method according to an embodiment of the present invention can adopt a portable compact disk read-only memory (CD-ROM) and include program code, and can be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited thereto. In this document, a readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, an apparatus or a device.
[0144] The program product may use any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of readable storage media (a non-exhaustive list) include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.
[0145] Computer readable storage media may include data signals propagated in baseband or as part of a carrier wave, wherein readable program codes are carried. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. The readable storage medium may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, device, or device. The program codes contained on the readable storage medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination thereof.
[0146] Program code for performing the processes of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, C++, and the like, as well as conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., through the Internet using an Internet service provider).
[0147] In summary, the purpose of the present invention is to provide a traffic monitoring method, system, device and storage medium, which monitors the traffic interacting between the cluster where the container application is located and other clusters or Internet nodes in real time, and copies the traffic data for local processing in the load balancing so as to locate the traffic nodes involved in the traffic data. It does not affect the closedness and timeliness of the original traffic of the container application, is not limited to specific container application services, is not limited to specific message types, can start monitoring at various stages of container service deployment, does not affect the original framework of the container application and its cluster deployment, and has good versatility and scalability.
[0148] The above contents are further detailed descriptions of the present invention in combination with specific preferred embodiments, and it cannot be determined that the specific implementation of the present invention is limited to these descriptions. For ordinary technicians in the technical field to which the present invention belongs, several simple deductions or substitutions can be made without departing from the concept of the present invention, which should be regarded as falling within the protection scope of the present invention.
Claims
1. A flow monitoring method, It is characterized in that include: Monitor traffic data of interactions between the cluster where the container application is located and other clusters or Internet nodes through load balancing, where the cluster includes working nodes and container applications deployed thereon; Distributing and copying the traffic data; In the case where the copied traffic data contains sensitive information, reconstructing the copied traffic data to obtain a simulated message, and distributing the simulated message; In the case of obtaining a response message to the simulation message, locating a message node of the simulation message according to the response message, and using the message node as a flow node of the flow data; The step of reconstructing the copied traffic data to obtain a simulated message includes: For the data header of the copied traffic data, the source address in the data header is modified to the address of the load balancer, and the tracking tag information is added to the data body to obtain the simulation message containing the address of the load balancer and the tracking tag information, so as to receive the candidate traffic through the load balancer and confirm that the candidate traffic is a response message of the simulation message when the tracking tag information is extracted from the candidate traffic.
2. The flow monitoring method according to claim 1, It is characterized in that Monitor the traffic data of container applications through load balancing, including: Traffic data from the cluster where the container application is located, the other clusters, or the Internet node is received through the load balancing.
3. The flow monitoring method according to claim 1, It is characterized in that The flow monitoring method further includes: In the case where the replicated traffic data contains sensitive information, before reconstructing the replicated traffic data to obtain the simulated message, submitting the replicated traffic data to the data warehouse through the load balancing; receiving a traffic data reconstruction request from the data warehouse, the traffic data reconstruction request being generated when the replicated traffic data contains sensitive information; In response to the traffic data reconstruction request, the replicated traffic data is extracted from the data warehouse and the replicated traffic data is reconstructed to obtain the simulation message.
4. The flow monitoring method according to claim 3, It is characterized in that The flow monitoring method further includes: In a case where the tracking tag information is not extracted from the candidate traffic, the candidate traffic is confirmed to be traffic data of a container application, and the traffic data is returned to be distributed and replicated based on the traffic data of the container application.
5. The flow monitoring method according to claim 3, It is characterized in that The flow monitoring method further includes: In the case that the copied traffic data does not contain sensitive information, a deletion request for the copied traffic data is sent to the data warehouse.
6. The flow monitoring method according to claim 1, It is characterized in that The flow monitoring method further includes: The node information of the traffic node, the traffic data and the sensitive information contained therein are sent to an administrator.
7. The flow monitoring method according to claim 1, It is characterized in that In the case where the copied traffic data contains sensitive information, before reconstructing the copied traffic data to obtain the simulated message, the traffic monitoring method further includes: Determine whether the copied traffic data contains the sensitive information.
8. A flow monitoring system, It is characterized in that include: A traffic monitoring module monitors traffic data of interactions between the cluster where the container application is located and other clusters or Internet nodes through load balancing, wherein the cluster includes working nodes and container applications deployed thereon; A traffic processing module distributes and copies the traffic data; A traffic reconstruction module, which reconstructs the copied traffic data to obtain a simulated message when the copied traffic data contains sensitive information, and distributes the simulated message; A node positioning module, when a response message of the simulation message is obtained, locates a message node of the simulation message according to the response message, and uses the message node as a flow node of the flow data; The traffic reconstruction module is specifically used for: For the data header of the copied traffic data, the source address in the data header is modified to the address of the load balancer, and the tracking tag information is added to the data body to obtain the simulation message containing the address of the load balancer and the tracking tag information, so as to receive the candidate traffic through the load balancer and confirm that the candidate traffic is a response message of the simulation message when the tracking tag information is extracted from the candidate traffic.
9. An electronic device, It is characterized in that include: processor; a memory storing executable instructions of the processor; Wherein, the processor is configured to perform the steps of the flow monitoring method described in any one of claims 1 to 7 by executing the executable instructions.
10. A computer-readable storage medium for storing a program, It is characterized in that When the program is executed by a processor, the steps of the flow monitoring method according to any one of claims 1 to 7 are implemented.
