Method and system for realizing cloud environment bypass monitoring by utilizing public cloud storage

Abstract

The invention provides a method and system for realizing cloud environment bypass monitoring by utilizing public cloud storage, and the method comprises the following steps: a PA service flow collection step: a PA captures the flow on a VM communication port in real time, extracts a useful data packet according to a service filtering rule, and stores the useful data packet in a shared storage in a pcap format; a step that the PKTM reads the service flow: the PKTM reads the abstract file information in the shared storage in real time, extracts a data packet in the file, and submits the data packet to the DP in a shared memory mode; and a DP decoding analysis step: carrying out DP decoding analysis, analyzing the data packet according to configuration and a protocol format, generating a service original record, carrying out aggregation calculation on a specified field, generating multi-dimensional index data, generating real-time alarm, multi-dimensional statistics and alarm records according to the multi-dimensional index data, and sending the alarm records to a monitoring platform. The method is wide in applicability, influences on cloud services are as little as possible, the bandwidth of a service network is not occupied, and influences on communication between service nodes are avoided.

Description

technical field [0001] The present invention relates to the field of network communication, in particular to a method and system for implementing cloud environment bypass monitoring by utilizing public cloud storage. Background technique [0002] Real-time collection of network service traffic for decoding and statistical analysis is the current mainstream operation and maintenance monitoring solution. The main advantage of this method is bypass monitoring and no intrusion into the business. It has the least impact on the business among all operation and maintenance monitoring solutions. [0003] In a traditional environment, network traffic collection is to aggregate and export business traffic through switch port mirroring. A TAP device may also be required to aggregate and filter the traffic exported by multiple switches, and then send it to the monitoring system for decoding, analysis and statistics. [0004] However, with the increasing proportion of cloud services in v...

AI Technical Summary

Problems solved by technology

[0006] 1) Most public clouds do not provide business traffic mirroring services, and cannot use traditional environment switch port mirroring to collect traffic;

[0007] 2) The local area network in the public cloud may be distributed in different nodes, and the network intercommunication between virtual machines is limited, and the transmission of protocol traffic such as GRE, vxlan, and MPLS may not be supported;

However, the above solutions are only aimed at the performance indicators of servers or containers in the cloud environment, and are limited to the occupancy of resources such as CPU, memory, and disk. These monitoring data can monitor whether the server and container resources are overloaded at the time, but cannot monitor the server or container. Is the application working properly

Unable to fully meet the needs of users to monitor cloud environment applications

Images