A cloud platform traffic monitoring system, method and apparatus

Abstract

The cloud platform traffic monitoring system, method and device provided by the present disclosure, wherein the system comprises: a database for storing and dynamically maintaining IP addresses held by users and corresponding traffic statistics modes; a gateway monitor for collecting, through a virtual switch, traffic data of the IP addresses accessing the Internet via a virtual machine according to a preset first time period, and writing the traffic data and a collection timestamp into a message queue; a traffic statistic device for reading, from the message queue, traffic data corresponding to the IP addresses within a second time period according to a preset second time period based on a timestamp corresponding to the traffic data, performing traffic data aggregation according to the traffic statistics mode corresponding to the IP addresses and the timestamp corresponding to the traffic data based on the IP address dimension, obtaining traffic aggregation data, and sending the traffic aggregation data to a billing platform to enable the billing platform to generate a traffic consumption bill based on the traffic aggregation data corresponding to the IP addresses and a traffic billing mode matched with the traffic statistics mode.

Description

Technical Field

[0001] This disclosure relates to the field of data processing technology, and more specifically, to a cloud platform traffic monitoring system, method, and apparatus. Background Technology

[0002] In recent years, cloud platforms and their related applications have experienced rapid development. Because cloud platform services can significantly reduce users' hardware purchase and maintenance costs, users can choose cloud platforms as their infrastructure. When deploying services on a cloud platform, it is usually necessary to configure corresponding Elastic Internet Protocol Addresses (EIPs) to enable cloud resources on the platform to communicate with the public network. In cloud platform scenarios, it is necessary to aggregate and monitor the traffic data used by each EIP. Based on the aggregated traffic data, tasks such as billing and adjusting cloud resource configurations can be performed.

[0003] Currently, cloud platform traffic statistics are generally based on big data processing platforms. Big data processing platforms can collect, store, structure, protect privacy, mine, and display results for many types of data. They are feature-rich, have high data throughput, and require a great deal of hardware. For enterprises using private clouds or those that only need to perform traffic data statistics and monitoring, the services provided by big data platforms exceed their energy needs, and the costs of building, deploying, and maintaining them are too high. Summary of the Invention

[0004] This disclosure provides at least one cloud platform traffic monitoring system, method, and apparatus.

[0005] In a first aspect, embodiments of this disclosure provide a cloud platform traffic monitoring system, including:

[0006] The database is used to store and dynamically maintain the IP addresses held by users and the corresponding traffic statistics methods;

[0007] The gateway monitor is used to collect traffic data of the IP address accessing the Internet through the virtual machine through the virtual switch according to a preset first time period, and write the traffic data of the IP address and the corresponding collection timestamp into the message queue.

[0008] The traffic statistics unit is used to read the traffic data of the IP address within the second time period from the message queue according to the timestamp corresponding to the traffic data, based on the IP address dimension, and to aggregate the traffic data according to the traffic statistics method corresponding to the IP address and the collection timestamp corresponding to the traffic data to obtain traffic aggregated data. The traffic aggregated data corresponding to the IP address is sent to the billing platform so that the billing platform can generate a traffic consumption bill based on the traffic billing method that matches the traffic aggregated data corresponding to the IP address and the traffic statistics method.

[0009] In one optional implementation, when the traffic statistics device aggregates traffic data based on the IP address dimension, according to the traffic statistics method corresponding to the IP address and the collection timestamp corresponding to the traffic data, to obtain aggregated traffic data, it is used for:

[0010] For any IP address, when the traffic statistics method is total volume statistics, based on the traffic data corresponding to the earliest and latest collection timestamps within the second time period, the total traffic usage of the IP address within the second time period is determined, and the total traffic usage is used as the traffic aggregation data.

[0011] In one optional implementation, when the traffic statistics device aggregates traffic data based on the IP address dimension, according to the traffic statistics method corresponding to the IP address and the collection timestamp corresponding to the traffic data, to obtain aggregated traffic data, it is used for:

[0012] For any of the IP addresses, when the traffic statistics method is time-segmented statistics, the traffic data is classified based on the time-segmentation classification information indicated by the traffic statistics method and the collection timestamp indicated by the traffic data to obtain traffic data under at least one time segment.

[0013] For each type of time period, based on the traffic data and its corresponding collection timestamp, determine the traffic usage of the IP address in that time period.

[0014] The traffic usage of the IP address under various time periods is used as the aggregated traffic data of the IP address in the second time period.

[0015] In one optional implementation, when the traffic statistics device determines the traffic usage of the IP address during a given time period based on the traffic data and its corresponding collection timestamp, it is used to:

[0016] Based on the collection timestamps of this type of time period, at least one set of continuously collected traffic data is determined;

[0017] For each set of continuous traffic data, based on the difference between the traffic data corresponding to the latest collection timestamp and the earliest collection timestamp in the set of continuous traffic data, the traffic usage of the IP address in the time period corresponding to the set of continuous traffic data is determined.

[0018] Based on the traffic usage of the IP address within the time period corresponding to each group of traffic data, the traffic usage of the IP address in that type of time period is determined.

[0019] In one optional implementation, the gateway monitor is deployed on the cloud platform gateway of the virtual switch; the IP address is an elastic public IP address; the cloud platform gateway is used to convert the local address of a virtual machine with cloud services deployed to the IP address, so that the virtual machine can access the Internet based on the IP address.

[0020] In one optional implementation, the system further includes a display and monitoring platform for:

[0021] Obtain and display aggregated traffic data for the IP address from the traffic statistics tool.

[0022] Secondly, this disclosure also provides a cloud platform traffic monitoring method, including:

[0023] According to a preset second time period, based on the timestamps corresponding to each traffic data stored in the message queue, traffic data corresponding to multiple IP addresses within the second time period is read from the message queue. Based on the IP address dimension, traffic data is aggregated according to the traffic statistics method corresponding to the IP address and the collection timestamps corresponding to the traffic data to obtain aggregated traffic data. The traffic data is the traffic data collected by the gateway monitor through the virtual switch according to a preset first time period when the user's IP address accesses the Internet through the virtual machine.

[0024] The system sends the traffic aggregation data corresponding to the IP address to the billing platform, so that the billing platform can generate a traffic consumption bill based on the traffic aggregation data corresponding to the IP address and the traffic billing method that matches the traffic statistics method.

[0025] In one optional implementation, the step of aggregating traffic data based on the IP address dimension, according to the traffic statistics method corresponding to the IP address and the collection timestamp corresponding to the traffic data, to obtain aggregated traffic data includes:

[0026] For any IP address, when the traffic statistics method is total volume statistics, based on the traffic data corresponding to the earliest and latest collection timestamps within the second time period, the total traffic usage of the IP address within the second time period is determined, and the total traffic usage is used as the traffic aggregation data.

[0027] In one optional implementation, the step of aggregating traffic data based on the IP address dimension, according to the traffic statistics method corresponding to the IP address and the collection timestamp corresponding to the traffic data, to obtain aggregated traffic data includes:

[0028] For any of the IP addresses, when the traffic statistics method is time-segmented statistics, the traffic data is classified based on the time-segmentation classification information indicated by the traffic statistics method and the collection timestamp indicated by the traffic data to obtain traffic data under at least one time segment.

[0029] For each type of time period, based on the traffic data and its corresponding collection timestamp, determine the traffic usage of the IP address in that time period.

[0030] The traffic usage of the IP address under various time periods is used as the aggregated traffic data of the IP address in the second time period.

[0031] In one optional implementation, determining the traffic usage of the IP address during a given time period based on the traffic data and its corresponding collection timestamp includes:

[0032] Based on the collection timestamps of this type of time period, at least one set of continuously collected traffic data is determined;

[0033] For each set of continuous traffic data, based on the difference between the traffic data corresponding to the latest collection timestamp and the earliest collection timestamp in the set of continuous traffic data, the traffic usage of the IP address in the time period corresponding to the set of continuous traffic data is determined.

[0034] Based on the traffic usage of the IP address within the time period corresponding to each group of traffic data, the traffic usage of the IP address in that type of time period is determined.

[0035] In one optional implementation, the gateway monitor is deployed on the cloud platform gateway of the virtual switch; the IP address is an elastic public IP address; the cloud platform gateway is used to convert the local address of a virtual machine with cloud services deployed to the IP address, so that the virtual machine can access the Internet based on the IP address.

[0036] In one optional implementation, the method further includes:

[0037] The traffic aggregation data of the IP address is sent to the display and monitoring platform so that the display and monitoring platform can display the traffic aggregation data of the IP address.

[0038] Thirdly, this disclosure also provides a cloud platform traffic monitoring device, comprising:

[0039] The acquisition module is used to read traffic data corresponding to multiple IP addresses within the second time period from the message queue based on the timestamps corresponding to each traffic data stored in the message queue according to the preset second time period, and to aggregate the traffic data based on the IP address dimension according to the traffic statistics method corresponding to the IP address and the collection timestamps corresponding to the traffic data to obtain traffic aggregated data. The traffic data is the traffic data collected by the gateway monitor through the virtual switch according to the preset first time period when the user's IP address accesses the Internet through the virtual machine.

[0040] The sending module is used to send the traffic aggregation data corresponding to the IP address to the billing platform, so that the billing platform can generate a traffic consumption bill based on the traffic aggregation data corresponding to the IP address and the traffic billing method that matches the traffic statistics method.

[0041] In one possible implementation, when the acquisition module aggregates traffic data based on the IP address dimension, according to the traffic statistics method corresponding to the IP address and the collection timestamp corresponding to the traffic data, to obtain aggregated traffic data, it is used for:

[0042] For any IP address, when the traffic statistics method is total volume statistics, based on the traffic data corresponding to the earliest and latest collection timestamps within the second time period, the total traffic usage of the IP address within the second time period is determined, and the total traffic usage is used as the traffic aggregation data.

[0043] In one possible implementation, when the acquisition module aggregates traffic data based on the IP address dimension, according to the traffic statistics method corresponding to the IP address and the collection timestamp corresponding to the traffic data, to obtain aggregated traffic data, it is used for:

[0044] For any of the IP addresses, when the traffic statistics method is time-segmented statistics, the traffic data is classified based on the time-segmentation classification information indicated by the traffic statistics method and the collection timestamp indicated by the traffic data to obtain traffic data under at least one time segment.

[0045] For each type of time period, based on the traffic data and its corresponding collection timestamp, determine the traffic usage of the IP address in that time period.

[0046] The traffic usage of the IP address under various time periods is used as the aggregated traffic data of the IP address in the second time period.

[0047] In one possible implementation, when the acquisition module determines the traffic usage of the IP address during a given time period based on the traffic data and its corresponding collection timestamp, it is used to:

[0048] Based on the collection timestamps of this type of time period, at least one set of continuously collected traffic data is determined;

[0049] For each set of continuous traffic data, based on the difference between the traffic data corresponding to the latest collection timestamp and the earliest collection timestamp in the set of continuous traffic data, the traffic usage of the IP address in the time period corresponding to the set of continuous traffic data is determined.

[0050] Based on the traffic usage of the IP address within the time period corresponding to each group of traffic data, the traffic usage of the IP address in that type of time period is determined.

[0051] In one possible implementation, the gateway monitor is deployed on the cloud platform gateway of the virtual switch; the IP address is an elastic public IP address; the cloud platform gateway is used to convert the local address of a virtual machine with cloud services deployed to the IP address, so that the virtual machine can access the Internet based on the IP address.

[0052] In one possible implementation, the device further includes a display and monitoring module for:

[0053] The traffic aggregation data of the IP address is sent to the display and monitoring platform so that the display and monitoring platform can display the traffic aggregation data of the IP address.

[0054] Fourthly, embodiments of this disclosure also provide an electronic device, including: a processor, a memory, and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor communicates with the memory via the bus, and when the machine-readable instructions are executed by the processor, the steps of the second aspect above, or any possible implementation of the second aspect, are performed.

[0055] Fifthly, embodiments of this disclosure also provide a computer-readable storage medium storing a computer program that, when executed by a processor, performs the steps of the second aspect described above, or any possible implementation of the second aspect.

[0056] This disclosure provides a cloud platform traffic monitoring system, method, and apparatus. The cloud platform traffic monitoring system includes only a database, a gateway monitor, and a traffic counter. The database stores and dynamically maintains the IP addresses held by users and their corresponding traffic statistics methods. The gateway monitor collects traffic data corresponding to IP addresses according to a preset first time period and writes the traffic data and the corresponding collection timestamp into a message queue. The traffic counter reads the traffic data of IP addresses within the second time period from the message queue based on the timestamp corresponding to the traffic data, according to a preset second time period, and aggregates the traffic data based on the IP address dimension to obtain aggregated traffic data, which is then sent to the billing platform so that the billing platform generates a traffic consumption bill based on the traffic aggregation data of the IP address and the traffic billing method that matches the traffic statistics method. In this embodiment, the cloud platform traffic monitoring system includes only a database, a gateway monitor, and a traffic counter. The gateway monitor collects traffic data corresponding to IP addresses from the virtual switch and records the collection timestamp. Then, it aggregates the traffic data based on the IP address dimension to obtain aggregated traffic data and sends it to the billing platform. Compared with the method of counting traffic through a big data processing platform, this system focuses more on counting traffic based on IP addresses, requires fewer modules, and is easier to build, deploy, and maintain.

[0057] To make the above-mentioned objects, features and advantages of this disclosure more apparent and understandable, preferred embodiments are described below in detail with reference to the accompanying drawings. Attached Figure Description

[0058] To more clearly illustrate the technical solutions of the embodiments of this disclosure, the accompanying drawings used in the embodiments will be briefly described below. These drawings are incorporated in and constitute a part of this specification. They illustrate embodiments conforming to this disclosure and, together with the specification, serve to explain the technical solutions of this disclosure. It should be understood that the following drawings only show some embodiments of this disclosure and should not be considered as limiting the scope. Those skilled in the art can obtain other related drawings based on these drawings without creative effort.

[0059] Figure 1 A schematic diagram of a cloud platform traffic monitoring system provided in an embodiment of this disclosure is shown;

[0060] Figure 2A schematic diagram of another cloud platform traffic monitoring system provided in an embodiment of this disclosure is shown;

[0061] Figure 3 A flowchart of a cloud platform traffic monitoring method provided in an embodiment of this disclosure is shown;

[0062] Figure 4 A schematic diagram of a cloud platform traffic monitoring device provided in an embodiment of this disclosure is shown;

[0063] Figure 5 A schematic diagram of a cloud platform traffic monitoring electronic device provided in an embodiment of this disclosure is shown. Detailed Implementation

[0064] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this disclosure, and not all of them. The components of the embodiments of this disclosure described and shown in the accompanying drawings can generally be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of this disclosure provided in the accompanying drawings is not intended to limit the scope of the claimed disclosure, but merely represents selected embodiments of this disclosure. All other embodiments obtained by those skilled in the art based on the embodiments of this disclosure without inventive effort are within the scope of protection of this disclosure.

[0065] It should be noted that similar labels and letters in the following figures indicate similar items. Therefore, once an item is defined in one figure, it does not need to be further defined and explained in subsequent figures.

[0066] In this document, the term "and / or" merely describes a relationship, indicating that three relationships can exist. For example, A and / or B can represent three cases: A alone, A and B simultaneously, and B alone. Furthermore, the term "at least one" in this document means any combination of at least two of any one or more elements. For example, including at least one of A, B, and C can mean including any one or more elements selected from the set consisting of A, B, and C.

[0067] Research has found that cloud platform traffic statistics are generally based on big data processing platforms. These platforms can collect, store, structure, protect privacy, mine, and display results for many types of data, offering comprehensive functionality and high data throughput. However, for enterprises using private clouds or those only performing traffic data statistics, the services provided by big data platforms exceed their energy needs, and the deployment and maintenance costs are excessively high.

[0068] Based on the above research, this disclosure provides a cloud platform traffic monitoring system. It collects traffic data corresponding to IP addresses from virtual switches via a gateway monitor and records the collection timestamp. Then, it aggregates the traffic data based on the IP address dimension to obtain aggregated traffic data, which is then sent to the billing platform. Compared to big data processing platforms, this system primarily serves cloud platform traffic monitoring and offers a higher degree of customization. The system consists only of a database, a gateway monitor, and a traffic counter; its simple structure and small size make it a lightweight cloud platform traffic monitoring and billing system that is easy to build, deploy, and maintain.

[0069] To facilitate understanding of this embodiment, a cloud platform traffic monitoring system disclosed in this disclosure will first be described in detail. The execution subject of the cloud platform traffic monitoring system provided in this disclosure is generally a computer device with certain computing capabilities.

[0070] See Figure 1 The diagram shown is a schematic of a cloud platform traffic monitoring system provided in this embodiment of the present disclosure. The system includes: a database 101, a gateway monitor 102, and a traffic statistician 103. The traffic statistician 103 can communicate with the gateway monitor 102 and the database 101, wherein:

[0071] The database 101 is used to store and dynamically maintain the IP addresses held by users and the corresponding traffic statistics methods.

[0072] A database is a "repository for organizing, storing and managing data according to a data structure." It is a large collection of organized, shareable, and uniformly managed data that is stored in a computer for a long period of time.

[0073] An IP address is a standardized address format provided by the Internet Protocol (IP). It assigns a logical address to every network and every host on the Internet, thereby masking the differences in physical addresses.

[0074] Traffic statistics methods refer to different ways of counting the traffic generated when a user communicates with the public network after creating an IP address. These methods can be total statistics, which counts traffic data from all time periods together with the same billing standard, or they can be classified by time period, such as setting peak time periods, normal time periods, and off-peak time periods, where traffic data needs to be counted separately for different time periods, and the billing standard for each type of time period is different.

[0075] Optionally, users can choose to release their held IP addresses at any time, or change the traffic method corresponding to their held IP addresses at any time. Therefore, the database needs to dynamically update and maintain the stored user IP addresses and traffic statistics methods to make the statistics and monitoring of traffic data more accurate.

[0076] The gateway monitor 102 is used to collect traffic data of the IP address accessing the Internet through the virtual machine via the virtual switch according to a preset first time period, and write the traffic data of the IP address and the corresponding collection timestamp into the message queue.

[0077] Specifically, the first time period is the preset data collection interval of the gateway monitor. The setting of the first time period can be determined according to the time accuracy required by the cloud platform traffic monitoring system, such as a time interval of 5 seconds, 10 seconds or 20 seconds.

[0078] Virtual switches utilize public network resources to form private networks, providing public network users with special switching functions such as virtual private switching extension services. Therefore, they are also known as centralized user small switches or virtual user switches.

[0079] The gateway monitor is deployed on the cloud platform gateway of the virtual switch; the IP address is an elastic public IP address; the cloud platform gateway is used to convert the local address of virtual machines with cloud services deployed to IP address, so that the virtual machines can access the Internet based on the IP address.

[0080] Elastic Internet Protocol Address (EIP) is a type of Internet Protocol IP address. Internet Protocol IP addresses can be categorized into internal IP addresses, EIPs, and virtual IP addresses. An EIP is an independently held public IP address, specifically designed for dynamic cloud computing. Compared to other types of IP addresses, it has the following characteristics: An EIP can be independently held by a user, without needing to be bound to other computing resources; EIPs can be elastically bound, attaching to the required resources when needed and unbinding and releasing them when no longer required; EIPs have configurable network capabilities, allowing bandwidth adjustments to be made immediately. Based on these characteristics, EIPs can be used to communicate with the public network in cloud platform services.

[0081] A gateway, also known as an internetwork connector, is a computer system or device that enables network interconnection at the network layer and above, acting as a converter. A cloud platform gateway is a connection device that connects virtual machines (VMs) deploying cloud service resources on a cloud platform to the internet. In other words, after the cloud service resources required by the user are deployed on the VM, the gateway translates the VM's local address into an EIP (Enterprise IP Address), thereby enabling communication between the VM and the internet. All traffic generated during the communication process needs to pass through the cloud platform gateway. Therefore, by deploying a gateway monitor on the cloud platform gateway, traffic data corresponding to the user's IP address can be collected.

[0082] When collecting traffic data corresponding to an IP address, the gateway monitor also needs to record the collection timestamp of the traffic data to facilitate the calculation of the traffic data corresponding to that IP address within a certain time period. For example, to calculate the traffic usage of a user IP address within a certain time period, the traffic data can be obtained based on the total traffic usage corresponding to the latest collection timestamp and the total traffic usage corresponding to the earliest collection timestamp within that time period.

[0083] A message queue is a container that stores messages during transmission. The main purpose of a queue is to provide routing and ensure message delivery; if the receiver is unavailable when a message is sent, the message queue will retain the message until it can be successfully delivered.

[0084] The traffic statistics unit 103 is used to read the traffic data of the IP address within the second time period from the message queue according to the timestamp corresponding to the traffic data, based on the IP address dimension, and to aggregate the traffic data according to the traffic statistics method corresponding to the IP address and the collection timestamp corresponding to the traffic data to obtain traffic aggregated data. The traffic aggregated data corresponding to the IP address is then sent to the billing platform so that the billing platform can generate a traffic consumption bill based on the traffic aggregated data corresponding to the IP address and the traffic statistics method that match.

[0085] The second time period is the minimum period for the cloud platform traffic monitoring system to generate traffic usage results. The second time period is longer than the first time period. For example, if the first time period is 5 seconds, the second time period can be 30 seconds; if the first time period is 10 seconds, the second time period can be 60 seconds; if the first time period is 15 seconds, the second time period can be 120 seconds.

[0086] Specifically, the calculation methods for traffic data aggregation differ depending on the traffic statistics method:

[0087] (1) For any IP address, when the traffic statistics method is total statistics, based on the traffic data corresponding to the earliest and latest collection timestamps in the second time period, determine the total traffic usage of the IP address in the second time period, and use the total traffic usage as the traffic aggregation data.

[0088] For example, if an IP address generates traffic from 7 PM to 2 AM the next day, and the traffic statistics method is total volume statistics, the aggregated traffic data generated by the IP address from 7 PM to 2 AM the next day can be determined by calculating the total traffic usage corresponding to the latest timestamp of 2 AM the next day and the total traffic usage corresponding to the earliest timestamp of 7 PM.

[0089] (2) For any of the IP addresses, when the traffic statistics method is time-segmented statistics, the traffic data is classified based on the time-segmentation classification information indicated by the traffic statistics method and the collection timestamp indicated by the traffic data to obtain traffic data under at least one time segment.

[0090] For each type of time period, based on the traffic data and its corresponding collection timestamp, the traffic usage of the IP address in that time period is determined. Specifically, based on each collection timestamp in that time period, at least one set of continuously collected traffic data is determined. For each set of continuous traffic data, based on the difference between the traffic data corresponding to the latest and earliest collection timestamps in that set of continuous traffic data, the traffic usage of the IP address in the time period corresponding to that set of continuous traffic data is determined. Based on the traffic usage of the IP address in the time period corresponding to each set of traffic data, the traffic usage of the IP address in that time period is determined.

[0091] The traffic usage of the IP address under various time periods is used as the aggregated traffic data of the IP address in the second time period.

[0092] The time period classification information can be determined based on the traffic data generated in different time periods. Time periods with relatively high traffic data are peak periods, time periods with average traffic data are normal periods, and time periods with relatively low traffic data are off-peak periods. For example, off-peak periods can be from 0:00 to 7:00; normal periods can be from 7:00 to 9:00, 11:00 to 13:00, and 17:00 to 20:00; and peak periods can be from 9:00 to 11:00, 13:00 to 17:00, and 20:00 to 24:00. Traffic generated by a certain IP address occurs between 7 PM and 2 AM the next day. Based on the system's preset time period classification information, it can be divided into three time periods: 7 PM to 8 PM is the normal time period, 8 PM to 12 AM is the peak time period, and 12 AM to 2 AM the next day is the off-peak time period. The traffic generated by this IP address between 7 PM and 8 PM can be aggregated based on the traffic data corresponding to the latest timestamp of 8 PM and the traffic data corresponding to the earliest timestamp of 7 PM to obtain the aggregated traffic data for this time period. The traffic usage for other time periods is calculated in the same way. Finally, the three time periods and their corresponding aggregated traffic data can be obtained.

[0093] The traffic statistics tool sends the aggregated traffic data to the billing platform. The billing platform has the traffic billing standards corresponding to the traffic statistics method. For example, when the traffic statistics method is total volume statistics, the billing standard is the same for all time periods; when the traffic statistics method is time period statistics, the billing standard can be different according to different time periods, such as peak time, normal time and off-peak time. Then, the traffic bill for each IP address is generated by combining the aggregated traffic data collected by the traffic statistics tool.

[0094] In addition to the billing platform, the traffic statistics tool can also send aggregated traffic data to the display and monitoring platform, allowing it to show the aggregated traffic data corresponding to each IP address.

[0095] See Figure 2 The diagram shown is a schematic of another cloud platform traffic monitoring system provided in this embodiment. The cloud platform traffic monitoring system includes: a cloud network external service platform (Vega) 201, a database (DB) 202, a traffic acquisition component (GW-watcher) 203, a traffic storage component (Kafka) 204, a traffic statistics component (GW-biller) 205, a billing platform 206, and a display and monitoring platform 207. In addition, Figure 2 The components also include virtual machines, virtual switches (open vswitch, OVS), the Internet, public network gateway clusters and public network gateway nodes in the clusters. All of the above components are used to communicate and interact with the cloud platform traffic monitoring system, but are not part of the cloud platform traffic monitoring system.

[0096] The cloud network's external service platform 201 is used to obtain relevant information generated after a user creates an EIP, and send the relevant information of this EIP to the database 202. The relevant information may include the EIP's Internet Protocol IP address, traffic statistics method, creation time, and modification time, wherein the modification time refers to the time when the user changes the traffic statistics method.

[0097] The database 202 is used to store relevant information, including traffic statistics methods, corresponding to the EIP.

[0098] The traffic acquisition component 203 is used to collect the traffic data of the EIP and the timestamp of the traffic data collection from the cloud platform gateway according to the first time period, and send the collected relevant information to the traffic storage component 204.

[0099] The cloud platform gateway includes a virtual switch used to translate the user's local address into the EIP, thereby enabling communication between the virtual machine and the Internet. The virtual machine is used to deploy the cloud services required by the user. A virtual machine can communicate with the Internet through different public network gateways on the cloud platform. That is to say, all OVS in the public network gateway cluster may have traffic records of the virtual machine accessing the Internet. At the same time, a public network gateway can enable different virtual machines to communicate with the Internet. That is to say, a public network gateway may have traffic records of different virtual machines accessing the Internet.

[0100] The traffic acquisition component collects traffic data from the virtual machine to the Internet passing through all OVSs according to a first time period, along with the timestamp of the traffic data collection.

[0101] The traffic storage component Kafka 204 is used to store the relevant information sent by the traffic acquisition component 203.

[0102] The traffic statistics component 205 is used to obtain relevant information of the EIP from the traffic storage component 204 according to the second time period, and obtain the traffic statistics method corresponding to the EIP from the database; based on the traffic data and the corresponding collection timestamp, as well as the traffic statistics method, it generates traffic usage statistics results of the EIP within the second time period.

[0103] Specifically, the traffic statistics component acquires the traffic data of the corresponding virtual machine on different public network gateways and the corresponding collection timestamp for each EIP, and generates the traffic aggregation data of the EIP within the second time period.

[0104] The billing platform 206 is used to generate a traffic consumption bill based on the traffic aggregation data corresponding to the IP address and the traffic billing method that matches the traffic statistics method.

[0105] The display and monitoring platform 207 is used to display the traffic aggregation data based on the EIP to the terminal devices of users or systems.

[0106] Based on the same inventive concept, this disclosure also provides a cloud platform traffic monitoring method corresponding to the cloud platform traffic monitoring system.

[0107] Reference Figure 3 The diagram shown is a flowchart of a cloud platform traffic monitoring method provided in this embodiment of the disclosure. The execution entity is a traffic statistician, and the steps of the method include:

[0108] 301: According to a preset second time period, based on the timestamps corresponding to each traffic data stored in the message queue, read traffic data corresponding to multiple IP addresses within the second time period from the message queue, and aggregate the traffic data according to the IP address dimension, the traffic statistics method corresponding to the IP address and the collection timestamps corresponding to the traffic data, to obtain aggregated traffic data. The traffic data is the traffic data collected by the gateway monitor through the virtual switch from the user's IP address to access the Internet via the virtual machine according to a preset first time period.

[0109] 302: Send the traffic aggregation data corresponding to the IP address to the billing platform so that the billing platform can generate a traffic consumption bill based on the traffic aggregation data corresponding to the IP address and the traffic billing method that matches the traffic statistics method.

[0110] The calculation method for traffic aggregation data differs depending on the traffic statistics method corresponding to the IP address.

[0111] For any IP address, when the traffic statistics method is total volume statistics, based on the traffic data corresponding to the earliest and latest collection timestamps within the second time period, the total traffic usage of the IP address within the second time period is determined, and the total traffic usage is used as the traffic aggregation data.

[0112] For any given IP address, when the traffic statistics method is time-segmented statistics, the traffic data is classified based on the time-segmentation classification information indicated by the traffic statistics method and the collection timestamp indicated by the traffic data, resulting in traffic data for at least one time segment. Specifically, based on each collection timestamp within this time segment, at least one set of continuously collected traffic data is determined. For each set of continuous traffic data, the traffic usage of the IP address within the time segment corresponding to the latest and earliest collection timestamps within that set of continuous traffic data is determined. Based on the traffic usage of the IP address within the time segments corresponding to each set of traffic data, the traffic usage of the IP address within this time segment is determined. For each time segment, the traffic usage of the IP address within that time segment is determined based on the traffic data within that time segment and its corresponding collection timestamp.

[0113] The traffic usage of the IP address under various time periods is used as the aggregated traffic data of the IP address in the second time period.

[0114] The gateway monitor is deployed on the cloud platform gateway of the virtual switch; the IP address is an elastic public IP address; the cloud platform gateway is used to convert the local address of the virtual machine with cloud services deployed to the IP address, so that the virtual machine can access the Internet based on the IP address.

[0115] In addition, the cloud platform traffic monitoring method further includes: sending the traffic aggregation data of the IP address to the display and monitoring platform so that the display and monitoring platform can display the traffic aggregation data of the IP address.

[0116] Those skilled in the art will understand that, in the above-described method of the specific implementation, the order in which each step is written does not imply a strict execution order and does not constitute any limitation on the implementation process. The specific execution order of each step should be determined by its function and possible internal logic.

[0117] Based on the same inventive concept, this disclosure also provides a cloud platform traffic monitoring device corresponding to the cloud platform traffic monitoring method. Since the principle of the device in this disclosure for solving the problem is similar to the cloud platform traffic monitoring method described above in this disclosure, the implementation of the device can refer to the implementation of the method, and the repeated parts will not be described again.

[0118] Reference Figure 4 The diagram shown is a schematic of a cloud platform traffic monitoring device provided in an embodiment of this disclosure. The device includes:

[0119] The acquisition module 401 is used to read traffic data corresponding to multiple IP addresses within the second time period from the message queue based on the timestamps corresponding to each traffic data stored in the message queue according to the preset second time period, and to aggregate the traffic data based on the IP address dimension according to the traffic statistics method corresponding to the IP address and the collection timestamps corresponding to the traffic data to obtain traffic aggregated data. The traffic data is the traffic data collected by the gateway monitor through the virtual switch according to the preset first time period when the user's IP address accesses the Internet through the virtual machine.

[0120] The sending module 403 is used to send the traffic aggregation data corresponding to the IP address to the billing platform, so that the billing platform can generate a traffic consumption bill based on the traffic aggregation data corresponding to the IP address and the traffic billing method that matches the traffic statistics method.

[0121] In one possible implementation, when the acquisition module 401 aggregates traffic data based on the IP address dimension, according to the traffic statistics method corresponding to the IP address and the collection timestamp corresponding to the traffic data, to obtain aggregated traffic data, it is used for:

[0122] For any IP address, when the traffic statistics method is total volume statistics, based on the traffic data corresponding to the earliest and latest collection timestamps within the second time period, the total traffic usage of the IP address within the second time period is determined, and the total traffic usage is used as the traffic aggregation data.

[0123] In one possible implementation, when the acquisition module 401 aggregates traffic data based on the IP address dimension, according to the traffic statistics method corresponding to the IP address and the collection timestamp corresponding to the traffic data, to obtain aggregated traffic data, it is used for:

[0124] For any of the IP addresses, when the traffic statistics method is time-segmented statistics, the traffic data is classified based on the time-segmentation classification information indicated by the traffic statistics method and the collection timestamp indicated by the traffic data to obtain traffic data under at least one time segment.

[0125] For each type of time period, based on the traffic data and its corresponding collection timestamp, determine the traffic usage of the IP address in that time period.

[0126] The traffic usage of the IP address under various time periods is used as the aggregated traffic data of the IP address in the second time period.

[0127] In one possible implementation, when the acquisition module 401 determines the traffic usage of the IP address during a given time period based on the traffic data and its corresponding collection timestamp, it is used to:

[0128] Based on the collection timestamps of this type of time period, at least one set of continuously collected traffic data is determined;

[0129] For each set of continuous traffic data, based on the difference between the traffic data corresponding to the latest collection timestamp and the earliest collection timestamp in the set of continuous traffic data, the traffic usage of the IP address in the time period corresponding to the set of continuous traffic data is determined.

[0130] Based on the traffic usage of the IP address within the time period corresponding to each group of traffic data, the traffic usage of the IP address in that type of time period is determined.

[0131] In one possible implementation, the gateway monitor is deployed on the cloud platform gateway of the virtual switch; the IP address is an elastic public IP address; the cloud platform gateway is used to convert the local address of a virtual machine with cloud services deployed to the IP address, so that the virtual machine can access the Internet based on the IP address.

[0132] In one possible implementation, the device further includes a display and monitoring module for:

[0133] The traffic aggregation data of the IP address is sent to the display and monitoring platform so that the display and monitoring platform can display the traffic aggregation data of the IP address.

[0134] The processing flow of each module in the device and the interaction flow between each module can be referred to the relevant descriptions in the above method embodiments, and will not be detailed here.

[0135] Corresponding to Figure 1 In the cloud platform traffic monitoring system, this disclosure also provides an electronic device 500, such as... Figure 5 The diagram shown is a structural schematic of an electronic device 500 provided in an embodiment of this disclosure, including:

[0136] The system includes a processor 51, a memory 52, and a bus 53. The memory 52 stores execution instructions and includes a main memory 521 and an external memory 522. The main memory 521, also known as internal memory, is used to temporarily store the computational data in the processor 51, as well as data exchanged with external memory such as a hard disk. The processor 51 exchanges data with the external memory 522 through the main memory 521. When the electronic device 500 is running, the processor 51 and the memory 52 communicate through the bus 53, enabling the processor 51 to execute the following instructions when used in the traffic statistics module:

[0137] According to a preset second time period, based on the timestamps corresponding to each traffic data stored in the message queue, traffic data corresponding to multiple IP addresses within the second time period is read from the message queue. Based on the IP address dimension, traffic data is aggregated according to the traffic statistics method corresponding to the IP address and the collection timestamps corresponding to the traffic data to obtain aggregated traffic data. The traffic data is the traffic data collected by the gateway monitor through the virtual switch according to a preset first time period when the user's IP address accesses the Internet through the virtual machine.

[0138] The system sends the traffic aggregation data corresponding to the IP address to the billing platform, so that the billing platform can generate a traffic consumption bill based on the traffic aggregation data corresponding to the IP address and the traffic billing method that matches the traffic statistics method.

[0139] In one optional implementation, the instructions executed by the processor 51, wherein the step of aggregating traffic data based on the IP address dimension, according to the traffic statistics method corresponding to the IP address and the collection timestamp corresponding to the traffic data, to obtain aggregated traffic data, includes:

[0140] For any IP address, when the traffic statistics method is total volume statistics, based on the traffic data corresponding to the earliest and latest collection timestamps within the second time period, the total traffic usage of the IP address within the second time period is determined, and the total traffic usage is used as the traffic aggregation data.

[0141] In one optional implementation, the instructions executed by the processor 51, wherein the step of aggregating traffic data based on the IP address dimension, according to the traffic statistics method corresponding to the IP address and the collection timestamp corresponding to the traffic data, to obtain aggregated traffic data, includes:

[0142] For any of the IP addresses, when the traffic statistics method is time-segmented statistics, the traffic data is classified based on the time-segmentation classification information indicated by the traffic statistics method and the collection timestamp indicated by the traffic data to obtain traffic data under at least one time segment.

[0143] For each type of time period, based on the traffic data and its corresponding collection timestamp, determine the traffic usage of the IP address in that time period.

[0144] The traffic usage of the IP address under various time periods is used as the aggregated traffic data of the IP address in the second time period.

[0145] In one optional implementation, the instructions executed by the processor 51, wherein determining the traffic usage of the IP address during the specified time period based on the traffic data and its corresponding collection timestamp, includes:

[0146] Based on the collection timestamps of this type of time period, at least one set of continuously collected traffic data is determined;

[0147] For each set of continuous traffic data, based on the difference between the traffic data corresponding to the latest collection timestamp and the earliest collection timestamp in the set of continuous traffic data, the traffic usage of the IP address in the time period corresponding to the set of continuous traffic data is determined.

[0148] Based on the traffic usage of the IP address within the time period corresponding to each group of traffic data, the traffic usage of the IP address in that type of time period is determined.

[0149] In one optional implementation, in the instructions executed by the processor 51, the gateway monitor is deployed on the cloud platform gateway of the virtual switch; the IP address is an elastic public IP address; the cloud platform gateway is used to convert the local address of a virtual machine with cloud services deployed to the IP address, so that the virtual machine can access the Internet based on the IP address.

[0150] In an optional implementation, the processor 51 is further configured to perform:

[0151] The traffic aggregation data of the IP address is sent to the display and monitoring platform so that the display and monitoring platform can display the traffic aggregation data of the IP address.

[0152] The processing flow for each structure in the electronic device can be found in the relevant descriptions in the above method embodiments, and will not be detailed here.

[0153] This disclosure also provides a computer-readable storage medium storing a computer program, which, when executed by a processor, performs the steps of the cloud platform traffic monitoring method described in the above-described method embodiments. The storage medium can be a volatile or non-volatile computer-readable storage medium.

[0154] This disclosure also provides a computer program product carrying program code. The program code includes instructions that can be used to execute the steps of the cloud platform traffic monitoring method described in the above method embodiments. For details, please refer to the above method embodiments, which will not be repeated here.

[0155] The aforementioned computer program product can be implemented through hardware, software, or a combination thereof. In one optional embodiment, the computer program product is specifically embodied in a computer storage medium; in another optional embodiment, the computer program product is specifically embodied in a software product, such as a software development kit (SDK), etc.

[0156] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems and devices described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here. In the several embodiments provided in this disclosure, it should be understood that the disclosed systems, devices, and methods can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of units is only a logical functional division; in actual implementation, there may be other division methods. Furthermore, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Another point is that the displayed or discussed mutual coupling or direct coupling or communication connection may be through some communication interfaces; the indirect coupling or communication connection of devices or units may be electrical, mechanical, or other forms.

[0157] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0158] In addition, the functional units in the various embodiments of this disclosure can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0159] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a processor-executable, non-volatile, computer-readable storage medium. Based on this understanding, the technical solution of this disclosure, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this disclosure. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0160] Finally, it should be noted that the above-described embodiments are merely specific implementations of this disclosure, used to illustrate the technical solutions of this disclosure, and not to limit it. The protection scope of this disclosure is not limited thereto. Although this disclosure has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that any person skilled in the art can still modify or easily conceive of changes to the technical solutions described in the foregoing embodiments, or make equivalent substitutions for some of the technical features, within the scope of the technology disclosed in this disclosure. Such modifications, changes, or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of this disclosure, and should all be covered within the protection scope of this disclosure. Therefore, the protection scope of this disclosure should be determined by the protection scope of the claims.

Claims

1. A cloud platform traffic monitoring system, characterized in that, include: The database is used to store and dynamically maintain the IP addresses held by users and the corresponding traffic statistics methods; The gateway monitor is used to collect traffic data of the IP address accessing the Internet through the virtual machine through the virtual switch according to a preset first time period, and write the traffic data of the IP address and the corresponding collection timestamp into the message queue. A traffic statistics unit is used to read traffic data of the IP address within the second time period from the message queue based on the timestamp corresponding to the traffic data, according to a preset second time period. Based on the IP address dimension, it aggregates the traffic data according to the traffic statistics method corresponding to the IP address and the collection timestamp corresponding to the traffic data, obtaining aggregated traffic data. This aggregated traffic data is then sent to the billing platform, enabling the billing platform to generate a traffic consumption bill based on the traffic billing method matching the aggregated traffic data and the traffic statistics method. The gateway monitor is deployed on the cloud platform gateway of the virtual switch; the IP address is an elastic public IP address; the cloud platform gateway is used to convert the local address of the virtual machine with cloud services deployed to the IP address, so that the virtual machine can access the Internet based on the IP address.

2. The system according to claim 1, characterized in that, When the traffic statistics device aggregates traffic data based on the IP address dimension, according to the traffic statistics method corresponding to the IP address and the collection timestamp corresponding to the traffic data, to obtain aggregated traffic data, it is used for: For any IP address, when the traffic statistics method is total volume statistics, based on the traffic data corresponding to the earliest and latest collection timestamps within the second time period, the total traffic usage of the IP address within the second time period is determined, and the total traffic usage is used as the traffic aggregation data.

3. The system according to claim 1, characterized in that, When the traffic statistics device aggregates traffic data based on the IP address dimension, according to the traffic statistics method corresponding to the IP address and the collection timestamp corresponding to the traffic data, to obtain aggregated traffic data, it is used for: For any of the IP addresses, when the traffic statistics method is time-segmented statistics, the traffic data is classified based on the time-segmentation classification information indicated by the traffic statistics method and the collection timestamp indicated by the traffic data to obtain traffic data under at least one time segment. For each type of time period, based on the traffic data and its corresponding collection timestamp, determine the traffic usage of the IP address in that time period. The traffic usage of the IP address under various time periods is used as the aggregated traffic data of the IP address in the second time period.

4. The system according to claim 3, characterized in that, When the traffic statistics device determines the traffic usage of the IP address during a given time period based on the traffic data and its corresponding collection timestamp, it is used for: Based on the collection timestamps of this type of time period, at least one set of continuously collected traffic data is determined; For each set of continuous traffic data, based on the difference between the traffic data corresponding to the latest collection timestamp and the earliest collection timestamp in the set of continuous traffic data, the traffic usage of the IP address in the time period corresponding to the set of continuous traffic data is determined. Based on the traffic usage of the IP address within the time period corresponding to each group of traffic data, the traffic usage of the IP address in that type of time period is determined.

5. The system according to claim 1, characterized in that, The system also includes a display and monitoring platform for: Obtain and display aggregated traffic data for the IP address from the traffic statistics tool.

6. A cloud platform traffic monitoring method, characterized in that, include: According to a preset second time period, based on the timestamps corresponding to each traffic data stored in the message queue, traffic data corresponding to multiple IP addresses within the second time period is read from the message queue. Based on the IP address dimension, traffic data is aggregated according to the traffic statistics method corresponding to the IP address and the collection timestamps corresponding to the traffic data to obtain aggregated traffic data. The traffic data is the traffic data collected by the gateway monitor through the virtual switch according to a preset first time period when the user's IP address accesses the Internet through the virtual machine. The system sends the traffic aggregation data corresponding to the IP address to the billing platform, so that the billing platform can generate a traffic consumption bill based on the traffic aggregation data corresponding to the IP address and the traffic billing method that matches the traffic statistics method. The gateway monitor is deployed on the cloud platform gateway of the virtual switch; the IP address is an elastic public IP address; the cloud platform gateway is used to convert the local address of the virtual machine with cloud services deployed to the IP address, so that the virtual machine can access the Internet based on the IP address.

7. The method according to claim 6, characterized in that, The traffic data is aggregated based on the IP address dimension, according to the traffic statistics method corresponding to the IP address and the collection timestamp corresponding to the traffic data, to obtain aggregated traffic data, including: For any IP address, when the traffic statistics method is total volume statistics, based on the traffic data corresponding to the earliest and latest collection timestamps within the second time period, the total traffic usage of the IP address within the second time period is determined, and the total traffic usage is used as the traffic aggregation data.

8. The method according to claim 6, characterized in that, The traffic data is aggregated based on the IP address dimension, according to the traffic statistics method corresponding to the IP address and the collection timestamp corresponding to the traffic data, to obtain aggregated traffic data, including: For any of the IP addresses, when the traffic statistics method is time-segmented statistics, the traffic data is classified based on the time-segmentation classification information indicated by the traffic statistics method and the collection timestamp indicated by the traffic data to obtain traffic data under at least one time segment. For each type of time period, based on the traffic data and its corresponding collection timestamp, determine the traffic usage of the IP address in that time period. The traffic usage of the IP address under various time periods is used as the aggregated traffic data of the IP address in the second time period.

9. The method according to claim 8, characterized in that, The determination of the traffic usage of the IP address during this time period based on the traffic data and its corresponding collection timestamp includes: Based on the collection timestamps of this type of time period, at least one set of continuously collected traffic data is determined; For each set of continuous traffic data, based on the difference between the traffic data corresponding to the latest collection timestamp and the earliest collection timestamp in the set of continuous traffic data, the traffic usage of the IP address in the time period corresponding to the set of continuous traffic data is determined. Based on the traffic usage of the IP address within the time period corresponding to each group of traffic data, the traffic usage of the IP address in that type of time period is determined.

10. The method according to claim 6, characterized in that, The method further includes: The traffic aggregation data of the IP address is sent to the display and monitoring platform so that the display and monitoring platform can display the traffic aggregation data of the IP address.

11. A cloud platform traffic monitoring device, characterized in that, include: The acquisition module is used to read traffic data corresponding to multiple IP addresses within the second time period from the message queue based on the timestamps corresponding to each traffic data stored in the message queue according to the preset second time period, and to aggregate the traffic data based on the IP address dimension according to the traffic statistics method corresponding to the IP address and the collection timestamps corresponding to the traffic data to obtain traffic aggregated data. The traffic data is the traffic data collected by the gateway monitor through the virtual switch according to the preset first time period when the user's IP address accesses the Internet through the virtual machine. The sending module is used to send the traffic aggregation data corresponding to the IP address to the billing platform, so that the billing platform can generate a traffic consumption bill based on the traffic aggregation data corresponding to the IP address and the traffic billing method that matches the traffic statistics method. The gateway monitor is deployed on the cloud platform gateway of the virtual switch; the IP address is an elastic public IP address; the cloud platform gateway is used to convert the local address of the virtual machine with cloud services deployed to the IP address, so that the virtual machine can access the Internet based on the IP address.

12. An electronic device, characterized in that, include: The device includes a processor, a memory, and a bus. The memory stores machine-readable instructions executable by the processor. When the electronic device is running, the processor communicates with the memory via the bus. When the machine-readable instructions are executed by the processor, the steps of the cloud platform traffic monitoring method as described in any one of claims 6 to 10 are performed.

13. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, performs the steps of the cloud platform traffic monitoring method as described in any one of claims 6 to 10.

Images