Data transmission alarm method, device and equipment and storage medium

Abstract

The embodiment of the invention relates to the technical field of data processing, in particular to a data transmission alarm method, device and equipment and a storage medium, and aims to realize real-time monitoring alarm of cloud private line traffic. The method comprises the following steps: a resource pool acquisition machine sends port time sequence data of a switch to a monitoring platform every other preset time period; the monitoring platform sends the port time sequence data to a data transmission assembly; the data transmission component associates the port time sequence data with corresponding tenant information and service information; the data transmission component sends the port time sequence data associated with the tenant information and the service information to a cloud monitoring background; the cloud monitoring background calculates a value of a preset monitoring index according to the port time sequence data; and the cloud monitoring background pushes alarm information to a user through a preset alarm rule according to a preset threshold value corresponding to the monitoring index.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of network technology, and in particular to a data transmission alarm method, apparatus, device and storage medium. Background Art

[0002] Cloud dedicated line is used to build a high-speed, low-latency, stable and secure dedicated connection channel between the user's local data center and the virtual private cloud (VPC) on the cloud, which can meet the customer's business needs for large amounts of data. In order to ensure the stable operation of the business, it is necessary to monitor and alarm the data transmission status of the cloud dedicated line in real time. In the existing technology, the traffic data status is generally checked by actively querying the data transmission status.

[0003] In the prior art, it is impossible to analyze and process the stock data and generate threshold alarms, and it is also impossible to display alarm information to the corresponding users in real time. Summary of the invention

[0004] The embodiments of the present application provide a data transmission alarm method, apparatus, device and storage medium, which are intended to implement real-time monitoring and alarm of cloud dedicated line traffic.

[0005] A first aspect of an embodiment of the present application provides a data transmission alarm method, the method comprising: The resource pool collector sends the switch port timing data to the monitoring platform at a preset time interval; The monitoring platform sends the port timing data to the data transmission component; The data transmission component associates the port timing data with corresponding tenant information and business information; The data transmission component sends the port timing data associated with the tenant information and the service information to the cloud monitoring background; The cloud monitoring backend calculates the value of the preset monitoring indicator according to the port timing data; The cloud monitoring backend pushes alarm information to the user according to the preset threshold value corresponding to the monitoring indicator and the preset alarm rule.

[0006] Optionally, the method further comprises: When the cloud monitoring backend receives an information viewing instruction, determining the tenant corresponding to the information viewing instruction; The cloud monitoring backend sends the time series data information corresponding to the tenant to the cloud monitoring console.

[0007] Optionally, the resource pool collector sends the port timing data of the switch to the monitoring platform every preset time period, including: The resource pool collector collects the port timing data from the switch through a pre-configured gateway monitoring protocol at intervals of a preset time period; The resource pool collector sends the port timing data to the monitoring platform.

[0008] Optionally, the data transmission component associates the port timing data with corresponding tenant information and business information, including: the data transmission component determines the tenant information and business information corresponding to the port timing data according to the port information carried in the port timing data; The data transmission component encapsulates the tenant information, the service information and the port timing data into the same data packet.

[0009] Optionally, before the data transmission component associates the port timing data with corresponding tenant information and service information, the method further includes: The data transmission component establishes a message queue of corresponding length according to the flow size of the port timing data; The data transmission component creates a corresponding number of coroutines according to the length of the message queue; The data transmission component puts the port timing data into the message queue.

[0010] Optionally, the cloud monitoring backend calculates the value of a preset monitoring indicator according to the port timing data, including: The cloud monitoring backend writes a corresponding query statement according to the time series data; The cloud monitoring backend aggregates the time series data of all time periods of the tenant corresponding to the time series data according to the query statement; The cloud monitoring backend calculates the value of the monitoring indicator corresponding to the tenant based on the aggregated time series data.

[0011] Optionally, the cloud monitoring backend pushes alarm information to the user according to a preset threshold value corresponding to the monitoring indicator through a preset alarm rule, including: When the value of the monitoring indicator does not meet the preset threshold, a corresponding alarm message is generated; When the alarm information complies with the alarm rule, the alarm information is sent to the cloud monitoring console.

[0012] A second aspect of an embodiment of the present application provides a data transmission alarm device, the device comprising: The data collection module is used for the resource pool collector to send the port timing data of the switch to the monitoring platform at a preset time interval; A first data sending module, used for the monitoring platform to send the port timing data to the data transmission component; A data association module, used for the data transmission component to associate the port timing data with corresponding tenant information and business information; A second data sending module, used for the data transmission component to send the port timing data associated with the tenant information and the business information to the cloud monitoring background; An indicator calculation module, used for the cloud monitoring background to calculate the value of a preset monitoring indicator according to the port timing data; The alarm module is used for the cloud monitoring background to push alarm information to users according to the preset thresholds corresponding to the monitoring indicators through preset alarm rules.

[0013] Optionally, the device further comprises: A switch determination module, configured to determine a tenant corresponding to an information viewing instruction when the cloud monitoring backend receives the information viewing instruction; The switch information sending module is used for the cloud monitoring background to send the time series data information corresponding to the tenant to the cloud monitoring console.

[0014] Optionally, the data acquisition module includes: A data collection submodule, used for the resource pool collector to collect the port timing data from the switch through a pre-configured gateway monitoring protocol at every preset time period; The data sending submodule is used for the resource pool collector to send the port timing data to the monitoring platform.

[0015] Optionally, the data association module includes: a data determination submodule, which is used for the data transmission component to determine the tenant information and the service information corresponding to the port timing data according to the port information carried in the port timing data; The data encapsulation submodule is used for the data transmission component to encapsulate the tenant information, the service information and the port timing data into the same data packet.

[0016] Optionally, the device further comprises: A message queue establishment submodule, used for the data transmission component to establish a message queue of corresponding length according to the flow size of the port timing data; A coroutine creation submodule, used for the data transmission component to create a corresponding number of coroutines according to the length of the message queue; The data placement submodule is used for the data transmission component to place the port timing data into the message queue.

[0017] Optionally, the indicator calculation module includes: A statement writing submodule is used for the cloud monitoring backend to write corresponding query statements according to the time series data; A data aggregation submodule, used for the cloud monitoring backend to aggregate the time series data of all time periods of the tenant corresponding to the time series data according to the query statement; The indicator calculation submodule is used for the cloud monitoring background to calculate the value of the monitoring indicator corresponding to the tenant based on the aggregated time series data.

[0018] Optionally, the alarm module includes: An alarm information generation submodule is used to generate corresponding alarm information when the value of the monitoring indicator does not meet the preset threshold; The alarm information sending submodule is used to send the alarm information to the cloud monitoring console when the alarm information meets the alarm rule.

[0019] A third aspect of an embodiment of the present application provides a readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps in the method described in the first aspect of the present application are implemented.

[0020] A fourth aspect of an embodiment of the present application provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the steps of the method described in the first aspect of the present application are implemented.

[0021] By adopting the data transmission alarm method provided by the present application, the resource pool collector sends the port timing data of the switch to the monitoring platform every preset time period; the monitoring platform sends the port timing data to the data transmission component; the data transmission component associates the port timing data with the corresponding tenant information and business information; the data transmission component sends the port timing data associated with the tenant information and the business information to the cloud monitoring background; the cloud monitoring background calculates the value of the preset monitoring indicator based on the port timing data; the cloud monitoring background pushes the alarm information to the user through the preset alarm rule according to the preset threshold value corresponding to the monitoring indicator.

[0022] In this method, the real-time port data of the switch is collected through the monitoring platform, and then the real-time port data is associated with tenant information and business information through the transmission component. Then, various monitoring indicators of the switch are calculated through the cloud monitoring background. Finally, according to the preset thresholds corresponding to the monitoring indicators and combined with the preset alarm rules, alarm information is pushed to the user, realizing real-time monitoring and alarm of cloud dedicated line traffic. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the description of the embodiments of the present application will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0024] Figure 1 This is a diagram of the cloud dedicated line network group; Figure 2 It is the HTTP method to query the traffic graph; Figure 3 This is the Kafka traffic diagram; Figure 4 is a flow chart of a data transmission alarm method proposed in an embodiment of the present application; Figure 5 This is a data display effect diagram that does not use data transmission components for processing; Figure 6 This is a data display effect diagram after being processed by the data transmission component proposed in one embodiment of the present application; Figure 7 This is a data transmission flow interaction diagram proposed in an embodiment of the present application; Figure 8 It is a cloud network service logic diagram proposed in an embodiment of the present application; Fig. 9 is a schematic diagram of a data transmission alarm device proposed in an embodiment of the present application; Fig.10 It is a schematic diagram of an electronic device proposed in an embodiment of the present application. DETAILED DESCRIPTION

[0025] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0026] refer to Figure 1 , Figure 1This is a diagram of the cloud dedicated line network group. Cloud dedicated line is a network service technology that connects enterprise data centers and cloud vendors' virtual private networks, providing a stable and reliable high-speed interconnection channel for enterprise private networks to the cloud. The Overay network is a virtual network built on the Underlay network. Through tunnel encapsulation and other technologies, it virtualizes and abstracts the underlying physical connection to achieve a logical network structure. The function of the Overay network is to isolate data traffic between different virtual networks and allow it to cross multiple physical networks to achieve flexible network segmentation and security isolation. The Underay network is the underlying physical network that the Overlay network relies on. It is mainly composed of physical devices (such as routers and switches) and is responsible for transmitting data in the data center Q, enterprise or wide area network environment. It provides a real transmission path for data packets and guarantees transmission quality and bandwidth. The cloud gateway simulates a disk array, a block-based device or a file server. This device is placed at the customer's site and delivers hardware or software loaded on the hardware. It translates SCSI or file service requirements into REST protocols to communicate with public cloud services. BGP (Border Gateway Protocol) is a protocol set on the cloud gateway cluster. BFD (Bidirectional Forwarding Detection) is a network protocol that detects errors between two forwarding engines through data link layer connections. Bidirectional forwarding detection can detect the entire path, no matter how many switches or lines are passed in the middle, to help end-to-end detect whether the path is disconnected. NQA (Network Quality Analyzer) is a real-time network performance monitoring and statistical technology that can collect statistics on network information such as response time, network jitter, and packet loss rate. Vxlan is a network virtualization technology that can improve the expansion problem of large-scale cloud computing during deployment and is an extension of VLAN. VXLAN is a powerful tool that can penetrate the third layer network to extend the second layer. It can solve the portability limitations of VMS (Virtual Memory System) by encapsulating traffic and extending it to the third layer gateway, so that it can access servers on external IP subnets. VM is a virtual machine. VPC (Virtual Private Cloud) is a dynamically configured pool of public cloud computing resources that requires the use of encryption protocols, tunneling protocols, and other security procedures to transmit data between private enterprises and cloud service providers. EIP (Enterprise Information Portal) refers to the integration of various application systems, data resources and Internet resources into the enterprise information portal under the Internet environment, forming a personalized application interface based on the usage characteristics and roles of each user, and organically linking users together through the processing and transmission of events and messages.NAT (Network Address Translation) refers to network address translation, which is a technology used to use private addresses in local networks and switch to global IP addresses when connecting to the Internet. NAT is actually a technology developed to solve the shortage of IPv4 addresses. vSwitch (Virtual Switch) refers to a virtual switch or virtual network switch, which works in a layer 2 data network and implements the layer 2 (and part of the layer 3) network functions of a physical switch through software. IDC (Internet Data Center) refers to the Internet center.

[0027] A single link of Cloud Private Line supports 100Gbps bandwidth, and can reach Tbps level through link aggregation technology, which is used to meet customers' business needs with large data volumes. To ensure stable operation of key customer services, Cloud Private Line uses active / standby / load technology to achieve high availability of multi-access point services, but it is still relatively lacking in performance monitoring and alarming such as traffic and status.

[0028] In the existing solution, traffic data monitoring can be achieved through active query of the Http protocol or Kafka consumption.

[0029] refer to Figure 2 , Figure 2 It is the Http method to query the traffic graph, such as Figure 2 As shown in the figure, the resource pool collector uses SNMP (Simple Network Management Protocol) to periodically collect dedicated line switch traffic, status and other port performance data and report them to the Prometheus platform. Users customize query parameters based on the specified physical dedicated line in the cloud dedicated line portal interface and trigger the background control component to query data. The cloud dedicated line control component uses the Http protocol to call the Prometheus interface to query port traffic data, calculate and associate tenant business data, and then return to the portal interface to draw inflow and outflow rate curves. This method requires users to specify parameters to query traffic data and only supports traffic curve monitoring. The cloud dedicated line control component does not store switch performance data and cannot analyze and process the existing data or configure threshold alarms.

[0030] refer to Figure 3 , Figure 3 This is the Kafka traffic diagram, such as Figure 3As shown in the figure, the resource pool collector uses the SNMP protocol to periodically collect dedicated switch traffic, status and other port performance data and report it to the central area service. The intelligent maintenance platform uses the Kafka protocol to consume switch port performance data from the central area service and store it in the database, supporting operation and maintenance personnel to configure port granularity threshold monitoring alarms. This method supports real-time data consumption and storage, and operation and maintenance personnel can customize threshold configuration monitoring alarms and view traffic curves. However, the current data is not associated with tenant and business information, and it is impossible to display monitoring data to the corresponding users in real time and push alarm information.

[0031] refer to Figure 4 , Figure 4 FIG. 1 is a flow chart of a data transmission alarm method proposed in an embodiment of the present application. Figure 4 As shown, the method comprises the following steps: S11: The resource pool collector sends the port timing data of the switch to the monitoring platform at a preset time interval.

[0032] In this embodiment, the resource pool collector is a data collector arranged in the resource pool. The monitoring platform is used to monitor the devices in the cloud dedicated line. The port timing data is the flow data and status data of the switch in a period of time arranged in time sequence.

[0033] For example, the monitoring platform is Prometheus, which is a multifunctional open source system developed in Go language and supports monitoring, alarm, time series data transmission, etc. RemoteWrite is set on it. In the Prometheus system, RemoteWrite can be used to push server data to remote storage.

[0034] In this embodiment, the resource pool collector sends the port timing data of the switch to the monitoring platform every preset time period. The specific steps include: S11-1: The resource pool collector collects the port timing data from the switch through a pre-configured gateway monitoring protocol at intervals of a preset time period.

[0035] In this embodiment, the gateway monitoring protocol (SNMP, Simple Network Management Protocol) is an application layer protocol specially designed for managing network nodes (such as servers, workstations, routers, switches and Hubs, etc.) in IP networks. SNMP enables network administrators to remotely monitor and manage the status and configuration of network devices through standardized information structure and management information base (MIB), and timely discover and solve network problems.

[0036] In this embodiment, the resource pool collector collects port timing data from the switch through a pre-configured network management monitoring protocol at every preset time period, and the switch is a dedicated line switch. The preset time period can be set according to actual needs.

[0037] S11-2: The resource pool collector sends the port timing data to the monitoring platform.

[0038] In this embodiment, the resource pool collector sends the port timing data to the monitoring platform, which receives the data and prepares to forward it.

[0039] S12: The monitoring platform sends the port timing data to the data transmission component.

[0040] In this embodiment, the data transmission component (Transfer) is used to process the time series data and associate the time series data with the corresponding tenants and services.

[0041] In this embodiment, the monitoring platform sends the port timing data to the data transmission component.

[0042] S13: The data transmission component associates the port timing data with corresponding tenant information and service information.

[0043] In this embodiment, the tenant information includes information such as the tenant ID, tenant mailbox, tenant port name, etc., and the service information includes information such as the switch IP, physical dedicated line number, dedicated line gateway, resource pool identifier, etc.

[0044] In this embodiment, after receiving the port timing data, the data transmission component queries the corresponding tenant information and service information in the cloud server according to the port information contained in the port timing data, and then encapsulates the tenant information and service information with the port timing data.

[0045] In this embodiment, the specific steps of the data transmission component associating the port timing data with the corresponding tenant information and service information include: S13-1: The data transmission component determines the tenant information and the service information corresponding to the port timing data according to the port information carried in the port timing data.

[0046] In this embodiment, the port information includes an identifier of the port, an identifier of a tenant corresponding to the port, and the like.

[0047] In this embodiment, the data transmission component determines the tenant identifier corresponding to the switch according to the port information carried in the port timing data, and then queries the tenant information and service information corresponding to the tenant in the cloud server.

[0048] S13-2: The data transmission component encapsulates the tenant information, the service information and the port timing data into the same data packet.

[0049] In this embodiment, the data transmission component encapsulates the tenant information, service information and port timing data into the same data packet, and completes the association between the port timing data and the tenant information and service information.

[0050] S14: The data transmission component sends the port timing data associated with the tenant information and the service information to the cloud monitoring background.

[0051] In this embodiment, the cloud monitoring background is a platform for monitoring various devices in the private cloud network. It can uniformly monitor multiple nodes in the private cloud network and monitor the traffic usage of tenants.

[0052] In this embodiment, the data transmission component sends the port timing data associated with the tenant information and the service information to the cloud monitoring background.

[0053] In this embodiment, the data transmission method can be RemoteWrite or Push Gateway. PushGateway is an independent tool that uses passive push to obtain monitoring data. It allows users to push monitoring data to Push Gateway through custom scripts, and then Prometheus pulls this data from Push Gateway to achieve centralized management and monitoring. This method is particularly suitable for scenarios where monitoring indicators cannot be directly obtained through Prometheus Express, such as monitoring sources behind firewalls or data generated instantly.

[0054] S15: The cloud monitoring background calculates the value of the preset monitoring indicator according to the port timing data.

[0055] In this embodiment, the monitoring indicators include the physical dedicated line rate, the number of bytes flowing in / out of the dedicated line gateway, etc.

[0056] In this embodiment, the cloud monitoring background determines the tenant information corresponding to the timing data based on the received timing data, and then writes a query statement to query all port timing data corresponding to the tenant information, not only the port timing data received this time, but also the port timing data received in the previous time period. These port timing data are aggregated to calculate the values ​​of monitoring indicators corresponding to the switch, such as the physical dedicated line rate, the number of bytes flowing in / out of the dedicated line gateway, etc.

[0057] In this embodiment, the specific steps of the cloud monitoring background calculating the value of the preset monitoring indicator according to the port timing data include: S15-1: The cloud monitoring backend writes corresponding query statements according to the time series data.

[0058] In this embodiment, the query statement is used to query data in the database of the cloud platform.

[0059] In this embodiment, the cloud monitoring backend determines the tenant information corresponding to the time series data based on the received time series data, and then writes a corresponding query statement to query all the time series data stored by the tenant in the cloud platform.

[0060] In this example, the query statement is a PromQL statement. PromQL (Prometheus Query Language) is a powerful expression language built into the Prometheus system, which is used to query and aggregate time series data in real time. PromQL supports multiple data types and operations, allowing users to flexibly query and operate monitoring data.

[0061] S15-2: The cloud monitoring backend aggregates the time series data of all time periods of the tenant corresponding to the time series data according to the query statement.

[0062] In this embodiment, after the corresponding query statement is written in the cloud monitoring background, the query statement is used to aggregate the time series data of all time periods of the tenant corresponding to the time series data.

[0063] S15-3: The cloud monitoring backend calculates the value of the monitoring indicator corresponding to the tenant based on the aggregated time series data.

[0064] In this embodiment, the cloud monitoring backend calculates the values ​​of all monitoring indicators of the tenant based on the aggregated time series data.

[0065] For example, the cloud platform calculates the physical dedicated line rate of the corresponding tenant based on the aggregated time series data, and calculates the values ​​of indicators such as the number of bytes flowing in / out of the dedicated line gateway.

[0066] S16: The cloud monitoring backend pushes alarm information to the user according to the preset threshold value corresponding to the monitoring indicator and the preset alarm rule.

[0067] In this embodiment, the preset threshold is a critical value of each monitoring indicator set in advance, and values ​​lower than or higher than certain thresholds are considered abnormal. The alarm information is used to notify the user that the performance of a certain port is abnormal.

[0068] In this embodiment, the cloud monitoring backend pushes alarm information to the user according to the preset threshold corresponding to the monitoring indicator and the preset alarm rule. The specific steps include: S16-1: When the value of the monitoring indicator does not meet the preset threshold, generate corresponding alarm information.

[0069] In this embodiment, when the value of the monitoring indicator does not meet the preset threshold, it means that the monitoring indicator is abnormal, and corresponding alarm information is generated.

[0070] For example, if the calculated rate of the physical dedicated line is lower than the preset minimum value of the physical dedicated line rate, it means that the physical dedicated line rate is abnormal, and an alarm message "dedicated line rate is too low" is generated.

[0071] S16-2: When the alarm information meets the alarm rule, the alarm information is sent to the cloud monitoring console.

[0072] In this embodiment, the cloud monitoring console is a platform for managing the cloud platform, which can support viewing the data of the cloud monitoring background and viewing and managing the operating status of each device in the cloud network.

[0073] In this embodiment, when the alarm information meets the alarm rules, the alarm information is sent to the cloud monitoring console.

[0074] For example, the alarm rules stipulate that the alarm information must be sent immediately after it is generated. At this time, the alarm information meets the alarm rules and is sent directly to the cloud monitoring console. If the alarm rules stipulate that the alarm is only issued within the specified time, check the current time. If it is within the specified time, an alarm is issued. If it is not within the specified time, no alarm is issued.

[0075] In this embodiment, the RemoteWrite protocol is used to pull, encapsulate and push time series data, and realize tenant-level monitoring alarm. Alarm information can be pushed to users in real time to achieve early warning, timely discover equipment failures in the private cloud network, and facilitate management and maintenance.

[0076] In another embodiment of the present application, the user can log in to the cloud monitoring console and create an alarm rule in the alarm rule page. The alarm rule list is as follows: Table 1

[0077] Among them, users can flexibly set various alarm rules. After setting, they can click to confirm and create the alarm rules. At this time, the alarm rules will be applied to the cloud monitoring background.

[0078] In another embodiment of the present application, the method further includes: S21: When the cloud monitoring background receives an information viewing instruction, determine the tenant corresponding to the information viewing instruction.

[0079] In this embodiment, the information viewing instruction is a command issued by the user on the cloud monitoring console, which is used to view tenant information. The tenant information viewed includes the physical dedicated line inflow / outflow rate, the number of dedicated line gateway inflow / outflow bytes, the port status of the tenant's switch and other information.

[0080] In this embodiment, when the cloud monitoring background receives an information viewing instruction, the corresponding tenant is determined according to the tenant information included in the information viewing instruction.

[0081] S22: The cloud monitoring backend sends the time series data information corresponding to the tenant to the cloud monitoring console.

[0082] In this embodiment, after determining the switch corresponding to the tenant, the cloud monitoring background sends the switch information corresponding to the switch to the cloud monitoring console. The user can view the physical dedicated line inflow / outflow rate corresponding to the switch, the number of dedicated line gateway inflow / outflow bytes, and the switch port status on the cloud monitoring console.

[0083] In this embodiment, the user can query the switch information corresponding to the tenant on the cloud monitoring console and observe the data transmission status on the cloud dedicated line, ensuring that when a failure occurs in the cloud dedicated line data transmission, the user can promptly check where the failure occurred, which is conducive to the stable operation of the entire cloud network.

[0084] In another embodiment of the present application, before the data transmission component associates the port timing data with the corresponding tenant information and service information, the method further includes: S31: The data transmission component establishes a message queue of corresponding length according to the flow size of the port timing data.

[0085] In this embodiment, the message queue is a container for storing messages during the message transmission process.

[0086] In this embodiment, when the data transmission component receives port timing data, it can establish a message queue of corresponding length according to the flow size of the port timing data. When the flow of port timing data received by the data transmission component is large, a longer message queue can be established to store the port timing data and wait for the port timing data to be processed. When the flow of port timing data received by the data transmission component is small, a shorter message queue can be established, thereby saving computing resources.

[0087] S32: The data transmission component creates a corresponding number of coroutines according to the length of the message queue.

[0088] In this embodiment, the coroutine is similar to a thread, but the coroutine runs in user mode, which can greatly reduce the overhead caused by context switching. At the same time, the coroutine scheduler gradually schedules the executable coroutines to the thread for execution, and schedules the blocked coroutine out of the thread in time, which can avoid frequent thread switching and achieve high concurrency with fewer threads. Multiple coroutines can run simultaneously for data processing.

[0089] In this embodiment, the data transmission component creates a corresponding number of coroutines according to the length of the message queue. When the message queue is long, the number of coroutines created is large, and when the message queue is short, the number of coroutines created is small.

[0090] S33: The data transmission component puts the port timing data into the message queue.

[0091] In this embodiment, after the data transmission component creates the message queue and the coroutine, it puts the port timing data into the message queue.

[0092] In this embodiment, Transfer supports customizing the message queue length and the number of coroutines, and can be flexibly scheduled according to the size of the time series traffic data. All components are deployed in a cluster manner to achieve overall high availability, improve data processing and transmission speed, and improve system operation efficiency.

[0093] refer to Figure 5 , Figure 5 This is a data display effect diagram without using data transmission components. This diagram can only display the traffic data on the dedicated line in chronological order. Figure 6 is a data display effect diagram after being processed by the data transmission component proposed in an embodiment of the present application, such as Figure 6 As shown, after being processed by the data transmission component, the changing trend of the traffic rate can be clearly known.

[0094] refer to Figure 7 , Figure 7 is a data transmission flow interaction diagram proposed in an embodiment of the present application, such as Figure 7 As shown, there is one resource pool collector in each resource pool, which reports data to the monitoring platform at regular intervals. The monitoring platform sends the data to the data forwarding component, which processes the data and sends it to the cloud monitoring background. After the cloud monitoring background calculates the data, the data can be queried through the cloud monitoring console, and alarm configuration can also be performed through the cloud monitoring console.

[0095] refer to Figure 8 , Figure 8 This is a cloud network service logic diagram proposed in an embodiment of the present application, such as Figure 8As shown, the resource pool in the business push layer sends monitoring data to the monitoring sub-resource pool. In the monitoring sub-resource pool, tenant monitoring is set up on the tenant side, and operation and maintenance monitoring is set up on the operation and maintenance side. Both are implemented based on the Prometheus system. After processing, the port timing data of each tenant is sent to the cloud management layer by the data forwarding component. The cloud management layer stores the data in the database, and users view the corresponding data in the cloud management layer through monitoring requests.

[0096] In another embodiment of the present application, the method can also be extended to support Kafka mode data consumption, and provide a Kafka message subscription mechanism after associating tenant business data to achieve protocol diversification. Users can subscribe to the required information, obtain the corresponding information through the data transmission component and view it on the cloud platform, and provide users with a variety of information viewing through diversified protocols to improve the user experience.

[0097] Based on the same inventive concept, an embodiment of the present application provides a data transmission alarm device. Fig. 9 , Fig. 9 FIG. 9 is a schematic diagram of a data transmission alarm device 900 proposed in an embodiment of the present application. Fig. 9 As shown, the device comprises: Data collection module 901, used for the resource pool collector to send the port timing data of the switch to the monitoring platform every preset time period; A first data sending module 902, used for the monitoring platform to send the port timing data to the data transmission component; A data association module 903, used for the data transmission component to associate the port timing data with corresponding tenant information and business information; A second data sending module 904 is used for the data transmission component to send the port timing data associated with the tenant information and the business information to the cloud monitoring background; The indicator calculation module 905 is used for the cloud monitoring background to calculate the value of the preset monitoring indicator according to the port timing data; The alarm module 906 is used for the cloud monitoring background to push alarm information to the user according to the preset threshold value corresponding to the monitoring indicator through the preset alarm rule.

[0098] Optionally, the device further comprises: A switch determination module, configured to determine a tenant corresponding to an information viewing instruction when the cloud monitoring backend receives the information viewing instruction; The switch information sending module is used for the cloud monitoring background to send the time series data information corresponding to the tenant to the cloud monitoring console.

[0099] Optionally, the data acquisition module includes: A data collection submodule, used for the resource pool collector to collect the port timing data from the switch through a pre-configured gateway monitoring protocol at every preset time period; The data sending submodule is used for the resource pool collector to send the port timing data to the monitoring platform.

[0100] Optionally, the data association module includes: a data determination submodule, which is used for the data transmission component to determine the tenant information and the service information corresponding to the port timing data according to the port information carried in the port timing data; The data encapsulation submodule is used for the data transmission component to encapsulate the tenant information, the service information and the port timing data into the same data packet.

[0101] Optionally, the device further comprises: A message queue establishment submodule, used for the data transmission component to establish a message queue of corresponding length according to the flow size of the port timing data; A coroutine creation submodule, used for the data transmission component to create a corresponding number of coroutines according to the length of the message queue; The data placement submodule is used for the data transmission component to place the port timing data into the message queue.

[0102] Optionally, the indicator calculation module includes: A statement writing submodule is used for the cloud monitoring backend to write corresponding query statements according to the time series data; A data aggregation submodule, used for the cloud monitoring backend to aggregate the time series data of all time periods of the tenant corresponding to the time series data according to the query statement; The indicator calculation submodule is used for the cloud monitoring background to calculate the value of the monitoring indicator corresponding to the tenant based on the aggregated time series data.

[0103] Optionally, the alarm module includes: An alarm information generation submodule is used to generate corresponding alarm information when the value of the monitoring indicator does not meet the preset threshold; The alarm information sending submodule is used to send the alarm information to the cloud monitoring console when the alarm information meets the alarm rule.

[0104] Based on the same inventive concept, another embodiment of the present application provides a readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps in the data transmission alarm method as described in any of the above embodiments of the present application.

[0105] Based on the same inventive concept, another embodiment of the present application provides an electronic device, Fig.10 It is a schematic diagram of an electronic device 1000 proposed in one embodiment of the present application, including a memory 1002, a processor 1001 and a computer program stored in the memory and executable on the processor, wherein when the processor is executed, the steps in the data transmission alarm method described in any of the above embodiments of the present application are implemented.

[0106] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0107] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0108] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, devices, or computer program products. Therefore, the embodiments of the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the embodiments of the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0109] The embodiments of the present application are described with reference to the flowcharts and / or block diagrams of the methods, terminal devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing terminal device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0110] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing terminal device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0111] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device so that a series of operating steps are executed on the computer or other programmable terminal device to produce a computer-implemented process, thereby providing instructions for executing on the computer or other programmable terminal device to implement the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0112] Although the preferred embodiments of the present application have been described, those skilled in the art may make additional changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the embodiments of the present application.

[0113] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or terminal device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or terminal device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or terminal device including the elements.

[0114] The data transmission alarm method, device, equipment and storage medium provided by the present application are introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for general technical personnel in this field, according to the idea of ​​the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A data transmission alarm method, characterized in that: The method comprises: The resource pool collector sends the switch port timing data to the monitoring platform at a preset time interval; The monitoring platform sends the port timing data to the data transmission component; The data transmission component associates the port timing data with corresponding tenant information and business information; The data transmission component sends the port timing data associated with the tenant information and the service information to the cloud monitoring background; The cloud monitoring backend calculates the value of the preset monitoring indicator according to the port timing data; The cloud monitoring backend pushes alarm information to the user according to the preset threshold value corresponding to the monitoring indicator and the preset alarm rule.

2. The data transmission alarm method according to claim 1, characterized in that: The method further comprises: When the cloud monitoring backend receives an information viewing instruction, determining the tenant corresponding to the information viewing instruction; The cloud monitoring backend sends the time series data information corresponding to the tenant to the cloud monitoring console.

3. The data transmission alarm method according to claim 1, characterized in that: The resource pool collector sends the port timing data of the switch to the monitoring platform at every preset time period, including: The resource pool collector collects the port timing data from the switch through a pre-configured gateway monitoring protocol at intervals of a preset time period; The resource pool collector sends the port timing data to the monitoring platform.

4. The data transmission alarm method according to claim 1, characterized in that: The data transmission component associates the port timing data with corresponding tenant information and business information, including: the data transmission component determines the tenant information and business information corresponding to the port timing data according to the port information carried in the port timing data; The data transmission component encapsulates the tenant information, the service information and the port timing data into the same data packet.

5. The data transmission alarm method according to claim 1, characterized in that: Before the data transmission component associates the port timing data with the corresponding tenant information and service information, the method further includes: The data transmission component establishes a message queue of corresponding length according to the flow size of the port timing data; The data transmission component creates a corresponding number of coroutines according to the length of the message queue; The data transmission component puts the port timing data into the message queue.

6. The data transmission alarm method according to claim 1, characterized in that: The cloud monitoring backend calculates the value of the preset monitoring indicator according to the port timing data, including: The cloud monitoring backend writes a corresponding query statement according to the time series data; The cloud monitoring backend aggregates the time series data of all time periods of the tenant corresponding to the time series data according to the query statement; The cloud monitoring backend calculates the value of the monitoring indicator corresponding to the tenant based on the aggregated time series data.

7. The data transmission alarm method according to claim 1, characterized in that: The cloud monitoring backend pushes alarm information to the user according to the preset threshold value corresponding to the monitoring indicator through the preset alarm rule, including: When the value of the monitoring indicator does not meet the preset threshold, a corresponding alarm message is generated; When the alarm information complies with the alarm rule, the alarm information is sent to the cloud monitoring console.

8. A data transmission alarm device, characterized in that: The device comprises: The data collection module is used for the resource pool collector to send the port timing data of the switch to the monitoring platform at a preset time interval; A first data sending module, used for the monitoring platform to send the port timing data to the data transmission component; A data association module, used for the data transmission component to associate the port timing data with corresponding tenant information and business information; A second data sending module, used for the data transmission component to send the port timing data associated with the tenant information and the business information to the cloud monitoring background; An indicator calculation module, used for the cloud monitoring background to calculate the value of a preset monitoring indicator according to the port timing data; The alarm module is used for the cloud monitoring background to push alarm information to users according to the preset thresholds corresponding to the monitoring indicators through preset alarm rules.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps in the method according to any one of claims 1 to 7 are implemented.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

Images