Monitoring and early warning method and device for associated combined line, electronic equipment and storage medium
The method addresses the lack of combined line analysis in data center monitoring by calculating index parameters and applying Spark-based rules to generate timely alerts, enhancing network stability.
Patent Information
- Application Number
- CN202411181554.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-27
- Publication Date
- 2024-12-20
AI Technical Summary
Current line monitoring methods in data centers focus on individual lines, lacking the ability to analyze and warn for associated line combinations, which can lead to failures when one line carries increased traffic due to another's interruption.
A monitoring and early warning method for combined lines that calculates index parameters, such as delay, rate, and bandwidth, using a derivation algorithm, and applies preset warning rules through Spark-based analysis to generate timely alerts.
Provides timely early warnings for potential failures in complex network environments by intelligently analyzing combined line indicators, improving monitoring effectiveness and stability.
Smart Images

Figure CN119172220A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of data center line monitoring, and in particular to a monitoring and early warning method, device, electronic equipment, and storage medium for associated combined lines. Background Art
[0002] Data centers are taking on more and more system operation and maintenance work, so monitoring network lines is becoming more and more important.
[0003] Most of the current line monitoring methods in the industry are based on single line monitoring, lacking the ability to analyze and warn of related line combinations, which can lead to failures in certain scenarios. For example, when two lines carry business traffic at the same time, the single line warning rule is not exceeded, but when one of the lines is interrupted due to a fault, the business traffic is all carried by the other line, which will cause a sharp increase in the line traffic, causing line traffic abnormalities, and in severe cases, production failures. Summary of the invention
[0004] The embodiments of the present application provide a monitoring and early warning method, device, electronic device, and storage medium for associated combination lines to analyze and warn indicators of associated line combinations.
[0005] The present application embodiment adopts the following technical solutions:
[0006] In a first aspect, an embodiment of the present application provides a monitoring and early warning method for an associated combined line, wherein the method includes:
[0007] Determine a combined line, where the combined line includes a group of lines carrying the same service;
[0008] According to the combined line, calculating the index parameter of the combined line;
[0009] According to the indicator parameters of the combined line and the preset warning rules, the monitoring warning result of the combined line is obtained, and there is a correlation relationship between the warning rules and the indicator parameters.
[0010] In some embodiments, the method further comprises:
[0011] When setting the warning rules for the combined line, select the configuration mode of selecting all according to line categories;
[0012] When combined line information is added according to the configuration method of selecting all by line category, the newly added combined line will be automatically managed and monitored according to the selection rule of line category.
[0013] In some embodiments, the method further comprises:
[0014] According to the preset warning rule, consume the message about the configuration change of the combined line from the Kafka queue;
[0015] If a new line resource of this type is added, the corresponding warning rule is bound and the new warning rule is pushed to the Kafka queue;
[0016] Spark-based early warning rules analyze job consumption rule message queues to achieve automatic monitoring and management of incremental combination lines.
[0017] In some embodiments, the indicator parameter includes at least one of the following: delay, rate, and bandwidth, and the calculating the indicator parameter of the combined line according to the combined line includes:
[0018] Calculate the delay in the index parameter of the combined line according to the data transmission speed and delay of the combined line;
[0019] Calculate the rate in the index parameter of the combined line according to the in / out rate of the combined line;
[0020] The bandwidth in the indicator parameter of the combined line is calculated according to the maximum rate of data transmission of the combined line.
[0021] In some embodiments, the calculating the index parameter of the associated combined line according to the associated combined line further includes:
[0022] Using an associated combination line index derivation algorithm to generate index parameters of the associated combination line;
[0023] Calculate the bandwidth of the combined line as the sum of the associated real line bandwidths;
[0024] The output rate of the combined line is calculated according to the sum of the most recent output rates of the associated real lines;
[0025] The input rate of the combined line is calculated according to the sum of the most recent input rates of the associated real lines;
[0026] The outbound bandwidth utilization rate of the combined line is calculated according to the outbound rate of the combined line / the bandwidth of the combined line;
[0027] The input bandwidth utilization rate of the combined line is calculated according to the input rate of the combined line / the bandwidth of the combined line;
[0028] The path response delay of the combined line is calculated according to the maximum value of the most recent response delay of the associated real line.
[0029] In some embodiments, the monitoring warning result of the combined line is obtained according to the indicator parameters of the combined line and the preset warning rules, and there is an association relationship between the warning rules and the indicator parameters, including:
[0030] The generated combined line indicator data is pushed to the Kafka queue, and the Spark engine consumes the data from the Kafka queue and writes the combined line indicator data to the Elasticsearch database;
[0031] Based on the early warning analysis job in the Spark engine, the combined line indicator information in the Kafka queue is consumed for analysis and calculation. If the combined line indicator information in the Kafka queue meets the configured early warning rules, a monitoring early warning result is generated.
[0032] In some embodiments, determining the combined line includes setting virtual combined line information and establishing an association relationship with a real line, storing the combined line data in a database MongoDB, the preset warning rule includes setting the warning rule according to the indicator name and storing the warning rule data in a relational database PostgreSQL, and the method further includes:
[0033] Based on the database MongoDB, obtaining the combined line data;
[0034] Based on the relational database PostgreSQL, obtaining the preset warning rule;
[0035] The combined line data and the real line list are displayed, wherein the combined line data is used to expand and display the resource configuration information, preset warning rules and indicator information of the associated real lines.
[0036] In a second aspect, an embodiment of the present application further provides a monitoring and early warning device for an associated combined line, wherein the device comprises:
[0037] A determination module, used to determine a combined line, where the combined line includes a group of lines carrying the same service;
[0038] A calculation module, used for calculating the index parameters of the combined circuit according to the combined circuit;
[0039] The monitoring and early warning module is used to obtain the monitoring and early warning result of the combined line according to the indicator parameters of the combined line and the preset early warning rules, and there is an association relationship between the early warning rules and the indicator parameters.
[0040] In a third aspect, an embodiment of the present application further provides an electronic device, comprising: a processor; and a memory arranged to store computer executable instructions, wherein the executable instructions, when executed, cause the processor to perform the above method.
[0041] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium, which stores one or more programs. When the one or more programs are executed by an electronic device including multiple application programs, the electronic device executes the above method.
[0042] At least one of the above technical solutions adopted in the embodiments of the present application can achieve the following beneficial effects: determine a combined line, wherein the combined line includes a group of lines carrying the same service. Then, according to the combined line, calculate the index parameters of the combined line, and finally, according to the index parameters of the combined line and the preset early warning rules, obtain the monitoring and early warning results of the combined line, and there is a correlation between the early warning rules and the index parameters. Through the above method, timely early warning of line failures in line-specific scenarios is achieved. At the same time, early warnings are generated through intelligent analysis of early warning rules, which provides a more reasonable and effective monitoring method for the current complex network environment, and can timely warn of potential failures. BRIEF DESCRIPTION OF THE DRAWINGS
[0043] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:
[0044] Figure 1 A schematic diagram of a flow chart of a monitoring and early warning method for an associated combined line in an embodiment of the present application;
[0045] Figure 2 This is a structural diagram of a monitoring and early warning device for an associated combined line in an embodiment of the present application;
[0046] Figure 3 This is a schematic diagram of the structure of an electronic device in an embodiment of the present application. DETAILED DESCRIPTION
[0047] In order to make the purpose, technical solution and advantages of the present application clearer, the technical solution of the present application will be clearly and completely described below in combination with the specific embodiments of the present application and the corresponding drawings. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present application.
[0048] The current data center monitoring system focuses on line monitoring, collecting indicators such as line on / off status, PING delay, in / out rate, in / out bandwidth usage, and issuing warnings based on specified warning rules. However, since the line monitoring method is based on the monitoring of a single line, there is a lack of indicator analysis and warnings for associated line combinations.
[0049] In view of the above shortcomings, an embodiment of the present application provides an intelligent analysis and warning technology for associated combined lines, including setting combined line information, setting warning rule information, calculating combined line indicators, and calculating line warning analysis.
[0050] The technical solutions provided by various embodiments of the present application are described in detail below in conjunction with the accompanying drawings.
[0051] The present application embodiment provides a monitoring and early warning method for an associated combined line, such as Figure 1 As shown, a flow chart of a monitoring and early warning method for an associated combined line in an embodiment of the present application is provided, and the method at least includes the following steps S110 to S130:
[0052] Step S110: determining a combined line, where the combined line includes a group of lines carrying the same service.
[0053] It can be understood that a combined line refers specifically to a group of lines that carry the same service. For example, inter-provincial line combinations: Beijing to Jiangsu and Hefei to Jiangsu are lines of different operators for the same service. Of course, there are many groups of lines that carry the same service, which are not specifically limited in the embodiments of this application, as long as they meet the requirements of the same service.
[0054] At the same time, the line specifically refers to a network dedicated line, which mainly includes two types of channels: physical dedicated channels and virtual dedicated channels.
[0055] Among them, the physical dedicated channel is a dedicated line laid between the service provider and the user. The line is only for independent use by the user, and other data cannot enter this line. General lines allow multiple users to share the channel.
[0056] Among them, the virtual private channel reserves a certain bandwidth for users on the general channel, so that users can enjoy this bandwidth exclusively, just like opening another channel on the public channel, which is only used by the corresponding users, and the user's data is encrypted to ensure reliability and security.
[0057] For the same business, a combined line is determined to facilitate subsequent monitoring and early warning.
[0058] Step S120: Calculate the index parameters of the combined line according to the combined line.
[0059] According to the combined line, the combined line index can be calculated. For example, the combined line index can be calculated by intelligent analysis based on the collection index of the associated lines configured by the combined line, and the combined line index can be generated by using a preset index derivation algorithm.
[0060] Step S130, obtaining a monitoring warning result of the combined line according to the indicator parameters of the combined line and a preset warning rule, wherein the warning rule and the indicator parameters are associated with each other.
[0061] According to the warning rules and combined line indicators, a warning analysis is performed to generate a combined line warning, and the monitoring warning results of the combined line are obtained.
[0062] The warning rules are configured through the configuration interface according to the indicator name, the number of consecutive threshold violations, and the alarm level.
[0063] It should be noted that the warning rules and indicator parameters are associated with each other according to a pre-set mapping relationship or corresponding relationship. The association relationship here can be configured according to actual conditions and is not specifically limited in the embodiments of the present application as long as the requirements are met.
[0064] Through the above method, the intelligent analysis and early warning technology of the associated combination lines can be used to timely warn of fault risks and improve the stability of data center business operations.
[0065] Through the above method, the deficiency of only monitoring and warning for individual lines in the related technology is solved. Information can be set according to the combined line, and combined line indicators can be automatically generated according to the preset derivative algorithm. At the same time, warnings can be generated through intelligent analysis of warning rules, which can provide more reasonable and effective monitoring means for the current complex network environment and timely warn of potential faults.
[0066] In one embodiment of the present application, the method further includes: when setting the warning rules for the combined line, selecting a configuration method of selecting all according to line categories; when combined line information is added according to the configuration method of selecting all according to line categories, the newly added combined line is automatically managed and monitored according to the line category selection rule.
[0067] Preferably, when setting the warning rules, it is possible to support the setting of all combination lines by category. Specifically, when a new combination line is added, the warning rules can be automatically bound incrementally, and real-time analysis and calculation can be performed based on the set warning rules and the combination line indicators calculated by intelligent analysis to generate a combination line warning, thereby eliminating the need to manually bind and add warning rules.
[0068] In one embodiment of the present application, the method also includes: according to the preset warning rules, consuming messages about the configuration changes of the combined line from the Kafka queue; if there are new line resources of this type, binding the corresponding warning rules and pushing the new warning rules to the Kafka queue; based on Spark's warning rule analysis job consumption rule message queue to realize automatic monitoring and management of incremental combined lines.
[0069] When setting the combined line warning rules, the configuration method is to select all line categories. That is, when the combined line information is added, the newly added combined line is automatically managed and monitored according to the line category selection rule.
[0070] Furthermore, after setting up the warning rules, messages about configuration changes are consumed from the Kafka queue. If new line resources of this type are added, the corresponding warning rules are bound and the newly added warning rules are pushed to the Kafka queue. The Spark-based warning rule analysis job consumes the rule message queue to realize automatic monitoring and management of incremental combined lines.
[0071] It can be understood that Spark is a general-purpose big data parallel computing framework based on memory computing. It is a fast, general and scalable big data analysis engine with the advantages of high efficiency and ease of use. Kafka queue is a high-throughput distributed publish-subscribe messaging system.
[0072] In one embodiment of the present application, the indicator parameters include at least one of the following: delay, rate, and bandwidth. The calculating the indicator parameters of the combined line according to the combined line includes: calculating the delay in the indicator parameters of the combined line according to the data transmission speed and delay of the combined line; calculating the rate in the indicator parameters of the combined line according to the input and output rates of the combined line; and calculating the bandwidth in the indicator parameters of the combined line according to the maximum data transmission rate of the combined line.
[0073] The key indicators of a line mainly include delay and / or rate.
[0074] (1) Latency is an important indicator for measuring network connections, which affects the user experience. Latency indicators can help determine the speed and delay of data transmission, thereby ensuring a fast response of the network connection.
[0075] (2) Network transmission rate, also known as data rate or bit rate, is an important indicator for measuring network performance. The line input and output rates are directly related to the efficiency and stability of the network connection.
[0076] (3) Bandwidth is another key indicator of network connection. It determines the maximum rate of data transmission. Sufficient bandwidth is the basis for ensuring smooth online activities and efficient data transmission.
[0077] In one embodiment of the present application, the calculating the index parameters of the associated combined lines according to the associated combined lines further includes: using an associated combined line index derivation algorithm to generate the index parameters of the associated combined lines: calculating the bandwidth of the combined lines according to the sum of the bandwidths of the associated real lines; calculating the output rate of the combined lines according to the sum of the most recent output rates of the associated real lines; calculating the input rate of the combined lines according to the sum of the most recent input rates of the associated real lines; calculating the output bandwidth utilization rate of the combined lines according to the output rate of the combined lines / the bandwidth of the combined lines; calculating the input bandwidth utilization rate of the combined lines according to the input rate of the combined lines / the bandwidth of the combined lines; and calculating the path response delay of the combined lines according to the most recent maximum value of the response delay of the associated real lines.
[0078] For the monitoring of combined lines, the derivation of combined line indicators is the basis for monitoring accuracy. According to actual needs, the above combined line indicator derivation algorithm is designed as follows:
[0079] 1) Combined line bandwidth: calculated as the sum of the associated real line bandwidths;
[0080] 2) Combined line output rate: calculated based on the sum of the most recent output rates of the associated real lines;
[0081] 3) Combined line input rate: calculated as the sum of the most recent input rates of the associated real lines;
[0082] 4) Combined line outbound bandwidth utilization rate: calculated as combined line outbound rate / combined line bandwidth;
[0083] 5) Combined line inbound bandwidth utilization rate: calculated as combined line inbound rate / combined line bandwidth;
[0084] 6) Combined line response delay: calculated according to the maximum value of the most recent response delay of the associated real line. This indicator can reflect the network quality of the combined line. Each line can have a different line IP. The real line response delay indicator for each area is obtained by detecting the line IP through the Internet Control Message Protocol (ICMP).
[0085] It can be understood that the index parameters of the associated combined lines can be calculated through different associated combined lines. In addition, the above combined line indexes can be combined or configured according to actual usage.
[0086] Specifically, a feasible usage scenario is: because the combined line is a group of lines that carry the same business, when one of the lines fails, the traffic of other lines will surge. If a combined line C is associated with two real lines A and B with the same bandwidth of 100M, the bandwidth of combined line C is automatically calculated as 200M, and the warning rule for the combined line outbound bandwidth usage is set to 45%.
[0087] Case 1: When the data center is running, the outbound bandwidth rate of line A is 50M, and the outbound bandwidth rate of line B is 30M. The outbound bandwidth utilization of each line is low, and the warning of each line will not be triggered. The outbound bandwidth utilization rate of the combined line is (50M+30M) / 200M=40%, which is lower than the set alarm threshold, and no alarm is generated. In this case, when line A fails, the service traffic is taken over by line B, and the traffic of line B increases sharply to 80M, without the risk of failure.
[0088] Case 2: When the data center is running, the outbound bandwidth rate of line A is 50M, and the outbound bandwidth rate of line B is 60M. The outbound bandwidth utilization of each line is low, and the warning of each line will not be triggered. The outbound bandwidth utilization rate of the combined line is (50M+60M) / 200M=55%, which is larger than the set alarm threshold, and a bandwidth utilization warning is generated. In this case, when line A fails, the service traffic is taken over by line B, and the traffic of line B increases sharply to 110M, exceeding the bandwidth of line B itself, and there is a risk of failure.
[0089] In one embodiment of the present application, a monitoring and early warning result of the combined line is obtained according to the indicator parameters of the combined line and the preset early warning rules, and the early warning rules are associated with the indicator parameters, including: pushing the generated combined line indicator data to the Kafka queue, and consuming the data from the Kafka queue by the Spark engine, and writing the combined line indicator data into the Elasticsearch database; consuming the combined line indicator information in the Kafka queue based on the early warning analysis job in the Spark engine for analysis and calculation, and if the combined line indicator information in the Kafka queue meets the configured early warning rules, a monitoring and early warning result is generated.
[0090] Considering that the monitoring and early warning requirements are accurate and timely. The characteristics of the selected combined line indicator data are: large data volume and periodic peaks in reporting rate. Therefore, Kafka technology is selected in the specific implementation. When there is a burst of upstream data flow or insufficient downstream service processing capacity, Kafka can be used as a buffer to help smooth the data flow and prevent the loss of early warnings. In addition, by utilizing the performance improvement brought by the Spark engine (jobs running on Spark), the indicator data processing performance can be improved to ensure the timeliness of early warnings.
[0091] The combined line warning analysis and calculation process is as follows: the generated combined line indicators are pushed to the Kafka queue, and Spark (a job running on Spark) consumes data from the Kafka queue. After data standardization and enrichment, the indicator data is written to the Elasticsearch database. The warning analysis Spark job consumes the combined line indicator information of the Kafka queue for analysis and calculation. If its indicator meets the configured warning rules, a warning is generated.
[0092] In one embodiment of the present application, determining the combined line includes setting virtual combined line information and establishing an association relationship with a real line, storing the data of the combined line in a database MongoDB, and the preset warning rule includes setting the warning rule according to the indicator name and storing the warning rule data in a relational database PostgreSQL. The method further includes: obtaining the combined line data based on the database MongoDB; obtaining the preset warning rule based on the relational database PostgreSQL; displaying the combined line data and a real line list, wherein the combined line data is used to expand and display the resource configuration information, preset warning rules and indicator information of the associated real line.
[0093] When setting the combined line information, set the virtual combined line information, and establish an association relationship with the real line, and the data is stored in the database MongoDB. At this time, including the situation of multiple real lines, you can establish an association relationship, and store the virtual combined line information in MongoDB.
[0094] When setting the warning rule information, set the warning rule according to the indicator name, the warning level (supports full selection by combined line type), and the data is stored in a relational database (PostgreSQL). The warning rules are named mainly according to actual needs and are not specifically limited in the embodiments of this application. The warning level can be divided into different levels such as emergency, error, warning, and reminder according to the actual number of alarms. The warning level can also be divided into different levels according to the alarm time.
[0095] Finally, a comprehensive display of combined lines can be achieved, showing a list of combined lines and / or real lines, wherein the combined lines can be expanded to display resource configuration information and indicator information of the associated real lines.
[0096] The embodiment of the present application also provides a monitoring and early warning device 200 for an associated combined line, such as Figure 2 As shown, a schematic diagram of the structure of the monitoring and early warning device of the associated combined line in an embodiment of the present application is provided, and the monitoring and early warning device 200 of the associated combined line at least includes: a determination module 210, a calculation module 220, and a monitoring and early warning module 230, wherein:
[0097] In one embodiment of the present application, the determining module 210 is specifically used to: determine a combined line, where the combined line includes a group of lines that carry the same service.
[0098] It can be understood that a combined line refers specifically to a group of lines that carry the same service. For example, inter-provincial line combinations: Beijing to Jiangsu and Hefei to Jiangsu are lines of different operators for the same service. Of course, there are many groups of lines that carry the same service, which are not specifically limited in the embodiments of this application, as long as they meet the requirements of the same service.
[0099] At the same time, the line specifically refers to a network dedicated line, which mainly includes two types of channels: physical dedicated channels and virtual dedicated channels.
[0100] Among them, the physical dedicated channel is a dedicated line laid between the service provider and the user. The line is only for independent use by the user, and other data cannot enter this line. General lines allow multiple users to share the channel.
[0101] Among them, the virtual private channel reserves a certain bandwidth for users on the general channel, so that users can enjoy this bandwidth exclusively, just like opening another channel on the public channel, which is only used by the corresponding users, and the user's data is encrypted to ensure reliability and security.
[0102] For the same business, a combined line is determined to facilitate subsequent monitoring and early warning.
[0103] In one embodiment of the present application, the calculation module 220 is specifically used to calculate the index parameter of the combined line according to the combined line.
[0104] According to the combined line, the combined line index can be calculated. For example, the combined line index can be calculated by intelligent analysis based on the collection index of the associated lines configured by the combined line, and the combined line index can be generated by using a preset index derivation algorithm.
[0105] In one embodiment of the present application, the monitoring and warning module 230 is specifically used to obtain a monitoring and warning result of the combined line according to the indicator parameters of the combined line and preset warning rules, and there is an association relationship between the warning rules and the indicator parameters.
[0106] According to the warning rules and combined line indicators, a warning analysis is performed to generate a combined line warning, and the monitoring warning results of the combined line are obtained.
[0107] The warning rules are configured through the configuration interface according to the indicator name, the number of consecutive threshold violations, and the alarm level.
[0108] It should be noted that the warning rules and indicator parameters are associated with each other according to a pre-set mapping relationship or corresponding relationship. The association relationship here can be configured according to actual conditions and is not specifically limited in the embodiments of the present application as long as the requirements are met.
[0109] It can be understood that the monitoring and early warning device for the above-mentioned associated combined lines can implement the various steps of the monitoring and early warning method for the associated combined lines provided in the aforementioned embodiments, and the relevant explanations on the monitoring and early warning method for the associated combined lines are applicable to the monitoring and early warning device for the associated combined lines, which will not be repeated here.
[0110] Figure 3 This is a schematic diagram of the structure of an electronic device according to an embodiment of the present application. Figure 3 At the hardware level, the electronic device includes a processor, and optionally also includes an internal bus, a network interface, and a memory. The memory may include a memory, such as a high-speed random access memory (RAM), and may also include a non-volatile memory (non-volatile memory), such as at least one disk storage. Of course, the electronic device may also include hardware required for other services.
[0111] The processor, network interface and memory can be interconnected through an internal bus, which can be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 3 Only one bidirectional arrow is used in the diagram, but this does not mean that there is only one bus or only one type of bus.
[0112] The memory is used to store the program. Specifically, the program may include a program code, and the program code includes a computer operation instruction. The memory may include a memory and a non-volatile memory, and provides instructions and data to the processor.
[0113] The processor reads the corresponding computer program from the non-volatile memory into the memory and then runs it, forming a monitoring and early warning device for the associated combination circuit at the logical level. The processor executes the program stored in the memory and is specifically used to perform the following operations:
[0114] Determine a combined line, where the combined line includes a group of lines carrying the same service;
[0115] According to the combined line, calculating the index parameter of the combined line;
[0116] According to the indicator parameters of the combined line and the preset warning rules, the monitoring warning result of the combined line is obtained, and there is a correlation relationship between the warning rules and the indicator parameters.
[0117] The above application Figure 1 The method performed by the monitoring and early warning device of the associated combined circuit disclosed in the illustrated embodiment can be applied to a processor or implemented by a processor. The processor may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method can be completed by an integrated logic circuit of hardware in the processor or an instruction in the form of software. The above processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The steps of the method disclosed in the embodiments of the present application can be directly embodied as a hardware decoding processor for execution, or a combination of hardware and software modules in the decoding processor for execution. The software module can be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, etc. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.
[0118] The electronic device may also perform Figure 1 The method for executing the monitoring and early warning device of the associated combined line is implemented in Figure 1 The functions of the illustrated embodiment will not be described in detail in the embodiments of the present application.
[0119] The present application also provides a computer-readable storage medium, which stores one or more programs, wherein the one or more programs include instructions, which, when executed by an electronic device including multiple application programs, enable the electronic device to execute Figure 1 The method executed by the monitoring and early warning device of the associated combined line in the illustrated embodiment is specifically used to execute:
[0120] Determine a combined line, where the combined line includes a group of lines carrying the same service;
[0121] According to the combined line, calculating the index parameter of the combined line;
[0122] According to the indicator parameters of the combined line and the preset warning rules, the monitoring warning result of the combined line is obtained, and there is a correlation relationship between the warning rules and the indicator parameters.
[0123] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0124] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0125] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0126] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0127] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.
[0128] The memory may include non-permanent storage in a computer-readable medium, random access memory (RAM) and / or non-volatile memory in the form of read-only memory (ROM) or flash RAM. The memory is an example of a computer-readable medium.
[0129] Computer readable media include permanent and non-permanent, removable and non-removable media that can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, program modules or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media that can be used to store information that can be accessed by a computing device. As defined herein, computer readable media does not include temporary computer readable media (transitory media), such as modulated data signals and carrier waves.
[0130] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the elements defined by the sentence "comprises a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.
[0131] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment or an embodiment in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.
[0132] The above is only an embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims
1. A monitoring and early warning method for associated combined lines, wherein: The method comprises: Determine a combined line, where the combined line includes a group of lines carrying the same service; According to the combined line, calculating the index parameter of the combined line; According to the indicator parameters of the combined line and the preset warning rules, the monitoring warning result of the combined line is obtained, and there is a correlation relationship between the warning rules and the indicator parameters.
2. The method of claim 1, wherein: The method further comprises: When setting the warning rules for the combined line, select the configuration mode of selecting all according to line categories; When combined line information is added according to the configuration method of selecting all by line category, the newly added combined line will be automatically managed and monitored according to the selection rule of line category.
3. The method of claim 2, wherein: The method further comprises: According to the preset warning rule, consume the message about the configuration change of the combined line from the Kafka queue; If a new line resource of this type is added, the corresponding warning rule is bound and the new warning rule is pushed to the Kafka queue; Spark-based early warning rules analyze job consumption rule message queues to achieve automatic monitoring and management of incremental combination lines.
4. The method of claim 1, wherein: The indicator parameter includes at least one of the following: delay, rate, and bandwidth. The calculating the indicator parameter of the combined line according to the combined line includes: Calculate the delay in the index parameter of the combined line according to the data transmission speed and delay of the combined line; Calculate the rate in the index parameter of the combined line according to the in / out rate of the combined line; The bandwidth in the indicator parameter of the combined line is calculated according to the maximum rate of data transmission of the combined line.
5. The method of claim 4, wherein: The step of calculating the index parameter of the associated combined line according to the associated combined line further includes: Using an associated combination line index derivation algorithm to generate index parameters of the associated combination line; Calculate the bandwidth of the combined line as the sum of the associated real line bandwidths; The output rate of the combined line is calculated according to the sum of the most recent output rates of the associated real lines; The input rate of the combined line is calculated according to the sum of the most recent input rates of the associated real lines; The outbound bandwidth utilization rate of the combined line is calculated according to the outbound rate of the combined line / the bandwidth of the combined line; The input bandwidth utilization rate of the combined line is calculated according to the input rate of the combined line / the bandwidth of the combined line; The path response delay of the combined line is calculated according to the maximum value of the most recent response delay of the associated real line.
6. The method of claim 1, wherein: The monitoring and warning result of the combined line is obtained according to the indicator parameters of the combined line and the preset warning rules, wherein the warning rules and the indicator parameters have an associated relationship, including: The generated combined line indicator data is pushed to the Kafka queue, and the Spark engine consumes the data from the Kafka queue and writes the combined line indicator data to the Elasticsearch database; Based on the early warning analysis job in the Spark engine, the combined line indicator information in the Kafka queue is consumed for analysis and calculation. If the combined line indicator information in the Kafka queue meets the configured early warning rules, a monitoring early warning result is generated.
7. The method of claim 1, wherein: The determining of the combined line includes setting virtual combined line information and establishing an association relationship with the real line, storing the combined line data in the database MongoDB, the preset warning rule includes setting the warning rule according to the indicator name and storing the warning rule data in the relational database PostgreSQL, and the method also includes: Based on the database MongoDB, obtaining the combined line data; Based on the relational database PostgreSQL, obtaining the preset warning rule; The combined line data and the real line list are displayed, wherein the combined line data is used to expand and display the resource configuration information, preset warning rules and indicator information of the associated real lines.
8. A monitoring and early warning device for an associated combined line, wherein: The device comprises: A determination module, used to determine a combined line, where the combined line includes a group of lines carrying the same service; A calculation module, used for calculating the index parameters of the combined circuit according to the combined circuit; The monitoring and early warning module is used to obtain the monitoring and early warning result of the combined line according to the indicator parameters of the combined line and the preset early warning rules, and there is an association relationship between the early warning rules and the indicator parameters.
9. An electronic device, comprising: processor; as well as A memory arranged to store computer executable instructions, which when executed cause the processor to perform the method of any one of claims 1 to 7.
10. A computer-readable storage medium storing one or more programs, which, when executed by an electronic device including a plurality of application programs, causes the electronic device to execute any one of the methods of claims 1 to 7.
