A method, device, computer equipment and storage medium for monitoring effectiveness of rules

Abstract

The embodiment of the present invention provides a method, device, computer equipment and storage medium for monitoring the effectiveness of rules. In the technical solution provided by the embodiment of the present invention, alarm information and dispatch logs in the network management system are obtained; according to the set alarm rules, the set dispatch rules, alarm information and dispatch logs, the rule effectiveness results are generated, which can improve the timeliness of monitoring the effectiveness of rules, thereby ensuring that the rules can continue to take effect.

Description

[Technical field]

[0001] The present invention relates to the field of communication technology, and in particular to a rule effectiveness monitoring method, device, computer equipment and storage medium. [Background technology]

[0002] As the scale of operators' networks continues to expand, the number of alarms is also increasing. It is necessary to deploy association rules and derivative rules in the network management system to reduce the number of alarms and accurately locate fault points. If the network management system fails to take effect after the deployment of rules, it will seriously affect the discovery and handling of network faults. At present, the methods for monitoring whether the rules are effective include online verification and post-fault point tracing. The current monitoring methods are less timely and cannot guarantee the continuous effectiveness of the rules. [Summary of the invention]

[0003] In view of this, the embodiments of the present invention provide a method, apparatus, computer device and storage medium for monitoring the effectiveness of rules, which can improve the timeliness of monitoring the effectiveness of rules, thereby ensuring that the rules can continue to be effective.

[0004] In one aspect, an embodiment of the present invention provides a method for monitoring effectiveness of a rule, the method comprising:

[0005] Obtain alarm information and dispatch logs from the network management system;

[0006] Generate rule effectiveness results based on the set alarm rules, set order dispatch rules, alarm information and order dispatch logs.

[0007] Optionally, the rule effectiveness result includes a rule expiration message;

[0008] Generate rule effectiveness results based on the set alarm rules, set dispatch rules, alarm information and dispatch logs, including:

[0009] Determine whether the alarm information matches the alarm rules and whether the dispatch log matches the dispatch rules;

[0010] If it is determined that the alarm information does not match the alarm rule or the dispatch log does not match the dispatch rule, a rule invalidation message is generated.

[0011] Optionally, if it is determined that the alarm information does not match the alarm rule or the dispatch log does not match the dispatch rule, after generating a rule invalidation message, the method further includes:

[0012] Send the rule expiration message to the operation and maintenance department.

[0013] Optionally, before obtaining the alarm information and dispatch log in the network management system, the following steps are also included:

[0014] The set current test network element information is sent to the network management system for the network management system to determine whether the current test network element information complies with the alarm rules. If it is determined that the current test network element information complies with the alarm rules, the alarm information is generated and the dispatching rules corresponding to the alarm information are queried. The orders are dispatched according to the dispatching rules and a dispatching log is generated.

[0015] Optionally, sending the set current test network element information to the network management system includes:

[0016] The current test network element information is sent to the network management system according to a preset first time interval.

[0017] Optionally, after sending the set test network element information to the network management system, the method further includes:

[0018] The set updated test network element information is sent to the network management system at a preset second time interval, so that the network management system determines the updated test network element information as the current test network element information.

[0019] Optionally, after sending the set current test network element information to the network management system, the method further includes:

[0020] Receive alarm information sent by the network management system;

[0021] Modify the current test network element information;

[0022] The modified test network element information is sent to the network management system, so that the network management system determines the modified test network element information as the current test network element information.

[0023] On the other hand, an embodiment of the present invention provides a rule effectiveness monitoring device, including:

[0024] An acquisition unit, used to acquire alarm information and dispatch logs in the network management system;

[0025] The generation unit is used to generate rule effectiveness results according to the set alarm rules, the set dispatching rules, the alarm information and the dispatching log.

[0026] On the other hand, an embodiment of the present invention provides a storage medium, which includes a stored program, wherein when the program is running, the device where the storage medium is located is controlled to execute the above-mentioned rule effectiveness monitoring method.

[0027] On the other hand, an embodiment of the present invention provides a computer device, including a memory and a processor, wherein the memory is used to store information including program instructions, and the processor is used to control the execution of the program instructions, and is characterized in that the above-mentioned rule effectiveness monitoring method is implemented when the program instructions are loaded and executed by the processor.

[0028] In the scheme of the embodiment of the present invention, the alarm information and dispatch log in the network management system are obtained; the rule effectiveness results are generated according to the set alarm rules, the set dispatch rules, the alarm information and the dispatch log, which can improve the timeliness of the rule effectiveness monitoring, thereby ensuring that the rules can continue to take effect.

Brief Description of the Drawings

[0029] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0030] Figure 1 A flow chart of a method for monitoring the effectiveness of rules provided by an embodiment of the present invention;

[0031] Figure 2 A flowchart of another method for monitoring effectiveness of rules provided by an embodiment of the present invention;

[0032] Figure 3 A schematic diagram of the structure of a rule effectiveness monitoring device provided by an embodiment of the present invention;

[0033] Figure 4 A schematic diagram of a computer device provided by an embodiment of the present invention. [Specific implementation method]

[0034] In order to better understand the technical solution of the present invention, the embodiments of the present invention are described in detail below with reference to the accompanying drawings.

[0035] It should be clear that the described embodiments are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0036] The terms used in the embodiments of the present invention are only for the purpose of describing specific embodiments, and are not intended to limit the present invention. The singular forms "a", "said" and "the" used in the embodiments of the present invention and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings.

[0037] It should be understood that the term "and / or" used in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the associated objects before and after are in an "or" relationship.

[0038] It should be understood that, although the terms first, second, etc. may be used to describe the set thresholds in the embodiments of the present invention, these set thresholds should not be limited to these terms. These terms are only used to distinguish the set thresholds from each other. For example, without departing from the scope of the embodiments of the present invention, the first set threshold may also be referred to as the second set threshold, and similarly, the second set threshold may also be referred to as the first set threshold.

[0039] Figure 1 A flowchart of a method for monitoring the effectiveness of a rule provided by an embodiment of the present invention is shown in FIG. Figure 1 As shown, the method includes:

[0040] Step 101: Obtain alarm information and dispatch logs in the network management system.

[0041] Step 102: Generate rule effectiveness results according to the set alarm rules, set dispatch rules, alarm information and dispatch logs.

[0042] In the technical solution provided by the embodiment of the present invention, the alarm information and dispatch log in the network management system are obtained; the rule effectiveness results are generated according to the set alarm rules, the set dispatch rules, the alarm information and the dispatch log, which can improve the timeliness of the rule effectiveness monitoring, thereby ensuring that the rules can continue to take effect.

[0043] Figure 2 A flowchart of another method for monitoring the effectiveness of rules provided by an embodiment of the present invention is as follows: Figure 2 As shown, the method includes:

[0044] Step 201: Send the set current test network element information to the network management system so that the network management system can determine whether the current test network element information complies with the alarm rules. If it is determined that the current test network element information complies with the alarm rules, generate alarm information and query the dispatching rules corresponding to the alarm information, dispatch orders according to the dispatching rules and generate dispatching logs.

[0045] In the embodiment of the present invention, each step is executed by the self-monitoring system, and the self-monitoring system simulates the equipment manufacturer, constructs the test network element and tests the performance index according to the existing network standard specification, and performs periodic black box testing, which can detect the failure of the network management system and improve the stability of the network management system. Among them, the black box test is to detect whether each function can be used normally through testing. In the test, the program is regarded as a black box that cannot be opened. Without considering the internal structure and internal characteristics of the program, the program interface is tested. It only checks whether the program function is used normally according to the requirements of the specification and whether the program can properly receive input data and generate correct output information. Black box testing focuses on the external structure of the program, does not consider the internal logical structure, and mainly tests the software interface and software functions. Black box testing is tested from the user's perspective, starting from the corresponding relationship between input data and output data. In the instant embodiment of the present invention, by performing black box testing on the network management system, it can be determined whether the network management system has a fault.

[0046] In the embodiment of the present invention, the current test network element is a test network element set on a mobility management entity (MME), each test network element has a unique identification code (ID), and the test network element ID does not conflict with the existing network element.

[0047] In the embodiment of the present invention, the current test network element information includes a current test performance indicator, which is preset. For example, the current test performance indicator is the number of MME attached users, and the number of MME attached users is set to 10.

[0048] In the embodiment of the present invention, the current test network element information is sent to the network management system according to a preset first time interval. The first time interval can be set according to actual conditions. As an optional solution, the first time interval is 24 hours.

[0049] In the embodiment of the present invention, the self-monitoring system sends the current network element information to the network management system according to the designated interface, wherein the designated interface includes a Common Object Request Broker Architecher (CORBA) interface or a northbound interface.

[0050] In the embodiment of the present invention, it is necessary to configure alarm rules in the network management system. The alarm rules can be configured according to actual conditions, and different alarm rules correspond to different alarm names.

[0051] In the embodiment of the present invention, the alarm information includes the alarm name, the test performance index of the test network element information in the previous cycle, and the current performance index of the current test network element information. Different alarm information corresponds to different dispatching rules.

[0052] For example: the alarm rule is configured as the ratio of the number of MME attached users to the number of MME attached users in the previous cycle is greater than or equal to the specified ratio threshold. As an optional solution, the specified ratio threshold is 80%; the alarm name corresponding to the alarm rule is the alarm of the sudden drop of the number of MME attached users exceeding the first threshold; the alarm information is generated based on the number of MME attached users in the current cycle, the number of MME attached users in the previous cycle, and the alarm of the sudden drop of the number of MME attached users exceeding the first threshold. The dispatch rule corresponding to the alarm information is to dispatch the order to the specified dispatch object after delaying the specified time threshold. As an optional solution, the specified time threshold is 5 minutes, and the dispatch object is Department A.

[0053] In the embodiment of the present invention, the dispatch log includes a planned dispatch time, an actual dispatch time and a dispatch object.

[0054] Step 202: Send the set updated test network element information to the network management system at a preset second time interval, so that the network management system determines the updated test network element information as the current test network element information.

[0055] In the embodiment of the present invention, the self-monitoring system sends the updated test network element information to the network management system according to the designated interface, wherein the designated interface includes a CORBA interface or a northbound interface.

[0056] In the embodiment of the present invention, the second time interval can be set according to actual conditions. As an optional solution, the second time interval is 15 minutes.

[0057] In an embodiment of the present invention, the self-monitoring system sends the updated test network element information to the network management system at time intervals. The network management system determines the updated test network element information according to the test network element ID, and the updated test performance indicator in the updated test network element information as the current test performance indicator in the current test network element information; the network management system determines whether the current test performance indicator meets the alarm rules. If it is determined that the current test performance indicator meets the alarm rules, it generates alarm information and queries the dispatching rules corresponding to the alarm information, dispatches according to the dispatching rules and generates a dispatching log.

[0058] For example, the alarm rule is configured as the ratio of the number of MME attached users to the number of MME attached users in the previous period to decrease by more than or equal to 80%. The number of MME attached users in the test network element in the period of 1:00-1:15 is 10, and the number of MME attached users in the period of 1:15-1:30 is 1. The network management system determines the number of MME attached users in the period of 1:15-1:30 as the current test performance indicator, that is, the current number of MME attached users is 1, and the number of MME attached users in the previous period is 1. The percentage of decreased number of MME attached users is 90%, which is greater than 80%, and meets the alarm rules; the network management system generates alarm information, which includes that the number of MME attached users in the period of 1:00-1:15 is 10, the number of MME attached users in the period of 1:15-1:30 is 1, and the number of MME attached users suddenly drops by more than one level threshold alarm; according to the alarm information, it is found that the dispatch rule is to delay dispatching to Department A for 5 minutes, so the network management system dispatches the order to Department A 5 minutes after the planned dispatch time.

[0059] It should be noted that there is a specified delay when the network management system receives the updated test network element information. As an optional solution, the specified delay is 10 minutes. For example, the network management system receives the updated test network element information from 1:15 to 1:30 sent by the self-monitoring system at 1:40.

[0060] Step 203: Receive the alarm information sent by the network management system.

[0061] In the embodiment of the present invention, the network management system sends the alarm information to the self-monitoring system.

[0062] For example, the alarm information includes that the number of MME attached users in the period of 1:00-1:15 is 10, the number of MME attached users in the period of 1:15-1:30 is 1, and the number of MME attached users suddenly drops above the threshold alarm level.

[0063] Step 204: Modify the current test network element information.

[0064] In the embodiment of the present invention, in order to ensure the normal operation of the network management system, the self-monitoring system needs to modify the test performance index of the test network element information of the next cycle to a normal value. For example, the number of MME attached users of the test network element from 1:00 to 1:15 is 10, and the number of MME attached users from 1:15 to 1:30 is 1. At this time, the network management system generates an alarm message. In order to ensure the normal operation of the network management system, the self-monitoring system needs to set the number of MME attached users of the test network element information from 1:30 to 1:45 to a normal value. The normal value is to ensure that the test performance index from 1:30 to 1:45 will not generate a value that exceeds the threshold alarm of the MME attached user number. As an optional solution, the normal value is 10.

[0065] Step 205: Send the modified test network element information to the network management system, so that the network management system determines the modified test network element information as the current test network element information.

[0066] In the embodiment of the present invention, the self-monitoring system sends the modified test network element information to the network management system, and the network management system determines the modified test network element information as the current test network element information. At this time, the network management system does not generate alarm information.

[0067] Step 206: Obtain alarm information and dispatch logs in the network management system.

[0068] In the embodiment of the present invention, the self-monitoring system obtains the alarm information and the dispatch log in the network management system according to the third time interval. The third time interval can be set according to the actual situation. As an optional solution, the third time interval is 10 minutes.

[0069] For example, the self-monitoring system sends the updated test network element information from 1:15 to 1:30 to the network management system at 1:45, and obtains the alarm information and dispatch log in the network management system at 1:55.

[0070] In the embodiment of the present invention, the self-monitoring system obtains alarm information through the alarm query interface opened by the network management system, and obtains the dispatch log through the database view interface opened by the network management system.

[0071] Step 207 , determine whether the alarm information matches the alarm rule and whether the dispatch log matches the dispatch rule. If not, execute step 208 ; if so, execute step 206 .

[0072] In the embodiment of the present invention, the alarm information includes the alarm name, the test performance index of the test network element information in the previous cycle, and the current performance index of the current test network element information.

[0073] In the embodiment of the present invention, the dispatch log includes a planned dispatch time, an actual dispatch time and a dispatch object.

[0074] In an embodiment of the present invention, it is determined whether the test performance indicators of the test network element information of the previous cycle and the current performance indicators of the current test network element information meet the alarm rules, and whether the alarm name corresponding to the alarm rule is the same as the alarm name in the alarm information, and whether the actual dispatch time meets the dispatch rules, and whether the dispatch object in the alarm information is the same as the dispatch object in the dispatch rules. If it is determined that the test performance indicators of the test network element information of the previous cycle and the current performance indicators of the current test network element information meet the alarm rules, and the alarm name corresponding to the alarm rule is the same as the alarm name in the alarm information, and the actual dispatch time If it complies with the dispatching rules and the dispatching object in the alarm information is the same as the dispatching object in the dispatching rules, it indicates that the alarm rules configured in the network management system are in effect, and step 206 is continued; if it is determined that the test performance indicators of the test network element information in the previous cycle and the current performance indicators of the current test network element information do not comply with the alarm rules, or the alarm name corresponding to the alarm rule is different from the alarm name in the alarm information, or the actual dispatching time does not comply with the dispatching rules, or the dispatching object in the alarm information is different from the dispatching object in the dispatching rules, it indicates that the alarm rules configured in the network management system are not effective, and step 208 is continued.

[0075] Step 208: Generate a rule expiration message.

[0076] As an optional solution, the rule expiration message is: The rule configured in the network management system has expired, please handle it as soon as possible.

[0077] Step 209: Send the rule expiration message to the operation and maintenance department.

[0078] In the embodiment of the present invention, the rule expiration message may be sent to the operation and maintenance department via a short message or via an email, which is not limited in the embodiment of the present invention.

[0079] In the embodiment of the present invention, the rule invalidation message is sent to the operation and maintenance department, so that the staff of the operation and maintenance department can conduct timely verification and processing on the rules configured in the network management system.

[0080] In the embodiment of the present invention, a variety of alarm rules and dispatching rules can be configured on the self-monitoring system, which has a wide coverage, improves the accuracy of the test, and lays a good foundation for the reliability of subsequent use in the existing network.

[0081] In the technical solution of the rule effectiveness monitoring method provided by the embodiment of the present invention, the alarm information and dispatch log in the network management system are obtained; the rule effectiveness results are generated according to the set alarm rules, the set dispatch rules, the alarm information and the dispatch log, which can improve the timeliness of the rule effectiveness monitoring, thereby ensuring that the rules can continue to take effect.

[0082] Figure 3Schematic diagram of a rule effectiveness monitoring device provided by an embodiment of the present invention, the device is used to execute the above rule effectiveness monitoring method, such as Figure 3 As shown, the device includes: an acquisition unit 11 and a generation unit 12.

[0083] The acquisition unit 11 is used to acquire alarm information and dispatch logs in the network management system.

[0084] The generating unit 12 is used to generate a rule effectiveness result according to the set alarm rules, the set dispatching rules, the alarm information and the dispatching log.

[0085] In an embodiment of the present invention, the generation unit 12 is specifically used to determine whether the alarm information matches the alarm rules and whether the dispatch log matches the dispatch rules; if it is determined that the alarm information does not match the alarm rules or the dispatch log does not match the dispatch rules, a rule invalidation message is generated.

[0086] In the embodiment of the present invention, the device further includes a sending unit 13.

[0087] The sending unit 13 is used to send the rule expiration message to the operation and maintenance department.

[0088] In an embodiment of the present invention, the sending unit 13 is also used to send the set current test network element information to the network management system, so that the network management system can determine whether the current test network element information complies with the alarm rules. If it is determined that the current test network element information complies with the alarm rules, the alarm information is generated and the dispatching rules corresponding to the alarm information are queried, and the dispatch is performed according to the dispatching rules and a dispatch log is generated.

[0089] In the embodiment of the present invention, the sending unit 13 is specifically configured to send the current test network element information to the network management system according to a preset first time interval.

[0090] In the embodiment of the present invention, the sending unit 13 is further configured to send the set updated test network element information to the network management system at a preset second time interval, so that the network management system determines the updated test network element information as the current test network element information.

[0091] In the embodiment of the present invention, the device further includes: a receiving unit 14 and a modifying unit 15.

[0092] The receiving unit 14 is used to receive alarm information sent by the network management system.

[0093] The modifying unit 15 is used to modify the current test network element information.

[0094] The sending unit 13 is further configured to send the modified test network element information to the network management system, so that the network management system determines the modified test network element information as the current test network element information.

[0095] In the scheme of the embodiment of the present invention, the alarm information and dispatch log in the network management system are obtained; the rule effectiveness results are generated according to the set alarm rules, the set dispatch rules, the alarm information and the dispatch log, which can improve the timeliness of the rule effectiveness monitoring, thereby ensuring that the rules can continue to take effect.

[0096] An embodiment of the present invention provides a storage medium, which includes a stored program, wherein when the program is running, the device where the storage medium is located is controlled to execute the steps of the embodiment of the above-mentioned rule effectiveness monitoring method. For a specific description, please refer to the embodiment of the above-mentioned rule effectiveness monitoring method.

[0097] An embodiment of the present invention provides a computer device, including a memory and a processor, the memory is used to store information including program instructions, the processor is used to control the execution of the program instructions, and when the program instructions are loaded and executed by the processor, the steps of the embodiment of the above-mentioned rule effectiveness monitoring method are implemented. For a specific description, please refer to the embodiment of the above-mentioned rule effectiveness monitoring method.

[0098] Figure 4 A schematic diagram of a computer device provided by an embodiment of the present invention. Figure 4 As shown, the computer device 30 of this embodiment includes: a processor 31, a memory 32, and a computer program 33 stored in the memory 32 and executable on the processor 31. When the computer program 33 is executed by the processor 31, the method for monitoring the effectiveness of rules in the embodiment is implemented. To avoid repetition, it is not described one by one here. Alternatively, when the computer program is executed by the processor 31, the functions of each model / unit in the device for monitoring the effectiveness of rules in the embodiment are implemented. To avoid repetition, it is not described one by one here.

[0099] The computer device 30 includes, but is not limited to, a processor 31 and a memory 32. Those skilled in the art will appreciate that Figure 4 This is only an example of the computer device 30 and does not constitute a limitation of the computer device 30. The computer device 30 may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the computer device may also include input and output devices, network access devices, buses, etc.

[0100] The processor 31 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0101] The memory 32 may be an internal storage unit of the computer device 30, such as a hard disk or memory of the computer device 30. The memory 32 may also be an external storage device of the computer device 30, such as a plug-in hard disk, a Smart Media (SM) card, a Secure Digital (SD) card, a Flash Card, etc. equipped on the computer device 30. Further, the memory 32 may also include both an internal storage unit of the computer device 30 and an external storage device. The memory 32 is used to store computer programs and other programs and data required by the computer device. The memory 32 may also be used to temporarily store data that has been output or is to be output.

[0102] In the several embodiments provided by the present invention, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0103] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0104] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0105] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims

1. A method for monitoring the effectiveness of a rule, characterized in that: The method comprises: Obtain alarm information and dispatch logs from the network management system; Generate a rule effectiveness result according to the set alarm rules, the set dispatch rules, the alarm information and the dispatch log; The generating of rule effectiveness results according to the set alarm rules, the set dispatching rules, the alarm information and the dispatching log includes: Determine whether the alarm information matches the alarm rule and whether the dispatch log matches the dispatch rule; The alarm information includes the alarm name, the test performance index of the test network element information of the previous cycle and the current performance index of the current test network element information; The dispatch log includes the planned dispatch time, the actual dispatch time and the dispatch object; The determining whether the alarm information matches the alarm rule and whether the dispatch log matches the dispatch rule includes: Determine whether the test performance indicators of the test network element information of the previous cycle and the current performance indicators of the current test network element information comply with the alarm rules, and whether the alarm name corresponding to the alarm rules is the same as the alarm name in the alarm information, and whether the actual dispatch time complies with the dispatch rules, and whether the dispatch object in the alarm information is the same as the dispatch object in the dispatch rules; Before obtaining the alarm information and dispatch log in the network management system, the method further includes: Sending the set current test network element information to the network management system, so that the network management system can determine whether the current test network element information complies with the alarm rule; if it is determined that the current test network element information complies with the alarm rule, generating the alarm information and querying the dispatching rule corresponding to the alarm information, dispatching the order according to the dispatching rule and generating the dispatching log; After sending the set current test network element information to the network management system, the method further includes: Receiving the alarm information sent by the network management system; Modify the current test network element information; The modified test network element information is sent to the network management system, so that the network management system determines the modified test network element information as the current test network element information.

2. The method according to claim 1, characterized in that The rule effectiveness result includes a rule failure message. If it is determined that the alarm information does not match the alarm rule or the dispatch log does not match the dispatch rule, the rule failure message is generated.

3. The method according to claim 2, characterized in that After the rule failure message is generated if it is determined that the alarm information does not match the alarm rule or the dispatch log does not match the dispatch rule, the method further includes: The rule expiration message is sent to the operation and maintenance department.

4. The method according to claim 1, characterized in that The sending the set current test network element information to the network management system includes: The current test network element information is sent to the network management system according to a preset first time interval.

5. The method according to claim 1, characterized in that After sending the set test network element information to the network management system, the method further includes: The set updated test network element information is sent to the network management system at a preset second time interval, so that the network management system determines the updated test network element information as the current test network element information.

6. A rule effectiveness monitoring device, characterized in that: The device comprises: An acquisition unit, used to acquire alarm information and dispatch logs in the network management system; A generating unit, configured to generate a rule effectiveness result according to a set alarm rule, a set dispatching rule, the alarm information and the dispatching log; The generating unit is specifically used to determine whether the alarm information matches the alarm rule and whether the dispatch log matches the dispatch rule; The alarm information includes the alarm name, the test performance index of the test network element information of the previous cycle and the current performance index of the current test network element information; The dispatch log includes the planned dispatch time, the actual dispatch time and the dispatch object; The generating unit is specifically used to determine whether the test performance indicators of the test network element information of the previous cycle and the current performance indicators of the current test network element information comply with the alarm rules, and whether the alarm name corresponding to the alarm rules is the same as the alarm name in the alarm information, and whether the actual dispatch time complies with the dispatch rules, and whether the dispatch object in the alarm information is the same as the dispatch object in the dispatch rules; A sending unit is used to send the set current test network element information to the network management system, so that the network management system can determine whether the current test network element information meets the alarm rules. If it is determined that the current test network element information meets the alarm rules, the alarm information is generated and the dispatching rules corresponding to the alarm information are queried, and the dispatch is performed according to the dispatching rules and a dispatch log is generated; The device further comprises: a receiving unit and a modifying unit; The receiving unit is used to receive the alarm information sent by the network management system; The modification unit is used to modify the current test network element information; The sending unit is further used to send the modified test network element information to the network management system, so that the network management system determines the modified test network element information as the current test network element information.

7. A storage medium, characterized in that: The storage medium includes a stored program, wherein when the program is running, the device where the storage medium is located is controlled to execute the rule effectiveness monitoring method described in any one of claims 1 to 5.

8. A computer device comprising a memory and a processor, wherein the memory is used to store information including program instructions, and the processor is used to control the execution of the program instructions, characterized in that: When the program instructions are loaded and executed by the processor, the rule effectiveness monitoring method described in any one of claims 1 to 5 is implemented.

Images