Method and device for monitoring operation of core network
By simulating user behavior for dialing tasks and filtering target network elements, the problem of inefficient troubleshooting efficiency caused by invalid alarms during core network operation is solved, and fast and accurate fault location is achieved.
Patent Information
- Application Number
- CN202411129072.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-16
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2044-08-16
AI Technical Summary
During the operation of the core network, the existing monitoring plan causes operation and maintenance personnel to spend a long time to troubleshoot faulty network elements due to a large number of invalid alarms, which is less efficient.
By simulating user behavior, dialing tasks, generating dialing calls, filtering out the target network element set based on the number of times the test item fails, determining the faulty network element, reducing the number of invalid alarms and troubleshooting network elements.
It realizes the rapid and accurate determination of faulty network elements, improves the timeliness and accuracy of fault location, and reduces the workload of operation and maintenance personnel.
Smart Images

Figure CN119012245A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of core network operation monitoring, and in particular to a method and device for monitoring core network operation. Background Art
[0002] The core network is a key part that plays a core role in the mobile communication system. It carries user data and control signaling, and provides interconnection functions with other networks. The core network is responsible for managing and routing data traffic to ensure the normal operation of the mobile network.
[0003] During the operation of the core network, the software and hardware of the core network elements need to be monitored. If an abnormal operation is encountered, the operation and maintenance personnel will be notified through alarms, and the operation and maintenance personnel will locate the faulty network element based on the content of the alarm. However, the current telecommunications network business is huge in scale, with a wide variety of equipment, and the alarms issued by the monitoring components have become massive, and a large number of alarms are invalid, which results in the operation and maintenance personnel spending a long time to troubleshoot the faulty network elements based on the alarms, and the efficiency is low.
[0004] Therefore, there is an urgent need for a solution for monitoring the operation of the core network that is conducive to quickly troubleshooting faulty network elements. Summary of the invention
[0005] The present application provides a method and device for monitoring the operation of a core network, which can quickly and effectively determine the network element where a fault occurs.
[0006] In a first aspect, a method for monitoring core network operation is provided, comprising:
[0007] Obtain at least one dial test task, each dial test task is used to test the completion of the test item executed by the network element on the route by simulating user behavior, the completion status includes success or failure of the test item execution, and each route is a path formed by the network element of the core network;
[0008] Acquire a dial test call sheet by communicating with a dial test module, the dial test module being used to periodically execute each dial test task with a first period length, and generate a dial test call sheet for recording the completion status of each test item executed;
[0009] Based on the number of execution failures of each test item in the dial test call record, a target network element set is screened out from network elements corresponding to the target test items whose number of consecutive execution failures exceeds a second threshold; the target network element set is composed of network elements whose probability of failure is greater than the first threshold;
[0010] A target network element having a fault in the core network is determined from the target network element set.
[0011] In a feasible design, based on the number of execution failures of each test item in the dial test record, a target network element set is screened out from network elements corresponding to target test items whose number of consecutive execution failures exceeds a second threshold, including:
[0012] The number of times each test item in the call log fails to be executed is counted periodically with the second cycle length;
[0013] After the target test items whose number of consecutive execution failures exceeds the second threshold are grouped according to the corresponding test services, a test item alarm call sheet is generated; each test service corresponds to one or more test items, and the test item alarm call sheet is also used to record the test item alarm time, which is the time when the number of target test item execution failures is detected to exceed the second threshold;
[0014] The target network element set is determined based on the key network element set of the test items and the overlapping network element set of the test items corresponding to each test service. The key network element set of the test items is the set of network elements included in the route of the target test item with the earliest test item alarm moment in the test service. The overlapping network element set of the test items is the intersection of the network element sets corresponding to the routes of each target test item corresponding to the test service.
[0015] In a feasible design, the target network element set is determined according to the test item key network element set and the test item overlap network element set corresponding to each test service, including:
[0016] Obtaining a first test item network element set corresponding to each test service, where the first test item network element set is an intersection or union of a test item key network element set and a test item coincident network element set;
[0017] The intersection or union of the first test item network element sets corresponding to each test service is determined as the target network element set.
[0018] In one possible design, the method further includes:
[0019] Determine the intersection of the test item key network element sets corresponding to each test service in the test item alarm call record as the second test item network element set;
[0020] Determine the intersection of the test item overlapping network element sets corresponding to each test service in the test item alarm call record as the third test item network element set;
[0021] The target network element set is updated according to the intersection of the target network element set, the second test item network element set and the third test item network element set.
[0022] In one possible design, the method further includes:
[0023] After periodically counting the number of execution failures of each test item within a preset time from the start time of the cycle for each test service of the test item alarm call sheet with a third cycle length, a service alarm call sheet is generated. The service alarm call sheet is used to record the test service in which the number of execution failures of each test item exceeds the third threshold, the test item corresponding to the test service, and the service alarm time. The service alarm time is the time when it is detected that the number of execution failures of each test item in the test service exceeds the third threshold;
[0024] Determine each target test service in the service alarm call record whose service alarm time is within a preset time from the current time;
[0025] Determine a test item sequence according to the test items in each target test service that meet the preset time condition and have a number of execution failures exceeding a fourth threshold, wherein the test items in the test item sequence are sorted from largest to smallest according to the number of execution failures, and the preset time condition is that the execution time of the test item is within a time range formed by a service alarm time of the target test service to which it belongs and the current time;
[0026] Obtain a first service network element set corresponding to each target test service, the first service network element set being the intersection or union of a service-critical network element set and a service-overlapping network element set corresponding to the target test service, the service-critical network element set being the set of network elements included in the route of the first test item in the test item sequence corresponding to the target test service, and the service-overlapping network element set being the intersection of network element sets corresponding to the routes of each test item in the test item sequence corresponding to the target test service;
[0027] The target network element set is updated according to the intersection of the intermediate network element set and the target network element set, where the intermediate network element set is the intersection or union of the first service network element sets corresponding to each target test service.
[0028] In a feasible design, each target test service includes a first target test service, and a first service network element set corresponding to each target test service is obtained. The first service network element set is an intersection or union of a service key network element set corresponding to the target test service and a service overlap network element set, including:
[0029] Obtaining each network element to be tested of the route corresponding to each test item that meets the preset time condition in the first target test service;
[0030] Counting the first number of failures of each network element to be tested in executing a test item of a first target test service within a preset time;
[0031] Counting the second number of times that each network element to be tested fails to execute the test items of each target test service including its own route within a preset time;
[0032] Calculate the overlap rate of each network element to be detected, where the overlap rate is the ratio of the first number to the second number of the network element to be detected;
[0033] Determine a set consisting of network elements to be detected whose overlap rate is greater than a fifth threshold as a high overlap rate network element set;
[0034] A first service network element set corresponding to the first target test service is obtained, where the first service network element set is the intersection or union of a service-critical network element set, a service-overlapping network element set, and a high-overlapping network element set corresponding to the first target test service.
[0035] In one possible design, the method further includes:
[0036] Determine the intersection of the business key network element sets corresponding to each target test business in the business alarm call sheet as the second business network element set;
[0037] Determine the intersection of the service overlap network element sets corresponding to each target test service in the service alarm call sheet as the third service network element set;
[0038] Determine the intersection of the high overlap rate network element sets corresponding to each target test service in the service alarm call sheet as the fourth service network element set;
[0039] The target network element set is updated according to the intersection of the target network element set, the second service network element set, the third service network element set and the fourth service network element set.
[0040] In one possible design, the method further includes:
[0041] Determine the target model, which is used to define the connection relationship between network elements in the core network;
[0042] Obtain the characteristic code of each network element in the core network;
[0043] Arrange at least one dialing test task according to the feature code and target model of each network element.
[0044] In a feasible design, determining a target network element having a fault in the core network from a set of target network elements includes:
[0045] If the number of network elements in the target network element set is 1, the network element in the target network element set is determined as the target network element having a fault in the core network;
[0046] If the number of network elements in the target network element set is greater than 1, a prompt message including information of each network element in the target network element set is sent to the handheld device of the operation and maintenance personnel, and the prompt message is used to remind the operation and maintenance personnel to troubleshoot the faulty target network element from the target network element set.
[0047] In a second aspect, a device for monitoring core network operation is provided, including:
[0048] A dial test task acquisition module is used to acquire at least one dial test task, each dial test task is used to test the completion of the test item executed by the network element on the route by simulating user behavior, the completion status includes the success or failure of the test item execution, and each route is a path composed of network elements of the core network;
[0049] A dial test call record acquisition module, used for acquiring a dial test call record by communicating with a dial test module, the dial test module being used for periodically executing each dial test task with a first period length, and generating a dial test call record for recording the completion status of each test item executed;
[0050] A target network element set determination module is used to screen out a target network element set from network elements corresponding to target test items whose number of consecutive execution failures exceeds a second threshold value based on the number of execution failures of each test item in the dial test call record; the target network element set is composed of network elements whose probability of failure is greater than the first threshold value;
[0051] The target network element determination module is used to determine the target network element where a fault occurs in the core network from the target network element set.
[0052] Since the more times a certain test item fails to execute, the greater the probability that the network element on the route corresponding to the test item fails. Therefore, after obtaining the dial test call record that records the completion status of each test item executed, the embodiment of the present application can screen out a target network element set consisting of network elements with a probability of failure greater than a first threshold (i.e., a greater possibility of failure) from the network elements included in the route of the test item in at least one dial test task based on the number of times each test item fails to execute in the dial test call record. In the current core network monitoring scheme, as long as the test item fails, an alarm is issued, resulting in a large number of invalid alarms. The operation and maintenance personnel need to perform complex calculations and screening on the network elements of the routes corresponding to a large number of invalid alarms to troubleshoot the network elements that have failed. Compared with the number of network elements in the test items that issue a large number of alarms in the current core network monitoring scheme, the scheme of the present application, based on the number of times the test item fails to execute, the number of network elements in the target network element set that are accurately and effectively screened is greatly reduced. Therefore, the network element that has failed can be accurately and quickly determined from the target network element set, which improves the real-time performance of determining the target network element that has failed.
[0053] Furthermore, the smaller the set length of the first cycle is, the higher the frequency of execution of the dialing task will be. If a network element on the route corresponding to the test item fails, the frequency of failure of the test item will also increase, which is conducive to speeding up the speed of screening out the target network element set, thereby further improving the speed of determining the faulty network element from the target network element set.
[0054] In addition, in the present application scheme, the dialing test task can be executed by the dialing test module that has been deployed in the core network. By communicating with the dialing test module, the dialing test call record generated by the dialing test module can be obtained without increasing the deployment cost. BRIEF DESCRIPTION OF THE DRAWINGS
[0055] In order to more clearly illustrate the technical solution of the present application, the drawings required for use in the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.
[0056] Figure 1 is a schematic flow chart of a method for monitoring core network operation provided by an exemplary embodiment of the present application;
[0057] Figure 2 is a schematic diagram of a dialing task model provided by an exemplary embodiment of the present application;
[0058] Figure 3 is another example of a dialing task model schematic diagram provided by an exemplary embodiment of the present application;
[0059] Figure 4 It is another schematic diagram of a dialing task model provided by an exemplary embodiment of the present application;
[0060] Figure 5 It is a schematic diagram of a device for monitoring core network operation provided by an exemplary embodiment of the present application. DETAILED DESCRIPTION
[0061] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0062] At present, in the scheme of monitoring the core network, it is usually necessary to deploy different monitoring components for different core network components, which requires a lot of costs from both the development perspective and the operation and maintenance perspective. In addition, the current core network equipment is large in scale, which will generate a large number of invalid monitoring alarms, making it difficult for operation and maintenance personnel to eliminate the faulty network elements according to the alarms. From the occurrence of alarms to the location of faults, it often requires complex calculations and screening to be located. Since it takes a long time to determine the faulty network element, the timeliness of this scheme is poor.
[0063] In this regard, the present application provides a method for monitoring the operation of a core network, such as Figure 1 As shown, the method includes:
[0064] S110: Obtain at least one dialing test task.
[0065] Each dial test task is used to simulate user behavior to test the completion of the test items executed by network elements on the route. The completion status includes success or failure of the test items. Each route is a path composed of network elements of the core network.
[0066] Test services refer to services that need to be tested based on customer needs. For example, for operators, test services include 4G voice services and 5G communication services. Each test service corresponds to one or more test items, and each test item corresponds to a route, that is, each test service can be executed by network elements on one or more routes. Each dial test task is used to test a test item, as shown in Table 1:
[0067] Table 1
[0068]
[0069] Among them, "C" represents the test service, "001" represents the test item of the test service "C", and "C001" is the dial test task corresponding to the test item "001" of the test service "C". "MME31" and "SAEGW31" are the network elements through which the route corresponding to the test item passes.
[0070] In the process of executing the dialing test task, the present application scheme simulates the user access behavior to test whether the network element can successfully execute the test item, thereby realizing the monitoring of the core network performance.
[0071] In a feasible design, the dial test task can be generated in the following way:
[0072] Determine the target model, which is used to define the connection relationship between network elements in the core network;
[0073] Obtain the characteristic code of each network element in the core network;
[0074] Arrange at least one dialing test task according to the feature code and target model of each network element.
[0075] The feature code is used to record the device information of the network element.
[0076] In the above example, each dial test task can be pre-arranged according to the characteristic code and target model of the network element.
[0077] In one feasible design, determining the target model includes:
[0078] Determine the target model based on the number of network elements in the deployment area of the core network.
[0079] Exemplarily, according to the number of network elements in the deployment area of the core network, the target model is determined from the following three models:
[0080] Fully connected model, fully covered model and binary sampling model.
[0081] Among them, Figure 2 As shown in the figure, each network element in the fully connected model is connected to all network elements in the previous layer. In this model, all routes will be traversed, which means that the most routes can be tested, the most test services are traversed, the most comprehensive coverage of fault discovery scenarios, and the strongest fault location capability. However, the deployment cost is high, and the number of test items increases exponentially with the network element level. Number of test items = number of network elements at level 1 * number of network elements at level 2 * number of network elements at level 3 * … * number of network elements at level n. This model is suitable for scenarios with a small number of network element levels.
[0082] like Figure 3 As shown in the figure, in the full coverage model, each network element has at least one directional route coverage. The number of test items to be deployed is relatively small (number of test items = Max (number of network elements at a single level)). It has the ability to locate paths and faulty network elements in small-scale scenarios, but its fault location capability is relatively weak in large-scale scenarios.
[0083] like Figure 4 As shown in the figure, in the binary sampling model, each network element has at least two branches upstream and downstream, ensuring that each network element has at least two directional routing coverage. The number of test items in this model is less than that of the full connection model, but more than that of the full coverage model. In large-scale scenarios, the fault location capability is stronger than that of the full coverage model.
[0084] Different models have different problem discovery, positioning capabilities, and applicable core network scales. Based on the number of network elements in the deployment area of the core network (i.e., the scale of the core network) and the positioning accuracy requirements, a suitable model can be used to arrange the dialing task, and the route composed of the network elements along the dialing task path can be determined through the dialing task.
[0085] S120, obtaining a dialing test call record by communicating with the dialing test module.
[0086] The dialing test module is used to periodically execute each dialing test task with a first period length, and generate a dialing test call record for recording the completion status of each test item executed.
[0087] Exemplarily, the dialing call record includes the following contents: task name, task ID, number attribute, start time, end time, calling number, called number, result, result description, delay, packet loss rate, single pass, jitter, and call record association ID.
[0088] For example, the call record of the dial test task "C002" is: C002|22041362611600963|Calling|2022-09-0710:08:00|2022-09-07 10:08:41|13800001234|138XXXXXXXX|Success||1567|0|No|1|04c7e00a066317fd11772c.
[0089] The length of the first cycle can be set according to actual needs, for example, the length of the first cycle is 1 minute. The dialing test task is performed once every first cycle length to achieve real-time monitoring of the corresponding route.
[0090] This application solution can obtain the dial test call record generated by the dial test module by communicating with the dial test module already deployed in the core network. After arranging the dial test task, this application can directly add the dial test task that has not been deployed by the dial test module to the deployed dial test module without adding additional deployment costs.
[0091] S130, based on the number of execution failures of each test item in the call log, a target network element set is screened out from network elements corresponding to target test items whose number of consecutive execution failures exceeds a second threshold; the target network element set is composed of network elements whose probability of failure is greater than a first threshold.
[0092] It should be understood that the first threshold is not a pre-set threshold and has no specific value. The probability of a failure being greater than the first threshold means that the possibility of a failure is greater.
[0093] After research, the present application believes that if the number of test item execution failures is small, such as 1, the network elements on the route corresponding to the test item are usually not faulty, the test item execution failure is sporadic, and the probability of network element failure is small. As the number of test item execution failures increases, the probability of failure of the network elements on the route corresponding to the test item increases. Therefore, based on the statistics and analysis of the number of test item execution failures in the dial test call record, invalid alarms caused by sporadic test item execution failures can be effectively eliminated, thereby screening out network elements with a greater probability of failure.
[0094] In a feasible design, the target network element set is screened out from network elements corresponding to target test items whose number of consecutive execution failures exceeds a second threshold value based on the number of execution failures of each test item in the call log in the dial test.
[0095] The number of times each test item in the call log fails to be executed is counted periodically with the second cycle length;
[0096] After the target test items whose number of consecutive execution failures exceeds the second threshold are grouped according to the corresponding test services, a test item alarm call sheet is generated; each test service corresponds to one or more test items, and the test item alarm call sheet is also used to record the test item alarm time, which is the time when the number of target test item execution failures is detected to exceed the second threshold;
[0097] The target network element set is determined based on the key network element set of the test items and the overlapping network element set of the test items corresponding to each test service. The key network element set of the test items is the set of network elements included in the route of the target test item with the earliest test item alarm moment in the test service. The overlapping network element set of the test items is the intersection of the network element sets corresponding to the routes of each target test item corresponding to the test service.
[0098] The length of the second cycle can be set according to actual needs.
[0099] The second threshold can be set according to actual needs, for example, the second threshold is set to 3.
[0100] The continuous execution failure means that the test item is executed once every the first cycle length and fails for multiple consecutive executions.
[0101] For example, the number of failed executions of each test item in the dial test call list is counted every 1 minute, and the target test items that have failed to execute continuously for more than 3 times are grouped according to the corresponding test services to generate a test item alarm call list. The content of the test item alarm call list is shown in the following Table 2:
[0102] Table 2
[0103]
[0104] The above example counts the number of times each test item in the dial test call sheet fails. If the number of times the test item fails to execute continuously exceeds the second threshold, it means that the probability of the test item failing is relatively high (i.e., greater than the first threshold). Therefore, the target test items whose number of consecutive execution failures exceeds the second threshold are grouped according to the corresponding test services, and the generated test item alarm call sheet realizes the preliminary screening of the test items, greatly reducing the number of invalid alarms. Furthermore, the target test item with the earliest alarm time in the test service can be used as the key route of the test service, and the network element set corresponding to the key route (i.e., the test item key network element set) participates in the subsequent calculation. Considering that after a network element fails, all test items passing through the network element will fail. Therefore, the intersection of the network element sets corresponding to the routes of each target test item corresponding to the current test service is determined as the test item overlap network element set, which can further screen the failed network element. Finally, according to the test item key network element set and the test item overlap network element set corresponding to each test service, the number of network elements in the determined target network element set is greatly reduced compared with the number of network elements in the test items that have issued all alarms. In the current core network monitoring solution, as long as the test item fails, an alarm is issued, resulting in a large number of invalid alarms. The operation and maintenance personnel need to perform complex calculations and screening on the network elements of the routes corresponding to the large number of alarms to troubleshoot the faulty network elements. Compared with the current core network monitoring solution, in the solution of this application, the faulty network element can be quickly and accurately determined from the target network element set.
[0105] In addition, the above example may be performed once every second period length, by continuously updating the target network element set to ensure the real-time and accuracy of the target network element set.
[0106] Exemplarily, the target network element set is determined according to the test item key network element set and the test item overlap network element set corresponding to each test service in the following manner:
[0107] Obtaining a first test item network element set corresponding to each test service, where the first test item network element set is an intersection or union of a test item key network element set and a test item coincident network element set;
[0108] The intersection or union of the first test item network element sets corresponding to each test service is determined as the target network element set.
[0109] Further exemplary, the first test item network element set corresponding to each test service is obtained by the following method, where the first test item network element set is the intersection or union of the test item key network element set and the test item coincident network element set:
[0110] Firstly, an intersection operation is performed on the test item key network element set and the test item coincident network element set to obtain a first test item network element set;
[0111] If the first test item network element set is empty, a union operation is performed on the test item key network element set and the test item overlapping network element set, and the obtained network element set is added to the first test item network element set.
[0112] Considering that when a network element fails, all test items passing through the network element will fail. Therefore, first taking the intersection of the test item key network element set and the test item overlap network element set can quickly locate the network element where the test service fails. If the first test item network element set is empty, it means that the probability that all network elements in the test item key network element set and the test item overlap network element set fail is small. In order to avoid this low-probability event, the union of the test item key network element set and the test item overlap network element set is used as the first test item network element set, so that it can be used as the target network element set for operation and maintenance personnel to check.
[0113] The following describes the calculation target network element set for the two test services in Table 2 in combination with the test services in the test item alarm call list shown in Table 2:
[0114] The target test item 001 corresponding to the 4G voice service has the earliest alarm time. By querying the corresponding dialing task, the route of the target test item 001 of the 4G voice service is obtained, which is composed of network elements "A, B, C, D". The network element set [A, B, C, D] corresponding to the route of the target test item 001 is determined as the key network element set of the test item. Since the test service corresponds to only one target test item, the set of network elements overlapping the test items is also [A, B, C, D]. The intersection operation is performed on the key network element set of the test item and the set of network elements overlapping the test items, and the first test item network element set obtained is [A, B, C, D].
[0115] The target test item 001 corresponding to the 5G communication service has the earliest alarm time. By querying the corresponding dialing task, the route of the target test item 001 of the 5G communication service is obtained, which is composed of network elements "A, B, C". The network element set [A, B, C] corresponding to the route of the target test item 001 is determined as the key network element set of the test item. Then the route of the target test item 003 is obtained, which is composed of network elements "B, C, E". The intersection [B, C] of the network element set [A, B, C] and the network element set [B, C, E] is taken as the test item overlapping network element set. Take the intersection of the test item key network element set and the test item overlapping network element set, and the first test item network element set obtained is [B, C].
[0116] Perform an intersection operation on the first test item network element sets corresponding to each test service, and obtain a target network element set of [B, C].
[0117] In the above example, by performing intersection or union operations on the test item key network element set and the test item coincident network element set, the first test item network element set is accurately obtained, and the probability of network elements failing in the first test item network element set is relatively high. Performing intersection or union operations on the first test item network element set corresponding to each test service can further accurately obtain the target network element set.
[0118] In a feasible design, in order to further enhance the screening effect of faulty network elements in the target network elements and further reduce the number of network elements that need to be checked in the target network element set, the intersection of the test item key network element set corresponding to each test service in the test item alarm call sheet can also be determined as the second test item network element set;
[0119] Determine the intersection of the test item overlapping network element sets corresponding to each test service in the test item alarm call record as the third test item network element set;
[0120] The target network element set is updated according to the intersection of the target network element set, the second test item network element set and the third test item network element set.
[0121] For example, firstly, an intersection operation is performed on the test item key network element set corresponding to each test service in the test item alarm call sheet to obtain a second test item network element set. Secondly, an intersection operation is performed on the test item overlap network element set corresponding to each test service in the test item alarm call sheet to obtain a third test item network element set; then, the target network element set is updated using the intersection of the target network element set, the second test item network element set, and the third test item network element set.
[0122] Exemplarily, updating the target network element set using the intersection of the target network element set, the second test item network element set and the third test item network element set refers to determining the intersection of the target network element set, the second test item network element set and the third test item network element set as a new target network element set.
[0123] Exemplarily, if the intersection of the target network element set, the second test item network element set and the third test item network element set is empty, in order to comprehensively check the network elements, the union of the three can also be calculated as a new target network element set for operation and maintenance personnel to check.
[0124] Continuing to use the content shown in Table 2 as an example, the above example is explained:
[0125] The key network element set of test items corresponding to 4G voice service is [A, B, C, D], and the key network element set of test items corresponding to 5G communication service is [A, B, C]. After the intersection operation, the second test item network element set obtained is [A, B, C].
[0126] The set of overlapping network elements for the test items corresponding to the 4G voice service is [A, B, C, D], and the set of overlapping network elements for the test items corresponding to the 5G communication service is [B, C]. After the intersection operation, the third set of network elements for the test items is [B, C].
[0127] Use the intersection [B, C] of the target network element set [B, C] obtained in the previous example, the second test item network element set [A, B, C], and the third test item network element set [B, C] to update the target network element set. The new target network element set is [B, C].
[0128] Since a test service may correspond to multiple test items, the failure of a test item does not mean that the test service to which it belongs has failed. For operation and maintenance personnel, if there is no test service failure, first check the faulty network element that caused the test item failure. When there is a test service failure, early detection and maintenance of the faulty network element that caused the test service failure can minimize the loss.
[0129] Therefore, based on the test item alarm call record, it is necessary to further determine the faulty network element in the target network element set that causes the test service failure. In a feasible design, the following method is shown:
[0130] After periodically counting the number of execution failures of each test item within a preset time from the start time of the cycle for each test service of the test item alarm call sheet with a third cycle length, a service alarm call sheet is generated. The service alarm call sheet is used to record the test service in which the number of execution failures of each test item exceeds the third threshold, the test item corresponding to the test service, and the service alarm time. The service alarm time is the time when it is detected that the number of execution failures of each test item in the test service exceeds the third threshold;
[0131] Determine each target test service in the service alarm call record whose service alarm time is within a preset time from the current time;
[0132] Determine a test item sequence according to the test items in each target test service that meet the preset time condition and have a number of execution failures exceeding a fourth threshold, wherein the test items in the test item sequence are sorted from largest to smallest according to the number of execution failures, and the preset time condition is that the execution time of the test item is within a time range formed by a service alarm time of the target test service to which it belongs and the current time;
[0133] Obtain a first service network element set corresponding to each target test service, the first service network element set being the intersection or union of a service-critical network element set and a service-overlapping network element set corresponding to the target test service, the service-critical network element set being the set of network elements included in the route of the first test item in the test item sequence corresponding to the target test service, and the service-overlapping network element set being the intersection of network element sets corresponding to the routes of each test item in the test item sequence corresponding to the target test service;
[0134] The target network element set is updated according to the intersection of the intermediate network element set and the target network element set, where the intermediate network element set is the intersection or union of the first service network element sets corresponding to each target test service.
[0135] Among them, the third cycle length, the preset time, the third threshold and the fourth threshold can be set according to actual needs.
[0136] It should be noted that the current time is a real-time concept, which refers to the start time of the program running the corresponding algorithm, that is, the start time of determining each target test service in the service alarm call record.
[0137] Exemplarily, obtaining the first service network element set corresponding to the target test service is achieved by:
[0138] Firstly, an intersection operation is performed on a service-critical network element set corresponding to the target test service and a service-overlapping network element set corresponding to the target test service to obtain a first service network element set;
[0139] If the first test item network element set is empty, a union operation is performed on the service-critical network element set and the service-overlapping network element set, and the obtained network element set is added to the first service network element set.
[0140] In this example, if the first service network element set is empty, it means that the probability that all network elements in the service-critical network element set and the service-overlapping network element set fail is low. In order to avoid this low-probability event, the union of the service-critical network element set and the service-overlapping network element set is further added to the first service network element set, so that it can be used as a target network element set for operation and maintenance personnel to check.
[0141] Exemplarily, based on the service alarm call list generated in the current cycle, after the target network element set is updated, when the next cycle starts, a new service alarm call list is generated again and the original service alarm call list is overwritten.
[0142] For example, the preset time is 30 minutes, the third threshold is 10 times, and the fourth threshold is 3 times. The effect of the above example is described below by taking the numerical values in this example as an example:
[0143] Since the dial test call record can record the time when the test item fails to execute, on this basis, when the test items of a certain test service in the test item alarm call record fail to execute more than 10 times within 30 minutes from the start time of the cycle, the test service is considered to have failed and added to the service alarm call record. The setting of the preset time is conducive to ensuring the real-time nature of the determined faulty network element. At this time, the target test service in the service alarm call record, that is, the test service that has an alarm, needs to be further located for the faulty network element. In the process of locating the faulty network element:
[0144] In order to ensure real-time performance, in the test service, the test items that have failed to execute more than 3 times within the time range from the service alarm moment to the current moment are sorted from large to small according to the number of failures to generate a test item sequence. The moments of the most recent execution failures of each test item in the test item sequence are all within the time range from the service alarm moment to the current moment, which further ensures the real-time performance of the solution. Since the more times the test items fail to execute, the greater the probability of each network element in the test item failing. Therefore, the set of network elements corresponding to the routes of the test items with the most failures is used as a business-critical network element set to participate in the subsequent positioning of the faulty network elements, which can improve accuracy and efficiency. Similarly, in the business overlap network element set composed of the intersection of the network element sets corresponding to the test items with a large number of execution failures, the probability of each network element failing is much higher than that of other network elements. Therefore, the probability of failure of the first business network element set obtained by performing an intersection operation or a union operation on the business-critical network element set and the business overlap network element set is further improved. The network element set obtained by performing intersection operation or union operation on the first service network element set corresponding to each test service and the target network element set are used as the new target network element set after performing intersection operation, which can further reduce the number of network elements in the target network element set. This is conducive to the operation and maintenance personnel to quickly and accurately troubleshoot the network elements of the failed test service.
[0145] In the above example, the operation of the network element set can be found in the description of the example of determining the faulty network element based on the test item alarm call record, taking the content of Table 2 as an example, and will not be repeated here.
[0146] In a feasible design, each target test service includes a first target test service. Taking the first target test service as an example, the first service network element set can be calculated by counting the network element set whose overlap rate is greater than the fifth threshold, so as to achieve the effect of further screening the faulty network element corresponding to the first target test service. The specific method is as follows:
[0147] Obtaining each network element to be tested of the route corresponding to each test item that meets the preset time condition in the first target test service;
[0148] Counting the first number of failures of each network element to be tested in executing a test item of a first target test service within a preset time;
[0149] Counting the second number of times that each network element to be tested fails to execute the test items of each target test service including its own route within a preset time;
[0150] Calculate the overlap rate of each network element to be detected, where the overlap rate is the ratio of the first number to the second number of the network element to be detected;
[0151] Determine a set consisting of network elements to be detected whose overlap rate is greater than a fifth threshold as a high overlap rate network element set;
[0152] A first service network element set corresponding to the first target test service is obtained, where the first service network element set is the intersection or union of a service-critical network element set, a service-overlapping network element set, and a high-overlapping network element set corresponding to the first target test service.
[0153] The fifth threshold may be set according to actual needs, for example, may be 80%.
[0154] In this example, the first number can be understood as the number of times the network element to be tested fails to execute the test items of the first target test service, and the second number can be understood as the number of times all test items executed by the network element to be tested fail. The "all test items" refers to all test items of the test service passing through the network element to be tested.
[0155] Exemplarily, if the first business network element set is the intersection of the business-critical network element set, the business overlapping network element set and the high overlap rate network element set corresponding to the first target test business, and the obtained first business network element set is empty, then the union of the business-critical network element set, the business overlapping network element set and the high overlap rate network element set is added to the first business network element set.
[0156] In the above example, considering that the network elements with an overlap rate greater than the fifth threshold in the route of the test service mean that the probability of failure is high, therefore, when the intersection operation is performed on the service-critical network element set, the service overlap network element set and the high overlap rate network element set, the screening effect of the faulty network elements can be further enhanced, making the first service network element set more accurate. When the union operation is performed on the service-critical network element set, the service overlap network element set and the high overlap rate network element set, the network elements included in the first service network element set can be made more comprehensive, so that the operation and maintenance personnel can comprehensively check the network elements in the first service network element set.
[0157] In a feasible design, the network elements in the target network element set may be further filtered in the following manner to further reduce the number of network elements that need to be checked:
[0158] Determine the intersection of the business key network element sets corresponding to each target test business in the business alarm call sheet as the second business network element set;
[0159] Determine the intersection of the service overlap network element sets corresponding to each target test service in the service alarm call sheet as the third service network element set;
[0160] Determine the intersection of the high overlap rate network element sets corresponding to each target test service in the service alarm call sheet as the fourth service network element set;
[0161] The target network element set is updated according to the intersection of the target network element set, the second service network element set, the third service network element set and the fourth service network element set.
[0162] Exemplarily, an intersection of the target network element set, the second service network element set, the third service network element set and the fourth service network element set is determined as a new target network element set to replace the original target network element set.
[0163] Exemplarily, if the intersection of the target network element set, the second service network element set, the third service network element set and the fourth service network element set is empty, in order to comprehensively check the network elements, the union of the four can also be calculated as a new target network element set for operation and maintenance personnel to check.
[0164] S140: Determine a target network element where a fault occurs in the core network from the target network element set.
[0165] In a feasible design, the target network element having a fault in the core network is determined from the target network element set in the following manner:
[0166] If the number of network elements in the target network element set is 1, the network elements in the target network element set are determined as the target network elements where faults occur in the core network; if the number of network elements in the target network element set is greater than 1, a prompt message including information of each network element in the target network element set is sent to the handheld device of the operation and maintenance personnel, and the prompt message is used to remind the operation and maintenance personnel to troubleshoot the target network elements where faults occur from the target network element set.
[0167] The handheld device may be a mobile device capable of communication.
[0168] The network element information includes the network element's feature code, location, and other information used to locate and identify the network element, and can be set according to actual needs.
[0169] Since the more times a certain test item fails to execute, the greater the probability that the network element on the route corresponding to the test item fails. Therefore, after obtaining the dial test call record that records the completion status of each test item executed, the embodiment of the present application can screen out a target network element set consisting of network elements with a probability of failure greater than a first threshold (i.e., a greater possibility of failure) from the network elements included in the route of the test item in at least one dial test task based on the number of times each test item fails to execute in the dial test call record. In the current core network monitoring scheme, as long as the test item fails, an alarm is issued, resulting in a large number of invalid alarms. The operation and maintenance personnel need to perform complex calculations and screening on the network elements of the routes corresponding to a large number of invalid alarms to troubleshoot the network elements that have failed. Compared with the number of network elements in the test items that issue a large number of alarms in the current core network monitoring scheme, the scheme of the present application, based on the number of times the test item fails to execute, the number of network elements in the target network element set that are accurately and effectively screened is greatly reduced. Therefore, the network element that has failed can be accurately and quickly determined from the target network element set, which improves the real-time performance of determining the target network element that has failed.
[0170] Furthermore, the smaller the set length of the first cycle is, the higher the frequency of execution of the dialing task will be. If a network element on the route corresponding to the test item fails, the frequency of failure of the test item will also increase, which is conducive to speeding up the speed of screening out the target network element set, thereby further improving the speed of determining the faulty network element from the target network element set.
[0171] In addition, in the present application scheme, the dialing test task can be executed by the dialing test module that has been deployed in the core network. By communicating with the dialing test module, the dialing test call record generated by the dialing test module can be obtained without increasing the deployment cost.
[0172] like Figure 5 As shown, the present application also provides a device for monitoring core network operation, including:
[0173] A dial test task acquisition module is used to acquire at least one dial test task, each dial test task is used to test the completion of the test item executed by the network element on the route by simulating user behavior, the completion status includes the success or failure of the test item execution, and each route is a path composed of network elements of the core network;
[0174] A dial test call record acquisition module, used for acquiring a dial test call record by communicating with a dial test module, the dial test module being used for periodically executing each dial test task with a first period length, and generating a dial test call record for recording the completion status of each test item executed;
[0175] A target network element set determination module is used to screen out a target network element set from network elements corresponding to target test items whose number of consecutive execution failures exceeds a second threshold value based on the number of execution failures of each test item in the dial test call record; the target network element set is composed of network elements whose probability of failure is greater than the first threshold value;
[0176] The target network element determination module is used to determine the target network element where a fault occurs in the core network from the target network element set.
[0177] In a feasible design, the target network element set determination module is implemented in the following manner: based on the number of execution failures of each test item in the dial test record, the target network element set is screened out from the network elements corresponding to the target test items whose number of consecutive execution failures exceeds a second threshold:
[0178] The number of times each test item in the call log fails to be executed is counted periodically with the second cycle length;
[0179] After the target test items whose number of consecutive execution failures exceeds the second threshold are grouped according to the corresponding test services, a test item alarm call sheet is generated; each test service corresponds to one or more test items, and the test item alarm call sheet is also used to record the test item alarm time, which is the time when the number of target test item execution failures is detected to exceed the second threshold;
[0180] The target network element set is determined based on the key network element set of the test items and the overlapping network element set of the test items corresponding to each test service. The key network element set of the test items is the set of network elements included in the route of the target test item with the earliest test item alarm moment in the test service. The overlapping network element set of the test items is the intersection of the network element sets corresponding to the routes of each target test item corresponding to the test service.
[0181] In a feasible design, the target network element set determination module is implemented in the following manner, and the target network element set is determined according to the test item key network element set and the test item overlap network element set corresponding to each test service:
[0182] Obtaining a first test item network element set corresponding to each test service, where the first test item network element set is an intersection or union of a test item key network element set and a test item coincident network element set;
[0183] The intersection or union of the first test item network element sets corresponding to each test service is determined as the target network element set.
[0184] In a feasible design, the target network element set determination module further screens the target network element set in the following manner:
[0185] Determine the intersection of the test item key network element sets corresponding to each test service in the test item alarm call record as the second test item network element set;
[0186] Determine the intersection of the test item overlapping network element sets corresponding to each test service in the test item alarm call record as the third test item network element set;
[0187] The target network element set is updated according to the intersection of the target network element set, the second test item network element set and the third test item network element set.
[0188] In a feasible design, the target network element set determination module further screens the target network element set in the following manner, so as to accurately and quickly determine the target network element that causes the test service execution failure:
[0189] After periodically counting the number of execution failures of each test item within a preset time from the start time of the cycle for each test service of the test item alarm call sheet with a third cycle length, a service alarm call sheet is generated. The service alarm call sheet is used to record the test service in which the number of execution failures of each test item exceeds the third threshold, the test item corresponding to the test service, and the service alarm time. The service alarm time is the time when it is detected that the number of execution failures of each test item in the test service exceeds the third threshold;
[0190] Determine each target test service in the service alarm call record whose service alarm time is within a preset time from the current time;
[0191] Determine a test item sequence according to the test items in each target test service that meet the preset time condition and have a number of execution failures exceeding a fourth threshold, wherein the test items in the test item sequence are sorted from largest to smallest according to the number of execution failures, and the preset time condition is that the execution time of the test item is within a time range formed by a service alarm time of the target test service to which it belongs and the current time;
[0192] Obtain a first service network element set corresponding to each target test service, the first service network element set being the intersection or union of a service-critical network element set and a service-overlapping network element set corresponding to the target test service, the service-critical network element set being the set of network elements included in the route of the first test item in the test item sequence corresponding to the target test service, and the service-overlapping network element set being the intersection of network element sets corresponding to the routes of each test item in the test item sequence corresponding to the target test service;
[0193] The target network element set is updated according to the intersection of the intermediate network element set and the target network element set, where the intermediate network element set is the intersection or union of the first service network element sets corresponding to each target test service.
[0194] In a feasible design, each target test service includes a first target test service, and the target network element set determination module is implemented in the following manner to obtain a first service network element set corresponding to each target test service:
[0195] Obtaining each network element to be tested of the route corresponding to each test item that meets the preset time condition in the first target test service;
[0196] Counting the first number of failures of each network element to be tested in executing a test item of a first target test service within a preset time;
[0197] Counting the second number of times that each network element to be tested fails to execute the test items of each target test service including its own route within a preset time;
[0198] Calculate the overlap rate of each network element to be detected, where the overlap rate is the ratio of the first number to the second number of the network element to be detected;
[0199] Determine a set consisting of network elements to be detected whose overlap rate is greater than a fifth threshold as a high overlap rate network element set;
[0200] A first service network element set corresponding to the first target test service is obtained, where the first service network element set is the intersection or union of a service-critical network element set, a service-overlapping network element set, and a high-overlapping network element set corresponding to the first target test service.
[0201] In a feasible design, the target network element set determination module further screens the target network element set in the following manner:
[0202] Determine the intersection of the business key network element sets corresponding to each target test business in the business alarm call sheet as the second business network element set;
[0203] Determine the intersection of the service overlap network element sets corresponding to each target test service in the service alarm call sheet as the third service network element set;
[0204] Determine the intersection of the high overlap rate network element sets corresponding to each target test service in the service alarm call sheet as the fourth service network element set;
[0205] The target network element set is updated according to the intersection of the target network element set, the second service network element set, the third service network element set and the fourth service network element set.
[0206] In a feasible design, the apparatus further includes a dialing task scheduling module, which is used to schedule at least one dialing task in the following manner:
[0207] Determine the target model, which is used to define the connection relationship between network elements in the core network;
[0208] Obtain the characteristic code of each network element in the core network;
[0209] Arrange at least one dialing test task according to the feature code and target model of each network element.
[0210] In a feasible design, the dialing task scheduling module determines the target model in the following way:
[0211] Determine the target model based on the number of network elements in the deployment area of the core network.
[0212] In a feasible design, the target network element determination module determines the target network element having a fault in the core network from the target network element set in the following manner:
[0213] If the number of network elements in the target network element set is 1, the network element in the target network element set is determined as the target network element having a fault in the core network;
[0214] If the number of network elements in the target network element set is greater than 1, a prompt message including information of each network element in the target network element set is sent to the handheld device of the operation and maintenance personnel, and the prompt message is used to remind the operation and maintenance personnel to troubleshoot the faulty target network element from the target network element set.
[0215] For other implementation methods and effects of the above-mentioned device, please refer to the description in the method embodiment for monitoring the operation of the core network, which will not be repeated here.
[0216] The basic principles of the present application are described above in conjunction with specific embodiments. However, it should be noted that the advantages, strengths, effects, etc. mentioned in the present application are only examples and not limitations, and it cannot be considered that these advantages, strengths, effects, etc. are required by each embodiment of the present application. In addition, the specific details disclosed above are only for the purpose of illustration and ease of understanding, not for limitation, and the above details do not limit the present application to being implemented by adopting the above specific details.
[0217] It should be understood that, although the steps in the flowchart of the accompanying drawings are displayed in sequence as indicated by the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least a part of the steps in the flowchart of the accompanying drawings may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be executed in turn or alternately with other steps or at least a part of the sub-steps or stages of other steps.
[0218] The block diagrams of the devices, apparatuses, equipment, and systems involved in this application are only illustrative examples and are not intended to require or imply that they must be connected, arranged, and configured in the manner shown in the block diagram. As will be appreciated by those skilled in the art, these devices, apparatuses, equipment, and systems can be connected, arranged, and configured in any manner. Words such as "including", "comprising", "having", etc. are open words, referring to "including but not limited to", and can be used interchangeably with them. The words "or" and "and" used here refer to the words "and / or" and can be used interchangeably with them, unless the context clearly indicates otherwise. The words "such as" used here refer to the phrase "such as but not limited to", and can be used interchangeably with them.
[0219] It should also be noted that in the apparatus, device and method of the present application, each component or each step can be decomposed and / or recombined. Such decomposition and / or recombination should be regarded as equivalent solutions of the present application.
[0220] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present application. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of the present application. Therefore, the present application is not intended to be limited to the aspects shown herein, but rather to the widest scope consistent with the principles and novel features disclosed herein.
[0221] The above description has been given for the purpose of illustration and description. In addition, this description is not intended to limit the embodiments of the present application to the forms disclosed herein. Although multiple example aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, changes, additions and sub-combinations thereof.
Claims
1. A method for monitoring core network operation, characterized in that: include: Acquire at least one dialing test task, each of which is used to test the completion of the test item executed by the network element on the route by simulating user behavior, wherein the completion status includes success or failure of the test item execution, and each route is a path formed by the network element of the core network; Acquire a dial test call record by communicating with a dial test module, wherein the dial test module is used to periodically execute each of the dial test tasks with a first period length and generate a dial test call record for recording the completion status of each test item executed; Based on the number of execution failures of each of the test items in the dial test call record, a target network element set is screened out from network elements corresponding to the target test items whose number of consecutive execution failures exceeds a second threshold; the target network element set is composed of network elements whose probability of failure is greater than a first threshold; A target network element where a fault occurs in the core network is determined from the target network element set.
2. The method according to claim 1, characterized in that The step of filtering out a target network element set from network elements corresponding to target test items whose number of consecutive execution failures exceeds a second threshold based on the number of execution failures of each test item in the dial test call record includes: Periodically counting the number of times each of the test items in the call test record fails to execute according to the second cycle length; After the target test items whose number of consecutive execution failures exceeds the second threshold are grouped according to the corresponding test services, a test item alarm call sheet is generated; each of the test services corresponds to one or more test items, and the test item alarm call sheet is also used to record the test item alarm time, which is the time when the number of target test item execution failures is detected to exceed the second threshold; According to the key network element set of test items and the overlapping network element set of test items corresponding to each of the test services, a target network element set is determined, wherein the key network element set of test items is the set of network elements included in the route of the target test item with the earliest test item alarm moment in the test service, and the overlapping network element set of test items is the intersection of the network element sets corresponding to the routes of each target test item corresponding to the test service.
3. The method according to claim 2, characterized in that The determining of the target network element set according to the test item key network element set and the test item overlap network element set corresponding to each of the test services includes: Obtaining a first test item network element set corresponding to each of the test services, wherein the first test item network element set is an intersection or union of the test item key network element set and the test item coincident network element set; The intersection or union of the first test item network element sets corresponding to the test services is determined as a target network element set.
4. The method according to claim 2 or 3, characterized in that: The method further comprises: Determine the intersection of the test item key network element sets corresponding to the test services in the test item alarm call record as the second test item network element set; Determine the intersection of the test item overlapping network element sets corresponding to the test services in the test item alarm call record as a third test item network element set; The target network element set is updated according to the intersection of the target network element set, the second test item network element set and the third test item network element set.
5. The method according to claim 2 or 3, characterized in that: The method further comprises: After periodically counting the number of execution failures of each test item within a preset time from the start time of the cycle in each test service of the test item alarm call sheet with a third cycle length, a service alarm call sheet is generated, wherein the service alarm call sheet is used to record the test service in which the number of execution failures of each test item exceeds the third threshold, the test item corresponding to the test service, and the service alarm time, wherein the service alarm time is the time when the number of execution failures of each test item in the test service exceeds the third threshold; Determine each target test service in the service alarm call record whose service alarm time is within the preset time from the current time; Determine a test item sequence according to the test items in each target test service that meet the preset time condition and have a number of execution failures exceeding a fourth threshold, wherein the test items in the test item sequence are sorted from large to small according to the number of execution failures, and the preset time condition is that the execution time of the test item is within a time range formed by a service alarm time of the target test service to which it belongs and the current time; Obtaining a first service network element set corresponding to each of the target test services, wherein the first service network element set is the intersection or union of a service-critical network element set and a service-overlapping network element set corresponding to the target test service, wherein the service-critical network element set is the set of network elements included in the route of the first test item in the test item sequence corresponding to the target test service, and the service-overlapping network element set is the intersection of network element sets corresponding to the routes of each test item in the test item sequence corresponding to the target test service; The target network element set is updated according to the intersection of the intermediate network element set and the target network element set, wherein the intermediate network element set is the intersection or union of the first service network element sets corresponding to each of the target test services.
6. The method according to claim 5, characterized in that Each of the target test services includes a first target test service, and the first service network element set corresponding to each of the target test services is obtained, where the first service network element set is the intersection or union of the service-critical network element set corresponding to the target test service and the service overlap network element set, including: Obtaining each network element to be detected of the route corresponding to each test item that meets the preset time condition in the first target test service; Counting a first number of failures of each of the network elements to be tested in executing the test item of the first target test service within the preset time; Counting the second number of times that each of the network elements to be detected fails in executing the test items of each target test service of the routing including itself within the preset time; Calculating the overlap rate of each of the network elements to be detected, where the overlap rate is the ratio of the first number to the second number of the network elements to be detected; Determine a set consisting of the network elements to be detected whose overlap rate is greater than a fifth threshold as a high overlap rate network element set; A first service network element set corresponding to the first target test service is obtained, where the first service network element set is the intersection or union of the service-critical network element set, the service overlap network element set and the high overlap rate network element set corresponding to the first target test service.
7. The method according to claim 6, characterized in that The method further comprises: Determine the intersection of the business critical network element sets corresponding to the target test services in the business alarm call sheet as the second business network element set; Determine the intersection of the service overlap network element sets corresponding to the target test services in the service alarm call sheet as the third service network element set; Determine the intersection of the high overlap rate network element sets corresponding to the target test services in the service alarm call sheet as the fourth service network element set; The target network element set is updated according to the intersection of the target network element set, the second service network element set, the third service network element set and the fourth service network element set.
8. The method according to any one of claims 1 to 3, characterized in that The method further comprises: Determining a target model, wherein the target model is used to define a connection relationship between network elements in the core network; Obtaining a characteristic code of each network element in the core network; Arrange the at least one dialing test task according to the feature code of each network element and the target model.
9. The method according to any one of claims 1 to 3, characterized in that: Determining a target network element having a fault in the core network from the target network element set includes: If the number of network elements in the target network element set is 1, determining the network element in the target network element set as the target network element having a fault in the core network; If the number of network elements in the target network element set is greater than 1, a prompt message including information of each network element in the target network element set is sent to the handheld device of the operation and maintenance personnel, and the prompt message is used to remind the operation and maintenance personnel to troubleshoot the faulty target network element from the target network element set.
10. A device for monitoring core network operation, characterized in that: include: A dialing test task acquisition module, used to acquire at least one dialing test task, each of which is used to test the completion of the test item executed by the network element on the route by simulating user behavior, the completion status including the success or failure of the test item execution, and each route is a path formed by the network element of the core network; A dial test call record acquisition module, used for acquiring a dial test call record by communicating with a dial test module, wherein the dial test module is used for periodically executing each of the dial test tasks with a first period length, and generating a dial test call record for recording the completion status of each test item executed; A target network element set determination module, configured to filter out a target network element set from network elements corresponding to target test items whose number of consecutive execution failures exceeds a second threshold value based on the number of execution failures of each of the test items in the dial test call record; the target network element set is composed of network elements whose probability of failure is greater than a first threshold value; The target network element determination module is used to determine the target network element where a fault occurs in the core network from the target network element set.
Citation Information
Patent Citations
GPRS (General Packet Radio Service) core network simulation and test system
CN101888658A
Fault positioning method and device of communication network
CN105471669A
Network element fault positioning method and device, computing equipment and computer storage medium
CN112242910A
Fault positioning method and related device
CN117336158A
