Network measurement method, device, communication equipment and storage medium

Abstract

The present invention discloses a network measurement method, apparatus, communication equipment and storage medium; the method comprises: determining business requirements; determining network indicator information according to the business requirements; the network indicator information comprises: an identifier of the network indicator and an operation corresponding to the network indicator; generating a network measurement strategy according to the network indicator information; monitoring the real-time value of the network indicator, and determining a measurement result according to the network measurement strategy and the real-time value of the network indicator.

Description

Technical Field

[0001] The present invention relates to the field of transmission and Internet Protocol (IP), and in particular to a network measurement method, device, communication equipment and storage medium. Background Art

[0002] Network performance measurement is an important part of network management. Currently, network performance measurement methods mainly include the following:

[0003] Active measurement: Network performance measurement is achieved at both the sending and receiving ends by sending measurement protocol messages, such as Internet Control Message Protocol (ICMP) messages and Two-Way Active Measurement Protocol (TWAMP) messages.

[0004] Passive measurement: Calculates network performance during service transmission by collecting actual service traffic.

[0005] Hybrid measurement: Combining active and passive measurement solutions, some fields or flags are inserted into service messages to measure network performance during service transmission.

[0006] However, whether it is active network measurement, passive measurement, or hybrid measurement, the measurement process lacks flexibility:

[0007] Active measurement: If measurement messages are sent too frequently, they will occupy too much bandwidth and affect normal service operations. If they are sent too slowly, some transient network anomalies may be missed, and the network status cannot be accurately reflected.

[0008] Passive measurement: To collect actual business data in real time, if the sampling rate is too high, a large amount of data will be accumulated in a short period of time, which requires a high level of real-time processing capability of network elements and data analysis systems. If the sampling rate is too low, some network anomalies will also be missed.

[0009] Hybrid measurement: Measuring the network performance of each service packet also places high demands on the real-time processing capabilities of the network element. If sampling measurement is used, some network anomalies of service packets may be missed. Summary of the Invention

[0010] In view of this, the main object of the present invention is to provide a network measurement method, apparatus, communication equipment and storage medium.

[0011] To achieve the above object, the technical solution of the present invention is achieved as follows:

[0012] An embodiment of the present invention provides a network measurement method, including:

[0013] Identify business needs;

[0014] Determining network indicator information according to the business requirements; the network indicator information includes: an identifier of the network indicator and an operation corresponding to the network indicator;

[0015] generating a network measurement strategy based on the information of the network indicators;

[0016] The real-time value of the network indicator is monitored, and a measurement result is determined according to the network measurement strategy and the real-time value of the network indicator.

[0017] In the above solution, the information of determining network indicators according to the business requirements includes at least one of the following:

[0018] Querying a first relationship table according to the business requirement to determine the network indicator corresponding to the business requirement; the first relationship table includes information on at least one business requirement and at least one network indicator corresponding to each business requirement;

[0019] Use a preset recognition model to identify the business needs and determine the information of the network indicators corresponding to the business needs; the recognition model is obtained based on a neural network and a training set; the training set includes at least one business need sample and a label corresponding to each business need sample; the label is information of at least one network indicator.

[0020] In the above solution, generating a network measurement strategy based on the information of the network indicator includes:

[0021] Determining, based on the network indicator, a first threshold and a second threshold corresponding to the network indicator;

[0022] generating a network measurement strategy according to the first threshold and the second threshold;

[0023] The network measurement strategy includes:

[0024] In response to the real-time value of the network indicator being lower than the first threshold, determining that the network is normal and performing a first operation;

[0025] In response to the real-time value of the network indicator being between the first threshold and the second threshold, it is determined that a network abnormality occurs but services can still be run, and a second operation is performed;

[0026] In response to the situation where the real-time value of the network indicator is higher than the second threshold, it is determined that the network is abnormal and the service cannot be run, and a third operation is performed.

[0027] In the above solution, the first operation includes at least one of the following:

[0028] Feedback a first measurement result, perform telemetry at a first rate, and extract first information of a key node device; the first information includes at least: status information;

[0029] The second operation includes:

[0030] Feedback a second measurement result, perform telemetry at a second rate, and extract second information of the node devices of the first proportion; the second information includes at least one of the following: status information and log information;

[0031] The third operation includes:

[0032] Feedback a third measurement result, perform telemetry at a third rate, and extract third information of the node devices of a second proportion; the third information includes at least one of the following: status information, log information, and alarm information;

[0033] Wherein, the first rate is lower than the second rate, and the second rate is lower than the third rate;

[0034] The first measurement result and the second measurement result at least indicate that the service requirement is met; and the third measurement result indicates that the service requirement is not met.

[0035] In the above solution, the network indicators include: measurement indicators and configuration indicators;

[0036] The monitoring of the real-time value of the network indicator includes:

[0037] According to the network measurement strategy, information about the network indicator involved in the network measurement strategy is sent to a node device corresponding to the network indicator; the node device is used to measure and obtain a real-time value of the indicator according to the measurement indicator, and to configure according to the configuration indicator and measure and obtain a real-time value of the configured indicator;

[0038] Receive the real-time value of the network indicator sent by the node device.

[0039] In the above solution, the method further includes:

[0040] verifying the network measurement strategy;

[0041] Corresponding to a situation where the network measurement strategy is verified to be successful, the real-time value of the network indicator is monitored according to the network measurement strategy.

[0042] In the above solution, the verifying the network measurement strategy includes at least one of the following:

[0043] In response to a situation where the network indicators involved in the network measurement strategy include configuration indicators, verifying whether the configuration indicators affect the operation of other functions, and determining that the configuration indicators affect the operation of other functions, the verification fails;

[0044] Corresponding to a situation where the number of network measurement policies at the same time is at least two, verifying whether any two of the at least two network measurement policies conflict; determining that any two network measurement policies conflict, and verifying failure.

[0045] An embodiment of the present invention provides a network measurement device, comprising:

[0046] A first determination module is used to determine business needs;

[0047] A second determining module is configured to determine information of a network indicator according to the business requirements; the information of the network indicator includes: an identifier of the network indicator and an operation corresponding to the network indicator;

[0048] A generating module, configured to generate a network measurement strategy based on the information of the network indicators;

[0049] The monitoring module is used to monitor the real-time value of the network indicator and determine the measurement result according to the network measurement strategy and the real-time value of the network indicator.

[0050] In the above solution, the second determining module is configured to perform at least one of the following:

[0051] Querying a first relationship table according to the business requirement to determine the network indicator corresponding to the business requirement; the first relationship table includes information on at least one business requirement and at least one network indicator corresponding to each business requirement;

[0052] Use a preset recognition model to identify the business needs and determine the information of the network indicators corresponding to the business needs; the recognition model is obtained based on a neural network and a training set; the training set includes at least one business need sample and a label corresponding to each business need sample; the label is information of at least one network indicator.

[0053] In the above solution, the generating module is used to determine the first threshold and the second threshold corresponding to the network indicator according to the network indicator;

[0054] generating a network measurement strategy according to the first threshold and the second threshold;

[0055] The network measurement strategy includes:

[0056] In response to the real-time value of the network indicator being lower than the first threshold, determining that the network is normal and performing a first operation;

[0057] In response to the real-time value of the network indicator being between the first threshold and the second threshold, it is determined that a network abnormality occurs but services can still be run, and a second operation is performed;

[0058] In response to the situation where the real-time value of the network indicator is higher than the second threshold, it is determined that the network is abnormal and the service cannot be run, and a third operation is performed.

[0059] In the above solution, the first operation includes at least one of the following:

[0060] Feedback a first measurement result, perform telemetry at a first rate, and extract first information of a key node device; the first information includes at least: status information;

[0061] The second operation includes:

[0062] Feedback a second measurement result, perform telemetry at a second rate, and extract second information of the first proportion of node devices; the second information includes at least one of the following: status information and log information;

[0063] The third operation includes:

[0064] Feedback a third measurement result, perform telemetry at a third rate, and extract third information of the node devices of a second proportion; the third information includes at least one of the following: status information, log information, and alarm information;

[0065] Wherein, the first rate is lower than the second rate, and the second rate is lower than the third rate;

[0066] The first measurement result and the second measurement result at least indicate that the service requirement is met; and the third measurement result indicates that the service requirement is not met.

[0067] In the above solution, the network indicators include: measurement indicators and configuration indicators;

[0068] The monitoring module is configured to send information about the network indicators involved in the network measurement policy to the node devices corresponding to the network indicators according to the network measurement policy; the node devices are configured to obtain real-time values ​​of the indicators according to the measurement indicators, and to perform configuration according to the configuration indicators and measure the real-time values ​​of the configured indicators;

[0069] Receive the real-time value of the network indicator sent by the node device.

[0070] In the above solution, the device further includes: a verification module, configured to verify the network measurement strategy;

[0071] Corresponding to a situation where the network measurement policy is verified to be successful, the real-time value of the network indicator is monitored according to the network measurement policy.

[0072] In the above solution, the verification module is used to perform at least one of the following:

[0073] In response to a situation where the network indicators involved in the network measurement strategy include configuration indicators, verifying whether the configuration indicators affect the operation of other functions, and determining that the configuration indicators affect the operation of other functions, the verification fails;

[0074] Corresponding to a situation where the number of network measurement policies at the same time is at least two, verifying whether any two of the at least two network measurement policies conflict; determining that any two network measurement policies conflict, and verifying failure.

[0075] An embodiment of the present invention provides a communication device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of any one of the above network measurement methods when executing the program.

[0076] An embodiment of the present invention provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the computer program implements the steps of any one of the above network measurement methods.

[0077] An embodiment of the present invention provides a network measurement method, apparatus, communication equipment, and storage medium. The method includes: determining business needs; determining network indicator information based on the business needs; the network indicator information includes: an identifier of the network indicator and an operation corresponding to the network indicator; generating a network measurement strategy based on the network indicator information; monitoring the real-time value of the network indicator, and determining a measurement result based on the network measurement strategy and the real-time value of the network indicator; in this way, the network indicator information obtained based on the user's business needs and the network measurement strategy generated based on the network indicator information can realize dynamic generation of network measurement based on the business needs of different users, better meet user needs, and improve user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0078] Figure 1 A schematic diagram of a flow chart of a network measurement method provided by an embodiment of the present invention;

[0079] Figure 2 A schematic diagram of the structure of a network measurement device provided by an application embodiment of the present invention;

[0080] Figure 3 A flowchart of a network measurement method provided by an application embodiment of the present invention;

[0081] Figure 4 A schematic diagram of a flow chart of a method for generating a network measurement strategy provided in an application embodiment of the present invention;

[0082] FIG5( a ) is a schematic diagram showing the relationship between a measurement rate and a measurement granularity according to an embodiment of the present invention;

[0083] FIG5( b ) is a schematic diagram showing the relationship between another measurement rate and measurement granularity provided by an embodiment of the present invention;

[0084] Figure 6 A schematic structural diagram of a network measurement device provided by an embodiment of the present invention;

[0085] Figure 7 A schematic structural diagram of another network measurement device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0086] The present invention will be further described in detail below with reference to the embodiments.

[0087] Figure 1 A flow chart of a network measurement method provided by an embodiment of the present invention; Figure 1 As shown, the method can be applied to smart devices such as servers; the method includes:

[0088] Step 101: Determine business requirements.

[0089] Step 102: Determine network indicator information according to the business requirements; the network indicator information includes: an identifier of the network indicator and an operation corresponding to the network indicator;

[0090] Step 103: Generate a network measurement strategy based on the network indicator information;

[0091] Step 104: monitor the real-time value of the network indicator, and determine the measurement result according to the network measurement strategy and the real-time value of the network indicator.

[0092] In some embodiments, the number of the network indicators may be one or more;

[0093] The information of determining network indicators according to the business requirements includes at least one of the following:

[0094] Querying a first relationship table according to the business requirement to determine the network indicator corresponding to the business requirement; the first relationship table includes information on at least one business requirement and at least one network indicator corresponding to each business requirement;

[0095] Use a preset recognition model to identify the business needs and determine the information of the network indicators corresponding to the business needs; the recognition model is obtained based on a neural network and a training set; the training set includes at least one business need sample and a label corresponding to each business need sample; the label is information of at least one network indicator.

[0096] Here, two methods for determining network indicator information are provided. One method is to determine the information through a preset template, that is, a first relationship table. The first relationship table can be preset by network maintenance personnel or developers.

[0097] The other is based on natural language implementation, that is, pre-training a recognition model that can identify the business requests entered by users and determine the corresponding network indicator information.

[0098] In some embodiments, determining the business needs includes:

[0099] The receiving terminal sends a service request to the server; the terminal has a human-computer interaction interface, and the user enters his or her intention through the human-computer interaction interface (for example, the intention is described in text, and different functions are selected (each function corresponds to an intention), and the terminal generates a service request accordingly.

[0100] The intent may be, for example, measuring whether the network supports playing cloud games, measuring video quality, etc.

[0101] In some embodiments, generating a network measurement strategy based on the network indicator information includes:

[0102] Determining, based on the network indicator, a first threshold and a second threshold corresponding to the network indicator;

[0103] generating a network measurement strategy according to the first threshold and the second threshold;

[0104] The network measurement strategy includes:

[0105] In response to the real-time value of the network indicator being lower than the first threshold, determining that the network is normal and performing a first operation;

[0106] In response to the real-time value of the network indicator being between the first threshold and the second threshold, it is determined that a network abnormality occurs but services can still be run, and a second operation is performed;

[0107] In response to the situation where the real-time value of the network indicator is higher than the second threshold, it is determined that the network is abnormal and the service cannot be run, and a third operation is performed.

[0108] Determining the first threshold and the second threshold corresponding to the network indicator includes:

[0109] Querying a second relationship table according to the network indicator to determine a first threshold and a second threshold corresponding to the network indicator;

[0110] The second relationship table includes: at least one network indicator, and a first threshold and a second threshold corresponding to each of the network indicators.

[0111] In some embodiments, the first operation includes at least one of the following:

[0112] Feedback a first measurement result, perform telemetry at a first rate, and extract first information of a key node device; the first information includes at least: status information;

[0113] The second operation includes:

[0114] Feedback a second measurement result, perform telemetry at a second rate, and extract second information of the node devices of the first proportion; the second information includes at least one of the following: status information and log information;

[0115] The third operation includes:

[0116] Feedback a third measurement result, perform telemetry at a third rate, and extract third information of the node devices of a second proportion; the third information includes at least one of the following: status information, log information, and alarm information;

[0117] Wherein, the first rate is lower than the second rate, and the second rate is lower than the third rate;

[0118] The first measurement result and the second measurement result at least indicate that the service requirement is met; and the third measurement result indicates that the service requirement is not met.

[0119] For example, the first measurement result includes: the network is normal and meets service requirements;

[0120] The second measurement result includes: the network is abnormal but the service can still run (i.e., it meets the service requirements);

[0121] The third measurement result includes: the network is abnormal and the service cannot be run (ie, the service requirements are not met).

[0122] In some embodiments, the network indicators include: measurement indicators, configuration indicators;

[0123] The monitoring of the real-time value of the network indicator includes:

[0124] According to the network measurement strategy, information about the network indicator involved in the network measurement strategy is sent to a node device corresponding to the network indicator; the node device is used to measure and obtain a real-time value of the indicator according to the measurement indicator, and to configure according to the configuration indicator and measure and obtain a real-time value of the configured indicator;

[0125] Receive the real-time value of the network indicator sent by the node device.

[0126] The information of the network indicator includes: the identifier of the network indicator and the operation corresponding to the network indicator; after receiving the information, the node device can perform the operation corresponding to the network indicator according to the information of the network indicator.

[0127] For example, the corresponding operation for a measurement indicator can be measurement, such as measuring packet loss or measuring jitter.

[0128] Configuration indicators, the corresponding operations can be configuration; for example, increasing the latency measurement frequency, increasing device information extraction (specifically including device logs, port status information, etc.).

[0129] Node devices include: Infrastructure devices that implement the network, which are the carriers of network operation and the basis for meeting business needs, including network resources, storage resources, computing resources, security resources, etc. Infrastructure devices can perform corresponding operations based on network indicators, such as measuring packet loss, measuring jitter, increasing bandwidth, and expanding capacity.

[0130] In actual applications, considering that there may be situations where the business needs of multiple users need to be processed, and if different network indicators are processed at the same time, conflicts may occur or network failures may occur, a verification method is provided to avoid network failures.

[0131] In some embodiments, the method further comprises:

[0132] verifying the network measurement strategy;

[0133] Corresponding to a situation where the network measurement policy is verified to be successful, the real-time value of the network indicator is monitored according to the network measurement policy.

[0134] The verifying of the network measurement strategy includes at least one of the following:

[0135] In response to a situation where the network indicators involved in the network measurement strategy include configuration indicators, verifying whether the configuration indicators affect the operation of other functions, and determining that the configuration indicators affect the operation of other functions, the verification fails;

[0136] Corresponding to a situation where the number of network measurement policies at the same time is at least two, verifying whether any two of the at least two network measurement policies conflict; determining that any two network measurement policies conflict, and verifying failure.

[0137] Specifically, the network may be configured differently according to the configuration indicators. Therefore, it is necessary to verify whether the configuration indicators affect the operation of other functions, where the impact on the operation of other functions includes: whether it will cause other functional abnormalities (such as address conflicts, routing loops, unreachable routes), unsupported functions, etc. The specific method can be implemented by verifying the network, which is a network that simulates the actual network structure, and the verification network is used to verify whether there are abnormal problems in the configuration. When applied, in the verification network, relevant configurations and / or measurements are performed according to the information of the network indicators to verify whether there are abnormalities (such as address conflicts, routing loops, unreachable routes, etc.). If an abnormality occurs, the business requirements can be re-translated to obtain new network indicator information or the configuration indicators can be regenerated, and verified again until there are no problems.

[0138] In the case where there are at least two network measurement strategies at the same time, it is necessary to verify whether any two network measurement strategies conflict with each other. If any two network measurement strategies conflict with each other and the verification fails, the processing method can generally be to process them in the order in which the business requirements are received; if any two network measurement strategies do not conflict with each other, they can be executed according to the network measurement strategy, such as sending the information of the network indicators involved in the network measurement strategy to the node device corresponding to the network indicator. For example, it is determined that there are business needs of multiple users, and the business needs of two users are for video and games respectively, and only one business need can be met at the same time. In another case, it is determined that the implementation of a function will cause other network failures, and the business needs need to be processed according to priority to troubleshoot the problem. The verification method can be implemented by verifying the network, or it can be pre-set which network indicator operations are in conflict, and the operation of the conflicting network indicators is determined by querying the settings when applying.

[0139] Figure 2 A schematic diagram of the structure of a network measurement system provided by an embodiment of the present invention; Figure 2 As shown, the system includes: an intention input module, a network model platform, basic equipment, an intention translation module, a configuration verification module, an automatic configuration module, a network status perception module, an intention verification module, an automatic repair module, and a monitoring interface module.

[0140] Intent input module, used to receive business requirements input by users;

[0141] Intent translation module, used to translate user business needs into network indicator information;

[0142] The network model platform is a digital platform built on a thorough understanding of the actual network, providing comprehensive, complete, and multi-layered network models and data. In addition to providing an artificial intelligence (AI)-assisted analysis system, it is also used to generate network measurement strategies based on network indicator information.

[0143] Here, the network indicators include measurement indicators and configuration indicators; for example, the user's business requirement is "measuring the network transmission quality of video services", and the translated network indicator information includes: measuring network packet loss, jitter, etc. (for measurement indicators, it can be understood as a device configuration); the user's business requirement is "measuring whether the network supports playing games", considering that games have high requirements for latency, the translated network indicator information includes: enabling latency measurement, improving network speed (specifically, it may include: improving network speed, increasing bandwidth, expanding capacity, etc.), etc. (for indicators that require enabling certain functions, changing network configurations, etc., it can be understood as a network planning).

[0144] Regarding how the intent translation module realizes the translation of business requirements into network indicators, two methods are provided here. One is to translate according to a template. Specifically, a relationship table (such as the first relationship table mentioned above) can be provided, which includes the correspondence between at least one business requirement and the information of at least one network indicator corresponding to each of the business requirements; when applied, the relationship table is queried according to the business requirement to determine the information of the network indicator corresponding to the business requirement.

[0145] Another method uses natural language translation technology. Specifically, a preset recognition model is used to identify the business requirement and determine the network indicator corresponding to the business requirement. The recognition model is derived from a neural network and a training set; the training set includes at least one business requirement sample and a label corresponding to each business requirement sample; the label is information about at least one network indicator.

[0146] The configuration verification module is used to discover some abnormal problems in the configuration, such as address conflicts, routing loops, and unreachable routes, by simulating / actually running the configuration on the actual network. Here, considering that adding configurations and / or changing the original network plan may cause abnormalities, or that this function is not supported, the configuration verification module needs to be verified to determine whether the network measurement strategy can be implemented and whether there will be any problems; if the verification passes, it will be sent to the basic equipment; if it fails, it will be prompted to be modified. Specifically, the configuration verification module may include: a verification network that simulates the actual network, and the verification network is used to verify whether there are abnormal problems in the configuration. When applied, in the verification network, relevant configurations and / or tests are performed according to the information of the network indicators to verify whether there are any abnormalities (such as address conflicts, routing loops, and unreachable routes). If an abnormality occurs, the business requirements can be re-translated to obtain new network indicator information and verified again until there are no problems.

[0147] The automated configuration module is used to automatically send network indicators to basic devices in the network through a standard configuration interface; the basic devices perform corresponding configurations and / or enable certain functions based on the network indicators.

[0148] The network status perception module is used to obtain the operating status of basic equipment in the network through technologies such as telemetry.

[0149] The intent verification module is used to verify in real time whether the user's intent is met in the network's basic equipment. That is, the intent verification module is used to verify whether the user's business needs are met according to the network indicators. For example, the business need is "measuring the network transmission quality of video services", and the corresponding network indicators are: measuring jitter and packet loss; intent verification means that meeting the jitter and packet loss requirements can meet the user's business needs; and if not, the business needs need to be re-determined. The intent verification module here can determine whether the user's business needs are met based on user feedback. For example, after measuring jitter, it is determined that the network transmission quality is excellent, and the result is fed back to the user, and the user confirms that he is satisfied; and if the determined network indicator is whether the network is correct, and the result obtained is also that the network can communicate, this result is fed back to the user, and the user cannot determine the network transmission quality, and may think that he is dissatisfied with the result. After feedback to the system, the network indicator can be re-determined and re-measured.

[0150] The automated repair module diagnoses and analyzes intent conflicts and / or network faults based on the results of intent assurance and configuration verification, automatically or assisting network administrators in troubleshooting. Specifically, consider network faults that affect the execution of network measurement strategies, such as node device failures, abnormal node device information reporting, and configuration delivery errors. This requires automated analysis of the fault cause, output of a fault repair strategy, and troubleshooting.

[0151] Basic equipment is the carrier of network operation and the basis for realizing user business needs, including network resources, storage resources, computing resources, security resources, etc.

[0152] The monitoring interface is used to display the execution status of users' business needs, real-time network status, network anomaly repair results, etc.

[0153] Figure 3 A flow chart of a network measurement method provided by an application embodiment of the present invention; Figure 3 As shown, the method is Figure 2 The device shown is implemented in such a way that, when used, the user can vaguely input the measurement intention when inputting the intention, for example, wanting to measure the network transmission quality of a video service. After receiving this intention, the device automatically performs the network measurement action and feeds back the measurement results. Specifically, the method includes:

[0154] Step 301: The intention input module receives the business requirements input by the user and inputs the business requirements into the intention translation module;

[0155] Step 302: The intent translation module determines network indicator information according to business requirements;

[0156] Here, the number of network indicators obtained by translation is one or more;

[0157] Step 303: The network model platform generates a network measurement strategy;

[0158] Step 304: The configuration verification module verifies the correctness of the network measurement strategy;

[0159] Specifically, step 304 includes:

[0160] In response to a situation where the network indicators involved in the network measurement strategy include configuration indicators, verifying whether the configuration indicators affect the operation of other functions, and determining that the configuration indicators affect the operation of other functions, the verification fails;

[0161] Corresponding to a situation where the number of network measurement policies at the same time is at least two, verifying whether any two of the at least two network measurement policies conflict; determining that any two network measurement policies conflict, and verifying failure.

[0162] Step 305: The verified network measurement policy is sent to the network infrastructure through the automated configuration module.

[0163] Step 306: The network status perception module obtains the real-time value of the network indicator from the basic equipment in real time based on the network indicator; at the same time, the real-time value of the network indicator is sent to the network model platform;

[0164] Here, step 306 may be executed continuously to obtain real-time values, and the execution order thereof is not limited.

[0165] Step 307: The monitoring interface monitors the real-time values ​​of network indicators and the execution of measurement strategies in real time from the network model platform.

[0166] The generation of a network measurement strategy is key to the entire measurement process. The following provides a method for generating a network measurement strategy that can dynamically generate a measurement strategy, meeting measurement requirements while reducing resource usage. The method includes:

[0167] For network indicators, determine a high-quality threshold (equivalent to the first threshold) and a low-quality threshold (equivalent to the second threshold); generate a network measurement strategy based on the high-quality threshold and the low-quality threshold. Specifically, the network measurement strategy includes:

[0168] When the real-time value of a network metric is below the premium threshold, the network and services are considered normal, and a coarse-grained measurement solution is used, such as low telemetry rate and extraction of status information of key node devices;

[0169] When the real-time value of a network metric is between the high-quality threshold and the low-quality threshold, the network is determined to be abnormal, but the service has a certain tolerance and can still operate normally. A medium-granularity measurement solution is used, such as a medium telemetry rate and extracting a certain proportion of device logs and status information.

[0170] When the real-time value of a network indicator exceeds the poor quality threshold, it is determined that the network is seriously abnormal and the business cannot operate normally. The most granular measurement solution is adopted, such as the highest telemetry frequency, to extract logs, status, and alarm information of all network devices.

[0171] After receiving the real-time value of the network indicator to be tested on the existing network, the network model platform compares it with the high-quality threshold and the low-quality threshold, and performs corresponding operations according to the above network measurement, such as Figure 4 As stated.

[0172] Here, different measurement granularities correspond to different measurement rates, such as telemetry rate, active measurement message transmission frequency, and passive measurement sampling ratio. Measurement rates at different granularities can be either linearly increasing or fixed. Figure 5(a) shows that the measurement rate increases linearly across different measurement granularity intervals, but at different rates. Figure 5(b) shows that the measurement rate has three fixed values ​​across different measurement granularity intervals.

[0173] The method provided by the embodiment of the present invention uses a dynamic network measurement strategy to obtain the most appropriate measurement data using the minimum network resources for network anomaly analysis and location, thereby reducing the network burden without missing abnormal data.

[0174] Figure 6 A schematic diagram of the structure of a network measurement device provided by an embodiment of the present invention; Figure 6 As shown, the device includes:

[0175] A first determination module is used to determine business needs;

[0176] A second determining module is configured to determine information of a network indicator according to the business requirements; the information of the network indicator includes: an identifier of the network indicator and an operation corresponding to the network indicator;

[0177] A generating module, configured to generate a network measurement strategy based on the information of the network indicators;

[0178] The monitoring module is used to monitor the real-time value of the network indicator and determine the measurement result according to the network measurement strategy and the real-time value of the network indicator.

[0179] In some embodiments, the second determining module is configured to perform at least one of the following:

[0180] Querying a first relationship table according to the business requirement to determine the network indicator corresponding to the business requirement; the first relationship table includes information on at least one business requirement and at least one network indicator corresponding to each business requirement;

[0181] Use a preset recognition model to identify the business needs and determine the information of the network indicators corresponding to the business needs; the recognition model is obtained based on a neural network and a training set; the training set includes at least one business need sample and a label corresponding to each business need sample; the label is information of at least one network indicator.

[0182] In some embodiments, the generating module is configured to determine a first threshold and a second threshold corresponding to the network indicator based on the network indicator;

[0183] generating a network measurement strategy according to the first threshold and the second threshold;

[0184] The network measurement strategy includes:

[0185] In response to the real-time value of the network indicator being lower than the first threshold, determining that the network is normal and performing a first operation;

[0186] In response to the real-time value of the network indicator being between the first threshold and the second threshold, it is determined that a network abnormality occurs but services can still be run, and a second operation is performed;

[0187] In response to the situation where the real-time value of the network indicator is higher than the second threshold, it is determined that the network is abnormal and the service cannot be run, and a third operation is performed.

[0188] The first operation includes at least one of the following:

[0189] Feedback a first measurement result, perform telemetry at a first rate, and extract first information of a key node device; the first information includes at least: status information;

[0190] The second operation includes:

[0191] Feedback a second measurement result, perform telemetry at a second rate, and extract second information of the first proportion of node devices; the second information includes at least one of the following: status information and log information;

[0192] The third operation includes:

[0193] Feedback a third measurement result, perform telemetry at a third rate, and extract third information of the node devices of a second proportion; the third information includes at least one of the following: status information, log information, and alarm information;

[0194] Wherein, the first rate is lower than the second rate, and the second rate is lower than the third rate;

[0195] The first measurement result and the second measurement result at least indicate that the service requirement is met; and the third measurement result indicates that the service requirement is not met.

[0196] In some embodiments, the network indicators include: measurement indicators, configuration indicators;

[0197] The monitoring module is configured to send information about the network indicators involved in the network measurement policy to the node devices corresponding to the network indicators according to the network measurement policy; the node devices are configured to obtain real-time values ​​of the indicators according to the measurement indicators, and to perform configuration according to the configuration indicators and measure the real-time values ​​of the configured indicators;

[0198] Receive the real-time value of the network indicator sent by the node device.

[0199] In some embodiments, the apparatus further comprises: a verification module configured to verify the network measurement policy;

[0200] Corresponding to a situation where the network measurement policy is verified to be successful, the real-time value of the network indicator is monitored according to the network measurement policy.

[0201] In some embodiments, the verification module is configured to perform at least one of the following:

[0202] In response to a situation where the network indicators involved in the network measurement strategy include configuration indicators, verifying whether the configuration indicators affect the operation of other functions, and determining that the configuration indicators affect the operation of other functions, the verification fails;

[0203] Corresponding to a situation where the number of network measurement policies at the same time is at least two, verifying whether any two of the at least two network measurement policies conflict; determining that any two network measurement policies conflict, and verifying failure.

[0204] It should be noted that the network measurement device provided in the above embodiments, when implementing the corresponding network measurement method, uses the division of the aforementioned program modules as an example. In actual applications, the aforementioned processing can be assigned to different program modules as needed. In other words, the internal structure of the server can be divided into different program modules to complete all or part of the aforementioned processing. Furthermore, the device provided in the above embodiments and the corresponding method embodiments are based on the same concept. The specific implementation process is detailed in the method embodiments and will not be repeated here.

[0205] Figure 7 A schematic diagram of the structure of a communication device provided in an embodiment of the present invention is shown in FIG. Figure 7 As shown, the communication device 70 includes: a processor 701 and a memory 702 for storing a computer program that can be run on the processor; when the processor 701 is used to run the computer program, it performs the following operations: determining business needs; determining network indicator information based on the business needs; the network indicator information includes: an identifier of the network indicator and an operation corresponding to the network indicator; generating a network measurement strategy based on the network indicator information; monitoring the real-time value of the network indicator, and determining a measurement result based on the network measurement strategy and the real-time value of the network indicator.

[0206] In some embodiments, the processor 701 is further configured to perform at least one of the following when running the computer program:

[0207] Querying a first relationship table according to the business requirement to determine the network indicator corresponding to the business requirement; the first relationship table includes information on at least one business requirement and at least one network indicator corresponding to each business requirement;

[0208] Use a preset recognition model to identify the business needs and determine the information of the network indicators corresponding to the business needs; the recognition model is obtained based on a neural network and a training set; the training set includes at least one business need sample and a label corresponding to each business need sample; the label is information of at least one network indicator.

[0209] In some embodiments, the processor 701 is further configured to, when running the computer program, perform: determining, based on the network indicator, a first threshold and a second threshold corresponding to the network indicator;

[0210] generating a network measurement strategy according to the first threshold and the second threshold;

[0211] The network measurement strategy includes:

[0212] In response to the real-time value of the network indicator being lower than the first threshold, determining that the network is normal and performing a first operation;

[0213] In response to the real-time value of the network indicator being between the first threshold and the second threshold, it is determined that a network abnormality occurs but services can still be run, and a second operation is performed;

[0214] In response to the situation where the real-time value of the network indicator is higher than the second threshold, it is determined that the network is abnormal and the service cannot be run, and a third operation is performed.

[0215] The first operation includes at least one of the following:

[0216] Feedback a first measurement result, perform telemetry at a first rate, and extract first information of a key node device; the first information includes at least: status information;

[0217] The second operation includes:

[0218] Feedback a second measurement result, perform telemetry at a second rate, and extract second information of the node devices of the first proportion; the second information includes at least one of the following: status information and log information;

[0219] The third operation includes:

[0220] Feedback a third measurement result, perform telemetry at a third rate, and extract third information of the node devices of a second proportion; the third information includes at least one of the following: status information, log information, and alarm information;

[0221] Wherein, the first rate is lower than the second rate, and the second rate is lower than the third rate;

[0222] The first measurement result and the second measurement result at least indicate that the service requirement is met; and the third measurement result indicates that the service requirement is not met.

[0223] In some embodiments, the processor 701 is further configured to, when running the computer program, execute: sending, according to the network measurement policy, information of the network indicator involved in the network measurement policy to a node device corresponding to the network indicator; the node device is configured to obtain a real-time value of the indicator according to the measurement indicator, and to configure according to the configuration indicator and measure the real-time value of the configured indicator;

[0224] Receive the real-time value of the network indicator sent by the node device.

[0225] In some embodiments, the processor 701 is further configured to, when running the computer program, perform: verifying the network measurement policy;

[0226] Corresponding to a situation where the network measurement strategy is verified to be successful, the real-time value of the network indicator is monitored according to the network measurement strategy.

[0227] In some embodiments, the processor 701 is further configured to perform at least one of the following when running the computer program:

[0228] In response to a situation where the network indicators involved in the network measurement strategy include configuration indicators, verifying whether the configuration indicators affect the operation of other functions, and determining that the configuration indicators affect the operation of other functions, the verification fails;

[0229] Corresponding to a situation where the number of network measurement policies at the same time is at least two, verifying whether any two of the at least two network measurement policies conflict; determining that any two network measurement policies conflict, and verifying failure.

[0230] In actual application, the communication device 70 may further include: at least one network interface 703. The various components in the communication device 70 are coupled together via a bus system 704. It is understood that the bus system 704 is used to achieve connection and communication between these components. In addition to the data bus, the bus system 704 also includes a power bus, a control bus, and a status signal bus. However, for the sake of clarity, Figure 7 In the figure, various buses are labeled as bus system 704. There may be at least one processor 701. The network interface 703 is used for wired or wireless communication between the communication device 70 and other devices.

[0231] The memory 702 in the embodiment of the present invention is used to store various types of data to support the operation of the communication device 70 .

[0232] The methods disclosed in the above embodiments of the present invention can be applied to or implemented by processor 701. Processor 701 may be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method can be completed by hardware integrated logic circuits in processor 701 or by software instructions. The above processor 701 may be a general-purpose processor, a digital signal processor (DSP), or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, etc. Processor 701 can implement or execute the various methods, steps, and logic block diagrams disclosed in the embodiments of the present invention. A general-purpose processor may be a microprocessor or any conventional processor. The steps of the methods disclosed in the embodiments of the present invention can be directly implemented and executed by a hardware decoding processor, or by a combination of hardware and software modules in the decoding processor. The software module may be located in a storage medium located in memory 702. Processor 701 reads information from memory 702 and, in conjunction with its hardware, completes the steps of the above method.

[0233] In an exemplary embodiment, the communication device 70 may be implemented by one or more application-specific integrated circuits (ASICs), DSPs, programmable logic devices (PLDs), complex programmable logic devices (CPLDs), field-programmable gate arrays (FPGAs), general-purpose processors, controllers, microcontrollers (MCUs), microprocessors, or other electronic components to execute the aforementioned method.

[0234] An embodiment of the present invention also provides a computer-readable storage medium having a computer program stored thereon; when the computer program is executed by a processor, the computer program performs the following operations: determining business requirements; determining information of network indicators based on the business requirements; the information of the network indicators including: an identifier of the network indicator and an operation corresponding to the network indicator; generating a network measurement strategy based on the information of the network indicators; monitoring the real-time value of the network indicator, and determining a measurement result based on the network measurement strategy and the real-time value of the network indicator.

[0235] In some embodiments, when the computer program is executed by a processor, it performs at least one of the following:

[0236] Querying a first relationship table according to the business requirement to determine the network indicator corresponding to the business requirement; the first relationship table includes information on at least one business requirement and at least one network indicator corresponding to each business requirement;

[0237] Use a preset recognition model to identify the business needs and determine the information of the network indicators corresponding to the business needs; the recognition model is obtained based on a neural network and a training set; the training set includes at least one business need sample and a label corresponding to each business need sample; the label is information of at least one network indicator.

[0238] In some embodiments, when the computer program is executed by a processor, the computer program performs: determining a first threshold and a second threshold corresponding to the network indicator based on the network indicator; generating a network measurement strategy based on the first threshold and the second threshold;

[0239] The network measurement strategy includes:

[0240] In response to the real-time value of the network indicator being lower than the first threshold, determining that the network is normal and performing a first operation;

[0241] In response to the real-time value of the network indicator being between the first threshold and the second threshold, it is determined that a network abnormality occurs but services can still be run, and a second operation is performed;

[0242] In response to the situation where the real-time value of the network indicator is higher than the second threshold, it is determined that the network is abnormal and the service cannot be run, and a third operation is performed.

[0243] The first operation includes at least one of the following:

[0244] Feedback a first measurement result, perform telemetry at a first rate, and extract first information of a key node device; the first information includes at least: status information;

[0245] The second operation includes:

[0246] Feedback a second measurement result, perform telemetry at a second rate, and extract second information of the node devices of the first proportion; the second information includes at least one of the following: status information and log information;

[0247] The third operation includes:

[0248] Feedback a third measurement result, perform telemetry at a third rate, and extract third information of the node devices of a second proportion; the third information includes at least one of the following: status information, log information, and alarm information;

[0249] Wherein, the first rate is lower than the second rate, and the second rate is lower than the third rate;

[0250] The first measurement result and the second measurement result at least indicate that the service requirement is met; and the third measurement result indicates that the service requirement is not met.

[0251] In some embodiments, when the computer program is executed by a processor, the computer program performs: according to the network measurement policy, sending information of the network indicator involved in the network measurement policy to a node device corresponding to the network indicator; the node device is configured to obtain a real-time value of the indicator according to the measurement indicator, and to perform configuration according to the configuration indicator and measure the real-time value of the configured indicator;

[0252] Receive the real-time value of the network indicator sent by the node device.

[0253] In some embodiments, when the computer program is executed by a processor, the computer program performs: verifying the network measurement policy;

[0254] Corresponding to a situation where the network measurement strategy is verified to be successful, the real-time value of the network indicator is monitored according to the network measurement strategy.

[0255] In some embodiments, when the computer program is executed by a processor, it performs at least one of the following:

[0256] In response to a situation where the network indicators involved in the network measurement strategy include configuration indicators, verifying whether the configuration indicators affect the operation of other functions, and determining that the configuration indicators affect the operation of other functions, the verification fails;

[0257] Corresponding to a situation where the number of network measurement policies at the same time is at least two, verifying whether any two of the at least two network measurement policies conflict; determining that any two network measurement policies conflict, and verifying failure.

[0258] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.

[0259] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0260] In addition, all functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be separately used as a unit, or two or more units may be integrated into one unit; the above-mentioned integrated units may be implemented in the form of hardware or in the form of hardware plus software functional units.

[0261] Those skilled in the art will appreciate that all or part of the steps of the above-mentioned method embodiments may be implemented by hardware associated with program instructions, and the aforementioned program may be stored in a computer-readable storage medium. When the program is executed, the program executes the steps of the above-mentioned method embodiments. The aforementioned storage medium includes various media that can store program codes, such as mobile storage devices, read-only memories (ROMs), random access memories (RAMs), magnetic disks, or optical disks.

[0262] Alternatively, if the above-mentioned integrated unit of the present invention is implemented in the form of a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a number of instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the methods described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROM, RAM, magnetic disks or optical disks.

[0263] It should be noted that: "first", "second", etc. are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0264] In addition, the technical solutions described in the embodiments of the present application can be arbitrarily combined without conflict.

[0265] The above description is merely a specific embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any modifications or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in the present invention should be included within the scope of protection of the present invention. Therefore, the scope of protection of the present invention should be based on the scope of protection of the claims.

Claims

1. A network measurement method, characterized in that: include: Identify business needs; Determine network indicator information based on the business requirements; The network indicators include: measurement indicators and configuration indicators; the information of the network indicators includes: identification of the network indicators and operations corresponding to the network indicators; Determining, based on the network indicator, a first threshold and a second threshold corresponding to the network indicator; Generate a network measurement strategy based on the first threshold and the second threshold; the network measurement strategy includes: In response to the real-time value of the network indicator being lower than the first threshold, determining that the network is normal and performing a first operation; In response to the real-time value of the network indicator being between the first threshold and the second threshold, it is determined that a network abnormality occurs but services can still be run, and a second operation is performed; In response to the real-time value of the network indicator being higher than the second threshold, determining that the network is abnormal and the service is not operable, and performing a third operation; The real-time value of the network indicator is monitored, and a measurement result is determined according to the network measurement strategy and the real-time value of the network indicator.

2. The method according to claim 1, characterized in that The information of determining network indicators according to the business requirements includes at least one of the following: Querying a first relationship table according to the business requirement to determine the network indicator corresponding to the business requirement; the first relationship table includes information on at least one business requirement and at least one network indicator corresponding to each business requirement; Use a preset recognition model to identify the business needs and determine the information of the network indicators corresponding to the business needs; the recognition model is obtained based on a neural network and a training set; the training set includes at least one business need sample and a label corresponding to each business need sample; the label is information of at least one network indicator.

3. The method according to claim 1, characterized in that The first operation includes at least one of the following: Feedback a first measurement result, perform telemetry at a first rate, and extract first information of a key node device; The first information includes at least: status information; The second operation includes: Feedback a second measurement result, perform telemetry at a second rate, and extract second information of the node devices of the first proportion; the second information includes at least one of the following: status information and log information; The third operation includes: Feedback a third measurement result, perform telemetry at a third rate, and extract third information of the node devices of a second proportion; the third information includes at least one of the following: status information, log information, and alarm information; Wherein, the first rate is lower than the second rate, and the second rate is lower than the third rate; The first measurement result and the second measurement result at least indicate that the service requirement is met; and the third measurement result indicates that the service requirement is not met.

4. The method according to claim 1, wherein The monitoring of the real-time value of the network indicator includes: According to the network measurement strategy, information about the network indicator involved in the network measurement strategy is sent to a node device corresponding to the network indicator; the node device is used to measure and obtain a real-time value of the indicator according to the measurement indicator, and to configure according to the configuration indicator and measure and obtain a real-time value of the configured indicator; Receive the real-time value of the network indicator sent by the node device.

5. The method according to claim 1, wherein The method further comprises: verifying the network measurement strategy; Corresponding to a situation where the network measurement policy is verified to be successful, the real-time value of the network indicator is monitored according to the network measurement policy.

6. The method according to claim 5, characterized in that The verifying the network measurement strategy includes at least one of the following: In response to a situation where the network indicators involved in the network measurement strategy include configuration indicators, verifying whether the configuration indicators affect the operation of other functions, and determining that the configuration indicators affect the operation of other functions, the verification fails; Corresponding to a situation where the number of network measurement policies at the same time is at least two, verifying whether any two of the at least two network measurement policies conflict; determining that any two network measurement policies conflict, and verifying failure.

7. A network measurement device, characterized in that: The device comprises: A first determination module is used to determine business needs; A second determining module is configured to determine information of network indicators according to the business requirements; the network indicators include: measurement indicators and configuration indicators; the information of network indicators includes: identification of network indicators and operations corresponding to network indicators; A generating module is configured to determine, based on the network indicator, a first threshold and a second threshold corresponding to the network indicator; and generate a network measurement strategy based on the first threshold and the second threshold; the network measurement strategy includes: In response to the real-time value of the network indicator being lower than the first threshold, determining that the network is normal and performing a first operation; In response to the real-time value of the network indicator being between the first threshold and the second threshold, it is determined that a network abnormality occurs but services can still be run, and a second operation is performed; In response to the real-time value of the network indicator being higher than the second threshold, determining that the network is abnormal and the service is not operable, and performing a third operation; The monitoring module is used to monitor the real-time value of the network indicator and determine the measurement result according to the network measurement strategy and the real-time value of the network indicator.

8. A communication device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the program, the steps of the method according to any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

Images