An intent pre-evaluation method and device

Abstract

The embodiment of the application provides an intention pre-evaluation method and device, the method comprises the following steps: a first network element receives an intention target and a pre-evaluation type from a second network element, the pre-evaluation type comprises pre-evaluation information of an intention achievement result or pre-evaluation information of the influence of a network key performance indicator (KPI), and the intention target comprises a first operation; receiving first information from a third network element, the first information comprises one or more of the following: operation influence information or first KPI influence information, the operation influence information is used for indicating mutual exclusion information of the first operation, and the first KPI influence information is used for indicating the influence of the first operation on a KPI associated with the intention target or the influence of the first operation on a network KPI; determining result information corresponding to the pre-evaluation type according to the first information and sending the result information to the second network element, and the result information comprises pre-evaluation information of the intention achievement result or pre-evaluation information of the influence of the KPI, and the embodiment of the application can improve the intention execution efficiency.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of communication, in particular to an intention pre-evaluation method and device. BACKGROUND

[0002] In the existing intention system, intention translation decision needs to be constantly tried. After a user issues an intention target, the intention target related operation is selected through intention translation and intention decision, and the implementation of the intention target is performed according to the operation. In the implementation process of the intention target, if the gain does not meet the intention target, the decision is retranslated, and if all operations are used and still cannot meet the gain, the user is fed back that the intention target cannot be achieved. However, in the case that the intention target cannot be achieved, the implementation of the intention target will modify the current network state, and the intention execution efficiency is low. Therefore, how to improve the intention execution efficiency is a technical problem to be solved by the person skilled in the art. SUMMARY

[0003] Embodiments of the present application disclose an intention pre-evaluation method and device, which can know whether the intention can be completed or know the influence on the network after the implementation of the intention without modifying the network state, which is beneficial to improve the intention execution efficiency.

[0004] The first aspect of the embodiments of the present application discloses an intention pre-evaluation method, comprising:

[0005] The first network element receives an intention target and a pre-evaluation type from the second network element, the pre-evaluation type includes pre-evaluation information of an intention achievement result or pre-evaluation information of an influence on a network key performance indicator (KPI), and the intention target includes a first operation;

[0006] The first network element receives first information from the third network element, the first information includes one or more of the following: operation influence information or first KPI influence information, the operation influence information is used to indicate mutual exclusion information of the first operation, and the first KPI influence information is used to indicate an influence of the first operation on a KPI associated with the intention target or an influence on a network KPI;

[0007] The first network element determines result information corresponding to the pre-evaluation type according to the first information, the result information includes: pre-evaluation information of an intention achievement result or pre-evaluation information of an influence on a KPI;

[0008] The first network element sends the result information to the second network element.

[0009] In the method, the intention target and the pre-evaluation type are sent to the first network element by the second network element, correspondingly, the first network element determines the result information corresponding to the pre-evaluation type according to the first information, and sends the result information to the second network element, the result information includes the pre-evaluation information of the intention achievement result and the pre-evaluation information of the KPI influence, which can know whether the intention can be completed or the influence on the network after the intention is implemented without modifying the network state, and is beneficial for the second network element to take it as a reference and improve the intention execution efficiency.

[0010] In a possible implementation, the intention target includes an identifier of the intention target and / or a target value of the intention target.

[0011] In another possible implementation, the first network element further receives one or more of the following from the second network element: a pre-evaluation termination condition, a pre-evaluation maximum duration, the pre-evaluation termination condition is used to determine whether the process of determining the result information corresponding to the pre-evaluation type according to the first information by the first network element continues or terminates; and the pre-evaluation maximum duration is used to determine whether the process of determining the result information corresponding to the pre-evaluation type according to the first information by the first network element continues or terminates.

[0012] In the method, the pre-evaluation process can be performed within a reasonable range through the pre-evaluation termination condition and the pre-evaluation maximum duration, thereby improving the system performance.

[0013] In another possible implementation, if the result information includes the pre-evaluation information of the intention achievement result, the result information further includes one or more of the following: a confidence degree of the result information, a time duration required for the intention target to be achieved, and a reason why the intention target is not achieved.

[0014] In the method, the result information includes one or more of the above, for the second network element to analyze, which is beneficial to improve the intention execution efficiency.

[0015] In another possible implementation, if the result information includes the pre-evaluation information of the KPI influence, the result information further includes one or more of the following: a confidence degree of the result information, a KPI list corresponding to the pre-evaluation information of the KPI influence, and a confidence degree of the pre-evaluation information of the KPI influence.

[0016] In another possible implementation, the first information further includes one or more of the following: network performance data information, time information of validity of the first operation, and information of other intention targets in addition to the intention target.

[0017] In a further possible implementation, the network KPIs include one or more of the following: latency, throughput rate, speed, physical resource block (PRB) utilization, jitter, radio resource control (RRC) setup success rate, quality of service flow (QoS Flow) setup success rate, call setup success rate, radio call drop rate, intra-frequency handover success rate, inter-frequency handover success rate, central processing unit (CPU) utilization, cell availability, radio network availability, data service uplink traffic, data service downlink traffic, average user number, maximum user number, uplink interference noise, PSCell change success rate, protocol data unit (PDU) total packet number, PDU total data amount, coverage curve, reference signal received power (RSRP) average value, signal-to-interference-and-noise ratio (SINR) average value, base station energy efficiency value, and base station energy efficiency level.

[0018] In a further possible implementation, the mutual exclusion information includes identification information of the mutually exclusive operations, or indication information indicating whether the operations are mutually exclusive.

[0019] The second aspect of the embodiments of the present application discloses an intention pre-evaluation method, including:

[0020] The second network element sends an intention target and a pre-evaluation type to the first network element, the pre-evaluation type including pre-evaluation information of an intention achievement result or pre-evaluation information of an influence on network key performance indicators (KPIs), and the intention target including a first operation;

[0021] The second network element receives result information from the first network element, the result information being determined by the first network element according to first information and corresponding to the pre-evaluation type, and the result information including pre-evaluation information of an intention achievement result or pre-evaluation information of an influence on KPIs; and the first information including one or more of the following: operation influence information or first KPI influence information, the operation influence information being used to indicate mutual exclusion information of the first operation, and the first KPI influence information being used to indicate an influence of the first operation on an intention target-associated KPI or an influence of the first operation on network KPIs.

[0022] In the above method, the second network element sends an intention target and a pre-evaluation type to the first network element, and correspondingly, the first network element determines result information corresponding to the pre-evaluation type according to first information and sends the result information to the second network element, the result information including pre-evaluation information of an intention achievement result and pre-evaluation information of an influence on KPIs, which can help to know whether an intention can be completed or an influence on a network after implementation of the intention without modifying a network state, and is beneficial for the second network element to take the result information as a reference and improve intention execution efficiency.

[0023] In a possible implementation, the intention target includes identification of the intention target and / or a target value of the intention target.

[0024] In a further possible implementation, the second network element further sends one or more of the following to the first network element: a pre-evaluation termination condition, a pre-evaluation maximum duration, the pre-evaluation termination condition being used to determine whether the first network element continues or terminates the process of determining the result information corresponding to the pre-evaluation type according to the first information, and the pre-evaluation maximum duration being used to determine whether the first network element continues or terminates the process of determining the result information corresponding to the pre-evaluation type according to the first information.

[0025] In a further possible implementation, if the result information includes the pre-evaluation information of the intended target achievement, the result information further includes one or more of the following: a confidence level of the result information, a time duration required for the intended target to be achieved, and a reason why the intended target is not achieved.

[0026] In a further possible implementation, if the result information includes the pre-evaluation information of the KPI impact, the result information further includes one or more of the following: a confidence level of the result information, a KPI list corresponding to the pre-evaluation information of the KPI impact, and a confidence level of the pre-evaluation information of the KPI impact.

[0027] In a further possible implementation, the first information further includes one or more of the following: network performance data information, time information of the taking effect of the first operation, and information of other intended targets in addition to the intended target.

[0028] In a further possible implementation, the network KPI includes one or more of the following: latency, throughput rate, speed, physical resource block (PRB) utilization rate, jitter, radio resource control (RRC) establishment success rate, quality of service (QoS) flow establishment success rate, call establishment success rate, radio call drop rate, intra-frequency handover success rate, inter-frequency handover success rate, central processing unit (CPU) utilization rate, cell availability rate, wireless network availability rate, data service uplink traffic, data service downlink traffic, average user number, maximum user number, uplink interference noise, primary secondary cell (PSCell) change success rate, protocol data unit (PDU) total packet number, PDU total data amount, coverage curve, reference signal received power (RSRP) average value, signal-to-interference-and-noise ratio (SINR) average value, base station energy efficiency value, and base station energy efficiency level.

[0029] In a further possible implementation, the mutual exclusion information includes identification information of the mutually exclusive operation, or indication information indicating whether the operations are mutually exclusive.

[0030] The third aspect of the embodiment of the present application discloses an intended pre-evaluation method, including:

[0031] The first network element receives pre-evaluation information of network key performance indicator (KPI) impact from the second network element.

[0032] The first network element receives first information from the third network element, the first information including one or more of the following: operation impact information or impact information of a second KPI, the operation impact information being used to indicate mutual exclusion information of a second operation, the impact information of the second KPI being used to indicate an impact of the second operation on a network KPI, the second operation being an operation affecting the network KPI;

[0033] The first network element determines an evaluation value corresponding to the pre-evaluation information according to the first information.

[0034] The first network element sends the evaluation value to the second network element.

[0035] In the above method, by sending, by the second network element, pre-evaluation information of an impact on the network KPI to the first network element, and correspondingly, by the first network element determining an evaluation value of the pre-evaluation information according to the first information and sending the evaluation value to the second network element, the evaluation value can be fed back without modifying the network state, which is beneficial for the second network element to refer to the evaluation value and is beneficial for improving intent execution efficiency.

[0036] In a possible implementation, the first network element further receives, from the second network element, one or more of the following: a pre-evaluation constraint condition, a pre-evaluation termination condition, and a pre-evaluation maximum time length; the pre-evaluation constraint condition is used to indicate a constraint on performing a process of determining an evaluation value corresponding to the pre-evaluation information according to the first information, the pre-evaluation termination condition is used to determine whether to continue or terminate the process of determining the evaluation value corresponding to the pre-evaluation information according to the first information, and the pre-evaluation maximum time length is used to determine whether to continue or terminate the process of determining the evaluation value corresponding to the pre-evaluation information according to the first information.

[0037] In the above method, by using the pre-evaluation constraint condition, the pre-evaluation termination condition, and the pre-evaluation maximum time length, the pre-evaluation process can be performed within a reasonable range, thereby improving system performance.

[0038] In another possible implementation, the first network element determining an evaluation value corresponding to the pre-evaluation information according to the first information includes: the first network element determining the evaluation value corresponding to the pre-evaluation information according to the first information and a confidence degree of the evaluation value.

[0039] In the above method, by determining the confidence degree of the evaluation value and sending the confidence degree of the evaluation value to the second network element for reference by the second network element, intent execution efficiency can be improved.

[0040] In another possible implementation, the first information further includes one or more of the following: network performance data information, a time at which a second operation takes effect, and information of an intent corresponding to a network KPI other than the network KPI.

[0041] In a further possible implementation, the network KPIs include one or more of the following: latency, throughput rate, speed, physical resource block (PRB) utilization, jitter, radio resource control (RRC) setup success rate, quality of service flow (QoS Flow) setup success rate, call setup success rate, radio call drop rate, intra-frequency handover success rate, inter-frequency handover success rate, central processing unit (CPU) utilization, cell availability, radio network availability, data service uplink traffic, data service downlink traffic, average user number, maximum user number, uplink interference noise, PSCell change success rate, protocol data unit (PDU) total packet number, PDU total data amount, coverage curve, reference signal received power (RSRP) average value, signal-to-interference-and-noise ratio (SINR) average value, base station energy efficiency value, and base station energy efficiency level.

[0042] In a further possible implementation, the mutual exclusion information includes operation identification information of mutual exclusion, or indication information indicating whether mutual exclusion.

[0043] The fourth aspect of the embodiments of the present application discloses an intention pre-evaluation method, including:

[0044] The second network element sends pre-evaluation information of the influence of the network KPI to the first network element;

[0045] The second network element receives an evaluation value corresponding to the pre-evaluation information from the first network element; the evaluation value corresponding to the pre-evaluation information is determined according to first information, and the first information includes one or more of the following: operation influence information or second KPI influence information, the operation influence information is used to indicate mutual exclusion information of a second operation, the second KPI influence information is used to indicate the influence of the second operation on the network KPI, and the second operation is an operation that influences the network KPI.

[0046] In the above method, the second network element sends pre-evaluation information of the influence of the network KPI to the first network element, and correspondingly, the first network element determines an evaluation value of the pre-evaluation information according to first information and sends the evaluation value to the second network element, which can feedback the evaluation value without modifying the network state, and is beneficial for the second network element to take it as a reference and improve the intention execution efficiency.

[0047] In a possible implementation, the second network element sends one or more of the following to the first network element: pre-evaluation constraint condition, pre-evaluation termination condition, and pre-evaluation maximum time length; the pre-evaluation constraint condition is used to indicate the constraint on the process of determining the evaluation value corresponding to the pre-evaluation information according to the first information, the pre-evaluation termination condition is used to determine whether to continue or terminate the process of determining the evaluation value corresponding to the pre-evaluation information according to the first information, and the pre-evaluation maximum time length is used to determine whether to continue or terminate the process of determining the evaluation value corresponding to the pre-evaluation information according to the first information.

[0048] In a further possible implementation, the method further includes: receiving, by the second network element, a confidence level of the evaluation value from the first network element, the confidence level of the evaluation value being determined according to the first information.

[0049] In a further possible implementation, the first information further includes one or more of: network performance data information, a time of taking effect of the second operation, and information of an intention corresponding to a network KPI other than the network KPI.

[0050] In a further possible implementation, the network KPI includes one or more of: latency, throughput rate, speed, physical resource block (PRB) utilization, jitter, radio resource control (RRC) setup success rate, quality of service (QoS) flow setup success rate, call setup success rate, radio drop rate, intra-frequency handover success rate, inter-frequency handover success rate, central processing unit (CPU) utilization, cell availability, radio network availability, data service uplink traffic, data service downlink traffic, average user number, maximum user number, uplink interference noise, primary secondary cell (PSCell) change success rate, protocol data unit (PDU) total packet number, PDU total data amount, coverage curve, reference signal received power (RSRP) average value, signal-to-interference-and-noise ratio (SINR) average value, base station energy efficiency value, and base station energy efficiency level.

[0051] In a further possible implementation, the mutual exclusion information includes mutual exclusion operation identification information or indication information indicating whether mutual exclusion.

[0052] A fifth aspect of the embodiments of the present application discloses an intention pre-evaluation device, including: a communication unit and a processing unit,

[0053] The communication unit is configured to receive an intention target and a pre-evaluation type from a second network element, the pre-evaluation type including pre-evaluation information of an intention achievement result or pre-evaluation information of an influence on a network key performance indicator (KPI), and the intention target including a first operation.

[0054] The communication unit is configured to receive first information from a third network element, the first information including one or more of: operation influence information or first KPI influence information, the operation influence information being used to indicate mutual exclusion information of the first operation, and the first KPI influence information being used to indicate an influence of the first operation on a KPI associated with the intention target or an influence of the first operation on a network KPI.

[0055] The processing unit is configured to determine, according to the first information, result information corresponding to the pre-evaluation type, the result information including: pre-evaluation information of the intention achievement result or pre-evaluation information of the influence on the KPI.

[0056] The communication unit is configured to send the result information to the second network element.

[0057] In a possible implementation, the intent target includes an identification of the intent target and / or a target value of the intent target.

[0058] In a further possible implementation, the communication unit is further configured to receive, from the second network element, one or more of the following: a pre-evaluation termination condition, a pre-evaluation maximum duration, the pre-evaluation termination condition being used to determine whether the process of determining the result information corresponding to the pre-evaluation type according to the first information is to be continued or terminated; the pre-evaluation maximum duration being used to determine whether the process of determining the result information corresponding to the pre-evaluation type according to the first information is to be continued or terminated.

[0059] In a further possible implementation, if the result information includes the pre-evaluation information of the intent achievement result, the result information further includes one or more of the following: a confidence level of the result information, a time duration required for the intent target to be achieved, a reason why the intent target is not achieved.

[0060] In a further possible implementation, if the result information includes the pre-evaluation information of the KPI influence, the result information further includes one or more of the following: a confidence level of the result information, a KPI list corresponding to the pre-evaluation information of the KPI influence, a confidence level of the pre-evaluation information of the KPI influence.

[0061] In a further possible implementation, the first information further includes one or more of the following: network performance data information, time information of the taking effect of the first operation, and information of other intent targets in addition to the intent target.

[0062] In a further possible implementation, the network KPI includes one or more of the following: latency, throughput rate, speed, physical resource block (PRB) utilization rate, jitter, radio resource control (RRC) establishment success rate, quality of service (QoS) flow establishment success rate, call establishment success rate, radio call drop rate, intra-frequency handover success rate, inter-frequency handover success rate, central processing unit (CPU) utilization rate, cell availability rate, wireless network availability rate, data service uplink traffic, data service downlink traffic, average user number, maximum user number, uplink interference noise, primary secondary cell (PSCell) change success rate, protocol data unit (PDU) total packet number, PDU total data amount, coverage curve, reference signal received power (RSRP) average value, signal-to-interference-and-noise ratio (SINR) average value, base station energy efficiency value, and base station energy efficiency level.

[0063] In a further possible implementation, the mutual exclusion information includes identification information of the mutually exclusive operation or indication information indicating whether the operations are mutually exclusive.

[0064] As to the technical effects brought by the fifth aspect or possible implementation, reference can be made to the introduction of the technical effects of the first aspect or corresponding implementation.

[0065] The sixth aspect of the embodiments of the present application discloses an intention pre-evaluation device, comprising:

[0066] a communication unit configured to receive pre-evaluation information of an influence of a network key performance indicator (KPI) from a second network element;

[0067] a communication unit configured to receive first information from a third network element, the first information comprising one or more of: operation influence information or second KPI influence information, the operation influence information being used to indicate mutual exclusion information of a second operation, the second KPI influence information being used to indicate an influence of the second operation on the network KPI, the second operation being an operation that influences the network KPI;

[0068] a processing unit configured to determine an evaluation value corresponding to the pre-evaluation information according to the first information;

[0069] a communication unit configured to send the evaluation value to the second network element.

[0070] In a possible implementation, the communication unit is further configured to receive one or more of the following from the second network element: a pre-evaluation constraint condition, a pre-evaluation termination condition, and a pre-evaluation maximum time length, the pre-evaluation constraint condition being used to indicate a constraint on a process of determining the evaluation value corresponding to the pre-evaluation information according to the first information, the pre-evaluation termination condition being used to determine whether the process of determining the evaluation value corresponding to the pre-evaluation information according to the first information continues or terminates, and the pre-evaluation maximum time length being used to determine whether the process of determining the evaluation value corresponding to the pre-evaluation information according to the first information continues or terminates.

[0071] In another possible implementation, the communication unit is configured to determine the evaluation value corresponding to the pre-evaluation information according to the first information and a confidence degree of the evaluation value.

[0072] In another possible implementation, the first information further comprises one or more of: network performance data information, a time at which the second operation takes effect, and information of an intention corresponding to another network KPI in addition to the network KPI.

[0073] In a further possible implementation, the network KPIs include one or more of the following: latency, throughput rate, speed, physical resource block (PRB) utilization, jitter, radio resource control (RRC) setup success rate, quality of service flow (QoS Flow) setup success rate, call setup success rate, radio call drop rate, intra-frequency handover success rate, inter-frequency handover success rate, central processing unit (CPU) utilization, cell availability, radio network availability, data service uplink traffic, data service downlink traffic, average user number, maximum user number, uplink interference noise, PSCell change success rate, protocol data unit (PDU) total packet number, PDU total data amount, coverage curve, reference signal received power (RSRP) average value, signal-to-interference-and-noise ratio (SINR) average value, base station energy efficiency value, and base station energy efficiency level.

[0074] In a further possible implementation, the mutual exclusion information includes operation identification information of mutual exclusion, or indication information indicating whether mutual exclusion.

[0075] As to the technical effects brought by the sixth aspect or possible implementation, reference can be made to the introduction of the technical effects of the third aspect or corresponding implementation.

[0076] The seventh aspect of the embodiments of the present application discloses an intent pre-evaluation device, which includes at least one processor and a communication interface. The at least one processor is configured to invoke a computer program stored in at least one memory and perform the following operations:

[0077] The intent target and the pre-evaluation type are received from the second network element through the communication interface. The pre-evaluation type includes pre-evaluation information of an intent achievement result or pre-evaluation information of an influence on network key performance indicators (KPIs), and the intent target includes the first operation.

[0078] The first information is received from the third network element through the communication interface. The first information includes one or more of the following: operation influence information or first KPI influence information. The operation influence information is used to indicate mutual exclusion information of the first operation, and the first KPI influence information is used to indicate an influence of the first operation on KPIs associated with the intent target or an influence of the first operation on network KPIs.

[0079] The result information corresponding to the pre-evaluation type is determined according to the first information. The result information includes pre-evaluation information of an intent achievement result or pre-evaluation information of an influence on KPIs.

[0080] The result information is sent to the second network element through the communication interface.

[0081] In a possible implementation, the intent target includes an identification of the intent target and / or a target value of the intent target.

[0082] In a further possible implementation, the at least one processor is further configured to receive, through the communication interface, from the second network element, one or more of the following: a pre-evaluation termination condition, a pre-evaluation maximum duration, the pre-evaluation termination condition being used to determine whether the process of determining the result information corresponding to the pre-evaluation type according to the first information is to be continued or terminated; the pre-evaluation maximum duration being used to determine whether the process of determining the result information corresponding to the pre-evaluation type according to the first information is to be continued or terminated.

[0083] In a further possible implementation, if the result information comprises the pre-evaluation information of the intended result, the result information further comprises one or more of the following: a confidence level of the result information, a time duration required for the intended target to be achieved, a reason why the intended target is not achieved.

[0084] In a further possible implementation, if the result information comprises the pre-evaluation information of the influence on the KPI, the result information further comprises one or more of the following: a confidence level of the result information, a list of KPIs corresponding to the pre-evaluation information of the influence on the KPI, a confidence level of the pre-evaluation information of the influence on the KPI.

[0085] In a further possible implementation, the first information further comprises one or more of the following: network performance data information, time information of the taking effect of the first operation, and information of other intended targets in addition to the intended target.

[0086] In a further possible implementation, the network KPI comprises one or more of the following: latency, throughput rate, speed, physical resource block (PRB) utilization, jitter, radio resource control (RRC) setup success rate, quality of service (QoS) flow setup success rate, call setup success rate, radio drop rate, intra-frequency handover success rate, inter-frequency handover success rate, central processing unit (CPU) utilization, cell availability, radio network availability, data service uplink traffic, data service downlink traffic, average user number, maximum user number, uplink interference noise, primary secondary cell (PSCell) change success rate, protocol data unit (PDU) total packet number, PDU total data amount, coverage curve, reference signal received power (RSRP) average value, signal-to-interference-and-noise ratio (SINR) average value, base station energy efficiency value, and base station energy efficiency level.

[0087] In a further possible implementation, the mutual exclusion information comprises identification information of the mutually exclusive operation, or indication information indicating whether the operations are mutually exclusive.

[0088] As to the technical effects brought by the seventh aspect or possible implementation, reference can be made to the introduction of the technical effects of the first aspect or corresponding implementation.

[0089] The eighth aspect of the embodiments of the present application discloses an intention pre-evaluation device, the device comprising at least one processor and a communication interface, the at least one processor being configured to invoke a computer program stored in at least one memory, and perform the following operations.

[0090] receiving, through the communication interface, pre-evaluation information of an influence of a network key performance indicator (KPI) from a second network element;

[0091] receiving, through the communication interface, first information from a third network element, the first information comprising one or more of the following: operation influence information or second KPI influence information, the operation influence information being used to indicate mutual exclusion information of a second operation, and the second KPI influence information being used to indicate an influence of the second operation on the network KPI, the second operation being an operation that influences the network KPI;

[0092] determining, according to the first information, an evaluation value corresponding to the pre-evaluation information;

[0093] sending, through the communication interface, the evaluation value to the second network element.

[0094] In a possible implementation, the at least one processor is further configured to receive, through the communication interface, one or more of the following from the second network element: a pre-evaluation constraint condition, a pre-evaluation termination condition, and a pre-evaluation maximum time length, the pre-evaluation constraint condition being used to indicate a constraint on performing a process of determining the evaluation value corresponding to the pre-evaluation information according to the first information, the pre-evaluation termination condition being used to determine whether the process of determining the evaluation value corresponding to the pre-evaluation information according to the first information continues or terminates, and the pre-evaluation maximum time length being used to determine whether the process of determining the evaluation value corresponding to the pre-evaluation information according to the first information continues or terminates.

[0095] In another possible implementation, the at least one processor is further configured to determine a confidence degree of the evaluation value according to the first information.

[0096] In another possible implementation, the first information further comprises one or more of the following: network performance data information, a time at which the second operation takes effect, and information of an intention corresponding to another network KPI in addition to the network KPI.

[0097] In a further possible implementation form of the eighth aspect, the network KPIs comprise one or more of: latency, throughput rate, speed, physical resource block (PRB) utilization, jitter, radio resource control (RRC) setup success rate, quality of service flow (QoS Flow) setup success rate, call setup success rate, radio drop rate, intra-frequency handover success rate, inter-frequency handover success rate, central processing unit (CPU) utilization, cell availability, radio network availability, data traffic uplink volume, data traffic downlink volume, average user number, maximum user number, uplink interference noise, PSCell change success rate, protocol data unit (PDU) total packet number, PDU total data volume, coverage curve, reference signal received power (RSRP) average value, signal-to-interference-and-noise ratio (SINR) average value, base station energy efficiency value, base station energy efficiency level.

[0098] In a further possible implementation form of the eighth aspect, the mutual exclusion information comprises mutual exclusion operation identification information, or indication information indicating whether mutual exclusion.

[0099] As to the technical effects brought by the eighth aspect or possible implementation forms, reference can be made to the introduction of the technical effects of the third aspect or corresponding implementation forms.

[0100] The ninth aspect of the embodiments of the present application discloses a chip system, which comprises at least one processor and a communication interface, and the at least one processor is configured to invoke a computer program stored in at least one memory to implement the method of any one of the above aspects or possible implementation forms of any one of the above aspects.

[0101] The tenth aspect of the embodiments of the present application discloses a computer readable storage medium, which stores program instructions, and when the program instructions are run on a processor, the method of any one of the above aspects or possible implementation forms of any one of the above aspects is implemented.

[0102] The eleventh aspect of the embodiments of the present application discloses a computer program product, and when the computer program product is run on a processor, the method of any one of the above aspects or possible implementation forms of any one of the above aspects is implemented. BRIEF DESCRIPTION OF DRAWINGS

[0103] The following describes the drawings used in the embodiments of the present application.

[0104] Figure 1 is a structural schematic diagram of a communication system provided by the embodiments of the present application;

[0105] Figure 2 is a schematic diagram of an existing wIDN system architecture provided by the embodiments of the present application;

[0106] Figure 3 is a schematic diagram of an improved wIDN system architecture provided by the embodiments of the present application;

[0107] Figure 4 is a schematic diagram of an existing ENI system architecture provided by an embodiment of the present application;

[0108] Figure 5 is a schematic diagram of an existing IDMS system architecture provided by an embodiment of the present application;

[0109] Figure 6 is an intent implementation flowchart provided by an embodiment of the present application;

[0110] Figure 7 is a flowchart of an intent pre-evaluation method provided by an embodiment of the present application;

[0111] Figure 8 is a flowchart of an intent pre-evaluation method provided by an embodiment of the present application;

[0112] Figure 9 is a flowchart of an intent pre-evaluation method provided by an embodiment of the present application;

[0113] Figure 10 is a flowchart of an intent pre-evaluation method provided by an embodiment of the present application;

[0114] Figure 11 is a flowchart of an intent pre-evaluation method provided by an embodiment of the present application;

[0115] Figure 12 is a schematic diagram of an intent pre-evaluation device provided by an embodiment of the present application;

[0116] Figure 13 is a schematic diagram of an intent pre-evaluation device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0117] The embodiments of the present application will be described below in conjunction with the accompanying drawings.

[0118] First, the technical terms involved in the embodiments of the present application are explained:

[0119] Intent: refers to the expectation of the action system. The intent can include one or more of the following: requirements, intent targets and constraints.

[0120] Intent instance: the object after instantiation of the intent. For example, in the present application, the intent can be replaced by the intent instance.

[0121] Intent target: used to indicate the target value that the intent needs to achieve.

[0122] Intent translation: the process of converting intent into intent executable command or rule or sub-intent.

[0123] Intention execution: issuing intention executable commands, sub-intentions, rules, and adjusting intention executable commands, sub-intentions, rules according to network environment and intention achievement.

[0124] Intention executable command: a series of instructions formed by translating and deciding an intention.

[0125] Intention schema: defining the syntax and semantics of an intention expression. An intention schema can include one or more of the following: fields, value ranges of fields, types of fields, hierarchical relationships between fields. For example, a field can be used to describe the kind, name or consumer of an intention schema.

[0126] Intention creation: creating a new intention in an intention system and creating a corresponding intention context.

[0127] Intention knowledge: intention knowledge is a related parameter of an intention schema stored in an intention knowledge base. For example, the above-mentioned related parameter can include one or more of the following: executable operations corresponding to an intention, an intention acting entity identifier or an intention acting entity type.

[0128] Intention operation: an executable operation corresponding to an intention target.

[0129] Intention conflict: when two intentions cannot be achieved simultaneously due to mutual exclusion in intention expression, execution operation or semantics, it is said that the two intentions have a conflict. Optionally, intention conflict can refer to the conflict between an intention that needs to be created and an intention that is in an active state in the system.

[0130] See Figure 1 , Figure 1Figure 1 is a structural schematic diagram of a communication system 100 provided by an embodiment of the present application, which includes a first network element 101, a second network element 102, and a third network element 103. The second network element 102 can be a network element in a business support system (BSS), an operation support system (OSS), an application (APP), or a third-party user (User). The first network element 101 and the third network element 103 can be network elements in one or more of the following systems: a wireless intent driven network (wIDN) system, an experiential networked intelligence (ENI) system proposed by the European Telecommunications Standards Institute (ETSI), and an intent driven network management service (IDMS) system proposed by the 3rd Generation Partnership Project (3GPP).

[0131] I. wIDN system: can translate intent instructions into corresponding operation command sets of wireless networks, and further supports sub-intent decomposition, intent execution, and maintenance, etc. The existing wIDN system architecture, as shown in Figure 2, includes an intent management (IM) module, an intent translation (IT) module, a knowledge management (KM) module, and an intent decision and execution (IDE) module. Functions of the modules are as follows: Figure 2

[0132] (1) Intent Management (IM) module: performs intent pattern management and intent instance management.

[0133] (2) Intent Translation (IT) module: performs intent translation, translates intents into judgment criteria for whether the intents are achieved, and operations required to achieve the intents, which can be understood by networks.

[0134] (3) Knowledge Management (KM) module: performs intent knowledge management, and provides intent knowledge query functions.​

[0135] (4) Intent Decision and Execution module: to make intent execution.

[0136] The intent management module entity can include two sub-functions, namely an intent instance base and an intent schema base. The intent instance base is used to store intent instances, and the intent schema base is used to store intent schemas. The knowledge management module entity can include an intent knowledge base, which is used to store intent knowledge.

[0137] The wIDN system proposed in the embodiments of the present application further includes an Intent Evaluation and Simulation (IES) module, as shown in Figure 3 The intent evaluation and simulation module is used for pre-evaluation of an intent. For example, the intent evaluation and simulation module can be implemented as an independent network element or a functional module; or can be included in the intent translation module, that is, the intent translation module is enhanced, and the enhanced intent translation module can implement the functions implemented by the intent evaluation and simulation module. When the intent evaluation and simulation module is implemented as an independent network element or a functional module, Figure 1 The first network element 101 in the communication system shown in Figure 1 The third network element 103 in the communication system shown in Figure 1 The first network element 101 in the communication system shown in

[0138] II. ENI system: The architecture of the ENI system is as shown in Figure 4As shown, the ENI system includes one or more of the following functional modules: a Data Ingestion Function Block, a Normalization Function Block, a Knowledge Management Function Block, an Intent Translation Function Block, OSS-and BSS-like Functionality, and a User. The functions of each module are as follows:

[0139] (1) Data Ingestion Function Block: responsible for receiving data from external systems.

[0140] (2) Normalization Function Block: responsible for normalizing data and the like.

[0141] (3) Knowledge Management Function Block: responsible for analyzing existing network states and storing intent knowledge and intent context knowledge.

[0142] (4) Intent Translation Function Block: used to translate received intent policies into commands recognizable by the ENI internal system, and can be placed in a Policy Management Function Block.

[0143] (5) OSS-and BSS-like Functionality: responsible for inputting intents to the ENI system.

[0144] (6) User: responsible for inputting intents to the ENI system.

[0145] The ENI system proposed in the embodiments of the present application also includes an Intent Evaluation and Simulation module. The Intent Evaluation and Simulation module is used for pre-evaluation of intents. For example, the Intent Evaluation and Simulation module can be implemented as an independent network element or functional module; or can be included in the Intent Translation module, that is, the Intent Translation module is enhanced, and the enhanced Intent Translation module can implement the functions implemented by the Intent Evaluation and Simulation module. When the Intent Evaluation and Simulation module is implemented as an independent network element or functional module, Figure 1 The first network element 101 in the communication system shown can be an entity of the Intent Evaluation and Simulation module; Figure 1 The third network element 103 in the communication system shown can be an entity of the Knowledge Management Function Block. When the Intent Evaluation and Simulation module is implemented through the Intent Translation Function Block,Figure 1 The first network element 101 in the communication system shown can be an intent translation function module entity; the division of the above module is not fixed, and is only an example, and the embodiments of the present application are not limited.

[0146] III. IDMS system proposed by 3GPP: The IDMS system architecture is as shown in Figure 5 As shown in the figure, the IDMS system architecture includes a management service (MnS) consumer and a MnS producer. The MnS consumer can refer to an intent consumer in the embodiments of the present application, and the MnS producer can refer to an intent service provider in the embodiments of the present application. The MnS consumer is used to issue an intent service request, such as intent creation, intent modification, etc. The MnS producer is used for intent pattern management, intent instance management, intent translation, translation of the intent into a judgment criterion that the network can understand for whether the intent is achieved, and operations that need to be performed to achieve the intent, intent knowledge management, provision of an intent knowledge query function, and intent execution. The embodiments of the present application can improve the function of the intent service provider of the IDMS system, and add an intent pre-evaluation function, which is used to implement the method described in the embodiments of the present application.

[0147] The existing intent system is as shown in Figure 2 As shown in the figure, the intent translation decision needs to constantly try operations. After the user issues an intent, the intent is translated and decided by the intent translation and the intent decision, and the operation is selected to implement the intent. If the result obtained after the implementation of the intent does not satisfy the intent target, the decision is retranslated, and if all operations are used and the intent target cannot be satisfied, the user is fed back that the intent cannot be achieved. The specific steps are as shown in Figure 6 Figure 6 The auxiliary system can also be referred to as an intent action system, that is, a network element on which the operation of the generated intent acts.

[0148] (1) Step 1: The user issues an intent.

[0149] (2) Step 2: The intent translation module in the intent system translates the intent, and decides the intent operation.

[0150] (3) Step 3: The intent is implemented according to the intent operation. After the implementation of the intent in the system, the intent system checks the result obtained after the implementation of the intent. If the result obtained after the implementation of the intent does not satisfy the intent target, the intent translation of step 2 is reperformed to obtain the intent operation, and the implementation of the intent and the checking of the result obtained after the implementation of the intent are reperformed.

[0151] (4) Step 4: If all operations in step 3 cannot satisfy the intent target, the user is fed back that the intent cannot be achieved. ​

[0152] Wherein, step 2 and step 3 need to try multiple intent operations by iteration, each time of trying will modify the network state, for example, the resource state of the network or the performance state of the network, the efficiency of intent execution is low. Therefore, how to improve the efficiency of intent execution is a technical problem that persons skilled in the art are trying to solve, in order to solve the above problems, the embodiment of the present application proposes the following solutions.

[0153] Please refer to Figure 7 , Figure 7 The method provided by the embodiment of the present application is a kind of intent pre-evaluation method, which can be implemented in intent creation process or after intent creation, the method includes but is not limited to the following steps:

[0154] Step S701: the second network element sends the intent target and the pre-evaluation type to the first network element.

[0155] Step S702: the first network element receives the intent target and the pre-evaluation type from the second network element.

[0156] For example, the intent target includes the identification (targetName) of the intent target and / or the target value (targetValue) of the intent target. For example, the intent target is to improve the throughput rate by 10%, the identification of the intent target can be the throughput rate, and the target value of the intent target can be 10%.

[0157] For example, the pre-evaluation type includes the pre-evaluation information of the intent achievement result or the pre-evaluation information of the influence of network key performance indicator (KPI). Wherein, the influence of network KPI can refer to the influence of the network KPI after the implementation of the intent target. Wherein, the pre-evaluation information of the influence of network KPI can be a network KPI list.

[0158] For example, the network KPIs include one or more of the following: latency, throughput rate, speed, physical resource block (PRB) utilization, jitter, radio resource control (RRC) setup success rate, quality of service (QoS) flow setup success rate, call setup success rate, radio drop call rate, intra-frequency handover success rate, inter-frequency handover success rate, central processing unit (CPU) utilization, cell availability, radio network availability, data service uplink traffic, data service downlink traffic, average user number, maximum user number, uplink interference noise, primary secondary cell (PSCell) change success rate, protocol data unit (PDU) total packet number, PDU total data volume, coverage curve, reference signal receiving power (RSRP) average value, signal to interference plus noise ratio (SINR) average value, base station energy efficiency value, and base station energy efficiency level.

[0159] Optionally, the first network element further receives indication information from the second network element, the indication information being used to indicate whether to pre-evaluate the intention target. When the indication information indicates not to pre-evaluate the intention target, the subsequent steps are not executed.

[0160] For example, the first network element further receives one or more of the following from the second network element: pre-evaluation termination condition, and pre-evaluation maximum time length. The pre-evaluation termination condition is used to determine whether the process of determining the result information corresponding to the pre-evaluation type according to the first information by the first network element continues or terminates; and the pre-evaluation maximum time length is used to determine whether the process of determining the result information corresponding to the pre-evaluation type according to the first information by the first network element continues or terminates. For example, the first network element further receives the pre-evaluation termination condition from the second network element, which is that the pre-evaluation process is stopped when the system resource occupied by the pre-evaluation process is more than 70%. For example, the first network element further receives the pre-evaluation maximum time length from the second network element, which is that the pre-evaluation process is stopped when the time consumed by the pre-evaluation process is more than 10 minutes. The pre-evaluation process can be understood as the process of determining the result information corresponding to the pre-evaluation type according to the first information by the first network element.

[0161] For example, the intent target includes a first operation. The first operation can refer to all operations associated with the intent target. The first operation can be obtained by the first network element from other network elements, or determined by the first network element according to the intent target. The first operation can be an operation set list, which includes one or more operations. For example, the first operation is operation set 1, and operation set 1 includes operation 1, operation 2, and operation 3.

[0162] Step S703: The third network element sends first information to the first network element.

[0163] Step S704: The first network element receives the first information from the third network element.

[0164] For example, the third network element can refer to one or more network elements. The first information includes one or more of the following: operation impact information or first KPI impact information. The operation impact information is used to indicate mutual exclusion information of the first operation, and the first KPI impact information is used to indicate the impact of the first operation on the KPI associated with the intent target or the impact on the network KPI.

[0165] For example, the mutual exclusion information of the first operation includes identification information of mutually exclusive operations, or indication information indicating whether it is mutually exclusive. That is, assuming that the first operation includes multiple operations, the identification information of mutually exclusive operations can refer to the identification information of mutually exclusive operations in the multiple operations. For example, the first operation includes operation 1, operation 2, and operation 3, and the identification information is identification 1, identification 2, and identification 3. Assuming that operation 1 and operation 3 are mutually exclusive, the identification information of mutually exclusive operations is identification 1 and identification 3.

[0166] For example, the impact of the first operation on the KPI associated with the intent target can refer to the impact of the first operation on the KPI associated with the intent target in the network KPI. The impact of the first operation on the KPI associated with the intent target can be positive or negative. For example, assuming that the KPI associated with the intent target is rate, the first operation includes operation 1 and operation 2, operation 1 can increase the rate by 3%, and operation 2 can increase the rate by 5%. For example, assuming that the KPI associated with the intent target is rate, the first operation includes operation 1 and operation 2, operation 1 can increase the rate by 3%, and operation 2 can decrease the rate by 5%. The impact of the first operation on the network KPI can also be positive or negative. For example, assuming that the network KPI includes rate and latency, the first operation includes operation 1 and operation 2, operation 1 can increase the rate by 1% and decrease the latency by 1%, and operation 2 can increase the rate by 5% and decrease the latency by 1%. For example, assuming that the network KPI includes rate and latency, the first operation includes operation 1 and operation 2, operation 1 can increase the rate by 1% and decrease the latency by 1%, and operation 2 can decrease the rate by 5% and increase the latency by 5%.

[0167] For example, the first information further comprises one or more of the following: network performance data information, time information of the taking effect of the first operation, and information of other intent targets other than the intent target. The network performance data information refers to information characterizing network performance, such as latency, throughput rate, speed, PRB utilization, jitter, RRC establishment success rate, QoS flow (Flow) establishment success rate, call establishment success rate, radio call drop rate, same frequency handover success rate, different frequency handover success rate, CPU utilization, cell availability, wireless network availability, data service uplink traffic, data service downlink traffic, average user number, maximum user number, uplink interference noise, PSCell replacement success rate, PDU total packet number, PDU total data amount, coverage curve, RSRP average value, SINR average value, base station energy efficiency value, base station energy efficiency level, and the like. When the third network element can refer to multiple network elements, for example, the third network element refers to 3 network elements, namely network element 1, network element 2 and network element 3, wherein the operation impact information, the first KPI impact information, and the time information of the taking effect of the first operation can come from network element 1, the network performance data information can come from network element 2, and the information of other intent targets other than the intent target can come from network element 3.

[0168] The network performance data information can be determined by the third network element according to the first operation, or according to the context information of the intent target. The context information of the intent target can be determined by the first network element according to the identifier of the intent target, and then the first network element sends the context information of the intent target to the third network element. After receiving the network performance data information, the first network element can monitor the pre-evaluation process according to the network performance data information. For example, assuming that the first network element also receives a pre-evaluation termination condition from the second network element, i.e., the pre-evaluation process is stopped when the system resource occupied by the pre-evaluation process is more than 70%, and the network performance data information is that the system resource occupied by the pre-evaluation process is 80, then the first network element stops the pre-evaluation. The time information of the taking effect of the first operation can refer to the duration of the taking effect of the first operation, or refer to the start time and end time of the taking effect of the first operation. The information of other intent targets other than the intent target can be used for checking intent conflicts between the intent target and other intent targets.

[0169] Step S705: The first network element determines the result information corresponding to the pre-evaluation type according to the first information.

[0170] For example, the result information includes: pre-evaluation information of an intended result or pre-evaluation information of an influence on a KPI. The pre-evaluation information of an intended result can mean whether the intention can be achieved. When the pre-evaluation type is the pre-evaluation information of an intended result, the first network element can determine the result information according to the operation influence information, and the result information includes the pre-evaluation information of an intended result. For example, assuming that the pre-evaluation type is the pre-evaluation information of an intended result, the first operation includes operation 1 and operation 2, the operation influence information is indication information for indicating that operation 1 and operation 2 are mutually exclusive, and the first network element determines the result information as the intention cannot be achieved according to the operation influence information.

[0171] When the pre-evaluation type is the pre-evaluation information of an influence on a network KPI, the first network element can determine the result information according to the first KPI influence information, and the result information includes the pre-evaluation information of an influence on a KPI. For example, assuming that the pre-evaluation type is the pre-evaluation information of an influence on a network KPI, the first KPI influence information indicates an influence of the first operation on a KPI associated with an intention target, the first operation includes operation 1 and operation 2, the intention target is a rate increase of 10%, and the first KPI influence information can mean that operation 1 can increase the rate by 3% and operation 2 can increase the rate by 5%. The first network element determines the result information according to the first KPI influence information, and the result information includes the pre-evaluation information of an influence on a KPI, i.e., operation 1 can increase the rate by 3% and operation 2 can increase the rate by 5%. For example, assuming that the pre-evaluation type is the pre-evaluation information of an influence on a network KPI, the first KPI influence information indicates an influence of the first operation on a network KPI, the first operation includes operation 1, and the network KPI includes a rate and a throughput rate. The first KPI influence information can mean that operation 1 can increase the rate by 3% and the throughput rate by 2%. The first network element determines the result information according to the first KPI influence information, and the result information includes the pre-evaluation information of an influence on a KPI, i.e., operation 1 can increase the rate by 3% and the throughput rate by 2%.

[0172] For example, if the result information includes the pre-evaluation information of an intended result, the result information further includes one or more of: a confidence level of the result information, a time length required for the intention target to be achieved, and a reason why the intention target is not achieved. The confidence level of the result information can also mean a degree of credibility of the result information, i.e., a probability that the result information is accurate. For example, a confidence level of 90% means that there is a 90% chance that the result information is accurate.

[0173] For example, if the result information includes the pre-evaluation information of an influence on a KPI, the result information further includes one or more of: a confidence level of the result information, a list of KPIs corresponding to the pre-evaluation information of an influence on a KPI, and a confidence level of the pre-evaluation information of an influence on a KPI.

[0174] Step S706: The first network element sends the result information to the second network element.

[0175] Step S707: The second network element receives the result information from the first network element.

[0176] In Figure 7 In the method, the intention target and the pre-evaluation type are sent by the second network element to the first network element, and correspondingly, the first network element determines the result information corresponding to the pre-evaluation type according to the first information, and sends the result information to the second network element, the result information including pre-evaluation information of an intention achievement result and pre-evaluation information of an influence of KPI, which can realize knowing whether the intention can be completed or knowing the influence on the network after the intention is implemented without modifying the network state, and is beneficial for the second network element to take it as a reference and improve the intention execution efficiency.

[0177] Please refer to Figure 8 , Figure 8 The method provided by the embodiment of the present application is an intention pre-evaluation method, which includes but is not limited to the following steps:

[0178] Step S801: The second network element sends pre-evaluation information of an influence of network KPI to the first network element.

[0179] Step S802: The first network element receives the pre-evaluation information of the influence of the network KPI from the second network element.

[0180] The pre-evaluation information of the influence of the network KPI can be a target name (targetName), such as a delay, a rate, and a throughput rate, but does not include a target value (targetValue) corresponding to the target name. For example, the pre-evaluation information of the influence of the network KPI can be a throughput rate, and the targetName thereof is “Object”. For example, the pre-evaluation information of the influence of the network KPI can be a delay, and the targetName thereof is “Latency”.

[0181] For example, the network KPI includes one or more of the following: a delay, a throughput rate, a rate, a PRB utilization rate, a jitter, an RRC establishment success rate, a QoS Flow establishment success rate, a call establishment success rate, a wireless call drop rate, a same-frequency handover success rate, a different-frequency handover success rate, a CPU utilization rate, a cell availability rate, a wireless network availability rate, a data service uplink traffic, a data service downlink traffic, an average user number, a maximum user number, an uplink interference noise, a PSCell replacement success rate, a total PDU packet number, a total PDU data amount, a coverage curve, an RSRP average value, an SINR average value, a base station energy efficiency value, and a base station energy efficiency level.

[0182] For example, the first network element further receives one or more of the following from the second network element: a pre-evaluation constraint condition, a pre-evaluation termination condition, and a pre-evaluation maximum time length; the pre-evaluation constraint condition is used to indicate a constraint on performing a process of determining an evaluation value corresponding to the pre-evaluation information according to the first information, the pre-evaluation termination condition is used to determine whether the process of determining the evaluation value corresponding to the pre-evaluation information according to the first information continues or terminates, and the pre-evaluation maximum time length is used to determine whether the process of determining the evaluation value corresponding to the pre-evaluation information according to the first information continues or terminates. For example, assuming that the pre-evaluation information of the influence of the network KPI sent by the second network element is a throughput rate, the targetName of which is "Object", and the second network element hopes to return a throughput rate action area such as "Jinqiao", wherein the pre-evaluation constraint condition can be "Object is a main device in {Zhangjiang, Jinqiao, Lujiazui} where the throughput rate is increased by 10% and the change is the least, which can make the throughput rate of Pudong be increased by 5%", and accordingly, the first network element is limited by the pre-evaluation constraint condition when performing the process of determining the evaluation value corresponding to the pre-evaluation information according to the first information, and the evaluation value is one of "Zhangjiang, Jinqiao, and Lujiazui". For example, the first network element further receives a pre-evaluation termination condition from the second network element, which is that the pre-evaluation process occupies more than 70% of system resources, and the pre-evaluation is stopped. For example, the first network element further receives a pre-evaluation maximum time length from the second network element, which is that the pre-evaluation process consumes more than 10 minutes, and the pre-evaluation is stopped. The above pre-evaluation process can be understood as a process of determining the evaluation value corresponding to the pre-evaluation information according to the first information by the first network element.

[0183] Step S803: The third network element sends the first information to the first network element.

[0184] Step S804: The first network element receives the first information from the third network element.

[0185] For example, the first information includes one or more of the following: operation influence information or second KPI influence information, the operation influence information is used to indicate mutual exclusion information of a second operation, and the second KPI influence information is used to indicate an influence of the second operation on a network KPI. The second operation is an operation that influences the network KPI. The network KPI in the operation that influences the network KPI can be a network KPI corresponding to the pre-evaluation information of the influence of the network KPI. For example, assuming that the pre-evaluation information of the influence of the network KPI is a throughput rate, the second operation is an operation that influences the throughput rate.

[0186] For example, the mutual exclusion information of the second operation includes identification information of mutually exclusive operations, or indication information indicating whether to be mutually exclusive. That is, assuming that the second operation includes multiple operations, the identification information of mutually exclusive operations can be identification information of mutually exclusive operations in the multiple operations. For example, the second operation includes operation 1, operation 2 and operation 3, and the identification information is identification 1, identification 2 and identification 3, assuming that operation 1 and operation 3 are mutually exclusive, the identification information of mutually exclusive operations is identification 1 and identification 3.

[0187] For example, the impact of the second operation on the network KPI can also be a beneficial impact or a negative impact. For example, assuming that the network KPI includes a throughput rate, the second operation affecting the throughput rate includes operation 1 and operation 2, operation 1 can increase the throughput rate by 1%, and operation 2 can increase the throughput rate by 3%; for example, assuming that the network KPI includes a throughput rate, the second operation affecting the throughput rate includes operation 1 and operation 2, operation 1 can decrease the throughput rate by 1%, and operation 2 can decrease the throughput rate by 5%.

[0188] For example, the first information further includes one or more of: network performance data information, time of validity of the second operation, and information of intentions corresponding to other network KPIs in addition to the network KPI. When the third network element can refer to multiple network elements, for example, the third network element refers to 3 network elements, which are network element 1, network element 2 and network element 3, respectively, wherein the operation impact information, the second KPI impact information, and the time of validity of the second operation information can come from network element 1, the network performance data information can come from network element 2, and the information of intentions corresponding to other network KPIs in addition to the network KPI can come from network element 3.

[0189] Step S805: The first network element determines an evaluation value corresponding to the pre-evaluation information according to the first information.

[0190] For example, in addition to determining the evaluation value corresponding to the pre-evaluation information according to the first information, the first network element can also determine the confidence of the evaluation value. Wherein, the confidence of the evaluation value can also be understood as the credibility of the evaluation value.

[0191] For example, the first network element determines the pre-evaluation information according to the operation impact information and the second KPI impact information. For example, assuming that the network KPI includes a throughput rate, the second operation affecting the throughput rate includes operation 1 and operation 2, the operation impact information is that operation 1 and operation 2 are mutually exclusive, and the second KPI impact information can indicate that operation 1 can increase the throughput rate by 1%, and operation 2 can increase the throughput rate by 3%, since operation 2 increases the throughput rate by 3% which is greater than operation 1 increases the throughput rate by 1%, the first network element determines that the evaluation value corresponding to the pre-evaluation information is 3%.

[0192] For example, the first network element determines the evaluation value corresponding to the pre-evaluation information based on the impact information of the second KPI. For example, assuming that the network KPI includes throughput, and the second operation affecting throughput includes operation 1 and operation 2, the impact information of the second KPI could be that operation 1 can increase throughput by 1%, and operation 2 can increase throughput by 3%. Since the 3% increase in throughput caused by operation 2 is greater than the 1% increase in throughput caused by operation 1, the first network element determines the evaluation value corresponding to the pre-evaluation information to be 3%.

[0193] Step S806: The first network element sends the evaluation value to the second network element.

[0194] For example, in addition to sending the evaluation value to the second network element, the first network element can also send the confidence level corresponding to the evaluation value and pre-evaluation information on the impact on network KPIs.<object,3%,80%> Where, object refers to targetName of the pre-evaluation information on the impact of network KPI; 3% refers to the evaluation value corresponding to the pre-evaluation information; and 80% refers to the confidence level corresponding to the evaluation value.

[0195] Step S807: The second network element receives the evaluation value from the first network element.

[0196] exist Figure 8 In the described method, the second network element sends pre-assessment information about the impact of network KPIs to the first network element. Accordingly, the first network element determines the assessment value of the pre-assessment information based on the first information and sends the assessment value to the second network element. This enables feedback of the assessment value without modifying the network state, which is beneficial for the second network element to use as a reference and improve the efficiency of intent execution.

[0197] Figure 9 The system architecture applicable to the embodiments described may include: intent pre-evaluation and simulation module entities, knowledge management module entities, intent management module entities, intent translation module entities in the wIDN system, as well as auxiliary systems, BSS / OSS / APP / User, and their correspondence with the first network element, the second network element, and the third network element is as follows: the first network element is as follows Figure 3 The intent pre-evaluation and simulation module entity in the wIDN system shown is represented by the third network element as follows: Figure 3 The wIDN system shown includes the knowledge management module entity, intent management module entity, intent translation module entity, and auxiliary system. The second network element is the network element in BSS / OSS / APP / User.

[0198] Please see Figure 9 , Figure 9 This application provides an intent pre-evaluation method, which includes, but is not limited to, the following steps:

[0199] Step S901: The BSS / OSS / APP / User sends the intent target and the pre-evaluation type to the intent pre-evaluation and simulation module entity via the intent management module entity.

[0200] For example, the BSS / OSS / APP / User can also send one or more of the following to the intent pre-evaluation and simulation module entity via the intent management module entity: pre-evaluation termination condition, pre-evaluation maximum duration.

[0201] Step S902: The intent pre-evaluation and simulation module entity receives the intent target and the pre-evaluation type from the BSS / OSS / APP / User via the intent management module entity.

[0202] For example, the intent pre-evaluation and simulation module entity receives one or more of the following from the BSS / OSS / APP / User via the intent management module entity: pre-evaluation termination condition, pre-evaluation maximum duration.

[0203] For example, the intent target includes an identification (targetName) of the intent target and / or a target value (targetValue) of the intent target. The pre-evaluation type includes pre-evaluation information of an intent achievement result or pre-evaluation information of an influence on a network key performance indicator (KPI). The intent target and the pre-evaluation type can be carried in an intent creation message. For details, refer to step S702, which will not be described here.

[0204] Step S903: The intent management module entity sends indication information to the intent translation module entity.

[0205] For example, the indication information is used to instruct the intent translation module entity to send a first operation to the intent pre-evaluation and simulation module entity. For example, the intent management module entity sends the indication information to the intent translation module entity in addition to sending the intent target. Of course, the indication information and the intent target can be carried in a message.

[0206] Step S904: The intent translation module entity receives the indication information from the intent management module entity.

[0207] Step S905: The intent translation module entity sends the first operation to the intent pre-evaluation and simulation module entity.

[0208] For example, the first operation is determined by the intent translation module entity according to the intent target.

[0209] Step S906: The intent pre-evaluation and simulation module entity receives the first operation from the intent translation module entity.

[0210] Step S907: The intention pre-evaluation and simulation module entity sends a performance data request message to the auxiliary system.

[0211] The step is an optional step, and the performance data request message includes the first operation. The performance data request message can also be a measurement task request message.

[0212] Step S908: The auxiliary system receives the performance data request message from the intention pre-evaluation and simulation module entity.

[0213] The step is an optional step.

[0214] Step S909: The auxiliary system sends a performance data response message to the intention pre-evaluation and simulation module entity.

[0215] The step is an optional step. For example, the performance data response message includes network performance data information determined according to the first operation. The network performance data information is Figure 7 The network performance data information in the first information in the embodiment can be specifically referred to step S704, which will not be described here. The performance data response message can be a measurement task response message.

[0216] Step S910: The intention pre-evaluation and simulation module entity receives the performance data response message from the auxiliary system.

[0217] The step is an optional step. By sending the performance data request message to the auxiliary system by the intention pre-evaluation and simulation module entity, the auxiliary system sends the performance data response message to the intention pre-evaluation and simulation module entity according to the performance data request message, which can assist in judging the pre-evaluation termination condition and the pre-evaluation maximum time length, and can make the network KPI value more accurate.

[0218] Step S911: The intention pre-evaluation and simulation module entity sends an operation information request message to the knowledge management module entity.

[0219] Step S912: The knowledge management module entity receives the operation information request message from the intention pre-evaluation and simulation module entity.

[0220] For example, the operation information request message includes the identifier of the first operation.

[0221] Step S913: The knowledge management module entity sends an operation information response message to the intention pre-evaluation and simulation module entity.

[0222] Step S914: The intention pre-evaluation and simulation module entity receives the operation information response message from the knowledge management module entity.

[0223] For example, the operation information response message includes operation impact information or impact information of the first KPI. The operation impact information is used to indicate mutual exclusion information of the first operation, and the impact information of the first KPI is used to indicate an impact of the first operation on the KPI associated with the intent target or an impact on the network KPI. For example, the operation information response message can also include time information of validity of the first operation. The operation impact information, the impact information of the first KPI, and the time information of validity of the first operation are Figure 7 The operation impact information, the impact information of the first KPI, and the time information of validity of the first operation in the first information in the embodiment can be specifically referred to step S704, and will not be described here.

[0224] Step S915: The intent pre-evaluation and simulation module entity sends an other intent request message to the intent management module entity.

[0225] This step is an optional step.

[0226] Step S916: The intent management module entity receives the other intent request message from the intent pre-evaluation and simulation module entity.

[0227] This step is an optional step.

[0228] Step S917: The intent management module entity sends an other intent response message to the intent pre-evaluation and simulation module entity.

[0229] This step is an optional step.

[0230] Step S918: The intent pre-evaluation and simulation module entity receives the other intent response message from the intent management module entity.

[0231] This step is an optional step. For example, the other intent response message includes information of other intent targets in addition to the intent target. The information of other intent targets in addition to the intent target is Figure 7 The information of other intent targets in addition to the intent target in the first information in the embodiment can be specifically referred to step S704, and will not be described here.

[0232] By the intent pre-evaluation and simulation module entity sending an other intent request message to the intent management module entity, and the corresponding intent management module entity sending an other intent response message to the intent pre-evaluation and simulation module entity according to the other intent request message, the system performance can be improved by assisting the intent system to detect intent conflicts.

[0233] Step S919: The intent pre-evaluation and simulation module entity determines result information corresponding to a pre-evaluation type according to the first information.

[0234] For example, the first information includes one or more of the following: operation impact information or impact information of the first KPI. The first information further includes one or more of the following: network performance data information, time information of the taking effect of the first operation, and information of other intent targets other than the intent target. For details, reference can be made to step S705, which will not be repeated here.

[0235] Step S920: The intent pre-evaluation and simulation module entity sends the result information to the BSS / OSS / APP / User through the intent management module entity.

[0236] Step S921: The BSS / OSS / APP / User receives the result information from the intent pre-evaluation and simulation module entity through the intent management module entity.

[0237] Of course, Figure 9 The intent translation module entity and the intent pre-evaluation module entity can be integrated into one module entity, for example, an intent translation pre-evaluation module entity, which can simultaneously implement the functions implemented by the intent translation module entity and the intent pre-evaluation module entity, which will not be repeated here.

[0238] Figure 10 The system architecture to which the embodiments are applicable can include: an intent translation pre-evaluation module entity, a knowledge management module entity, an intent management module entity, and an auxiliary system, a BSS / OSS / APP / User in a wIDN system, and the corresponding relationship with the first network element, the second network element, and the third network element is: the first network element is the intent translation pre-evaluation module entity in the wIDN system, wherein the intent translation pre-evaluation module entity is a module entity in which the functions of the intent pre-evaluation and simulation module and the intent translation module are integrated together, the third network element is the knowledge management module entity, the intent management module entity, and the auxiliary system in the wIDN system as shown, and the second network element is the network element in the BSS / OSS / APP / User. Figure 3 The knowledge management module entity, the intent management module entity, and the auxiliary system in the wIDN system as shown, the second network element is the network element in the BSS / OSS / APP / User.

[0239] Step S1001: The BSS / OSS / APP / User creates an intent.

[0240] Step S1002: The BSS / OSS / APP / User sends the intent target and the pre-evaluation type to the intent translation pre-evaluation module entity through the intent management module entity.

[0241] For example, the BSS / OSS / APP / User can also send one or more of the following to the intent translation pre-evaluation module entity through the intent management module entity: pre-evaluation termination condition, pre-evaluation maximum duration.

[0242] Step S1003: The intent translation pre-evaluation module entity receives the intent target and the pre-evaluation type from the BSS / OSS / APP / User through the intent management module entity.

[0243] For example, the intent translation pre-evaluation module entity can also receive one or more of the following from the BSS / OSS / APP / User through the intent management module entity: pre-evaluation termination condition, pre-evaluation maximum duration.

[0244] Step S1004: The intent translation pre-evaluation module entity sends a performance data request message to the auxiliary system.

[0245] The step is an optional step. The performance data request message includes the context information of the intent. The context information of the intent is determined by the intent translation pre-evaluation module entity according to the intent target. The context information of the intent includes the first operation. The performance data request message can be a measurement task request message.

[0246] Step S1005: The auxiliary system receives the performance data request message from the intent translation pre-evaluation module entity.

[0247] The step is an optional step.

[0248] Step S1006: The auxiliary system sends a performance data response message to the intent translation pre-evaluation module entity.

[0249] The step is an optional step. For example, the performance data response message includes network performance data information, which is determined according to the first operation. The network performance data information is Figure 7 The network performance data information in the first information in the embodiment, which can be referred to as step S704, will not be described here. The performance data response message can be a measurement task response message.

[0250] Step S1007: The intent translation pre-evaluation module entity receives the performance data response message from the auxiliary system.

[0251] The step is an optional step. By sending the performance data request message to the auxiliary system through the intent translation pre-evaluation module entity, the auxiliary system sends the performance data response message to the intent translation pre-evaluation module entity according to the performance data request message, which can assist in judging the pre-evaluation termination condition and the pre-evaluation maximum duration, and can make the network KPI value more accurate.

[0252] Step S1008: The intent translation pre-evaluation module entity sends an operation information request message to the knowledge management module entity.

[0253] Step S1009: The knowledge management module entity receives an operation information request message from the intent translation pre-evaluation module entity.

[0254] For example, the operation information request message includes an identification of the first operation.

[0255] Step S1010: The knowledge management module entity sends an operation information response message to the intent translation pre-evaluation module entity.

[0256] Step S1011: The intent translation pre-evaluation module entity receives the operation information response message from the knowledge management module entity.

[0257] For example, the operation information response message includes operation impact information or impact information of the first KPI. The operation impact information is used to indicate mutual exclusion information of the first operation, and the impact information of the first KPI is used to indicate an impact of the first operation on a KPI associated with the intent target or an impact on a network KPI. For example, the operation information response message can also include time information of validity of the first operation. The operation impact information, the impact information of the first KPI, and the time information of validity of the first operation are Figure 7 The operation impact information, the impact information of the first KPI, and the time information of validity of the first operation in the first information in the embodiment can be specifically referred to step S704, which will not be described here.

[0258] Step S1012: The intent translation pre-evaluation module entity sends an other intent request message to the intent management module entity.

[0259] This step is an optional step.

[0260] Step S1013: The intent management module entity receives the other intent request message from the intent translation pre-evaluation module entity.

[0261] This step is an optional step.

[0262] Step S1014: The intent management module entity sends an other intent response message to the intent translation pre-evaluation module entity.

[0263] This step is an optional step.

[0264] Step S1015: The intent translation pre-evaluation module entity receives the other intent response message from the intent management module entity.

[0265] This step is an optional step. For example, the other intent response message includes information of other intent targets in addition to the intent target. The information of other intent targets in addition to the intent target is Figure 7The information of other intent targets in the first information in the embodiment, in addition to the intent target, can be specifically referred to step S704, and will not be repeated here.

[0266] The other intent request message sent by the intent translation pre-evaluation module entity to the intent management module entity, and the corresponding manner in which the intent management module entity sends the other intent response message to the intent translation pre-evaluation module entity according to the other intent request message, can assist the intent system in detecting intent conflicts and improve system performance.

[0267] Step S1016: The intent translation pre-evaluation module entity determines the result information corresponding to the pre-evaluation type according to the first information.

[0268] For example, the first information includes one or more of the following: operation impact information or first KPI impact information. The first information also includes one or more of the following: network performance data information, time information of the validity of the first operation, and information of other intent targets in addition to the intent target. Details can be referred to step S705, and will not be repeated here.

[0269] Step S1017: The intent translation pre-evaluation module entity sends the result information to the BSS / OSS / APP / User through the intent management module entity.

[0270] Step S1018: The BSS / OSS / APP / User receives the result information from the intent translation pre-evaluation module entity through the intent management module entity.

[0271] Of course, Figure 10 The intent translation pre-evaluation module entity can also be divided into an intent translation module entity and an intent pre-evaluation module entity, which will not be repeated here.

[0272] Figure 11 The system architecture applicable to the embodiments can include: an intent pre-evaluation and simulation module entity, a knowledge management module entity, an intent management module entity, an intent translation module entity, and an auxiliary system, BSS / OSS / APP / User in the wIDN system, and the corresponding relationship between the first network element, the second network element, and the third network element is as follows: the first network element is the intent pre-evaluation and simulation module entity in the wIDN system as shown in Figure 3 The third network element is the knowledge management module entity, the intent management module entity, the intent translation module entity, and the auxiliary system in the wIDN system as shown in Figure 3 The second network element is the network element in the BSS / OSS / APP / User.

[0273] Step S1101: The BSS / OSS / APP / User sends the pre-evaluation information of the influence of the network KPI to the intent pre-evaluation and simulation module entity through the intent management module entity.

[0274] For example, the BSS / OSS / APP / User can also send one or more of the following to the intent pre-evaluation and simulation module entity through the intent management module entity: pre-evaluation constraint condition, pre-evaluation termination condition, pre-evaluation maximum duration.

[0275] Step S1102: The intent pre-evaluation and simulation module entity receives the pre-evaluation information of the influence of the network KPI from the BSS / OSS / APP / User through the intent management module entity.

[0276] For example, the intent pre-evaluation and simulation module entity receives one or more of the following from the BSS / OSS / APP / User through the intent management module entity: pre-evaluation constraint condition, pre-evaluation termination condition, pre-evaluation maximum duration. For details, refer to step S802, which will not be described here.

[0277] Step S1103: The intent translation module entity performs intent translation.

[0278] For example, before performing intent translation, the intent translation module entity can receive indication information from the intent management module entity, which can include pre-evaluation information of the influence of the network KPI. The intent translation module entity performing intent translation can mean that the intent translation module entity determines a second operation according to the pre-evaluation information of the influence of the network KPI, wherein the second operation is an operation that affects the network KPI.

[0279] Step S1104: The intent translation module entity performs lexical syntax analysis.

[0280] Step S1105: The intent translation module entity sends the second operation to the intent pre-evaluation and simulation module entity.

[0281] For example, the identification information of the second operation is sent.

[0282] Step S1106: The intent pre-evaluation and simulation module entity receives the second operation from the intent translation module entity.

[0283] Step S1107: The intent pre-evaluation and simulation module entity sends a performance data request message to the auxiliary system.

[0284] This step is an optional step, and the performance data request message includes the second operation. The performance data request message can be a measurement task request message.

[0285] Step S1108: The assistance system receives a performance data request message from the intent pre-evaluation and simulation module entity.

[0286] This step is an optional step.

[0287] Step S1109: The assistance system sends a performance data response message to the intent pre-evaluation and simulation module entity.

[0288] This step is an optional step. For example, the performance data response message includes network performance data information determined according to the second operation. The network performance data message is Figure 8 The network performance data information in the first information in the embodiment can be specifically referred to step S804, and will not be described here again. The performance data response message can be a measurement task response message.

[0289] Step S1110: The intent pre-evaluation and simulation module entity receives the performance data response message from the assistance system.

[0290] This step is an optional step. By sending the performance data request message from the intent pre-evaluation and simulation module entity to the assistance system, the assistance system sends the performance data response message to the intent pre-evaluation and simulation module entity according to the performance data request message, which can assist in judging the pre-evaluation termination condition and the pre-evaluation maximum time length, and can make the network KPI value more accurate.

[0291] Step S1111: The intent pre-evaluation and simulation module entity sends an operation information request message to the knowledge management module entity.

[0292] Step S1112: The knowledge management module entity receives the operation information request message from the intent pre-evaluation and simulation module entity.

[0293] For example, the operation information request message includes an identifier of the second operation.

[0294] Step S1113: The knowledge management module entity sends an operation information response message to the intent pre-evaluation and simulation module entity.

[0295] Step S1114: The intent pre-evaluation and simulation module entity receives the operation information response message from the knowledge management module entity.

[0296] For example, the operation information response message includes operation impact information or second KPI impact information. The operation impact information is used to indicate mutual exclusion information of the second operation, and the second KPI impact information is used to indicate an impact of the second operation on the network KPI. For example, the operation information response message can also include time information of validity of the second operation. The operation impact information, the second KPI impact information, and the time information of validity of the second operation areFigure 8 The operation impact information in the first information in the embodiment, the impact information of the second KPI, and the time information of the taking effect of the second operation can be specifically referred to step S804, and will not be described here again.

[0297] Step S1115: The intent pre-evaluation and simulation module entity sends an other intent request message to the intent management module entity.

[0298] This step is an optional step.

[0299] Step S1116: The intent management module entity receives the other intent request message from the intent pre-evaluation and simulation module entity.

[0300] This step is an optional step.

[0301] Step S1117: The intent management module entity sends an other intent response message to the intent pre-evaluation and simulation module entity.

[0302] This step is an optional step.

[0303] Step S1118: The intent pre-evaluation and simulation module entity receives the other intent response message from the intent management module entity.

[0304] This step is an optional step. For example, the other intent response message includes information of an intent corresponding to another network KPI in addition to the network KPI. The information of the intent corresponding to the another network KPI in addition to the network KPI is Figure 8 The information of the intent corresponding to another network KPI in addition to the network KPI in the first information in the embodiment can be specifically referred to step S804, and will not be described here again.

[0305] By the intent pre-evaluation and simulation module entity sending the other intent request message to the intent management module entity, and the corresponding intent management module entity sending the other intent response message to the intent pre-evaluation and simulation module entity according to the other intent request message, the system performance can be improved by assisting the intent system in detecting intent conflicts.

[0306] Step S1119: The intent pre-evaluation and simulation module entity determines an evaluation value corresponding to the pre-evaluation information according to the first information.

[0307] For example, the first information includes one or more of the following: operation impact information or impact information of the second KPI. The first information also includes one or more of the following: network performance data information, time information of the taking effect of the second operation, and information of an intent corresponding to another network KPI in addition to the network KPI. Details can be referred to step S805, and will not be described here again.

[0308] Step S1120: The intention pre-evaluation and simulation module entity sends the evaluation value to the BSS / OSS / APP / User through the intention management module entity.

[0309] The evaluation value can be carried in the intention creation completion message.

[0310] Step S1121: The BSS / OSS / APP / User receives the evaluation value from the intention pre-evaluation and simulation module entity through the intention management module entity.

[0311] Of course, Figure 11 The intention translation module entity and the intention pre-evaluation module entity can be integrated into one module entity, for example, an intention translation pre-evaluation module entity, which can simultaneously implement the functions of the intention translation module entity and the intention pre-evaluation module entity. Details are not repeated here.

[0312] The above describes the method of the embodiments of the present application in detail. The device of the embodiments of the present application is provided below.

[0313] Please refer to Figure 12 , Figure 12 FIG. 12 is a structural diagram of an intention pre-evaluation device 1200 provided by the embodiments of the present application. The device 1200 can include a communication unit 1201 and a processing unit 1202. The details of each unit are described as follows.

[0314] The communication unit 1201 is configured to receive an intention target and a pre-evaluation type from a second network element. The pre-evaluation type includes pre-evaluation information of an intention achievement result or pre-evaluation information of an influence on a network key performance indicator (KPI). The intention target includes a first operation.

[0315] The communication unit 1201 is configured to receive first information from a third network element. The first information includes one or more of the following: operation influence information or first KPI influence information. The operation influence information is used to indicate mutual exclusion information of the first operation, and the first KPI influence information is used to indicate an influence of the first operation on a KPI associated with the intention target or an influence on the network KPI.

[0316] The processing unit 1202 is configured to determine result information corresponding to the pre-evaluation type according to the first information. The result information includes pre-evaluation information of an intention achievement result or pre-evaluation information of an influence on a KPI.

[0317] The communication unit 1201 is configured to send the result information to the second network element.

[0318] In a possible implementation, the intention target includes an identifier of the intention target and / or a target value of the intention target.

[0319] In a further possible implementation, the communication unit 1201 is further configured to receive, from the second network element, one or more of the following: a pre-evaluation termination condition, a pre-evaluation maximum duration, the pre-evaluation termination condition being used to determine whether the process of determining the result information corresponding to the pre-evaluation type according to the first information is to be continued or terminated; the pre-evaluation maximum duration being used to determine whether the process of determining the result information corresponding to the pre-evaluation type according to the first information is to be continued or terminated.

[0320] In a further possible implementation, if the result information comprises pre-evaluation information of an intended-to-achieve result, the result information further comprises one or more of the following: a confidence level of the result information, a time duration required for the intended-to-achieve result, a reason for the intended-to-achieve result not being achieved.

[0321] In a further possible implementation, if the result information comprises pre-evaluation information of an influence on the KPI, the result information further comprises one or more of the following: a confidence level of the result information, a list of KPIs corresponding to the pre-evaluation information of the influence on the KPI, a confidence level of the pre-evaluation information of the influence on the KPI.

[0322] In a further possible implementation, the first information further comprises one or more of the following: network performance data information, time information of validity of the first operation, and information of other intended-to-achieve targets other than the intended-to-achieve target.

[0323] In a further possible implementation, the network KPI comprises one or more of the following: latency, throughput rate, speed, physical resource block (PRB) utilization, jitter, radio resource control (RRC) setup success rate, quality of service (QoS) flow setup success rate, call setup success rate, radio dropped call rate, intra-frequency handover success rate, inter-frequency handover success rate, central processing unit (CPU) utilization, cell availability, radio network availability, data service uplink traffic, data service downlink traffic, average number of users, maximum number of users, uplink interference noise, secondary primary secondary cell (PSCell) change success rate, total number of protocol data unit (PDU) packets, total amount of PDU data, coverage curve, reference signal received power (RSRP) average value, signal-to-interference noise ratio (SINR) average value, base station energy efficiency value, base station energy efficiency level.

[0324] In a further possible implementation, the mutual exclusion information comprises identification information of the mutually exclusive operation, or indication information indicating whether the operation is mutually exclusive.

[0325] It should be noted that the implementation and advantages of each unit can also be correspondingly described with reference to the method embodiments shown in Figure 7 、 Figure 9 、 Figure 10 .

[0326] Please refer toFigure 12 , Figure 12 is a structural schematic diagram of an intent pre-evaluation device 1200 provided by an embodiment of the present application. The device 1200 can include a communication unit 1201 and a processing unit 1202, and detailed descriptions of each unit are as follows.

[0327] The communication unit 1201 is configured to receive pre-evaluation information of an influence of a network key performance indicator (KPI) from a second network element.

[0328] The communication unit 1201 is configured to receive first information from a third network element, the first information including one or more of the following: operation influence information or second KPI influence information, the operation influence information being used to indicate mutual exclusion information of a second operation, and the second KPI influence information being used to indicate an influence of the second operation on a network KPI, the second operation being an operation that influences the network KPI.

[0329] The processing unit 1202 is configured to determine an evaluation value corresponding to the pre-evaluation information according to the first information.

[0330] The communication unit 1201 is configured to send the evaluation value to the second network element.

[0331] In a possible implementation, the communication unit 1201 is further configured to receive one or more of the following from the second network element: a pre-evaluation constraint condition, a pre-evaluation termination condition, and a pre-evaluation maximum time length, the pre-evaluation constraint condition being used to indicate a constraint on a process of determining the evaluation value corresponding to the pre-evaluation information according to the first information, the pre-evaluation termination condition being used to determine whether the process of determining the evaluation value corresponding to the pre-evaluation information according to the first information continues or terminates, and the pre-evaluation maximum time length being used to determine whether the process of determining the evaluation value corresponding to the pre-evaluation information according to the first information continues or terminates.

[0332] In another possible implementation, the communication unit 1201 is configured to determine the evaluation value corresponding to the pre-evaluation information according to the first information and a confidence degree of the evaluation value.

[0333] In another possible implementation, the first information further includes one or more of the following: network performance data information, a time at which the second operation takes effect, and information of an intent corresponding to another network KPI in addition to the network KPI.

[0334] In yet another possible implementation, the network KPIs include one or more of the following: latency, throughput rate, speed, physical resource block (PRB) utilization, jitter, radio resource control (RRC) setup success rate, quality of service flow (QoS Flow) setup success rate, call setup success rate, radio call drop rate, intra-frequency handover success rate, inter-frequency handover success rate, central processing unit (CPU) utilization, cell availability, radio network availability, data service uplink traffic, data service downlink traffic, average user number, maximum user number, uplink interference noise, PSCell change success rate, protocol data unit (PDU) total packet number, PDU total data amount, coverage curve, reference signal received power (RSRP) average value, signal-to-interference-and-noise ratio (SINR) average value, base station energy efficiency value, and base station energy efficiency level.

[0335] In yet another possible implementation, the mutual exclusion information includes operation identification information of mutual exclusion, or indication information indicating whether mutual exclusion.

[0336] It should be noted that the implementation and advantages of each unit can also be described in correspondence with the description of the method embodiments shown in Figure 8 、 Figure 11

[0337] Please refer to Figure 13 、 Figure 13 An intent pre-evaluation device 1300 is provided in the embodiments of the present application, and the device 1300 includes at least one processor 1301 and a communication interface 1303, and optionally further includes a memory 1302. The processor 1301, the memory 1302 and the communication interface 1303 are connected to each other through a bus 1304.

[0338] The memory 1302 includes, but is not limited to, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read only memory (EPROM), or a compact disc read-only memory (CD-ROM). The memory 1302 is used for storing relevant computer programs and data. The communication interface 1303 is used for receiving and sending data.

[0339] The processor 1301 can be one or more central processing units (CPUs). In the case where the processor 1301 is a CPU, the CPU can be a single-core CPU or a multi-core CPU.

[0340] ​The processor 1301 in the apparatus 1300 is configured to read the computer program codes stored in the memory 1302, and perform the following operations:

[0341] receive, by the communication interface 1303, an intention target and a pre-evaluation type from a second network element, the pre-evaluation type including pre-evaluation information of an intention achievement result or pre-evaluation information of an influence on a network key performance indicator (KPI), the intention target including a first operation;

[0342] receive, by the communication interface 1303, first information from a third network element, the first information including one or more of operation influence information or first KPI influence information, the operation influence information being used to indicate mutual exclusion information of the first operation, the first KPI influence information being used to indicate an influence of the first operation on a KPI associated with the intention target or an influence of the first operation on the network KPI;

[0343] determine, according to the first information, result information corresponding to the pre-evaluation type, the result information including pre-evaluation information of an intention achievement result or pre-evaluation information of an influence on a KPI;

[0344] send, by the communication interface 1303, the result information to the second network element.

[0345] In a possible implementation, the intention target includes an identifier of the intention target and / or a target value of the intention target.

[0346] In another possible implementation, the at least one processor 1301 is further configured to receive, by the communication interface 1303, from the second network element, one or more of a pre-evaluation termination condition or a pre-evaluation maximum duration, the pre-evaluation termination condition being used to determine whether a process of determining, by the apparatus, the result information corresponding to the pre-evaluation type according to the first information continues or terminates, and the pre-evaluation maximum duration being used to determine whether the process of determining, by the apparatus, the result information corresponding to the pre-evaluation type according to the first information continues or terminates.

[0347] In another possible implementation, if the result information includes the pre-evaluation information of the intention achievement result, the result information further includes one or more of a confidence degree of the result information, a time duration required for achieving the intention target, or a reason for not achieving the intention target.

[0348] In another possible implementation, if the result information includes the pre-evaluation information of the influence on the KPI, the result information further includes one or more of a confidence degree of the result information, a list of KPIs corresponding to the pre-evaluation information of the influence on the KPI, or a confidence degree of the pre-evaluation information of the influence on the KPI.

[0349] In a further possible implementation, the first information further comprises one or more of: network performance data information, time information of taking effect of the first operation, and information of other intention targets other than the intention target.

[0350] In a further possible implementation, the network KPIs comprise one or more of: latency, throughput rate, speed, physical resource block (PRB) utilization, jitter, radio resource control (RRC) setup success rate, quality of service (QoS) flow setup success rate, call setup success rate, radio drop rate, intra-frequency handover success rate, inter-frequency handover success rate, central processing unit (CPU) utilization, cell availability, radio network availability, data service uplink traffic, data service downlink traffic, average user number, maximum user number, uplink interference noise, primary secondary cell (PSCell) change success rate, protocol data unit (PDU) total packet number, PDU total data amount, coverage curve, reference signal received power (RSRP) average value, signal-to-interference-and-noise ratio (SINR) average value, base station energy efficiency value, and base station energy efficiency level.

[0351] In a further possible implementation, the mutual exclusion information comprises identification information of the mutually exclusive operations, or indication information indicating whether the operations are mutually exclusive.

[0352] It should be noted that the implementation and advantages of each operation can also be described with reference to the corresponding description of the method embodiments shown in Figure 7 、 Figure 9 、 Figure 10 .

[0353] Please refer to Figure 13 , Figure 13 is an intention pre-evaluation device 1300 provided by an embodiment of the present application, the device 1300 comprises at least one processor 1301 and a communication interface 1303, and optionally further comprises a memory 1302, the processor 1301, the memory 1302 and the communication interface 1303 are connected with each other through a bus 1304.

[0354] The memory 1302 comprises, but is not limited to, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read only memory (EPROM), or a compact disc read-only memory (CD-ROM), which is used for relevant computer programs and data. The communication interface 1303 is used for receiving and sending data.

[0355] The processor 1301 can be one or more central processing units (CPUs), which can be single core processors or multi core processors in the case of the processor 1301 being a CPU.

[0356] The processor 1301 in the apparatus 1300 is configured to read computer program codes stored in the memory 1302 and perform the following operations:

[0357] receive, through the communication interface 1303, pre-evaluation information of an influence of a network key performance indicator (KPI) from a second network element;

[0358] receive, through the communication interface 1303, first information from a third network element, the first information including one or more of the following: operation influence information or second KPI influence information, the operation influence information being used to indicate mutual exclusion information of a second operation, the second KPI influence information being used to indicate an influence of the second operation on the network KPI, the second operation being an operation that influences the network KPI;

[0359] determine an evaluation value corresponding to the pre-evaluation information according to the first information;

[0360] send, through the communication interface 1303, the evaluation value to the second network element.

[0361] In a possible implementation, the at least one processor 1301 is further configured to receive, through the communication interface 1303, from the second network element, one or more of the following: a pre-evaluation constraint condition, a pre-evaluation termination condition, and a pre-evaluation maximum time length, the pre-evaluation constraint condition being used to indicate a constraint on performing the process of determining the evaluation value corresponding to the pre-evaluation information according to the first information, the pre-evaluation termination condition being used to determine whether to continue or terminate the process of determining the evaluation value corresponding to the pre-evaluation information according to the first information, and the pre-evaluation maximum time length being used to determine whether to continue or terminate the process of determining the evaluation value corresponding to the pre-evaluation information according to the first information.

[0362] In yet another possible implementation, the at least one processor 1301 is further configured to determine a confidence degree of the evaluation value according to the first information.

[0363] In yet another possible implementation, the first information further includes one or more of the following: network performance data information, a time at which the second operation takes effect, and information of an intention corresponding to another network KPI in addition to the network KPI.

[0364] In a further possible implementation, the network KPIs include one or more of: latency, throughput rate, speed, physical resource block (PRB) utilization, jitter, radio resource control (RRC) setup success rate, quality of service flow (QoS Flow) setup success rate, call setup success rate, radio drop rate, intra-frequency handover success rate, inter-frequency handover success rate, central processing unit (CPU) utilization, cell availability, radio network availability, data service uplink traffic, data service downlink traffic, average user number, maximum user number, uplink interference noise, PSCell change success rate, protocol data unit (PDU) total packet number, PDU total data amount, coverage curve, reference signal received power (RSRP) average value, signal-to-interference-and-noise ratio (SINR) average value, base station energy efficiency value, and base station energy efficiency level.

[0365] In a further possible implementation, the mutual exclusion information includes mutual exclusion operation identification information or indication information indicating whether mutual exclusion.

[0366] It should be noted that the implementation and advantages of each operation can also be described with reference to the corresponding description of the method embodiments shown in Figure 8 、 Figure 11

[0367] The method steps in the embodiments of the present application can be implemented by means of hardware, or by means of a processor executing software instructions. The software instructions can be composed of corresponding software modules, and the software modules can be stored in a random access memory, a flash memory, a read-only memory, a programmable read-only memory, an erasable programmable read-only memory, an electrically erasable programmable read-only memory, a register, a hard disk, a mobile hard disk, a CD-ROM, or any other form of storage medium well known in the art. An exemplary storage medium is coupled to a processor, so that the processor can read information from, and write information to, the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an ASIC. In addition, the ASIC can be located in a network device or a terminal device. Of course, the processor and the storage medium can also exist as discrete components in the network device or the terminal device.

[0368] ​In the above embodiments, all or part of the embodiments can be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer programs or instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments are performed. The computer can be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user equipment or other programmable apparatus. The computer programs or instructions can be stored in a computer-readable storage medium or transferred from one computer-readable storage medium to another computer-readable storage medium, for example, the computer programs or instructions can be transferred from one website, computer, server or data center to another website, computer, server or data center through a wired or wireless manner. The computer-readable storage medium can be any available medium accessible by a computer or a data storage device such as a server, data center and the like integrated with one or more available media. The available media can be a magnetic medium, for example, a floppy disk, a hard disk, a magnetic tape; an optical medium, for example, a digital video disc; and a semiconductor medium, for example, a solid state disk.

[0369] In various embodiments of the present application, the terms and / or descriptions of different embodiments are consistent and can be referred to each other if there is no special description and logical conflict, and the technical features in different embodiments can be combined to form new embodiments according to their inherent logical relationship.

[0370] In the present application, "at least one" means one or more, and "multiple" means two or more. The "and / or" describes the association relationship between the associated objects, which means that there can be three relationships, for example, A and / or B, which can represent the following three cases: A exists alone, A and B exist together, and B exists alone, where A and B can be singular or plural. In the textual description of the present application, the character " / ", generally represents that the front and rear associated objects have an "or" relationship; in the formula of the present application, the character " / ", represents that the front and rear associated objects have a "division" relationship.

[0371] It can be understood that various numbers involved in the embodiments of the present application are only distinguished for convenience of description, and are not used to limit the scope of the embodiments of the present application. The size of the serial number of the above processes does not mean the execution order, and the execution order of the processes should be determined according to its function and inherent logic.

Claims

1. An intent pre-evaluation method, characterized by, The method comprises: a first network element receiving an intention target and a pre-evaluation type from a second network element, the pre-evaluation type comprising pre-evaluation information of an intention achievement result or pre-evaluation information of an influence on a network key performance indicator (KPI), and the intention target comprising a first operation; the first network element receiving first information from a third network element, the first information being generated without modifying a network state, and the first information comprising one or more of operation influence information or first KPI influence information, the operation influence information being used to indicate mutual exclusion information of the first operation, and the first KPI influence information being used to indicate an influence of the first operation on a KPI associated with the intention target or an influence of the first operation on the network KPI; the first network element determining result information corresponding to the pre-evaluation type according to the first information, the result information comprising pre-evaluation information of an intention achievement result or pre-evaluation information of an influence on a KPI; the first network element sending the result information to the second network element.

2. The method of claim 1, wherein, The intention target comprises an identifier of the intention target and / or a target value of the intention target.

3. The method according to claim 1 or 2, characterized in that, The first network element further receives one or more of a pre-evaluation termination condition or a pre-evaluation maximum duration from the second network element, the pre-evaluation termination condition being used to determine whether a process of the first network element for determining the result information corresponding to the pre-evaluation type according to the first information continues or terminates, and the pre-evaluation maximum duration being used to determine whether the process of the first network element for determining the result information corresponding to the pre-evaluation type according to the first information continues or terminates.

4. The method of claim 1, wherein, If the result information comprises the pre-evaluation information of the intention achievement result, the result information further comprises one or more of a confidence level of the result information, a time duration required for achieving the intention target, or a reason for not achieving the intention target.

5. The method of claim 1, wherein, If the result information comprises the pre-evaluation information of the influence on the KPI, the result information further comprises one or more of a confidence level of the result information, a list of KPIs corresponding to the pre-evaluation information of the influence on the KPI, or a confidence level of the pre-evaluation information of the influence on the KPI.

6. The method of claim 1, wherein, The first information further comprises one or more of: network performance data information, time information of validity of the first operation, and information of another intention target other than the intention target.

7. The method of claim 1, wherein, The network KPI comprises one or more of a latency, a throughput rate, a rate, a physical resource block (PRB) utilization rate, a jitter, a radio resource control (RRC) establishment success rate, a quality of service (QoS) flow establishment success rate, a call establishment success rate, a radio drop call rate, a same-frequency handover success rate, a different-frequency handover success rate, a central processing unit (CPU) utilization rate, a cell availability rate, a wireless network availability rate, an uplink data service traffic, a downlink data service traffic, an average number of users, a maximum number of users, an uplink interference noise, a primary secondary cell (PSCell) change success rate, a total number of protocol data unit (PDU) packets, a total amount of PDU data, a coverage curve, a reference signal received power (RSRP) average value, a signal-to-interference noise ratio (SINR) average value, a base station energy efficiency value, and a base station energy efficiency level.

8. The method of claim 1, wherein, The mutual exclusion information includes identification information of mutually exclusive operations, or indication information indicating whether they are mutually exclusive.

9. An intent pre-evaluation method, characterized by, include: The first network element receives pre-assessment information on the impact of the network's key performance indicators (KPIs) from the second network element; The first network element receives first information from the third network element. The first information is generated without modifying the network state. The first information includes one or more of the following: operation impact information or second KPI impact information. The operation impact information is used to indicate the mutual exclusion information of the second operation. The second KPI impact information is used to indicate the impact of the second operation on the network KPI. The second operation is an operation that affects the network KPI. The first network element determines the evaluation value corresponding to the pre-evaluation information based on the first information; The first network element sends the evaluation value to the second network element.

10. The method of claim 9, wherein, The first network element also receives one or more of the following from the second network element: pre-evaluation constraints, pre-evaluation termination conditions, and pre-evaluation maximum duration; the pre-evaluation constraints are used to indicate the constraints on the process of determining the evaluation value corresponding to the pre-evaluation information based on the first information; the pre-evaluation termination conditions are used to determine whether the process of determining the evaluation value corresponding to the pre-evaluation information based on the first information continues to execute or terminates; and the pre-evaluation maximum duration is used to determine whether the process of determining the evaluation value corresponding to the pre-evaluation information based on the first information continues to execute or terminates.

11. The method according to claim 9 or 10, characterized in that, The first network element determines the evaluation value corresponding to the pre-evaluation information based on the first information, including: The first network element determines the evaluation value corresponding to the pre-evaluation information and the confidence level of the evaluation value based on the first information.

12. The method of claim 9, wherein, The first information also includes one or more of the following: Network performance data, the effective time of the second operation, and information on the intent corresponding to other network KPIs besides the network KPIs mentioned above.

13. The method of claim 9, wherein, The network KPIs include one or more of the following: latency, throughput, rate, physical resource block (PRB) utilization, jitter, radio resource control (RRC) establishment success rate, quality of service flow (QoSFlow) establishment success rate, call establishment success rate, dropped call rate, intra-frequency handover success rate, inter-frequency handover success rate, central processing unit (CPU) utilization, cell availability, wireless network availability, uplink data traffic, downlink data traffic, average number of users, maximum number of users, uplink interference noise, auxiliary primary cell (PSCell) replacement success rate, total number of protocol data units (PDU) packets, total PDU data volume, coverage curve, average reference signal received power (RSRP), average signal-to-interference-plus-noise ratio (SINR), base station energy efficiency value, and base station energy efficiency level.

14. The method of claim 9, wherein, The mutual exclusion information includes mutually exclusive operation identifier information, or indication information indicating whether they are mutually exclusive.

15. An intent pre-evaluation device, characterized by include: Communication unit and processing unit The communication unit is configured to receive an intent target and a pre-evaluation type from a second network element. The pre-evaluation type includes pre-evaluation information on the outcome of the intent or pre-evaluation information on the impact of network key performance indicators (KPIs). The intent target includes a first operation. The communication unit is configured to receive first information from a third network element, the first information being generated without modifying a network state, and the first information including one or more of the following: operation impact information or first KPI impact information, the operation impact information being used to indicate mutual exclusion information of the first operation, and the first KPI impact information being used to indicate an impact of the first operation on a KPI associated with the intent target or an impact of the first operation on a network KPI. The processing unit is configured to determine, according to the first information, result information corresponding to the pre-evaluation type, the result information including one or more of the following: pre-evaluation information of an intent achievement result or pre-evaluation information of a KPI impact. The communication unit is configured to send the result information to the second network element.

16. The apparatus of claim 15, wherein, The intent target includes an identifier of the intent target and / or a target value of the intent target.

17. The apparatus of claim 15 or 16, wherein The communication unit is further configured to receive, from a second network element, one or more of the following: a pre-evaluation termination condition and a pre-evaluation maximum duration, the pre-evaluation termination condition being used to determine whether a process of determining, by the intent pre-evaluation apparatus, the result information corresponding to the pre-evaluation type according to the first information continues or terminates, and the pre-evaluation maximum duration being used to determine whether the process of determining, by the intent pre-evaluation apparatus, the result information corresponding to the pre-evaluation type according to the first information continues or terminates.

18. The apparatus of claim 15, wherein If the result information includes the pre-evaluation information of the intent achievement result, the result information further includes one or more of the following: a confidence level of the result information, a time duration required for achieving the intent target, and a reason for not achieving the intent target.

19. The apparatus of claim 15, wherein If the result information includes the pre-evaluation information of the KPI impact, the result information further includes one or more of the following: a confidence level of the result information, a list of KPIs corresponding to the pre-evaluation information of the KPI impact, and a confidence level of the pre-evaluation information of the KPI impact.

20. The apparatus of claim 15, wherein, The first information further includes one or more of the following: network performance data information, time information of validity of the first operation, and information of another intent target in addition to the intent target.

21. The apparatus of claim 15, wherein, The network KPIs include one or more of the following: latency, throughput rate, speed, physical resource block (PRB) utilization, jitter, radio resource control (RRC) setup success rate, quality of service flow (QoS Flow) setup success rate, call setup success rate, radio call drop rate, intra-frequency handover success rate, inter-frequency handover success rate, central processing unit (CPU) utilization, cell availability, radio network availability, data service uplink traffic, data service downlink traffic, average number of users, maximum number of users, uplink interference noise, PSCell change success rate, total number of protocol data unit (PDU) packets, total PDU data volume, coverage curve, reference signal received power (RSRP) average value, signal-to-interference noise ratio (SINR) average value, base station energy efficiency value, and base station energy efficiency level.

22. The apparatus of claim 15, wherein, The mutual exclusion information includes identification information of mutually exclusive operations or indication information indicating whether mutual exclusion.

23. An intent pre-evaluation device, characterized by The method comprises: a communication unit and a processing unit, the communication unit is configured to receive pre-evaluation information of an influence of a network key performance indicator (KPI) from a second network element, the communication unit is configured to receive first information from a third network element, the first information being generated without modifying a network state, and the first information including one or more of the following: operation influence information or second KPI influence information, the operation influence information being used to indicate mutual exclusion information of a second operation, and the second KPI influence information being used to indicate an influence of the second operation on the network KPI, the second operation being an operation that influences the network KPI; the communication unit is configured to determine an evaluation value corresponding to the pre-evaluation information according to the first information; the communication unit is configured to send the evaluation value to the second network element.

24. The apparatus of claim 23, wherein the communication unit is further configured to receive one or more of the following from the second network element: a pre-evaluation constraint condition, a pre-evaluation termination condition, and a pre-evaluation maximum time length, the pre-evaluation constraint condition being used to indicate a constraint on performing a process of determining the evaluation value corresponding to the pre-evaluation information according to the first information, the pre-evaluation termination condition being used to determine whether to continue or terminate the process of determining the evaluation value corresponding to the pre-evaluation information according to the first information, and the pre-evaluation maximum time length being used to determine whether to continue or terminate the process of determining the evaluation value corresponding to the pre-evaluation information according to the first information.

25. The apparatus of claim 23 or 24, wherein the communication unit is configured to determine the evaluation value corresponding to the pre-evaluation information according to the first information and a confidence level of the evaluation value.

26. The apparatus of claim 23, wherein, The first information further includes one or more of the following: network performance data information, a time at which the second operation takes effect, and information of an intention corresponding to a network KPI other than the network KPI.

27. The apparatus of claim 23, wherein, The network KPIs include one or more of the following: latency, throughput rate, speed, physical resource block (PRB) utilization, jitter, radio resource control (RRC) setup success rate, quality of service flow (QoS Flow) setup success rate, call setup success rate, radio call drop rate, intra-frequency handover success rate, inter-frequency handover success rate, central processing unit (CPU) utilization, cell availability, radio network availability, data service uplink traffic, data service downlink traffic, average user number, maximum user number, uplink interference noise, PSCell change success rate, protocol data unit (PDU) total packet number, PDU total data volume, coverage curve, reference signal received power (RSRP) average value, signal-to-interference-and-noise ratio (SINR) average value, base station energy efficiency value, and base station energy efficiency level.

28. The apparatus of claim 23, wherein, The mutual exclusion information includes mutual exclusion operation identification information or indication information indicating whether mutual exclusion exists.

29. An intent pre-evaluation device, characterized by The apparatus includes at least one processor and a communication interface, and the at least one processor is configured to invoke a computer program stored in at least one memory to enable the apparatus to implement the method of any one of claims 1-8.

30. An intent pre-evaluation device, characterized by The apparatus includes at least one processor and a communication interface, and the at least one processor is configured to invoke a computer program stored in at least one memory to enable the apparatus to implement the method of any one of claims 9-14.

31. A computer readable storage medium, characterized in that, The computer readable storage medium stores program instructions, and when the program instructions are executed on a processor, the method of any one of claims 1-14 is implemented.

32. A computer program product, characterised in that, When the computer program product is executed on a processor, the method of any one of claims 1-14 is implemented.

Images