Nwdaf network element service performance index obtaining method, device and system

Abstract

The present disclosure relates to a method, apparatus and system for obtaining a key performance indicator of a NWDAF network element service performance. The method comprises: obtaining performance measurement values of a plurality of network data analysis function (NWDAF) network elements in a network or a network slice; generating a key performance indicator of the plurality of NWDAF network elements in the corresponding network or network slice according to the performance measurement values of the plurality of NWDAF network elements, wherein the key performance indicator is used to evaluate the overall service of the NWDAF network elements in the network or network slice, and provide necessary information for resource optimization of the corresponding network or network slice; and reporting the key performance indicator externally. The present disclosure can determine a key performance indicator reflecting and evaluating the overall service of a plurality of NWDAFs in a network / network slice, and provide necessary information for resource optimization of the network / network slice.

Description

Technical Field

[0001] This disclosure relates to the field of wireless communication, and in particular to a method, apparatus and system for obtaining NWDAF network element service performance indicators. Background Technology

[0002] NWDAF (Network Data Analytics Function) is a network element in 5GC (5G core network). The architecture of NWDAF network elements supports the deployment of multiple NWDAF network elements in a single PLMN (Public Land Mobile Network).

[0003] Network slicing is one of the key features of 5G. It transforms a PLMN from a single network into a network with multiple logical partitions, using network isolation and specific resource configurations to meet different services (such as eMBB, URLLC, etc.). Based on service type, network slices can be divided into eMBB (Enhanced Mobile Broadband) slices, URLLC (Ultra-Reliable and Low-Latency Communication) slices, and mMTC (massive Machine Type Communication, i.e., large-scale Internet of Things) slices, etc. Summary of the Invention

[0004] The inventors discovered through research that in networks with multiple NWDAFs deployed, these technologies allow multiple NWDAFs to collaboratively provide services to consumers. With the further development of network intelligence, operators are increasingly focusing on the service carrying capacity and resource allocation methods of NWDAFs. For example, when the available resources of an NWDAF are insufficient to support the services requested / subscribed by consumers, it will affect the service performance of the NWDAF and the consumer experience.

[0005] In view of at least one of the above technical problems, this disclosure provides a method, apparatus and system for obtaining NWDAF network element service performance indicators, which determines key performance indicators that reflect and evaluate the overall service status of multiple NWDAFs in a network / network slice, and provides necessary information for network / network slice resource optimization.

[0006] According to one aspect of this disclosure, a method for obtaining network element service performance indicators for network data analysis functions is provided, including:

[0007] Obtain performance measurement values ​​of NWDAF network elements in a network or network slice for multiple network data analysis functions;

[0008] Based on the performance measurement values ​​of multiple NWDAF network elements, key performance indicators are generated for multiple NWDAF network elements in the corresponding network or network slice. The key performance indicators are used to evaluate the overall service status of NWDAF network elements in the network or network slice and provide the necessary information for resource optimization of the corresponding network or network slice.

[0009] The key performance indicators reported externally.

[0010] In some embodiments of this disclosure, the acquisition of performance measurement values ​​of multiple Network Data Analysis Function (NWDAF) network elements in a network or network slice includes:

[0011] Obtain performance measurement values ​​of multiple network data analysis (NWDAF) network elements in the network or network slice within a predetermined time interval.

[0012] In some embodiments of this disclosure, the performance measurement values ​​include at least one of the following: the maximum or average number of service requests or subscriptions received by each NWDAF network element associated with the corresponding network or network slice within a predetermined time interval; the maximum or average number of responses or notifications generated by each NWDAF network element; the maximum or average number of error responses or notifications generated by each NWDAF network element; and the maximum or average number of success responses or notifications generated by each NWDAF network element.

[0013] In some embodiments of this disclosure, the key performance indicators include at least one of the following: the maximum or average number of service requests or subscriptions received by multiple NWDAF network elements in the corresponding network or network slice within a predetermined time interval; the maximum or average number of responses or notifications generated by multiple NWDAF network elements; the maximum or average number of error responses or notifications generated by multiple NWDAF network elements; the maximum or average number of successful responses or notifications generated by multiple NWDAF network elements; the error response or notification ratio generated by multiple NWDAF network elements; and the successful response or notification ratio generated by multiple NWDAF network elements.

[0014] In some embodiments of this disclosure, generating key performance indicators for multiple NWDAF network elements in a corresponding network or network slice based on performance measurement values ​​of multiple NWDAF network elements includes:

[0015] The maximum number of service requests or subscriptions received by multiple NWDAF network elements in a network or network slice is determined by summing the maximum number of service requests or subscriptions received by each NWDAF network element associated with the corresponding network or network slice.

[0016] In some embodiments of this disclosure, generating key performance indicators for multiple NWDAF network elements in a corresponding network or network slice based on performance measurement values ​​of multiple NWDAF network elements includes:

[0017] The average number of service requests or subscriptions received by multiple NWDAF network elements in a network or network slice is determined by summing the average number of service requests or subscriptions received by each NWDAF network element associated with the corresponding network or network slice.

[0018] In some embodiments of this disclosure, generating key performance indicators for multiple NWDAF network elements in a corresponding network or network slice based on performance measurement values ​​of multiple NWDAF network elements includes:

[0019] The maximum number of responses or notifications generated by multiple NWDAF network elements in a network or network slice is determined by summing the maximum number of responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice.

[0020] In some embodiments of this disclosure, generating key performance indicators for multiple NWDAF network elements in a corresponding network or network slice based on performance measurement values ​​of multiple NWDAF network elements includes:

[0021] The average number of responses or notifications generated by multiple NWDAF network elements in a network or network slice is determined by summing the average number of responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice.

[0022] In some embodiments of this disclosure, generating key performance indicators for multiple NWDAF network elements in a corresponding network or network slice based on performance measurement values ​​of multiple NWDAF network elements includes:

[0023] The maximum number of error responses or notifications generated by multiple NWDAF network elements in a network or network slice is determined by summing the maximum number of error responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice.

[0024] In some embodiments of this disclosure, generating key performance indicators for multiple NWDAF network elements in a corresponding network or network slice based on performance measurement values ​​of multiple NWDAF network elements includes:

[0025] The average number of error responses or notifications generated by multiple NWDAF network elements in a network or network slice is determined by summing the average number of error responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice.

[0026] In some embodiments of this disclosure, generating key performance indicators for multiple NWDAF network elements in a corresponding network or network slice based on performance measurement values ​​of multiple NWDAF network elements includes:

[0027] The maximum number of successful responses or notifications generated by multiple NWDAF network elements in a network or network slice is determined by summing the maximum number of successful responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice.

[0028] In some embodiments of this disclosure, generating key performance indicators for multiple NWDAF network elements in a corresponding network or network slice based on performance measurement values ​​of multiple NWDAF network elements includes:

[0029] The average number of successful responses or notifications generated by multiple NWDAF network elements in a network or network slice is determined by summing the average number of successful responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice.

[0030] In some embodiments of this disclosure, generating key performance indicators for multiple NWDAF network elements in a corresponding network or network slice based on performance measurement values ​​of multiple NWDAF network elements includes:

[0031] The ratio of successful responses or notifications generated by multiple NWDAF network elements in a network or network slice is determined by comparing the average number of successful responses or notifications generated by multiple NWDAF network elements in the network or network slice with the average number of successful responses or notifications generated by multiple NWDAF network elements in the network or network slice.

[0032] In some embodiments of this disclosure, generating key performance indicators for multiple NWDAF network elements in a corresponding network or network slice based on performance measurement values ​​of multiple NWDAF network elements includes:

[0033] The ratio of error responses or notifications generated by multiple NWDAF network elements in a network or network slice is determined by comparing the average number of error responses or notifications generated by multiple NWDAF network elements in the network or network slice with the average number of responses or notifications generated by multiple NWDAF network elements in the network or network slice.

[0034] According to another aspect of this disclosure, a method for obtaining network element service performance indicators for network data analysis functions is provided, comprising:

[0035] The system receives reported key performance indicators, which are key performance indicators generated by the performance indicator producer device based on the performance measurement values ​​of multiple NWDAF network elements in the network or network slice. These key performance indicators are used to evaluate the overall service status of NWDAF network elements in the network or network slice and provide the necessary information for resource optimization of the corresponding network or network slice.

[0036] In some embodiments of this disclosure, the method further includes:

[0037] The overall service performance of NWDAF network elements in a network or network slice is evaluated based on the aforementioned key performance indicators, providing the necessary information for resource optimization of the corresponding network or network slice.

[0038] According to another aspect of this disclosure, a performance indicator producer apparatus is provided, comprising:

[0039] The performance measurement value acquisition module is configured to acquire the performance measurement values ​​of multiple network data analysis (NWDAF) network elements in a network or network slice.

[0040] The key performance indicator generation module is configured to generate key performance indicators for multiple NWDAF network elements in a corresponding network or network slice based on the performance measurement values ​​of multiple NWDAF network elements. The key performance indicators are used to evaluate the overall service status of NWDAF network elements in a network or network slice and provide the necessary information for resource optimization of the corresponding network or network slice.

[0041] The key performance indicator reporting module is configured to report the key performance indicators to external parties.

[0042] In some embodiments of this disclosure, the performance indicator producer device is configured to perform operations that implement the methods described in any of the above embodiments.

[0043] According to another aspect of this disclosure, a consumer device with performance indicators is provided, comprising:

[0044] The key performance indicator receiving module is configured to receive reported key performance indicators, wherein the key performance indicators are key performance indicators of multiple NWDAF network elements in the network or network slice generated by the performance indicator producer device based on the performance measurement values ​​of multiple NWDAF network elements in the network or network slice. The key performance indicators are used to evaluate the overall service status of NWDAF network elements in the network or network slice and provide the necessary information for resource optimization of the corresponding network or network slice.

[0045] In some embodiments of this disclosure, the performance-indicating consumer device further includes:

[0046] The service evaluation module is configured to evaluate the overall service status of NWDAF network elements in the network or network slice based on the key performance indicators, and provide the necessary information for resource optimization of the corresponding network or network slice.

[0047] According to another aspect of this disclosure, a network data analysis function network element service performance index acquisition system is provided, including a performance index producer device as described in any of the above embodiments and a performance index consumer device as described in any of the above embodiments.

[0048] According to another aspect of this disclosure, a computer apparatus is provided, comprising:

[0049] The memory is configured to store instructions;

[0050] A processor is configured to execute the instructions, causing the computer device to perform operations implementing the methods described in any of the above embodiments.

[0051] According to another aspect of this disclosure, a non-transitory computer-readable storage medium is provided, wherein the non-transitory computer-readable storage medium stores computer instructions that, when executed by a processor, implement the method as described in any of the above embodiments.

[0052] This disclosure can identify key performance indicators that reflect and evaluate the overall service status of multiple NWDAFs in a network / network slice, providing necessary information for network / network slice resource optimization. Attached Figure Description

[0053] To more clearly illustrate the technical solutions in the embodiments of this disclosure or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0054] Figure 1 These are schematic diagrams illustrating some embodiments of the method for obtaining network element service performance indicators for network data analysis functions disclosed herein.

[0055] Figure 2 These are schematic diagrams illustrating other embodiments of the method for obtaining network element service performance indicators for network data analysis functions disclosed herein.

[0056] Figure 3 These are schematic diagrams of some embodiments of the producer apparatus for the performance indicators of this disclosure.

[0057] Figure 4 This is a schematic diagram of some embodiments of the consumer device for which the performance indicators of this disclosure are presented.

[0058] Figure 5 These are schematic diagrams illustrating some embodiments of the network data analysis function network element service performance index acquisition system disclosed herein.

[0059] Figure 6 This is a schematic diagram of the structure of some embodiments of the computer device disclosed herein. Detailed Implementation

[0060] The technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this disclosure, and not all embodiments. The following description of at least one exemplary embodiment is merely illustrative and is in no way intended to limit this disclosure or its application or use. All other embodiments obtained by those skilled in the art based on the embodiments of this disclosure without creative effort are within the scope of protection of this disclosure.

[0061] Unless otherwise specifically stated, the relative arrangement, numerical expressions, and values ​​of the components and steps set forth in these embodiments do not limit the scope of this disclosure.

[0062] At the same time, it should be understood that, for ease of description, the dimensions of the various parts shown in the accompanying drawings are not drawn according to actual scale.

[0063] Techniques, methods, and equipment known to those skilled in the art may not be discussed in detail, but where appropriate, such techniques, methods, and equipment should be considered part of the specification.

[0064] In all examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not as limitations. Therefore, other examples of exemplary embodiments may have different values.

[0065] It should be noted that similar labels and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be discussed further in subsequent figures.

[0066] Figure 1 This diagram illustrates some embodiments of the method for obtaining network element service performance indicators for network data analysis functions disclosed herein. Preferably, this embodiment can be executed by the performance indicator producer device or the system for obtaining network element service performance indicators for network data analysis functions disclosed herein. The method may include at least one step from steps 11-13, wherein:

[0067] Step 11: Obtain performance measurement values ​​of multiple Network Data Analysis (NWDAF) network elements in the network or network slice.

[0068] In some embodiments of this disclosure, step 11 may include at least one of steps 111-113, wherein:

[0069] Step 111: Obtain the raw measurement values ​​of the network element in the Network Data Analysis Function (NWDAF).

[0070] In some embodiments of this disclosure, the original measurement value may be at least one of the following: a request or subscription received by the NWDAF network element, a response or notification generated by the NWDAF network element, an error response or notification generated by the NWDAF network element, and a success response or notification generated by the NWDAF network element.

[0071] In some embodiments of this disclosure, the request or subscription received by the NWDAF network element is the request or subscription issued by the NWDAF service consumer device to the NWDAF network element.

[0072] In some embodiments of this disclosure, the NWDAF service consumer device can be NFs, Afs, or OAM.

[0073] In some embodiments of this disclosure, the error response / notification generated by the NWDAF network element refers to the response / notification sent to the service consumer when the NWDAF network element is unable to fulfill the service request of the NWDAF service consumer device, such as a timeout error response / notification.

[0074] In some embodiments of this disclosure, the successful response / notification generated by the NWDAF network element refers to the response / notification sent by the NWDAF network element to the service consumer when it is able to satisfy the service request of the NWDAF service consumer device.

[0075] Step 112: Based on the original measurement values, generate performance measurement values ​​corresponding to at least one NWDAF network element, wherein the performance measurement values ​​are used for statistical analysis related to the performance of the NWDAF network element, to evaluate and optimize the service performance of the NWDAF network element.

[0076] In some embodiments of this disclosure, the performance measurement value may include at least one of the following: the number of requests or subscriptions received by the NWDAF network element, the number of responses or notifications generated by the NWDAF network element, the number of error responses or notifications generated by the NWDAF network element, and the number of successful responses or notifications generated by the NWDAF network element.

[0077] In some embodiments of this disclosure, the number of requests or subscriptions received by the NWDAF network element includes the value of a first cumulative counter, wherein the first cumulative counter is a cumulative counter related to the number of requests or subscriptions received by the NWDAF.

[0078] In some embodiments of this disclosure, step 12, the step of generating a performance measurement value corresponding to at least one NWDAF network element based on the original measurement value, may include: incrementing the value of a first cumulative counter by 1 when the NWDAF network element receives a request or subscription from an NWDAF service consumer device.

[0079] In some other embodiments of this disclosure, the number of responses or notifications generated by the NWDAF network element includes the value of a second cumulative counter, wherein the second cumulative counter is a cumulative counter related to the number of responses or notifications generated by the NWDAF.

[0080] In some embodiments of this disclosure, step 12, which involves generating a performance measurement value corresponding to at least one NWDAF network element based on the original measurement value, may include incrementing the value of a second cumulative counter by 1 when the NWDAF network element generates a response or notification.

[0081] In some other embodiments of this disclosure, the number of error responses or notifications generated by the NWDAF network element includes the value of a third cumulative counter, wherein the third cumulative counter is a cumulative counter related to the number of error responses or notifications generated by the NWDAF.

[0082] In some embodiments of this disclosure, step 12, which involves generating a performance measurement value corresponding to at least one NWDAF network element based on the original measurement value, may include incrementing the value of a third cumulative counter by 1 in the event that the NWDAF network element generates an error response or notification.

[0083] In some other embodiments of this disclosure, the number of successful responses or notifications generated by the NWDAF network element includes the value of a fourth cumulative counter, wherein the fourth cumulative counter is a cumulative counter related to the number of successful responses or notifications generated by the NWDAF.

[0084] In some embodiments of this disclosure, step 12, which involves generating a performance measurement value corresponding to at least one NWDAF network element based on the original measurement value, may include incrementing the value of a fourth cumulative counter by 1 if the NWDAF network element generates a successful response or notification.

[0085] In some embodiments of this disclosure, when the performance measurement is associated with specific information, the performance measurement value includes the value of a sub-cumulative counter associated with the specific information, wherein the specific information includes at least one of single network slice selection assistance information, analysis type, request type, subscription type, and analysis identifier.

[0086] In some embodiments of this disclosure, if the above performance measurement is related to S-NSSAI (Single Network Slice Selection Assistance Information), the above performance measurement may include the value of a sub-cumulative counter associated with S-NSSAI.

[0087] In some embodiments of this disclosure, if the performance measurement is for an Analytics ID, the performance measurement may include a sub-cumulative counter associated with the Analytics ID.

[0088] In some embodiments of this disclosure, when the specific information is an analysis type, a request type, or a subscription type, the value of the sub-cumulative counter associated with each performance measurement value includes the value of the sub-cumulative counter associated with an analysis service request, the value of the sub-cumulative counter associated with a data management service request, and the value of the sub-cumulative counter associated with a machine learning model service request.

[0089] In some embodiments of this disclosure, the NWDAF network element includes at least one of an analytical logic function (AnLF) and a model training logical function (MTLF), wherein NWDAF(AnLF) means that it only includes AnLF, NWDAF(MTLF) means that it only includes MTLF, and NWDAF means that it includes both AnLF and MTLF.

[0090] In some embodiments of this disclosure, the NWDAF network element can support at least one of the following services: analysis service, data management service, and machine learning model service. Different services correspond to different analysis types or request / subscription types.

[0091] In some embodiments of this disclosure, if the performance measurement is for an analytics type or a request / subscription type, the performance measurement may include the value of a sub-cumulative counter associated with each analytics type or request / subscription type, as follows:

[0092] 1. The value of the sub-cumulative counter related to the number of requests / subscriptions received by each NWDAF network element may include the value of the sub-cumulative counter associated with analysis service requests, the value of the sub-cumulative counter associated with data management service requests, and the value of the sub-cumulative counter associated with machine learning model service requests.

[0093] 2. The value of the sub-cumulative counter related to the number of responses / notifications generated by each NWDAF network element may include the value of the sub-cumulative counter associated with analysis service requests, the value of the sub-cumulative counter associated with data management service requests, and the value of the sub-cumulative counter associated with service requests from machine learning models.

[0094] 3. The value of the sub-cumulative counter related to the number of error responses / notifications generated by each NWDAF network element may include the value of the sub-cumulative counter associated with analysis service requests, the value of the sub-cumulative counter associated with data management service requests, and the value of the sub-cumulative counter associated with service requests from machine learning models.

[0095] 4. The value of the sub-cumulative counter related to the number of successful responses / notifications generated by each NWDAF network element may include the value of the sub-cumulative counter associated with the analysis service request, the value of the sub-cumulative counter associated with the data management service request, and the value of the sub-cumulative counter associated with the service request from the machine learning model.

[0096] Step 113: Obtain the performance measurement values ​​of multiple network data analysis (NWDAF) network elements in the network or network slice within a predetermined time interval.

[0097] In some embodiments of this disclosure, the performance measurement values ​​include at least one of the following: the maximum or average number of service requests or subscriptions received by each NWDAF network element associated with the corresponding network or network slice within a predetermined time interval; the maximum or average number of responses or notifications generated by each NWDAF network element; the maximum or average number of error responses or notifications generated by each NWDAF network element; and the maximum or average number of successful responses or notifications generated by each NWDAF network element.

[0098] In some embodiments of this disclosure, the maximum number of service requests / subscriptions received by each NWDAF network element associated with a network slice is represented as ReqSubNWDAFNbrMax.SNSSAI.

[0099] In some embodiments of this disclosure, the average number of service requests / subscriptions received by each NWDAF element associated with a network slice is denoted as ReqSubNWDAFNbrMean.SNSSAI.

[0100] In some embodiments of this disclosure, the maximum number of responses / notifications generated by each NWDAF network element associated with a network slice is represented as ResponseNotifyNWDAFNbrMax.SNSSAI.

[0101] In some embodiments of this disclosure, the average number of responses / notifications generated by each NWDAF element associated with a network slice is denoted as ResponseNotifyNWDAFNbrMean.SNSSAI.

[0102] In some embodiments of this disclosure, the maximum number of error responses / notifications generated per NWDAF element associated with a network slice is represented as ErrResponseNotifyNWDAFNbrMax.SNSSAI.

[0103] In some embodiments of this disclosure, the average number of error responses / notifications generated per NWDAF element associated with a network slice is denoted as ErrResponseNotifyNWDAFNbrMean.SNSSAI.

[0104] In some embodiments of this disclosure, the maximum number of successful responses / notifications generated per NWDAF element associated with a network slice is represented as SucResponseNotifyNWDAFNbrMax.SNSSAI.

[0105] In some embodiments of this disclosure, the average number of successful responses / notifications generated per NWDAF element associated with a network slice is denoted as SucResponseNotifyNWDAFNbrMean.SNSSAI.

[0106] Step 12: Based on the performance measurement values ​​of multiple NWDAF network elements, generate key performance indicators for multiple NWDAF network elements in the corresponding network or network slice. The key performance indicators are used to evaluate the overall service status of NWDAF network elements in the network or network slice and provide the necessary information for resource optimization of the corresponding network or network slice.

[0107] In some embodiments of this disclosure, the key performance indicators may include at least one of the following: the maximum or average number of service requests or subscriptions received by multiple NWDAF network elements in the corresponding network or network slice within a predetermined time interval; the maximum or average number of responses or notifications generated by multiple NWDAF network elements; the maximum or average number of error responses or notifications generated by multiple NWDAF network elements; the maximum or average number of successful responses or notifications generated by multiple NWDAF network elements; the error response or notification ratio generated by multiple NWDAF network elements; and the successful response or notification ratio generated by multiple NWDAF network elements.

[0108] In some embodiments of this disclosure, step 12, which involves generating key performance indicators for multiple NWDAF network elements in a corresponding network or network slice based on the performance measurement values ​​of multiple NWDAF network elements, may include: determining the maximum number of service requests or subscriptions received by multiple NWDAF network elements in a network or network slice based on the sum of the maximum number of service requests or subscriptions received by each NWDAF network element related to the corresponding network or network slice.

[0109] In some embodiments of this disclosure, step 12, which involves generating key performance indicators for multiple NWDAF network elements in a network or network slice based on the performance measurement values ​​of multiple NWDAF network elements, may include: determining the maximum number of service requests / subscriptions received by the NWDAF network elements in the network / network slice (NWDAFRegSubNbrMax) according to formula (1).

[0110] NWDAFRegSubNbrMax=∑ NWDAF ReqSubNbrNWDAFMax.SNSSAI (1)

[0111] In some embodiments of this disclosure, step 12, which involves generating key performance indicators for multiple NWDAF network elements in a corresponding network or network slice based on the performance measurement values ​​of multiple NWDAF network elements, may include: determining the average number of service requests or subscriptions received by multiple NWDAF network elements in a network or network slice based on the sum of the average number of service requests or subscriptions received by each NWDAF network element related to the corresponding network or network slice.

[0112] In some embodiments of this disclosure, step 12, which involves generating key performance indicators for multiple NWDAF network elements in a corresponding network or network slice based on the performance measurement values ​​of multiple NWDAF network elements, may include: determining the average number of service requests / subscriptions received by the NWDAF network elements in the network / network slice (NWDAFRegSubNbrMean) according to formula (2).

[0113] NWDAFRegSubNbrMean=∑ NWDAF ReqSubNbrNWDAFMean.SNSSAI (2)

[0114] In some embodiments of this disclosure, step 12, which involves generating key performance indicators for multiple NWDAF network elements in a corresponding network or network slice based on the performance measurement values ​​of multiple NWDAF network elements, may include: determining the maximum number of responses or notifications generated by multiple NWDAF network elements in a network or network slice based on the sum of the maximum number of responses or notifications generated by each NWDAF network element related to the corresponding network or network slice.

[0115] In some embodiments of this disclosure, step 12, which involves generating key performance indicators for multiple NWDAF network elements in a network or network slice based on the performance measurement values ​​of multiple NWDAF network elements, may include: determining the maximum number of responses / notifications generated by NWDAF network elements in the network / network slice (NWDAFResNotiNbrMax) according to formula (3).

[0116] NWDAFResNotiNbrMax=∑ NWDAF ResponseNotifyNWDAFNbrMax.SNSSAI (3)

[0117] In some embodiments of this disclosure, step 12, which involves generating key performance indicators for multiple NWDAF network elements in a corresponding network or network slice based on the performance measurement values ​​of multiple NWDAF network elements, may include: determining the average number of responses or notifications generated by multiple NWDAF network elements in a network or network slice based on the sum of the average number of responses or notifications generated by each NWDAF network element related to the corresponding network or network slice.

[0118] In some embodiments of this disclosure, step 12, which involves generating key performance indicators for multiple NWDAF network elements in a network or network slice based on the performance measurement values ​​of multiple NWDAF network elements, may include: determining the average number of responses / notifications generated by NWDAF network elements in the network / network slice (NWDAFResNotiNbrMean) according to formula (4).

[0119] WDAFResNotiNbrMean=∑ NWDAF ResponseNotifyNWDAFNbrMean.SNSSAI (4)

[0120] In some embodiments of this disclosure, step 12, which involves generating key performance indicators for multiple NWDAF network elements in a corresponding network or network slice based on the performance measurement values ​​of multiple NWDAF network elements, may include: determining the maximum number of error responses or notifications generated by multiple NWDAF network elements in a network or network slice based on the sum of the maximum number of error responses or notifications generated by each NWDAF network element related to the corresponding network or network slice.

[0121] In some embodiments of this disclosure, step 12, which involves generating key performance indicators for multiple NWDAF network elements in a network or network slice based on their performance measurements, may include: determining the maximum number of error responses / notifications generated by NWDAF network elements in the network / network slice (NWDAFErrResNotiNbrMax) according to formula (5).

[0122] NWDAFErrResNotiNbrMax=∑ NWDAF ErrResponseNotifyNWDAFNbrMax.SNSSAI (5)

[0123] In some embodiments of this disclosure, step 12, which involves generating key performance indicators for multiple NWDAF network elements in a corresponding network or network slice based on the performance measurement values ​​of multiple NWDAF network elements, may include: determining the average number of error responses or notifications generated by multiple NWDAF network elements in a network or network slice based on the sum of the average number of error responses or notifications generated by each NWDAF network element related to the corresponding network or network slice.

[0124] In some embodiments of this disclosure, step 12, which involves generating key performance indicators for multiple NWDAF network elements in a network or network slice based on the performance measurement values ​​of multiple NWDAF network elements, may include: determining the average number of error responses / notifications generated by NWDAF network elements in the network / network slice (NWDAFErrResNotiNbrMean) according to formula (6).

[0125] NWDAFErrResNotiNbrMean=∑ NWDAF ErrResponseNotifyNWDAFNbrMean.SNSSAI(6)

[0126] In some embodiments of this disclosure, step 12, which involves generating key performance indicators for multiple NWDAF network elements in a corresponding network or network slice based on the performance measurement values ​​of multiple NWDAF network elements, may include: determining the maximum number of successful responses or notifications generated by multiple NWDAF network elements in a network or network slice based on the sum of the maximum number of successful responses or notifications generated by each NWDAF network element related to the corresponding network or network slice.

[0127] In some embodiments of this disclosure, step 12, which involves generating key performance indicators for multiple NWDAF network elements in a corresponding network or network slice based on the performance measurement values ​​of multiple NWDAF network elements, may include: determining the maximum number of successful responses / notifications generated by NWDAF network elements in the network / network slice (NWDAFSucResNotiNbrMax) according to formula (7).

[0128] NWDAFSucResNotiNbrMax=∑ NWDAF SucResponseNotifyNWDAFNbrMax.SNSSAI (7)

[0129] In some embodiments of this disclosure, step 12, which involves generating key performance indicators for multiple NWDAF network elements in a corresponding network or network slice based on the performance measurement values ​​of multiple NWDAF network elements, may include: determining the average number of successful responses or notifications generated by multiple NWDAF network elements in a network or network slice based on the sum of the average number of successful responses or notifications generated by each NWDAF network element related to the corresponding network or network slice.

[0130] In some embodiments of this disclosure, step 12, which involves generating key performance indicators for multiple NWDAF network elements in a corresponding network or network slice based on the performance measurement values ​​of multiple NWDAF network elements, may include: determining the average number of successful responses / notifications generated by NWDAF network elements in the network / network slice (NWDAFSucResNotiNbrMean) according to formula (8).

[0131] NWDAFSucResNotiNbrMean=∑ NWDAF SucResponseNotifyNWDAFNbrMean.SNSSAI(8)

[0132] In some embodiments of this disclosure, step 12, the step of generating key performance indicators for multiple NWDAF network elements in a network or network slice based on the performance measurement values ​​of multiple NWDAF network elements, may include: determining the ratio of error responses or notifications generated by multiple NWDAF network elements in a network or network slice based on the ratio of the average number of error responses or notifications generated by multiple NWDAF network elements in a network or network slice to the average number of responses or notifications generated by multiple NWDAF network elements in a network or network slice.

[0133] In some embodiments of this disclosure, step 12, which involves generating key performance indicators for multiple NWDAF network elements in a network or network slice based on the performance measurement values ​​of multiple NWDAF network elements, may include: determining the ratio of error responses / notifications generated by NWDAF in the network / network slice (NWDAF rrResNotiNRate) according to formula (9).

[0134]

[0135] In some embodiments of this disclosure, step 12, the step of generating key performance indicators for multiple NWDAF network elements in a network or network slice based on the performance measurement values ​​of multiple NWDAF network elements, may include: determining the ratio of successful responses or notifications generated by multiple NWDAF network elements in a network or network slice based on the ratio of the average number of successful responses or notifications generated by multiple NWDAF network elements in a network or network slice to the average number of responses or notifications generated by multiple NWDAF network elements in a network or network slice.

[0136] In some embodiments of this disclosure, step 12, which involves generating key performance indicators for multiple NWDAF network elements in a corresponding network or network slice based on the performance measurement values ​​of multiple NWDAF network elements, may include: determining the ratio of successful responses / notifications generated by NWDAF in the network / network slice (NWDAFucResNotiNRate) according to formula (10).

[0137]

[0138] Step 13: Report the aforementioned key performance indicators to external parties.

[0139] In some embodiments of this disclosure, step 13 may include: reporting the key performance indicators to a performance indicator consumer device in order to evaluate the overall service status of NWDAF network elements in a network or network slice based on the key performance indicators, and to provide the necessary information for resource optimization of the corresponding network or network slice.

[0140] In some embodiments of this disclosure, the step of evaluating the overall service performance of NWDAF network elements in a network or network slice may include: determining whether a key performance indicator (e.g., the success rate of responses or notifications generated by multiple NWDAF network elements in a corresponding network or network slice within a predetermined time interval) is greater than a first predetermined rate; if the key performance indicator is greater than the first predetermined rate, then the overall service performance of the NWDAF network elements in the network or network slice is determined to be excellent; if the difference between the performance measurement value and the predetermined performance threshold is not greater than the first predetermined rate, then the overall service performance of the NWDAF network elements in the network or network slice is determined to be poor.

[0141] In some other embodiments of this disclosure, the step of evaluating the overall service performance of NWDAF network elements in a network or network slice may include: determining whether a key performance indicator (e.g., the error response or notification ratio generated by multiple NWDAF network elements in a corresponding network or network slice within a predetermined time interval) is less than a second predetermined ratio; if the key performance indicator is less than the second predetermined ratio, then the overall service performance of the NWDAF network elements in the network or network slice is determined to be excellent; if the difference between the performance measurement value and the predetermined performance threshold is not less than the second predetermined ratio, then the overall service performance of the NWDAF network elements in the network or network slice is determined to be poor.

[0142] The inventors discovered through research that there is no method in related technologies for obtaining key performance indicators for NWDAF interaction.

[0143] In order to evaluate the overall service performance of NWDAF in a network / network slice, the above embodiments of this disclosure introduce a method for obtaining key performance indicators of NWDAF. These key performance indicators can be used to reflect the service status (such as the carrying status) of NWDAF in a network / network slice. Based on these performance indicators, it can be further determined whether the resources of the network / network slice need to be optimized, thereby mitigating or preventing the service performance problems of NWDAF in the corresponding network / network slice.

[0144] The embodiments of this disclosure monitor and process the performance measurement of each NWDAF in the network / network slice, calculate the performance measurement value of each NWDAF within a predefined interval, and generate key performance indicators of NWDAF in the network / network slice within the predefined interval.

[0145] The embodiments of this disclosure generate key performance indicators for NWDAFs in a network / network slice based on performance measurements from multiple NWDAFs. These key performance indicators include, within a predefined interval, the maximum / average number of service requests / subscriptions received by multiple NWDAFs in the network or network slice, the maximum / average number of responses / notifications generated by multiple NWDAFs, the maximum / average number of error responses / notifications generated by multiple NWDAFs, the maximum / average number of successful responses / notifications generated by multiple NWDAFs, the error response / notification ratio generated by multiple NWDAFs, and the successful response / notification ratio generated by multiple NWDAFs.

[0146] In some embodiments of this disclosure, step 13 may further include: reporting the performance measurement value to the performance metrics consumer device so that the performance metrics consumer device can perform statistical analysis related to the performance of the NWDAF network element based on the performance measurement value, and evaluate and optimize the service performance of the NWDAF network element.

[0147] In some embodiments of this disclosure, the step of evaluating the service performance of an NWDAF network element may include: determining whether the difference between a performance measurement value (e.g., the number of requests or subscriptions received by the NWDAF network element) and a predetermined performance threshold (the maximum number of requests or subscriptions that the NWDAF network element can receive) is greater than a predetermined value; if the difference between the performance measurement value and the predetermined performance threshold is greater than the predetermined value, then the service performance of the NWDAF network element is determined to be excellent; if the difference between the performance measurement value and the predetermined performance threshold is not greater than the predetermined value, then the service performance of the NWDAF network element is determined to be poor.

[0148] The method for obtaining network element service performance indicators based on the above embodiments of this disclosure may include a method for generating performance measurement values ​​for NWDAF network element interaction.

[0149] In order to detect and prevent technical problems in related technologies, the above embodiments of this disclosure can realize performance measurement (data). The NWDAF performance measurement values ​​of the above embodiments of this disclosure can be used for statistical analysis related to NWDAF performance, thereby evaluating and optimizing the service performance of NWDAF, detecting potential NWDAF service performance problems in advance, and taking appropriate actions (such as resource allocation, task scheduling, etc.) to prevent or mitigate these problems.

[0150] The purpose of the above embodiments of this disclosure is to propose a method for generating performance measurements of NWDAF interaction, monitoring and processing the raw measurements of NWDAF, and generating performance measurements of NWDAF based on the raw measurements. These performance measurements can be used for statistical analysis related to NWDAF performance, thereby evaluating and optimizing the service performance of NWDAF.

[0151] Figure 2 This is a schematic diagram of some other embodiments of the method for obtaining network element service performance indicators for the network data analysis function disclosed herein. Preferably, this embodiment can be executed by a consumer device for performance indicators or a system for obtaining network element service performance indicators for the network data analysis function disclosed herein. The method may include at least one step in step 21-step 22, wherein:

[0152] Step 21: Receive the reported key performance indicators, wherein the key performance indicators are key performance indicators of multiple NWDAF network elements in the network or network slice generated by the performance indicator producer device based on the performance measurement values ​​of multiple NWDAF network elements in the network or network slice. The key performance indicators are used to evaluate the overall service status of NWDAF network elements in the network or network slice and provide the necessary information for resource optimization of the corresponding network or network slice.

[0153] In some embodiments of this disclosure, step 21 may include: receiving key performance indicators reported by the performance indicator producer device.

[0154] Step 22: Evaluate the overall service status of NWDAF network elements in the network or network slice based on the key performance indicators, and provide the necessary information for resource optimization of the corresponding network or network slice.

[0155] In some embodiments of this disclosure, the step of evaluating the overall service performance of NWDAF network elements in a network or network slice may include: determining whether a key performance indicator (e.g., the success rate of responses or notifications generated by multiple NWDAF network elements in a corresponding network or network slice within a predetermined time interval) is greater than a first predetermined rate; if the key performance indicator is greater than the first predetermined rate, then the overall service performance of the NWDAF network elements in the network or network slice is determined to be excellent; if the difference between the performance measurement value and the predetermined performance threshold is not greater than the first predetermined rate, then the overall service performance of the NWDAF network elements in the network or network slice is determined to be poor.

[0156] In some other embodiments of this disclosure, the step of evaluating the overall service performance of NWDAF network elements in a network or network slice may include: determining whether a key performance indicator (e.g., the error response or notification ratio generated by multiple NWDAF network elements in a corresponding network or network slice within a predetermined time interval) is less than a second predetermined ratio; if the key performance indicator is less than the second predetermined ratio, then the overall service performance of the NWDAF network elements in the network or network slice is determined to be excellent; if the difference between the performance measurement value and the predetermined performance threshold is not less than the second predetermined ratio, then the overall service performance of the NWDAF network elements in the network or network slice is determined to be poor.

[0157] In order to detect and prevent technical problems in related technologies, the above embodiments of this disclosure can realize the acquisition of key performance indicators of NWDAF based on multiple NWDAF deployment scenarios. These key performance indicators can be used to reflect and evaluate the overall service status of multiple NWDAFs in a network / network slice, and provide direction for optimizing the service performance of multiple NWDAFs.

[0158] The purpose of the above embodiments of this disclosure is to propose a method for obtaining key performance indicators for NWDAF interaction, which monitors and processes performance measurements of NWDAF interaction within a predefined interval, calculates the performance measurements, and generates key performance indicators for multiple NWDAFs in a corresponding network / network slice. These key performance indicators are used to reflect and evaluate the overall service status (e.g., bearer status) of multiple NWDAFs in a corresponding network / network slice, providing necessary information for network / network slice resource optimization.

[0159] Figure 3 These are schematic diagrams illustrating some embodiments of the producer apparatus for the performance indicators of this disclosure. For example... Figure 3 As shown, the performance indicator producer device disclosed herein may include a performance measurement value acquisition module 31, a key performance indicator generation module 32, and a key performance indicator reporting module 33, wherein:

[0160] The performance measurement value acquisition module 31 is configured to acquire the performance measurement values ​​of multiple network data analysis function (NWDAF) network elements in the network or network slice.

[0161] In some embodiments of this disclosure, the performance measurement value acquisition module 31 can be configured to acquire performance measurement values ​​of multiple Network Data Analysis Function (NWDAF) network elements in a network or network slice within a predetermined time interval.

[0162] In some embodiments of this disclosure, the performance measurement values ​​include at least one of the following: the maximum or average number of service requests or subscriptions received by each NWDAF network element associated with the corresponding network or network slice within a predetermined time interval; the maximum or average number of responses or notifications generated by each NWDAF network element; the maximum or average number of error responses or notifications generated by each NWDAF network element; and the maximum or average number of success responses or notifications generated by each NWDAF network element.

[0163] The key performance indicator generation module 32 is configured to generate key performance indicators for multiple NWDAF network elements in a corresponding network or network slice based on the performance measurement values ​​of multiple NWDAF network elements. The key performance indicators are used to evaluate the overall service status of NWDAF network elements in the network or network slice and provide the necessary information for resource optimization of the corresponding network or network slice.

[0164] In some embodiments of this disclosure, the key performance indicators include at least one of the following: the maximum or average number of service requests or subscriptions received by multiple NWDAF network elements in the corresponding network or network slice within a predetermined time interval; the maximum or average number of responses or notifications generated by multiple NWDAF network elements; the maximum or average number of error responses or notifications generated by multiple NWDAF network elements; the maximum or average number of successful responses or notifications generated by multiple NWDAF network elements; the error response or notification ratio generated by multiple NWDAF network elements; and the successful response or notification ratio generated by multiple NWDAF network elements.

[0165] In some embodiments of this disclosure, the key performance indicator generation module 32 can be configured to determine the maximum number of service requests or subscriptions received by multiple NWDAF network elements in a network or network slice based on the sum of the maximum number of service requests or subscriptions received by each NWDAF network element associated with the corresponding network or network slice.

[0166] In some embodiments of this disclosure, the key performance indicator generation module 32 can be configured to determine the average number of service requests or subscriptions received by multiple NWDAF network elements in a network or network slice based on the sum of the average number of service requests or subscriptions received by each NWDAF network element associated with the corresponding network or network slice.

[0167] In some embodiments of this disclosure, the key performance indicator generation module 32 can be configured to determine the maximum number of responses or notifications generated by multiple NWDAF network elements in a network or network slice based on the sum of the maximum number of responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice.

[0168] In some embodiments of this disclosure, the key performance indicator generation module 32 can be configured to determine the average number of responses or notifications generated by multiple NWDAF network elements in a network or network slice based on the sum of the average number of responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice.

[0169] In some embodiments of this disclosure, the key performance indicator generation module 32 can be configured to determine the maximum number of error responses or notifications generated by multiple NWDAF network elements in a network or network slice based on the sum of the maximum number of error responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice.

[0170] In some embodiments of this disclosure, the key performance indicator generation module 32 can be configured to determine the average number of error responses or notifications generated by multiple NWDAF network elements in a network or network slice based on the sum of the average number of error responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice.

[0171] In some embodiments of this disclosure, the key performance indicator generation module 32 can be configured to determine the maximum number of successful responses or notifications generated by multiple NWDAF network elements in a network or network slice based on the sum of the maximum number of successful responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice.

[0172] In some embodiments of this disclosure, the key performance indicator generation module 32 can be configured to determine the average number of successful responses or notifications generated by multiple NWDAF network elements in a network or network slice based on the sum of the average number of successful responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice.

[0173] In some embodiments of this disclosure, the key performance indicator generation module 32 can be configured to determine the ratio of successful responses or notifications generated by multiple NWDAF network elements in a network or network slice based on the ratio of the average number of successful responses or notifications generated by multiple NWDAF network elements in a network or network slice to the average number of responses or notifications generated by multiple NWDAF network elements in a network or network slice.

[0174] In some embodiments of this disclosure, the key performance indicator generation module 32 can be configured to determine the ratio of error responses or notifications generated by multiple NWDAF network elements in a network or network slice based on the ratio of the average number of error responses or notifications generated by multiple NWDAF network elements in a network or network slice to the average number of responses or notifications generated by multiple NWDAF network elements in a network or network slice.

[0175] The key performance indicator reporting module 33 is configured to report the key performance indicators to external parties.

[0176] In some embodiments of this disclosure, the key performance indicator reporting module 33 may be configured to report the key performance indicators to the performance indicator consumer device so as to evaluate the overall service status of NWDAF network elements in the network or network slice based on the key performance indicators and provide the necessary information for resource optimization of the corresponding network or network slice.

[0177] In some embodiments of this disclosure, the performance indicator producer device is configured to perform implementations as described in any of the embodiments above (e.g., Figure 1 The operation of the method described in the embodiment)

[0178] The embodiments of this disclosure can generate key performance indicators of NWDAFs in a network / network slice based on the performance measurements of multiple NWDAFs. The generated key performance indicators include the maximum / average number of service requests / subscriptions received by multiple NWDAFs in the network / network slice within a predefined interval, the maximum / average number of responses / notifications generated by multiple NWDAFs, the maximum / average number of error responses / notifications generated by multiple NWDAFs, the maximum / average number of successful responses / notifications generated by multiple NWDAFs, the error response / notification ratio generated by multiple NWDAFs, and the successful response / notification ratio generated by multiple NWDAFs.

[0179] The key performance indicators generated by the above embodiments of this disclosure can be used to reflect and evaluate the overall service status (such as the carrying capacity) of NWDAF in the network / network slice. Based on these performance indicators, it can be further determined whether the resources of the network slice need to be optimized, thereby mitigating or preventing NWDAF service performance problems in the corresponding network slice.

[0180] Figure 4This is a schematic diagram illustrating some embodiments of the consumer device for which the performance metrics of this disclosure exist. For example... Figure 4 As shown, the consumer device for performance indicators disclosed herein may include a key performance indicator receiving module 41 and a service evaluation module 42, wherein:

[0181] The key performance indicator receiving module 41 is configured to receive reported key performance indicators, wherein the key performance indicators are key performance indicators of multiple NWDAF network elements in the network or network slice generated by the performance indicator producer device based on the performance measurement values ​​of multiple NWDAF network elements in the network or network slice. The key performance indicators are used to evaluate the overall service status of NWDAF network elements in the network or network slice and provide the necessary information for resource optimization of the corresponding network or network slice.

[0182] In some embodiments of this disclosure, the key performance indicator receiving module 41 can be configured to receive key performance indicators reported by the performance indicator producer device.

[0183] The service evaluation module 42 is configured to evaluate the overall service status of NWDAF network elements in the network or network slice based on the key performance indicators, and provide the necessary information for resource optimization of the corresponding network or network slice.

[0184] The above embodiments of this disclosure propose a performance index consumer device that can receive NWDAF key performance indicators generated by a performance index producer device. The NWDAF key performance indicators can be used to reflect and evaluate the overall service status (such as the carrying capacity) of NWDAF in a network / network slice. Based on the performance indicators, it can be further determined whether the resources of the network / network slice need to be optimized, thereby mitigating or preventing NWDAF service performance problems in the corresponding network / network slice.

[0185] According to another aspect of this disclosure, a network data analysis function network element service performance index acquisition system is provided, including a performance index producer device as described in any of the above embodiments and a performance index consumer device as described in any of the above embodiments.

[0186] Figure 5 These are schematic diagrams illustrating some embodiments of the network element service performance index acquisition system for network data analysis functions disclosed herein. For example... Figure 5 As shown, the network data analysis function network element service performance index acquisition system disclosed herein may include a performance index producer device 51 and a performance index consumer device 52, wherein:

[0187] The performance metric producer device 51 is configured to acquire performance measurement values ​​of multiple Network Data Analysis Function (NWDAF) network elements 50 in a network or network slice; generate key performance metrics for the corresponding NWDAF network elements based on the performance measurement values ​​of the multiple NWDAF network elements, wherein the key performance metrics are used to evaluate the overall service status of the NWDAF network elements in the network or network slice and provide the necessary information for resource optimization of the corresponding network or network slice; and report the key performance metrics to the performance metric consumer device 52.

[0188] In some embodiments of this disclosure, the performance indicator producer device 51 may be as described in any of the embodiments above (e.g., Figure 3 The performance index producer device described in the embodiment)

[0189] In some embodiments of this disclosure, the performance index producer device 51 may be located in other network elements besides the performance index consumer device 52 and the NWDAF network element 50.

[0190] The performance metrics consumer device 52 is configured to receive key performance metrics reported by the performance metrics producer device; evaluate the overall service status of NWDAF network elements in the network or network slice based on the key performance metrics, and provide the necessary information for resource optimization of the corresponding network or network slice.

[0191] In some embodiments of this disclosure, the performance indicator consumer device 52 can be as described in any of the embodiments above (e.g., Figure 4 The performance indicators of the consumer device described in the embodiment)

[0192] The above embodiments of this disclosure propose a system for obtaining key performance indicators of NWDAF, which can generate key performance indicators of NWDAF in a network / network slice within a predefined interval based on the performance measurement values ​​of NWDAF.

[0193] The key performance indicators of NWDAF generated in the above embodiments of this disclosure can be used to reflect and evaluate the overall service status (such as the carrying capacity) of NWDAF in a network / network slice. Based on these performance indicators, it can be further determined whether the resources of the network / network slice need to be optimized, thereby mitigating or preventing NWDAF service performance problems in the corresponding network / network slice.

[0194] The above embodiments of this disclosure propose a system for generating key performance indicators of NWDAF based on NWDAF performance measurement, including monitoring and processing the performance measurement of each NWDAF in a network / network slice within a predefined interval, and calculating the performance measurement value of each NWDAF to generate key performance indicators of NWDAF in the network / network slice within the predefined interval.

[0195] The key performance indicators generated in the above embodiments of this disclosure include the maximum / average number of service requests / subscriptions received by multiple NWDAFs in the network or network slice within a predefined interval, the maximum / average number of responses / notifications generated by multiple NWDAFs, the maximum / average number of error responses / notifications generated by multiple NWDAFs, the maximum / average number of successful responses / notifications generated by multiple NWDAFs, the error response / notification ratio generated by multiple NWDAFs, and the successful response / notification ratio generated by multiple NWDAFs.

[0196] Figure 6 This is a schematic diagram illustrating the structure of some embodiments of the computer device disclosed herein. For example... Figure 6 As shown, the computer device includes a memory 61 and a processor 62.

[0197] Memory 61 is used to store instructions, and processor 62 is coupled to memory 61. Processor 62 is configured to execute instructions stored in memory to implement the above embodiments (e.g., Figure 1 or Figure 2 The method involved in the embodiment).

[0198] In some embodiments of this disclosure, the processor 62 executes Figure 1 In the case of the embodiments, the computer device of this disclosure can be implemented as a consumer device with performance indicators of this disclosure.

[0199] In other embodiments of this disclosure, the processor 62 executes Figure 2 In the case of the embodiments, the computer device of this disclosure can be implemented as a performance indicator producer device of this disclosure.

[0200] like Figure 6 As shown, the computer device also includes a communication interface 63 for exchanging information with other devices. Additionally, the computer device includes a bus 64, through which the processor 62, communication interface 63, and memory 61 communicate with each other.

[0201] Memory 61 may include high-speed RAM, and may also include non-volatile memory, such as at least one disk drive. Memory 61 may also be a memory array. Memory 61 may also be divided into blocks, and the blocks may be combined into virtual volumes according to certain rules.

[0202] Furthermore, processor 62 may be a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement embodiments of the present disclosure.

[0203] The embodiments disclosed above can monitor and process the performance measurements of each NWDAF in a network / network slice within a predefined interval, and calculate the performance measurement value of each NWDAF to generate key performance indicators of NWDAF in the network / network slice within the predefined interval.

[0204] The key performance indicators generated by the above embodiments of this disclosure include the maximum / average number of service requests / subscriptions received by multiple NWDAFs in the network or network slice within a predefined interval, the maximum / average number of responses / notifications generated by multiple NWDAFs, the maximum / average number of error responses / notifications generated by multiple NWDAFs, the maximum / average number of successful responses / notifications generated by multiple NWDAFs, the error response / notification ratio generated by multiple NWDAFs, and the successful response / notification ratio generated by multiple NWDAFs.

[0205] The key performance indicators of NWDAF generated in the above embodiments of this disclosure can be used to reflect and evaluate the overall service status (such as the carrying capacity) of NWDAF in a network / network slice. Based on these performance indicators, it can be further determined whether the resources of the network / network slice need to be optimized, thereby mitigating or preventing NWDAF service performance problems in the corresponding network / network slice.

[0206] The embodiments described above can be applied to the 5G field.

[0207] According to another aspect of this disclosure, a non-transitory computer-readable storage medium is provided, wherein the non-transitory computer-readable storage medium stores computer instructions that, when executed by a processor, implement any of the embodiments described above (e.g., Figure 1 or Figure 2 The method described in the example.

[0208] Those skilled in the art will understand that embodiments of this disclosure can be provided as methods, apparatus, or computer program products. Therefore, this disclosure can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this disclosure can take the form of a computer program product embodied on one or more computer-usable non-transitory storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0209] This disclosure is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this disclosure. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create a machine for implementing the flowchart illustrations. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0210] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0211] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0212] The performance indicator producer device and performance indicator consumer device described above can be implemented as a general-purpose processor, programmable logic controller (PLC), digital signal processor (DSP), application-specific integrated circuit (ASIC), field-programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware component or any suitable combination thereof for performing the functions described herein.

[0213] This concludes the detailed description of the present disclosure. To avoid obscuring the concept of the disclosure, some details known in the art have not been described. Those skilled in the art will fully understand how to implement the technical solutions disclosed herein based on the above description.

[0214] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware, or by a program instructing the relevant hardware to implement them. The program can be stored in a non-transitory computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.

[0215] The description in this disclosure is provided for illustrative and descriptive purposes only and is not intended to be exhaustive or to limit the disclosure to its forms. Many modifications and variations will be apparent to those skilled in the art. The embodiments were chosen and described in order to better illustrate the principles and practical application of this disclosure and to enable those skilled in the art to understand this disclosure and to design various embodiments with various modifications suitable for a particular purpose.

Claims

1. A method for obtaining performance indicators of network element services for network data analysis functions, characterized in that, include: Obtain performance measurement values ​​of multiple Network Data Analysis Function (NWDAF) network elements in a network or network slice, wherein the performance measurement values ​​include the maximum or average number of service requests or subscriptions received by each NWDAF network element associated with the corresponding network or network slice within a predetermined time interval. Based on the performance measurement values ​​of multiple NWDAF network elements, key performance indicators are generated for multiple NWDAF network elements in the corresponding network or network slice. The key performance indicators are used to evaluate the overall service status of NWDAF network elements in the network or network slice and provide the necessary information for resource optimization of the corresponding network or network slice. The key performance indicators include the maximum or average number of service requests or subscriptions received by multiple NWDAF network elements in the corresponding network or network slice within a predetermined time interval. Key performance indicators reported externally; The step of generating key performance indicators for multiple NWDAF network elements in a corresponding network or network slice based on the performance measurement values ​​of multiple NWDAF network elements includes: The maximum number of service requests or subscriptions received by multiple NWDAF network elements in a network or network slice is determined based on the sum of the maximum number of service requests or subscriptions received by each NWDAF network element associated with the corresponding network or network slice. And / or, The average number of service requests or subscriptions received by multiple NWDAF network elements in a network or network slice is determined by summing the average number of service requests or subscriptions received by each NWDAF network element associated with the corresponding network or network slice.

2. The method according to claim 1, characterized in that, The performance measurement values ​​of the NWDAF network element, which acquires multiple network data analysis functions in a network or network slice, include: Obtain performance measurement values ​​of multiple network data analysis (NWDAF) network elements in the network or network slice within a predetermined time interval.

3. A method for obtaining performance indicators of network element services in network data analysis, characterized in that, include: Obtain performance measurement values ​​of multiple Network Data Analysis Function (NWDAF) network elements in a network or network slice, wherein the performance measurement values ​​include the maximum or average number of responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice within a predetermined time interval. Based on the performance measurements of multiple NWDAF network elements, key performance indicators are generated for multiple NWDAF network elements in the corresponding network or network slice. The key performance indicators are used to evaluate the overall service status of NWDAF network elements in the network or network slice and provide the necessary information for resource optimization of the corresponding network or network slice. The key performance indicators include the maximum or average number of responses or notifications generated by multiple NWDAF network elements in the corresponding network or network slice within a predetermined time interval. Key performance indicators reported externally; The step of generating key performance indicators for multiple NWDAF network elements in a corresponding network or network slice based on the performance measurement values ​​of multiple NWDAF network elements includes: The maximum number of responses or notifications generated by multiple NWDAF network elements in a network or network slice is determined by summing the maximum number of responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice. And / or, The average number of responses or notifications generated by multiple NWDAF network elements in a network or network slice is determined by summing the average number of responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice.

4. A method for obtaining performance indicators of network element services for network data analysis functions, characterized in that, include: Obtain performance measurement values ​​of multiple Network Data Analysis Function (NWDAF) network elements in a network or network slice, wherein the performance measurement values ​​include the maximum or average number of error responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice within a predetermined time interval; Based on the performance measurements of multiple NWDAF network elements, key performance indicators are generated for multiple NWDAF network elements in the corresponding network or network slice. The key performance indicators are used to evaluate the overall service status of NWDAF network elements in the network or network slice and provide the necessary information for resource optimization of the corresponding network or network slice. The key performance indicators include the maximum or average number of error responses or notifications generated by multiple NWDAF network elements in the corresponding network or network slice within a predetermined time interval. Key performance indicators reported externally; The step of generating key performance indicators for multiple NWDAF network elements in a corresponding network or network slice based on the performance measurement values ​​of multiple NWDAF network elements includes: The maximum number of error responses or notifications generated by multiple NWDAF network elements in a network or network slice is determined based on the sum of the maximum number of error responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice. And / or, The average number of error responses or notifications generated by multiple NWDAF network elements in a network or network slice is determined by summing the average number of error responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice.

5. A method for obtaining performance indicators of network element services for network data analysis functions, characterized in that, include: Obtain performance measurement values ​​of multiple Network Data Analysis Function (NWDAF) network elements in a network or network slice, wherein the performance measurement values ​​include the maximum or average number of successful responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice within a predetermined time interval. Based on the performance measurements of multiple NWDAF network elements, key performance indicators are generated for multiple NWDAF network elements in the corresponding network or network slice. The key performance indicators are used to evaluate the overall service status of NWDAF network elements in the network or network slice and provide the necessary information for resource optimization of the corresponding network or network slice. The key performance indicators include the maximum or average number of successful responses or notifications generated by multiple NWDAF network elements in the corresponding network or network slice within a predetermined time interval. Key performance indicators reported externally; The step of generating key performance indicators for multiple NWDAF network elements in a corresponding network or network slice based on the performance measurement values ​​of multiple NWDAF network elements includes: The maximum number of successful responses or notifications generated by multiple NWDAF network elements in a network or network slice is determined by summing the maximum number of successful responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice. And / or, The average number of successful responses or notifications generated by multiple NWDAF network elements in a network or network slice is determined by summing the average number of successful responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice.

6. A method for obtaining performance indicators of network element services for network data analysis functions, characterized in that, include: Obtain performance measurement values ​​of multiple Network Data Analysis Function (NWDAF) network elements in a network or network slice, wherein the performance measurement values ​​include at least one of the following within a predetermined time interval: the maximum or average number of responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice, the maximum or average number of error responses or notifications generated by each NWDAF network element, and the maximum or average number of success responses or notifications generated by each NWDAF network element. Based on the performance measurements of multiple NWDAF network elements, key performance indicators are generated for multiple NWDAF network elements in the corresponding network or network slice. The key performance indicators are used to evaluate the overall service status of NWDAF network elements in the network or network slice and provide the necessary information for resource optimization of the corresponding network or network slice. The key performance indicators include at least one of the following: the error response or notification ratio generated by multiple NWDAF network elements in the corresponding network or network slice within a predetermined time interval, and the successful response or notification ratio generated by multiple NWDAF network elements. Key performance indicators reported externally; The step of generating key performance indicators for multiple NWDAF network elements in a corresponding network or network slice based on the performance measurement values ​​of multiple NWDAF network elements includes: The ratio of successful responses or notifications generated by multiple NWDAF network elements in a network or network slice is determined by comparing the average number of successful responses or notifications generated by multiple NWDAF network elements in the network or network slice with the average number of successful responses or notifications generated by multiple NWDAF network elements in the network or network slice. And / or, The ratio of error responses or notifications generated by multiple NWDAF network elements in a network or network slice is determined by comparing the average number of error responses or notifications generated by multiple NWDAF network elements in the network or network slice with the average number of responses or notifications generated by multiple NWDAF network elements in the network or network slice.

7. A method for obtaining performance indicators of network element services for network data analysis functions, characterized in that, include: The system receives reported key performance indicators (KPIs), which are generated by the performance indicator producer device based on performance measurements of multiple Network Data Analysis Function (NWDAF) network elements within a network or network slice. These KPIs are used to evaluate the overall service performance of the NWDAF network elements in the network or network slice, providing necessary information for resource optimization of the corresponding network or network slice. The performance measurements include the maximum or average number of service requests or subscriptions received by each NWDAF network element associated with the corresponding network or network slice within a predetermined time interval. The KPIs include... Within a predetermined time interval, the maximum or average number of service requests or subscriptions received by multiple NWDAF network elements in a corresponding network or network slice. The maximum number of service requests or subscriptions received by multiple NWDAF network elements in a network or network slice is determined by the performance index producer device based on the sum of the maximum number of service requests or subscriptions received by each NWDAF network element associated with the corresponding network or network slice. The average number of service requests or subscriptions received by multiple NWDAF network elements in a network or network slice is determined by the performance index producer device based on the sum of the average number of service requests or subscriptions received by each NWDAF network element associated with the corresponding network or network slice.

8. The method according to claim 7, characterized in that, Also includes: The overall service performance of NWDAF network elements in a network or network slice is evaluated based on the aforementioned key performance indicators, providing the necessary information for resource optimization of the corresponding network or network slice.

9. A method for obtaining performance indicators of network element services for network data analysis functions, characterized in that, include: The system receives reported key performance indicators (KPIs), which are generated by the performance indicator producer device based on performance measurements of multiple Network Data Analysis Function (NWDAF) network elements within a network or network slice. These KPIs are used to evaluate the overall service performance of the NWDAF network elements in the network or network slice, providing necessary information for resource optimization of the corresponding network or network slice. The performance measurements include the maximum or average number of responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice within a predetermined time interval. The metrics include the maximum or average number of responses or notifications generated by multiple NWDAF network elements in a corresponding network or network slice within a predetermined time interval. The maximum number of responses or notifications generated by multiple NWDAF network elements in a network or network slice is determined by the performance metric producer device based on the sum of the maximum number of responses or notifications generated by each NWDAF network element related to the corresponding network or network slice. The average number of responses or notifications generated by multiple NWDAF network elements in a network or network slice is determined by the performance metric producer device based on the sum of the average number of responses or notifications generated by each NWDAF network element related to the corresponding network or network slice.

10. A method for obtaining performance indicators of network element services for network data analysis functions, characterized in that, include: The system receives reported key performance indicators (KPIs), which are generated by the performance indicator producer device based on performance measurements of multiple Network Data Analysis Function (NWDAF) network elements within a network or network slice. These KPIs are used to evaluate the overall service performance of the NWDAF network elements in the network or network slice, providing necessary information for resource optimization of the corresponding network or network slice. The performance measurements include the maximum or average number of error responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice within a predetermined time interval. The KPIs include... Within a predetermined time interval, the maximum or average number of error responses or notifications generated by multiple NWDAF network elements in a corresponding network or network slice. The maximum number of error responses or notifications generated by multiple NWDAF network elements in a network or network slice is determined by the performance indicator producer device based on the sum of the maximum number of error responses or notifications generated by each NWDAF network element related to the corresponding network or network slice. The average number of error responses or notifications generated by multiple NWDAF network elements in a network or network slice is determined by the performance indicator producer device based on the sum of the average number of error responses or notifications generated by each NWDAF network element related to the corresponding network or network slice.

11. A method for obtaining performance indicators of network element services for network data analysis functions, characterized in that, include: The system receives reported key performance indicators (KPIs), which are generated by the performance indicator producer device based on performance measurements of multiple Network Data Analysis Function (NWDAF) network elements within a network or network slice. These KPIs are used to evaluate the overall service performance of the NWDAF network elements in the network or network slice, providing necessary information for resource optimization of the corresponding network or network slice. The performance measurements include the maximum or average number of successful responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice within a predetermined time interval. The KPIs include... Within a predetermined time interval, the maximum or average number of successful responses or notifications generated by multiple NWDAF network elements in a corresponding network or network slice. The maximum number of successful responses or notifications generated by multiple NWDAF network elements in a network or network slice is determined by the performance index producer device based on the sum of the maximum number of successful responses or notifications generated by each NWDAF network element related to the corresponding network or network slice. The average number of successful responses or notifications generated by multiple NWDAF network elements in a network or network slice is determined by the performance index producer device based on the sum of the average number of successful responses or notifications generated by each NWDAF network element related to the corresponding network or network slice.

12. A method for obtaining performance indicators of network element services for network data analysis functions, characterized in that, include: The system receives reported key performance indicators (KPIs), which are generated by the performance indicator producer device based on performance measurements of multiple Network Data Analysis Function (NWDAF) network elements within a network or network slice. These KPIs are used to evaluate the overall service performance of the NWDAF network elements in the network or network slice, providing necessary information for resource optimization of the corresponding network or network slice. The performance measurements include at least one of the following within a predetermined time interval: the maximum or average number of responses or notifications generated by each NWDAF network element related to the corresponding network or network slice; the maximum or average number of error responses or notifications generated by each NWDAF network element; and the maximum or average number of successful responses or notifications generated by each NWDAF network element. The KPIs include the performance metrics generated within the predetermined time interval. Within a segment, the ratio of error responses or notifications generated by multiple NWDAF network elements in the corresponding network or network slice, and the ratio of successful responses or notifications generated by multiple NWDAF network elements, are at least one of the following: the ratio of successful responses or notifications generated by multiple NWDAF network elements in the network or network slice is determined by the performance indicator producer device based on the ratio of the average number of successful responses or notifications generated by multiple NWDAF network elements in the network or network slice to the average number of responses or notifications generated by multiple NWDAF network elements in the network or network slice. The ratio of error responses or notifications generated by multiple NWDAF network elements in the network or network slice is determined by the performance indicator producer device based on the ratio of the average number of error responses or notifications generated by multiple NWDAF network elements in the network or network slice to the average number of responses or notifications generated by multiple NWDAF network elements in the network or network slice.

13. A performance index producer device, characterized in that, include: The performance measurement value acquisition module is configured to acquire the performance measurement values ​​of multiple Network Data Analysis Function (NWDAF) network elements in a network or network slice, wherein the performance measurement values ​​include the maximum or average number of service requests or subscriptions received by each NWDAF network element associated with the corresponding network or network slice within a predetermined time interval. A key performance indicator (KPI) generation module is configured to generate KPIs for multiple NWDAF network elements in a corresponding network or network slice based on performance measurement values ​​of multiple NWDAF network elements. These KPIs are used to evaluate the overall service performance of the NWDAF network elements in the network or network slice, providing necessary information for resource optimization of the corresponding network or network slice. The KPIs include the maximum or average number of service requests or subscriptions received by the multiple NWDAF network elements in the corresponding network or network slice within a predetermined time interval. Generating KPIs for the multiple NWDAF network elements in the corresponding network or network slice based on performance measurement values ​​includes: determining the maximum number of service requests or subscriptions received by the multiple NWDAF network elements in the network or network slice based on the sum of the maximum number of service requests or subscriptions received by each NWDAF network element related to the corresponding network or network slice; and / or, determining the average number of service requests or subscriptions received by the multiple NWDAF network elements in the network or network slice based on the sum of the average number of service requests or subscriptions received by each NWDAF network element related to the corresponding network or network slice. The key performance indicator reporting module is configured to report the key performance indicators to external parties.

14. A performance index producer device, characterized in that, include: The performance measurement value acquisition module is configured to acquire the performance measurement values ​​of multiple Network Data Analysis Function (NWDAF) network elements in a network or network slice, wherein the performance measurement values ​​include the maximum or average number of responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice within a predetermined time interval. A key performance indicator (KPI) generation module is configured to generate KPIs for multiple NWDAF network elements in a corresponding network or network slice based on performance measurement values ​​of multiple NWDAF network elements. The KPIs are used to evaluate the overall service performance of the NWDAF network elements in the network or network slice, providing necessary information for resource optimization of the corresponding network or network slice. The KPIs include the maximum or average number of responses or notifications generated by the multiple NWDAF network elements in the corresponding network or network slice within a predetermined time interval. Generating KPIs for the multiple NWDAF network elements in the corresponding network or network slice based on performance measurement values ​​includes: determining the maximum number of responses or notifications generated by the multiple NWDAF network elements in the network or network slice based on the sum of the maximum number of responses or notifications generated by each NWDAF network element related to the corresponding network or network slice; and / or, determining the average number of responses or notifications generated by the multiple NWDAF network elements in the network or network slice based on the sum of the average number of responses or notifications generated by each NWDAF network element related to the corresponding network or network slice. The key performance indicator reporting module is configured to report the key performance indicators to external parties.

15. A performance index producer device, characterized in that, include: The performance measurement value acquisition module is configured to acquire the performance measurement values ​​of multiple Network Data Analysis Function (NWDAF) network elements in a network or network slice, wherein the performance measurement values ​​include the maximum or average number of error responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice within a predetermined time interval. A key performance indicator (KPI) generation module is configured to generate KPIs for multiple NWDAF network elements in a corresponding network or network slice based on performance measurement values ​​of multiple NWDAF network elements. These KPIs are used to evaluate the overall service performance of the NWDAF network elements in the network or network slice, providing necessary information for resource optimization of the corresponding network or network slice. The KPIs include the maximum or average number of error responses or notifications generated by the multiple NWDAF network elements in the corresponding network or network slice within a predetermined time interval. Generating KPIs for the multiple NWDAF network elements in the corresponding network or network slice based on performance measurement values ​​includes: determining the maximum number of error responses or notifications generated by the multiple NWDAF network elements in the network or network slice based on the sum of the maximum number of error responses or notifications generated by each NWDAF network element related to the corresponding network or network slice; and / or, determining the average number of error responses or notifications generated by the multiple NWDAF network elements in the network or network slice based on the sum of the average number of error responses or notifications generated by each NWDAF network element related to the corresponding network or network slice. The key performance indicator reporting module is configured to report the key performance indicators to external parties.

16. A performance index producer device, characterized in that, include: The performance measurement value acquisition module is configured to acquire the performance measurement values ​​of multiple Network Data Analysis Function (NWDAF) network elements in a network or network slice, wherein the performance measurement values ​​include the maximum or average number of successful responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice within a predetermined time interval. A key performance indicator (KPI) generation module is configured to generate KPIs for multiple NWDAF network elements in a corresponding network or network slice based on performance measurement values ​​of multiple NWDAF network elements. These KPIs are used to evaluate the overall service performance of the NWDAF network elements in the network or network slice, providing necessary information for resource optimization of the corresponding network or network slice. The KPIs include the maximum or average number of successful responses or notifications generated by the multiple NWDAF network elements in the corresponding network or network slice within a predetermined time interval. Generating KPIs for the multiple NWDAF network elements in the corresponding network or network slice based on performance measurement values ​​includes: determining the maximum number of successful responses or notifications generated by the multiple NWDAF network elements in the network or network slice based on the sum of the maximum number of successful responses or notifications generated by each NWDAF network element related to the corresponding network or network slice; and / or, determining the average number of successful responses or notifications generated by the multiple NWDAF network elements in the network or network slice based on the sum of the average number of successful responses or notifications generated by each NWDAF network element related to the corresponding network or network slice. The key performance indicator reporting module is configured to report the key performance indicators to external parties.

17. A performance index producer device, characterized in that, include: The performance measurement value acquisition module is configured to acquire performance measurement values ​​of multiple Network Data Analysis Function (NWDAF) network elements in a network or network slice. The performance measurement values ​​include at least one of the following within a predetermined time interval: the maximum or average number of responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice, the maximum or average number of error responses or notifications generated by each NWDAF network element, and the maximum or average number of success responses or notifications generated by each NWDAF network element. A key performance indicator (KPI) generation module is configured to generate KPIs for multiple NWDAF network elements in a corresponding network or network slice based on performance measurements of multiple NWDAF network elements. These KPIs are used to evaluate the overall service performance of the NWDAF network elements in the network or network slice, providing necessary information for resource optimization of the corresponding network or network slice. The KPIs include at least one of the following: the error response or notification ratio generated by multiple NWDAF network elements in the corresponding network or network slice within a predetermined time interval; and the successful response or notification ratio generated by multiple NWDAF network elements. The generation of KPIs for the corresponding network or network slice is described in detail below. Key performance indicators for multiple NWDAF network elements in a network slice include: determining the ratio of successful responses or notifications generated by multiple NWDAF network elements in a network or network slice based on the average number of successful responses or notifications generated by multiple NWDAF network elements in a network or network slice to the average number of responses or notifications generated by multiple NWDAF network elements in a network or network slice; and / or determining the ratio of error responses or notifications generated by multiple NWDAF network elements in a network or network slice based on the average number of error responses or notifications generated by multiple NWDAF network elements in a network or network slice to the average number of responses or notifications generated by multiple NWDAF network elements in a network or network slice. The key performance indicator reporting module is configured to report the key performance indicators to external parties.

18. A consumer device with performance indicators, characterized in that, include: A key performance indicator (KPI) receiving module is configured to receive reported key performance indicators (KPIs). These KPIs are generated by a performance indicator producer device based on performance measurements of multiple Network Data Analysis Function (NWDAF) network elements within a network or network slice. These KPIs are used to evaluate the overall service performance of the NWDAF network elements in the network or network slice, providing necessary information for resource optimization of the corresponding network or network slice. The performance measurements include the maximum or average number of service requests or subscriptions received by each NWDAF network element associated with the corresponding network or network slice within a predetermined time interval. Key performance indicators include the maximum or average number of service requests or subscriptions received by multiple NWDAF network elements in a corresponding network or network slice within a predetermined time interval. The maximum number of service requests or subscriptions received by multiple NWDAF network elements in a network or network slice is determined by the performance indicator producer device based on the sum of the maximum number of service requests or subscriptions received by each NWDAF network element related to the corresponding network or network slice. The average number of service requests or subscriptions received by multiple NWDAF network elements in a network or network slice is determined by the performance indicator producer device based on the sum of the average number of service requests or subscriptions received by each NWDAF network element related to the corresponding network or network slice.

19. The consumer device with performance indicators according to claim 18, characterized in that, Also includes: The service evaluation module is configured to evaluate the overall service status of NWDAF network elements in the network or network slice based on the key performance indicators, and provide the necessary information for resource optimization of the corresponding network or network slice.

20. A consumer device with performance indicators, characterized in that, include: The key performance indicator (KPI) receiving module is configured to receive reported key performance indicators (KPIs). These KPIs are generated by the performance indicator producer device based on performance measurements of multiple Network Data Analysis Function (NWDAF) network elements within a network or network slice. These KPIs are used to evaluate the overall service performance of the NWDAF network elements in the network or network slice, providing necessary information for resource optimization of the corresponding network or network slice. The performance measurements include the maximum or average number of responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice within a predetermined time interval. The key performance indicator includes the maximum or average number of responses or notifications generated by multiple NWDAF network elements in a corresponding network or network slice within a predetermined time interval. The maximum number of responses or notifications generated by multiple NWDAF network elements in a network or network slice is determined by the performance indicator producer device based on the sum of the maximum number of responses or notifications generated by each NWDAF network element related to the corresponding network or network slice. The average number of responses or notifications generated by multiple NWDAF network elements in a network or network slice is determined by the performance indicator producer device based on the sum of the average number of responses or notifications generated by each NWDAF network element related to the corresponding network or network slice.

21. A consumer device with performance indicators, characterized in that, include: A key performance indicator (KPI) receiving module is configured to receive reported key performance indicators (KPIs). These KPIs are generated by the performance indicator producer device based on performance measurements of multiple Network Data Analysis Function (NWDAF) network elements within a network or network slice. These KPIs are used to evaluate the overall service performance of the NWDAF network elements in the network or network slice, providing necessary information for resource optimization of the corresponding network or network slice. The performance measurements include the maximum or average number of error responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice within a predetermined time interval. Key performance indicators include the maximum or average number of error responses or notifications generated by multiple NWDAF network elements in a corresponding network or network slice within a predetermined time interval. The maximum number of error responses or notifications generated by multiple NWDAF network elements in a network or network slice is determined by the performance indicator producer device based on the sum of the maximum number of error responses or notifications generated by each NWDAF network element related to the corresponding network or network slice. The average number of error responses or notifications generated by multiple NWDAF network elements in a network or network slice is determined by the performance indicator producer device based on the sum of the average number of error responses or notifications generated by each NWDAF network element related to the corresponding network or network slice.

22. A consumer device with performance indicators, characterized in that, include: A key performance indicator (KPI) receiving module is configured to receive reported key performance indicators (KPIs). These KPIs are generated by the performance indicator producer device based on performance measurements of multiple Network Data Analysis Function (NWDAF) network elements within a network or network slice. The KPIs are used to evaluate the overall service performance of the NWDAF network elements in the network or network slice, providing necessary information for resource optimization of the corresponding network or network slice. The performance measurements include the maximum or average number of successful responses or notifications generated by each NWDAF network element associated with the corresponding network or network slice within a predetermined time interval. Key performance indicators include the maximum or average number of successful responses or notifications generated by multiple NWDAF network elements in a corresponding network or network slice within a predetermined time interval. The maximum number of successful responses or notifications generated by multiple NWDAF network elements in a network or network slice is determined by the performance indicator producer device based on the sum of the maximum number of successful responses or notifications generated by each NWDAF network element related to the corresponding network or network slice. The average number of successful responses or notifications generated by multiple NWDAF network elements in a network or network slice is determined by the performance indicator producer device based on the sum of the average number of successful responses or notifications generated by each NWDAF network element related to the corresponding network or network slice.

23. A consumer device with performance indicators, characterized in that, include: A key performance indicator (KPI) receiving module is configured to receive reported key performance indicators (KPIs). These KPIs are generated by a performance indicator producer device based on performance measurements of multiple Network Data Analysis Function (NWDAF) network elements within a network or network slice. The KPIs are used to evaluate the overall service performance of the NWDAF network elements in the network or network slice, providing necessary information for resource optimization of the corresponding network or network slice. The performance measurements include at least one of the following within a predetermined time interval: the maximum or average number of responses or notifications generated by each NWDAF network element related to the corresponding network or network slice; the maximum or average number of error responses or notifications generated by each NWDAF network element; and the maximum or average number of successful responses or notifications generated by each NWDAF network element. The indicator includes at least one of the following within a predetermined time interval: the error response or notification ratio generated by multiple NWDAF network elements in a corresponding network or network slice, and the successful response or notification ratio generated by multiple NWDAF network elements. The successful response or notification ratio generated by multiple NWDAF network elements in the network or network slice is determined by the performance indicator producer device based on the ratio of the average number of successful responses or notifications generated by multiple NWDAF network elements in the network or network slice to the average number of responses or notifications generated by multiple NWDAF network elements in the network or network slice. The error response or notification ratio generated by multiple NWDAF network elements in the network or network slice is determined by the performance indicator producer device based on the ratio of the average number of error responses or notifications generated by multiple NWDAF network elements in the network or network slice to the average number of responses or notifications generated by multiple NWDAF network elements in the network or network slice.

24. A system for obtaining network element service performance indicators for network data analysis functions, characterized in that, Includes a performance indicator producer device as claimed in any one of claims 13 to 17 and a performance indicator consumer device as claimed in any one of claims 18 to 23.

25. A computer device, characterized in that, include: The memory is configured to store instructions; A processor is configured to execute the instructions, causing the computer device to perform operations that implement the method as described in any one of claims 1-12.

26. A non-transitory computer-readable storage medium, characterized in that, The non-transitory computer-readable storage medium stores computer instructions that, when executed by a processor, implement the method as described in any one of claims 1-12.

Images